2026-02-24T08:58:55.166 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T08:58:55.184 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T08:58:55.314 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081 branch: wip-vshankar-testing-20260223.155722 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/iogen}} email: vshankar@redhat.com first_in_suite: false flavor: default job_id: '67081' kernel: client: sha1: distro sha1: 8dec4b357aab872d3b63ec979924962a64be83dd ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20260223.155722 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true global: ms die on skipped message: false mds: mds_export_ephemeral_random_max: 0.2 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - slow metadata IO - SLOW_OPS - slow request sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20260223.155722 sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b owner: scheduled_vshankar@soko04.front.sepia.ceph.com priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2406 sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b sleep_before_teardown: 0 subset: 283/1024 suite: fs suite_branch: wip-vshankar-testing-20260223.155722 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_5bc9a1ffc19df681248ece8c3c8c7191a571745b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial004.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDJsAWo6+3ngTBqCvHraALNQ6nNxDVQv5t6gUbNd+iU0UWX5yx9NBaYfhytv1DmhWg87KIyTtdkyr3DP7CLsrJ4= trial014.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBXlfVm5Ay/p/rif7TboSRZy+lnTDBd2ht6KLnsKgOgQlvHOkGvmcuDLVihwgXrRFLIUtkG0e5n9ZNxW2fWljxA= trial090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH54uW00KseFLVUb1lGq8NdCGGXaDC/kkIrvdIcuhQH1D+oKEV1ff6WGlxFKsu85D++8LzX+7cEmxLLIzVUr8S8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.20 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - quiescer: null - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-24_05:06:44 tube: trial user: vshankar verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T08:58:55.314 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_5bc9a1ffc19df681248ece8c3c8c7191a571745b/qa; will attempt to use it 2026-02-24T08:58:55.315 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_5bc9a1ffc19df681248ece8c3c8c7191a571745b/qa/tasks 2026-02-24T08:58:55.315 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-24T08:58:55.316 INFO:teuthology.task.internal:Checking packages... 2026-02-24T08:58:55.316 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5bc9a1ffc19df681248ece8c3c8c7191a571745b' 2026-02-24T08:58:55.317 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-24T08:58:55.317 INFO:teuthology.packaging:ref: None 2026-02-24T08:58:55.317 INFO:teuthology.packaging:tag: None 2026-02-24T08:58:55.317 INFO:teuthology.packaging:branch: wip-vshankar-testing-20260223.155722 2026-02-24T08:58:55.317 INFO:teuthology.packaging:sha1: 5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T08:58:55.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20260223.155722 2026-02-24T08:58:55.445 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5537.g5bc9a1ff 2026-02-24T08:58:55.447 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-24T08:58:55.459 INFO:teuthology.task.internal:no buildpackages task found 2026-02-24T08:58:55.459 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T08:58:55.473 INFO:teuthology.task.internal:Saving configuration 2026-02-24T08:58:55.494 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T08:58:55.507 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T08:58:55.586 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial004.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 08:55:26.733937', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDJsAWo6+3ngTBqCvHraALNQ6nNxDVQv5t6gUbNd+iU0UWX5yx9NBaYfhytv1DmhWg87KIyTtdkyr3DP7CLsrJ4='} 2026-02-24T08:58:55.643 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial014.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 08:55:26.732939', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBXlfVm5Ay/p/rif7TboSRZy+lnTDBd2ht6KLnsKgOgQlvHOkGvmcuDLVihwgXrRFLIUtkG0e5n9ZNxW2fWljxA='} 2026-02-24T08:58:55.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial090.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 08:55:26.733542', 'locked_by': 'scheduled_vshankar@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH54uW00KseFLVUb1lGq8NdCGGXaDC/kkIrvdIcuhQH1D+oKEV1ff6WGlxFKsu85D++8LzX+7cEmxLLIzVUr8S8='} 2026-02-24T08:58:55.699 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T08:58:55.711 INFO:teuthology.task.internal:roles: ubuntu@trial004.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-24T08:58:55.711 INFO:teuthology.task.internal:roles: ubuntu@trial014.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-24T08:58:55.711 INFO:teuthology.task.internal:roles: ubuntu@trial090.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-24T08:58:55.711 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T08:58:55.906 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x770179b4a7a0>, signals=[15]) 2026-02-24T08:58:55.906 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T08:58:55.918 INFO:teuthology.task.internal:Opening connections... 2026-02-24T08:58:55.918 DEBUG:teuthology.task.internal:connecting to ubuntu@trial004.front.sepia.ceph.com 2026-02-24T08:58:55.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T08:58:55.979 DEBUG:teuthology.task.internal:connecting to ubuntu@trial014.front.sepia.ceph.com 2026-02-24T08:58:55.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T08:58:56.039 DEBUG:teuthology.task.internal:connecting to ubuntu@trial090.front.sepia.ceph.com 2026-02-24T08:58:56.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T08:58:56.098 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T08:58:56.110 DEBUG:teuthology.orchestra.run.trial004:> uname -m 2026-02-24T08:58:56.126 INFO:teuthology.orchestra.run.trial004.stdout:x86_64 2026-02-24T08:58:56.126 DEBUG:teuthology.orchestra.run.trial004:> cat /etc/os-release 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:NAME="CentOS Stream" 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:VERSION="9" 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:ID="centos" 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:ID_LIKE="rhel fedora" 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:VERSION_ID="9" 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:PLATFORM_ID="platform:el9" 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:ANSI_COLOR="0;31" 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:LOGO="fedora-logo-icon" 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T08:58:56.182 INFO:teuthology.orchestra.run.trial004.stdout:HOME_URL="https://centos.org/" 2026-02-24T08:58:56.183 INFO:teuthology.orchestra.run.trial004.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T08:58:56.183 INFO:teuthology.orchestra.run.trial004.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T08:58:56.183 INFO:teuthology.orchestra.run.trial004.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T08:58:56.183 INFO:teuthology.lock.ops:Updating trial004.front.sepia.ceph.com on lock server 2026-02-24T08:58:56.256 DEBUG:teuthology.orchestra.run.trial014:> uname -m 2026-02-24T08:58:56.271 INFO:teuthology.orchestra.run.trial014.stdout:x86_64 2026-02-24T08:58:56.271 DEBUG:teuthology.orchestra.run.trial014:> cat /etc/os-release 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:NAME="CentOS Stream" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:VERSION="9" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:ID="centos" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:ID_LIKE="rhel fedora" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:VERSION_ID="9" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:PLATFORM_ID="platform:el9" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:ANSI_COLOR="0;31" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:LOGO="fedora-logo-icon" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:HOME_URL="https://centos.org/" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T08:58:56.327 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T08:58:56.328 INFO:teuthology.lock.ops:Updating trial014.front.sepia.ceph.com on lock server 2026-02-24T08:58:56.404 DEBUG:teuthology.orchestra.run.trial090:> uname -m 2026-02-24T08:58:56.419 INFO:teuthology.orchestra.run.trial090.stdout:x86_64 2026-02-24T08:58:56.419 DEBUG:teuthology.orchestra.run.trial090:> cat /etc/os-release 2026-02-24T08:58:56.474 INFO:teuthology.orchestra.run.trial090.stdout:NAME="CentOS Stream" 2026-02-24T08:58:56.474 INFO:teuthology.orchestra.run.trial090.stdout:VERSION="9" 2026-02-24T08:58:56.474 INFO:teuthology.orchestra.run.trial090.stdout:ID="centos" 2026-02-24T08:58:56.474 INFO:teuthology.orchestra.run.trial090.stdout:ID_LIKE="rhel fedora" 2026-02-24T08:58:56.474 INFO:teuthology.orchestra.run.trial090.stdout:VERSION_ID="9" 2026-02-24T08:58:56.475 INFO:teuthology.orchestra.run.trial090.stdout:PLATFORM_ID="platform:el9" 2026-02-24T08:58:56.475 INFO:teuthology.orchestra.run.trial090.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T08:58:56.475 INFO:teuthology.orchestra.run.trial090.stdout:ANSI_COLOR="0;31" 2026-02-24T08:58:56.475 INFO:teuthology.orchestra.run.trial090.stdout:LOGO="fedora-logo-icon" 2026-02-24T08:58:56.475 INFO:teuthology.orchestra.run.trial090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T08:58:56.475 INFO:teuthology.orchestra.run.trial090.stdout:HOME_URL="https://centos.org/" 2026-02-24T08:58:56.475 INFO:teuthology.orchestra.run.trial090.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T08:58:56.475 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T08:58:56.475 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T08:58:56.475 INFO:teuthology.lock.ops:Updating trial090.front.sepia.ceph.com on lock server 2026-02-24T08:58:56.552 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T08:58:56.569 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T08:58:56.581 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T08:58:56.581 DEBUG:teuthology.orchestra.run.trial004:> test '!' -e /home/ubuntu/cephtest 2026-02-24T08:58:56.582 DEBUG:teuthology.orchestra.run.trial014:> test '!' -e /home/ubuntu/cephtest 2026-02-24T08:58:56.584 DEBUG:teuthology.orchestra.run.trial090:> test '!' -e /home/ubuntu/cephtest 2026-02-24T08:58:56.599 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T08:58:56.610 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T08:58:56.611 DEBUG:teuthology.orchestra.run.trial004:> test -z $(ls -A /var/lib/ceph) 2026-02-24T08:58:56.638 DEBUG:teuthology.orchestra.run.trial014:> test -z $(ls -A /var/lib/ceph) 2026-02-24T08:58:56.640 DEBUG:teuthology.orchestra.run.trial090:> test -z $(ls -A /var/lib/ceph) 2026-02-24T08:58:56.655 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T08:58:56.854 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T08:58:56.873 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'sha1': '8dec4b357aab872d3b63ec979924962a64be83dd'} 2026-02-24T08:58:56.874 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2026-02-24T08:58:56.874 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2026-02-24T08:58:56.874 DEBUG:teuthology.orchestra.run.trial004:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T08:58:56.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T08:58:56.889 DEBUG:teuthology.orchestra.run.trial004:> uname -r 2026-02-24T08:58:56.945 INFO:teuthology.orchestra.run.trial004.stdout:5.14.0-681.el9.x86_64 2026-02-24T08:58:56.945 INFO:teuthology.task.kernel:Running kernel on trial004: 5.14.0-681.el9.x86_64 2026-02-24T08:58:56.945 DEBUG:teuthology.orchestra.run.trial004:> sudo yum install -y kernel 2026-02-24T08:58:58.394 INFO:teuthology.orchestra.run.trial004.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.9 MB 00:01 2026-02-24T08:59:00.985 INFO:teuthology.orchestra.run.trial004.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-24T08:59:04.302 INFO:teuthology.orchestra.run.trial004.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 8.0 MB 00:00 2026-02-24T08:59:06.432 INFO:teuthology.orchestra.run.trial004.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 20 kB 00:01 2026-02-24T08:59:07.659 INFO:teuthology.orchestra.run.trial004.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-24T08:59:10.909 INFO:teuthology.orchestra.run.trial004.stdout:lab-extras 1.5 MB/s | 50 kB 00:00 2026-02-24T08:59:11.922 INFO:teuthology.orchestra.run.trial004.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T08:59:11.922 INFO:teuthology.orchestra.run.trial004.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T08:59:11.942 INFO:teuthology.orchestra.run.trial004.stdout:Dependencies resolved. 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout:================================================================================ 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout: Package Architecture Version Repository Size 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout:================================================================================ 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout:Installing: 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout:Installing dependencies: 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout:Transaction Summary 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout:================================================================================ 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout:Install 4 Packages 2026-02-24T08:59:11.943 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T08:59:11.944 INFO:teuthology.orchestra.run.trial004.stdout:Total download size: 89 M 2026-02-24T08:59:11.944 INFO:teuthology.orchestra.run.trial004.stdout:Installed size: 135 M 2026-02-24T08:59:11.944 INFO:teuthology.orchestra.run.trial004.stdout:Downloading Packages: 2026-02-24T08:59:12.450 INFO:teuthology.orchestra.run.trial004.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 4.4 MB/s | 901 kB 00:00 2026-02-24T08:59:12.607 INFO:teuthology.orchestra.run.trial004.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 48 MB/s | 17 MB 00:00 2026-02-24T08:59:12.779 INFO:teuthology.orchestra.run.trial004.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 94 MB/s | 31 MB 00:00 2026-02-24T08:59:12.837 INFO:teuthology.orchestra.run.trial004.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 68 MB/s | 40 MB 00:00 2026-02-24T08:59:12.838 INFO:teuthology.orchestra.run.trial004.stdout:-------------------------------------------------------------------------------- 2026-02-24T08:59:12.838 INFO:teuthology.orchestra.run.trial004.stdout:Total 100 MB/s | 89 MB 00:00 2026-02-24T08:59:13.030 INFO:teuthology.orchestra.run.trial004.stdout:Running transaction check 2026-02-24T08:59:13.233 INFO:teuthology.orchestra.run.trial004.stdout:Transaction check succeeded. 2026-02-24T08:59:13.233 INFO:teuthology.orchestra.run.trial004.stdout:Running transaction test 2026-02-24T08:59:13.618 INFO:teuthology.orchestra.run.trial004.stdout:Transaction test succeeded. 2026-02-24T08:59:13.618 INFO:teuthology.orchestra.run.trial004.stdout:Running transaction 2026-02-24T08:59:14.732 INFO:teuthology.orchestra.run.trial004.stdout: Preparing : 1/1 2026-02-24T08:59:15.023 INFO:teuthology.orchestra.run.trial004.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T08:59:15.045 INFO:teuthology.orchestra.run.trial004.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T08:59:17.621 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T08:59:17.655 INFO:teuthology.orchestra.run.trial004.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T08:59:20.914 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T08:59:20.921 INFO:teuthology.orchestra.run.trial004.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:59:24.036 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:59:41.574 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:59:41.596 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:59:41.785 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:59:41.785 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T08:59:41.786 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T08:59:41.786 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T08:59:41.842 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T08:59:41.843 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T08:59:41.843 INFO:teuthology.orchestra.run.trial004.stdout:Installed: 2026-02-24T08:59:41.843 INFO:teuthology.orchestra.run.trial004.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T08:59:41.843 INFO:teuthology.orchestra.run.trial004.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T08:59:41.843 INFO:teuthology.orchestra.run.trial004.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T08:59:41.843 INFO:teuthology.orchestra.run.trial004.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T08:59:41.843 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T08:59:41.843 INFO:teuthology.orchestra.run.trial004.stdout:Complete! 2026-02-24T08:59:41.906 DEBUG:teuthology.orchestra.run.trial004:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T08:59:41.935 INFO:teuthology.orchestra.run.trial004.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T08:59:41.936 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T08:59:41.936 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T08:59:41.936 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T08:59:41.936 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T08:59:41.936 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2026-02-24T08:59:41.936 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial004.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T08:59:41.936 DEBUG:teuthology.orchestra.run.trial004:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T08:59:42.000 INFO:teuthology.orchestra.run.trial004.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T08:59:42.002 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T08:59:42.002 DEBUG:teuthology.orchestra.run.trial004:> sudo rpm -qi grub2-tools 2026-02-24T08:59:42.072 INFO:teuthology.orchestra.run.trial004.stdout:Name : grub2-tools 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Epoch : 1 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Version : 2.06 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Release : 120.el9 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Architecture: x86_64 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Group : Unspecified 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Size : 9108611 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:License : GPLv3+ 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T08:59:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout:Packager : builder@centos.org 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout:Vendor : CentOS 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout:Summary : Support tools for GRUB. 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout:Description : 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout:hardware devices. 2026-02-24T08:59:42.074 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T08:59:42.075 INFO:teuthology.orchestra.run.trial004.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T08:59:42.076 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T08:59:42.076 INFO:teuthology.task.kernel:Updating grub on trial004 to boot 5.14.0-686.el9.x86_64 2026-02-24T08:59:42.076 DEBUG:teuthology.orchestra.run.trial004:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T08:59:42.138 INFO:teuthology.orchestra.run.trial004.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T08:59:42.139 DEBUG:teuthology.orchestra.run.trial004:> sudo command -v grubby && echo yes || echo no 2026-02-24T08:59:42.203 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/grubby 2026-02-24T08:59:42.204 INFO:teuthology.orchestra.run.trial004.stdout:yes 2026-02-24T08:59:42.205 DEBUG:teuthology.orchestra.run.trial004:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T08:59:42.270 INFO:teuthology.orchestra.run.trial004.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T08:59:42.271 DEBUG:teuthology.orchestra.run.trial004:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T08:59:42.343 DEBUG:teuthology.orchestra.run.trial004:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T08:59:42.550 INFO:teuthology.orchestra.run.trial004.stderr:Generating grub configuration file ... 2026-02-24T08:59:42.618 INFO:teuthology.orchestra.run.trial004.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T08:59:42.625 INFO:teuthology.orchestra.run.trial004.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T08:59:42.875 INFO:teuthology.orchestra.run.trial004.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T08:59:42.882 INFO:teuthology.orchestra.run.trial004.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T08:59:42.917 INFO:teuthology.orchestra.run.trial004.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T08:59:42.923 INFO:teuthology.orchestra.run.trial004.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T08:59:42.955 INFO:teuthology.orchestra.run.trial004.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T08:59:42.962 INFO:teuthology.orchestra.run.trial004.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T08:59:42.985 INFO:teuthology.orchestra.run.trial004.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T08:59:42.991 INFO:teuthology.orchestra.run.trial004.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T08:59:43.078 INFO:teuthology.orchestra.run.trial004.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T08:59:43.087 INFO:teuthology.orchestra.run.trial004.stderr:done 2026-02-24T08:59:43.089 DEBUG:teuthology.orchestra.run.trial004:> test -d /sys/firmware/efi 2026-02-24T08:59:43.104 DEBUG:teuthology.orchestra.run.trial004:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T08:59:43.169 INFO:teuthology.orchestra.run.trial004.stdout:/boot/efi/EFI/BOOT 2026-02-24T08:59:43.169 INFO:teuthology.orchestra.run.trial004.stdout:/boot/efi/EFI/centos 2026-02-24T08:59:43.170 DEBUG:teuthology.orchestra.run.trial004:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T08:59:43.236 INFO:teuthology.orchestra.run.trial004.stdout:no 2026-02-24T08:59:43.237 DEBUG:teuthology.orchestra.run.trial004:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T08:59:43.300 INFO:teuthology.orchestra.run.trial004.stdout:yes 2026-02-24T08:59:43.301 DEBUG:teuthology.orchestra.run.trial004:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T08:59:43.365 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial004 2026-02-24T08:59:43.365 DEBUG:teuthology.orchestra.run.trial004:> sudo bash -c ' 2026-02-24T08:59:43.365 DEBUG:teuthology.orchestra.run.trial004:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T08:59:43.365 DEBUG:teuthology.orchestra.run.trial004:> ' 2026-02-24T09:00:13.407 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-24T09:00:13.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial004.front.sepia.ceph.com' 2026-02-24T09:00:13.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:01:13.412 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T09:01:22.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial004.front.sepia.ceph.com' 2026-02-24T09:01:22.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:01:22.546 DEBUG:teuthology.orchestra.run.trial004:> true 2026-02-24T09:01:22.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial004.front.sepia.ceph.com' 2026-02-24T09:01:22.709 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-686.el9.x86_64"... 2026-02-24T09:01:22.709 DEBUG:teuthology.orchestra.run.trial004:> uname -r 2026-02-24T09:01:22.765 INFO:teuthology.orchestra.run.trial004.stdout:5.14.0-686.el9.x86_64 2026-02-24T09:01:22.765 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T09:01:22.765 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T09:01:22.766 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T09:01:23.767 DEBUG:teuthology.parallel:result is None 2026-02-24T09:01:23.767 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T09:01:23.779 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T09:01:23.779 DEBUG:teuthology.orchestra.run.trial004:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T09:01:23.781 DEBUG:teuthology.orchestra.run.trial014:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T09:01:23.783 DEBUG:teuthology.orchestra.run.trial090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T09:01:23.800 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T09:01:23.812 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T09:01:23.827 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T09:01:23.827 DEBUG:teuthology.orchestra.run.trial004:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T09:01:23.839 DEBUG:teuthology.orchestra.run.trial014:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T09:01:23.841 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T09:01:23.867 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T09:01:23.878 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T09:01:23.878 DEBUG:teuthology.orchestra.run.trial014:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T09:01:23.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:01:23.910 DEBUG:teuthology.orchestra.run.trial090:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T09:01:23.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:01:23.925 DEBUG:teuthology.orchestra.run.trial004:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T09:01:23.927 DEBUG:teuthology.orchestra.run.trial014:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T09:01:23.953 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T09:01:23.956 INFO:teuthology.orchestra.run.trial004.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:01:23.965 INFO:teuthology.orchestra.run.trial004.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:01:23.977 INFO:teuthology.orchestra.run.trial014.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:01:23.987 INFO:teuthology.orchestra.run.trial014.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:01:23.991 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:01:24.000 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T09:01:24.002 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T09:01:24.015 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T09:01:24.015 DEBUG:teuthology.orchestra.run.trial004:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T09:01:24.016 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T09:01:24.030 DEBUG:teuthology.orchestra.run.trial090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T09:01:24.069 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T09:01:24.089 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T09:01:24.089 DEBUG:teuthology.orchestra.run.trial004:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T09:01:24.091 DEBUG:teuthology.orchestra.run.trial014:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T09:01:24.094 DEBUG:teuthology.orchestra.run.trial090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T09:01:24.126 DEBUG:teuthology.orchestra.run.trial004:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:01:24.221 DEBUG:teuthology.orchestra.run.trial004:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:01:24.245 DEBUG:teuthology.orchestra.run.trial004:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:01:24.357 DEBUG:teuthology.orchestra.run.trial004:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:01:24.380 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:01:24.381 DEBUG:teuthology.orchestra.run.trial004:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T09:01:24.444 DEBUG:teuthology.orchestra.run.trial014:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:01:24.544 DEBUG:teuthology.orchestra.run.trial014:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:01:24.569 DEBUG:teuthology.orchestra.run.trial014:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:01:24.697 DEBUG:teuthology.orchestra.run.trial014:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:01:24.721 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:01:24.722 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T09:01:24.785 DEBUG:teuthology.orchestra.run.trial090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:01:24.880 DEBUG:teuthology.orchestra.run.trial090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:01:24.905 DEBUG:teuthology.orchestra.run.trial090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:01:25.019 DEBUG:teuthology.orchestra.run.trial090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:01:25.044 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:01:25.044 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T09:01:25.108 DEBUG:teuthology.orchestra.run.trial004:> sudo service rsyslog restart 2026-02-24T09:01:25.109 DEBUG:teuthology.orchestra.run.trial014:> sudo service rsyslog restart 2026-02-24T09:01:25.111 DEBUG:teuthology.orchestra.run.trial090:> sudo service rsyslog restart 2026-02-24T09:01:25.136 INFO:teuthology.orchestra.run.trial004.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:01:25.138 INFO:teuthology.orchestra.run.trial014.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:01:25.175 INFO:teuthology.orchestra.run.trial090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:01:25.625 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T09:01:25.637 INFO:teuthology.task.internal:Starting timer... 2026-02-24T09:01:25.637 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T09:01:25.661 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T09:01:25.679 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2026-02-24T09:01:25.679 DEBUG:teuthology.orchestra.run.trial004:> sudo service auditd rotate 2026-02-24T09:01:25.709 INFO:teuthology.orchestra.run.trial004.stdout:Rotating logs: 2026-02-24T09:01:25.711 DEBUG:teuthology.orchestra.run.trial014:> sudo service auditd rotate 2026-02-24T09:01:25.741 INFO:teuthology.orchestra.run.trial014.stdout:Rotating logs: 2026-02-24T09:01:25.742 DEBUG:teuthology.orchestra.run.trial090:> sudo service auditd rotate 2026-02-24T09:01:25.772 INFO:teuthology.orchestra.run.trial090.stdout:Rotating logs: 2026-02-24T09:01:25.773 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T09:01:25.773 DEBUG:teuthology.orchestra.run.trial004:> /usr/sbin/getenforce 2026-02-24T09:01:25.788 INFO:teuthology.orchestra.run.trial004.stdout:Permissive 2026-02-24T09:01:25.789 DEBUG:teuthology.orchestra.run.trial014:> /usr/sbin/getenforce 2026-02-24T09:01:25.806 INFO:teuthology.orchestra.run.trial014.stdout:Permissive 2026-02-24T09:01:25.806 DEBUG:teuthology.orchestra.run.trial090:> /usr/sbin/getenforce 2026-02-24T09:01:25.829 INFO:teuthology.orchestra.run.trial090.stdout:Permissive 2026-02-24T09:01:25.829 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial004.front.sepia.ceph.com': 'permissive', 'ubuntu@trial014.front.sepia.ceph.com': 'permissive', 'ubuntu@trial090.front.sepia.ceph.com': 'permissive'} 2026-02-24T09:01:25.829 DEBUG:teuthology.orchestra.run.trial004:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:01:25.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:01:25.852 DEBUG:teuthology.orchestra.run.trial014:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:01:25.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:01:25.876 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:01:25.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:01:25.901 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T09:01:25.901 DEBUG:teuthology.orchestra.run.trial004:> sudo /usr/sbin/setenforce permissive 2026-02-24T09:01:25.925 DEBUG:teuthology.orchestra.run.trial014:> sudo /usr/sbin/setenforce permissive 2026-02-24T09:01:25.950 DEBUG:teuthology.orchestra.run.trial090:> sudo /usr/sbin/setenforce permissive 2026-02-24T09:01:25.975 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T09:01:25.993 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-24T09:01:25.997 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-24T09:01:26.161 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T09:01:26.168 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T09:01:26.168 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial004.front.sepia.ceph.com,trial014.front.sepia.ceph.com,trial090.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T09:04:42.168 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial004.front.sepia.ceph.com'), Remote(name='ubuntu@trial014.front.sepia.ceph.com'), Remote(name='ubuntu@trial090.front.sepia.ceph.com')] 2026-02-24T09:04:42.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial004.front.sepia.ceph.com' 2026-02-24T09:04:42.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial004.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:04:42.321 DEBUG:teuthology.orchestra.run.trial004:> true 2026-02-24T09:04:42.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial004.front.sepia.ceph.com' 2026-02-24T09:04:42.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-24T09:04:42.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:04:42.485 DEBUG:teuthology.orchestra.run.trial014:> true 2026-02-24T09:04:42.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-24T09:04:42.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-24T09:04:42.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T09:04:42.634 DEBUG:teuthology.orchestra.run.trial090:> true 2026-02-24T09:04:42.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-24T09:04:42.712 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T09:04:42.726 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T09:04:42.726 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T09:04:42.726 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:04:42.728 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T09:04:42.729 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:04:42.731 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T09:04:42.731 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:04:42.756 INFO:teuthology.orchestra.run.trial004.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T09:04:42.756 INFO:teuthology.orchestra.run.trial014.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T09:04:42.767 INFO:teuthology.orchestra.run.trial014.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T09:04:42.768 INFO:teuthology.orchestra.run.trial004.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T09:04:42.779 INFO:teuthology.orchestra.run.trial090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial004.stderr:sudo: ntpd: command not found 2026-02-24T09:04:42.787 INFO:teuthology.orchestra.run.trial014.stderr:sudo: ntpd: command not found 2026-02-24T09:04:42.791 INFO:teuthology.orchestra.run.trial090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial014.stdout:506 Cannot talk to daemon 2026-02-24T09:04:42.797 INFO:teuthology.orchestra.run.trial004.stdout:506 Cannot talk to daemon 2026-02-24T09:04:42.808 INFO:teuthology.orchestra.run.trial004.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T09:04:42.809 INFO:teuthology.orchestra.run.trial014.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T09:04:42.812 INFO:teuthology.orchestra.run.trial090.stderr:sudo: ntpd: command not found 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial014.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T09:04:42.820 INFO:teuthology.orchestra.run.trial004.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T09:04:42.821 INFO:teuthology.orchestra.run.trial090.stdout:506 Cannot talk to daemon 2026-02-24T09:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T09:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T09:04:42.865 INFO:teuthology.orchestra.run.trial014.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:04:42.872 INFO:teuthology.orchestra.run.trial004.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:04:42.880 INFO:teuthology.orchestra.run.trial014.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:04:42.880 INFO:teuthology.orchestra.run.trial014.stdout:=============================================================================== 2026-02-24T09:04:42.880 INFO:teuthology.orchestra.run.trial014.stdout:^? clover0.mattnordhoffdns.> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:04:42.880 INFO:teuthology.orchestra.run.trial014.stdout:^? frumentum-zeus.infra.fru> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:04:42.887 INFO:teuthology.orchestra.run.trial004.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:04:42.887 INFO:teuthology.orchestra.run.trial004.stdout:=============================================================================== 2026-02-24T09:04:42.887 INFO:teuthology.orchestra.run.trial004.stdout:^? 38.45.64.130 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:04:42.887 INFO:teuthology.orchestra.run.trial004.stdout:^? ntp3.radio-sunshine.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:04:42.892 INFO:teuthology.orchestra.run.trial090.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:04:42.901 INFO:teuthology.orchestra.run.trial090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:04:42.901 INFO:teuthology.orchestra.run.trial090.stdout:=============================================================================== 2026-02-24T09:04:42.901 INFO:teuthology.orchestra.run.trial090.stdout:^? 149.28.61.105.vultruserc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:04:42.901 INFO:teuthology.orchestra.run.trial090.stdout:^? 155.248.196.28 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T09:04:42.902 INFO:teuthology.run_tasks:Running task install... 2026-02-24T09:04:42.917 DEBUG:teuthology.task.install:project ceph 2026-02-24T09:04:42.918 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b'}} 2026-02-24T09:04:42.918 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b'} 2026-02-24T09:04:42.918 INFO:teuthology.task.install:Using flavor: default 2026-02-24T09:04:42.928 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-24T09:04:42.928 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-24T09:04:42.929 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'tag': None, 'wait_for_package': False} 2026-02-24T09:04:42.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:04:42.933 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'tag': None, 'wait_for_package': False} 2026-02-24T09:04:42.934 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:04:42.935 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'tag': None, 'wait_for_package': False} 2026-02-24T09:04:42.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:04:43.175 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/ 2026-02-24T09:04:43.175 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5537.g5bc9a1ff 2026-02-24T09:04:43.191 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/ 2026-02-24T09:04:43.191 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5537.g5bc9a1ff 2026-02-24T09:04:43.191 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/ 2026-02-24T09:04:43.191 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5537.g5bc9a1ff 2026-02-24T09:04:43.370 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T09:04:43.370 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:04:43.370 DEBUG:teuthology.orchestra.run.trial004:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T09:04:43.373 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T09:04:43.374 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:04:43.374 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T09:04:43.381 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T09:04:43.381 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:04:43.381 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T09:04:43.395 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-24T09:04:43.396 DEBUG:teuthology.orchestra.run.trial004:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5bc9a1ffc19df681248ece8c3c8c7191a571745b/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T09:04:43.399 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-24T09:04:43.399 DEBUG:teuthology.orchestra.run.trial090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5bc9a1ffc19df681248ece8c3c8c7191a571745b/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T09:04:43.407 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-24T09:04:43.407 DEBUG:teuthology.orchestra.run.trial014:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5bc9a1ffc19df681248ece8c3c8c7191a571745b/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T09:04:43.461 DEBUG:teuthology.orchestra.run.trial004:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T09:04:43.463 DEBUG:teuthology.orchestra.run.trial090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T09:04:43.471 DEBUG:teuthology.orchestra.run.trial014:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T09:04:43.535 DEBUG:teuthology.orchestra.run.trial004:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T09:04:43.537 DEBUG:teuthology.orchestra.run.trial090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T09:04:43.545 DEBUG:teuthology.orchestra.run.trial014:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T09:04:43.597 INFO:teuthology.orchestra.run.trial004.stdout:check_obsoletes = 1 2026-02-24T09:04:43.599 DEBUG:teuthology.orchestra.run.trial004:> sudo yum clean all 2026-02-24T09:04:43.603 INFO:teuthology.orchestra.run.trial090.stdout:check_obsoletes = 1 2026-02-24T09:04:43.604 DEBUG:teuthology.orchestra.run.trial090:> sudo yum clean all 2026-02-24T09:04:43.610 INFO:teuthology.orchestra.run.trial014.stdout:check_obsoletes = 1 2026-02-24T09:04:43.612 DEBUG:teuthology.orchestra.run.trial014:> sudo yum clean all 2026-02-24T09:04:43.747 INFO:teuthology.orchestra.run.trial004.stdout:41 files removed 2026-02-24T09:04:43.760 DEBUG:teuthology.orchestra.run.trial004:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-24T09:04:43.761 INFO:teuthology.orchestra.run.trial090.stdout:41 files removed 2026-02-24T09:04:43.769 INFO:teuthology.orchestra.run.trial014.stdout:41 files removed 2026-02-24T09:04:43.775 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-24T09:04:43.784 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-24T09:04:44.039 INFO:teuthology.orchestra.run.trial004.stdout:ceph packages for x86_64 722 kB/s | 93 kB 00:00 2026-02-24T09:04:44.051 INFO:teuthology.orchestra.run.trial014.stdout:ceph packages for x86_64 754 kB/s | 93 kB 00:00 2026-02-24T09:04:44.052 INFO:teuthology.orchestra.run.trial090.stdout:ceph packages for x86_64 718 kB/s | 93 kB 00:00 2026-02-24T09:04:44.184 INFO:teuthology.orchestra.run.trial004.stdout:ceph noarch packages 210 kB/s | 24 kB 00:00 2026-02-24T09:04:44.193 INFO:teuthology.orchestra.run.trial090.stdout:ceph noarch packages 212 kB/s | 24 kB 00:00 2026-02-24T09:04:44.194 INFO:teuthology.orchestra.run.trial014.stdout:ceph noarch packages 208 kB/s | 24 kB 00:00 2026-02-24T09:04:44.313 INFO:teuthology.orchestra.run.trial004.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-24T09:04:44.320 INFO:teuthology.orchestra.run.trial090.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-24T09:04:44.322 INFO:teuthology.orchestra.run.trial014.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-24T09:04:52.335 INFO:teuthology.orchestra.run.trial004.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-24T09:04:52.731 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-24T09:04:53.282 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-24T09:04:55.370 INFO:teuthology.orchestra.run.trial004.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-24T09:04:58.838 INFO:teuthology.orchestra.run.trial004.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 8.0 MB 00:01 2026-02-24T09:04:59.772 INFO:teuthology.orchestra.run.trial004.stdout:CentOS Stream 9 - Extras packages 107 kB/s | 20 kB 00:00 2026-02-24T09:05:00.406 INFO:teuthology.orchestra.run.trial004.stdout:Extra Packages for Enterprise Linux 36 MB/s | 20 MB 00:00 2026-02-24T09:05:03.609 INFO:teuthology.orchestra.run.trial004.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-24T09:05:04.823 INFO:teuthology.orchestra.run.trial004.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:05:04.823 INFO:teuthology.orchestra.run.trial004.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:05:04.829 INFO:teuthology.orchestra.run.trial004.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-24T09:05:04.829 INFO:teuthology.orchestra.run.trial004.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-24T09:05:04.830 INFO:teuthology.orchestra.run.trial004.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-24T09:05:04.830 INFO:teuthology.orchestra.run.trial004.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-24T09:05:04.831 INFO:teuthology.orchestra.run.trial004.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-24T09:05:04.832 INFO:teuthology.orchestra.run.trial004.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-24T09:05:04.833 INFO:teuthology.orchestra.run.trial004.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-24T09:05:04.861 INFO:teuthology.orchestra.run.trial004.stdout:Dependencies resolved. 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout:======================================================================================= 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout: Package Arch Version Repository Size 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout:======================================================================================= 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout:Installing: 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout: ceph x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 k 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout: ceph-base x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.2 M 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout: ceph-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 987 k 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 148 k 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 950 k 2026-02-24T09:05:04.866 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 184 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 15 M 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 7.4 M 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-rook noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 50 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: ceph-osd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 167 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: ceph-osd-classic x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 16 M 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: ceph-radosgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 13 M 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: ceph-test x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 76 M 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: ceph-volume noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 301 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 1.0 M 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: cephfs-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 243 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: cephfs-shell x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 27 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: cephfs-top noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 18 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: libcephfs-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 37 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: libcephfs2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 909 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: librados-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 123 k 2026-02-24T09:05:04.867 INFO:teuthology.orchestra.run.trial004.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: libuuid-devel x86_64 2.37.4-25.el9 appstream 23 k 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: python3-cephfs x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 204 k 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: python3-rados x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 324 k 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: python3-rbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 304 k 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: python3-rgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 100 k 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: rbd-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 84 k 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: rbd-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.9 M 2026-02-24T09:05:04.868 INFO:teuthology.orchestra.run.trial004.stdout: rbd-nbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 172 k 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout:Upgrading: 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout: libblkid x86_64 2.37.4-25.el9 baseos 105 k 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout: libfdisk x86_64 2.37.4-25.el9 baseos 152 k 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout: libmount x86_64 2.37.4-25.el9 baseos 133 k 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout: librados2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 3.5 M 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout: librbd1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.8 M 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout: libsmartcols x86_64 2.37.4-25.el9 baseos 61 k 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout: libuuid x86_64 2.37.4-25.el9 baseos 26 k 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout: util-linux x86_64 2.37.4-25.el9 baseos 2.3 M 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout: util-linux-core x86_64 2.37.4-25.el9 baseos 458 k 2026-02-24T09:05:04.869 INFO:teuthology.orchestra.run.trial004.stdout:Installing dependencies: 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 24 M 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 57 k 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mds x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.3 M 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 298 k 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.0 M 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: ceph-osd-crimson x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 19 M 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 17 k 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: ceph-selinux x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 25 k 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T09:05:04.870 INFO:teuthology.orchestra.run.trial004.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 26 k 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: libcephsqlite x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 159 k 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T09:05:04.871 INFO:teuthology.orchestra.run.trial004.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: libradosstriper1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 247 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: librgw2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 M 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-24T09:05:04.872 INFO:teuthology.orchestra.run.trial004.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-24T09:05:04.873 INFO:teuthology.orchestra.run.trial004.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: python3-ceph-argparse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 45 k 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: python3-ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 186 k 2026-02-24T09:05:04.874 INFO:teuthology.orchestra.run.trial004.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T09:05:04.875 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T09:05:04.876 INFO:teuthology.orchestra.run.trial004.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-24T09:05:04.877 INFO:teuthology.orchestra.run.trial004.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T09:05:04.878 INFO:teuthology.orchestra.run.trial004.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T09:05:04.879 INFO:teuthology.orchestra.run.trial004.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout:Installing weak dependencies: 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 22 k 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout: libcephfs-daemon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 39 k 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout:Transaction Summary 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout:======================================================================================= 2026-02-24T09:05:04.880 INFO:teuthology.orchestra.run.trial004.stdout:Install 174 Packages 2026-02-24T09:05:04.881 INFO:teuthology.orchestra.run.trial004.stdout:Upgrade 9 Packages 2026-02-24T09:05:04.881 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:04.881 INFO:teuthology.orchestra.run.trial004.stdout:Total download size: 296 M 2026-02-24T09:05:04.882 INFO:teuthology.orchestra.run.trial004.stdout:Downloading Packages: 2026-02-24T09:05:05.033 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 27 MB 00:11 2026-02-24T09:05:05.674 INFO:teuthology.orchestra.run.trial004.stdout:(1/183): ceph-20.3.0-5537.g5bc9a1ff.el9.x86_64. 110 kB/s | 6.5 kB 00:00 2026-02-24T09:05:05.799 INFO:teuthology.orchestra.run.trial004.stdout:(2/183): ceph-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 7.7 MB/s | 987 kB 00:00 2026-02-24T09:05:05.844 INFO:teuthology.orchestra.run.trial004.stdout:(3/183): ceph-immutable-object-cache-20.3.0-553 3.2 MB/s | 148 kB 00:00 2026-02-24T09:05:05.963 INFO:teuthology.orchestra.run.trial004.stdout:(4/183): ceph-base-20.3.0-5537.g5bc9a1ff.el9.x8 15 MB/s | 5.2 MB 00:00 2026-02-24T09:05:06.021 INFO:teuthology.orchestra.run.trial004.stdout:(5/183): ceph-mgr-20.3.0-5537.g5bc9a1ff.el9.x86 16 MB/s | 950 kB 00:00 2026-02-24T09:05:06.110 INFO:teuthology.orchestra.run.trial004.stdout:(6/183): ceph-mds-20.3.0-5537.g5bc9a1ff.el9.x86 8.8 MB/s | 2.3 MB 00:00 2026-02-24T09:05:06.168 INFO:teuthology.orchestra.run.trial004.stdout:(7/183): ceph-osd-20.3.0-5537.g5bc9a1ff.el9.x86 2.8 MB/s | 167 kB 00:00 2026-02-24T09:05:06.274 INFO:teuthology.orchestra.run.trial004.stdout:(8/183): ceph-mon-20.3.0-5537.g5bc9a1ff.el9.x86 20 MB/s | 5.0 MB 00:00 2026-02-24T09:05:06.493 INFO:teuthology.orchestra.run.trial004.stdout:(9/183): ceph-common-20.3.0-5537.g5bc9a1ff.el9. 28 MB/s | 24 MB 00:00 2026-02-24T09:05:06.968 INFO:teuthology.orchestra.run.trial004.stdout:(10/183): ceph-radosgw-20.3.0-5537.g5bc9a1ff.el 28 MB/s | 13 MB 00:00 2026-02-24T09:05:06.985 INFO:teuthology.orchestra.run.trial004.stdout:(11/183): ceph-selinux-20.3.0-5537.g5bc9a1ff.el 1.4 MB/s | 25 kB 00:00 2026-02-24T09:05:07.200 INFO:teuthology.orchestra.run.trial004.stdout:(12/183): ceph-osd-crimson-20.3.0-5537.g5bc9a1f 21 MB/s | 19 MB 00:00 2026-02-24T09:05:07.238 INFO:teuthology.orchestra.run.trial004.stdout:(13/183): cephfs-mirror-20.3.0-5537.g5bc9a1ff.e 6.2 MB/s | 243 kB 00:00 2026-02-24T09:05:07.278 INFO:teuthology.orchestra.run.trial004.stdout:(14/183): cephfs-shell-20.3.0-5537.g5bc9a1ff.el 687 kB/s | 27 kB 00:00 2026-02-24T09:05:07.318 INFO:teuthology.orchestra.run.trial004.stdout:(15/183): libcephfs-daemon-20.3.0-5537.g5bc9a1f 973 kB/s | 39 kB 00:00 2026-02-24T09:05:07.357 INFO:teuthology.orchestra.run.trial004.stdout:(16/183): libcephfs-devel-20.3.0-5537.g5bc9a1ff 936 kB/s | 37 kB 00:00 2026-02-24T09:05:07.398 INFO:teuthology.orchestra.run.trial004.stdout:(17/183): libcephfs-proxy2-20.3.0-5537.g5bc9a1f 651 kB/s | 26 kB 00:00 2026-02-24T09:05:07.456 INFO:teuthology.orchestra.run.trial004.stdout:(18/183): libcephfs2-20.3.0-5537.g5bc9a1ff.el9. 15 MB/s | 909 kB 00:00 2026-02-24T09:05:07.499 INFO:teuthology.orchestra.run.trial004.stdout:(19/183): libcephsqlite-20.3.0-5537.g5bc9a1ff.e 3.6 MB/s | 159 kB 00:00 2026-02-24T09:05:07.542 INFO:teuthology.orchestra.run.trial004.stdout:(20/183): librados-devel-20.3.0-5537.g5bc9a1ff. 2.8 MB/s | 123 kB 00:00 2026-02-24T09:05:07.587 INFO:teuthology.orchestra.run.trial004.stdout:(21/183): libradosstriper1-20.3.0-5537.g5bc9a1f 5.3 MB/s | 247 kB 00:00 2026-02-24T09:05:07.686 INFO:teuthology.orchestra.run.trial004.stdout:(22/183): ceph-osd-classic-20.3.0-5537.g5bc9a1f 10 MB/s | 16 MB 00:01 2026-02-24T09:05:07.726 INFO:teuthology.orchestra.run.trial004.stdout:(23/183): python3-ceph-argparse-20.3.0-5537.g5b 1.1 MB/s | 45 kB 00:00 2026-02-24T09:05:07.780 INFO:teuthology.orchestra.run.trial004.stdout:(24/183): python3-ceph-common-20.3.0-5537.g5bc9 3.4 MB/s | 186 kB 00:00 2026-02-24T09:05:07.838 INFO:teuthology.orchestra.run.trial004.stdout:(25/183): python3-cephfs-20.3.0-5537.g5bc9a1ff. 3.5 MB/s | 204 kB 00:00 2026-02-24T09:05:07.883 INFO:teuthology.orchestra.run.trial004.stdout:(26/183): python3-rados-20.3.0-5537.g5bc9a1ff.e 7.0 MB/s | 324 kB 00:00 2026-02-24T09:05:07.925 INFO:teuthology.orchestra.run.trial004.stdout:(27/183): librgw2-20.3.0-5537.g5bc9a1ff.el9.x86 19 MB/s | 6.5 MB 00:00 2026-02-24T09:05:07.930 INFO:teuthology.orchestra.run.trial004.stdout:(28/183): python3-rbd-20.3.0-5537.g5bc9a1ff.el9 6.4 MB/s | 304 kB 00:00 2026-02-24T09:05:07.960 INFO:teuthology.orchestra.run.trial004.stdout:(29/183): python3-rgw-20.3.0-5537.g5bc9a1ff.el9 2.9 MB/s | 100 kB 00:00 2026-02-24T09:05:07.963 INFO:teuthology.orchestra.run.trial004.stdout:(30/183): rbd-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 2.4 MB/s | 84 kB 00:00 2026-02-24T09:05:08.004 INFO:teuthology.orchestra.run.trial004.stdout:(31/183): rbd-nbd-20.3.0-5537.g5bc9a1ff.el9.x86 4.2 MB/s | 172 kB 00:00 2026-02-24T09:05:08.041 INFO:teuthology.orchestra.run.trial004.stdout:(32/183): ceph-grafana-dashboards-20.3.0-5537.g 1.5 MB/s | 57 kB 00:00 2026-02-24T09:05:08.080 INFO:teuthology.orchestra.run.trial004.stdout:(33/183): rbd-mirror-20.3.0-5537.g5bc9a1ff.el9. 24 MB/s | 2.9 MB 00:00 2026-02-24T09:05:08.086 INFO:teuthology.orchestra.run.trial004.stdout:(34/183): ceph-mgr-cephadm-20.3.0-5537.g5bc9a1f 4.1 MB/s | 184 kB 00:00 2026-02-24T09:05:08.572 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 8.0 MB 00:01 2026-02-24T09:05:08.875 INFO:teuthology.orchestra.run.trial004.stdout:(35/183): ceph-mgr-dashboard-20.3.0-5537.g5bc9a 19 MB/s | 15 MB 00:00 2026-02-24T09:05:08.876 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - AppStream 1.7 MB/s | 27 MB 00:15 2026-02-24T09:05:08.885 INFO:teuthology.orchestra.run.trial004.stdout:(36/183): ceph-mgr-diskprediction-local-20.3.0- 9.3 MB/s | 7.4 MB 00:00 2026-02-24T09:05:08.907 INFO:teuthology.orchestra.run.trial004.stdout:(37/183): ceph-mgr-k8sevents-20.3.0-5537.g5bc9a 711 kB/s | 22 kB 00:00 2026-02-24T09:05:08.926 INFO:teuthology.orchestra.run.trial004.stdout:(38/183): ceph-mgr-modules-core-20.3.0-5537.g5b 7.1 MB/s | 298 kB 00:00 2026-02-24T09:05:08.947 INFO:teuthology.orchestra.run.trial004.stdout:(39/183): ceph-mgr-rook-20.3.0-5537.g5bc9a1ff.e 1.2 MB/s | 50 kB 00:00 2026-02-24T09:05:08.961 INFO:teuthology.orchestra.run.trial004.stdout:(40/183): ceph-prometheus-alerts-20.3.0-5537.g5 493 kB/s | 17 kB 00:00 2026-02-24T09:05:08.988 INFO:teuthology.orchestra.run.trial004.stdout:(41/183): ceph-volume-20.3.0-5537.g5bc9a1ff.el9 7.2 MB/s | 301 kB 00:00 2026-02-24T09:05:09.032 INFO:teuthology.orchestra.run.trial004.stdout:(42/183): cephfs-top-20.3.0-5537.g5bc9a1ff.el9. 416 kB/s | 18 kB 00:00 2026-02-24T09:05:09.055 INFO:teuthology.orchestra.run.trial004.stdout:(43/183): cephadm-20.3.0-5537.g5bc9a1ff.el9.noa 11 MB/s | 1.0 MB 00:00 2026-02-24T09:05:09.235 INFO:teuthology.orchestra.run.trial004.stdout:(44/183): ceph-test-20.3.0-5537.g5bc9a1ff.el9.x 34 MB/s | 76 MB 00:02 2026-02-24T09:05:09.514 INFO:teuthology.orchestra.run.trial004.stdout:(45/183): ledmon-libs-1.1.0-3.el9.x86_64.rpm 145 kB/s | 40 kB 00:00 2026-02-24T09:05:09.574 INFO:teuthology.orchestra.run.trial004.stdout:(46/183): cryptsetup-2.8.1-3.el9.x86_64.rpm 648 kB/s | 351 kB 00:00 2026-02-24T09:05:09.627 INFO:teuthology.orchestra.run.trial004.stdout:(47/183): libatomic-11.5.0-14.el9.x86_64.rpm 203 kB/s | 23 kB 00:00 2026-02-24T09:05:09.662 INFO:teuthology.orchestra.run.trial004.stdout:(48/183): libconfig-1.7.2-9.el9.x86_64.rpm 822 kB/s | 72 kB 00:00 2026-02-24T09:05:09.767 INFO:teuthology.orchestra.run.trial004.stdout:(49/183): libquadmath-11.5.0-14.el9.x86_64.rpm 1.7 MB/s | 184 kB 00:00 2026-02-24T09:05:09.858 INFO:teuthology.orchestra.run.trial004.stdout:(50/183): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2026-02-24T09:05:09.896 INFO:teuthology.orchestra.run.trial004.stdout:(51/183): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.5 MB/s | 2.1 MB 00:00 2026-02-24T09:05:09.940 INFO:teuthology.orchestra.run.trial004.stdout:(52/183): mailcap-2.1.49-5.el9.noarch.rpm 407 kB/s | 33 kB 00:00 2026-02-24T09:05:10.004 INFO:teuthology.orchestra.run.trial004.stdout:(53/183): nvme-cli-2.16-1.el9.x86_64.rpm 11 MB/s | 1.2 MB 00:00 2026-02-24T09:05:10.031 INFO:teuthology.orchestra.run.trial004.stdout:(54/183): pciutils-3.7.0-7.el9.x86_64.rpm 1.0 MB/s | 93 kB 00:00 2026-02-24T09:05:10.064 INFO:teuthology.orchestra.run.trial004.stdout:(55/183): libgfortran-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 794 kB 00:00 2026-02-24T09:05:10.088 INFO:teuthology.orchestra.run.trial004.stdout:(56/183): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 253 kB 00:00 2026-02-24T09:05:10.150 INFO:teuthology.orchestra.run.trial004.stdout:(57/183): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2026-02-24T09:05:10.170 INFO:teuthology.orchestra.run.trial004.stdout:(58/183): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2026-02-24T09:05:10.237 INFO:teuthology.orchestra.run.trial004.stdout:(59/183): python3-pyparsing-2.4.7-9.el9.noarch. 1.7 MB/s | 150 kB 00:00 2026-02-24T09:05:10.251 INFO:teuthology.orchestra.run.trial004.stdout:(60/183): python3-requests-2.25.1-10.el9.noarch 1.5 MB/s | 126 kB 00:00 2026-02-24T09:05:10.274 INFO:teuthology.orchestra.run.trial004.stdout:(61/183): python3-cryptography-36.0.1-5.el9.x86 5.1 MB/s | 1.2 MB 00:00 2026-02-24T09:05:10.329 INFO:teuthology.orchestra.run.trial004.stdout:(62/183): python3-urllib3-1.26.5-7.el9.noarch.r 2.3 MB/s | 218 kB 00:00 2026-02-24T09:05:10.333 INFO:teuthology.orchestra.run.trial004.stdout:(63/183): unzip-6.0-59.el9.x86_64.rpm 2.2 MB/s | 182 kB 00:00 2026-02-24T09:05:10.353 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-24T09:05:10.361 INFO:teuthology.orchestra.run.trial004.stdout:(64/183): zip-3.0-35.el9.x86_64.rpm 3.0 MB/s | 266 kB 00:00 2026-02-24T09:05:10.961 INFO:teuthology.orchestra.run.trial004.stdout:(65/183): boost-program-options-1.75.0-13.el9.x 174 kB/s | 104 kB 00:00 2026-02-24T09:05:11.147 INFO:teuthology.orchestra.run.trial004.stdout:(66/183): elfutils-libelf-devel-0.194-1.el9.x86 426 kB/s | 79 kB 00:00 2026-02-24T09:05:11.305 INFO:teuthology.orchestra.run.trial090.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-24T09:05:11.555 INFO:teuthology.orchestra.run.trial004.stdout:(67/183): automake-1.16.2-8.el9.noarch.rpm 562 kB/s | 689 kB 00:01 2026-02-24T09:05:11.566 INFO:teuthology.orchestra.run.trial004.stdout:(68/183): flex-2.6.4-9.el9.x86_64.rpm 749 kB/s | 313 kB 00:00 2026-02-24T09:05:11.662 INFO:teuthology.orchestra.run.trial004.stdout:(69/183): flexiblas-3.0.4-9.el9.x86_64.rpm 277 kB/s | 30 kB 00:00 2026-02-24T09:05:11.766 INFO:teuthology.orchestra.run.trial004.stdout:(70/183): flexiblas-openblas-openmp-3.0.4-9.el9 143 kB/s | 15 kB 00:00 2026-02-24T09:05:11.812 INFO:teuthology.orchestra.run.trial004.stdout:(71/183): bison-3.7.4-5.el9.x86_64.rpm 638 kB/s | 943 kB 00:01 2026-02-24T09:05:11.870 INFO:teuthology.orchestra.run.trial004.stdout:(72/183): libaio-devel-0.3.111-13.el9.x86_64.rp 107 kB/s | 11 kB 00:00 2026-02-24T09:05:12.075 INFO:teuthology.orchestra.run.trial004.stdout:(73/183): libnbd-1.20.3-4.el9.x86_64.rpm 623 kB/s | 164 kB 00:00 2026-02-24T09:05:12.129 INFO:teuthology.orchestra.run.trial004.stdout:(74/183): libpmemobj-1.12.1-1.el9.x86_64.rpm 618 kB/s | 160 kB 00:00 2026-02-24T09:05:12.179 INFO:teuthology.orchestra.run.trial004.stdout:(75/183): librabbitmq-0.11.0-7.el9.x86_64.rpm 431 kB/s | 45 kB 00:00 2026-02-24T09:05:12.521 INFO:teuthology.orchestra.run.trial004.stdout:(76/183): libstoragemgmt-1.10.1-1.el9.x86_64.rp 723 kB/s | 246 kB 00:00 2026-02-24T09:05:12.931 INFO:teuthology.orchestra.run.trial004.stdout:(77/183): librdkafka-1.6.1-102.el9.x86_64.rpm 826 kB/s | 662 kB 00:00 2026-02-24T09:05:13.035 INFO:teuthology.orchestra.run.trial004.stdout:(78/183): libuuid-devel-2.37.4-25.el9.x86_64.rp 216 kB/s | 23 kB 00:00 2026-02-24T09:05:13.256 INFO:teuthology.orchestra.run.trial004.stdout:(79/183): libtool-2.4.6-46.el9.x86_64.rpm 790 kB/s | 581 kB 00:00 2026-02-24T09:05:13.361 INFO:teuthology.orchestra.run.trial004.stdout:(80/183): libzstd-devel-1.5.5-1.el9.x86_64.rpm 485 kB/s | 51 kB 00:00 2026-02-24T09:05:13.371 INFO:teuthology.orchestra.run.trial004.stdout:(81/183): libxslt-1.1.34-12.el9.x86_64.rpm 694 kB/s | 233 kB 00:00 2026-02-24T09:05:13.634 INFO:teuthology.orchestra.run.trial004.stdout:(82/183): lua-5.4.4-4.el9.x86_64.rpm 717 kB/s | 188 kB 00:00 2026-02-24T09:05:13.738 INFO:teuthology.orchestra.run.trial004.stdout:(83/183): openblas-0.3.29-1.el9.x86_64.rpm 404 kB/s | 42 kB 00:00 2026-02-24T09:05:13.774 INFO:teuthology.orchestra.run.trial004.stdout:(84/183): lttng-ust-2.12.0-6.el9.x86_64.rpm 707 kB/s | 292 kB 00:00 2026-02-24T09:05:14.553 INFO:teuthology.orchestra.run.trial090.stdout:lab-extras 1.4 MB/s | 50 kB 00:00 2026-02-24T09:05:15.008 INFO:teuthology.orchestra.run.trial004.stdout:(85/183): flexiblas-netlib-3.0.4-9.el9.x86_64.r 889 kB/s | 3.0 MB 00:03 2026-02-24T09:05:15.112 INFO:teuthology.orchestra.run.trial004.stdout:(86/183): perl-Thread-Queue-3.14-460.el9.noarch 213 kB/s | 22 kB 00:00 2026-02-24T09:05:15.216 INFO:teuthology.orchestra.run.trial004.stdout:(87/183): perl-threads-2.25-460.el9.x86_64.rpm 565 kB/s | 58 kB 00:00 2026-02-24T09:05:15.319 INFO:teuthology.orchestra.run.trial004.stdout:(88/183): perl-threads-shared-1.61-460.el9.x86_ 432 kB/s | 45 kB 00:00 2026-02-24T09:05:15.741 INFO:teuthology.orchestra.run.trial090.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:05:15.741 INFO:teuthology.orchestra.run.trial090.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:05:15.747 INFO:teuthology.orchestra.run.trial090.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-24T09:05:15.747 INFO:teuthology.orchestra.run.trial090.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-24T09:05:15.748 INFO:teuthology.orchestra.run.trial090.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-24T09:05:15.748 INFO:teuthology.orchestra.run.trial090.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-24T09:05:15.749 INFO:teuthology.orchestra.run.trial090.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-24T09:05:15.750 INFO:teuthology.orchestra.run.trial090.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-24T09:05:15.750 INFO:teuthology.orchestra.run.trial090.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-24T09:05:15.778 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-24T09:05:15.784 INFO:teuthology.orchestra.run.trial090.stdout:======================================================================================= 2026-02-24T09:05:15.784 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-24T09:05:15.784 INFO:teuthology.orchestra.run.trial090.stdout:======================================================================================= 2026-02-24T09:05:15.784 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-24T09:05:15.784 INFO:teuthology.orchestra.run.trial090.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-24T09:05:15.784 INFO:teuthology.orchestra.run.trial090.stdout: ceph x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 k 2026-02-24T09:05:15.784 INFO:teuthology.orchestra.run.trial090.stdout: ceph-base x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.2 M 2026-02-24T09:05:15.784 INFO:teuthology.orchestra.run.trial090.stdout: ceph-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 987 k 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 148 k 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 950 k 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 184 k 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 15 M 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 7.4 M 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-rook noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 50 k 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 167 k 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-classic x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 16 M 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-radosgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 13 M 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-test x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 76 M 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: ceph-volume noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 301 k 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 1.0 M 2026-02-24T09:05:15.785 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 243 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-shell x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 27 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-top noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 18 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 37 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 909 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: librados-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 123 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: libuuid-devel x86_64 2.37.4-25.el9 appstream 23 k 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-24T09:05:15.786 INFO:teuthology.orchestra.run.trial090.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: python3-cephfs x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 204 k 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: python3-rados x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 324 k 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: python3-rbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 304 k 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: python3-rgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 100 k 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: rbd-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 84 k 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: rbd-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.9 M 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: rbd-nbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 172 k 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout:Upgrading: 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: libblkid x86_64 2.37.4-25.el9 baseos 105 k 2026-02-24T09:05:15.787 INFO:teuthology.orchestra.run.trial090.stdout: libfdisk x86_64 2.37.4-25.el9 baseos 152 k 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: libmount x86_64 2.37.4-25.el9 baseos 133 k 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: librados2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 3.5 M 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: librbd1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.8 M 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: libsmartcols x86_64 2.37.4-25.el9 baseos 61 k 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: libuuid x86_64 2.37.4-25.el9 baseos 26 k 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: util-linux x86_64 2.37.4-25.el9 baseos 2.3 M 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: util-linux-core x86_64 2.37.4-25.el9 baseos 458 k 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T09:05:15.788 INFO:teuthology.orchestra.run.trial090.stdout: ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 24 M 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 57 k 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mds x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.3 M 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 298 k 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.0 M 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-crimson x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 19 M 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 17 k 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: ceph-selinux x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 25 k 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T09:05:15.789 INFO:teuthology.orchestra.run.trial090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 26 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: libcephsqlite x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 159 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T09:05:15.790 INFO:teuthology.orchestra.run.trial090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: libradosstriper1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 247 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: librgw2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 M 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T09:05:15.791 INFO:teuthology.orchestra.run.trial090.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T09:05:15.792 INFO:teuthology.orchestra.run.trial090.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-argparse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 45 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 186 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-24T09:05:15.793 INFO:teuthology.orchestra.run.trial090.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T09:05:15.794 INFO:teuthology.orchestra.run.trial090.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T09:05:15.795 INFO:teuthology.orchestra.run.trial090.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T09:05:15.796 INFO:teuthology.orchestra.run.trial090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T09:05:15.797 INFO:teuthology.orchestra.run.trial090.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-24T09:05:15.798 INFO:teuthology.orchestra.run.trial090.stdout:Installing weak dependencies: 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 22 k 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-daemon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 39 k 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout:======================================================================================= 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout:Install 174 Packages 2026-02-24T09:05:15.799 INFO:teuthology.orchestra.run.trial090.stdout:Upgrade 9 Packages 2026-02-24T09:05:15.800 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:05:15.800 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 296 M 2026-02-24T09:05:15.800 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-24T09:05:16.169 INFO:teuthology.orchestra.run.trial090.stdout:(1/183): ceph-20.3.0-5537.g5bc9a1ff.el9.x86_64. 105 kB/s | 6.5 kB 00:00 2026-02-24T09:05:16.306 INFO:teuthology.orchestra.run.trial090.stdout:(2/183): ceph-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 7.1 MB/s | 987 kB 00:00 2026-02-24T09:05:16.357 INFO:teuthology.orchestra.run.trial090.stdout:(3/183): ceph-immutable-object-cache-20.3.0-553 2.8 MB/s | 148 kB 00:00 2026-02-24T09:05:16.369 INFO:teuthology.orchestra.run.trial090.stdout:(4/183): ceph-base-20.3.0-5537.g5bc9a1ff.el9.x8 20 MB/s | 5.2 MB 00:00 2026-02-24T09:05:16.417 INFO:teuthology.orchestra.run.trial090.stdout:(5/183): ceph-mgr-20.3.0-5537.g5bc9a1ff.el9.x86 19 MB/s | 950 kB 00:00 2026-02-24T09:05:16.603 INFO:teuthology.orchestra.run.trial090.stdout:(6/183): ceph-mon-20.3.0-5537.g5bc9a1ff.el9.x86 27 MB/s | 5.0 MB 00:00 2026-02-24T09:05:16.606 INFO:teuthology.orchestra.run.trial090.stdout:(7/183): ceph-mds-20.3.0-5537.g5bc9a1ff.el9.x86 9.4 MB/s | 2.3 MB 00:00 2026-02-24T09:05:16.629 INFO:teuthology.orchestra.run.trial090.stdout:(8/183): ceph-osd-20.3.0-5537.g5bc9a1ff.el9.x86 6.3 MB/s | 167 kB 00:00 2026-02-24T09:05:17.209 INFO:teuthology.orchestra.run.trial004.stdout:(89/183): postgresql-13.23-1.el9.x86_64.rpm 880 kB/s | 1.6 MB 00:01 2026-02-24T09:05:17.322 INFO:teuthology.orchestra.run.trial090.stdout:(9/183): ceph-common-20.3.0-5537.g5bc9a1ff.el9. 20 MB/s | 24 MB 00:01 2026-02-24T09:05:17.349 INFO:teuthology.orchestra.run.trial090.stdout:(10/183): ceph-osd-crimson-20.3.0-5537.g5bc9a1f 26 MB/s | 19 MB 00:00 2026-02-24T09:05:17.363 INFO:teuthology.orchestra.run.trial090.stdout:(11/183): ceph-selinux-20.3.0-5537.g5bc9a1ff.el 1.7 MB/s | 25 kB 00:00 2026-02-24T09:05:17.980 INFO:teuthology.orchestra.run.trial090.stdout:(12/183): ceph-radosgw-20.3.0-5537.g5bc9a1ff.el 20 MB/s | 13 MB 00:00 2026-02-24T09:05:18.025 INFO:teuthology.orchestra.run.trial090.stdout:(13/183): cephfs-mirror-20.3.0-5537.g5bc9a1ff.e 5.4 MB/s | 243 kB 00:00 2026-02-24T09:05:18.066 INFO:teuthology.orchestra.run.trial090.stdout:(14/183): cephfs-shell-20.3.0-5537.g5bc9a1ff.el 655 kB/s | 27 kB 00:00 2026-02-24T09:05:18.107 INFO:teuthology.orchestra.run.trial090.stdout:(15/183): libcephfs-daemon-20.3.0-5537.g5bc9a1f 946 kB/s | 39 kB 00:00 2026-02-24T09:05:18.149 INFO:teuthology.orchestra.run.trial090.stdout:(16/183): libcephfs-devel-20.3.0-5537.g5bc9a1ff 897 kB/s | 37 kB 00:00 2026-02-24T09:05:18.184 INFO:teuthology.orchestra.run.trial090.stdout:(17/183): ceph-osd-classic-20.3.0-5537.g5bc9a1f 9.9 MB/s | 16 MB 00:01 2026-02-24T09:05:18.185 INFO:teuthology.orchestra.run.trial090.stdout:(18/183): libcephfs-proxy2-20.3.0-5537.g5bc9a1f 730 kB/s | 26 kB 00:00 2026-02-24T09:05:18.231 INFO:teuthology.orchestra.run.trial090.stdout:(19/183): libcephsqlite-20.3.0-5537.g5bc9a1ff.e 3.4 MB/s | 159 kB 00:00 2026-02-24T09:05:18.244 INFO:teuthology.orchestra.run.trial004.stdout:(90/183): postgresql-contrib-13.23-1.el9.x86_64 872 kB/s | 903 kB 00:01 2026-02-24T09:05:18.258 INFO:teuthology.orchestra.run.trial090.stdout:(20/183): libcephfs2-20.3.0-5537.g5bc9a1ff.el9. 12 MB/s | 909 kB 00:00 2026-02-24T09:05:18.271 INFO:teuthology.orchestra.run.trial090.stdout:(21/183): librados-devel-20.3.0-5537.g5bc9a1ff. 3.0 MB/s | 123 kB 00:00 2026-02-24T09:05:18.295 INFO:teuthology.orchestra.run.trial090.stdout:(22/183): libradosstriper1-20.3.0-5537.g5bc9a1f 6.5 MB/s | 247 kB 00:00 2026-02-24T09:05:18.347 INFO:teuthology.orchestra.run.trial090.stdout:(23/183): python3-ceph-argparse-20.3.0-5537.g5b 871 kB/s | 45 kB 00:00 2026-02-24T09:05:18.404 INFO:teuthology.orchestra.run.trial090.stdout:(24/183): python3-ceph-common-20.3.0-5537.g5bc9 3.2 MB/s | 186 kB 00:00 2026-02-24T09:05:18.426 INFO:teuthology.orchestra.run.trial004.stdout:(91/183): postgresql-private-libs-13.23-1.el9.x 760 kB/s | 138 kB 00:00 2026-02-24T09:05:18.461 INFO:teuthology.orchestra.run.trial090.stdout:(25/183): python3-cephfs-20.3.0-5537.g5bc9a1ff. 3.5 MB/s | 204 kB 00:00 2026-02-24T09:05:18.519 INFO:teuthology.orchestra.run.trial090.stdout:(26/183): python3-rados-20.3.0-5537.g5bc9a1ff.e 5.4 MB/s | 324 kB 00:00 2026-02-24T09:05:18.578 INFO:teuthology.orchestra.run.trial090.stdout:(27/183): python3-rbd-20.3.0-5537.g5bc9a1ff.el9 5.1 MB/s | 304 kB 00:00 2026-02-24T09:05:18.607 INFO:teuthology.orchestra.run.trial090.stdout:(28/183): librgw2-20.3.0-5537.g5bc9a1ff.el9.x86 19 MB/s | 6.5 MB 00:00 2026-02-24T09:05:18.625 INFO:teuthology.orchestra.run.trial090.stdout:(29/183): python3-rgw-20.3.0-5537.g5bc9a1ff.el9 2.1 MB/s | 100 kB 00:00 2026-02-24T09:05:18.642 INFO:teuthology.orchestra.run.trial090.stdout:(30/183): rbd-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 2.4 MB/s | 84 kB 00:00 2026-02-24T09:05:18.687 INFO:teuthology.orchestra.run.trial090.stdout:(31/183): rbd-nbd-20.3.0-5537.g5bc9a1ff.el9.x86 3.7 MB/s | 172 kB 00:00 2026-02-24T09:05:18.731 INFO:teuthology.orchestra.run.trial090.stdout:(32/183): ceph-grafana-dashboards-20.3.0-5537.g 1.3 MB/s | 57 kB 00:00 2026-02-24T09:05:18.771 INFO:teuthology.orchestra.run.trial090.stdout:(33/183): ceph-mgr-cephadm-20.3.0-5537.g5bc9a1f 4.4 MB/s | 184 kB 00:00 2026-02-24T09:05:18.913 INFO:teuthology.orchestra.run.trial090.stdout:(34/183): rbd-mirror-20.3.0-5537.g5bc9a1ff.el9. 9.9 MB/s | 2.9 MB 00:00 2026-02-24T09:05:19.232 INFO:teuthology.orchestra.run.trial004.stdout:(92/183): openssl-devel-3.5.5-1.el9.x86_64.rpm 900 kB/s | 4.8 MB 00:05 2026-02-24T09:05:19.612 INFO:teuthology.orchestra.run.trial090.stdout:(35/183): ceph-mgr-dashboard-20.3.0-5537.g5bc9a 18 MB/s | 15 MB 00:00 2026-02-24T09:05:19.720 INFO:teuthology.orchestra.run.trial090.stdout:(36/183): ceph-test-20.3.0-5537.g5bc9a1ff.el9.x 32 MB/s | 76 MB 00:02 2026-02-24T09:05:19.720 INFO:teuthology.orchestra.run.trial090.stdout:(37/183): ceph-mgr-k8sevents-20.3.0-5537.g5bc9a 206 kB/s | 22 kB 00:00 2026-02-24T09:05:19.731 INFO:teuthology.orchestra.run.trial090.stdout:(38/183): ceph-mgr-diskprediction-local-20.3.0- 9.1 MB/s | 7.4 MB 00:00 2026-02-24T09:05:19.732 INFO:teuthology.orchestra.run.trial090.stdout:(39/183): ceph-mgr-modules-core-20.3.0-5537.g5b 23 MB/s | 298 kB 00:00 2026-02-24T09:05:19.733 INFO:teuthology.orchestra.run.trial090.stdout:(40/183): ceph-mgr-rook-20.3.0-5537.g5bc9a1ff.e 4.0 MB/s | 50 kB 00:00 2026-02-24T09:05:19.743 INFO:teuthology.orchestra.run.trial090.stdout:(41/183): ceph-prometheus-alerts-20.3.0-5537.g5 1.4 MB/s | 17 kB 00:00 2026-02-24T09:05:19.746 INFO:teuthology.orchestra.run.trial090.stdout:(42/183): ceph-volume-20.3.0-5537.g5bc9a1ff.el9 22 MB/s | 301 kB 00:00 2026-02-24T09:05:19.758 INFO:teuthology.orchestra.run.trial090.stdout:(43/183): cephadm-20.3.0-5537.g5bc9a1ff.el9.noa 41 MB/s | 1.0 MB 00:00 2026-02-24T09:05:19.758 INFO:teuthology.orchestra.run.trial090.stdout:(44/183): cephfs-top-20.3.0-5537.g5bc9a1ff.el9. 1.2 MB/s | 18 kB 00:00 2026-02-24T09:05:19.821 INFO:teuthology.orchestra.run.trial090.stdout:(45/183): ledmon-libs-1.1.0-3.el9.x86_64.rpm 646 kB/s | 40 kB 00:00 2026-02-24T09:05:19.830 INFO:teuthology.orchestra.run.trial004.stdout:(93/183): openblas-openmp-0.3.29-1.el9.x86_64.r 888 kB/s | 5.3 MB 00:06 2026-02-24T09:05:19.843 INFO:teuthology.orchestra.run.trial090.stdout:(46/183): libatomic-11.5.0-14.el9.x86_64.rpm 1.0 MB/s | 23 kB 00:00 2026-02-24T09:05:19.856 INFO:teuthology.orchestra.run.trial090.stdout:(47/183): cryptsetup-2.8.1-3.el9.x86_64.rpm 3.1 MB/s | 351 kB 00:00 2026-02-24T09:05:19.865 INFO:teuthology.orchestra.run.trial090.stdout:(48/183): libconfig-1.7.2-9.el9.x86_64.rpm 3.2 MB/s | 72 kB 00:00 2026-02-24T09:05:19.901 INFO:teuthology.orchestra.run.trial090.stdout:(49/183): libgfortran-11.5.0-14.el9.x86_64.rpm 17 MB/s | 794 kB 00:00 2026-02-24T09:05:19.908 INFO:teuthology.orchestra.run.trial090.stdout:(50/183): hwloc-libs-2.4.1-6.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2026-02-24T09:05:19.909 INFO:teuthology.orchestra.run.trial090.stdout:(51/183): libquadmath-11.5.0-14.el9.x86_64.rpm 4.1 MB/s | 184 kB 00:00 2026-02-24T09:05:19.924 INFO:teuthology.orchestra.run.trial090.stdout:(52/183): lksctp-tools-1.0.19-2.el9.x86_64.rpm 4.0 MB/s | 94 kB 00:00 2026-02-24T09:05:19.930 INFO:teuthology.orchestra.run.trial090.stdout:(53/183): mailcap-2.1.49-5.el9.noarch.rpm 1.5 MB/s | 33 kB 00:00 2026-02-24T09:05:19.947 INFO:teuthology.orchestra.run.trial090.stdout:(54/183): pciutils-3.7.0-7.el9.x86_64.rpm 4.0 MB/s | 93 kB 00:00 2026-02-24T09:05:19.954 INFO:teuthology.orchestra.run.trial090.stdout:(55/183): python3-cffi-1.14.5-5.el9.x86_64.rpm 10 MB/s | 253 kB 00:00 2026-02-24T09:05:19.974 INFO:teuthology.orchestra.run.trial090.stdout:(56/183): python3-cryptography-36.0.1-5.el9.x86 46 MB/s | 1.2 MB 00:00 2026-02-24T09:05:19.978 INFO:teuthology.orchestra.run.trial090.stdout:(57/183): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-24T09:05:19.981 INFO:teuthology.orchestra.run.trial090.stdout:(58/183): nvme-cli-2.16-1.el9.x86_64.rpm 16 MB/s | 1.2 MB 00:00 2026-02-24T09:05:19.998 INFO:teuthology.orchestra.run.trial090.stdout:(59/183): python3-pycparser-2.20-6.el9.noarch.r 5.5 MB/s | 135 kB 00:00 2026-02-24T09:05:20.000 INFO:teuthology.orchestra.run.trial090.stdout:(60/183): python3-pyparsing-2.4.7-9.el9.noarch. 6.5 MB/s | 150 kB 00:00 2026-02-24T09:05:20.005 INFO:teuthology.orchestra.run.trial090.stdout:(61/183): python3-requests-2.25.1-10.el9.noarch 5.3 MB/s | 126 kB 00:00 2026-02-24T09:05:20.021 INFO:teuthology.orchestra.run.trial090.stdout:(62/183): python3-urllib3-1.26.5-7.el9.noarch.r 9.5 MB/s | 218 kB 00:00 2026-02-24T09:05:20.024 INFO:teuthology.orchestra.run.trial090.stdout:(63/183): unzip-6.0-59.el9.x86_64.rpm 7.6 MB/s | 182 kB 00:00 2026-02-24T09:05:20.028 INFO:teuthology.orchestra.run.trial090.stdout:(64/183): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-24T09:05:20.081 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - CRB 925 kB/s | 8.0 MB 00:08 2026-02-24T09:05:20.422 INFO:teuthology.orchestra.run.trial004.stdout:(94/183): protobuf-3.14.0-17.el9.x86_64.rpm 864 kB/s | 1.0 MB 00:01 2026-02-24T09:05:20.487 INFO:teuthology.orchestra.run.trial090.stdout:(65/183): boost-program-options-1.75.0-13.el9.x 227 kB/s | 104 kB 00:00 2026-02-24T09:05:20.527 INFO:teuthology.orchestra.run.trial004.stdout:(95/183): python3-colorama-0.4.6-3.el9.noarch.r 587 kB/s | 61 kB 00:00 2026-02-24T09:05:20.834 INFO:teuthology.orchestra.run.trial090.stdout:(66/183): elfutils-libelf-devel-0.194-1.el9.x86 229 kB/s | 79 kB 00:00 2026-02-24T09:05:20.863 INFO:teuthology.orchestra.run.trial004.stdout:(96/183): python3-devel-3.9.25-3.el9.x86_64.rpm 726 kB/s | 244 kB 00:00 2026-02-24T09:05:21.200 INFO:teuthology.orchestra.run.trial004.stdout:(97/183): python3-jinja2-2.11.3-8.el9.noarch.rp 738 kB/s | 249 kB 00:00 2026-02-24T09:05:21.304 INFO:teuthology.orchestra.run.trial004.stdout:(98/183): python3-jmespath-1.0.1-1.el9.noarch.r 457 kB/s | 48 kB 00:00 2026-02-24T09:05:21.517 INFO:teuthology.orchestra.run.trial090.stdout:(67/183): flex-2.6.4-9.el9.x86_64.rpm 459 kB/s | 313 kB 00:00 2026-02-24T09:05:21.564 INFO:teuthology.orchestra.run.trial004.stdout:(99/183): python3-libstoragemgmt-1.10.1-1.el9.x 681 kB/s | 177 kB 00:00 2026-02-24T09:05:21.630 INFO:teuthology.orchestra.run.trial090.stdout:(68/183): automake-1.16.2-8.el9.noarch.rpm 428 kB/s | 689 kB 00:01 2026-02-24T09:05:21.834 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-24T09:05:22.047 INFO:teuthology.orchestra.run.trial090.stdout:(69/183): flexiblas-3.0.4-9.el9.x86_64.rpm 56 kB/s | 30 kB 00:00 2026-02-24T09:05:22.142 INFO:teuthology.orchestra.run.trial090.stdout:(70/183): bison-3.7.4-5.el9.x86_64.rpm 445 kB/s | 943 kB 00:02 2026-02-24T09:05:22.314 INFO:teuthology.orchestra.run.trial090.stdout:(71/183): flexiblas-openblas-openmp-3.0.4-9.el9 56 kB/s | 15 kB 00:00 2026-02-24T09:05:22.354 INFO:teuthology.orchestra.run.trial014.stdout:Extra Packages for Enterprise Linux 44 MB/s | 20 MB 00:00 2026-02-24T09:05:22.496 INFO:teuthology.orchestra.run.trial090.stdout:(72/183): libaio-devel-0.3.111-13.el9.x86_64.rp 31 kB/s | 11 kB 00:00 2026-02-24T09:05:22.987 INFO:teuthology.orchestra.run.trial004.stdout:(100/183): python3-lxml-4.6.5-3.el9.x86_64.rpm 880 kB/s | 1.2 MB 00:01 2026-02-24T09:05:23.091 INFO:teuthology.orchestra.run.trial004.stdout:(101/183): python3-markupsafe-1.1.1-12.el9.x86_ 334 kB/s | 35 kB 00:00 2026-02-24T09:05:23.172 INFO:teuthology.orchestra.run.trial090.stdout:(73/183): libpmemobj-1.12.1-1.el9.x86_64.rpm 237 kB/s | 160 kB 00:00 2026-02-24T09:05:23.248 INFO:teuthology.orchestra.run.trial090.stdout:(74/183): libnbd-1.20.3-4.el9.x86_64.rpm 175 kB/s | 164 kB 00:00 2026-02-24T09:05:23.562 INFO:teuthology.orchestra.run.trial090.stdout:(75/183): librabbitmq-0.11.0-7.el9.x86_64.rpm 116 kB/s | 45 kB 00:00 2026-02-24T09:05:23.731 INFO:teuthology.orchestra.run.trial090.stdout:(76/183): flexiblas-netlib-3.0.4-9.el9.x86_64.r 1.4 MB/s | 3.0 MB 00:02 2026-02-24T09:05:24.599 INFO:teuthology.orchestra.run.trial090.stdout:(77/183): libstoragemgmt-1.10.1-1.el9.x86_64.rp 237 kB/s | 246 kB 00:01 2026-02-24T09:05:24.713 INFO:teuthology.orchestra.run.trial090.stdout:(78/183): librdkafka-1.6.1-102.el9.x86_64.rpm 452 kB/s | 662 kB 00:01 2026-02-24T09:05:24.738 INFO:teuthology.orchestra.run.trial090.stdout:(79/183): libtool-2.4.6-46.el9.x86_64.rpm 577 kB/s | 581 kB 00:01 2026-02-24T09:05:24.909 INFO:teuthology.orchestra.run.trial090.stdout:(80/183): libuuid-devel-2.37.4-25.el9.x86_64.rp 73 kB/s | 23 kB 00:00 2026-02-24T09:05:25.037 INFO:teuthology.orchestra.run.trial090.stdout:(81/183): libzstd-devel-1.5.5-1.el9.x86_64.rpm 170 kB/s | 51 kB 00:00 2026-02-24T09:05:25.057 INFO:teuthology.orchestra.run.trial004.stdout:(102/183): postgresql-server-13.23-1.el9.x86_64 891 kB/s | 5.8 MB 00:06 2026-02-24T09:05:25.508 INFO:teuthology.orchestra.run.trial090.stdout:(82/183): libxslt-1.1.34-12.el9.x86_64.rpm 293 kB/s | 233 kB 00:00 2026-02-24T09:05:25.540 INFO:teuthology.orchestra.run.trial014.stdout:lab-extras 2.0 MB/s | 50 kB 00:00 2026-02-24T09:05:25.628 INFO:teuthology.orchestra.run.trial004.stdout:(103/183): python3-numpy-f2py-1.23.5-2.el9.x86_ 776 kB/s | 442 kB 00:00 2026-02-24T09:05:25.650 INFO:teuthology.orchestra.run.trial090.stdout:(83/183): lua-5.4.4-4.el9.x86_64.rpm 307 kB/s | 188 kB 00:00 2026-02-24T09:05:25.779 INFO:teuthology.orchestra.run.trial090.stdout:(84/183): lttng-ust-2.12.0-6.el9.x86_64.rpm 336 kB/s | 292 kB 00:00 2026-02-24T09:05:25.790 INFO:teuthology.orchestra.run.trial090.stdout:(85/183): openblas-0.3.29-1.el9.x86_64.rpm 149 kB/s | 42 kB 00:00 2026-02-24T09:05:25.810 INFO:teuthology.orchestra.run.trial004.stdout:(104/183): python3-packaging-20.9-5.el9.noarch. 423 kB/s | 77 kB 00:00 2026-02-24T09:05:26.026 INFO:teuthology.orchestra.run.trial090.stdout:(86/183): perl-Thread-Queue-3.14-460.el9.noarch 94 kB/s | 22 kB 00:00 2026-02-24T09:05:26.148 INFO:teuthology.orchestra.run.trial004.stdout:(105/183): python3-protobuf-3.14.0-17.el9.noarc 792 kB/s | 267 kB 00:00 2026-02-24T09:05:26.329 INFO:teuthology.orchestra.run.trial090.stdout:(87/183): perl-threads-2.25-460.el9.x86_64.rpm 193 kB/s | 58 kB 00:00 2026-02-24T09:05:26.408 INFO:teuthology.orchestra.run.trial004.stdout:(106/183): python3-pyasn1-0.4.8-7.el9.noarch.rp 605 kB/s | 157 kB 00:00 2026-02-24T09:05:26.509 INFO:teuthology.orchestra.run.trial090.stdout:(88/183): perl-threads-shared-1.61-460.el9.x86_ 249 kB/s | 45 kB 00:00 2026-02-24T09:05:26.712 INFO:teuthology.orchestra.run.trial004.stdout:(107/183): python3-babel-2.9.1-2.el9.noarch.rpm 887 kB/s | 6.0 MB 00:06 2026-02-24T09:05:26.724 INFO:teuthology.orchestra.run.trial014.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:05:26.725 INFO:teuthology.orchestra.run.trial014.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-24T09:05:26.730 INFO:teuthology.orchestra.run.trial014.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-24T09:05:26.731 INFO:teuthology.orchestra.run.trial014.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-24T09:05:26.731 INFO:teuthology.orchestra.run.trial014.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-24T09:05:26.732 INFO:teuthology.orchestra.run.trial014.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-24T09:05:26.732 INFO:teuthology.orchestra.run.trial014.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-24T09:05:26.734 INFO:teuthology.orchestra.run.trial014.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-24T09:05:26.734 INFO:teuthology.orchestra.run.trial014.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-24T09:05:26.745 INFO:teuthology.orchestra.run.trial004.stdout:(108/183): python3-pyasn1-modules-0.4.8-7.el9.n 822 kB/s | 277 kB 00:00 2026-02-24T09:05:26.762 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T09:05:26.767 INFO:teuthology.orchestra.run.trial014.stdout:======================================================================================= 2026-02-24T09:05:26.767 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-24T09:05:26.767 INFO:teuthology.orchestra.run.trial014.stdout:======================================================================================= 2026-02-24T09:05:26.767 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: ceph x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 k 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: ceph-base x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.2 M 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: ceph-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 987 k 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 148 k 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 950 k 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 184 k 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 15 M 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 7.4 M 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-rook noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 50 k 2026-02-24T09:05:26.768 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 167 k 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd-classic x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 16 M 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: ceph-radosgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 13 M 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: ceph-test x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 76 M 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: ceph-volume noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 301 k 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: cephadm noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 1.0 M 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: cephfs-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 243 k 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: cephfs-shell x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 27 k 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: cephfs-top noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 18 k 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 37 k 2026-02-24T09:05:26.769 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 909 k 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: librados-devel x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 123 k 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: libuuid-devel x86_64 2.37.4-25.el9 appstream 23 k 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: python3-cephfs x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 204 k 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: python3-rados x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 324 k 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: python3-rbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 304 k 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: python3-rgw x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 100 k 2026-02-24T09:05:26.770 INFO:teuthology.orchestra.run.trial014.stdout: rbd-fuse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 84 k 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: rbd-mirror x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.9 M 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: rbd-nbd x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 172 k 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout:Upgrading: 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: libblkid x86_64 2.37.4-25.el9 baseos 105 k 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: libfdisk x86_64 2.37.4-25.el9 baseos 152 k 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: libmount x86_64 2.37.4-25.el9 baseos 133 k 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: librados2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 3.5 M 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: librbd1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.8 M 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: libsmartcols x86_64 2.37.4-25.el9 baseos 61 k 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: libuuid x86_64 2.37.4-25.el9 baseos 26 k 2026-02-24T09:05:26.771 INFO:teuthology.orchestra.run.trial014.stdout: util-linux x86_64 2.37.4-25.el9 baseos 2.3 M 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: util-linux-core x86_64 2.37.4-25.el9 baseos 458 k 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 24 M 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 57 k 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mds x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 2.3 M 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 298 k 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 5.0 M 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd-crimson x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 19 M 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 17 k 2026-02-24T09:05:26.772 INFO:teuthology.orchestra.run.trial014.stdout: ceph-selinux x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 25 k 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 26 k 2026-02-24T09:05:26.773 INFO:teuthology.orchestra.run.trial014.stdout: libcephsqlite x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 159 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: libradosstriper1 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 247 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: librgw2 x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 6.5 M 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T09:05:26.774 INFO:teuthology.orchestra.run.trial014.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T09:05:26.775 INFO:teuthology.orchestra.run.trial014.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T09:05:26.776 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-argparse x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 45 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-common x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 186 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T09:05:26.777 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T09:05:26.778 INFO:teuthology.orchestra.run.trial014.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T09:05:26.779 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-24T09:05:26.780 INFO:teuthology.orchestra.run.trial014.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T09:05:26.781 INFO:teuthology.orchestra.run.trial014.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout:Installing weak dependencies: 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5537.g5bc9a1ff.el9 ceph-noarch 22 k 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-daemon x86_64 2:20.3.0-5537.g5bc9a1ff.el9 ceph 39 k 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T09:05:26.782 INFO:teuthology.orchestra.run.trial014.stdout:======================================================================================= 2026-02-24T09:05:26.783 INFO:teuthology.orchestra.run.trial014.stdout:Install 174 Packages 2026-02-24T09:05:26.783 INFO:teuthology.orchestra.run.trial014.stdout:Upgrade 9 Packages 2026-02-24T09:05:26.783 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:05:26.783 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 296 M 2026-02-24T09:05:26.783 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T09:05:26.817 INFO:teuthology.orchestra.run.trial004.stdout:(109/183): python3-requests-oauthlib-1.3.0-12.e 508 kB/s | 54 kB 00:00 2026-02-24T09:05:26.922 INFO:teuthology.orchestra.run.trial004.stdout:(110/183): python3-toml-0.10.2-6.el9.noarch.rpm 396 kB/s | 42 kB 00:00 2026-02-24T09:05:27.028 INFO:teuthology.orchestra.run.trial004.stdout:(111/183): python3-wcwidth-0.2.5-8.el9.noarch.r 419 kB/s | 44 kB 00:00 2026-02-24T09:05:27.369 INFO:teuthology.orchestra.run.trial004.stdout:(112/183): qatlib-25.08.0-2.el9.x86_64.rpm 702 kB/s | 240 kB 00:00 2026-02-24T09:05:27.475 INFO:teuthology.orchestra.run.trial004.stdout:(113/183): qatlib-service-25.08.0-2.el9.x86_64. 352 kB/s | 37 kB 00:00 2026-02-24T09:05:27.581 INFO:teuthology.orchestra.run.trial004.stdout:(114/183): qatzip-libs-1.3.1-1.el9.x86_64.rpm 627 kB/s | 66 kB 00:00 2026-02-24T09:05:27.704 INFO:teuthology.orchestra.run.trial014.stdout:(1/183): ceph-20.3.0-5537.g5bc9a1ff.el9.x86_64. 111 kB/s | 6.5 kB 00:00 2026-02-24T09:05:27.806 INFO:teuthology.orchestra.run.trial014.stdout:(2/183): ceph-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 9.5 MB/s | 987 kB 00:00 2026-02-24T09:05:27.845 INFO:teuthology.orchestra.run.trial014.stdout:(3/183): ceph-immutable-object-cache-20.3.0-553 3.7 MB/s | 148 kB 00:00 2026-02-24T09:05:27.919 INFO:teuthology.orchestra.run.trial014.stdout:(4/183): ceph-base-20.3.0-5537.g5bc9a1ff.el9.x8 19 MB/s | 5.2 MB 00:00 2026-02-24T09:05:27.973 INFO:teuthology.orchestra.run.trial014.stdout:(5/183): ceph-mgr-20.3.0-5537.g5bc9a1ff.el9.x86 17 MB/s | 950 kB 00:00 2026-02-24T09:05:27.990 INFO:teuthology.orchestra.run.trial014.stdout:(6/183): ceph-mds-20.3.0-5537.g5bc9a1ff.el9.x86 16 MB/s | 2.3 MB 00:00 2026-02-24T09:05:28.003 INFO:teuthology.orchestra.run.trial004.stdout:(115/183): socat-1.7.4.1-8.el9.x86_64.rpm 719 kB/s | 303 kB 00:00 2026-02-24T09:05:28.035 INFO:teuthology.orchestra.run.trial014.stdout:(7/183): ceph-osd-20.3.0-5537.g5bc9a1ff.el9.x86 3.6 MB/s | 167 kB 00:00 2026-02-24T09:05:28.108 INFO:teuthology.orchestra.run.trial004.stdout:(116/183): uuid-1.6.2-55.el9.x86_64.rpm 548 kB/s | 58 kB 00:00 2026-02-24T09:05:28.189 INFO:teuthology.orchestra.run.trial014.stdout:(8/183): ceph-mon-20.3.0-5537.g5bc9a1ff.el9.x86 23 MB/s | 5.0 MB 00:00 2026-02-24T09:05:28.292 INFO:teuthology.orchestra.run.trial004.stdout:(117/183): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 521 kB/s | 96 kB 00:00 2026-02-24T09:05:28.554 INFO:teuthology.orchestra.run.trial004.stdout:(118/183): xmlsec1-1.2.29-13.el9.x86_64.rpm 719 kB/s | 189 kB 00:00 2026-02-24T09:05:28.738 INFO:teuthology.orchestra.run.trial004.stdout:(119/183): xmlsec1-openssl-1.2.29-13.el9.x86_64 492 kB/s | 90 kB 00:00 2026-02-24T09:05:28.844 INFO:teuthology.orchestra.run.trial004.stdout:(120/183): xmlstarlet-1.6.1-20.el9.x86_64.rpm 602 kB/s | 64 kB 00:00 2026-02-24T09:05:28.949 INFO:teuthology.orchestra.run.trial004.stdout:(121/183): zlib-devel-1.2.11-41.el9.x86_64.rpm 427 kB/s | 45 kB 00:00 2026-02-24T09:05:28.979 INFO:teuthology.orchestra.run.trial014.stdout:(9/183): ceph-osd-classic-20.3.0-5537.g5bc9a1ff 17 MB/s | 16 MB 00:00 2026-02-24T09:05:29.012 INFO:teuthology.orchestra.run.trial014.stdout:(10/183): ceph-common-20.3.0-5537.g5bc9a1ff.el9 18 MB/s | 24 MB 00:01 2026-02-24T09:05:29.029 INFO:teuthology.orchestra.run.trial004.stdout:(122/183): lua-devel-5.4.4-4.el9.x86_64.rpm 278 kB/s | 22 kB 00:00 2026-02-24T09:05:29.041 INFO:teuthology.orchestra.run.trial014.stdout:(11/183): ceph-osd-crimson-20.3.0-5537.g5bc9a1f 22 MB/s | 19 MB 00:00 2026-02-24T09:05:29.041 INFO:teuthology.orchestra.run.trial014.stdout:(12/183): ceph-selinux-20.3.0-5537.g5bc9a1ff.el 860 kB/s | 25 kB 00:00 2026-02-24T09:05:29.058 INFO:teuthology.orchestra.run.trial014.stdout:(13/183): cephfs-mirror-20.3.0-5537.g5bc9a1ff.e 14 MB/s | 243 kB 00:00 2026-02-24T09:05:29.096 INFO:teuthology.orchestra.run.trial014.stdout:(14/183): cephfs-shell-20.3.0-5537.g5bc9a1ff.el 722 kB/s | 27 kB 00:00 2026-02-24T09:05:29.135 INFO:teuthology.orchestra.run.trial014.stdout:(15/183): libcephfs-daemon-20.3.0-5537.g5bc9a1f 1.0 MB/s | 39 kB 00:00 2026-02-24T09:05:29.174 INFO:teuthology.orchestra.run.trial014.stdout:(16/183): libcephfs-devel-20.3.0-5537.g5bc9a1ff 953 kB/s | 37 kB 00:00 2026-02-24T09:05:29.175 INFO:teuthology.orchestra.run.trial004.stdout:(123/183): protobuf-compiler-3.14.0-17.el9.x86_ 5.8 MB/s | 862 kB 00:00 2026-02-24T09:05:29.213 INFO:teuthology.orchestra.run.trial014.stdout:(17/183): libcephfs-proxy2-20.3.0-5537.g5bc9a1f 674 kB/s | 26 kB 00:00 2026-02-24T09:05:29.269 INFO:teuthology.orchestra.run.trial014.stdout:(18/183): libcephfs2-20.3.0-5537.g5bc9a1ff.el9. 16 MB/s | 909 kB 00:00 2026-02-24T09:05:29.312 INFO:teuthology.orchestra.run.trial014.stdout:(19/183): libcephsqlite-20.3.0-5537.g5bc9a1ff.e 3.7 MB/s | 159 kB 00:00 2026-02-24T09:05:29.352 INFO:teuthology.orchestra.run.trial014.stdout:(20/183): librados-devel-20.3.0-5537.g5bc9a1ff. 2.9 MB/s | 123 kB 00:00 2026-02-24T09:05:29.396 INFO:teuthology.orchestra.run.trial014.stdout:(21/183): libradosstriper1-20.3.0-5537.g5bc9a1f 5.6 MB/s | 247 kB 00:00 2026-02-24T09:05:29.407 INFO:teuthology.orchestra.run.trial004.stdout:(124/183): abseil-cpp-20211102.0-4.el9.x86_64.r 2.3 MB/s | 551 kB 00:00 2026-02-24T09:05:29.442 INFO:teuthology.orchestra.run.trial004.stdout:(125/183): gperftools-libs-2.9.1-3.el9.x86_64.r 8.8 MB/s | 308 kB 00:00 2026-02-24T09:05:29.474 INFO:teuthology.orchestra.run.trial004.stdout:(126/183): grpc-data-1.46.7-10.el9.noarch.rpm 610 kB/s | 19 kB 00:00 2026-02-24T09:05:29.557 INFO:teuthology.orchestra.run.trial014.stdout:(22/183): ceph-radosgw-20.3.0-5537.g5bc9a1ff.el 23 MB/s | 13 MB 00:00 2026-02-24T09:05:29.590 INFO:teuthology.orchestra.run.trial014.stdout:(23/183): python3-ceph-argparse-20.3.0-5537.g5b 1.3 MB/s | 45 kB 00:00 2026-02-24T09:05:29.634 INFO:teuthology.orchestra.run.trial014.stdout:(24/183): python3-ceph-common-20.3.0-5537.g5bc9 4.2 MB/s | 186 kB 00:00 2026-02-24T09:05:29.651 INFO:teuthology.orchestra.run.trial004.stdout:(127/183): libarrow-9.0.0-15.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2026-02-24T09:05:29.679 INFO:teuthology.orchestra.run.trial014.stdout:(25/183): python3-cephfs-20.3.0-5537.g5bc9a1ff. 4.4 MB/s | 204 kB 00:00 2026-02-24T09:05:29.683 INFO:teuthology.orchestra.run.trial004.stdout:(128/183): libarrow-doc-9.0.0-15.el9.noarch.rpm 771 kB/s | 25 kB 00:00 2026-02-24T09:05:29.715 INFO:teuthology.orchestra.run.trial004.stdout:(129/183): liboath-2.6.12-1.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2026-02-24T09:05:29.720 INFO:teuthology.orchestra.run.trial014.stdout:(26/183): librgw2-20.3.0-5537.g5bc9a1ff.el9.x86 20 MB/s | 6.5 MB 00:00 2026-02-24T09:05:29.721 INFO:teuthology.orchestra.run.trial014.stdout:(27/183): python3-rados-20.3.0-5537.g5bc9a1ff.e 7.5 MB/s | 324 kB 00:00 2026-02-24T09:05:29.725 INFO:teuthology.orchestra.run.trial090.stdout:(89/183): openblas-openmp-0.3.29-1.el9.x86_64.r 1.3 MB/s | 5.3 MB 00:04 2026-02-24T09:05:29.747 INFO:teuthology.orchestra.run.trial014.stdout:(28/183): python3-rbd-20.3.0-5537.g5bc9a1ff.el9 11 MB/s | 304 kB 00:00 2026-02-24T09:05:29.748 INFO:teuthology.orchestra.run.trial004.stdout:(130/183): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2026-02-24T09:05:29.751 INFO:teuthology.orchestra.run.trial014.stdout:(29/183): python3-rgw-20.3.0-5537.g5bc9a1ff.el9 3.4 MB/s | 100 kB 00:00 2026-02-24T09:05:29.773 INFO:teuthology.orchestra.run.trial014.stdout:(30/183): rbd-fuse-20.3.0-5537.g5bc9a1ff.el9.x8 3.3 MB/s | 84 kB 00:00 2026-02-24T09:05:29.782 INFO:teuthology.orchestra.run.trial004.stdout:(131/183): luarocks-3.9.2-5.el9.noarch.rpm 4.3 MB/s | 151 kB 00:00 2026-02-24T09:05:29.815 INFO:teuthology.orchestra.run.trial014.stdout:(31/183): rbd-nbd-20.3.0-5537.g5bc9a1ff.el9.x86 4.0 MB/s | 172 kB 00:00 2026-02-24T09:05:29.830 INFO:teuthology.orchestra.run.trial004.stdout:(132/183): parquet-libs-9.0.0-15.el9.x86_64.rpm 17 MB/s | 838 kB 00:00 2026-02-24T09:05:29.855 INFO:teuthology.orchestra.run.trial014.stdout:(32/183): ceph-grafana-dashboards-20.3.0-5537.g 1.4 MB/s | 57 kB 00:00 2026-02-24T09:05:29.895 INFO:teuthology.orchestra.run.trial014.stdout:(33/183): ceph-mgr-cephadm-20.3.0-5537.g5bc9a1f 4.5 MB/s | 184 kB 00:00 2026-02-24T09:05:29.898 INFO:teuthology.orchestra.run.trial004.stdout:(133/183): python3-asyncssh-2.13.2-5.el9.noarch 7.9 MB/s | 548 kB 00:00 2026-02-24T09:05:29.899 INFO:teuthology.orchestra.run.trial014.stdout:(34/183): rbd-mirror-20.3.0-5537.g5bc9a1ff.el9. 19 MB/s | 2.9 MB 00:00 2026-02-24T09:05:29.914 INFO:teuthology.orchestra.run.trial090.stdout:(90/183): postgresql-13.23-1.el9.x86_64.rpm 488 kB/s | 1.6 MB 00:03 2026-02-24T09:05:29.931 INFO:teuthology.orchestra.run.trial004.stdout:(134/183): python3-autocommand-2.2.2-8.el9.noar 901 kB/s | 29 kB 00:00 2026-02-24T09:05:29.964 INFO:teuthology.orchestra.run.trial004.stdout:(135/183): python3-backports-tarfile-1.2.0-1.el 1.8 MB/s | 60 kB 00:00 2026-02-24T09:05:29.997 INFO:teuthology.orchestra.run.trial004.stdout:(136/183): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2026-02-24T09:05:30.029 INFO:teuthology.orchestra.run.trial004.stdout:(137/183): python3-cachetools-4.2.4-1.el9.noarc 999 kB/s | 32 kB 00:00 2026-02-24T09:05:30.063 INFO:teuthology.orchestra.run.trial004.stdout:(138/183): python3-certifi-2023.05.07-4.el9.noa 419 kB/s | 14 kB 00:00 2026-02-24T09:05:30.104 INFO:teuthology.orchestra.run.trial004.stdout:(139/183): python3-numpy-1.23.5-2.el9.x86_64.rp 895 kB/s | 6.1 MB 00:07 2026-02-24T09:05:30.105 INFO:teuthology.orchestra.run.trial004.stdout:(140/183): python3-cheroot-10.0.1-4.el9.noarch. 4.1 MB/s | 173 kB 00:00 2026-02-24T09:05:30.143 INFO:teuthology.orchestra.run.trial004.stdout:(141/183): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.8 MB/s | 303 kB 00:00 2026-02-24T09:05:30.178 INFO:teuthology.orchestra.run.trial004.stdout:(142/183): python3-google-auth-2.45.0-1.el9.noa 7.1 MB/s | 254 kB 00:00 2026-02-24T09:05:30.306 INFO:teuthology.orchestra.run.trial004.stdout:(143/183): python3-grpcio-1.46.7-10.el9.x86_64. 16 MB/s | 2.0 MB 00:00 2026-02-24T09:05:30.309 INFO:teuthology.orchestra.run.trial004.stdout:(144/183): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2026-02-24T09:05:30.341 INFO:teuthology.orchestra.run.trial004.stdout:(145/183): python3-grpcio-tools-1.46.7-10.el9.x 4.1 MB/s | 144 kB 00:00 2026-02-24T09:05:30.346 INFO:teuthology.orchestra.run.trial004.stdout:(146/183): python3-influxdb-5.3.1-1.el9.noarch. 3.7 MB/s | 139 kB 00:00 2026-02-24T09:05:30.355 INFO:teuthology.orchestra.run.trial090.stdout:(91/183): postgresql-private-libs-13.23-1.el9.x 314 kB/s | 138 kB 00:00 2026-02-24T09:05:30.374 INFO:teuthology.orchestra.run.trial004.stdout:(147/183): python3-isodate-0.6.1-3.el9.noarch.r 1.6 MB/s | 56 kB 00:00 2026-02-24T09:05:30.380 INFO:teuthology.orchestra.run.trial004.stdout:(148/183): python3-jaraco-8.2.1-3.el9.noarch.rp 310 kB/s | 11 kB 00:00 2026-02-24T09:05:30.407 INFO:teuthology.orchestra.run.trial004.stdout:(149/183): python3-jaraco-classes-3.2.1-5.el9.n 541 kB/s | 18 kB 00:00 2026-02-24T09:05:30.415 INFO:teuthology.orchestra.run.trial004.stdout:(150/183): python3-jaraco-collections-3.0.0-8.e 659 kB/s | 23 kB 00:00 2026-02-24T09:05:30.439 INFO:teuthology.orchestra.run.trial004.stdout:(151/183): python3-jaraco-context-6.0.1-3.el9.n 603 kB/s | 20 kB 00:00 2026-02-24T09:05:30.450 INFO:teuthology.orchestra.run.trial004.stdout:(152/183): python3-jaraco-functools-3.5.0-2.el9 558 kB/s | 19 kB 00:00 2026-02-24T09:05:30.473 INFO:teuthology.orchestra.run.trial004.stdout:(153/183): python3-jaraco-text-4.0.0-2.el9.noar 805 kB/s | 26 kB 00:00 2026-02-24T09:05:30.485 INFO:teuthology.orchestra.run.trial014.stdout:(35/183): ceph-mgr-diskprediction-local-20.3.0- 13 MB/s | 7.4 MB 00:00 2026-02-24T09:05:30.506 INFO:teuthology.orchestra.run.trial004.stdout:(154/183): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2026-02-24T09:05:30.531 INFO:teuthology.orchestra.run.trial014.stdout:(36/183): ceph-mgr-k8sevents-20.3.0-5537.g5bc9a 493 kB/s | 22 kB 00:00 2026-02-24T09:05:30.537 INFO:teuthology.orchestra.run.trial004.stdout:(155/183): python3-kubernetes-26.1.0-3.el9.noar 12 MB/s | 1.0 MB 00:00 2026-02-24T09:05:30.540 INFO:teuthology.orchestra.run.trial004.stdout:(156/183): python3-msgpack-1.0.3-2.el9.x86_64.r 2.5 MB/s | 86 kB 00:00 2026-02-24T09:05:30.572 INFO:teuthology.orchestra.run.trial004.stdout:(157/183): python3-portend-3.1.0-2.el9.noarch.r 509 kB/s | 16 kB 00:00 2026-02-24T09:05:30.573 INFO:teuthology.orchestra.run.trial004.stdout:(158/183): python3-natsort-7.1.1-5.el9.noarch.r 1.6 MB/s | 58 kB 00:00 2026-02-24T09:05:30.579 INFO:teuthology.orchestra.run.trial014.stdout:(37/183): ceph-mgr-modules-core-20.3.0-5537.g5b 6.1 MB/s | 298 kB 00:00 2026-02-24T09:05:30.608 INFO:teuthology.orchestra.run.trial004.stdout:(159/183): python3-pyperclip-1.8.2-2.el9.noarch 804 kB/s | 28 kB 00:00 2026-02-24T09:05:30.611 INFO:teuthology.orchestra.run.trial014.stdout:(38/183): ceph-mgr-dashboard-20.3.0-5537.g5bc9a 21 MB/s | 15 MB 00:00 2026-02-24T09:05:30.611 INFO:teuthology.orchestra.run.trial014.stdout:(39/183): ceph-mgr-rook-20.3.0-5537.g5bc9a1ff.e 1.5 MB/s | 50 kB 00:00 2026-02-24T09:05:30.623 INFO:teuthology.orchestra.run.trial014.stdout:(40/183): ceph-prometheus-alerts-20.3.0-5537.g5 1.4 MB/s | 17 kB 00:00 2026-02-24T09:05:30.640 INFO:teuthology.orchestra.run.trial014.stdout:(41/183): ceph-volume-20.3.0-5537.g5bc9a1ff.el9 10 MB/s | 301 kB 00:00 2026-02-24T09:05:30.643 INFO:teuthology.orchestra.run.trial004.stdout:(160/183): python3-repoze-lru-0.7-16.el9.noarch 875 kB/s | 31 kB 00:00 2026-02-24T09:05:30.671 INFO:teuthology.orchestra.run.trial014.stdout:(42/183): cephadm-20.3.0-5537.g5bc9a1ff.el9.noa 21 MB/s | 1.0 MB 00:00 2026-02-24T09:05:30.680 INFO:teuthology.orchestra.run.trial014.stdout:(43/183): cephfs-top-20.3.0-5537.g5bc9a1ff.el9. 459 kB/s | 18 kB 00:00 2026-02-24T09:05:30.680 INFO:teuthology.orchestra.run.trial004.stdout:(161/183): python3-routes-2.5.1-5.el9.noarch.rp 5.0 MB/s | 188 kB 00:00 2026-02-24T09:05:30.693 INFO:teuthology.orchestra.run.trial004.stdout:(162/183): python3-pyOpenSSL-21.0.0-1.el9.noarc 742 kB/s | 90 kB 00:00 2026-02-24T09:05:30.716 INFO:teuthology.orchestra.run.trial004.stdout:(163/183): python3-rsa-4.9-2.el9.noarch.rpm 1.6 MB/s | 59 kB 00:00 2026-02-24T09:05:30.728 INFO:teuthology.orchestra.run.trial004.stdout:(164/183): python3-saml-1.16.0-1.el9.noarch.rpm 3.6 MB/s | 125 kB 00:00 2026-02-24T09:05:30.751 INFO:teuthology.orchestra.run.trial004.stdout:(165/183): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2026-02-24T09:05:30.761 INFO:teuthology.orchestra.run.trial004.stdout:(166/183): python3-typing-extensions-4.15.0-1.e 2.5 MB/s | 86 kB 00:00 2026-02-24T09:05:30.788 INFO:teuthology.orchestra.run.trial004.stdout:(167/183): python3-websocket-client-1.2.3-2.el9 2.4 MB/s | 90 kB 00:00 2026-02-24T09:05:30.794 INFO:teuthology.orchestra.run.trial004.stdout:(168/183): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.4 MB/s | 48 kB 00:00 2026-02-24T09:05:30.822 INFO:teuthology.orchestra.run.trial004.stdout:(169/183): python3-xmltodict-0.12.0-15.el9.noar 634 kB/s | 22 kB 00:00 2026-02-24T09:05:30.826 INFO:teuthology.orchestra.run.trial004.stdout:(170/183): python3-zc-lockfile-2.0-10.el9.noarc 618 kB/s | 20 kB 00:00 2026-02-24T09:05:30.859 INFO:teuthology.orchestra.run.trial004.stdout:(171/183): re2-20211101-20.el9.x86_64.rpm 5.2 MB/s | 191 kB 00:00 2026-02-24T09:05:30.896 INFO:teuthology.orchestra.run.trial004.stdout:(172/183): thrift-0.15.0-4.el9.x86_64.rpm 23 MB/s | 1.6 MB 00:00 2026-02-24T09:05:30.897 INFO:teuthology.orchestra.run.trial004.stdout:(173/183): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.2 MB/s | 122 kB 00:00 2026-02-24T09:05:31.175 INFO:teuthology.orchestra.run.trial004.stdout:(174/183): librbd1-20.3.0-5537.g5bc9a1ff.el9.x8 10 MB/s | 2.8 MB 00:00 2026-02-24T09:05:31.217 INFO:teuthology.orchestra.run.trial014.stdout:(44/183): cryptsetup-2.8.1-3.el9.x86_64.rpm 644 kB/s | 351 kB 00:00 2026-02-24T09:05:31.248 INFO:teuthology.orchestra.run.trial004.stdout:(175/183): librados2-20.3.0-5537.g5bc9a1ff.el9. 9.9 MB/s | 3.5 MB 00:00 2026-02-24T09:05:31.300 INFO:teuthology.orchestra.run.trial014.stdout:(45/183): ledmon-libs-1.1.0-3.el9.x86_64.rpm 483 kB/s | 40 kB 00:00 2026-02-24T09:05:31.402 INFO:teuthology.orchestra.run.trial014.stdout:(46/183): ceph-test-20.3.0-5537.g5bc9a1ff.el9.x 32 MB/s | 76 MB 00:02 2026-02-24T09:05:31.402 INFO:teuthology.orchestra.run.trial014.stdout:(47/183): libatomic-11.5.0-14.el9.x86_64.rpm 224 kB/s | 23 kB 00:00 2026-02-24T09:05:31.480 INFO:teuthology.orchestra.run.trial014.stdout:(48/183): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.6 MB/s | 2.1 MB 00:00 2026-02-24T09:05:31.564 INFO:teuthology.orchestra.run.trial014.stdout:(49/183): libquadmath-11.5.0-14.el9.x86_64.rpm 2.2 MB/s | 184 kB 00:00 2026-02-24T09:05:31.576 INFO:teuthology.orchestra.run.trial004.stdout:(176/183): libblkid-2.37.4-25.el9.x86_64.rpm 262 kB/s | 105 kB 00:00 2026-02-24T09:05:31.613 INFO:teuthology.orchestra.run.trial014.stdout:(50/183): libgfortran-11.5.0-14.el9.x86_64.rpm 3.7 MB/s | 794 kB 00:00 2026-02-24T09:05:31.644 INFO:teuthology.orchestra.run.trial014.stdout:(51/183): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2026-02-24T09:05:31.692 INFO:teuthology.orchestra.run.trial004.stdout:(177/183): libfdisk-2.37.4-25.el9.x86_64.rpm 341 kB/s | 152 kB 00:00 2026-02-24T09:05:31.693 INFO:teuthology.orchestra.run.trial014.stdout:(52/183): mailcap-2.1.49-5.el9.noarch.rpm 414 kB/s | 33 kB 00:00 2026-02-24T09:05:31.737 INFO:teuthology.orchestra.run.trial004.stdout:(178/183): libmount-2.37.4-25.el9.x86_64.rpm 822 kB/s | 133 kB 00:00 2026-02-24T09:05:31.755 INFO:teuthology.orchestra.run.trial090.stdout:(92/183): postgresql-contrib-13.23-1.el9.x86_64 445 kB/s | 903 kB 00:02 2026-02-24T09:05:31.760 INFO:teuthology.orchestra.run.trial014.stdout:(53/183): libconfig-1.7.2-9.el9.x86_64.rpm 201 kB/s | 72 kB 00:00 2026-02-24T09:05:31.763 INFO:teuthology.orchestra.run.trial014.stdout:(54/183): nvme-cli-2.16-1.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2026-02-24T09:05:31.776 INFO:teuthology.orchestra.run.trial014.stdout:(55/183): pciutils-3.7.0-7.el9.x86_64.rpm 1.1 MB/s | 93 kB 00:00 2026-02-24T09:05:31.792 INFO:teuthology.orchestra.run.trial004.stdout:(179/183): libsmartcols-2.37.4-25.el9.x86_64.rp 610 kB/s | 61 kB 00:00 2026-02-24T09:05:31.821 INFO:teuthology.orchestra.run.trial004.stdout:(180/183): libuuid-2.37.4-25.el9.x86_64.rpm 308 kB/s | 26 kB 00:00 2026-02-24T09:05:31.860 INFO:teuthology.orchestra.run.trial014.stdout:(56/183): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2026-02-24T09:05:31.886 INFO:teuthology.orchestra.run.trial014.stdout:(57/183): python3-cryptography-36.0.1-5.el9.x86 10 MB/s | 1.2 MB 00:00 2026-02-24T09:05:31.947 INFO:teuthology.orchestra.run.trial014.stdout:(58/183): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2026-02-24T09:05:31.968 INFO:teuthology.orchestra.run.trial014.stdout:(59/183): python3-pyparsing-2.4.7-9.el9.noarch. 1.8 MB/s | 150 kB 00:00 2026-02-24T09:05:32.014 INFO:teuthology.orchestra.run.trial014.stdout:(60/183): python3-cffi-1.14.5-5.el9.x86_64.rpm 996 kB/s | 253 kB 00:00 2026-02-24T09:05:32.024 INFO:teuthology.orchestra.run.trial004.stdout:(181/183): util-linux-core-2.37.4-25.el9.x86_64 2.2 MB/s | 458 kB 00:00 2026-02-24T09:05:32.033 INFO:teuthology.orchestra.run.trial014.stdout:(61/183): python3-requests-2.25.1-10.el9.noarch 1.4 MB/s | 126 kB 00:00 2026-02-24T09:05:32.052 INFO:teuthology.orchestra.run.trial014.stdout:(62/183): python3-urllib3-1.26.5-7.el9.noarch.r 2.5 MB/s | 218 kB 00:00 2026-02-24T09:05:32.126 INFO:teuthology.orchestra.run.trial014.stdout:(63/183): unzip-6.0-59.el9.x86_64.rpm 1.6 MB/s | 182 kB 00:00 2026-02-24T09:05:32.127 INFO:teuthology.orchestra.run.trial014.stdout:(64/183): zip-3.0-35.el9.x86_64.rpm 2.8 MB/s | 266 kB 00:00 2026-02-24T09:05:32.195 INFO:teuthology.orchestra.run.trial004.stdout:(182/183): util-linux-2.37.4-25.el9.x86_64.rpm 5.6 MB/s | 2.3 MB 00:00 2026-02-24T09:05:33.000 INFO:teuthology.orchestra.run.trial014.stdout:(65/183): boost-program-options-1.75.0-13.el9.x 119 kB/s | 104 kB 00:00 2026-02-24T09:05:33.342 INFO:teuthology.orchestra.run.trial090.stdout:(93/183): openssl-devel-3.5.5-1.el9.x86_64.rpm 650 kB/s | 4.8 MB 00:07 2026-02-24T09:05:33.393 INFO:teuthology.orchestra.run.trial014.stdout:(66/183): elfutils-libelf-devel-0.194-1.el9.x86 202 kB/s | 79 kB 00:00 2026-02-24T09:05:33.434 INFO:teuthology.orchestra.run.trial014.stdout:(67/183): automake-1.16.2-8.el9.noarch.rpm 499 kB/s | 689 kB 00:01 2026-02-24T09:05:33.671 INFO:teuthology.orchestra.run.trial014.stdout:(68/183): flexiblas-3.0.4-9.el9.x86_64.rpm 125 kB/s | 30 kB 00:00 2026-02-24T09:05:33.749 INFO:teuthology.orchestra.run.trial090.stdout:(94/183): protobuf-3.14.0-17.el9.x86_64.rpm 516 kB/s | 1.0 MB 00:01 2026-02-24T09:05:33.780 INFO:teuthology.orchestra.run.trial014.stdout:(69/183): bison-3.7.4-5.el9.x86_64.rpm 570 kB/s | 943 kB 00:01 2026-02-24T09:05:33.864 INFO:teuthology.orchestra.run.trial014.stdout:(70/183): flex-2.6.4-9.el9.x86_64.rpm 665 kB/s | 313 kB 00:00 2026-02-24T09:05:33.938 INFO:teuthology.orchestra.run.trial014.stdout:(71/183): flexiblas-openblas-openmp-3.0.4-9.el9 94 kB/s | 15 kB 00:00 2026-02-24T09:05:34.021 INFO:teuthology.orchestra.run.trial014.stdout:(72/183): libaio-devel-0.3.111-13.el9.x86_64.rp 71 kB/s | 11 kB 00:00 2026-02-24T09:05:34.253 INFO:teuthology.orchestra.run.trial014.stdout:(73/183): libnbd-1.20.3-4.el9.x86_64.rpm 520 kB/s | 164 kB 00:00 2026-02-24T09:05:34.316 INFO:teuthology.orchestra.run.trial090.stdout:(95/183): python3-colorama-0.4.6-3.el9.noarch.r 108 kB/s | 61 kB 00:00 2026-02-24T09:05:34.336 INFO:teuthology.orchestra.run.trial014.stdout:(74/183): libpmemobj-1.12.1-1.el9.x86_64.rpm 508 kB/s | 160 kB 00:00 2026-02-24T09:05:34.411 INFO:teuthology.orchestra.run.trial014.stdout:(75/183): librabbitmq-0.11.0-7.el9.x86_64.rpm 287 kB/s | 45 kB 00:00 2026-02-24T09:05:34.805 INFO:teuthology.orchestra.run.trial014.stdout:(76/183): libstoragemgmt-1.10.1-1.el9.x86_64.rp 626 kB/s | 246 kB 00:00 2026-02-24T09:05:34.816 INFO:teuthology.orchestra.run.trial090.stdout:(96/183): python3-babel-2.9.1-2.el9.noarch.rpm 4.0 MB/s | 6.0 MB 00:01 2026-02-24T09:05:34.963 INFO:teuthology.orchestra.run.trial090.stdout:(97/183): python3-devel-3.9.25-3.el9.x86_64.rpm 378 kB/s | 244 kB 00:00 2026-02-24T09:05:35.198 INFO:teuthology.orchestra.run.trial090.stdout:(98/183): python3-jinja2-2.11.3-8.el9.noarch.rp 650 kB/s | 249 kB 00:00 2026-02-24T09:05:35.199 INFO:teuthology.orchestra.run.trial014.stdout:(77/183): librdkafka-1.6.1-102.el9.x86_64.rpm 768 kB/s | 662 kB 00:00 2026-02-24T09:05:35.320 INFO:teuthology.orchestra.run.trial090.stdout:(99/183): python3-jmespath-1.0.1-1.el9.noarch.r 133 kB/s | 48 kB 00:00 2026-02-24T09:05:35.357 INFO:teuthology.orchestra.run.trial014.stdout:(78/183): libuuid-devel-2.37.4-25.el9.x86_64.rp 143 kB/s | 23 kB 00:00 2026-02-24T09:05:35.576 INFO:teuthology.orchestra.run.trial090.stdout:(100/183): postgresql-server-13.23-1.el9.x86_64 1.1 MB/s | 5.8 MB 00:05 2026-02-24T09:05:35.589 INFO:teuthology.orchestra.run.trial014.stdout:(79/183): libtool-2.4.6-46.el9.x86_64.rpm 740 kB/s | 581 kB 00:00 2026-02-24T09:05:35.696 INFO:teuthology.orchestra.run.trial090.stdout:(101/183): python3-libstoragemgmt-1.10.1-1.el9. 355 kB/s | 177 kB 00:00 2026-02-24T09:05:35.747 INFO:teuthology.orchestra.run.trial014.stdout:(80/183): libzstd-devel-1.5.5-1.el9.x86_64.rpm 323 kB/s | 51 kB 00:00 2026-02-24T09:05:35.749 INFO:teuthology.orchestra.run.trial014.stdout:(81/183): libxslt-1.1.34-12.el9.x86_64.rpm 593 kB/s | 233 kB 00:00 2026-02-24T09:05:35.894 INFO:teuthology.orchestra.run.trial090.stdout:(102/183): python3-markupsafe-1.1.1-12.el9.x86_ 109 kB/s | 35 kB 00:00 2026-02-24T09:05:36.065 INFO:teuthology.orchestra.run.trial014.stdout:(82/183): lua-5.4.4-4.el9.x86_64.rpm 598 kB/s | 188 kB 00:00 2026-02-24T09:05:36.111 INFO:teuthology.orchestra.run.trial090.stdout:(103/183): python3-numpy-f2py-1.23.5-2.el9.x86_ 2.0 MB/s | 442 kB 00:00 2026-02-24T09:05:36.218 INFO:teuthology.orchestra.run.trial014.stdout:(83/183): lttng-ust-2.12.0-6.el9.x86_64.rpm 621 kB/s | 292 kB 00:00 2026-02-24T09:05:36.222 INFO:teuthology.orchestra.run.trial014.stdout:(84/183): openblas-0.3.29-1.el9.x86_64.rpm 267 kB/s | 42 kB 00:00 2026-02-24T09:05:36.418 INFO:teuthology.orchestra.run.trial014.stdout:(85/183): flexiblas-netlib-3.0.4-9.el9.x86_64.r 1.1 MB/s | 3.0 MB 00:02 2026-02-24T09:05:36.431 INFO:teuthology.orchestra.run.trial090.stdout:(104/183): python3-packaging-20.9-5.el9.noarch. 241 kB/s | 77 kB 00:00 2026-02-24T09:05:36.576 INFO:teuthology.orchestra.run.trial014.stdout:(86/183): perl-Thread-Queue-3.14-460.el9.noarch 141 kB/s | 22 kB 00:00 2026-02-24T09:05:36.734 INFO:teuthology.orchestra.run.trial014.stdout:(87/183): perl-threads-2.25-460.el9.x86_64.rpm 369 kB/s | 58 kB 00:00 2026-02-24T09:05:36.892 INFO:teuthology.orchestra.run.trial014.stdout:(88/183): perl-threads-shared-1.61-460.el9.x86_ 283 kB/s | 45 kB 00:00 2026-02-24T09:05:37.078 INFO:teuthology.orchestra.run.trial090.stdout:(105/183): python3-numpy-1.23.5-2.el9.x86_64.rp 4.4 MB/s | 6.1 MB 00:01 2026-02-24T09:05:37.105 INFO:teuthology.orchestra.run.trial090.stdout:(106/183): python3-pyasn1-0.4.8-7.el9.noarch.rp 5.6 MB/s | 157 kB 00:00 2026-02-24T09:05:37.114 INFO:teuthology.orchestra.run.trial090.stdout:(107/183): python3-protobuf-3.14.0-17.el9.noarc 392 kB/s | 267 kB 00:00 2026-02-24T09:05:37.402 INFO:teuthology.orchestra.run.trial090.stdout:(108/183): python3-lxml-4.6.5-3.el9.x86_64.rpm 601 kB/s | 1.2 MB 00:02 2026-02-24T09:05:37.466 INFO:teuthology.orchestra.run.trial090.stdout:(109/183): python3-requests-oauthlib-1.3.0-12.e 152 kB/s | 54 kB 00:00 2026-02-24T09:05:37.521 INFO:teuthology.orchestra.run.trial014.stdout:(89/183): postgresql-13.23-1.el9.x86_64.rpm 2.6 MB/s | 1.6 MB 00:00 2026-02-24T09:05:37.550 INFO:teuthology.orchestra.run.trial090.stdout:(110/183): python3-pyasn1-modules-0.4.8-7.el9.n 622 kB/s | 277 kB 00:00 2026-02-24T09:05:37.579 INFO:teuthology.orchestra.run.trial090.stdout:(111/183): python3-toml-0.10.2-6.el9.noarch.rpm 369 kB/s | 42 kB 00:00 2026-02-24T09:05:37.828 INFO:teuthology.orchestra.run.trial090.stdout:(112/183): python3-wcwidth-0.2.5-8.el9.noarch.r 159 kB/s | 44 kB 00:00 2026-02-24T09:05:37.837 INFO:teuthology.orchestra.run.trial014.stdout:(90/183): postgresql-contrib-13.23-1.el9.x86_64 2.8 MB/s | 903 kB 00:00 2026-02-24T09:05:37.894 INFO:teuthology.orchestra.run.trial004.stdout:(183/183): python3-scipy-1.9.3-2.el9.x86_64.rpm 1.7 MB/s | 19 MB 00:11 2026-02-24T09:05:37.897 INFO:teuthology.orchestra.run.trial004.stdout:-------------------------------------------------------------------------------- 2026-02-24T09:05:37.897 INFO:teuthology.orchestra.run.trial004.stdout:Total 8.9 MB/s | 296 MB 00:33 2026-02-24T09:05:37.951 INFO:teuthology.orchestra.run.trial090.stdout:(113/183): qatlib-25.08.0-2.el9.x86_64.rpm 644 kB/s | 240 kB 00:00 2026-02-24T09:05:37.996 INFO:teuthology.orchestra.run.trial014.stdout:(91/183): postgresql-private-libs-13.23-1.el9.x 872 kB/s | 138 kB 00:00 2026-02-24T09:05:38.049 INFO:teuthology.orchestra.run.trial090.stdout:(114/183): qatlib-service-25.08.0-2.el9.x86_64. 168 kB/s | 37 kB 00:00 2026-02-24T09:05:38.109 INFO:teuthology.orchestra.run.trial090.stdout:(115/183): qatzip-libs-1.3.1-1.el9.x86_64.rpm 418 kB/s | 66 kB 00:00 2026-02-24T09:05:38.475 INFO:teuthology.orchestra.run.trial090.stdout:(116/183): uuid-1.6.2-55.el9.x86_64.rpm 158 kB/s | 58 kB 00:00 2026-02-24T09:05:38.661 INFO:teuthology.orchestra.run.trial004.stdout:Running transaction check 2026-02-24T09:05:38.735 INFO:teuthology.orchestra.run.trial004.stdout:Transaction check succeeded. 2026-02-24T09:05:38.735 INFO:teuthology.orchestra.run.trial004.stdout:Running transaction test 2026-02-24T09:05:38.833 INFO:teuthology.orchestra.run.trial090.stdout:(117/183): socat-1.7.4.1-8.el9.x86_64.rpm 387 kB/s | 303 kB 00:00 2026-02-24T09:05:39.001 INFO:teuthology.orchestra.run.trial090.stdout:(118/183): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 182 kB/s | 96 kB 00:00 2026-02-24T09:05:39.185 INFO:teuthology.orchestra.run.trial014.stdout:(92/183): postgresql-server-13.23-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2026-02-24T09:05:39.402 INFO:teuthology.orchestra.run.trial090.stdout:(119/183): xmlsec1-openssl-1.2.29-13.el9.x86_64 226 kB/s | 90 kB 00:00 2026-02-24T09:05:39.501 INFO:teuthology.orchestra.run.trial014.stdout:(93/183): protobuf-3.14.0-17.el9.x86_64.rpm 3.2 MB/s | 1.0 MB 00:00 2026-02-24T09:05:39.512 INFO:teuthology.orchestra.run.trial090.stdout:(120/183): xmlsec1-1.2.29-13.el9.x86_64.rpm 278 kB/s | 189 kB 00:00 2026-02-24T09:05:39.565 INFO:teuthology.orchestra.run.trial090.stdout:(121/183): xmlstarlet-1.6.1-20.el9.x86_64.rpm 390 kB/s | 64 kB 00:00 2026-02-24T09:05:39.587 INFO:teuthology.orchestra.run.trial090.stdout:(122/183): lua-devel-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 22 kB 00:00 2026-02-24T09:05:39.672 INFO:teuthology.orchestra.run.trial090.stdout:(123/183): protobuf-compiler-3.14.0-17.el9.x86_ 9.9 MB/s | 862 kB 00:00 2026-02-24T09:05:39.827 INFO:teuthology.orchestra.run.trial004.stdout:Transaction test succeeded. 2026-02-24T09:05:39.827 INFO:teuthology.orchestra.run.trial004.stdout:Running transaction 2026-02-24T09:05:39.871 INFO:teuthology.orchestra.run.trial090.stdout:(124/183): zlib-devel-1.2.11-41.el9.x86_64.rpm 125 kB/s | 45 kB 00:00 2026-02-24T09:05:39.907 INFO:teuthology.orchestra.run.trial090.stdout:(125/183): abseil-cpp-20211102.0-4.el9.x86_64.r 2.3 MB/s | 551 kB 00:00 2026-02-24T09:05:39.921 INFO:teuthology.orchestra.run.trial090.stdout:(126/183): gperftools-libs-2.9.1-3.el9.x86_64.r 6.0 MB/s | 308 kB 00:00 2026-02-24T09:05:39.931 INFO:teuthology.orchestra.run.trial090.stdout:(127/183): grpc-data-1.46.7-10.el9.noarch.rpm 791 kB/s | 19 kB 00:00 2026-02-24T09:05:40.016 INFO:teuthology.orchestra.run.trial090.stdout:(128/183): libarrow-9.0.0-15.el9.x86_64.rpm 46 MB/s | 4.4 MB 00:00 2026-02-24T09:05:40.017 INFO:teuthology.orchestra.run.trial090.stdout:(129/183): libarrow-doc-9.0.0-15.el9.noarch.rpm 290 kB/s | 25 kB 00:00 2026-02-24T09:05:40.041 INFO:teuthology.orchestra.run.trial090.stdout:(130/183): liboath-2.6.12-1.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2026-02-24T09:05:40.042 INFO:teuthology.orchestra.run.trial090.stdout:(131/183): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2026-02-24T09:05:40.067 INFO:teuthology.orchestra.run.trial090.stdout:(132/183): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2026-02-24T09:05:40.070 INFO:teuthology.orchestra.run.trial090.stdout:(133/183): parquet-libs-9.0.0-15.el9.x86_64.rpm 29 MB/s | 838 kB 00:00 2026-02-24T09:05:40.095 INFO:teuthology.orchestra.run.trial090.stdout:(134/183): python3-asyncssh-2.13.2-5.el9.noarch 19 MB/s | 548 kB 00:00 2026-02-24T09:05:40.096 INFO:teuthology.orchestra.run.trial090.stdout:(135/183): python3-autocommand-2.2.2-8.el9.noar 1.1 MB/s | 29 kB 00:00 2026-02-24T09:05:40.120 INFO:teuthology.orchestra.run.trial090.stdout:(136/183): python3-backports-tarfile-1.2.0-1.el 2.4 MB/s | 60 kB 00:00 2026-02-24T09:05:40.120 INFO:teuthology.orchestra.run.trial090.stdout:(137/183): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2026-02-24T09:05:40.145 INFO:teuthology.orchestra.run.trial090.stdout:(138/183): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2026-02-24T09:05:40.145 INFO:teuthology.orchestra.run.trial090.stdout:(139/183): python3-certifi-2023.05.07-4.el9.noa 572 kB/s | 14 kB 00:00 2026-02-24T09:05:40.174 INFO:teuthology.orchestra.run.trial090.stdout:(140/183): python3-cheroot-10.0.1-4.el9.noarch. 5.9 MB/s | 173 kB 00:00 2026-02-24T09:05:40.175 INFO:teuthology.orchestra.run.trial090.stdout:(141/183): python3-cherrypy-18.6.1-2.el9.noarch 12 MB/s | 358 kB 00:00 2026-02-24T09:05:40.200 INFO:teuthology.orchestra.run.trial090.stdout:(142/183): python3-cmd2-2.4.2-2.el9.noarch.rpm 11 MB/s | 303 kB 00:00 2026-02-24T09:05:40.201 INFO:teuthology.orchestra.run.trial090.stdout:(143/183): python3-google-auth-2.45.0-1.el9.noa 9.7 MB/s | 254 kB 00:00 2026-02-24T09:05:40.234 INFO:teuthology.orchestra.run.trial090.stdout:(144/183): python3-grpcio-1.46.7-10.el9.x86_64. 61 MB/s | 2.0 MB 00:00 2026-02-24T09:05:40.234 INFO:teuthology.orchestra.run.trial090.stdout:(145/183): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2026-02-24T09:05:40.259 INFO:teuthology.orchestra.run.trial090.stdout:(146/183): python3-influxdb-5.3.1-1.el9.noarch. 5.5 MB/s | 139 kB 00:00 2026-02-24T09:05:40.259 INFO:teuthology.orchestra.run.trial090.stdout:(147/183): python3-isodate-0.6.1-3.el9.noarch.r 2.2 MB/s | 56 kB 00:00 2026-02-24T09:05:40.283 INFO:teuthology.orchestra.run.trial090.stdout:(148/183): python3-jaraco-8.2.1-3.el9.noarch.rp 439 kB/s | 11 kB 00:00 2026-02-24T09:05:40.284 INFO:teuthology.orchestra.run.trial090.stdout:(149/183): python3-jaraco-classes-3.2.1-5.el9.n 724 kB/s | 18 kB 00:00 2026-02-24T09:05:40.308 INFO:teuthology.orchestra.run.trial090.stdout:(150/183): python3-jaraco-collections-3.0.0-8.e 952 kB/s | 23 kB 00:00 2026-02-24T09:05:40.308 INFO:teuthology.orchestra.run.trial090.stdout:(151/183): python3-jaraco-context-6.0.1-3.el9.n 806 kB/s | 20 kB 00:00 2026-02-24T09:05:40.332 INFO:teuthology.orchestra.run.trial090.stdout:(152/183): python3-jaraco-functools-3.5.0-2.el9 798 kB/s | 19 kB 00:00 2026-02-24T09:05:40.333 INFO:teuthology.orchestra.run.trial090.stdout:(153/183): python3-jaraco-text-4.0.0-2.el9.noar 1.1 MB/s | 26 kB 00:00 2026-02-24T09:05:40.361 INFO:teuthology.orchestra.run.trial090.stdout:(154/183): python3-kubernetes-26.1.0-3.el9.noar 35 MB/s | 1.0 MB 00:00 2026-02-24T09:05:40.362 INFO:teuthology.orchestra.run.trial090.stdout:(155/183): python3-more-itertools-8.12.0-2.el9. 2.6 MB/s | 79 kB 00:00 2026-02-24T09:05:40.386 INFO:teuthology.orchestra.run.trial090.stdout:(156/183): python3-msgpack-1.0.3-2.el9.x86_64.r 3.4 MB/s | 86 kB 00:00 2026-02-24T09:05:40.387 INFO:teuthology.orchestra.run.trial090.stdout:(157/183): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2026-02-24T09:05:40.411 INFO:teuthology.orchestra.run.trial090.stdout:(158/183): python3-portend-3.1.0-2.el9.noarch.r 675 kB/s | 16 kB 00:00 2026-02-24T09:05:40.411 INFO:teuthology.orchestra.run.trial090.stdout:(159/183): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2026-02-24T09:05:40.435 INFO:teuthology.orchestra.run.trial090.stdout:(160/183): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2026-02-24T09:05:40.436 INFO:teuthology.orchestra.run.trial090.stdout:(161/183): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2026-02-24T09:05:40.461 INFO:teuthology.orchestra.run.trial090.stdout:(162/183): python3-routes-2.5.1-5.el9.noarch.rp 7.3 MB/s | 188 kB 00:00 2026-02-24T09:05:40.461 INFO:teuthology.orchestra.run.trial090.stdout:(163/183): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2026-02-24T09:05:40.486 INFO:teuthology.orchestra.run.trial090.stdout:(164/183): python3-saml-1.16.0-1.el9.noarch.rpm 4.9 MB/s | 125 kB 00:00 2026-02-24T09:05:40.486 INFO:teuthology.orchestra.run.trial090.stdout:(165/183): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2026-02-24T09:05:40.510 INFO:teuthology.orchestra.run.trial090.stdout:(166/183): python3-typing-extensions-4.15.0-1.e 3.4 MB/s | 86 kB 00:00 2026-02-24T09:05:40.511 INFO:teuthology.orchestra.run.trial090.stdout:(167/183): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2026-02-24T09:05:40.535 INFO:teuthology.orchestra.run.trial090.stdout:(168/183): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.9 MB/s | 48 kB 00:00 2026-02-24T09:05:40.536 INFO:teuthology.orchestra.run.trial090.stdout:(169/183): python3-xmltodict-0.12.0-15.el9.noar 905 kB/s | 22 kB 00:00 2026-02-24T09:05:40.560 INFO:teuthology.orchestra.run.trial090.stdout:(170/183): python3-zc-lockfile-2.0-10.el9.noarc 821 kB/s | 20 kB 00:00 2026-02-24T09:05:40.561 INFO:teuthology.orchestra.run.trial090.stdout:(171/183): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2026-02-24T09:05:40.591 INFO:teuthology.orchestra.run.trial090.stdout:(172/183): thrift-0.15.0-4.el9.x86_64.rpm 50 MB/s | 1.6 MB 00:00 2026-02-24T09:05:40.592 INFO:teuthology.orchestra.run.trial090.stdout:(173/183): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.8 MB/s | 122 kB 00:00 2026-02-24T09:05:40.692 INFO:teuthology.orchestra.run.trial014.stdout:(94/183): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2026-02-24T09:05:40.710 INFO:teuthology.orchestra.run.trial090.stdout:(174/183): librbd1-20.3.0-5537.g5bc9a1ff.el9.x8 24 MB/s | 2.8 MB 00:00 2026-02-24T09:05:40.749 INFO:teuthology.orchestra.run.trial090.stdout:(175/183): librados2-20.3.0-5537.g5bc9a1ff.el9. 22 MB/s | 3.5 MB 00:00 2026-02-24T09:05:40.753 INFO:teuthology.orchestra.run.trial090.stdout:(176/183): libblkid-2.37.4-25.el9.x86_64.rpm 2.4 MB/s | 105 kB 00:00 2026-02-24T09:05:40.775 INFO:teuthology.orchestra.run.trial090.stdout:(177/183): libmount-2.37.4-25.el9.x86_64.rpm 6.0 MB/s | 133 kB 00:00 2026-02-24T09:05:40.793 INFO:teuthology.orchestra.run.trial090.stdout:(178/183): libfdisk-2.37.4-25.el9.x86_64.rpm 3.4 MB/s | 152 kB 00:00 2026-02-24T09:05:40.797 INFO:teuthology.orchestra.run.trial090.stdout:(179/183): libsmartcols-2.37.4-25.el9.x86_64.rp 2.7 MB/s | 61 kB 00:00 2026-02-24T09:05:40.814 INFO:teuthology.orchestra.run.trial090.stdout:(180/183): libuuid-2.37.4-25.el9.x86_64.rpm 1.2 MB/s | 26 kB 00:00 2026-02-24T09:05:40.850 INFO:teuthology.orchestra.run.trial014.stdout:(95/183): python3-colorama-0.4.6-3.el9.noarch.r 386 kB/s | 61 kB 00:00 2026-02-24T09:05:40.859 INFO:teuthology.orchestra.run.trial090.stdout:(181/183): util-linux-core-2.37.4-25.el9.x86_64 10 MB/s | 458 kB 00:00 2026-02-24T09:05:40.865 INFO:teuthology.orchestra.run.trial090.stdout:(182/183): util-linux-2.37.4-25.el9.x86_64.rpm 34 MB/s | 2.3 MB 00:00 2026-02-24T09:05:40.985 INFO:teuthology.orchestra.run.trial004.stdout: Preparing : 1/1 2026-02-24T09:05:40.987 INFO:teuthology.orchestra.run.trial004.stdout: Upgrading : libuuid-2.37.4-25.el9.x86_64 1/192 2026-02-24T09:05:40.988 INFO:teuthology.orchestra.run.trial004.stdout: Upgrading : libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:05:41.001 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:05:41.010 INFO:teuthology.orchestra.run.trial014.stdout:(96/183): python3-devel-3.9.25-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2026-02-24T09:05:41.010 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/192 2026-02-24T09:05:41.013 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/192 2026-02-24T09:05:41.022 INFO:teuthology.orchestra.run.trial004.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/192 2026-02-24T09:05:41.032 INFO:teuthology.orchestra.run.trial004.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/192 2026-02-24T09:05:41.169 INFO:teuthology.orchestra.run.trial014.stdout:(97/183): python3-jinja2-2.11.3-8.el9.noarch.rp 1.5 MB/s | 249 kB 00:00 2026-02-24T09:05:41.188 INFO:teuthology.orchestra.run.trial004.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/192 2026-02-24T09:05:41.190 INFO:teuthology.orchestra.run.trial004.stdout: Upgrading : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:05:41.238 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:05:41.239 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:05:41.251 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:05:41.253 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:05:41.253 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:05:41.281 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:05:41.288 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:05:41.291 INFO:teuthology.orchestra.run.trial004.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 13/192 2026-02-24T09:05:41.294 INFO:teuthology.orchestra.run.trial004.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 14/192 2026-02-24T09:05:41.296 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 15/192 2026-02-24T09:05:41.298 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 16/192 2026-02-24T09:05:41.302 INFO:teuthology.orchestra.run.trial004.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 17/192 2026-02-24T09:05:41.327 INFO:teuthology.orchestra.run.trial014.stdout:(98/183): python3-jmespath-1.0.1-1.el9.noarch.r 301 kB/s | 48 kB 00:00 2026-02-24T09:05:41.426 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/192 2026-02-24T09:05:41.427 INFO:teuthology.orchestra.run.trial004.stdout: Upgrading : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:05:41.486 INFO:teuthology.orchestra.run.trial014.stdout:(99/183): python3-libstoragemgmt-1.10.1-1.el9.x 1.1 MB/s | 177 kB 00:00 2026-02-24T09:05:41.499 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:05:41.509 INFO:teuthology.orchestra.run.trial004.stdout: Installing : postgresql-13.23-1.el9.x86_64 20/192 2026-02-24T09:05:41.509 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:05:41.531 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:05:41.532 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:05:41.575 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:05:41.582 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 23/192 2026-02-24T09:05:41.585 INFO:teuthology.orchestra.run.trial004.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 24/192 2026-02-24T09:05:41.588 INFO:teuthology.orchestra.run.trial004.stdout: Upgrading : libmount-2.37.4-25.el9.x86_64 25/192 2026-02-24T09:05:41.590 INFO:teuthology.orchestra.run.trial004.stdout: Upgrading : libsmartcols-2.37.4-25.el9.x86_64 26/192 2026-02-24T09:05:41.593 INFO:teuthology.orchestra.run.trial004.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 27/192 2026-02-24T09:05:41.624 INFO:teuthology.orchestra.run.trial004.stdout: Installing : re2-1:20211101-20.el9.x86_64 28/192 2026-02-24T09:05:41.646 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 29/192 2026-02-24T09:05:41.650 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 30/192 2026-02-24T09:05:41.656 INFO:teuthology.orchestra.run.trial004.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 31/192 2026-02-24T09:05:41.658 INFO:teuthology.orchestra.run.trial004.stdout: Installing : lua-5.4.4-4.el9.x86_64 32/192 2026-02-24T09:05:41.663 INFO:teuthology.orchestra.run.trial004.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 33/192 2026-02-24T09:05:41.686 INFO:teuthology.orchestra.run.trial004.stdout: Installing : unzip-6.0-59.el9.x86_64 34/192 2026-02-24T09:05:41.699 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 35/192 2026-02-24T09:05:41.705 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 36/192 2026-02-24T09:05:41.708 INFO:teuthology.orchestra.run.trial004.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 37/192 2026-02-24T09:05:41.714 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 38/192 2026-02-24T09:05:41.715 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 39/192 2026-02-24T09:05:41.717 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 40/192 2026-02-24T09:05:41.727 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 41/192 2026-02-24T09:05:41.761 INFO:teuthology.orchestra.run.trial004.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 42/192 2026-02-24T09:05:41.766 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 43/192 2026-02-24T09:05:41.777 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 44/192 2026-02-24T09:05:41.788 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 45/192 2026-02-24T09:05:41.794 INFO:teuthology.orchestra.run.trial014.stdout:(100/183): openssl-devel-3.5.5-1.el9.x86_64.rpm 882 kB/s | 4.8 MB 00:05 2026-02-24T09:05:41.795 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 46/192 2026-02-24T09:05:41.805 INFO:teuthology.orchestra.run.trial014.stdout:(101/183): python3-lxml-4.6.5-3.el9.x86_64.rpm 3.8 MB/s | 1.2 MB 00:00 2026-02-24T09:05:41.818 INFO:teuthology.orchestra.run.trial004.stdout: Installing : zip-3.0-35.el9.x86_64 47/192 2026-02-24T09:05:41.822 INFO:teuthology.orchestra.run.trial004.stdout: Installing : luarocks-3.9.2-5.el9.noarch 48/192 2026-02-24T09:05:41.825 INFO:teuthology.orchestra.run.trial004.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 49/192 2026-02-24T09:05:41.827 INFO:teuthology.orchestra.run.trial004.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 50/192 2026-02-24T09:05:41.855 INFO:teuthology.orchestra.run.trial004.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 51/192 2026-02-24T09:05:41.907 INFO:teuthology.orchestra.run.trial004.stdout: Installing : automake-1.16.2-8.el9.noarch 52/192 2026-02-24T09:05:41.920 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 53/192 2026-02-24T09:05:41.945 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-rsa-4.9-2.el9.noarch 54/192 2026-02-24T09:05:41.947 INFO:teuthology.orchestra.run.trial004.stdout: Upgrading : util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:05:41.952 INFO:teuthology.orchestra.run.trial014.stdout:(102/183): python3-markupsafe-1.1.1-12.el9.x86_ 220 kB/s | 35 kB 00:00 2026-02-24T09:05:41.954 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:05:41.959 INFO:teuthology.orchestra.run.trial004.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/192 2026-02-24T09:05:41.975 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 57/192 2026-02-24T09:05:41.980 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 58/192 2026-02-24T09:05:41.987 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 59/192 2026-02-24T09:05:41.996 INFO:teuthology.orchestra.run.trial004.stdout: Installing : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 60/192 2026-02-24T09:05:42.000 INFO:teuthology.orchestra.run.trial004.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 61/192 2026-02-24T09:05:42.022 INFO:teuthology.orchestra.run.trial004.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 62/192 2026-02-24T09:05:42.026 INFO:teuthology.orchestra.run.trial004.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 63/192 2026-02-24T09:05:42.113 INFO:teuthology.orchestra.run.trial004.stdout: Upgrading : libfdisk-2.37.4-25.el9.x86_64 64/192 2026-02-24T09:05:42.191 INFO:teuthology.orchestra.run.trial014.stdout:(103/183): python3-numpy-f2py-1.23.5-2.el9.x86_ 1.8 MB/s | 442 kB 00:00 2026-02-24T09:05:42.232 INFO:teuthology.orchestra.run.trial004.stdout: Upgrading : util-linux-2.37.4-25.el9.x86_64 65/192 2026-02-24T09:05:42.235 INFO:teuthology.orchestra.run.trial004.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:05:42.334 INFO:teuthology.orchestra.run.trial014.stdout:(104/183): openblas-openmp-0.3.29-1.el9.x86_64. 885 kB/s | 5.3 MB 00:06 2026-02-24T09:05:42.350 INFO:teuthology.orchestra.run.trial014.stdout:(105/183): python3-packaging-20.9-5.el9.noarch. 486 kB/s | 77 kB 00:00 2026-02-24T09:05:42.510 INFO:teuthology.orchestra.run.trial014.stdout:(106/183): python3-pyasn1-0.4.8-7.el9.noarch.rp 984 kB/s | 157 kB 00:00 2026-02-24T09:05:42.533 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:05:42.533 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T09:05:42.533 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:42.557 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libuuid-devel-2.37.4-25.el9.x86_64 67/192 2026-02-24T09:05:42.562 INFO:teuthology.orchestra.run.trial004.stdout: Installing : thrift-0.15.0-4.el9.x86_64 68/192 2026-02-24T09:05:42.566 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 69/192 2026-02-24T09:05:42.580 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 70/192 2026-02-24T09:05:42.585 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 71/192 2026-02-24T09:05:42.590 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 72/192 2026-02-24T09:05:42.601 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 73/192 2026-02-24T09:05:42.606 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 74/192 2026-02-24T09:05:42.615 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 75/192 2026-02-24T09:05:42.621 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 76/192 2026-02-24T09:05:42.641 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 77/192 2026-02-24T09:05:42.652 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 78/192 2026-02-24T09:05:42.668 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 79/192 2026-02-24T09:05:42.669 INFO:teuthology.orchestra.run.trial014.stdout:(107/183): python3-pyasn1-modules-0.4.8-7.el9.n 1.7 MB/s | 277 kB 00:00 2026-02-24T09:05:42.673 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 80/192 2026-02-24T09:05:42.681 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 81/192 2026-02-24T09:05:42.721 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 82/192 2026-02-24T09:05:42.728 INFO:teuthology.orchestra.run.trial014.stdout:(108/183): python3-protobuf-3.14.0-17.el9.noarc 680 kB/s | 267 kB 00:00 2026-02-24T09:05:42.828 INFO:teuthology.orchestra.run.trial014.stdout:(109/183): python3-requests-oauthlib-1.3.0-12.e 337 kB/s | 54 kB 00:00 2026-02-24T09:05:42.987 INFO:teuthology.orchestra.run.trial014.stdout:(110/183): python3-toml-0.10.2-6.el9.noarch.rpm 262 kB/s | 42 kB 00:00 2026-02-24T09:05:43.050 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 83/192 2026-02-24T09:05:43.059 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 84/192 2026-02-24T09:05:43.063 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 85/192 2026-02-24T09:05:43.069 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 86/192 2026-02-24T09:05:43.073 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 87/192 2026-02-24T09:05:43.078 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/192 2026-02-24T09:05:43.080 INFO:teuthology.orchestra.run.trial004.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/192 2026-02-24T09:05:43.082 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 90/192 2026-02-24T09:05:43.109 INFO:teuthology.orchestra.run.trial004.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/192 2026-02-24T09:05:43.146 INFO:teuthology.orchestra.run.trial014.stdout:(111/183): python3-wcwidth-0.2.5-8.el9.noarch.r 279 kB/s | 44 kB 00:00 2026-02-24T09:05:43.153 INFO:teuthology.orchestra.run.trial004.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 92/192 2026-02-24T09:05:43.157 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/192 2026-02-24T09:05:43.161 INFO:teuthology.orchestra.run.trial004.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 94/192 2026-02-24T09:05:43.169 INFO:teuthology.orchestra.run.trial004.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/192 2026-02-24T09:05:43.176 INFO:teuthology.orchestra.run.trial004.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 96/192 2026-02-24T09:05:43.204 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 97/192 2026-02-24T09:05:43.210 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 98/192 2026-02-24T09:05:43.213 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 99/192 2026-02-24T09:05:43.219 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 100/192 2026-02-24T09:05:43.223 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 101/192 2026-02-24T09:05:43.230 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 102/192 2026-02-24T09:05:43.233 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 103/192 2026-02-24T09:05:43.261 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 104/192 2026-02-24T09:05:43.273 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 105/192 2026-02-24T09:05:43.279 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/192 2026-02-24T09:05:43.286 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 107/192 2026-02-24T09:05:43.321 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 108/192 2026-02-24T09:05:43.332 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 109/192 2026-02-24T09:05:43.541 INFO:teuthology.orchestra.run.trial014.stdout:(112/183): qatlib-25.08.0-2.el9.x86_64.rpm 607 kB/s | 240 kB 00:00 2026-02-24T09:05:43.558 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 110/192 2026-02-24T09:05:43.582 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 111/192 2026-02-24T09:05:43.586 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 112/192 2026-02-24T09:05:43.645 INFO:teuthology.orchestra.run.trial004.stdout: Installing : openblas-0.3.29-1.el9.x86_64 113/192 2026-02-24T09:05:43.647 INFO:teuthology.orchestra.run.trial004.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 114/192 2026-02-24T09:05:43.668 INFO:teuthology.orchestra.run.trial004.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 115/192 2026-02-24T09:05:43.698 INFO:teuthology.orchestra.run.trial014.stdout:(113/183): qatlib-service-25.08.0-2.el9.x86_64. 235 kB/s | 37 kB 00:00 2026-02-24T09:05:43.859 INFO:teuthology.orchestra.run.trial014.stdout:(114/183): qatzip-libs-1.3.1-1.el9.x86_64.rpm 415 kB/s | 66 kB 00:00 2026-02-24T09:05:43.995 INFO:teuthology.orchestra.run.trial004.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 116/192 2026-02-24T09:05:44.069 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 117/192 2026-02-24T09:05:44.330 INFO:teuthology.orchestra.run.trial014.stdout:(115/183): socat-1.7.4.1-8.el9.x86_64.rpm 643 kB/s | 303 kB 00:00 2026-02-24T09:05:44.488 INFO:teuthology.orchestra.run.trial014.stdout:(116/183): uuid-1.6.2-55.el9.x86_64.rpm 366 kB/s | 58 kB 00:00 2026-02-24T09:05:44.724 INFO:teuthology.orchestra.run.trial014.stdout:(117/183): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 405 kB/s | 96 kB 00:00 2026-02-24T09:05:44.745 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 118/192 2026-02-24T09:05:44.759 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 119/192 2026-02-24T09:05:44.761 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 120/192 2026-02-24T09:05:44.767 INFO:teuthology.orchestra.run.trial004.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 121/192 2026-02-24T09:05:45.040 INFO:teuthology.orchestra.run.trial014.stdout:(118/183): xmlsec1-1.2.29-13.el9.x86_64.rpm 598 kB/s | 189 kB 00:00 2026-02-24T09:05:45.053 INFO:teuthology.orchestra.run.trial004.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 122/192 2026-02-24T09:05:45.054 INFO:teuthology.orchestra.run.trial004.stdout: Installing : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:05:45.075 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:05:45.076 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 124/192 2026-02-24T09:05:45.276 INFO:teuthology.orchestra.run.trial014.stdout:(119/183): xmlsec1-openssl-1.2.29-13.el9.x86_64 383 kB/s | 90 kB 00:00 2026-02-24T09:05:45.434 INFO:teuthology.orchestra.run.trial014.stdout:(120/183): xmlstarlet-1.6.1-20.el9.x86_64.rpm 402 kB/s | 64 kB 00:00 2026-02-24T09:05:45.592 INFO:teuthology.orchestra.run.trial014.stdout:(121/183): zlib-devel-1.2.11-41.el9.x86_64.rpm 284 kB/s | 45 kB 00:00 2026-02-24T09:05:45.832 INFO:teuthology.orchestra.run.trial014.stdout:(122/183): lua-devel-5.4.4-4.el9.x86_64.rpm 93 kB/s | 22 kB 00:00 2026-02-24T09:05:46.158 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:05:46.160 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:05:46.177 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:05:46.188 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 126/192 2026-02-24T09:05:46.194 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-packaging-20.9-5.el9.noarch 127/192 2026-02-24T09:05:46.208 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-ply-3.11-14.el9.noarch 128/192 2026-02-24T09:05:46.224 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 129/192 2026-02-24T09:05:46.297 INFO:teuthology.orchestra.run.trial014.stdout:(123/183): python3-scipy-1.9.3-2.el9.x86_64.rpm 5.4 MB/s | 19 MB 00:03 2026-02-24T09:05:46.298 INFO:teuthology.orchestra.run.trial014.stdout:(124/183): protobuf-compiler-3.14.0-17.el9.x86_ 1.8 MB/s | 862 kB 00:00 2026-02-24T09:05:46.301 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 130/192 2026-02-24T09:05:46.310 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 131/192 2026-02-24T09:05:46.334 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 132/192 2026-02-24T09:05:46.364 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 133/192 2026-02-24T09:05:46.415 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 134/192 2026-02-24T09:05:46.421 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:05:46.425 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 136/192 2026-02-24T09:05:46.431 INFO:teuthology.orchestra.run.trial004.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 137/192 2026-02-24T09:05:46.433 INFO:teuthology.orchestra.run.trial004.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 138/192 2026-02-24T09:05:46.434 INFO:teuthology.orchestra.run.trial004.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:05:46.451 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:05:46.487 INFO:teuthology.orchestra.run.trial014.stdout:(125/183): gperftools-libs-2.9.1-3.el9.x86_64.r 1.6 MB/s | 308 kB 00:00 2026-02-24T09:05:46.504 INFO:teuthology.orchestra.run.trial014.stdout:(126/183): abseil-cpp-20211102.0-4.el9.x86_64.r 2.6 MB/s | 551 kB 00:00 2026-02-24T09:05:46.512 INFO:teuthology.orchestra.run.trial014.stdout:(127/183): grpc-data-1.46.7-10.el9.noarch.rpm 788 kB/s | 19 kB 00:00 2026-02-24T09:05:46.602 INFO:teuthology.orchestra.run.trial014.stdout:(128/183): libarrow-doc-9.0.0-15.el9.noarch.rpm 274 kB/s | 25 kB 00:00 2026-02-24T09:05:46.612 INFO:teuthology.orchestra.run.trial014.stdout:(129/183): libarrow-9.0.0-15.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2026-02-24T09:05:46.627 INFO:teuthology.orchestra.run.trial014.stdout:(130/183): liboath-2.6.12-1.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2026-02-24T09:05:46.636 INFO:teuthology.orchestra.run.trial014.stdout:(131/183): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2026-02-24T09:05:46.652 INFO:teuthology.orchestra.run.trial014.stdout:(132/183): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2026-02-24T09:05:46.664 INFO:teuthology.orchestra.run.trial014.stdout:(133/183): parquet-libs-9.0.0-15.el9.x86_64.rpm 29 MB/s | 838 kB 00:00 2026-02-24T09:05:46.678 INFO:teuthology.orchestra.run.trial014.stdout:(134/183): python3-asyncssh-2.13.2-5.el9.noarch 20 MB/s | 548 kB 00:00 2026-02-24T09:05:46.689 INFO:teuthology.orchestra.run.trial014.stdout:(135/183): python3-autocommand-2.2.2-8.el9.noar 1.2 MB/s | 29 kB 00:00 2026-02-24T09:05:46.699 INFO:teuthology.orchestra.run.trial004.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 140/192 2026-02-24T09:05:46.702 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:05:46.703 INFO:teuthology.orchestra.run.trial014.stdout:(136/183): python3-backports-tarfile-1.2.0-1.el 2.4 MB/s | 60 kB 00:00 2026-02-24T09:05:46.713 INFO:teuthology.orchestra.run.trial014.stdout:(137/183): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2026-02-24T09:05:46.728 INFO:teuthology.orchestra.run.trial014.stdout:(138/183): python3-cachetools-4.2.4-1.el9.noarc 1.2 MB/s | 32 kB 00:00 2026-02-24T09:05:46.738 INFO:teuthology.orchestra.run.trial014.stdout:(139/183): python3-certifi-2023.05.07-4.el9.noa 582 kB/s | 14 kB 00:00 2026-02-24T09:05:46.745 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:05:46.745 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T09:05:46.745 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T09:05:46.745 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:46.749 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:05:46.753 INFO:teuthology.orchestra.run.trial014.stdout:(140/183): python3-cheroot-10.0.1-4.el9.noarch. 6.8 MB/s | 173 kB 00:00 2026-02-24T09:05:46.766 INFO:teuthology.orchestra.run.trial014.stdout:(141/183): python3-cherrypy-18.6.1-2.el9.noarch 12 MB/s | 358 kB 00:00 2026-02-24T09:05:46.779 INFO:teuthology.orchestra.run.trial014.stdout:(142/183): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2026-02-24T09:05:46.791 INFO:teuthology.orchestra.run.trial014.stdout:(143/183): python3-google-auth-2.45.0-1.el9.noa 9.9 MB/s | 254 kB 00:00 2026-02-24T09:05:46.813 INFO:teuthology.orchestra.run.trial014.stdout:(144/183): python3-grpcio-1.46.7-10.el9.x86_64. 60 MB/s | 2.0 MB 00:00 2026-02-24T09:05:46.816 INFO:teuthology.orchestra.run.trial014.stdout:(145/183): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2026-02-24T09:05:46.837 INFO:teuthology.orchestra.run.trial014.stdout:(146/183): python3-influxdb-5.3.1-1.el9.noarch. 5.5 MB/s | 139 kB 00:00 2026-02-24T09:05:46.841 INFO:teuthology.orchestra.run.trial014.stdout:(147/183): python3-isodate-0.6.1-3.el9.noarch.r 2.2 MB/s | 56 kB 00:00 2026-02-24T09:05:46.862 INFO:teuthology.orchestra.run.trial014.stdout:(148/183): python3-jaraco-8.2.1-3.el9.noarch.rp 439 kB/s | 11 kB 00:00 2026-02-24T09:05:46.865 INFO:teuthology.orchestra.run.trial014.stdout:(149/183): python3-jaraco-classes-3.2.1-5.el9.n 725 kB/s | 18 kB 00:00 2026-02-24T09:05:46.887 INFO:teuthology.orchestra.run.trial014.stdout:(150/183): python3-jaraco-collections-3.0.0-8.e 950 kB/s | 23 kB 00:00 2026-02-24T09:05:46.890 INFO:teuthology.orchestra.run.trial014.stdout:(151/183): python3-jaraco-context-6.0.1-3.el9.n 806 kB/s | 20 kB 00:00 2026-02-24T09:05:46.911 INFO:teuthology.orchestra.run.trial014.stdout:(152/183): python3-jaraco-functools-3.5.0-2.el9 798 kB/s | 19 kB 00:00 2026-02-24T09:05:46.914 INFO:teuthology.orchestra.run.trial014.stdout:(153/183): python3-jaraco-text-4.0.0-2.el9.noar 1.1 MB/s | 26 kB 00:00 2026-02-24T09:05:46.940 INFO:teuthology.orchestra.run.trial014.stdout:(154/183): python3-kubernetes-26.1.0-3.el9.noar 35 MB/s | 1.0 MB 00:00 2026-02-24T09:05:46.941 INFO:teuthology.orchestra.run.trial014.stdout:(155/183): python3-more-itertools-8.12.0-2.el9. 2.9 MB/s | 79 kB 00:00 2026-02-24T09:05:46.965 INFO:teuthology.orchestra.run.trial014.stdout:(156/183): python3-msgpack-1.0.3-2.el9.x86_64.r 3.4 MB/s | 86 kB 00:00 2026-02-24T09:05:46.966 INFO:teuthology.orchestra.run.trial014.stdout:(157/183): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2026-02-24T09:05:46.989 INFO:teuthology.orchestra.run.trial014.stdout:(158/183): python3-portend-3.1.0-2.el9.noarch.r 675 kB/s | 16 kB 00:00 2026-02-24T09:05:46.990 INFO:teuthology.orchestra.run.trial014.stdout:(159/183): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2026-02-24T09:05:47.014 INFO:teuthology.orchestra.run.trial014.stdout:(160/183): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2026-02-24T09:05:47.015 INFO:teuthology.orchestra.run.trial014.stdout:(161/183): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2026-02-24T09:05:47.039 INFO:teuthology.orchestra.run.trial014.stdout:(162/183): python3-routes-2.5.1-5.el9.noarch.rp 7.4 MB/s | 188 kB 00:00 2026-02-24T09:05:47.040 INFO:teuthology.orchestra.run.trial014.stdout:(163/183): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2026-02-24T09:05:47.064 INFO:teuthology.orchestra.run.trial014.stdout:(164/183): python3-saml-1.16.0-1.el9.noarch.rpm 4.9 MB/s | 125 kB 00:00 2026-02-24T09:05:47.065 INFO:teuthology.orchestra.run.trial014.stdout:(165/183): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2026-02-24T09:05:47.089 INFO:teuthology.orchestra.run.trial014.stdout:(166/183): python3-typing-extensions-4.15.0-1.e 3.4 MB/s | 86 kB 00:00 2026-02-24T09:05:47.090 INFO:teuthology.orchestra.run.trial014.stdout:(167/183): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2026-02-24T09:05:47.114 INFO:teuthology.orchestra.run.trial014.stdout:(168/183): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.9 MB/s | 48 kB 00:00 2026-02-24T09:05:47.115 INFO:teuthology.orchestra.run.trial014.stdout:(169/183): python3-xmltodict-0.12.0-15.el9.noar 902 kB/s | 22 kB 00:00 2026-02-24T09:05:47.139 INFO:teuthology.orchestra.run.trial014.stdout:(170/183): python3-zc-lockfile-2.0-10.el9.noarc 818 kB/s | 20 kB 00:00 2026-02-24T09:05:47.140 INFO:teuthology.orchestra.run.trial014.stdout:(171/183): re2-20211101-20.el9.x86_64.rpm 7.4 MB/s | 191 kB 00:00 2026-02-24T09:05:47.171 INFO:teuthology.orchestra.run.trial014.stdout:(172/183): thrift-0.15.0-4.el9.x86_64.rpm 50 MB/s | 1.6 MB 00:00 2026-02-24T09:05:47.171 INFO:teuthology.orchestra.run.trial014.stdout:(173/183): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.8 MB/s | 122 kB 00:00 2026-02-24T09:05:47.319 INFO:teuthology.orchestra.run.trial014.stdout:(174/183): librbd1-20.3.0-5537.g5bc9a1ff.el9.x8 19 MB/s | 2.8 MB 00:00 2026-02-24T09:05:47.326 INFO:teuthology.orchestra.run.trial014.stdout:(175/183): librados2-20.3.0-5537.g5bc9a1ff.el9. 22 MB/s | 3.5 MB 00:00 2026-02-24T09:05:47.402 INFO:teuthology.orchestra.run.trial014.stdout:(176/183): libblkid-2.37.4-25.el9.x86_64.rpm 1.2 MB/s | 105 kB 00:00 2026-02-24T09:05:47.487 INFO:teuthology.orchestra.run.trial014.stdout:(177/183): libmount-2.37.4-25.el9.x86_64.rpm 1.5 MB/s | 133 kB 00:00 2026-02-24T09:05:47.567 INFO:teuthology.orchestra.run.trial014.stdout:(178/183): libsmartcols-2.37.4-25.el9.x86_64.rp 754 kB/s | 61 kB 00:00 2026-02-24T09:05:47.645 INFO:teuthology.orchestra.run.trial014.stdout:(179/183): libuuid-2.37.4-25.el9.x86_64.rpm 329 kB/s | 26 kB 00:00 2026-02-24T09:05:47.765 INFO:teuthology.orchestra.run.trial014.stdout:(180/183): libfdisk-2.37.4-25.el9.x86_64.rpm 345 kB/s | 152 kB 00:00 2026-02-24T09:05:47.866 INFO:teuthology.orchestra.run.trial014.stdout:(181/183): util-linux-2.37.4-25.el9.x86_64.rpm 10 MB/s | 2.3 MB 00:00 2026-02-24T09:05:48.006 INFO:teuthology.orchestra.run.trial014.stdout:(182/183): util-linux-core-2.37.4-25.el9.x86_64 1.9 MB/s | 458 kB 00:00 2026-02-24T09:05:49.018 INFO:teuthology.orchestra.run.trial014.stdout:(183/183): python3-numpy-1.23.5-2.el9.x86_64.rp 870 kB/s | 6.1 MB 00:07 2026-02-24T09:05:49.023 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T09:05:49.023 INFO:teuthology.orchestra.run.trial014.stdout:Total 13 MB/s | 296 MB 00:22 2026-02-24T09:05:49.770 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T09:05:49.845 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T09:05:49.845 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T09:05:50.928 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T09:05:50.929 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T09:05:51.409 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:05:51.409 INFO:teuthology.orchestra.run.trial004.stdout:skipping the directory /sys 2026-02-24T09:05:51.409 INFO:teuthology.orchestra.run.trial004.stdout:skipping the directory /proc 2026-02-24T09:05:51.409 INFO:teuthology.orchestra.run.trial004.stdout:skipping the directory /mnt 2026-02-24T09:05:51.409 INFO:teuthology.orchestra.run.trial004.stdout:skipping the directory /var/tmp 2026-02-24T09:05:51.409 INFO:teuthology.orchestra.run.trial004.stdout:skipping the directory /home 2026-02-24T09:05:51.409 INFO:teuthology.orchestra.run.trial004.stdout:skipping the directory /root 2026-02-24T09:05:51.410 INFO:teuthology.orchestra.run.trial004.stdout:skipping the directory /tmp 2026-02-24T09:05:51.410 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:51.511 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:05:51.534 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:05:51.534 INFO:teuthology.orchestra.run.trial004.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:05:51.534 INFO:teuthology.orchestra.run.trial004.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T09:05:51.534 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:05:51.534 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:05:51.534 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:51.747 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:05:51.769 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:05:51.769 INFO:teuthology.orchestra.run.trial004.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:05:51.769 INFO:teuthology.orchestra.run.trial004.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T09:05:51.769 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:05:51.769 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:05:51.769 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:51.777 INFO:teuthology.orchestra.run.trial004.stdout: Installing : mailcap-2.1.49-5.el9.noarch 145/192 2026-02-24T09:05:51.778 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 146/192 2026-02-24T09:05:51.796 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:05:51.796 INFO:teuthology.orchestra.run.trial004.stdout:Creating group 'qat' with GID 992. 2026-02-24T09:05:51.796 INFO:teuthology.orchestra.run.trial004.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T09:05:51.796 INFO:teuthology.orchestra.run.trial004.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T09:05:51.796 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:51.805 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:05:51.829 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:05:51.829 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T09:05:51.829 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:52.085 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T09:05:52.089 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : libuuid-2.37.4-25.el9.x86_64 1/192 2026-02-24T09:05:52.090 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:05:52.103 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:05:52.109 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/192 2026-02-24T09:05:52.113 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/192 2026-02-24T09:05:52.122 INFO:teuthology.orchestra.run.trial014.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/192 2026-02-24T09:05:52.133 INFO:teuthology.orchestra.run.trial014.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/192 2026-02-24T09:05:52.288 INFO:teuthology.orchestra.run.trial014.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/192 2026-02-24T09:05:52.292 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:05:52.341 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:05:52.342 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:05:52.354 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:05:52.356 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:05:52.357 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:05:52.383 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:05:52.391 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:05:52.395 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 13/192 2026-02-24T09:05:52.398 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 14/192 2026-02-24T09:05:52.400 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 15/192 2026-02-24T09:05:52.402 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 16/192 2026-02-24T09:05:52.406 INFO:teuthology.orchestra.run.trial014.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 17/192 2026-02-24T09:05:52.463 INFO:teuthology.orchestra.run.trial004.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 148/192 2026-02-24T09:05:52.530 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/192 2026-02-24T09:05:52.531 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:05:52.601 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:05:52.610 INFO:teuthology.orchestra.run.trial014.stdout: Installing : postgresql-13.23-1.el9.x86_64 20/192 2026-02-24T09:05:52.611 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:05:52.631 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:05:52.632 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:05:52.678 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:05:52.684 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 23/192 2026-02-24T09:05:52.687 INFO:teuthology.orchestra.run.trial014.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 24/192 2026-02-24T09:05:52.689 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : libmount-2.37.4-25.el9.x86_64 25/192 2026-02-24T09:05:52.692 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : libsmartcols-2.37.4-25.el9.x86_64 26/192 2026-02-24T09:05:52.695 INFO:teuthology.orchestra.run.trial014.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 27/192 2026-02-24T09:05:52.727 INFO:teuthology.orchestra.run.trial014.stdout: Installing : re2-1:20211101-20.el9.x86_64 28/192 2026-02-24T09:05:52.748 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 29/192 2026-02-24T09:05:52.752 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 30/192 2026-02-24T09:05:52.757 INFO:teuthology.orchestra.run.trial014.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 31/192 2026-02-24T09:05:52.760 INFO:teuthology.orchestra.run.trial014.stdout: Installing : lua-5.4.4-4.el9.x86_64 32/192 2026-02-24T09:05:52.764 INFO:teuthology.orchestra.run.trial014.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 33/192 2026-02-24T09:05:52.787 INFO:teuthology.orchestra.run.trial014.stdout: Installing : unzip-6.0-59.el9.x86_64 34/192 2026-02-24T09:05:52.800 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 35/192 2026-02-24T09:05:52.806 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 36/192 2026-02-24T09:05:52.809 INFO:teuthology.orchestra.run.trial014.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 37/192 2026-02-24T09:05:52.815 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 38/192 2026-02-24T09:05:52.816 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 39/192 2026-02-24T09:05:52.818 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 40/192 2026-02-24T09:05:52.828 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 41/192 2026-02-24T09:05:52.862 INFO:teuthology.orchestra.run.trial014.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 42/192 2026-02-24T09:05:52.867 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 43/192 2026-02-24T09:05:52.878 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 44/192 2026-02-24T09:05:52.889 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 45/192 2026-02-24T09:05:52.895 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 46/192 2026-02-24T09:05:52.919 INFO:teuthology.orchestra.run.trial014.stdout: Installing : zip-3.0-35.el9.x86_64 47/192 2026-02-24T09:05:52.922 INFO:teuthology.orchestra.run.trial014.stdout: Installing : luarocks-3.9.2-5.el9.noarch 48/192 2026-02-24T09:05:52.925 INFO:teuthology.orchestra.run.trial014.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 49/192 2026-02-24T09:05:52.927 INFO:teuthology.orchestra.run.trial014.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 50/192 2026-02-24T09:05:52.955 INFO:teuthology.orchestra.run.trial014.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 51/192 2026-02-24T09:05:53.006 INFO:teuthology.orchestra.run.trial014.stdout: Installing : automake-1.16.2-8.el9.noarch 52/192 2026-02-24T09:05:53.019 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 53/192 2026-02-24T09:05:53.043 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rsa-4.9-2.el9.noarch 54/192 2026-02-24T09:05:53.046 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:05:53.053 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:05:53.058 INFO:teuthology.orchestra.run.trial014.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/192 2026-02-24T09:05:53.076 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 57/192 2026-02-24T09:05:53.081 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 58/192 2026-02-24T09:05:53.088 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 59/192 2026-02-24T09:05:53.097 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 60/192 2026-02-24T09:05:53.101 INFO:teuthology.orchestra.run.trial014.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 61/192 2026-02-24T09:05:53.123 INFO:teuthology.orchestra.run.trial014.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 62/192 2026-02-24T09:05:53.127 INFO:teuthology.orchestra.run.trial014.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 63/192 2026-02-24T09:05:53.212 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : libfdisk-2.37.4-25.el9.x86_64 64/192 2026-02-24T09:05:53.217 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 149/192 2026-02-24T09:05:53.280 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 150/192 2026-02-24T09:05:53.282 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:05:53.296 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:05:53.296 INFO:teuthology.orchestra.run.trial004.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:05:53.296 INFO:teuthology.orchestra.run.trial004.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T09:05:53.296 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:53.306 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:05:53.330 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : util-linux-2.37.4-25.el9.x86_64 65/192 2026-02-24T09:05:53.331 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:05:53.331 INFO:teuthology.orchestra.run.trial004.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:05:53.331 INFO:teuthology.orchestra.run.trial004.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T09:05:53.331 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:05:53.331 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:05:53.331 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:53.333 INFO:teuthology.orchestra.run.trial014.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:05:53.390 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:05:53.392 INFO:teuthology.orchestra.run.trial004.stdout: Installing : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:05:53.402 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 154/192 2026-02-24T09:05:53.425 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 155/192 2026-02-24T09:05:53.427 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:05:53.609 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:05:53.609 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T09:05:53.610 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:05:53.632 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libuuid-devel-2.37.4-25.el9.x86_64 67/192 2026-02-24T09:05:53.638 INFO:teuthology.orchestra.run.trial014.stdout: Installing : thrift-0.15.0-4.el9.x86_64 68/192 2026-02-24T09:05:53.641 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 69/192 2026-02-24T09:05:53.656 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 70/192 2026-02-24T09:05:53.660 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 71/192 2026-02-24T09:05:53.665 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 72/192 2026-02-24T09:05:53.677 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 73/192 2026-02-24T09:05:53.682 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 74/192 2026-02-24T09:05:53.691 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 75/192 2026-02-24T09:05:53.697 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 76/192 2026-02-24T09:05:53.717 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 77/192 2026-02-24T09:05:53.728 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 78/192 2026-02-24T09:05:53.744 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 79/192 2026-02-24T09:05:53.748 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 80/192 2026-02-24T09:05:53.756 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 81/192 2026-02-24T09:05:53.797 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 82/192 2026-02-24T09:05:54.122 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 83/192 2026-02-24T09:05:54.132 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 84/192 2026-02-24T09:05:54.136 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 85/192 2026-02-24T09:05:54.142 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 86/192 2026-02-24T09:05:54.145 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 87/192 2026-02-24T09:05:54.151 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/192 2026-02-24T09:05:54.153 INFO:teuthology.orchestra.run.trial014.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/192 2026-02-24T09:05:54.154 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 90/192 2026-02-24T09:05:54.182 INFO:teuthology.orchestra.run.trial014.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/192 2026-02-24T09:05:54.225 INFO:teuthology.orchestra.run.trial014.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 92/192 2026-02-24T09:05:54.229 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/192 2026-02-24T09:05:54.233 INFO:teuthology.orchestra.run.trial014.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 94/192 2026-02-24T09:05:54.241 INFO:teuthology.orchestra.run.trial014.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/192 2026-02-24T09:05:54.248 INFO:teuthology.orchestra.run.trial014.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 96/192 2026-02-24T09:05:54.276 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 97/192 2026-02-24T09:05:54.282 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 98/192 2026-02-24T09:05:54.286 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 99/192 2026-02-24T09:05:54.291 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 100/192 2026-02-24T09:05:54.295 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 101/192 2026-02-24T09:05:54.302 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 102/192 2026-02-24T09:05:54.305 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 103/192 2026-02-24T09:05:54.334 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 104/192 2026-02-24T09:05:54.343 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 105/192 2026-02-24T09:05:54.349 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/192 2026-02-24T09:05:54.356 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 107/192 2026-02-24T09:05:54.391 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 108/192 2026-02-24T09:05:54.402 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 109/192 2026-02-24T09:05:54.625 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 110/192 2026-02-24T09:05:54.649 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 111/192 2026-02-24T09:05:54.653 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 112/192 2026-02-24T09:05:54.711 INFO:teuthology.orchestra.run.trial014.stdout: Installing : openblas-0.3.29-1.el9.x86_64 113/192 2026-02-24T09:05:54.713 INFO:teuthology.orchestra.run.trial014.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 114/192 2026-02-24T09:05:54.734 INFO:teuthology.orchestra.run.trial014.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 115/192 2026-02-24T09:05:55.007 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:05:55.014 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:05:55.061 INFO:teuthology.orchestra.run.trial014.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 116/192 2026-02-24T09:05:55.135 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 117/192 2026-02-24T09:05:55.475 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:05:55.476 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:05:55.489 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:05:55.489 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:05:55.551 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:05:55.593 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 160/192 2026-02-24T09:05:55.595 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:05:55.616 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:05:55.616 INFO:teuthology.orchestra.run.trial004.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:05:55.616 INFO:teuthology.orchestra.run.trial004.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T09:05:55.616 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:05:55.616 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:05:55.616 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:55.627 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:05:55.638 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:05:55.806 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 118/192 2026-02-24T09:05:55.820 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 119/192 2026-02-24T09:05:55.822 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 120/192 2026-02-24T09:05:55.827 INFO:teuthology.orchestra.run.trial014.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 121/192 2026-02-24T09:05:56.118 INFO:teuthology.orchestra.run.trial014.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 122/192 2026-02-24T09:05:56.119 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:05:56.139 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:05:56.140 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 124/192 2026-02-24T09:05:56.214 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 163/192 2026-02-24T09:05:56.215 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:05:56.237 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:05:56.237 INFO:teuthology.orchestra.run.trial004.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:05:56.237 INFO:teuthology.orchestra.run.trial004.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T09:05:56.237 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:05:56.237 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:05:56.237 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:56.246 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:05:56.265 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:05:56.265 INFO:teuthology.orchestra.run.trial004.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:05:56.265 INFO:teuthology.orchestra.run.trial004.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T09:05:56.265 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:56.278 INFO:teuthology.orchestra.run.trial004.stdout: Installing : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:05:56.299 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:05:56.300 INFO:teuthology.orchestra.run.trial004.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:05:56.300 INFO:teuthology.orchestra.run.trial004.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-24T09:05:56.300 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:05:56.300 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:05:56.300 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:56.424 INFO:teuthology.orchestra.run.trial004.stdout: Installing : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:05:56.444 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:05:56.444 INFO:teuthology.orchestra.run.trial004.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:05:56.445 INFO:teuthology.orchestra.run.trial004.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T09:05:56.445 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:05:56.445 INFO:teuthology.orchestra.run.trial004.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:05:56.445 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:05:57.247 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:05:57.250 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:05:57.266 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:05:57.276 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 126/192 2026-02-24T09:05:57.283 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-packaging-20.9-5.el9.noarch 127/192 2026-02-24T09:05:57.296 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-ply-3.11-14.el9.noarch 128/192 2026-02-24T09:05:57.312 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 129/192 2026-02-24T09:05:57.388 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 130/192 2026-02-24T09:05:57.397 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 131/192 2026-02-24T09:05:57.421 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 132/192 2026-02-24T09:05:57.451 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 133/192 2026-02-24T09:05:57.502 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 134/192 2026-02-24T09:05:57.508 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:05:57.512 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 136/192 2026-02-24T09:05:57.516 INFO:teuthology.orchestra.run.trial014.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 137/192 2026-02-24T09:05:57.519 INFO:teuthology.orchestra.run.trial014.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 138/192 2026-02-24T09:05:57.519 INFO:teuthology.orchestra.run.trial014.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:05:57.536 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:05:57.789 INFO:teuthology.orchestra.run.trial014.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 140/192 2026-02-24T09:05:57.792 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:05:57.831 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:05:57.831 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T09:05:57.832 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T09:05:57.832 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:05:57.835 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:05:59.794 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 168/192 2026-02-24T09:05:59.798 INFO:teuthology.orchestra.run.trial004.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 169/192 2026-02-24T09:05:59.872 INFO:teuthology.orchestra.run.trial004.stdout: Installing : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 170/192 2026-02-24T09:05:59.883 INFO:teuthology.orchestra.run.trial004.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 171/192 2026-02-24T09:05:59.887 INFO:teuthology.orchestra.run.trial004.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 172/192 2026-02-24T09:05:59.897 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 173/192 2026-02-24T09:05:59.898 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libtool-2.4.6-46.el9.x86_64 174/192 2026-02-24T09:06:00.019 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:06:00.023 INFO:teuthology.orchestra.run.trial004.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:06:00.041 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:06:00.051 INFO:teuthology.orchestra.run.trial004.stdout: Installing : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 176/192 2026-02-24T09:06:00.054 INFO:teuthology.orchestra.run.trial004.stdout: Installing : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:06:00.096 INFO:teuthology.orchestra.run.trial004.stdout: Installing : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 178/192 2026-02-24T09:06:00.548 INFO:teuthology.orchestra.run.trial004.stdout: Installing : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 179/192 2026-02-24T09:06:00.564 INFO:teuthology.orchestra.run.trial004.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 180/192 2026-02-24T09:06:00.574 INFO:teuthology.orchestra.run.trial004.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 181/192 2026-02-24T09:06:00.601 INFO:teuthology.orchestra.run.trial004.stdout: Installing : flex-2.6.4-9.el9.x86_64 182/192 2026-02-24T09:06:00.607 INFO:teuthology.orchestra.run.trial004.stdout: Installing : bison-3.7.4-5.el9.x86_64 183/192 2026-02-24T09:06:00.613 INFO:teuthology.orchestra.run.trial004.stdout: Cleanup : util-linux-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:06:00.616 INFO:teuthology.orchestra.run.trial004.stdout: Cleanup : util-linux-core-2.37.4-21.el9.x86_64 185/192 2026-02-24T09:06:00.617 INFO:teuthology.orchestra.run.trial004.stdout: Cleanup : libfdisk-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:06:00.620 INFO:teuthology.orchestra.run.trial004.stdout: Cleanup : libmount-2.37.4-21.el9.x86_64 187/192 2026-02-24T09:06:00.620 INFO:teuthology.orchestra.run.trial004.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:06:00.633 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:06:00.633 INFO:teuthology.orchestra.run.trial004.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:06:00.645 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:06:00.647 INFO:teuthology.orchestra.run.trial004.stdout: Cleanup : libblkid-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:06:00.648 INFO:teuthology.orchestra.run.trial004.stdout: Cleanup : libuuid-2.37.4-21.el9.x86_64 191/192 2026-02-24T09:06:00.649 INFO:teuthology.orchestra.run.trial004.stdout: Cleanup : libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:06:00.655 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:06:00.680 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:06:01.637 INFO:teuthology.orchestra.run.trial004.stdout: Running scriptlet: libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:06:01.638 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 1/192 2026-02-24T09:06:01.638 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2/192 2026-02-24T09:06:01.638 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 3/192 2026-02-24T09:06:01.638 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 4/192 2026-02-24T09:06:01.638 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 5/192 2026-02-24T09:06:01.638 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 6/192 2026-02-24T09:06:01.638 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 7/192 2026-02-24T09:06:01.638 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:06:01.638 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:06:01.638 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 13/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 14/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 15/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 16/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 17/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 18/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 19/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 20/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:06:01.639 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 22/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 23/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 24/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 25/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 26/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 27/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 28/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 29/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 30/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 31/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 32/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 33/192 2026-02-24T09:06:01.640 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 34/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 35/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 36/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 37/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 38/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 39/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 40/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 41/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 42/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 43/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 44/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 45/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 46/192 2026-02-24T09:06:01.641 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 47/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 48/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 49/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 50/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 51/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 52/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 53/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 54/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 55/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 56/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 57/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-ply-3.11-14.el9.noarch 58/192 2026-02-24T09:06:01.642 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 59/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 60/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 61/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 62/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : unzip-6.0-59.el9.x86_64 63/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : zip-3.0-35.el9.x86_64 64/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : automake-1.16.2-8.el9.noarch 65/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : bison-3.7.4-5.el9.x86_64 66/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 67/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 68/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : flex-2.6.4-9.el9.x86_64 69/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 70/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 71/192 2026-02-24T09:06:01.643 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 72/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 73/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 74/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 75/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 76/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 77/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 78/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 79/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libuuid-devel-2.37.4-25.el9.x86_64 80/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 81/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 82/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 83/192 2026-02-24T09:06:01.644 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : lua-5.4.4-4.el9.x86_64 84/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 85/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 86/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 87/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 88/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 89/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 90/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : postgresql-13.23-1.el9.x86_64 91/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 92/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 93/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 94/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 95/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 96/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 97/192 2026-02-24T09:06:01.645 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 98/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 99/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 100/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 101/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 102/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 104/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 105/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 106/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 107/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 108/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 109/192 2026-02-24T09:06:01.646 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 111/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 112/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 113/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 114/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 115/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 116/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 117/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 118/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 119/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 120/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 121/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 122/192 2026-02-24T09:06:01.647 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 123/192 2026-02-24T09:06:01.648 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 124/192 2026-02-24T09:06:01.648 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 125/192 2026-02-24T09:06:01.648 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 126/192 2026-02-24T09:06:01.648 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 127/192 2026-02-24T09:06:01.648 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 128/192 2026-02-24T09:06:01.648 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 129/192 2026-02-24T09:06:01.648 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 130/192 2026-02-24T09:06:01.648 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 131/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 132/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 133/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 134/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 136/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 137/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 138/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 139/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 140/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 141/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 142/192 2026-02-24T09:06:01.649 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 143/192 2026-02-24T09:06:01.650 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 144/192 2026-02-24T09:06:01.650 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/192 2026-02-24T09:06:01.650 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/192 2026-02-24T09:06:01.650 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 147/192 2026-02-24T09:06:01.650 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 148/192 2026-02-24T09:06:01.650 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/192 2026-02-24T09:06:01.650 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/192 2026-02-24T09:06:01.650 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/192 2026-02-24T09:06:01.650 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 152/192 2026-02-24T09:06:01.650 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 153/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 154/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 155/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 157/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 158/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 165/192 2026-02-24T09:06:01.651 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 166/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 167/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 169/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 170/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 171/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : re2-1:20211101-20.el9.x86_64 172/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 173/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 174/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 175/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 176/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:06:01.652 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 178/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libblkid-2.37.4-25.el9.x86_64 179/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libblkid-2.37.4-21.el9.x86_64 180/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libfdisk-2.37.4-25.el9.x86_64 181/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libfdisk-2.37.4-21.el9.x86_64 182/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libmount-2.37.4-25.el9.x86_64 183/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libmount-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libsmartcols-2.37.4-25.el9.x86_64 185/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libsmartcols-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libuuid-2.37.4-25.el9.x86_64 187/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : libuuid-2.37.4-21.el9.x86_64 188/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : util-linux-2.37.4-25.el9.x86_64 189/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : util-linux-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:06:01.653 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : util-linux-core-2.37.4-25.el9.x86_64 191/192 2026-02-24T09:06:01.713 INFO:teuthology.orchestra.run.trial004.stdout: Verifying : util-linux-core-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:06:01.714 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:06:01.714 INFO:teuthology.orchestra.run.trial004.stdout:Upgraded: 2026-02-24T09:06:01.714 INFO:teuthology.orchestra.run.trial004.stdout: libblkid-2.37.4-25.el9.x86_64 2026-02-24T09:06:01.714 INFO:teuthology.orchestra.run.trial004.stdout: libfdisk-2.37.4-25.el9.x86_64 2026-02-24T09:06:01.714 INFO:teuthology.orchestra.run.trial004.stdout: libmount-2.37.4-25.el9.x86_64 2026-02-24T09:06:01.714 INFO:teuthology.orchestra.run.trial004.stdout: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.714 INFO:teuthology.orchestra.run.trial004.stdout: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.714 INFO:teuthology.orchestra.run.trial004.stdout: libsmartcols-2.37.4-25.el9.x86_64 2026-02-24T09:06:01.714 INFO:teuthology.orchestra.run.trial004.stdout: libuuid-2.37.4-25.el9.x86_64 2026-02-24T09:06:01.714 INFO:teuthology.orchestra.run.trial004.stdout: util-linux-2.37.4-25.el9.x86_64 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout: util-linux-core-2.37.4-25.el9.x86_64 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout:Installed: 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout: automake-1.16.2-8.el9.noarch 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout: bison-3.7.4-5.el9.x86_64 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout: ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout: ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.715 INFO:teuthology.orchestra.run.trial004.stdout: ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.716 INFO:teuthology.orchestra.run.trial004.stdout: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T09:06:01.717 INFO:teuthology.orchestra.run.trial004.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: flex-2.6.4-9.el9.x86_64 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T09:06:01.718 INFO:teuthology.orchestra.run.trial004.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T09:06:01.719 INFO:teuthology.orchestra.run.trial004.stdout: librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: libuuid-devel-2.37.4-25.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T09:06:01.720 INFO:teuthology.orchestra.run.trial004.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-24T09:06:01.721 INFO:teuthology.orchestra.run.trial004.stdout: postgresql-13.23-1.el9.x86_64 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T09:06:01.722 INFO:teuthology.orchestra.run.trial004.stdout: python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T09:06:01.723 INFO:teuthology.orchestra.run.trial004.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T09:06:01.724 INFO:teuthology.orchestra.run.trial004.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T09:06:01.725 INFO:teuthology.orchestra.run.trial004.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T09:06:01.726 INFO:teuthology.orchestra.run.trial004.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T09:06:01.727 INFO:teuthology.orchestra.run.trial004.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T09:06:01.728 INFO:teuthology.orchestra.run.trial004.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T09:06:01.729 INFO:teuthology.orchestra.run.trial004.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T09:06:01.729 INFO:teuthology.orchestra.run.trial004.stdout: zip-3.0-35.el9.x86_64 2026-02-24T09:06:01.729 INFO:teuthology.orchestra.run.trial004.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-24T09:06:01.729 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:06:01.729 INFO:teuthology.orchestra.run.trial004.stdout:Complete! 2026-02-24T09:06:01.812 DEBUG:teuthology.parallel:result is None 2026-02-24T09:06:02.012 INFO:teuthology.orchestra.run.trial090.stdout:(183/183): python3-scipy-1.9.3-2.el9.x86_64.rpm 802 kB/s | 19 MB 00:24 2026-02-24T09:06:02.015 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-24T09:06:02.015 INFO:teuthology.orchestra.run.trial090.stdout:Total 6.4 MB/s | 296 MB 00:46 2026-02-24T09:06:02.492 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:06:02.492 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /sys 2026-02-24T09:06:02.492 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /proc 2026-02-24T09:06:02.492 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /mnt 2026-02-24T09:06:02.492 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /var/tmp 2026-02-24T09:06:02.492 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /home 2026-02-24T09:06:02.492 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /root 2026-02-24T09:06:02.492 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /tmp 2026-02-24T09:06:02.492 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:02.596 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:06:02.618 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:06:02.618 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:02.618 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T09:06:02.618 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:06:02.618 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:06:02.618 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:02.792 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-24T09:06:02.836 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:06:02.856 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:06:02.856 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:02.856 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T09:06:02.857 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:06:02.857 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:06:02.857 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:02.863 INFO:teuthology.orchestra.run.trial014.stdout: Installing : mailcap-2.1.49-5.el9.noarch 145/192 2026-02-24T09:06:02.864 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 146/192 2026-02-24T09:06:02.869 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-24T09:06:02.869 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-24T09:06:02.882 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:06:02.882 INFO:teuthology.orchestra.run.trial014.stdout:Creating group 'qat' with GID 992. 2026-02-24T09:06:02.882 INFO:teuthology.orchestra.run.trial014.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T09:06:02.882 INFO:teuthology.orchestra.run.trial014.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T09:06:02.882 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:02.891 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:06:02.915 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:06:02.915 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T09:06:02.915 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:03.562 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 148/192 2026-02-24T09:06:03.953 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-24T09:06:03.954 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-24T09:06:04.336 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 149/192 2026-02-24T09:06:04.399 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 150/192 2026-02-24T09:06:04.401 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:06:04.415 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:06:04.415 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:04.415 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T09:06:04.415 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:04.425 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:06:04.448 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:06:04.448 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:04.448 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T09:06:04.448 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:06:04.448 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:06:04.448 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:04.505 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:06:04.507 INFO:teuthology.orchestra.run.trial014.stdout: Installing : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:06:04.517 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 154/192 2026-02-24T09:06:04.540 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 155/192 2026-02-24T09:06:04.542 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:06:05.104 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-24T09:06:05.106 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : libuuid-2.37.4-25.el9.x86_64 1/192 2026-02-24T09:06:05.107 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:06:05.119 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libblkid-2.37.4-25.el9.x86_64 2/192 2026-02-24T09:06:05.124 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 3/192 2026-02-24T09:06:05.127 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/192 2026-02-24T09:06:05.135 INFO:teuthology.orchestra.run.trial090.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/192 2026-02-24T09:06:05.146 INFO:teuthology.orchestra.run.trial090.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/192 2026-02-24T09:06:05.302 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/192 2026-02-24T09:06:05.304 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:06:05.355 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:06:05.356 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:06:05.369 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:06:05.371 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:06:05.372 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:06:05.399 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:06:05.406 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:06:05.408 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 13/192 2026-02-24T09:06:05.412 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 14/192 2026-02-24T09:06:05.413 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 15/192 2026-02-24T09:06:05.416 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 16/192 2026-02-24T09:06:05.420 INFO:teuthology.orchestra.run.trial090.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 17/192 2026-02-24T09:06:05.541 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/192 2026-02-24T09:06:05.542 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:06:05.613 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 19/192 2026-02-24T09:06:05.622 INFO:teuthology.orchestra.run.trial090.stdout: Installing : postgresql-13.23-1.el9.x86_64 20/192 2026-02-24T09:06:05.623 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:06:05.643 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:06:05.644 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:06:05.690 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 22/192 2026-02-24T09:06:05.697 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 23/192 2026-02-24T09:06:05.701 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 24/192 2026-02-24T09:06:05.704 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : libmount-2.37.4-25.el9.x86_64 25/192 2026-02-24T09:06:05.707 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : libsmartcols-2.37.4-25.el9.x86_64 26/192 2026-02-24T09:06:05.710 INFO:teuthology.orchestra.run.trial090.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 27/192 2026-02-24T09:06:05.740 INFO:teuthology.orchestra.run.trial090.stdout: Installing : re2-1:20211101-20.el9.x86_64 28/192 2026-02-24T09:06:05.761 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 29/192 2026-02-24T09:06:05.767 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 30/192 2026-02-24T09:06:05.774 INFO:teuthology.orchestra.run.trial090.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 31/192 2026-02-24T09:06:05.776 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lua-5.4.4-4.el9.x86_64 32/192 2026-02-24T09:06:05.781 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 33/192 2026-02-24T09:06:05.804 INFO:teuthology.orchestra.run.trial090.stdout: Installing : unzip-6.0-59.el9.x86_64 34/192 2026-02-24T09:06:05.817 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 35/192 2026-02-24T09:06:05.823 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 36/192 2026-02-24T09:06:05.826 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 37/192 2026-02-24T09:06:05.833 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 38/192 2026-02-24T09:06:05.834 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 39/192 2026-02-24T09:06:05.836 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 40/192 2026-02-24T09:06:05.846 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 41/192 2026-02-24T09:06:05.880 INFO:teuthology.orchestra.run.trial090.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 42/192 2026-02-24T09:06:05.884 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 43/192 2026-02-24T09:06:05.895 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 44/192 2026-02-24T09:06:05.906 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 45/192 2026-02-24T09:06:05.913 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 46/192 2026-02-24T09:06:05.937 INFO:teuthology.orchestra.run.trial090.stdout: Installing : zip-3.0-35.el9.x86_64 47/192 2026-02-24T09:06:05.940 INFO:teuthology.orchestra.run.trial090.stdout: Installing : luarocks-3.9.2-5.el9.noarch 48/192 2026-02-24T09:06:05.942 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 49/192 2026-02-24T09:06:05.945 INFO:teuthology.orchestra.run.trial090.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 50/192 2026-02-24T09:06:05.973 INFO:teuthology.orchestra.run.trial090.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 51/192 2026-02-24T09:06:06.024 INFO:teuthology.orchestra.run.trial090.stdout: Installing : automake-1.16.2-8.el9.noarch 52/192 2026-02-24T09:06:06.037 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 53/192 2026-02-24T09:06:06.061 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 54/192 2026-02-24T09:06:06.064 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:06:06.072 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: util-linux-core-2.37.4-25.el9.x86_64 55/192 2026-02-24T09:06:06.076 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/192 2026-02-24T09:06:06.092 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 57/192 2026-02-24T09:06:06.097 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 58/192 2026-02-24T09:06:06.104 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 59/192 2026-02-24T09:06:06.112 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 60/192 2026-02-24T09:06:06.116 INFO:teuthology.orchestra.run.trial090.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 61/192 2026-02-24T09:06:06.123 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:06:06.130 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:06:06.138 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 62/192 2026-02-24T09:06:06.141 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 63/192 2026-02-24T09:06:06.227 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : libfdisk-2.37.4-25.el9.x86_64 64/192 2026-02-24T09:06:06.345 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : util-linux-2.37.4-25.el9.x86_64 65/192 2026-02-24T09:06:06.348 INFO:teuthology.orchestra.run.trial090.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:06:06.586 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:06:06.587 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:06:06.600 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:06:06.600 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:06:06.638 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 66/192 2026-02-24T09:06:06.638 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T09:06:06.638 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:06.660 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libuuid-devel-2.37.4-25.el9.x86_64 67/192 2026-02-24T09:06:06.661 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:06:06.666 INFO:teuthology.orchestra.run.trial090.stdout: Installing : thrift-0.15.0-4.el9.x86_64 68/192 2026-02-24T09:06:06.669 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 69/192 2026-02-24T09:06:06.684 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 70/192 2026-02-24T09:06:06.688 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 71/192 2026-02-24T09:06:06.693 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 72/192 2026-02-24T09:06:06.703 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 160/192 2026-02-24T09:06:06.705 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:06:06.705 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 73/192 2026-02-24T09:06:06.709 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 74/192 2026-02-24T09:06:06.718 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 75/192 2026-02-24T09:06:06.725 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 76/192 2026-02-24T09:06:06.726 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:06:06.726 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:06.726 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T09:06:06.726 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:06:06.726 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:06:06.726 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:06.739 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:06:06.744 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 77/192 2026-02-24T09:06:06.748 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:06:06.755 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 78/192 2026-02-24T09:06:06.771 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 79/192 2026-02-24T09:06:06.776 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 80/192 2026-02-24T09:06:06.784 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 81/192 2026-02-24T09:06:06.824 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 82/192 2026-02-24T09:06:07.148 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 83/192 2026-02-24T09:06:07.158 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 84/192 2026-02-24T09:06:07.162 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 85/192 2026-02-24T09:06:07.168 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 86/192 2026-02-24T09:06:07.171 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 87/192 2026-02-24T09:06:07.176 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/192 2026-02-24T09:06:07.179 INFO:teuthology.orchestra.run.trial090.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 89/192 2026-02-24T09:06:07.180 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 90/192 2026-02-24T09:06:07.208 INFO:teuthology.orchestra.run.trial090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/192 2026-02-24T09:06:07.250 INFO:teuthology.orchestra.run.trial090.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 92/192 2026-02-24T09:06:07.254 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/192 2026-02-24T09:06:07.258 INFO:teuthology.orchestra.run.trial090.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 94/192 2026-02-24T09:06:07.266 INFO:teuthology.orchestra.run.trial090.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/192 2026-02-24T09:06:07.273 INFO:teuthology.orchestra.run.trial090.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 96/192 2026-02-24T09:06:07.301 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 97/192 2026-02-24T09:06:07.307 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 98/192 2026-02-24T09:06:07.310 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 99/192 2026-02-24T09:06:07.316 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 100/192 2026-02-24T09:06:07.320 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 101/192 2026-02-24T09:06:07.326 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 102/192 2026-02-24T09:06:07.330 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 103/192 2026-02-24T09:06:07.331 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 163/192 2026-02-24T09:06:07.333 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:06:07.355 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:06:07.355 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:07.355 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T09:06:07.355 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:06:07.355 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:06:07.355 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:07.358 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 104/192 2026-02-24T09:06:07.364 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:06:07.368 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 105/192 2026-02-24T09:06:07.374 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/192 2026-02-24T09:06:07.380 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 107/192 2026-02-24T09:06:07.383 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:06:07.383 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:07.383 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T09:06:07.383 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:07.397 INFO:teuthology.orchestra.run.trial014.stdout: Installing : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:06:07.415 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 108/192 2026-02-24T09:06:07.416 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:06:07.416 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:07.416 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-24T09:06:07.416 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:06:07.416 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:06:07.416 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:07.426 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 109/192 2026-02-24T09:06:07.542 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:06:07.562 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:06:07.563 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:07.563 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T09:06:07.563 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:06:07.563 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:06:07.563 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:07.650 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 110/192 2026-02-24T09:06:07.673 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 111/192 2026-02-24T09:06:07.677 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 112/192 2026-02-24T09:06:07.736 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openblas-0.3.29-1.el9.x86_64 113/192 2026-02-24T09:06:07.738 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 114/192 2026-02-24T09:06:07.759 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 115/192 2026-02-24T09:06:08.085 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 116/192 2026-02-24T09:06:08.159 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 117/192 2026-02-24T09:06:08.831 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 118/192 2026-02-24T09:06:08.845 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 119/192 2026-02-24T09:06:08.847 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 120/192 2026-02-24T09:06:08.853 INFO:teuthology.orchestra.run.trial090.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 121/192 2026-02-24T09:06:09.134 INFO:teuthology.orchestra.run.trial090.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 122/192 2026-02-24T09:06:09.135 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:06:09.159 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 123/192 2026-02-24T09:06:09.160 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 124/192 2026-02-24T09:06:10.239 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:06:10.242 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:06:10.259 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 125/192 2026-02-24T09:06:10.269 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 126/192 2026-02-24T09:06:10.276 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 127/192 2026-02-24T09:06:10.290 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ply-3.11-14.el9.noarch 128/192 2026-02-24T09:06:10.306 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 129/192 2026-02-24T09:06:10.384 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 130/192 2026-02-24T09:06:10.393 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 131/192 2026-02-24T09:06:10.417 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 132/192 2026-02-24T09:06:10.447 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 133/192 2026-02-24T09:06:10.497 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 134/192 2026-02-24T09:06:10.503 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:06:10.507 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 136/192 2026-02-24T09:06:10.511 INFO:teuthology.orchestra.run.trial090.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 137/192 2026-02-24T09:06:10.514 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 138/192 2026-02-24T09:06:10.514 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:06:10.532 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 139/192 2026-02-24T09:06:10.777 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 140/192 2026-02-24T09:06:10.780 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:06:10.829 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 141/192 2026-02-24T09:06:10.829 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T09:06:10.829 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T09:06:10.829 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:10.833 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:06:10.989 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 168/192 2026-02-24T09:06:10.992 INFO:teuthology.orchestra.run.trial014.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 169/192 2026-02-24T09:06:11.066 INFO:teuthology.orchestra.run.trial014.stdout: Installing : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 170/192 2026-02-24T09:06:11.076 INFO:teuthology.orchestra.run.trial014.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 171/192 2026-02-24T09:06:11.080 INFO:teuthology.orchestra.run.trial014.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 172/192 2026-02-24T09:06:11.089 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 173/192 2026-02-24T09:06:11.091 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libtool-2.4.6-46.el9.x86_64 174/192 2026-02-24T09:06:11.215 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:06:11.219 INFO:teuthology.orchestra.run.trial014.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:06:11.239 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:06:11.250 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 176/192 2026-02-24T09:06:11.253 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:06:11.296 INFO:teuthology.orchestra.run.trial014.stdout: Installing : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 178/192 2026-02-24T09:06:11.748 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 179/192 2026-02-24T09:06:11.765 INFO:teuthology.orchestra.run.trial014.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 180/192 2026-02-24T09:06:11.774 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 181/192 2026-02-24T09:06:11.801 INFO:teuthology.orchestra.run.trial014.stdout: Installing : flex-2.6.4-9.el9.x86_64 182/192 2026-02-24T09:06:11.807 INFO:teuthology.orchestra.run.trial014.stdout: Installing : bison-3.7.4-5.el9.x86_64 183/192 2026-02-24T09:06:11.813 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : util-linux-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:06:11.815 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : util-linux-core-2.37.4-21.el9.x86_64 185/192 2026-02-24T09:06:11.817 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : libfdisk-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:06:11.819 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : libmount-2.37.4-21.el9.x86_64 187/192 2026-02-24T09:06:11.819 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:06:11.833 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:06:11.833 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:06:11.845 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:06:11.847 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : libblkid-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:06:11.848 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : libuuid-2.37.4-21.el9.x86_64 191/192 2026-02-24T09:06:11.849 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:06:11.856 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:06:11.879 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:06:12.843 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:06:12.843 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 1/192 2026-02-24T09:06:12.843 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2/192 2026-02-24T09:06:12.843 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 3/192 2026-02-24T09:06:12.843 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 4/192 2026-02-24T09:06:12.843 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 5/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 6/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 7/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 13/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 14/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 15/192 2026-02-24T09:06:12.844 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 16/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 17/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 18/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 19/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 20/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 22/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 23/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 24/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 25/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 26/192 2026-02-24T09:06:12.845 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 27/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 28/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 29/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 30/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 31/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 32/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 33/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 34/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 35/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 36/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 37/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 38/192 2026-02-24T09:06:12.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 39/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 40/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 41/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 42/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 43/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 44/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 45/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 46/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 47/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 48/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 49/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 50/192 2026-02-24T09:06:12.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 51/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 52/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 53/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 54/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 55/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 56/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 57/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-ply-3.11-14.el9.noarch 58/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 59/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 60/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 61/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 62/192 2026-02-24T09:06:12.848 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : unzip-6.0-59.el9.x86_64 63/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : zip-3.0-35.el9.x86_64 64/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : automake-1.16.2-8.el9.noarch 65/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : bison-3.7.4-5.el9.x86_64 66/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 67/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 68/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : flex-2.6.4-9.el9.x86_64 69/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 70/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 71/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 72/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 73/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 74/192 2026-02-24T09:06:12.849 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 75/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 76/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 77/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 78/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 79/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libuuid-devel-2.37.4-25.el9.x86_64 80/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 81/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 82/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 83/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : lua-5.4.4-4.el9.x86_64 84/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 85/192 2026-02-24T09:06:12.850 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 86/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 87/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 88/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 89/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 90/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : postgresql-13.23-1.el9.x86_64 91/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 92/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 93/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 94/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 95/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 96/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 97/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 98/192 2026-02-24T09:06:12.851 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 99/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 100/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 101/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 102/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 104/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 105/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 106/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 107/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 108/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 109/192 2026-02-24T09:06:12.852 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 111/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 112/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 113/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 114/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 115/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 116/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 117/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 118/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 119/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 120/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 121/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 122/192 2026-02-24T09:06:12.853 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 123/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 124/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 125/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 126/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 127/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 128/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 129/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 130/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 131/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 132/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 133/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 134/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:06:12.854 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 136/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 137/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 138/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 139/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 140/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 141/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 142/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 143/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 144/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 147/192 2026-02-24T09:06:12.855 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 148/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 152/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 153/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 154/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 155/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 157/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 158/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/192 2026-02-24T09:06:12.856 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 165/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 166/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 167/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 169/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 170/192 2026-02-24T09:06:12.857 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 171/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : re2-1:20211101-20.el9.x86_64 172/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 173/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 174/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 175/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 176/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 178/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libblkid-2.37.4-25.el9.x86_64 179/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libblkid-2.37.4-21.el9.x86_64 180/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libfdisk-2.37.4-25.el9.x86_64 181/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libfdisk-2.37.4-21.el9.x86_64 182/192 2026-02-24T09:06:12.858 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libmount-2.37.4-25.el9.x86_64 183/192 2026-02-24T09:06:12.859 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libmount-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:06:12.859 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libsmartcols-2.37.4-25.el9.x86_64 185/192 2026-02-24T09:06:12.859 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libsmartcols-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:06:12.859 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libuuid-2.37.4-25.el9.x86_64 187/192 2026-02-24T09:06:12.859 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libuuid-2.37.4-21.el9.x86_64 188/192 2026-02-24T09:06:12.859 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : util-linux-2.37.4-25.el9.x86_64 189/192 2026-02-24T09:06:12.859 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : util-linux-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:06:12.859 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : util-linux-core-2.37.4-25.el9.x86_64 191/192 2026-02-24T09:06:12.915 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : util-linux-core-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:06:12.915 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout:Upgraded: 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout: libblkid-2.37.4-25.el9.x86_64 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout: libfdisk-2.37.4-25.el9.x86_64 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout: libmount-2.37.4-25.el9.x86_64 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout: libsmartcols-2.37.4-25.el9.x86_64 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout: libuuid-2.37.4-25.el9.x86_64 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout: util-linux-2.37.4-25.el9.x86_64 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout: util-linux-core-2.37.4-25.el9.x86_64 2026-02-24T09:06:12.916 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: automake-1.16.2-8.el9.noarch 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: bison-3.7.4-5.el9.x86_64 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.917 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.918 INFO:teuthology.orchestra.run.trial014.stdout: ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: flex-2.6.4-9.el9.x86_64 2026-02-24T09:06:12.919 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.920 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.921 INFO:teuthology.orchestra.run.trial014.stdout: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: libuuid-devel-2.37.4-25.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T09:06:12.922 INFO:teuthology.orchestra.run.trial014.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-24T09:06:12.923 INFO:teuthology.orchestra.run.trial014.stdout: postgresql-13.23-1.el9.x86_64 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T09:06:12.924 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T09:06:12.925 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T09:06:12.926 INFO:teuthology.orchestra.run.trial014.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T09:06:12.927 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.928 INFO:teuthology.orchestra.run.trial014.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T09:06:12.929 INFO:teuthology.orchestra.run.trial014.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-24T09:06:12.930 INFO:teuthology.orchestra.run.trial014.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T09:06:12.931 INFO:teuthology.orchestra.run.trial014.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T09:06:12.931 INFO:teuthology.orchestra.run.trial014.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T09:06:12.931 INFO:teuthology.orchestra.run.trial014.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T09:06:12.931 INFO:teuthology.orchestra.run.trial014.stdout: zip-3.0-35.el9.x86_64 2026-02-24T09:06:12.931 INFO:teuthology.orchestra.run.trial014.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-24T09:06:12.931 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:06:12.931 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T09:06:13.014 DEBUG:teuthology.parallel:result is None 2026-02-24T09:06:15.435 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 142/192 2026-02-24T09:06:15.435 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /sys 2026-02-24T09:06:15.435 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /proc 2026-02-24T09:06:15.435 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /mnt 2026-02-24T09:06:15.435 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /var/tmp 2026-02-24T09:06:15.435 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /home 2026-02-24T09:06:15.436 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /root 2026-02-24T09:06:15.436 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /tmp 2026-02-24T09:06:15.436 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:15.535 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:06:15.558 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 143/192 2026-02-24T09:06:15.558 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:15.558 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T09:06:15.558 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:06:15.558 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T09:06:15.558 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:15.768 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:06:15.789 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 144/192 2026-02-24T09:06:15.790 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:15.790 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T09:06:15.790 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:06:15.790 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T09:06:15.790 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:15.795 INFO:teuthology.orchestra.run.trial090.stdout: Installing : mailcap-2.1.49-5.el9.noarch 145/192 2026-02-24T09:06:15.796 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 146/192 2026-02-24T09:06:15.815 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:06:15.815 INFO:teuthology.orchestra.run.trial090.stdout:Creating group 'qat' with GID 992. 2026-02-24T09:06:15.815 INFO:teuthology.orchestra.run.trial090.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T09:06:15.815 INFO:teuthology.orchestra.run.trial090.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T09:06:15.815 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:15.823 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:06:15.847 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 147/192 2026-02-24T09:06:15.848 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T09:06:15.848 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:16.477 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 148/192 2026-02-24T09:06:17.230 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 149/192 2026-02-24T09:06:17.293 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 150/192 2026-02-24T09:06:17.295 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:06:17.309 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 151/192 2026-02-24T09:06:17.309 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:17.309 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T09:06:17.309 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:17.319 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:06:17.342 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 152/192 2026-02-24T09:06:17.342 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:17.342 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T09:06:17.342 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:06:17.342 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T09:06:17.342 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:17.400 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:06:17.402 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 153/192 2026-02-24T09:06:17.411 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 154/192 2026-02-24T09:06:17.435 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 155/192 2026-02-24T09:06:17.436 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:06:19.013 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 156/192 2026-02-24T09:06:19.020 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:06:19.472 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 157/192 2026-02-24T09:06:19.473 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:06:19.486 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 158/192 2026-02-24T09:06:19.487 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:06:19.548 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 159/192 2026-02-24T09:06:19.589 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 160/192 2026-02-24T09:06:19.590 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:06:19.612 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 161/192 2026-02-24T09:06:19.612 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:19.612 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T09:06:19.612 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:06:19.612 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T09:06:19.612 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:19.625 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:06:19.635 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 162/192 2026-02-24T09:06:20.204 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 163/192 2026-02-24T09:06:20.206 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:06:20.227 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 164/192 2026-02-24T09:06:20.228 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:20.228 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T09:06:20.228 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:06:20.228 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T09:06:20.228 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:20.237 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:06:20.258 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 165/192 2026-02-24T09:06:20.258 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:20.258 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T09:06:20.258 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:20.270 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:06:20.290 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 166/192 2026-02-24T09:06:20.290 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:20.290 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-24T09:06:20.290 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:06:20.291 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-24T09:06:20.291 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:20.413 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:06:20.434 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 167/192 2026-02-24T09:06:20.434 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T09:06:20.434 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T09:06:20.435 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:06:20.435 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T09:06:20.435 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:23.773 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 168/192 2026-02-24T09:06:23.776 INFO:teuthology.orchestra.run.trial090.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 169/192 2026-02-24T09:06:23.850 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 170/192 2026-02-24T09:06:23.860 INFO:teuthology.orchestra.run.trial090.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 171/192 2026-02-24T09:06:23.864 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 172/192 2026-02-24T09:06:23.874 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 173/192 2026-02-24T09:06:23.875 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libtool-2.4.6-46.el9.x86_64 174/192 2026-02-24T09:06:23.992 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:06:23.996 INFO:teuthology.orchestra.run.trial090.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:06:24.015 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 175/192 2026-02-24T09:06:24.025 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 176/192 2026-02-24T09:06:24.029 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:06:24.070 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 178/192 2026-02-24T09:06:24.523 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 179/192 2026-02-24T09:06:24.539 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 180/192 2026-02-24T09:06:24.548 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 181/192 2026-02-24T09:06:24.576 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flex-2.6.4-9.el9.x86_64 182/192 2026-02-24T09:06:24.582 INFO:teuthology.orchestra.run.trial090.stdout: Installing : bison-3.7.4-5.el9.x86_64 183/192 2026-02-24T09:06:24.587 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : util-linux-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:06:24.590 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : util-linux-core-2.37.4-21.el9.x86_64 185/192 2026-02-24T09:06:24.591 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : libfdisk-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:06:24.594 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : libmount-2.37.4-21.el9.x86_64 187/192 2026-02-24T09:06:24.594 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:06:24.607 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 188/192 2026-02-24T09:06:24.607 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:06:24.619 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 189/192 2026-02-24T09:06:24.621 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : libblkid-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:06:24.622 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : libuuid-2.37.4-21.el9.x86_64 191/192 2026-02-24T09:06:24.623 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:06:24.630 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:06:24.654 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 192/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libsmartcols-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 1/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 3/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 4/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a 5/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 6/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 7/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 8/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 9/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86 10/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86 11/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 12/192 2026-02-24T09:06:25.643 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 13/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 14/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 15/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 16/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86 17/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_ 18/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86 19/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 20/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 21/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 22/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86 23/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 24/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el 25/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9. 26/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_6 27/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 28/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 29/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 30/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 31/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 32/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 33/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff. 34/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noa 35/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.n 36/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc 37/192 2026-02-24T09:06:25.644 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.n 38/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el 39/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 40/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.e 41/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 42/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 43/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 44/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 45/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 46/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 47/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 48/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 49/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 50/192 2026-02-24T09:06:25.645 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 51/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 52/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 53/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 54/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 55/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 56/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 57/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 58/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 59/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 60/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 61/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 62/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : unzip-6.0-59.el9.x86_64 63/192 2026-02-24T09:06:25.646 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : zip-3.0-35.el9.x86_64 64/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : automake-1.16.2-8.el9.noarch 65/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : bison-3.7.4-5.el9.x86_64 66/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 67/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 68/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flex-2.6.4-9.el9.x86_64 69/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 70/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 71/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 72/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 73/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 74/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 75/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 76/192 2026-02-24T09:06:25.647 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 77/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 78/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 79/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libuuid-devel-2.37.4-25.el9.x86_64 80/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 81/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 82/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 83/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 84/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 85/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 86/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 87/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 88/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 89/192 2026-02-24T09:06:25.648 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 90/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : postgresql-13.23-1.el9.x86_64 91/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 92/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 93/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 94/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 95/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 96/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 97/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 98/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 99/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 100/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 101/192 2026-02-24T09:06:25.649 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 102/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 104/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 105/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 106/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 107/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 108/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 109/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 111/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 112/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 113/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 114/192 2026-02-24T09:06:25.650 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 115/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 116/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 117/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 118/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 119/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 120/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 121/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 122/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 123/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 124/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 125/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 126/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 127/192 2026-02-24T09:06:25.651 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 128/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 129/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 130/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 131/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 132/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 133/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 134/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 135/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 136/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 137/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 138/192 2026-02-24T09:06:25.652 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 139/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 140/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 141/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 142/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 143/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 144/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 147/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 148/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/192 2026-02-24T09:06:25.653 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 152/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 153/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 154/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 155/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 157/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 158/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/192 2026-02-24T09:06:25.654 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 165/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 166/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 167/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 169/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 170/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 171/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : re2-1:20211101-20.el9.x86_64 172/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 173/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 174/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 175/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 176/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 177/192 2026-02-24T09:06:25.655 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 178/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libblkid-2.37.4-25.el9.x86_64 179/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libblkid-2.37.4-21.el9.x86_64 180/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libfdisk-2.37.4-25.el9.x86_64 181/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libfdisk-2.37.4-21.el9.x86_64 182/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libmount-2.37.4-25.el9.x86_64 183/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libmount-2.37.4-21.el9.x86_64 184/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libsmartcols-2.37.4-25.el9.x86_64 185/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libsmartcols-2.37.4-21.el9.x86_64 186/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libuuid-2.37.4-25.el9.x86_64 187/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libuuid-2.37.4-21.el9.x86_64 188/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : util-linux-2.37.4-25.el9.x86_64 189/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : util-linux-2.37.4-21.el9.x86_64 190/192 2026-02-24T09:06:25.656 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : util-linux-core-2.37.4-25.el9.x86_64 191/192 2026-02-24T09:06:25.715 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : util-linux-core-2.37.4-21.el9.x86_64 192/192 2026-02-24T09:06:25.715 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:25.715 INFO:teuthology.orchestra.run.trial090.stdout:Upgraded: 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout: libblkid-2.37.4-25.el9.x86_64 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout: libfdisk-2.37.4-25.el9.x86_64 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout: libmount-2.37.4-25.el9.x86_64 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout: librados2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout: librbd1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout: libsmartcols-2.37.4-25.el9.x86_64 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout: libuuid-2.37.4-25.el9.x86_64 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout: util-linux-2.37.4-25.el9.x86_64 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout: util-linux-core-2.37.4-25.el9.x86_64 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-24T09:06:25.716 INFO:teuthology.orchestra.run.trial090.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: automake-1.16.2-8.el9.noarch 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: bison-3.7.4-5.el9.x86_64 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-base-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-grafana-dashboards-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-immutable-object-cache-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mds-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-dashboard-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-k8sevents-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-modules-core-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-rook-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-classic-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-crimson-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-prometheus-alerts-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-radosgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.718 INFO:teuthology.orchestra.run.trial090.stdout: ceph-selinux-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: ceph-test-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: ceph-volume-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: cephadm-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-shell-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-top-2:20.3.0-5537.g5bc9a1ff.el9.noarch 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: flex-2.6.4-9.el9.x86_64 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T09:06:25.719 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-daemon-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-proxy2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.720 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: libcephsqlite-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: librados-devel-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: libradosstriper1-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: librgw2-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.721 INFO:teuthology.orchestra.run.trial090.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: libuuid-devel-2.37.4-25.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T09:06:25.722 INFO:teuthology.orchestra.run.trial090.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-13.23-1.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T09:06:25.723 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-argparse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-common-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-cephfs-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T09:06:25.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T09:06:25.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T09:06:25.726 INFO:teuthology.orchestra.run.trial090.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-24T09:06:25.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-rados-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-rbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-rgw-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T09:06:25.728 INFO:teuthology.orchestra.run.trial090.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: rbd-fuse-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: rbd-mirror-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: rbd-nbd-2:20.3.0-5537.g5bc9a1ff.el9.x86_64 2026-02-24T09:06:25.729 INFO:teuthology.orchestra.run.trial090.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: zip-3.0-35.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:06:25.730 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-24T09:06:25.812 DEBUG:teuthology.parallel:result is None 2026-02-24T09:06:25.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:06:25.992 DEBUG:teuthology.orchestra.run.trial004:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T09:06:26.016 INFO:teuthology.orchestra.run.trial004.stdout:20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:06:26.016 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:06:26.017 INFO:teuthology.task.install:The correct ceph version 20.3.0-5537.g5bc9a1ff is installed. 2026-02-24T09:06:26.020 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:06:26.172 DEBUG:teuthology.orchestra.run.trial014:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T09:06:26.194 INFO:teuthology.orchestra.run.trial014.stdout:20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:06:26.195 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:06:26.195 INFO:teuthology.task.install:The correct ceph version 20.3.0-5537.g5bc9a1ff is installed. 2026-02-24T09:06:26.198 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:06:26.345 DEBUG:teuthology.orchestra.run.trial090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T09:06:26.366 INFO:teuthology.orchestra.run.trial090.stdout:20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:06:26.366 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5537.g5bc9a1ff.el9 2026-02-24T09:06:26.366 INFO:teuthology.task.install:The correct ceph version 20.3.0-5537.g5bc9a1ff is installed. 2026-02-24T09:06:26.369 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T09:06:26.369 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:06:26.369 DEBUG:teuthology.orchestra.run.trial004:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T09:06:26.397 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:06:26.397 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T09:06:26.426 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:06:26.426 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T09:06:26.454 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T09:06:26.454 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:06:26.454 DEBUG:teuthology.orchestra.run.trial004:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T09:06:26.479 DEBUG:teuthology.orchestra.run.trial004:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T09:06:26.543 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:06:26.543 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T09:06:26.569 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T09:06:26.632 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:06:26.632 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T09:06:26.658 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T09:06:26.722 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T09:06:26.722 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:06:26.723 DEBUG:teuthology.orchestra.run.trial004:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T09:06:26.747 DEBUG:teuthology.orchestra.run.trial004:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T09:06:26.812 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:06:26.812 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T09:06:26.837 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T09:06:26.900 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:06:26.900 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T09:06:26.924 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T09:06:26.989 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T09:06:26.989 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:06:26.989 DEBUG:teuthology.orchestra.run.trial004:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T09:06:27.014 DEBUG:teuthology.orchestra.run.trial004:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T09:06:27.078 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:06:27.078 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T09:06:27.103 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T09:06:27.168 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:06:27.169 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T09:06:27.193 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T09:06:27.257 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-24T09:06:27.387 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds use global snaprealm seq for subvol': False, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_export_ephemeral_random_max': 0.2}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2026-02-24T09:06:27.387 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:06:27.390 INFO:tasks.cephadm:Cluster fsid is 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:27.390 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-24T09:06:27.390 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.4', 'mon.b': '10.20.193.14', 'mon.c': '10.20.193.90'} 2026-02-24T09:06:27.390 INFO:tasks.cephadm:First mon is mon.a on trial004 2026-02-24T09:06:27.390 INFO:tasks.cephadm:First mgr is x 2026-02-24T09:06:27.390 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-24T09:06:27.390 DEBUG:teuthology.orchestra.run.trial004:> sudo hostname $(hostname -s) 2026-02-24T09:06:27.417 DEBUG:teuthology.orchestra.run.trial014:> sudo hostname $(hostname -s) 2026-02-24T09:06:27.442 DEBUG:teuthology.orchestra.run.trial090:> sudo hostname $(hostname -s) 2026-02-24T09:06:27.466 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-24T09:06:27.466 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:06:27.611 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/flavors/default/', 'ref': 'wip-vshankar-testing-20260223.155722', 'sha1': '5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-24 04:18:34.321058', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '20.3.0-5537-g5bc9a1ff', 'package_manager_version': '20.3.0-5537.g5bc9a1ff', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3216/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-24T09:06:27.758 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-vshankar-testing-20260223.155722, sha1 5bc9a1ffc19df681248ece8c3c8c7191a571745b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:06:27.759 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/x86_64/flavors/default/cephadm 2026-02-24T09:06:27.759 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/x86_64/flavors/default/cephadm 2026-02-24T09:06:27.759 DEBUG:teuthology.orchestra.run.trial004:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T09:06:28.071 INFO:teuthology.orchestra.run.trial004.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076303 Feb 24 09:06 /home/ubuntu/cephtest/cephadm 2026-02-24T09:06:28.071 DEBUG:teuthology.orchestra.run.trial014:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T09:06:28.344 INFO:teuthology.orchestra.run.trial014.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076303 Feb 24 09:06 /home/ubuntu/cephtest/cephadm 2026-02-24T09:06:28.345 DEBUG:teuthology.orchestra.run.trial090:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20260223.155722/5bc9a1ffc19df681248ece8c3c8c7191a571745b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T09:06:28.625 INFO:teuthology.orchestra.run.trial090.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076303 Feb 24 09:06 /home/ubuntu/cephtest/cephadm 2026-02-24T09:06:28.625 DEBUG:teuthology.orchestra.run.trial004:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T09:06:28.643 DEBUG:teuthology.orchestra.run.trial014:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T09:06:28.662 DEBUG:teuthology.orchestra.run.trial090:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T09:06:28.696 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b on all hosts... 2026-02-24T09:06:28.696 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b pull 2026-02-24T09:06:28.699 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b pull 2026-02-24T09:06:28.704 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b pull 2026-02-24T09:06:28.855 INFO:teuthology.orchestra.run.trial004.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b... 2026-02-24T09:06:28.856 INFO:teuthology.orchestra.run.trial014.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b... 2026-02-24T09:06:28.883 INFO:teuthology.orchestra.run.trial090.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b... 2026-02-24T09:06:39.477 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:06:39.477 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev)", 2026-02-24T09:06:39.477 INFO:teuthology.orchestra.run.trial004.stdout: "image_id": "5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212", 2026-02-24T09:06:39.477 INFO:teuthology.orchestra.run.trial004.stdout: "repo_digests": [ 2026-02-24T09:06:39.477 INFO:teuthology.orchestra.run.trial004.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b" 2026-02-24T09:06:39.477 INFO:teuthology.orchestra.run.trial004.stdout: ] 2026-02-24T09:06:39.477 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:06:39.571 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T09:06:39.571 INFO:teuthology.orchestra.run.trial014.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev)", 2026-02-24T09:06:39.571 INFO:teuthology.orchestra.run.trial014.stdout: "image_id": "5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212", 2026-02-24T09:06:39.571 INFO:teuthology.orchestra.run.trial014.stdout: "repo_digests": [ 2026-02-24T09:06:39.571 INFO:teuthology.orchestra.run.trial014.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b" 2026-02-24T09:06:39.571 INFO:teuthology.orchestra.run.trial014.stdout: ] 2026-02-24T09:06:39.571 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T09:06:39.616 INFO:teuthology.orchestra.run.trial090.stdout:{ 2026-02-24T09:06:39.616 INFO:teuthology.orchestra.run.trial090.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev)", 2026-02-24T09:06:39.616 INFO:teuthology.orchestra.run.trial090.stdout: "image_id": "5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212", 2026-02-24T09:06:39.616 INFO:teuthology.orchestra.run.trial090.stdout: "repo_digests": [ 2026-02-24T09:06:39.616 INFO:teuthology.orchestra.run.trial090.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b" 2026-02-24T09:06:39.616 INFO:teuthology.orchestra.run.trial090.stdout: ] 2026-02-24T09:06:39.616 INFO:teuthology.orchestra.run.trial090.stdout:} 2026-02-24T09:06:39.634 DEBUG:teuthology.orchestra.run.trial004:> sudo mkdir -p /etc/ceph 2026-02-24T09:06:39.662 DEBUG:teuthology.orchestra.run.trial014:> sudo mkdir -p /etc/ceph 2026-02-24T09:06:39.687 DEBUG:teuthology.orchestra.run.trial090:> sudo mkdir -p /etc/ceph 2026-02-24T09:06:39.713 DEBUG:teuthology.orchestra.run.trial004:> sudo chmod 777 /etc/ceph 2026-02-24T09:06:39.736 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod 777 /etc/ceph 2026-02-24T09:06:39.759 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod 777 /etc/ceph 2026-02-24T09:06:39.782 INFO:tasks.cephadm:Writing seed config... 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.2 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-24T09:06:39.783 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-24T09:06:39.784 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-24T09:06:39.784 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-24T09:06:39.784 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-24T09:06:39.784 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-24T09:06:39.784 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-24T09:06:39.784 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2026-02-24T09:06:39.784 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:06:39.784 DEBUG:teuthology.orchestra.run.trial004:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-24T09:06:39.800 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 19e0945d-1160-11f1-92cf-d404e6e7d460 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True [mds] mds_export_ephemeral_random_max = 0.2 2026-02-24T09:06:39.800 DEBUG:teuthology.orchestra.run.trial004:mon.a> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.a.service 2026-02-24T09:06:39.843 DEBUG:teuthology.orchestra.run.trial004:mgr.x> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.x.service 2026-02-24T09:06:39.885 INFO:tasks.cephadm:Bootstrapping... 2026-02-24T09:06:39.886 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b -v bootstrap --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.4 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:06:40.024 INFO:teuthology.orchestra.run.trial004.stdout:-------------------------------------------------------------------------------- 2026-02-24T09:06:40.024 INFO:teuthology.orchestra.run.trial004.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', '-v', 'bootstrap', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.4', '--skip-admin-label'] 2026-02-24T09:06:40.024 INFO:teuthology.orchestra.run.trial004.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-24T09:06:40.024 INFO:teuthology.orchestra.run.trial004.stdout:Verifying podman|docker is present... 2026-02-24T09:06:40.039 INFO:teuthology.orchestra.run.trial004.stdout:/bin/podman: stdout 5.8.0 2026-02-24T09:06:40.039 INFO:teuthology.orchestra.run.trial004.stdout:Verifying lvm2 is present... 2026-02-24T09:06:40.039 INFO:teuthology.orchestra.run.trial004.stdout:Verifying time synchronization is in place... 2026-02-24T09:06:40.045 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T09:06:40.045 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T09:06:40.051 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T09:06:40.051 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout inactive 2026-02-24T09:06:40.057 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout enabled 2026-02-24T09:06:40.063 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout active 2026-02-24T09:06:40.063 INFO:teuthology.orchestra.run.trial004.stdout:Unit chronyd.service is enabled and running 2026-02-24T09:06:40.063 INFO:teuthology.orchestra.run.trial004.stdout:Repeating the final host check... 2026-02-24T09:06:40.077 INFO:teuthology.orchestra.run.trial004.stdout:/bin/podman: stdout 5.8.0 2026-02-24T09:06:40.077 INFO:teuthology.orchestra.run.trial004.stdout:podman (/bin/podman) version 5.8.0 is present 2026-02-24T09:06:40.077 INFO:teuthology.orchestra.run.trial004.stdout:systemctl is present 2026-02-24T09:06:40.078 INFO:teuthology.orchestra.run.trial004.stdout:lvcreate is present 2026-02-24T09:06:40.083 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T09:06:40.083 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T09:06:40.089 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T09:06:40.089 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout inactive 2026-02-24T09:06:40.095 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout enabled 2026-02-24T09:06:40.102 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout active 2026-02-24T09:06:40.102 INFO:teuthology.orchestra.run.trial004.stdout:Unit chronyd.service is enabled and running 2026-02-24T09:06:40.102 INFO:teuthology.orchestra.run.trial004.stdout:Host looks OK 2026-02-24T09:06:40.102 INFO:teuthology.orchestra.run.trial004.stdout:Cluster fsid: 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:40.102 INFO:teuthology.orchestra.run.trial004.stdout:Acquiring lock 140070933186304 on /run/cephadm/19e0945d-1160-11f1-92cf-d404e6e7d460.lock 2026-02-24T09:06:40.103 INFO:teuthology.orchestra.run.trial004.stdout:Lock 140070933186304 acquired on /run/cephadm/19e0945d-1160-11f1-92cf-d404e6e7d460.lock 2026-02-24T09:06:40.103 INFO:teuthology.orchestra.run.trial004.stdout:Verifying IP 10.20.193.4 port 3300 ... 2026-02-24T09:06:40.103 INFO:teuthology.orchestra.run.trial004.stdout:Verifying IP 10.20.193.4 port 6789 ... 2026-02-24T09:06:40.103 INFO:teuthology.orchestra.run.trial004.stdout:Base mon IP(s) is [10.20.193.4:3300, 10.20.193.4:6789], mon addrv is [v2:10.20.193.4:3300,v1:10.20.193.4:6789] 2026-02-24T09:06:40.106 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.4 metric 102 2026-02-24T09:06:40.106 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.4 metric 102 2026-02-24T09:06:40.107 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-24T09:06:40.109 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-24T09:06:40.109 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-24T09:06:40.109 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-24T09:06:40.112 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-24T09:06:40.112 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-24T09:06:40.112 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T09:06:40.112 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-24T09:06:40.112 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout inet6 fe80::9f7b:4aa1:caae:54d7/64 scope link noprefixroute 2026-02-24T09:06:40.113 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T09:06:40.113 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-24T09:06:40.113 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:5eae/64 scope link 2026-02-24T09:06:40.113 INFO:teuthology.orchestra.run.trial004.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T09:06:40.113 INFO:teuthology.orchestra.run.trial004.stdout:Mon IP `10.20.193.4` is in CIDR network `10.20.192.0/20` 2026-02-24T09:06:40.113 INFO:teuthology.orchestra.run.trial004.stdout:Mon IP `10.20.193.4` is in CIDR network `10.20.192.0/20` 2026-02-24T09:06:40.113 INFO:teuthology.orchestra.run.trial004.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-24T09:06:40.113 INFO:teuthology.orchestra.run.trial004.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-24T09:06:40.113 INFO:teuthology.orchestra.run.trial004.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b... 2026-02-24T09:06:40.352 INFO:teuthology.orchestra.run.trial004.stdout:/bin/podman: stdout 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 2026-02-24T09:06:40.352 INFO:teuthology.orchestra.run.trial004.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b... 2026-02-24T09:06:40.352 INFO:teuthology.orchestra.run.trial004.stdout:/bin/podman: stderr Getting image source signatures 2026-02-24T09:06:40.353 INFO:teuthology.orchestra.run.trial004.stdout:/bin/podman: stderr Copying blob sha256:3d82da28ef36b49476ffeec0ce0e397991e48c7457931968a65f282d08a3b761 2026-02-24T09:06:40.353 INFO:teuthology.orchestra.run.trial004.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-02-24T09:06:40.353 INFO:teuthology.orchestra.run.trial004.stdout:/bin/podman: stderr Copying config sha256:5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 2026-02-24T09:06:40.353 INFO:teuthology.orchestra.run.trial004.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-24T09:06:40.477 INFO:teuthology.orchestra.run.trial004.stdout:ceph: stdout ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev) 2026-02-24T09:06:40.477 INFO:teuthology.orchestra.run.trial004.stdout:Ceph version: ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev) 2026-02-24T09:06:40.478 INFO:teuthology.orchestra.run.trial004.stdout:Extracting ceph user uid/gid from container image... 2026-02-24T09:06:40.617 INFO:teuthology.orchestra.run.trial004.stdout:stat: stdout 167 167 2026-02-24T09:06:40.617 INFO:teuthology.orchestra.run.trial004.stdout:Creating initial keys... 2026-02-24T09:06:40.746 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph-authtool: stdout AQAgap1pL2mpKxAA1utaUXFVNNntTwmoowT7pA== 2026-02-24T09:06:40.872 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph-authtool: stdout AQAgap1pl/UHMxAAL3gJPPO2gPwTP2tcrLjmEQ== 2026-02-24T09:06:40.999 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph-authtool: stdout AQAgap1pagyrOhAAhq/VdTV6o4yJBOh9W9NqMw== 2026-02-24T09:06:40.999 INFO:teuthology.orchestra.run.trial004.stdout:Creating initial monmap... 2026-02-24T09:06:41.147 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T09:06:41.147 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-24T09:06:41.147 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:41.147 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T09:06:41.148 INFO:teuthology.orchestra.run.trial004.stdout:monmaptool for a [v2:10.20.193.4:3300,v1:10.20.193.4:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T09:06:41.148 INFO:teuthology.orchestra.run.trial004.stdout:setting min_mon_release = tentacle 2026-02-24T09:06:41.148 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/monmaptool: set fsid to 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:41.148 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T09:06:41.148 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:06:41.148 INFO:teuthology.orchestra.run.trial004.stdout:Creating mon... 2026-02-24T09:06:41.257 INFO:teuthology.orchestra.run.trial004.stdout:create mon.a on 2026-02-24T09:06:41.429 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-24T09:06:41.533 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-24T09:06:41.651 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-19e0945d-1160-11f1-92cf-d404e6e7d460.target → /etc/systemd/system/ceph-19e0945d-1160-11f1-92cf-d404e6e7d460.target. 2026-02-24T09:06:41.651 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-19e0945d-1160-11f1-92cf-d404e6e7d460.target → /etc/systemd/system/ceph-19e0945d-1160-11f1-92cf-d404e6e7d460.target. 2026-02-24T09:06:41.781 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.a 2026-02-24T09:06:41.782 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stderr Failed to reset failed state of unit ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.a.service: Unit ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.a.service not loaded. 2026-02-24T09:06:41.918 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-19e0945d-1160-11f1-92cf-d404e6e7d460.target.wants/ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@.service. 2026-02-24T09:06:42.049 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 podman[41125]: 2026-02-24 09:06:42.018154748 +0000 UTC m=+0.016176068 container create 3c3fc54f93b04be512602b4a28b84dfd4bbc02fe66f4494c4a62e10f3af08f5f (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223) 2026-02-24T09:06:42.066 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T09:06:42.066 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout disabled 2026-02-24T09:06:42.072 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T09:06:42.073 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout inactive 2026-02-24T09:06:42.073 INFO:teuthology.orchestra.run.trial004.stdout:firewalld.service is not enabled 2026-02-24T09:06:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T09:06:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Waiting for mon to start... 2026-02-24T09:06:42.073 INFO:teuthology.orchestra.run.trial004.stdout:Waiting for mon... 2026-02-24T09:06:42.227 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout cluster: 2026-02-24T09:06:42.227 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout id: 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:42.227 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-24T09:06:42.227 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout services: 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.129387s) [leader: a] 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout data: 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout pgs: 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:42.228 INFO:teuthology.orchestra.run.trial004.stdout:mon is available 2026-02-24T09:06:42.229 INFO:teuthology.orchestra.run.trial004.stdout:Assimilating anything we can from ceph.conf... 2026-02-24T09:06:42.340 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 podman[41125]: 2026-02-24 09:06:42.047219377 +0000 UTC m=+0.045240707 container init 3c3fc54f93b04be512602b4a28b84dfd4bbc02fe66f4494c4a62e10f3af08f5f (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T09:06:42.340 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 podman[41125]: 2026-02-24 09:06:42.050001596 +0000 UTC m=+0.048022926 container start 3c3fc54f93b04be512602b4a28b84dfd4bbc02fe66f4494c4a62e10f3af08f5f (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:06:42.340 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 bash[41125]: 3c3fc54f93b04be512602b4a28b84dfd4bbc02fe66f4494c4a62e10f3af08f5f 2026-02-24T09:06:42.340 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 podman[41125]: 2026-02-24 09:06:42.011532172 +0000 UTC m=+0.009553502 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:06:42.340 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 systemd[1]: Started Ceph mon.a for 19e0945d-1160-11f1-92cf-d404e6e7d460. 2026-02-24T09:06:42.341 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41156]: mkfs 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:42.341 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41156]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-24T09:06:42.382 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:42.384 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T09:06:42.384 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout fsid = 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:42.384 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T09:06:42.384 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.4:3300,v1:10.20.193.4:6789] 2026-02-24T09:06:42.384 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T09:06:42.384 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T09:06:42.384 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T09:06:42.385 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T09:06:42.386 INFO:teuthology.orchestra.run.trial004.stdout:Generating new minimal ceph.conf... 2026-02-24T09:06:42.538 INFO:teuthology.orchestra.run.trial004.stdout:Restarting the monitor... 2026-02-24T09:06:42.629 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 systemd[1]: Stopping Ceph mon.a for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:06:42.889 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a[41152]: 2026-02-24T09:06:42.625+0000 7fafb9e5e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:06:42.889 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a[41152]: 2026-02-24T09:06:42.625+0000 7fafb9e5e640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T09:06:42.889 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 podman[41437]: 2026-02-24 09:06:42.716308634 +0000 UTC m=+0.103588167 container died 3c3fc54f93b04be512602b4a28b84dfd4bbc02fe66f4494c4a62e10f3af08f5f (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, OSD_FLAVOR=default) 2026-02-24T09:06:42.889 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 podman[41437]: 2026-02-24 09:06:42.723683713 +0000 UTC m=+0.110963246 container remove 3c3fc54f93b04be512602b4a28b84dfd4bbc02fe66f4494c4a62e10f3af08f5f (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T09:06:42.889 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 bash[41437]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a 2026-02-24T09:06:42.890 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 systemd[1]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-24T09:06:42.890 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 systemd[1]: Stopped Ceph mon.a for 19e0945d-1160-11f1-92cf-d404e6e7d460. 2026-02-24T09:06:42.890 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 systemd[1]: Starting Ceph mon.a for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:06:42.890 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 podman[41567]: 2026-02-24 09:06:42.865547465 +0000 UTC m=+0.014513310 container create 953bcc75edc7d772692b3a34bd4ecdc8b3733185376178f69a595fc6d9cb69bf (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, io.buildah.version=1.41.3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:06:42.897 INFO:teuthology.orchestra.run.trial004.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-24T09:06:43.050 INFO:teuthology.orchestra.run.trial004.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-24T09:06:43.050 INFO:teuthology.orchestra.run.trial004.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:06:43.050 INFO:teuthology.orchestra.run.trial004.stdout:Creating mgr... 2026-02-24T09:06:43.050 INFO:teuthology.orchestra.run.trial004.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-24T09:06:43.051 INFO:teuthology.orchestra.run.trial004.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-24T09:06:43.182 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.x 2026-02-24T09:06:43.182 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stderr Failed to reset failed state of unit ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.x.service: Unit ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.x.service not loaded. 2026-02-24T09:06:43.188 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 podman[41567]: 2026-02-24 09:06:42.887400808 +0000 UTC m=+0.036366663 container init 953bcc75edc7d772692b3a34bd4ecdc8b3733185376178f69a595fc6d9cb69bf (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, OSD_FLAVOR=default) 2026-02-24T09:06:43.188 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 podman[41567]: 2026-02-24 09:06:42.889774842 +0000 UTC m=+0.038740677 container start 953bcc75edc7d772692b3a34bd4ecdc8b3733185376178f69a595fc6d9cb69bf (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:06:43.188 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 bash[41567]: 953bcc75edc7d772692b3a34bd4ecdc8b3733185376178f69a595fc6d9cb69bf 2026-02-24T09:06:43.188 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 podman[41567]: 2026-02-24 09:06:42.859575733 +0000 UTC m=+0.008541578 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:06:43.188 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 systemd[1]: Started Ceph mon.a for 19e0945d-1160-11f1-92cf-d404e6e7d460. 2026-02-24T09:06:43.188 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: set uid:gid to 167:167 (ceph:ceph) 2026-02-24T09:06:43.188 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: pidfile_write: ignore empty --pid-file 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: load: jerasure load: lrc 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: RocksDB version: 7.9.2 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Git sha 0 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Compile date 2026-02-24 03:46:44 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: DB SUMMARY 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: DB Session ID: K02ICNX4AUJ4U6JV431W 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: CURRENT file: CURRENT 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: IDENTITY file: IDENTITY 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-24T09:06:43.189 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 83845 ; 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.error_if_exists: 0 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.create_if_missing: 0 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.paranoid_checks: 1 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.env: 0xed6d60 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.fs: PosixFileSystem 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.info_log: 0x232ce20 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_file_opening_threads: 16 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.statistics: (nil) 2026-02-24T09:06:43.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.use_fsync: 0 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_log_file_size: 0 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.keep_log_file_num: 1000 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.recycle_log_file_num: 0 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.allow_fallocate: 1 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.allow_mmap_reads: 0 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.allow_mmap_writes: 0 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.use_direct_reads: 0 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.create_missing_column_families: 0 2026-02-24T09:06:43.191 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.db_log_dir: 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.wal_dir: 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.advise_random_on_open: 1 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.db_write_buffer_size: 0 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.write_buffer_manager: 0x2328140 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-24T09:06:43.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.rate_limiter: (nil) 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.wal_recovery_mode: 2 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.enable_thread_tracking: 0 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.enable_pipelined_write: 0 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.unordered_write: 0 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.row_cache: None 2026-02-24T09:06:43.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.wal_filter: None 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.allow_ingest_behind: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.two_write_queues: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.manual_wal_flush: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.wal_compression: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.atomic_flush: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.log_readahead_size: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.best_efforts_recovery: 0 2026-02-24T09:06:43.194 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.allow_data_in_errors: 0 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.db_host_id: __hostname__ 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_background_jobs: 2 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_background_compactions: -1 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_subcompactions: 1 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_total_wal_size: 0 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-24T09:06:43.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_open_files: -1 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bytes_per_sync: 0 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_readahead_size: 0 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_background_flushes: -1 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Compression algorithms supported: 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: kZSTD supported: 0 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: kXpressCompression supported: 0 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: kBZip2Compression supported: 0 2026-02-24T09:06:43.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: kLZ4Compression supported: 1 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: kZlibCompression supported: 1 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: kLZ4HCCompression supported: 1 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: kSnappyCompression supported: 1 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.merge_operator: 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_filter: None 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_filter_factory: None 2026-02-24T09:06:43.197 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.sst_partitioner_factory: None 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x232d560) 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout: cache_index_and_filter_blocks: 1 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout: pin_top_level_index_and_filter: 1 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout: index_type: 0 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout: data_block_index_type: 0 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout: index_shortening: 1 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-24T09:06:43.198 INFO:journalctl@ceph.mon.a.trial004.stdout: checksum: 4 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: no_block_cache: 0 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: block_cache: 0x22fba50 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: block_cache_name: BinnedLRUCache 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: block_cache_options: 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: capacity : 536870912 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: num_shard_bits : 4 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: strict_capacity_limit : 0 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: high_pri_pool_ratio: 0.000 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: block_cache_compressed: (nil) 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: persistent_cache: (nil) 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: block_size: 4096 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: block_size_deviation: 10 2026-02-24T09:06:43.199 INFO:journalctl@ceph.mon.a.trial004.stdout: block_restart_interval: 16 2026-02-24T09:06:43.200 INFO:journalctl@ceph.mon.a.trial004.stdout: index_block_restart_interval: 1 2026-02-24T09:06:43.200 INFO:journalctl@ceph.mon.a.trial004.stdout: metadata_block_size: 4096 2026-02-24T09:06:43.200 INFO:journalctl@ceph.mon.a.trial004.stdout: partition_filters: 0 2026-02-24T09:06:43.200 INFO:journalctl@ceph.mon.a.trial004.stdout: use_delta_encoding: 1 2026-02-24T09:06:43.200 INFO:journalctl@ceph.mon.a.trial004.stdout: filter_policy: bloomfilter 2026-02-24T09:06:43.200 INFO:journalctl@ceph.mon.a.trial004.stdout: whole_key_filtering: 1 2026-02-24T09:06:43.201 INFO:journalctl@ceph.mon.a.trial004.stdout: verify_compression: 0 2026-02-24T09:06:43.201 INFO:journalctl@ceph.mon.a.trial004.stdout: read_amp_bytes_per_bit: 0 2026-02-24T09:06:43.201 INFO:journalctl@ceph.mon.a.trial004.stdout: format_version: 5 2026-02-24T09:06:43.201 INFO:journalctl@ceph.mon.a.trial004.stdout: enable_index_compression: 1 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout: block_align: 0 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout: max_auto_readahead_size: 262144 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout: prepopulate_block_cache: 0 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout: initial_auto_readahead_size: 8192 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout: num_file_reads_for_auto_readahead: 2 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.write_buffer_size: 33554432 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_write_buffer_number: 2 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compression: NoCompression 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bottommost_compression: Disabled 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.prefix_extractor: nullptr 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-24T09:06:43.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.num_levels: 7 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-24T09:06:43.203 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compression_opts.level: 32767 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compression_opts.strategy: 0 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compression_opts.enabled: false 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-24T09:06:43.204 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.target_file_size_base: 67108864 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-24T09:06:43.205 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.arena_block_size: 1048576 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.disable_auto_compactions: 0 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-24T09:06:43.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.inplace_update_support: 0 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.bloom_locality: 0 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.max_successive_merges: 0 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.paranoid_file_checks: 0 2026-02-24T09:06:43.207 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.force_consistency_checks: 1 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.report_bg_io_stats: 0 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.ttl: 2592000 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.enable_blob_files: false 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.min_blob_size: 0 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.blob_file_size: 268435456 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-24T09:06:43.208 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.blob_file_starting_level: 0 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 13a57fc9-72cd-4b23-8c7c-12b871272192 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771924002907264, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771924002908026, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 80354, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 255, "table_properties": {"data_size": 78530, "index_size": 209, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11390, "raw_average_key_size": 50, "raw_value_size": 72149, "raw_average_value_size": 319, "num_data_blocks": 9, "num_entries": 226, "num_filter_entries": 226, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771924002, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "13a57fc9-72cd-4b23-8c7c-12b871272192", "db_session_id": "K02ICNX4AUJ4U6JV431W", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771924002908078, "job": 1, "event": "recovery_finished"} 2026-02-24T09:06:43.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x2348e00 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: DB pointer 0x313a000 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout: ** DB Stats ** 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T09:06:43.210 INFO:journalctl@ceph.mon.a.trial004.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: ** Compaction Stats [default] ** 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: L0 2/0 80.34 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: Sum 2/0 80.34 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: ** Compaction Stats [default] ** 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-24T09:06:43.211 INFO:journalctl@ceph.mon.a.trial004.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 140.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: Cumulative compaction: 0.00 GB write, 31.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: Interval compaction: 0.00 GB write, 31.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T09:06:43.212 INFO:journalctl@ceph.mon.a.trial004.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-24T09:06:43.213 INFO:journalctl@ceph.mon.a.trial004.stdout: Block cache BinnedLRUCache@0x22fba50#2 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2026-02-24T09:06:43.213 INFO:journalctl@ceph.mon.a.trial004.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2026-02-24T09:06:43.213 INFO:journalctl@ceph.mon.a.trial004.stdout: 2026-02-24T09:06:43.213 INFO:journalctl@ceph.mon.a.trial004.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-24T09:06:43.213 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: starting mon.a rank 0 at public addrs [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] at bind addrs [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:43.213 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: mon.a@-1(???) e1 preinit fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:43.213 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: mon.a@-1(???).mds e1 new map 2026-02-24T09:06:43.213 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: mon.a@-1(???).mds e1 print_map 2026-02-24T09:06:43.213 INFO:journalctl@ceph.mon.a.trial004.stdout: e1 2026-02-24T09:06:43.213 INFO:journalctl@ceph.mon.a.trial004.stdout: btime 2026-02-24T09:06:42:076252+0000 2026-02-24T09:06:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-24T09:06:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-24T09:06:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout: legacy client fscid: -1 2026-02-24T09:06:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout: 2026-02-24T09:06:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout: No filesystems configured 2026-02-24T09:06:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-24T09:06:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T09:06:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T09:06:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T09:06:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: monmap epoch 1 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: last_changed 2026-02-24T09:06:41.121420+0000 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: created 2026-02-24T09:06:41.121420+0000 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: min_mon_release 20 (tentacle) 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: election_strategy: 1 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: 0: [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] mon.a 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: fsmap 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: osdmap e1: 0 total, 0 up, 0 in 2026-02-24T09:06:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:42 trial004 ceph-mon[41596]: mgrmap e1: no daemons active 2026-02-24T09:06:43.291 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-19e0945d-1160-11f1-92cf-d404e6e7d460.target.wants/ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@.service. 2026-02-24T09:06:43.431 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T09:06:43.432 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout disabled 2026-02-24T09:06:43.438 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T09:06:43.438 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout inactive 2026-02-24T09:06:43.438 INFO:teuthology.orchestra.run.trial004.stdout:firewalld.service is not enabled 2026-02-24T09:06:43.438 INFO:teuthology.orchestra.run.trial004.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T09:06:43.445 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T09:06:43.446 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout disabled 2026-02-24T09:06:43.452 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T09:06:43.452 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout inactive 2026-02-24T09:06:43.452 INFO:teuthology.orchestra.run.trial004.stdout:firewalld.service is not enabled 2026-02-24T09:06:43.452 INFO:teuthology.orchestra.run.trial004.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-24T09:06:43.452 INFO:teuthology.orchestra.run.trial004.stdout:Waiting for mgr to start... 2026-02-24T09:06:43.452 INFO:teuthology.orchestra.run.trial004.stdout:Waiting for mgr... 2026-02-24T09:06:43.465 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:43 trial004 systemd[1]: Started Ceph mgr.x for 19e0945d-1160-11f1-92cf-d404e6e7d460. 2026-02-24T09:06:43.618 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:43.618 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:06:43.618 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:06:43.618 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T09:06:43.618 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T09:06:43.618 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 0 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T09:06:43.619 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:43.620 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T09:06:42:076252+0000", 2026-02-24T09:06:43.621 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:43.622 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T09:06:43.623 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:43.623 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T09:06:42.076620+0000", 2026-02-24T09:06:43.623 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:06:43.623 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:43.623 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T09:06:43.623 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:06:43.623 INFO:teuthology.orchestra.run.trial004.stdout:mgr not available, waiting (1/15)... 2026-02-24T09:06:44.436 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:44 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/214505890' entity='client.admin' 2026-02-24T09:06:44.437 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:44 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/310469483' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T09:06:44.715 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:44 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:06:44.715 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:44 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:06:44.715 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:44 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: from numpy import show_config as show_numpy_config 2026-02-24T09:06:45.796 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:45.796 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:06:45.797 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:06:45.797 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T09:06:45.797 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T09:06:45.797 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T09:06:45.797 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T09:06:45.797 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:45.797 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T09:06:45.797 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T09:06:45.797 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 0 2026-02-24T09:06:45.797 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:45.798 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T09:06:45.799 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T09:06:42:076252+0000", 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T09:06:45.800 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T09:06:42.076620+0000", 2026-02-24T09:06:45.801 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:06:45.802 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:45.802 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T09:06:45.802 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:06:45.802 INFO:teuthology.orchestra.run.trial004.stdout:mgr not available, waiting (2/15)... 2026-02-24T09:06:45.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:45 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1607078091' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T09:06:47.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: Activating manager daemon x 2026-02-24T09:06:47.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: mgrmap e2: x(active, starting, since 0.00258646s) 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: from='mgr.14100 10.20.193.4:0/3706591368' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: from='mgr.14100 10.20.193.4:0/3706591368' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: from='mgr.14100 10.20.193.4:0/3706591368' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: from='mgr.14100 10.20.193.4:0/3706591368' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: from='mgr.14100 10.20.193.4:0/3706591368' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: Manager daemon x is now available 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: from='mgr.14100 10.20.193.4:0/3706591368' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: from='mgr.14100 10.20.193.4:0/3706591368' entity='mgr.x' 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: from='mgr.14100 10.20.193.4:0/3706591368' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: from='mgr.14100 10.20.193.4:0/3706591368' entity='mgr.x' 2026-02-24T09:06:47.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:46 trial004 ceph-mon[41596]: from='mgr.14100 10.20.193.4:0/3706591368' entity='mgr.x' 2026-02-24T09:06:48.070 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:48.070 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:06:48.070 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:06:48.070 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T09:06:48.070 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T09:06:48.070 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T09:06:48.070 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T09:06:48.070 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 0 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:48.071 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:48.072 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:48.073 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T09:06:42:076252+0000", 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout ], 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:06:48.074 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:48.075 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T09:06:48.075 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T09:06:48.075 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T09:06:42.076620+0000", 2026-02-24T09:06:48.075 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T09:06:48.075 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout }, 2026-02-24T09:06:48.075 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T09:06:48.075 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:06:48.075 INFO:teuthology.orchestra.run.trial004.stdout:mgr is available 2026-02-24T09:06:48.285 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:48.286 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T09:06:48.286 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout fsid = 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:48.286 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T09:06:48.286 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.4:3300,v1:10.20.193.4:6789] 2026-02-24T09:06:48.286 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T09:06:48.286 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T09:06:48.286 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T09:06:48.286 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T09:06:48.287 INFO:teuthology.orchestra.run.trial004.stdout:Enabling cephadm module... 2026-02-24T09:06:48.398 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:48 trial004 ceph-mon[41596]: mgrmap e3: x(active, since 1.00523s) 2026-02-24T09:06:48.398 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:48 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3638415377' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T09:06:49.499 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:49 trial004 ceph-mon[41596]: mgrmap e4: x(active, since 2s) 2026-02-24T09:06:49.500 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:49 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/468373602' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-24T09:06:49.500 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:49 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3435290485' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-24T09:06:49.500 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:49 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: ignoring --setuser ceph since I am not root 2026-02-24T09:06:49.500 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:49 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: ignoring --setgroup ceph since I am not root 2026-02-24T09:06:49.522 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:06:49.522 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-24T09:06:49.522 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T09:06:49.522 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-24T09:06:49.522 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T09:06:49.522 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:06:49.522 INFO:teuthology.orchestra.run.trial004.stdout:Waiting for the mgr to restart... 2026-02-24T09:06:49.522 INFO:teuthology.orchestra.run.trial004.stdout:Waiting for mgr epoch 5... 2026-02-24T09:06:50.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:50 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3435290485' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-24T09:06:50.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:50 trial004 ceph-mon[41596]: mgrmap e5: x(active, since 3s) 2026-02-24T09:06:50.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:50 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1479145552' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-24T09:06:50.716 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:50 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:06:50.716 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:50 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:06:50.716 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:50 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: from numpy import show_config as show_numpy_config 2026-02-24T09:06:52.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:52 trial004 ceph-mon[41596]: Active manager daemon x restarted 2026-02-24T09:06:52.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:52 trial004 ceph-mon[41596]: Activating manager daemon x 2026-02-24T09:06:52.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:52 trial004 ceph-mon[41596]: osdmap e2: 0 total, 0 up, 0 in 2026-02-24T09:06:52.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:52 trial004 ceph-mon[41596]: mgrmap e6: x(active, starting, since 0.00277734s) 2026-02-24T09:06:52.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:52 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:06:52.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:52 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T09:06:52.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:52 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T09:06:52.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:52 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T09:06:52.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:52 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T09:06:52.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:52 trial004 ceph-mon[41596]: Manager daemon x is now available 2026-02-24T09:06:53.056 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:06:53.056 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-24T09:06:53.056 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T09:06:53.057 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:06:53.057 INFO:teuthology.orchestra.run.trial004.stdout:mgr epoch 5 is available 2026-02-24T09:06:53.057 INFO:teuthology.orchestra.run.trial004.stdout:Verifying orchestrator module is enabled... 2026-02-24T09:06:53.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:53.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:53.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: Found migration_current of "None". Setting to last migration. 2026-02-24T09:06:53.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:53.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:53.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:53.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:06:53.717 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:53.717 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:06:53.717 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T09:06:53.717 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T09:06:53.717 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:53.717 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:53.717 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: [24/Feb/2026:09:06:52] ENGINE Bus STARTING 2026-02-24T09:06:53.717 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: [24/Feb/2026:09:06:52] ENGINE Serving on https://10.20.193.4:7150 2026-02-24T09:06:53.717 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: [24/Feb/2026:09:06:52] ENGINE Client ('10.20.193.4', 34190) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T09:06:53.717 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: [24/Feb/2026:09:06:52] ENGINE Serving on http://10.20.193.4:8765 2026-02-24T09:06:53.718 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: [24/Feb/2026:09:06:52] ENGINE Bus STARTED 2026-02-24T09:06:53.718 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:06:53.718 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T09:06:53.718 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: mgrmap e7: x(active, since 1.0048s) 2026-02-24T09:06:53.718 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T09:06:53.718 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:53 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1577727241' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-24T09:06:54.054 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-24T09:06:54.055 INFO:teuthology.orchestra.run.trial004.stdout:Setting orchestrator backend to cephadm... 2026-02-24T09:06:54.516 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-24T09:06:54.517 INFO:teuthology.orchestra.run.trial004.stdout:Generating ssh key... 2026-02-24T09:06:54.798 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: Generating public/private ed25519 key pair. 2026-02-24T09:06:54.798 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: Your identification has been saved in /tmp/tmp3yf52fh1/key 2026-02-24T09:06:54.798 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: Your public key has been saved in /tmp/tmp3yf52fh1/key.pub 2026-02-24T09:06:54.798 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: The key fingerprint is: 2026-02-24T09:06:54.798 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: SHA256:hABNFgKL5qY1bmn5dQL6z/5xm0AhheNqkYS7PjAypMg ceph-19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:54.798 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: The key's randomart image is: 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: +--[ED25519 256]--+ 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: |..o==. .. | 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: |...oo.oo | 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: |o. o oo.o | 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: |o.. o .o . | 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: |=oo..o S | 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: |XE.=o. . | 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: |o=B. o + . | 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: | ooo o o + o | 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: | .oo+.. o | 2026-02-24T09:06:54.799 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: +----[SHA256]-----+ 2026-02-24T09:06:54.981 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIERCXigqIty2F+rwYKFbBbgrPKRxq9kN3+5ue5HiOxZz ceph-19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:06:54.982 INFO:teuthology.orchestra.run.trial004.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-24T09:06:54.982 INFO:teuthology.orchestra.run.trial004.stdout:Adding key to root@localhost authorized_keys... 2026-02-24T09:06:54.982 INFO:teuthology.orchestra.run.trial004.stdout:Adding host trial004... 2026-02-24T09:06:55.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:55 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1577727241' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-24T09:06:55.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:55 trial004 ceph-mon[41596]: mgrmap e8: x(active, since 2s) 2026-02-24T09:06:55.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:55 trial004 ceph-mon[41596]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:06:55.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:55 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:55.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:55 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:06:55.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:55 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:55.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:55 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:56.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:56 trial004 ceph-mon[41596]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:06:56.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:56 trial004 ceph-mon[41596]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:06:56.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:56 trial004 ceph-mon[41596]: Generating ssh key... 2026-02-24T09:06:56.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:56 trial004 ceph-mon[41596]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:06:56.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:56 trial004 ceph-mon[41596]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial004", "addr": "10.20.193.4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:06:56.819 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout Added host 'trial004' with addr '10.20.193.4' 2026-02-24T09:06:56.819 INFO:teuthology.orchestra.run.trial004.stdout:Deploying unmanaged mon service... 2026-02-24T09:06:57.050 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:57 trial004 ceph-mon[41596]: Deploying cephadm binary to trial004 2026-02-24T09:06:57.050 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:57 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:57.050 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:57 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:06:57.062 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-24T09:06:57.063 INFO:teuthology.orchestra.run.trial004.stdout:Deploying unmanaged mgr service... 2026-02-24T09:06:57.309 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-24T09:06:57.783 INFO:teuthology.orchestra.run.trial004.stdout:Enabling the dashboard module... 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: Added host trial004 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: Saving service mon spec with placement count:5 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3015183372' entity='client.admin' 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2491429597' entity='client.admin' 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:58.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:58 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3441814072' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-24T09:06:59.097 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:58 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: ignoring --setuser ceph since I am not root 2026-02-24T09:06:59.098 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:58 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: ignoring --setgroup ceph since I am not root 2026-02-24T09:06:59.120 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:06:59.120 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-24T09:06:59.120 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T09:06:59.120 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-24T09:06:59.120 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T09:06:59.121 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:06:59.121 INFO:teuthology.orchestra.run.trial004.stdout:Waiting for the mgr to restart... 2026-02-24T09:06:59.121 INFO:teuthology.orchestra.run.trial004.stdout:Waiting for mgr epoch 9... 2026-02-24T09:06:59.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:59 trial004 ceph-mon[41596]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:06:59.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:59 trial004 ceph-mon[41596]: Saving service mgr spec with placement count:2 2026-02-24T09:06:59.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:59 trial004 ceph-mon[41596]: from='mgr.14118 10.20.193.4:0/1524857437' entity='mgr.x' 2026-02-24T09:06:59.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:59 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3441814072' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-24T09:06:59.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:59 trial004 ceph-mon[41596]: mgrmap e9: x(active, since 6s) 2026-02-24T09:06:59.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:06:59 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2316219901' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-24T09:07:00.215 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:59 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:07:00.215 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:59 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:07:00.216 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:06:59 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: from numpy import show_config as show_numpy_config 2026-02-24T09:07:01.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:01 trial004 ceph-mon[41596]: Active manager daemon x restarted 2026-02-24T09:07:01.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:01 trial004 ceph-mon[41596]: Activating manager daemon x 2026-02-24T09:07:01.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:01 trial004 ceph-mon[41596]: osdmap e3: 0 total, 0 up, 0 in 2026-02-24T09:07:01.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:01 trial004 ceph-mon[41596]: mgrmap e10: x(active, starting, since 0.00269298s) 2026-02-24T09:07:01.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:07:01.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T09:07:01.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T09:07:01.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T09:07:01.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T09:07:01.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:01 trial004 ceph-mon[41596]: Manager daemon x is now available 2026-02-24T09:07:02.724 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout { 2026-02-24T09:07:02.724 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-24T09:07:02.724 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T09:07:02.724 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout } 2026-02-24T09:07:02.724 INFO:teuthology.orchestra.run.trial004.stdout:mgr epoch 9 is available 2026-02-24T09:07:02.724 INFO:teuthology.orchestra.run.trial004.stdout:Using certmgr to generate dashboard self-signed certificate... 2026-02-24T09:07:02.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:02.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T09:07:02.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T09:07:02.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:02.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:02.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:02 trial004 ceph-mon[41596]: mgrmap e11: x(active, since 1.00444s) 2026-02-24T09:07:03.527 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFHjCCAwagAwIBAgIUHRkjBj5SktAQpYTD0BmHWWnSrLswDQYJKoZIhvcNAQEL\nBQAwPDE6MDgGA1UEAwwxY2VwaGFkbS1yb290LTE5ZTA5NDVkLTExNjAtMTFmMS05\nMmNmLWQ0MDRlNmU3ZDQ2MDAeFw0yNjAyMjQwOTA3MDNaFw0yOTAyMjMwOTA3MDNa\nMBYxFDASBgNVBAMMCzEwLjIwLjE5My40MIICIjANBgkqhkiG9w0BAQEFAAOCAg8A\nMIICCgKCAgEA1kkGTJHApp0HPJrNX3yJPEcILwciT3lwWfouFk4tRP1HKWZjDtt+\nfVRwpcMEc8ojs+GCockpbJ5hCizgfADI1LKWIjpAF4+1TlPrvHvNUfa3haWtGOsk\n/84ZiOPlAjSxsCHr54L+jElysfDpyjlwECQOnfkf3v4t066hx2W1YMNPWcRAhVv3\nA+JG5SzaQspYDye1ZNIx5QD50RjEoasW1aSyurvSnW1P9ehuGjlgcDeIMAsVr+99\nhNLODFdjdLCM+CPgykf/1s8X3+4+TkANazyMLzZyiE4cZcJYnnirgGrpOjCo1NVa\niI/AgP8wOd5i4VaICSHr8rbnZMKTM26K7GVIsKHa9YM5foDs2BFXvdD5bm1NTVvn\ncYHxsbL84OC8jCk9jqpdGy9f1mKmMYjZQqJ1uqrrOD6dScdnnZqGJq7ToDjk6gZr\nBYCrAIPqfINUSgcsWqmRg6oHM8vABjw4mOiMrQlzEuu7WBbCcgl53kKCN4ItM2W8\n9ah/OqIZzPae7rl8/GKuLYAQfB8ST/Z1Hmc8UmUyvPSDTqTrNuoJp9Ri2uD1afsV\nmVn8N671AHIzDxYpYq7X0tPXfYDEjpdZz54DdH1tZ8sid7Ek5vSAmBVa/oftlkAN\nVN/ffjuo31De0Yh6YLfKsezz9g7QYcio1wPa2qSOazVmGfNQNksOlh8CAwEAAaM+\nMDwwLAYDVR0RBCUwI4IIdHJpYWwwMDSCEWRhc2hib2FyZF9zZXJ2ZXJzhwQKFMEE\nMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBAOJeLf3q/meGY2S3LbWM\nwOcFeSXvXGhT/7DFFMZQpgCCKhftZa5z2pMhlfRDVPFNbsBsPq/N4vZlRMRXlqVm\nccoCvBqq0HB/ZqUFMj6qrjYhzWePGEbk1BCWHKtVkYwP9KTYLvHgKkqvSYYNrHfM\naJT+2kfBnKhGrpjnIHCVTu0neHOVBZUkIkWuS8d5Ekll2kM/Pb1k6upAFTHPp8Fk\nVfXZawbC7KoBD3p/Rpq2beYItrIe47CHLQgOAi0OIWvYPBt7DjF5IUQN5HZzuMN3\nkhyV2PtnndSfY/jyJYKjD3JqusjQIo99pdLSn5DYzsRMGG5Wq24KPUS3TbNZOVQ4\ngCjYz6FEp7RMQ0VLdBuFOp1w0OZT4fUCKOVhaWIyHPFOj7Cczn5hgoxL1yzpvjpw\nJLn3oazWqSHu+rHO8ouSycs/YNeDyzQB3wxuLe+jlqfud2NiP5KcHY0kqFeyFoJs\nBvyrrKl2tCbB/OMUPMJ9qWq2z7goYfgrmrqyTwMi374BqBvLyCWinCDELl0t6TXZ\nwtcxoWkdArBezFlutxYh++CAjTcr8QOEXJHwAfDN9Mobe3WG5OkVwWfkQBNMAYrY\nyLIDHU/IH7QhIWttjgw6OIS8go8x7QEZFuqr9o5D9qIU9nhGsgMyZNHLkthlR9nI\nWOBKYknZ6WwkO1wvUsLsn1ah\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEA1kkGTJHApp0HPJrNX3yJPEcILwciT3lwWfouFk4tRP1HKWZj\nDtt+fVRwpcMEc8ojs+GCockpbJ5hCizgfADI1LKWIjpAF4+1TlPrvHvNUfa3haWt\nGOsk/84ZiOPlAjSxsCHr54L+jElysfDpyjlwECQOnfkf3v4t066hx2W1YMNPWcRA\nhVv3A+JG5SzaQspYDye1ZNIx5QD50RjEoasW1aSyurvSnW1P9ehuGjlgcDeIMAsV\nr+99hNLODFdjdLCM+CPgykf/1s8X3+4+TkANazyMLzZyiE4cZcJYnnirgGrpOjCo\n1NVaiI/AgP8wOd5i4VaICSHr8rbnZMKTM26K7GVIsKHa9YM5foDs2BFXvdD5bm1N\nTVvncYHxsbL84OC8jCk9jqpdGy9f1mKmMYjZQqJ1uqrrOD6dScdnnZqGJq7ToDjk\n6gZrBYCrAIPqfINUSgcsWqmRg6oHM8vABjw4mOiMrQlzEuu7WBbCcgl53kKCN4It\nM2W89ah/OqIZzPae7rl8/GKuLYAQfB8ST/Z1Hmc8UmUyvPSDTqTrNuoJp9Ri2uD1\nafsVmVn8N671AHIzDxYpYq7X0tPXfYDEjpdZz54DdH1tZ8sid7Ek5vSAmBVa/oft\nlkANVN/ffjuo31De0Yh6YLfKsezz9g7QYcio1wPa2qSOazVmGfNQNksOlh8CAwEA\nAQKCAgAKyI36mHMbb1eH4zpmjbvSPrjYtQEzAqd2v7JGCRUaHazRFofxnXYWFIO+\ns7uroAZ/7N9ICPl+r9GuU2fQlbGFkp8fhdLn3KGBGZQJXimM8F936Eh3so2gGd0L\nGHzTyZcPiAV5Fwx8Ps34ymjZdl5/UXEy3fCOpjfkKSuW/zVLc0iw+cFNdL1PgrmS\nmtk49znLOXJVaoZ8QbpQnXB3ukZh5fHgl8cXiQK3G0U/KJgDzaea01P6EJE+d+VK\nlbM5khDmA9gyFcF4K9/FsxWLlomWVeuwDIti9JtVO5x+DRCEW9z0wrIcU8hEiwdi\n9nSU1O4g7NvXqc9X3YBzf58svWlcOHSIOMBP+jwGeCALMIegcr8h/gkxuFq0sB/d\nZUWdct7PWA9ug0qgiM9jcmP5aKyd+tveTk0902NbUcMfTv1xMgZEU9365P0uvsey\nl4XoZm9nIvranYjNilmy3Z4sI/B1/VK4gc58gZQno1Gvm8027bZomlrdNN9ih8kn\nZD0RsCfoVwG3biP88m5QWlbfd0gbCwOA1AhBiEsML/4SC3JYcwMPQIYa/Pxz6GUY\nxO5vx+NaXaNW+9qHuzeh4JESi/keji6h6MfXdS3q2NIvwUbRUZ9mBZqYhPJcfxm6\nmSwkh9hQEQuDNV0DDZvr2D7gpwHcvnJyw+1moDVi2dVpI5T5EQKCAQEA+lL1CsgI\n2zpHxnSzrUZJwFaRZpk5Jt2r//Z9yNUsEXwtBz4MTDgph5MK4bnsktfVw+ZsNqej\nWB27WWUgdFS9fYJ9x04+B254WUwOjeOXXHHoggWayZTQi1LnK3eY2/uhae2Xe+TJ\nJgAoQd3giHZdFFNPTKcJOSZiQc+POU8yNLRnqXcq+ONhMAT0UESrtnfsiYdlTjQp\nEYaIFI8ZZM4Ffqx9HBcVTi4tqrB2Q512sE/w3GVf7f5R+qHCa6hKgP1BXZkz9nEs\n+58Au+fCYQ8qI7FfHTHfAGclrc1D6T7pbGu6+ZpRAoJv4mFl45E9+2M8LVCiU+lG\nDlNIgeszQMHMcwKCAQEA2yTf+SXOzn9kW+KJ4IMEahcVwV8ts9c8XIYvUwXOiuxd\n+oFnw73f2I2XDDkhq3xUOdshkzFoc4ZVDqeWSk6VKyYaq8gi1sWddR1TNI1YAcu/\nkbob58tnRUOm4HlZL3HBfGSR3R6kbkbQPbxxaGvF4dqVjyRk4KCOzuFpeiSnFQD/\n7Y3HfRZ5OUgD9B9Q3v5pW2nMrfbZZOIJPSDPAO7zbELX0wuzSl3Nu/K1nlL7D7uC\nv3R6C2e9kbDpLMoN+xBxvZsltyF4XSViQMNit0KngYUDKXtvQAvp17NlaQWx5VDJ\nI/GVnfpylcCO6fzHwAk7zcDtdR1q42Kv+HAdMx7wpQKCAQEAp/Nu62vo3UYOEC4O\nu4w0QXMTnTXirZv/If58yHmWVqjtATX1RFJOMuNKYsa+3osnpod8RXNWWfGg2MrL\n6qFMfeBGiamKXqwU3Tz1auevj1vxtwMRpnxNK51U8soMalQ7KXo6r+qBtxhV6lN2\nqbhYnSGETBaqTojdVfBv1PC467m6723ADDtq4rAAR7a7SvLNZjzMkJrYjySnOrwE\nOqkr8KDEVEt8hPbgtuwsfRMyJfuMzCLMKT8AO9u6OUcxrbe92pHG1mt61dwJvwkx\nVrO4/zerbEggqgGKu0DEdsM6E/939K4/+iIP9WCJ3xR89KTRJEo8j3YtBcGFHX3z\n5lfg1wKCAQAByfhGGWfpyaJxGZVUjt0/XHbiADvoRu6INtQ2EksQWUOfIuVM9MTa\nCLXd9K1wr/AkFMTeZb3bi5IwL3ALpT6UfpgjJNwb8rsJVLb0K983DInAz8sghkmO\niDHZjUQMHhqdQFjsfC6Nc+iJSHuIhbC02kr0QzDLoKPpzm9E/v2aL0rnjou9Wqyc\nqhjWKldHqr4DcAaquOQnbazzocvuzwSPsq/+Wg8ZoVBno2CWLUk9ZKN5mqLQawVi\nJhaRNgkNLqIvERAqwYww/ngh3TZ2FoY1iXdwJEDRPgenqiA+zjwYiiNKNtOo2X2L\n+WlxQY4D5E9nq5aEqTvRJWIYXhnu6+a9AoIBAQCG0P4RO2j9kk3Tt18ezKNQVgiQ\nCYY7mSN+RXTmgIwuDaoWerc1QFCAsg/eitgGOqnAXCgVgxFomxmxqjWeAURT/kNq\nZ9BpXreGlDP9sGf9yDXX1s148KnLfH2ZjdB5fXdqMjaW4q6Vq9RFByBrS6krLnQB\n/5rt6uuVOUNEepjoAfHfQ19DUabEJSpQ6o+ItEazSUCnG/YG2soo+7NzzROeNNDf\nidwUuG1mlimAlsWh2XJ7ROeLn4C+7xZ4Ov89YJtnKPWawO939fiqIYuSwQ7Zpq9t\n4ngRBzJNPwrFM093Av1lIKlLeam++4HukFwD2M0mds4VTxE2oTKfQyPe/OHE\n-----END RSA PRIVATE KEY-----\n"} 2026-02-24T09:07:03.763 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:03 trial004 ceph-mon[41596]: [24/Feb/2026:09:07:02] ENGINE Bus STARTING 2026-02-24T09:07:03.763 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:03 trial004 ceph-mon[41596]: [24/Feb/2026:09:07:02] ENGINE Serving on https://10.20.193.4:7150 2026-02-24T09:07:03.763 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:03 trial004 ceph-mon[41596]: [24/Feb/2026:09:07:02] ENGINE Client ('10.20.193.4', 55430) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T09:07:03.763 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:03 trial004 ceph-mon[41596]: [24/Feb/2026:09:07:02] ENGINE Serving on http://10.20.193.4:8765 2026-02-24T09:07:03.763 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:03 trial004 ceph-mon[41596]: [24/Feb/2026:09:07:02] ENGINE Bus STARTED 2026-02-24T09:07:03.763 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:03 trial004 ceph-mon[41596]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T09:07:03.764 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:03 trial004 ceph-mon[41596]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T09:07:03.767 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout SSL certificate updated 2026-02-24T09:07:04.007 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2026-02-24T09:07:04.007 INFO:teuthology.orchestra.run.trial004.stdout:Creating initial admin user... 2026-02-24T09:07:04.442 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Yl8Gk1qdikM/paCf7HHBs.yRpZUuz.k1y0OtuwQ1OwrZTBTC6wbHu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771924024, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-24T09:07:04.442 INFO:teuthology.orchestra.run.trial004.stdout:Fetching dashboard port number... 2026-02-24T09:07:04.668 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stdout 8443 2026-02-24T09:07:04.676 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T09:07:04.676 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout disabled 2026-02-24T09:07:04.682 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T09:07:04.682 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout inactive 2026-02-24T09:07:04.682 INFO:teuthology.orchestra.run.trial004.stdout:firewalld.service is not enabled 2026-02-24T09:07:04.682 INFO:teuthology.orchestra.run.trial004.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-24T09:07:04.683 INFO:teuthology.orchestra.run.trial004.stdout:Ceph Dashboard is now available at: 2026-02-24T09:07:04.683 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:04.683 INFO:teuthology.orchestra.run.trial004.stdout: URL: https://trial004:8443/ 2026-02-24T09:07:04.683 INFO:teuthology.orchestra.run.trial004.stdout: User: admin 2026-02-24T09:07:04.683 INFO:teuthology.orchestra.run.trial004.stdout: Password: m8gpv2j0a3 2026-02-24T09:07:04.684 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:04.684 INFO:teuthology.orchestra.run.trial004.stdout:Saving cluster configuration to /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config directory 2026-02-24T09:07:04.947 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:04 trial004 ceph-mon[41596]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:04.947 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:04 trial004 ceph-mon[41596]: mgrmap e12: x(active, since 2s) 2026-02-24T09:07:04.947 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:04 trial004 ceph-mon[41596]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:04.947 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:04.947 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:04.947 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:04.947 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:04 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3101596069' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-24T09:07:04.969 INFO:teuthology.orchestra.run.trial004.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-24T09:07:04.969 INFO:teuthology.orchestra.run.trial004.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-24T09:07:04.969 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:04.969 INFO:teuthology.orchestra.run.trial004.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:07:04.969 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:04.969 INFO:teuthology.orchestra.run.trial004.stdout:Or, if you are only running a single cluster on this host: 2026-02-24T09:07:04.969 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:04.969 INFO:teuthology.orchestra.run.trial004.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-24T09:07:04.970 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:04.970 INFO:teuthology.orchestra.run.trial004.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-24T09:07:04.970 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:04.970 INFO:teuthology.orchestra.run.trial004.stdout: ceph telemetry on 2026-02-24T09:07:04.970 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:04.970 INFO:teuthology.orchestra.run.trial004.stdout:For more information see: 2026-02-24T09:07:04.970 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:04.970 INFO:teuthology.orchestra.run.trial004.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-24T09:07:04.970 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:04.970 INFO:teuthology.orchestra.run.trial004.stdout:Bootstrap complete. 2026-02-24T09:07:04.976 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout static 2026-02-24T09:07:04.982 INFO:teuthology.orchestra.run.trial004.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-24T09:07:04.982 INFO:teuthology.orchestra.run.trial004.stdout:systemctl: stdout inactive 2026-02-24T09:07:04.982 INFO:teuthology.orchestra.run.trial004.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-24T09:07:05.122 INFO:tasks.cephadm:Fetching config... 2026-02-24T09:07:05.123 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:07:05.123 DEBUG:teuthology.orchestra.run.trial004:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-24T09:07:05.140 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-24T09:07:05.140 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:07:05.140 DEBUG:teuthology.orchestra.run.trial004:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-24T09:07:05.198 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-24T09:07:05.198 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:07:05.199 DEBUG:teuthology.orchestra.run.trial004:> sudo dd if=/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-24T09:07:05.266 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-24T09:07:05.266 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:07:05.266 DEBUG:teuthology.orchestra.run.trial004:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-24T09:07:05.323 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-24T09:07:05.323 DEBUG:teuthology.orchestra.run.trial004:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIERCXigqIty2F+rwYKFbBbgrPKRxq9kN3+5ue5HiOxZz ceph-19e0945d-1160-11f1-92cf-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T09:07:05.398 INFO:teuthology.orchestra.run.trial004.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIERCXigqIty2F+rwYKFbBbgrPKRxq9kN3+5ue5HiOxZz ceph-19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:05.409 DEBUG:teuthology.orchestra.run.trial014:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIERCXigqIty2F+rwYKFbBbgrPKRxq9kN3+5ue5HiOxZz ceph-19e0945d-1160-11f1-92cf-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T09:07:05.449 INFO:teuthology.orchestra.run.trial014.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIERCXigqIty2F+rwYKFbBbgrPKRxq9kN3+5ue5HiOxZz ceph-19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:05.459 DEBUG:teuthology.orchestra.run.trial090:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIERCXigqIty2F+rwYKFbBbgrPKRxq9kN3+5ue5HiOxZz ceph-19e0945d-1160-11f1-92cf-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T09:07:05.495 INFO:teuthology.orchestra.run.trial090.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIERCXigqIty2F+rwYKFbBbgrPKRxq9kN3+5ue5HiOxZz ceph-19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:05.505 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-24T09:07:05.620 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:05.843 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:05 trial004 ceph-mon[41596]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:05.843 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:05 trial004 ceph-mon[41596]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:05.843 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:05 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1237173860' entity='client.admin' 2026-02-24T09:07:05.872 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-24T09:07:05.872 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-24T09:07:05.991 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:06.261 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial014 2026-02-24T09:07:06.261 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:07:06.262 DEBUG:teuthology.orchestra.run.trial014:> dd of=/etc/ceph/ceph.conf 2026-02-24T09:07:06.280 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:07:06.280 DEBUG:teuthology.orchestra.run.trial014:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:07:06.337 INFO:tasks.cephadm:Adding host trial014 to orchestrator... 2026-02-24T09:07:06.337 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch host add trial014 2026-02-24T09:07:06.457 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:06 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3593291964' entity='client.admin' 2026-02-24T09:07:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:08.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:08.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial014", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial004", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:08.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:08.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:08.365 INFO:teuthology.orchestra.run.trial004.stdout:Added host 'trial014' with addr '10.20.193.14' 2026-02-24T09:07:08.408 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-24T09:07:08.526 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:08.746 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:08.746 INFO:teuthology.orchestra.run.trial004.stdout:[{"addr": "10.20.193.4", "hostname": "trial004", "labels": [], "status": ""}, {"addr": "10.20.193.14", "hostname": "trial014", "labels": [], "status": ""}] 2026-02-24T09:07:08.782 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial090 2026-02-24T09:07:08.782 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:07:08.782 DEBUG:teuthology.orchestra.run.trial090:> dd of=/etc/ceph/ceph.conf 2026-02-24T09:07:08.799 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:07:08.800 DEBUG:teuthology.orchestra.run.trial090:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:07:08.855 INFO:tasks.cephadm:Adding host trial090 to orchestrator... 2026-02-24T09:07:08.855 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch host add trial090 2026-02-24T09:07:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: Updating trial004:/etc/ceph/ceph.conf 2026-02-24T09:07:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: Updating trial004:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: Deploying cephadm binary to trial014 2026-02-24T09:07:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: Updating trial004:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:07:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: Updating trial004:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:07:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: Certificate for "cephadm-signed_agent_cert (trial004)" is still valid for 1824 days. 2026-02-24T09:07:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: mgrmap e13: x(active, since 6s) 2026-02-24T09:07:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:08.970 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:10.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:09 trial004 ceph-mon[41596]: Added host trial014 2026-02-24T09:07:10.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:09 trial004 ceph-mon[41596]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:07:10.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:09 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:10.817 INFO:teuthology.orchestra.run.trial004.stdout:Added host 'trial090' with addr '10.20.193.90' 2026-02-24T09:07:10.876 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-24T09:07:10.995 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:11.109 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:10 trial004 ceph-mon[41596]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial090", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:11.109 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:10 trial004 ceph-mon[41596]: Deploying cephadm binary to trial090 2026-02-24T09:07:11.110 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:11.110 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:11.110 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:11.110 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:11.110 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial014", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:11.110 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:11.110 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:11.110 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:11.224 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:11.224 INFO:teuthology.orchestra.run.trial004.stdout:[{"addr": "10.20.193.4", "hostname": "trial004", "labels": [], "status": ""}, {"addr": "10.20.193.14", "hostname": "trial014", "labels": [], "status": ""}, {"addr": "10.20.193.90", "hostname": "trial090", "labels": [], "status": ""}] 2026-02-24T09:07:11.264 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-24T09:07:11.265 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd crush tunables default 2026-02-24T09:07:11.381 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:12.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:11 trial004 ceph-mon[41596]: Updating trial014:/etc/ceph/ceph.conf 2026-02-24T09:07:12.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:11 trial004 ceph-mon[41596]: Updating trial014:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:12.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:11 trial004 ceph-mon[41596]: Added host trial090 2026-02-24T09:07:12.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:11 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:12.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:11 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:12.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:11 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:12.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:11 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:12.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:11 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:12.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:11 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:12.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:11 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/49342304' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-24T09:07:12.504 INFO:teuthology.orchestra.run.trial004.stderr:adjusted tunables profile to default 2026-02-24T09:07:12.562 INFO:tasks.cephadm:Adding mon.a on trial004 2026-02-24T09:07:12.562 INFO:tasks.cephadm:Adding mon.b on trial014 2026-02-24T09:07:12.562 INFO:tasks.cephadm:Adding mon.c on trial090 2026-02-24T09:07:12.563 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch apply mon '3;trial004:10.20.193.4=a;trial014:10.20.193.14=b;trial090:10.20.193.90=c' 2026-02-24T09:07:12.743 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T09:07:12.744 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T09:07:13.087 INFO:teuthology.orchestra.run.trial090.stdout:Scheduled mon update... 2026-02-24T09:07:13.124 DEBUG:teuthology.orchestra.run.trial014:mon.b> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.b.service 2026-02-24T09:07:13.127 DEBUG:teuthology.orchestra.run.trial090:mon.c> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.c.service 2026-02-24T09:07:13.130 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-24T09:07:13.130 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T09:07:13.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:12 trial004 ceph-mon[41596]: Updating trial014:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:07:13.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:12 trial004 ceph-mon[41596]: Updating trial014:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:07:13.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:12 trial004 ceph-mon[41596]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:07:13.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:13.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:12 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/49342304' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-24T09:07:13.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:12 trial004 ceph-mon[41596]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:07:13.287 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T09:07:13.288 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T09:07:13.542 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:07:13.543 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","modified":"2026-02-24T09:06:41.121420Z","created":"2026-02-24T09:06:41.121420Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:3300","nonce":0},{"type":"v1","addr":"10.20.193.4:6789","nonce":0}]},"addr":"10.20.193.4:6789/0","public_addr":"10.20.193.4:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:06:41:121432+0000","crush_location":[]}],"quorum":[0]} 2026-02-24T09:07:13.543 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-24T09:07:14.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial004:10.20.193.4=a;trial014:10.20.193.14=b;trial090:10.20.193.90=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:14.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: Saving service mon spec with placement trial004:10.20.193.4=a;trial014:10.20.193.14=b;trial090:10.20.193.90=c;count:3 2026-02-24T09:07:14.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:14.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/2698178394' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:07:14.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:14.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:14.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:14.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:14.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial090", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:14.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:14.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:14.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: Updating trial090:/etc/ceph/ceph.conf 2026-02-24T09:07:14.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:14 trial004 ceph-mon[41596]: Updating trial090:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:14.583 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-24T09:07:14.584 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T09:07:14.766 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:07:15.143 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:07:15.143 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","modified":"2026-02-24T09:06:41.121420Z","created":"2026-02-24T09:06:41.121420Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:3300","nonce":0},{"type":"v1","addr":"10.20.193.4:6789","nonce":0}]},"addr":"10.20.193.4:6789/0","public_addr":"10.20.193.4:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:06:41:121432+0000","crush_location":[]}],"quorum":[0]} 2026-02-24T09:07:15.144 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 1 2026-02-24T09:07:15.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:15 trial004 ceph-mon[41596]: Updating trial090:/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:07:15.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:15 trial004 ceph-mon[41596]: Updating trial090:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T09:07:15.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:15.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:15.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:15.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:07:15.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:15.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:15 trial004 ceph-mon[41596]: Deploying daemon mon.c on trial090 2026-02-24T09:07:15.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:15 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/2606801018' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:07:15.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:15 trial090 ceph-mon[47278]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-24T09:07:16.212 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-24T09:07:16.212 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T09:07:16.334 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:07:16.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:16 trial014 ceph-mon[46941]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-24T09:07:20.865 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: Deploying daemon mon.b on trial014 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: mon.a calling monitor election 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: mon.c calling monitor election 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: monmap epoch 2 2026-02-24T09:07:20.866 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: last_changed 2026-02-24T09:07:15.552416+0000 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: created 2026-02-24T09:06:41.121420+0000 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: min_mon_release 20 (tentacle) 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: election_strategy: 1 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: 0: [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] mon.a 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: 1: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.c 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: fsmap 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: mgrmap e13: x(active, since 18s) 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: overall HEALTH_OK 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:20.867 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:20.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: Deploying daemon mon.b on trial014 2026-02-24T09:07:20.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:07:20.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: mon.a calling monitor election 2026-02-24T09:07:20.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: mon.c calling monitor election 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: monmap epoch 2 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:20.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: last_changed 2026-02-24T09:07:15.552416+0000 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: created 2026-02-24T09:06:41.121420+0000 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: min_mon_release 20 (tentacle) 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: election_strategy: 1 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: 0: [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] mon.a 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: 1: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.c 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: fsmap 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: mgrmap e13: x(active, since 18s) 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: overall HEALTH_OK 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:20.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:21.965 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:07:21 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: 2026-02-24T09:07:21.553+0000 7f8467926640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-24T09:07:26.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:07:26.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: mon.a calling monitor election 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: mon.c calling monitor election 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: mon.b calling monitor election 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: monmap epoch 3 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: last_changed 2026-02-24T09:07:20.754127+0000 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: created 2026-02-24T09:06:41.121420+0000 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: min_mon_release 20 (tentacle) 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: election_strategy: 1 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: 0: [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] mon.a 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: 1: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.c 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: 2: [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] mon.b 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: fsmap 2026-02-24T09:07:26.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:07:26.086 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: mgrmap e13: x(active, since 24s) 2026-02-24T09:07:26.086 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: overall HEALTH_OK 2026-02-24T09:07:26.086 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.086 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.086 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.086 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.086 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.086 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:26.086 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:26.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: Deploying daemon mon.b on trial014 2026-02-24T09:07:26.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:07:26.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:26.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: mon.a calling monitor election 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: mon.c calling monitor election 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-24T09:07:26.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: monmap epoch 2 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: last_changed 2026-02-24T09:07:15.552416+0000 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: created 2026-02-24T09:06:41.121420+0000 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: min_mon_release 20 (tentacle) 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: election_strategy: 1 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: 0: [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] mon.a 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: 1: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.c 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: fsmap 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: mgrmap e13: x(active, since 18s) 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: overall HEALTH_OK 2026-02-24T09:07:26.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: mon.a calling monitor election 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: mon.c calling monitor election 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.096 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: mon.b calling monitor election 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: monmap epoch 3 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: last_changed 2026-02-24T09:07:20.754127+0000 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: created 2026-02-24T09:06:41.121420+0000 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: min_mon_release 20 (tentacle) 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: election_strategy: 1 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: 0: [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] mon.a 2026-02-24T09:07:26.097 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: 1: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.c 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: 2: [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] mon.b 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: fsmap 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: mgrmap e13: x(active, since 24s) 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: overall HEALTH_OK 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:26.098 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:26.193 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:07:26.193 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":3,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","modified":"2026-02-24T09:07:20.754127Z","created":"2026-02-24T09:06:41.121420Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:3300","nonce":0},{"type":"v1","addr":"10.20.193.4:6789","nonce":0}]},"addr":"10.20.193.4:6789/0","public_addr":"10.20.193.4:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:06:41:121432+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:3300","nonce":0},{"type":"v1","addr":"10.20.193.90:6789","nonce":0}]},"addr":"10.20.193.90:6789/0","public_addr":"10.20.193.90:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:07:15:552415+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:3300","nonce":0},{"type":"v1","addr":"10.20.193.14:6789","nonce":0}]},"addr":"10.20.193.14:6789/0","public_addr":"10.20.193.14:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T09:07:20:754125+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-24T09:07:26.193 INFO:teuthology.orchestra.run.trial090.stderr:dumped monmap epoch 3 2026-02-24T09:07:26.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:07:26.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:07:26.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: mon.a calling monitor election 2026-02-24T09:07:26.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: mon.c calling monitor election 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: mon.b calling monitor election 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: monmap epoch 3 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:26.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: last_changed 2026-02-24T09:07:20.754127+0000 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: created 2026-02-24T09:06:41.121420+0000 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: min_mon_release 20 (tentacle) 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: election_strategy: 1 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: 0: [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] mon.a 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: 1: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.c 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: 2: [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] mon.b 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: fsmap 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: mgrmap e13: x(active, since 24s) 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: overall HEALTH_OK 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:26.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:26.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:26.229 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-24T09:07:26.229 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-24T09:07:26.350 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:26.559 INFO:teuthology.orchestra.run.trial004.stdout:# minimal ceph.conf for 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:26.560 INFO:teuthology.orchestra.run.trial004.stdout:[global] 2026-02-24T09:07:26.560 INFO:teuthology.orchestra.run.trial004.stdout: fsid = 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:07:26.560 INFO:teuthology.orchestra.run.trial004.stdout: mon_host = [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] 2026-02-24T09:07:26.598 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-24T09:07:26.598 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:07:26.598 DEBUG:teuthology.orchestra.run.trial004:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T09:07:26.625 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:07:26.626 DEBUG:teuthology.orchestra.run.trial004:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:07:26.689 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:07:26.689 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T09:07:26.718 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:07:26.718 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:07:26.782 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:07:26.783 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T09:07:26.809 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:07:26.810 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T09:07:26.875 INFO:tasks.cephadm:Adding mgr.x on trial004 2026-02-24T09:07:26.875 INFO:tasks.cephadm:Adding mgr.y on trial014 2026-02-24T09:07:26.875 INFO:tasks.cephadm:Adding mgr.z on trial090 2026-02-24T09:07:26.875 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch apply mgr '3;trial004=x;trial014=y;trial090=z' 2026-02-24T09:07:27.030 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:07:27.051 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:27.051 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: Updating trial004:/etc/ceph/ceph.conf 2026-02-24T09:07:27.051 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: Updating trial014:/etc/ceph/ceph.conf 2026-02-24T09:07:27.051 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: Updating trial090:/etc/ceph/ceph.conf 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='client.? 10.20.193.90:0/2327055078' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:07:27.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/693832088' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.053 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:27.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:27.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: Updating trial004:/etc/ceph/ceph.conf 2026-02-24T09:07:27.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: Updating trial014:/etc/ceph/ceph.conf 2026-02-24T09:07:27.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: Updating trial090:/etc/ceph/ceph.conf 2026-02-24T09:07:27.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='client.? 10.20.193.90:0/2327055078' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:07:27.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:07:27.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/693832088' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:07:27.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:07:27.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: Updating trial004:/etc/ceph/ceph.conf 2026-02-24T09:07:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: Updating trial014:/etc/ceph/ceph.conf 2026-02-24T09:07:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: Updating trial090:/etc/ceph/ceph.conf 2026-02-24T09:07:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/2327055078' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:07:27.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:07:27.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/693832088' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:27.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T09:07:27.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T09:07:27.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:27.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:07:27.252 INFO:teuthology.orchestra.run.trial090.stdout:Scheduled mgr update... 2026-02-24T09:07:27.289 DEBUG:teuthology.orchestra.run.trial014:mgr.y> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.y.service 2026-02-24T09:07:27.293 DEBUG:teuthology.orchestra.run.trial090:mgr.z> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.z.service 2026-02-24T09:07:27.295 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-24T09:07:27.296 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-24T09:07:27.300 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-24T09:07:27.300 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-24T09:07:27.353 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-24T09:07:27.353 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-24T09:07:27.413 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-24T09:07:27.413 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-24T09:07:27.415 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.467 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.468 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-24T09:07:27.468 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-24T09:07:27.512 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-24T09:07:27.512 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-24T09:07:27.531 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.532 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-24T09:07:27.532 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-24T09:07:27.575 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-24T09:07:27.575 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-24T09:07:27.588 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.589 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-24T09:07:27.589 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-24T09:07:27.633 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-24T09:07:27.633 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-24T09:07:27.634 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.655 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.656 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-24T09:07:27.656 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-24T09:07:27.699 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-24T09:07:27.699 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-24T09:07:27.724 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.726 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-24T09:07:27.726 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-24T09:07:27.736 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.738 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-24T09:07:27.738 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-24T09:07:27.745 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-24T09:07:27.745 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-24T09:07:27.767 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.769 INFO:tasks.cephadm:setting config [mds] mds_use_global_snaprealm_seq_for_subvol = False 2026-02-24T09:07:27.769 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds mds_use_global_snaprealm_seq_for_subvol False 2026-02-24T09:07:27.778 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-24T09:07:27.779 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-24T09:07:27.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.777+0000 7fdd2b71c640 1 -- 10.20.193.4:0/199995864 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdd0003f9d0 msgr2=0x7fdd0005fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.777+0000 7fdd2b71c640 1 --2- 10.20.193.4:0/199995864 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdd0003f9d0 0x7fdd0005fe80 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd18005970 tx=0x7fdd18005900 comp rx=0 tx=0).stop 2026-02-24T09:07:27.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.777+0000 7fdd2b71c640 1 -- 10.20.193.4:0/199995864 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd24060920 msgr2=0x7fdd2416f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.777+0000 7fdd2b71c640 1 --2- 10.20.193.4:0/199995864 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd24060920 0x7fdd2416f160 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd1400d950 tx=0x7fdd1400de20 comp rx=0 tx=0).stop 2026-02-24T09:07:27.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.777+0000 7fdd2b71c640 1 -- 10.20.193.4:0/199995864 shutdown_connections 2026-02-24T09:07:27.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.778+0000 7fdd2b71c640 1 --2- 10.20.193.4:0/199995864 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdd0003f9d0 0x7fdd0005fe80 unknown :-1 s=CLOSED pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.778+0000 7fdd2b71c640 1 --2- 10.20.193.4:0/199995864 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd2414ed80 0x7fdd2411c400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.778+0000 7fdd2b71c640 1 --2- 10.20.193.4:0/199995864 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd2412e220 0x7fdd24109aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.778+0000 7fdd2b71c640 1 --2- 10.20.193.4:0/199995864 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd24060920 0x7fdd2416f160 unknown :-1 s=CLOSED pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.778+0000 7fdd2b71c640 1 -- 10.20.193.4:0/199995864 >> 10.20.193.4:0/199995864 conn(0x7fdd240e96c0 msgr2=0x7fdd2410ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:27.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.778+0000 7fdd2b71c640 1 -- 10.20.193.4:0/199995864 shutdown_connections 2026-02-24T09:07:27.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.779+0000 7fdd2b71c640 1 -- 10.20.193.4:0/199995864 wait complete. 2026-02-24T09:07:27.785 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-24T09:07:27.785 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-24T09:07:27.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2388170783 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f55e410eb30 msgr2=0x7f55e416f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f55eb6fd640 1 --2- 10.20.193.4:0/2388170783 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f55e410eb30 0x7f55e416f4c0 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=8584387720204056339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55e0010c10 tx=0x7f55e0034510 comp rx=0 tx=0).stop 2026-02-24T09:07:27.794 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-24T09:07:27.794 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-24T09:07:27.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f3a57cd0640 1 -- 10.20.193.4:0/2328964687 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5010e610 msgr2=0x7f3a5010ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f3a57cd0640 1 --2- 10.20.193.4:0/2328964687 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5010e610 0x7f3a5010ea00 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=7174682172707813272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a40009980 tx=0x7f3a4002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f3a57cd0640 1 -- 10.20.193.4:0/2328964687 shutdown_connections 2026-02-24T09:07:27.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f3a57cd0640 1 --2- 10.20.193.4:0/2328964687 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5010d850 0x7f3a5016f5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f3a57cd0640 1 --2- 10.20.193.4:0/2328964687 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5010cea0 0x7f3a5010d310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f3a57cd0640 1 --2- 10.20.193.4:0/2328964687 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5010e610 0x7f3a5010ea00 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=7174682172707813272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f3a57cd0640 1 -- 10.20.193.4:0/2328964687 >> 10.20.193.4:0/2328964687 conn(0x7f3a500ea860 msgr2=0x7f3a5010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f3a57cd0640 1 -- 10.20.193.4:0/2328964687 shutdown_connections 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.788+0000 7f3a57cd0640 1 -- 10.20.193.4:0/2328964687 wait complete. 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a57cd0640 1 Processor -- start 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a57cd0640 1 -- start start 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a57cd0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5010cea0 0x7f3a50062720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a57cd0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5010d850 0x7f3a5016f5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a57cd0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5010e610 0x7f3a50061030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a55244640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5010d850 0x7f3a5016f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a57cd0640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f3a50061680 con 0x7f3a5010d850 2026-02-24T09:07:27.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a57cd0640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3a500617f0 con 0x7f3a5010cea0 2026-02-24T09:07:27.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a57cd0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a500619b0 con 0x7f3a5010e610 2026-02-24T09:07:27.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a55244640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5010d850 0x7f3a5016f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56274/0 (socket says 10.20.193.4:56274) 2026-02-24T09:07:27.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f3a55244640 1 -- 10.20.193.4:0/2411656796 learned_addr learned my addr 10.20.193.4:0/2411656796 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:27.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2388170783 shutdown_connections 2026-02-24T09:07:27.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f55eb6fd640 1 --2- 10.20.193.4:0/2388170783 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f55e410eb30 0x7f55e416f4c0 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=8584387720204056339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f55eb6fd640 1 --2- 10.20.193.4:0/2388170783 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f55e410e180 0x7f55e410e5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f55eb6fd640 1 --2- 10.20.193.4:0/2388170783 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f55e410cff0 0x7f55e410d3e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2388170783 >> 10.20.193.4:0/2388170783 conn(0x7f55e40ea760 msgr2=0x7f55e410ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:27.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.789+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2388170783 shutdown_connections 2026-02-24T09:07:27.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2388170783 wait complete. 2026-02-24T09:07:27.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f3a55244640 1 -- 10.20.193.4:0/2411656796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5010e610 msgr2=0x7f3a50061030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f3a55a45640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5010cea0 0x7f3a50062720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f3a56246640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5010e610 0x7f3a50061030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55eb6fd640 1 Processor -- start 2026-02-24T09:07:27.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55eb6fd640 1 -- start start 2026-02-24T09:07:27.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55eb6fd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f55e410cff0 0x7f55e40f68a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55eb6fd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f55e410e180 0x7f55e416f4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55eb6fd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f55e410eb30 0x7f55e40f7100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55eb6fd640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40f7cf0 con 0x7f55e410eb30 2026-02-24T09:07:27.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55eb6fd640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40f7e60 con 0x7f55e410cff0 2026-02-24T09:07:27.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55eb6fd640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40f8020 con 0x7f55e410e180 2026-02-24T09:07:27.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55e8c71640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f55e410e180 0x7f55e416f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55e8c71640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f55e410e180 0x7f55e416f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:45786/0 (socket says 10.20.193.4:45786) 2026-02-24T09:07:27.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55e8c71640 1 -- 10.20.193.4:0/2935621479 learned_addr learned my addr 10.20.193.4:0/2935621479 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:27.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.790+0000 7f55e9c73640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f55e410eb30 0x7f55e40f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55e9c73640 1 -- 10.20.193.4:0/2935621479 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f55e410e180 msgr2=0x7f55e416f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55e9c73640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f55e410e180 0x7f55e416f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55e9c73640 1 -- 10.20.193.4:0/2935621479 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f55e410cff0 msgr2=0x7f55e40f68a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:27.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55e9c73640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f55e410cff0 0x7f55e40f68a0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55e9c73640 1 -- 10.20.193.4:0/2935621479 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e0010830 con 0x7f55e410eb30 2026-02-24T09:07:27.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55e9c73640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f55e410eb30 0x7f55e40f7100 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55e0010c10 tx=0x7f55e0003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55d27fc640 1 -- 10.20.193.4:0/2935621479 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55e00055c0 con 0x7f55e410eb30 2026-02-24T09:07:27.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55d27fc640 1 -- 10.20.193.4:0/2935621479 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(26 keys) ==== 1088+0+0 (secure 0 0 0) 0x7f55e00104f0 con 0x7f55e410eb30 2026-02-24T09:07:27.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2935621479 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e40f82a0 con 0x7f55e410eb30 2026-02-24T09:07:27.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2935621479 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e40f86c0 con 0x7f55e410eb30 2026-02-24T09:07:27.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.791+0000 7f55d27fc640 1 -- 10.20.193.4:0/2935621479 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55e003d440 con 0x7f55e410eb30 2026-02-24T09:07:27.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.792+0000 7f3a55244640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5010e610 0x7f3a50061030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.792+0000 7f3a55244640 1 -- 10.20.193.4:0/2411656796 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5010cea0 msgr2=0x7f3a50062720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.792+0000 7f3a55244640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5010cea0 0x7f3a50062720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.792+0000 7f3a55244640 1 -- 10.20.193.4:0/2411656796 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a40009570 con 0x7f3a5010d850 2026-02-24T09:07:27.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.792+0000 7f3a55a45640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5010cea0 0x7f3a50062720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:07:27.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.792+0000 7f3a56246640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5010e610 0x7f3a50061030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:07:27.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.792+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2935621479 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e41710a0 con 0x7f55e410eb30 2026-02-24T09:07:27.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.792+0000 7f3a55244640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5010d850 0x7f3a5016f5e0 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a4400b500 tx=0x7f3a4400b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.792+0000 7f3a3effd640 1 -- 10.20.193.4:0/2411656796 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a440044a0 con 0x7f3a5010d850 2026-02-24T09:07:27.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.793+0000 7f3a3effd640 1 -- 10.20.193.4:0/2411656796 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(26 keys) ==== 1088+0+0 (secure 0 0 0) 0x7f3a44002b40 con 0x7f3a5010d850 2026-02-24T09:07:27.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.793+0000 7f3a3effd640 1 -- 10.20.193.4:0/2411656796 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a4400fc00 con 0x7f3a5010d850 2026-02-24T09:07:27.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.793+0000 7f3a57cd0640 1 -- 10.20.193.4:0/2411656796 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a50061c90 con 0x7f3a5010d850 2026-02-24T09:07:27.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.793+0000 7f3a57cd0640 1 -- 10.20.193.4:0/2411656796 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a50104050 con 0x7f3a5010d850 2026-02-24T09:07:27.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.793+0000 7f55d27fc640 1 -- 10.20.193.4:0/2935621479 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f55e000f760 con 0x7f55e410eb30 2026-02-24T09:07:27.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.793+0000 7f55d27fc640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f55c003fa20 0x7f55c005fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.793+0000 7f55d27fc640 1 -- 10.20.193.4:0/2935621479 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f55e007e220 con 0x7f55e410eb30 2026-02-24T09:07:27.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.793+0000 7f3a57cd0640 1 -- 10.20.193.4:0/2411656796 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a50061eb0 con 0x7f3a5010d850 2026-02-24T09:07:27.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.795+0000 7f55e9472640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f55c003fa20 0x7f55c005fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.795+0000 7f55e9472640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f55c003fa20 0x7f55c005fed0 secure :-1 s=READY pgs=49 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55d4004760 tx=0x7f55d4006c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.795+0000 7f55d27fc640 1 -- 10.20.193.4:0/2935621479 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f55e003aa50 con 0x7f55e410eb30 2026-02-24T09:07:27.808 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-24T09:07:27.808 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-24T09:07:27.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.796+0000 7f3a3effd640 1 -- 10.20.193.4:0/2411656796 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f3a44002cb0 con 0x7f3a5010d850 2026-02-24T09:07:27.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.797+0000 7f3a3effd640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a2803f9d0 0x7f3a2805fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.797+0000 7f3a55a45640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a2803f9d0 0x7f3a2805fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.797+0000 7f3a3effd640 1 -- 10.20.193.4:0/2411656796 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f3a44054190 con 0x7f3a5010d850 2026-02-24T09:07:27.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.797+0000 7f3a55a45640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a2803f9d0 0x7f3a2805fe80 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a400023d0 tx=0x7f3a40031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.798+0000 7f3a3effd640 1 -- 10.20.193.4:0/2411656796 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3a4400e590 con 0x7f3a5010d850 2026-02-24T09:07:27.811 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.846 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-24T09:07:27.847 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-24T09:07:27.856 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.859 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-24T09:07:27.860 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-24T09:07:27.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.853+0000 7f34b0f01640 1 -- 10.20.193.4:0/1002409269 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f34ac05f470 con 0x7f34ac1103f0 2026-02-24T09:07:27.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.858+0000 7f34937fe640 1 -- 10.20.193.4:0/1002409269 <== mon.0 v2:10.20.193.4:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f349400e350 con 0x7f34ac1103f0 2026-02-24T09:07:27.864 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-24T09:07:27.864 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-24T09:07:27.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.858+0000 7f34937fe640 1 -- 10.20.193.4:0/1002409269 <== mon.0 v2:10.20.193.4:3300/0 9 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f349401d120 con 0x7f34ac1103f0 2026-02-24T09:07:27.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.858+0000 7f3a3effd640 1 -- 10.20.193.4:0/2411656796 <== mon.0 v2:10.20.193.4:3300/0 7 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f3a4400e590 con 0x7f3a5010d850 2026-02-24T09:07:27.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.858+0000 7f55d27fc640 1 -- 10.20.193.4:0/2935621479 <== mon.0 v2:10.20.193.4:3300/0 7 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f55e007daa0 con 0x7f55e410eb30 2026-02-24T09:07:27.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.859+0000 7f42d2693640 1 -- 10.20.193.4:0/3525978052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f42cc10d110 msgr2=0x7f42cc10d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.859+0000 7f42d2693640 1 --2- 10.20.193.4:0/3525978052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f42cc10d110 0x7f42cc10d500 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=6050408847598969539 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42b8009950 tx=0x7f42b802f190 comp rx=0 tx=0).stop 2026-02-24T09:07:27.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.860+0000 7f42d2693640 1 -- 10.20.193.4:0/3525978052 shutdown_connections 2026-02-24T09:07:27.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.860+0000 7f42d2693640 1 --2- 10.20.193.4:0/3525978052 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f42cc10ec50 0x7f42cc16f5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.860+0000 7f42d2693640 1 --2- 10.20.193.4:0/3525978052 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f42cc10e2a0 0x7f42cc10e710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.860+0000 7f42d2693640 1 --2- 10.20.193.4:0/3525978052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f42cc10d110 0x7f42cc10d500 unknown :-1 s=CLOSED pgs=8 gs=1 cs=0 l=1 c_cookie=6050408847598969539 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.860+0000 7f42d2693640 1 -- 10.20.193.4:0/3525978052 >> 10.20.193.4:0/3525978052 conn(0x7f42cc0ea840 msgr2=0x7f42cc10ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:27.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.860+0000 7f42d2693640 1 -- 10.20.193.4:0/3525978052 shutdown_connections 2026-02-24T09:07:27.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.860+0000 7f42d2693640 1 -- 10.20.193.4:0/3525978052 wait complete. 2026-02-24T09:07:27.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42d2693640 1 Processor -- start 2026-02-24T09:07:27.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42d2693640 1 -- start start 2026-02-24T09:07:27.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42d2693640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f42cc10d110 0x7f42cc17d000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42d2693640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f42cc10e2a0 0x7f42cc17d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cbfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f42cc10d110 0x7f42cc17d000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cbfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f42cc10d110 0x7f42cc17d000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:45796/0 (socket says 10.20.193.4:45796) 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f42cc10e2a0 0x7f42cc17d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f42cc10e2a0 0x7f42cc17d650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56316/0 (socket says 10.20.193.4:56316) 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cbfff640 1 -- 10.20.193.4:0/3698862515 learned_addr learned my addr 10.20.193.4:0/3698862515 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42d2693640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f42cc10ec50 0x7f42cc10f910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc110050 con 0x7f42cc10e2a0 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc1101c0 con 0x7f42cc10ec50 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc110380 con 0x7f42cc10d110 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42d0c09640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f42cc10ec50 0x7f42cc10f910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cbfff640 1 -- 10.20.193.4:0/3698862515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f42cc10ec50 msgr2=0x7f42cc10f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cbfff640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f42cc10ec50 0x7f42cc10f910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cbfff640 1 -- 10.20.193.4:0/3698862515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f42cc10e2a0 msgr2=0x7f42cc17d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cbfff640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f42cc10e2a0 0x7f42cc17d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cbfff640 1 -- 10.20.193.4:0/3698862515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c000a590 con 0x7f42cc10d110 2026-02-24T09:07:27.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.861+0000 7f42cb7fe640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f42cc10e2a0 0x7f42cc17d650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:07:27.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.862+0000 7f42cbfff640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f42cc10d110 0x7f42cc17d000 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42b802f6a0 tx=0x7f42b8004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.862+0000 7f42c97fa640 1 -- 10.20.193.4:0/3698862515 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42b803d070 con 0x7f42cc10d110 2026-02-24T09:07:27.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.862+0000 7f42c97fa640 1 -- 10.20.193.4:0/3698862515 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f42b802fe20 con 0x7f42cc10d110 2026-02-24T09:07:27.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.862+0000 7f42c97fa640 1 -- 10.20.193.4:0/3698862515 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42b8041b10 con 0x7f42cc10d110 2026-02-24T09:07:27.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.862+0000 7f34b0f01640 1 -- 10.20.193.4:0/1002409269 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f348403f9d0 msgr2=0x7f348405fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.862+0000 7f34b0f01640 1 --2- 10.20.193.4:0/1002409269 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f348403f9d0 0x7f348405fe80 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34a0004740 tx=0x7f34a0005f90 comp rx=0 tx=0).stop 2026-02-24T09:07:27.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.862+0000 7f34b0f01640 1 -- 10.20.193.4:0/1002409269 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f34ac1103f0 msgr2=0x7f34ac171730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.862+0000 7f34b0f01640 1 --2- 10.20.193.4:0/1002409269 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f34ac1103f0 0x7f34ac171730 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f349400d950 tx=0x7f349400de20 comp rx=0 tx=0).stop 2026-02-24T09:07:27.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.862+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b8009570 con 0x7f42cc10d110 2026-02-24T09:07:27.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.863+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc1509a0 con 0x7f42cc10d110 2026-02-24T09:07:27.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.863+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42cc1711c0 con 0x7f42cc10d110 2026-02-24T09:07:27.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f42c97fa640 1 -- 10.20.193.4:0/3698862515 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f42b80386b0 con 0x7f42cc10d110 2026-02-24T09:07:27.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f42c97fa640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f42a003fa20 0x7f42a005fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f42c97fa640 1 -- 10.20.193.4:0/3698862515 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f42b8078d70 con 0x7f42cc10d110 2026-02-24T09:07:27.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f42cb7fe640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f42a003fa20 0x7f42a005fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f34b0f01640 1 -- 10.20.193.4:0/1002409269 shutdown_connections 2026-02-24T09:07:27.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f34b0f01640 1 --2- 10.20.193.4:0/1002409269 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f348403f9d0 0x7f348405fe80 unknown :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f34b0f01640 1 --2- 10.20.193.4:0/1002409269 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f34ac110da0 0x7f34ac0f9370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f34b0f01640 1 --2- 10.20.193.4:0/1002409269 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f34ac1103f0 0x7f34ac171730 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f34b0f01640 1 --2- 10.20.193.4:0/1002409269 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f34ac10f260 0x7f34ac0f8b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f34b0f01640 1 -- 10.20.193.4:0/1002409269 >> 10.20.193.4:0/1002409269 conn(0x7f34ac0ec9f0 msgr2=0x7f34ac0ef130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:27.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f34b0f01640 1 -- 10.20.193.4:0/1002409269 shutdown_connections 2026-02-24T09:07:27.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f34b0f01640 1 -- 10.20.193.4:0/1002409269 wait complete. 2026-02-24T09:07:27.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.864+0000 7f42cb7fe640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f42a003fa20 0x7f42a005fed0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42bc004740 tx=0x7f42bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.877 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-24T09:07:27.877 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-24T09:07:27.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.866+0000 7f42c97fa640 1 -- 10.20.193.4:0/3698862515 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f42b804a780 con 0x7f42cc10d110 2026-02-24T09:07:27.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.867+0000 7fe7360d0640 1 -- 10.20.193.4:0/11895993 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe730064780 msgr2=0x7fe730064bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.867+0000 7fe7360d0640 1 --2- 10.20.193.4:0/11895993 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe730064780 0x7fe730064bf0 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=10619125793602264844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe71c009950 tx=0x7fe71c02f190 comp rx=0 tx=0).stop 2026-02-24T09:07:27.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.867+0000 7fe7360d0640 1 -- 10.20.193.4:0/11895993 shutdown_connections 2026-02-24T09:07:27.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.867+0000 7fe7360d0640 1 --2- 10.20.193.4:0/11895993 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe730065130 0x7fe730065a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.867+0000 7fe7360d0640 1 --2- 10.20.193.4:0/11895993 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe730064780 0x7fe730064bf0 unknown :-1 s=CLOSED pgs=10 gs=3 cs=0 l=1 c_cookie=10619125793602264844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.867+0000 7fe7360d0640 1 --2- 10.20.193.4:0/11895993 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe7300635f0 0x7fe7300639e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.867+0000 7fe7360d0640 1 -- 10.20.193.4:0/11895993 >> 10.20.193.4:0/11895993 conn(0x7fe7300ec9f0 msgr2=0x7fe73010ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.868+0000 7fe7360d0640 1 -- 10.20.193.4:0/11895993 shutdown_connections 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.868+0000 7fe7360d0640 1 -- 10.20.193.4:0/11895993 wait complete. 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe7360d0640 1 Processor -- start 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe7360d0640 1 -- start start 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe7360d0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe7300635f0 0x7fe7300f2b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe7360d0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe730064780 0x7fe7300f3180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe7360d0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe730065130 0x7fe7300f3d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe72f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe7300635f0 0x7fe7300f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe72f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe7300635f0 0x7fe7300f2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56336/0 (socket says 10.20.193.4:56336) 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe7360d0640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe7300f4470 con 0x7fe7300635f0 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe7360d0640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe7300f45e0 con 0x7fe730065130 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe7360d0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7300f47a0 con 0x7fe730064780 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe72f7fe640 1 -- 10.20.193.4:0/4011476989 learned_addr learned my addr 10.20.193.4:0/4011476989 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe72f7fe640 1 -- 10.20.193.4:0/4011476989 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe730064780 msgr2=0x7fe7300f3180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe72f7fe640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe730064780 0x7fe7300f3180 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe72f7fe640 1 -- 10.20.193.4:0/4011476989 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe730065130 msgr2=0x7fe7300f3d30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe72f7fe640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe730065130 0x7fe7300f3d30 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.869+0000 7fe72f7fe640 1 -- 10.20.193.4:0/4011476989 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72400a590 con 0x7fe7300635f0 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.870+0000 7fe72f7fe640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe7300635f0 0x7fe7300f2b30 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7200072a0 tx=0x7fe72000df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.870+0000 7fe72cff9640 1 -- 10.20.193.4:0/4011476989 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe72000bbf0 con 0x7fe7300635f0 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.870+0000 7fe7360d0640 1 -- 10.20.193.4:0/4011476989 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c009570 con 0x7fe7300635f0 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.870+0000 7fe72cff9640 1 -- 10.20.193.4:0/4011476989 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7fe720004590 con 0x7fe7300635f0 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.870+0000 7fe72cff9640 1 -- 10.20.193.4:0/4011476989 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe720002ea0 con 0x7fe7300635f0 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.870+0000 7fe7360d0640 1 -- 10.20.193.4:0/4011476989 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7300f4f40 con 0x7fe7300635f0 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.871+0000 7fe70a7fc640 1 -- 10.20.193.4:0/4011476989 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe730111100 con 0x7fe7300635f0 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.871+0000 7fe72cff9640 1 -- 10.20.193.4:0/4011476989 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7fe720021350 con 0x7fe7300635f0 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.871+0000 7fe72cff9640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe70403fa30 0x7fe70405fee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.871+0000 7fe72effd640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe70403fa30 0x7fe70405fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.872+0000 7fe72cff9640 1 -- 10.20.193.4:0/4011476989 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fe720013650 con 0x7fe7300635f0 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.872+0000 7fe72effd640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe70403fa30 0x7fe70405fee0 secure :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe71c02f6a0 tx=0x7fe71c002390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.875+0000 7fe72cff9640 1 -- 10.20.193.4:0/4011476989 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe720021b60 con 0x7fe7300635f0 2026-02-24T09:07:27.886 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.886 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-24T09:07:27.886 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-24T09:07:27.911 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.913 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-24T09:07:27.913 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-24T09:07:27.923 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.924 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-24T09:07:27.925 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-24T09:07:27.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1584436299 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e4068ac0 msgr2=0x7fb9e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fb9eaeab640 1 --2- 10.20.193.4:0/1584436299 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e4068ac0 0x7fb9e4069420 secure :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=3973088241120655752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9e000aa30 tx=0x7fb9e00302b0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fcc35d39640 1 -- 10.20.193.4:0/1786884606 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc30062a40 msgr2=0x7fcc300610d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fcc35d39640 1 --2- 10.20.193.4:0/1786884606 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc30062a40 0x7fcc300610d0 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=557105394339067392 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc2400aa30 tx=0x7fcc240302b0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fcc35d39640 1 -- 10.20.193.4:0/1786884606 shutdown_connections 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fcc35d39640 1 --2- 10.20.193.4:0/1786884606 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3010cb20 0x7fcc3010cfc0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fcc35d39640 1 --2- 10.20.193.4:0/1786884606 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30061610 0x7fcc30061a80 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fcc35d39640 1 --2- 10.20.193.4:0/1786884606 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc30062a40 0x7fcc300610d0 unknown :-1 s=CLOSED pgs=123 gs=1 cs=0 l=1 c_cookie=557105394339067392 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fcc35d39640 1 -- 10.20.193.4:0/1786884606 >> 10.20.193.4:0/1786884606 conn(0x7fcc300ea760 msgr2=0x7fcc3010ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fcc35d39640 1 -- 10.20.193.4:0/1786884606 shutdown_connections 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.946+0000 7fcc35d39640 1 -- 10.20.193.4:0/1786884606 wait complete. 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc35d39640 1 Processor -- start 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc35d39640 1 -- start start 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc35d39640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc30061610 0x7fcc300febe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc35d39640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30062a40 0x7fcc300ff230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc35d39640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3010cb20 0x7fcc300ffe30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc2f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc30061610 0x7fcc300febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc2f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc30061610 0x7fcc300febe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56354/0 (socket says 10.20.193.4:56354) 2026-02-24T09:07:27.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc2f7fe640 1 -- 10.20.193.4:0/4001836838 learned_addr learned my addr 10.20.193.4:0/4001836838 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:27.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fcc30100570 con 0x7fcc30061610 2026-02-24T09:07:27.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fcc301006e0 con 0x7fcc3010cb20 2026-02-24T09:07:27.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc301008a0 con 0x7fcc30062a40 2026-02-24T09:07:27.955 DEBUG:tasks.cephadm:set 27 configs 2026-02-24T09:07:27.955 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial004') 2026-02-24T09:07:27.955 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial004') 2026-02-24T09:07:27.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial004') 2026-02-24T09:07:27.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial004') 2026-02-24T09:07:27.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1584436299 shutdown_connections 2026-02-24T09:07:27.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fb9eaeab640 1 --2- 10.20.193.4:0/1584436299 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e4068ac0 0x7fb9e4069420 unknown :-1 s=CLOSED pgs=13 gs=2 cs=0 l=1 c_cookie=3973088241120655752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fb9eaeab640 1 --2- 10.20.193.4:0/1584436299 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9e4068110 0x7fb9e4068580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fb9eaeab640 1 --2- 10.20.193.4:0/1584436299 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9e4066f80 0x7fb9e4067370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1584436299 >> 10.20.193.4:0/1584436299 conn(0x7fb9e4064700 msgr2=0x7fb9e4064b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:27.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.947+0000 7fcc2ffff640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3010cb20 0x7fcc300ffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fcc2f7fe640 1 -- 10.20.193.4:0/4001836838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30062a40 msgr2=0x7fcc300ff230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:27.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fcc2f7fe640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30062a40 0x7fcc300ff230 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fcc2f7fe640 1 -- 10.20.193.4:0/4001836838 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3010cb20 msgr2=0x7fcc300ffe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fcc2f7fe640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3010cb20 0x7fcc300ffe30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fcc2f7fe640 1 -- 10.20.193.4:0/4001836838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2400a650 con 0x7fcc30061610 2026-02-24T09:07:27.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fcc2f7fe640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc30061610 0x7fcc300febe0 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc2400a230 tx=0x7fcc24030dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fcc2cff9640 1 -- 10.20.193.4:0/4001836838 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc2403e070 con 0x7fcc30061610 2026-02-24T09:07:27.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.948+0000 7fcc2cff9640 1 -- 10.20.193.4:0/4001836838 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7fcc24005580 con 0x7fcc30061610 2026-02-24T09:07:27.959 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial004') 2026-02-24T09:07:27.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.949+0000 7fcc2cff9640 1 -- 10.20.193.4:0/4001836838 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc240383d0 con 0x7fcc30061610 2026-02-24T09:07:27.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.949+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc30100b20 con 0x7fcc30061610 2026-02-24T09:07:27.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.949+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc30100cb0 con 0x7fcc30061610 2026-02-24T09:07:27.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.950+0000 7fcc2cff9640 1 -- 10.20.193.4:0/4001836838 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7fcc24049020 con 0x7fcc30061610 2026-02-24T09:07:27.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.950+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc30179ce0 con 0x7fcc30061610 2026-02-24T09:07:27.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.951+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1584436299 shutdown_connections 2026-02-24T09:07:27.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.951+0000 7fcc2cff9640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc0803f9a0 0x7fcc0805fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.951+0000 7fcc2cff9640 1 -- 10.20.193.4:0/4001836838 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fcc24079b30 con 0x7fcc30061610 2026-02-24T09:07:27.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.951+0000 7fcc2effd640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc0803f9a0 0x7fcc0805fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.952+0000 7fcc2effd640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc0803f9a0 0x7fcc0805fe50 secure :-1 s=READY pgs=53 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc1c004780 tx=0x7fcc1c006c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.952+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1584436299 wait complete. 2026-02-24T09:07:27.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.953+0000 7fb9eaeab640 1 Processor -- start 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.953+0000 7fb9eaeab640 1 -- start start 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.953+0000 7fb9eaeab640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9e4066f80 0x7fb9e41a3760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.953+0000 7fb9eaeab640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e4068110 0x7fb9e41a3db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.953+0000 7fb9eaeab640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9e4068ac0 0x7fb9e41a49b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9eaeab640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e41a50f0 con 0x7fb9e4068ac0 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9dbfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e4068110 0x7fb9e41a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9dbfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e4068110 0x7fb9e41a3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:45830/0 (socket says 10.20.193.4:45830) 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9dbfff640 1 -- 10.20.193.4:0/1390168776 learned_addr learned my addr 10.20.193.4:0/1390168776 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9e8c20640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9e4066f80 0x7fb9e41a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9e9421640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9e4068ac0 0x7fb9e41a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e41a5260 con 0x7fb9e4066f80 2026-02-24T09:07:27.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e41a5420 con 0x7fb9e4068110 2026-02-24T09:07:27.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9e9421640 1 -- 10.20.193.4:0/1390168776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e4068110 msgr2=0x7fb9e41a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9e9421640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e4068110 0x7fb9e41a3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9e9421640 1 -- 10.20.193.4:0/1390168776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9e4066f80 msgr2=0x7fb9e41a3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9e9421640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9e4066f80 0x7fb9e41a3760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9e9421640 1 -- 10.20.193.4:0/1390168776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d40094b0 con 0x7fb9e4068ac0 2026-02-24T09:07:27.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9dbfff640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e4068110 0x7fb9e41a3db0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:07:27.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.954+0000 7fb9e9421640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9e4068ac0 0x7fb9e41a49b0 secure :-1 s=READY pgs=125 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9e000aa30 tx=0x7fb9e0003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.958+0000 7fb9d9ffb640 1 -- 10.20.193.4:0/1390168776 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9e003e070 con 0x7fb9e4068ac0 2026-02-24T09:07:27.967 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.958+0000 7fb9d9ffb640 1 -- 10.20.193.4:0/1390168776 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7fb9e0039d90 con 0x7fb9e4068ac0 2026-02-24T09:07:27.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.958+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e000a650 con 0x7fb9e4068ac0 2026-02-24T09:07:27.967 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.959+0000 7fb9d9ffb640 1 -- 10.20.193.4:0/1390168776 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9e0042ad0 con 0x7fb9e4068ac0 2026-02-24T09:07:27.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.959+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e4205a50 con 0x7fb9e4068ac0 2026-02-24T09:07:27.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.960+0000 7fb9d9ffb640 1 -- 10.20.193.4:0/1390168776 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7fb9e004a060 con 0x7fb9e4068ac0 2026-02-24T09:07:27.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.960+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e406d340 con 0x7fb9e4068ac0 2026-02-24T09:07:27.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.960+0000 7fb9d9ffb640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9b403f950 0x7fb9b405fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:27.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.960+0000 7fb9d9ffb640 1 -- 10.20.193.4:0/1390168776 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fb9e0079c10 con 0x7fb9e4068ac0 2026-02-24T09:07:27.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.960+0000 7fb9e8c20640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9b403f950 0x7fb9b405fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:27.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.961+0000 7fb9e8c20640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9b403f950 0x7fb9b405fe00 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9cc004740 tx=0x7fb9cc02d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:27.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.965+0000 7fb9d9ffb640 1 -- 10.20.193.4:0/1390168776 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fb9e004b390 con 0x7fb9e4068ac0 2026-02-24T09:07:27.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.965+0000 7fcc2cff9640 1 -- 10.20.193.4:0/4001836838 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fcc24038930 con 0x7fcc30061610 2026-02-24T09:07:27.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.972+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2935621479 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f55e405f5d0 con 0x7f55e410eb30 2026-02-24T09:07:27.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.976+0000 7f55d27fc640 1 -- 10.20.193.4:0/2935621479 <== mon.0 v2:10.20.193.4:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v14)=0 v14) ==== 108+0+0 (secure 0 0 0) 0x7f55e004d020 con 0x7f55e410eb30 2026-02-24T09:07:27.982 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.986 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.981+0000 7f3a57cd0640 1 -- 10.20.193.4:0/2411656796 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f3a500630c0 con 0x7f3a5010d850 2026-02-24T09:07:27.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.983+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f55c003fa20 msgr2=0x7f55c005fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.983+0000 7f55eb6fd640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f55c003fa20 0x7f55c005fed0 secure :-1 s=READY pgs=49 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55d4004760 tx=0x7f55d4006c80 comp rx=0 tx=0).stop 2026-02-24T09:07:27.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.983+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f55e410eb30 msgr2=0x7f55e40f7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.983+0000 7f55eb6fd640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f55e410eb30 0x7f55e40f7100 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55e0010c10 tx=0x7f55e0003d00 comp rx=0 tx=0).stop 2026-02-24T09:07:27.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.984+0000 7f42c97fa640 1 -- 10.20.193.4:0/3698862515 <== mon.1 v2:10.20.193.90:3300/0 7 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f42b8078670 con 0x7f42cc10d110 2026-02-24T09:07:27.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.984+0000 7f3a3effd640 1 -- 10.20.193.4:0/2411656796 <== mon.0 v2:10.20.193.4:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7f3a44016310 con 0x7f3a5010d850 2026-02-24T09:07:27.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.985+0000 7fb9d9ffb640 1 -- 10.20.193.4:0/1390168776 <== mon.0 v2:10.20.193.4:3300/0 7 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9e0079510 con 0x7fb9e4068ac0 2026-02-24T09:07:27.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.985+0000 7f3a3effd640 1 -- 10.20.193.4:0/2411656796 <== mon.0 v2:10.20.193.4:3300/0 9 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a4401b300 con 0x7f3a5010d850 2026-02-24T09:07:27.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.985+0000 7fe72cff9640 1 -- 10.20.193.4:0/4011476989 <== mon.0 v2:10.20.193.4:3300/0 7 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe720053ce0 con 0x7fe7300635f0 2026-02-24T09:07:27.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7fcc2cff9640 1 -- 10.20.193.4:0/4001836838 <== mon.0 v2:10.20.193.4:3300/0 7 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc24079430 con 0x7fcc30061610 2026-02-24T09:07:27.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2935621479 shutdown_connections 2026-02-24T09:07:27.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f55eb6fd640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f55c003fa20 0x7f55c005fed0 unknown :-1 s=CLOSED pgs=49 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f55eb6fd640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f55e410eb30 0x7f55e40f7100 unknown :-1 s=CLOSED pgs=120 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f55eb6fd640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f55e410e180 0x7f55e416f4c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f55eb6fd640 1 --2- 10.20.193.4:0/2935621479 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f55e410cff0 0x7f55e40f68a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2935621479 >> 10.20.193.4:0/2935621479 conn(0x7f55e40ea760 msgr2=0x7f55e40ece70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:27.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2935621479 shutdown_connections 2026-02-24T09:07:27.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f55eb6fd640 1 -- 10.20.193.4:0/2935621479 wait complete. 2026-02-24T09:07:27.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f3a3cff9640 1 -- 10.20.193.4:0/2411656796 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a2803f9d0 msgr2=0x7f3a2805fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f3a3cff9640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a2803f9d0 0x7f3a2805fe80 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a400023d0 tx=0x7f3a40031040 comp rx=0 tx=0).stop 2026-02-24T09:07:27.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f3a3cff9640 1 -- 10.20.193.4:0/2411656796 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5010d850 msgr2=0x7f3a5016f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:27.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.988+0000 7f3a3cff9640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5010d850 0x7f3a5016f5e0 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a4400b500 tx=0x7f3a4400b9d0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.989+0000 7f3a3cff9640 1 -- 10.20.193.4:0/2411656796 shutdown_connections 2026-02-24T09:07:27.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.989+0000 7f3a3cff9640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a2803f9d0 0x7f3a2805fe80 unknown :-1 s=CLOSED pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.989+0000 7f3a3cff9640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5010e610 0x7f3a50061030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.989+0000 7f3a3cff9640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5010d850 0x7f3a5016f5e0 unknown :-1 s=CLOSED pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.989+0000 7f3a3cff9640 1 --2- 10.20.193.4:0/2411656796 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5010cea0 0x7f3a50062720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:27.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.989+0000 7f3a3cff9640 1 -- 10.20.193.4:0/2411656796 >> 10.20.193.4:0/2411656796 conn(0x7f3a500ea860 msgr2=0x7f3a50056270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:27.995 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:27.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.990+0000 7f3a3cff9640 1 -- 10.20.193.4:0/2411656796 shutdown_connections 2026-02-24T09:07:27.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:27.990+0000 7f3a3cff9640 1 -- 10.20.193.4:0/2411656796 wait complete. 2026-02-24T09:07:27.998 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:28.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.028+0000 7f7207aca640 1 -- 10.20.193.4:0/2695711373 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f720010f260 msgr2=0x7f720010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.028+0000 7f7207aca640 1 --2- 10.20.193.4:0/2695711373 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f720010f260 0x7f720010f650 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=10158702409421014772 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71f0009950 tx=0x7f71f002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.030+0000 7f7207aca640 1 -- 10.20.193.4:0/2695711373 shutdown_connections 2026-02-24T09:07:28.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.030+0000 7f7207aca640 1 --2- 10.20.193.4:0/2695711373 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7200110da0 0x7f7200171730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.030+0000 7f7207aca640 1 --2- 10.20.193.4:0/2695711373 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72001103f0 0x7f7200110860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.030+0000 7f7207aca640 1 --2- 10.20.193.4:0/2695711373 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f720010f260 0x7f720010f650 unknown :-1 s=CLOSED pgs=126 gs=1 cs=0 l=1 c_cookie=10158702409421014772 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.030+0000 7f7207aca640 1 -- 10.20.193.4:0/2695711373 >> 10.20.193.4:0/2695711373 conn(0x7f72000ec9f0 msgr2=0x7f720010ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.031+0000 7f7207aca640 1 -- 10.20.193.4:0/2695711373 shutdown_connections 2026-02-24T09:07:28.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.031+0000 7f7207aca640 1 -- 10.20.193.4:0/2695711373 wait complete. 2026-02-24T09:07:28.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.031+0000 7f7207aca640 1 Processor -- start 2026-02-24T09:07:28.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.031+0000 7f7207aca640 1 -- start start 2026-02-24T09:07:28.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.031+0000 7f7207aca640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f720010f260 0x7f72000f8960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f7207aca640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72001103f0 0x7f7200171730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f7207aca640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7200110da0 0x7f72000f91c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f7207aca640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f72000f9db0 con 0x7f720010f260 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f7207aca640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f72000f9f20 con 0x7f7200110da0 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f720583f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f720010f260 0x7f72000f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f720583f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f720010f260 0x7f72000f8960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56384/0 (socket says 10.20.193.4:56384) 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f720583f640 1 -- 10.20.193.4:0/14706969 learned_addr learned my addr 10.20.193.4:0/14706969 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f72000fa0e0 con 0x7f72001103f0 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f7206040640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7200110da0 0x7f72000f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f720583f640 1 -- 10.20.193.4:0/14706969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72001103f0 msgr2=0x7f7200171730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f720583f640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72001103f0 0x7f7200171730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f720583f640 1 -- 10.20.193.4:0/14706969 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7200110da0 msgr2=0x7f72000f91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f720583f640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7200110da0 0x7f72000f91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f720583f640 1 -- 10.20.193.4:0/14706969 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0009570 con 0x7f720010f260 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f720583f640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f720010f260 0x7f72000f8960 secure :-1 s=READY pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71f0002d80 tx=0x7f71f00028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.032+0000 7f71eeffd640 1 -- 10.20.193.4:0/14706969 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71f003d070 con 0x7f720010f260 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.033+0000 7f71eeffd640 1 -- 10.20.193.4:0/14706969 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71f00043d0 con 0x7f720010f260 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.033+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72000fa360 con 0x7f720010f260 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.033+0000 7f71eeffd640 1 -- 10.20.193.4:0/14706969 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71f0041aa0 con 0x7f720010f260 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.033+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72000fa7d0 con 0x7f720010f260 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.033+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72000fa9f0 con 0x7f720010f260 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.034+0000 7f71eeffd640 1 -- 10.20.193.4:0/14706969 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f71f0038920 con 0x7f720010f260 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.034+0000 7f71eeffd640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71dc03f9d0 0x7f71dc05fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.034+0000 7f71eeffd640 1 -- 10.20.193.4:0/14706969 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f71f0082830 con 0x7f720010f260 2026-02-24T09:07:28.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.035+0000 7f720503e640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71dc03f9d0 0x7f71dc05fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.036+0000 7f720503e640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71dc03f9d0 0x7f71dc05fe80 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71f4005970 tx=0x7f71f4005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.039+0000 7f71eeffd640 1 -- 10.20.193.4:0/14706969 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f71f007f060 con 0x7f720010f260 2026-02-24T09:07:28.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.040+0000 7f2e439b2640 1 -- 10.20.193.4:0/3801078582 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e3c062b40 msgr2=0x7f2e3c0610d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.040+0000 7f2e439b2640 1 --2- 10.20.193.4:0/3801078582 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e3c062b40 0x7f2e3c0610d0 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=394504225672037353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e2c009950 tx=0x7f2e2c02f1b0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.042+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f42cc062370 con 0x7f42cc10d110 2026-02-24T09:07:28.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.044+0000 7f2e439b2640 1 -- 10.20.193.4:0/3801078582 shutdown_connections 2026-02-24T09:07:28.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.044+0000 7f2e439b2640 1 --2- 10.20.193.4:0/3801078582 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e3c10cc90 0x7f2e3c10d130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.044+0000 7f2e439b2640 1 --2- 10.20.193.4:0/3801078582 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e3c061610 0x7f2e3c061a80 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.044+0000 7f2e439b2640 1 --2- 10.20.193.4:0/3801078582 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e3c062b40 0x7f2e3c0610d0 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=394504225672037353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.044+0000 7f2e439b2640 1 -- 10.20.193.4:0/3801078582 >> 10.20.193.4:0/3801078582 conn(0x7f2e3c0ea860 msgr2=0x7f2e3c10ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.044+0000 7f2e439b2640 1 -- 10.20.193.4:0/3801078582 shutdown_connections 2026-02-24T09:07:28.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e439b2640 1 -- 10.20.193.4:0/3801078582 wait complete. 2026-02-24T09:07:28.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f42c97fa640 1 -- 10.20.193.4:0/3698862515 <== mon.1 v2:10.20.193.90:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7f42b8046070 con 0x7f42cc10d110 2026-02-24T09:07:28.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e439b2640 1 Processor -- start 2026-02-24T09:07:28.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e439b2640 1 -- start start 2026-02-24T09:07:28.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e439b2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e3c061610 0x7f2e3c0f6c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e439b2640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e3c062b40 0x7f2e3c0f7280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e439b2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e3c10cc90 0x7f2e3c0f7e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e439b2640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c0f85c0 con 0x7f2e3c10cc90 2026-02-24T09:07:28.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e439b2640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c0f8730 con 0x7f2e3c062b40 2026-02-24T09:07:28.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e439b2640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c0f88f0 con 0x7f2e3c061610 2026-02-24T09:07:28.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e40f26640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e3c062b40 0x7f2e3c0f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e40f26640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e3c062b40 0x7f2e3c0f7280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:43212/0 (socket says 10.20.193.4:43212) 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.047+0000 7f2e40f26640 1 -- 10.20.193.4:0/121478070 learned_addr learned my addr 10.20.193.4:0/121478070 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.048+0000 7f2e41f28640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e3c10cc90 0x7f2e3c0f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.048+0000 7f2e40f26640 1 -- 10.20.193.4:0/121478070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e3c061610 msgr2=0x7f2e3c0f6c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.048+0000 7f2e40f26640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e3c061610 0x7f2e3c0f6c30 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.048+0000 7f2e40f26640 1 -- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e3c10cc90 msgr2=0x7f2e3c0f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.048+0000 7f2e40f26640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e3c10cc90 0x7f2e3c0f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.048+0000 7f2e40f26640 1 -- 10.20.193.4:0/121478070 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c009570 con 0x7f2e3c062b40 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.048+0000 7f2e41f28640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e3c10cc90 0x7f2e3c0f7e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.048+0000 7f2e40f26640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e3c062b40 0x7f2e3c0f7280 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e3000b520 tx=0x7f2e3000b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.049+0000 7f2e2a7fc640 1 -- 10.20.193.4:0/121478070 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e300044a0 con 0x7f2e3c062b40 2026-02-24T09:07:28.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.049+0000 7f2e2a7fc640 1 -- 10.20.193.4:0/121478070 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2e30002c20 con 0x7f2e3c062b40 2026-02-24T09:07:28.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.049+0000 7f2e2a7fc640 1 -- 10.20.193.4:0/121478070 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e3000fd90 con 0x7f2e3c062b40 2026-02-24T09:07:28.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.049+0000 7f2e439b2640 1 -- 10.20.193.4:0/121478070 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3c0f8bd0 con 0x7f2e3c062b40 2026-02-24T09:07:28.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.049+0000 7f2e439b2640 1 -- 10.20.193.4:0/121478070 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3c0f9110 con 0x7f2e3c062b40 2026-02-24T09:07:28.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.050+0000 7f2e2a7fc640 1 -- 10.20.193.4:0/121478070 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f2e30002740 con 0x7f2e3c062b40 2026-02-24T09:07:28.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.050+0000 7f2e439b2640 1 -- 10.20.193.4:0/121478070 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e3c179f00 con 0x7f2e3c062b40 2026-02-24T09:07:28.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.050+0000 7f2e2a7fc640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e1803f950 0x7f2e1805fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.050+0000 7f2e2a7fc640 1 -- 10.20.193.4:0/121478070 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f2e300539a0 con 0x7f2e3c062b40 2026-02-24T09:07:28.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.051+0000 7f2e41727640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e1803f950 0x7f2e1805fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.052+0000 7f2e41727640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e1803f950 0x7f2e1805fe00 secure :-1 s=READY pgs=56 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e2c02f6c0 tx=0x7f2e2c002390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.054+0000 7f2e2a7fc640 1 -- 10.20.193.4:0/121478070 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f2e30002d90 con 0x7f2e3c062b40 2026-02-24T09:07:28.060 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:28.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.061+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f42a003fa20 msgr2=0x7f42a005fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.061+0000 7f42d2693640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f42a003fa20 0x7f42a005fed0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42bc004740 tx=0x7f42bc005f90 comp rx=0 tx=0).stop 2026-02-24T09:07:28.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.061+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f42cc10d110 msgr2=0x7f42cc17d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.061+0000 7f42d2693640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f42cc10d110 0x7f42cc17d000 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42b802f6a0 tx=0x7f42b8004740 comp rx=0 tx=0).stop 2026-02-24T09:07:28.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.062+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 shutdown_connections 2026-02-24T09:07:28.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.062+0000 7f42d2693640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f42a003fa20 0x7f42a005fed0 unknown :-1 s=CLOSED pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.062+0000 7f42d2693640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f42cc10ec50 0x7f42cc10f910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.062+0000 7f42d2693640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f42cc10e2a0 0x7f42cc17d650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.062+0000 7f42d2693640 1 --2- 10.20.193.4:0/3698862515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f42cc10d110 0x7f42cc17d000 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.063+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 >> 10.20.193.4:0/3698862515 conn(0x7f42cc0ea840 msgr2=0x7f42cc10ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.065+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 shutdown_connections 2026-02-24T09:07:28.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.065+0000 7f42d2693640 1 -- 10.20.193.4:0/3698862515 wait complete. 2026-02-24T09:07:28.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.065+0000 7fe70a7fc640 1 -- 10.20.193.4:0/4011476989 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fe7300639e0 con 0x7fe7300635f0 2026-02-24T09:07:28.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.069+0000 7fe72cff9640 1 -- 10.20.193.4:0/4011476989 <== mon.0 v2:10.20.193.4:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v17)=0 v17) ==== 117+0+0 (secure 0 0 0) 0x7fe72001e0b0 con 0x7fe7300635f0 2026-02-24T09:07:28.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.074+0000 7fe70a7fc640 1 -- 10.20.193.4:0/4011476989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe70403fa30 msgr2=0x7fe70405fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.074+0000 7fe70a7fc640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe70403fa30 0x7fe70405fee0 secure :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe71c02f6a0 tx=0x7fe71c002390 comp rx=0 tx=0).stop 2026-02-24T09:07:28.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.074+0000 7fe70a7fc640 1 -- 10.20.193.4:0/4011476989 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe7300635f0 msgr2=0x7fe7300f2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.074+0000 7fe70a7fc640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe7300635f0 0x7fe7300f2b30 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7200072a0 tx=0x7fe72000df30 comp rx=0 tx=0).stop 2026-02-24T09:07:28.082 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:28.082 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: Updating trial014:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: Updating trial090:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: Updating trial004:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: Reconfiguring mon.a (unknown last config time)... 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: Reconfiguring daemon mon.a on trial004 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: Reconfiguring mon.b (monmap changed)... 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: Reconfiguring daemon mon.b on trial014 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: Reconfiguring mon.c (monmap changed)... 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: Reconfiguring daemon mon.c on trial090 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.083 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:07:28.084 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:07:28.085 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:28.085 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3521025520' entity='client.admin' 2026-02-24T09:07:28.085 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2482992703' entity='client.admin' 2026-02-24T09:07:28.085 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:27 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/199995864' entity='client.admin' 2026-02-24T09:07:28.086 INFO:journalctl@ceph.mgr.z.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mgr[48608]: -- 10.20.193.90:0/2621783774 <== mon.1 v2:10.20.193.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x2b85a00 con 0x2b59400 2026-02-24T09:07:28.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.080+0000 7fe70a7fc640 1 -- 10.20.193.4:0/4011476989 shutdown_connections 2026-02-24T09:07:28.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.080+0000 7fe70a7fc640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe70403fa30 0x7fe70405fee0 unknown :-1 s=CLOSED pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.080+0000 7fe70a7fc640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe730065130 0x7fe7300f3d30 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.080+0000 7fe70a7fc640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe730064780 0x7fe7300f3180 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.080+0000 7fe70a7fc640 1 --2- 10.20.193.4:0/4011476989 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe7300635f0 0x7fe7300f2b30 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.080+0000 7fe70a7fc640 1 -- 10.20.193.4:0/4011476989 >> 10.20.193.4:0/4011476989 conn(0x7fe7300ec9f0 msgr2=0x7fe730131d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: Updating trial014:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: Updating trial090:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: Updating trial004:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: Reconfiguring mon.a (unknown last config time)... 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: Reconfiguring daemon mon.a on trial004 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: Reconfiguring mon.b (monmap changed)... 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: Reconfiguring daemon mon.b on trial014 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: Reconfiguring mon.c (monmap changed)... 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: Reconfiguring daemon mon.c on trial090 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.087 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:07:28.088 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:28.089 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3521025520' entity='client.admin' 2026-02-24T09:07:28.089 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2482992703' entity='client.admin' 2026-02-24T09:07:28.089 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:27 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/199995864' entity='client.admin' 2026-02-24T09:07:28.089 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:28.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.084+0000 7fe70a7fc640 1 -- 10.20.193.4:0/4011476989 shutdown_connections 2026-02-24T09:07:28.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.084+0000 7fe70a7fc640 1 -- 10.20.193.4:0/4011476989 wait complete. 2026-02-24T09:07:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: Updating trial014:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: Updating trial090:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: Updating trial004:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/config/ceph.conf 2026-02-24T09:07:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: Reconfiguring mon.a (unknown last config time)... 2026-02-24T09:07:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: Reconfiguring daemon mon.a on trial004 2026-02-24T09:07:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: Reconfiguring mon.b (monmap changed)... 2026-02-24T09:07:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: Reconfiguring daemon mon.b on trial014 2026-02-24T09:07:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: Reconfiguring mon.c (monmap changed)... 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: Reconfiguring daemon mon.c on trial090 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:28.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:07:28.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:07:28.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:07:28.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:28.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3521025520' entity='client.admin' 2026-02-24T09:07:28.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2482992703' entity='client.admin' 2026-02-24T09:07:28.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:27 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/199995864' entity='client.admin' 2026-02-24T09:07:28.098 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.101 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:28.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.107+0000 7fdfd5193640 1 -- 10.20.193.4:0/2198395840 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfd010c680 msgr2=0x7fdfd016e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.107+0000 7fdfd5193640 1 --2- 10.20.193.4:0/2198395840 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfd010c680 0x7fdfd016e410 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=18323796084294767655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfc000aa60 tx=0x7fdfc00302f0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.107+0000 7fdfd5193640 1 -- 10.20.193.4:0/2198395840 shutdown_connections 2026-02-24T09:07:28.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.107+0000 7fdfd5193640 1 --2- 10.20.193.4:0/2198395840 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfd010c680 0x7fdfd016e410 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=18323796084294767655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.107+0000 7fdfd5193640 1 --2- 10.20.193.4:0/2198395840 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfd010bcd0 0x7fdfd010c140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.107+0000 7fdfd5193640 1 --2- 10.20.193.4:0/2198395840 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfd010d440 0x7fdfd010d830 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.107+0000 7fdfd5193640 1 -- 10.20.193.4:0/2198395840 >> 10.20.193.4:0/2198395840 conn(0x7fdfd00e9690 msgr2=0x7fdfd0109aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.108+0000 7fdfd5193640 1 -- 10.20.193.4:0/2198395840 shutdown_connections 2026-02-24T09:07:28.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.111+0000 7fdfd5193640 1 -- 10.20.193.4:0/2198395840 wait complete. 2026-02-24T09:07:28.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.111+0000 7fdfd5193640 1 Processor -- start 2026-02-24T09:07:28.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.112+0000 7fdfd5193640 1 -- start start 2026-02-24T09:07:28.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfd5193640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfd010bcd0 0x7fdfd00f6700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfd5193640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfd010c680 0x7fdfd016e410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfce575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfd010c680 0x7fdfd016e410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfced76640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfd010bcd0 0x7fdfd00f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfced76640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfd010bcd0 0x7fdfd00f6700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:43232/0 (socket says 10.20.193.4:43232) 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfce575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfd010c680 0x7fdfd016e410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56444/0 (socket says 10.20.193.4:56444) 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfced76640 1 -- 10.20.193.4:0/3712150437 learned_addr learned my addr 10.20.193.4:0/3712150437 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfd5193640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfd010d440 0x7fdfd00f6f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd00f7b50 con 0x7fdfd010c680 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd00f7cc0 con 0x7fdfd010bcd0 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd00f7e80 con 0x7fdfd010d440 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.113+0000 7fdfcf577640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfd010d440 0x7fdfd00f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.114+0000 7fdfce575640 1 -- 10.20.193.4:0/3712150437 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfd010d440 msgr2=0x7fdfd00f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.114+0000 7fdfce575640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfd010d440 0x7fdfd00f6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.114+0000 7fdfce575640 1 -- 10.20.193.4:0/3712150437 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfd010bcd0 msgr2=0x7fdfd00f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.114+0000 7fdfce575640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfd010bcd0 0x7fdfd00f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.114+0000 7fdfce575640 1 -- 10.20.193.4:0/3712150437 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc000a650 con 0x7fdfd010c680 2026-02-24T09:07:28.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.114+0000 7fdfce575640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfd010c680 0x7fdfd016e410 secure :-1 s=READY pgs=130 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfb8004740 tx=0x7fdfb800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.114+0000 7fdfaffff640 1 -- 10.20.193.4:0/3712150437 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfb800cc60 con 0x7fdfd010c680 2026-02-24T09:07:28.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.114+0000 7fdfaffff640 1 -- 10.20.193.4:0/3712150437 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfb800cdc0 con 0x7fdfd010c680 2026-02-24T09:07:28.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.115+0000 7fdfaffff640 1 -- 10.20.193.4:0/3712150437 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfb80106b0 con 0x7fdfd010c680 2026-02-24T09:07:28.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.115+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd00f8160 con 0x7fdfd010c680 2026-02-24T09:07:28.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.116+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd00f85d0 con 0x7fdfd010c680 2026-02-24T09:07:28.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.116+0000 7fdfaffff640 1 -- 10.20.193.4:0/3712150437 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7fdfb8018430 con 0x7fdfd010c680 2026-02-24T09:07:28.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.117+0000 7fdfaffff640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfa403f9a0 0x7fdfa405fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.117+0000 7fdfaffff640 1 -- 10.20.193.4:0/3712150437 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fdfb8014070 con 0x7fdfd010c680 2026-02-24T09:07:28.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.117+0000 7fdfced76640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfa403f9a0 0x7fdfa405fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.117+0000 7fdfced76640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfa403f9a0 0x7fdfa405fe50 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfc4006f30 tx=0x7fdfc4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.120+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd0172440 con 0x7fdfd010c680 2026-02-24T09:07:28.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.125+0000 7fdfaffff640 1 -- 10.20.193.4:0/3712150437 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fdfb805a060 con 0x7fdfd010c680 2026-02-24T09:07:28.132 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:28.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.136+0000 7f2f5601f640 1 -- 10.20.193.4:0/1606934594 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010d850 msgr2=0x7f2f5016f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.136+0000 7f2f5601f640 1 --2- 10.20.193.4:0/1606934594 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010d850 0x7f2f5016f5e0 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=2866042518984411542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f4400aa60 tx=0x7f2f44030290 comp rx=0 tx=0).stop 2026-02-24T09:07:28.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.136+0000 7f2f5601f640 1 -- 10.20.193.4:0/1606934594 shutdown_connections 2026-02-24T09:07:28.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.136+0000 7f2f5601f640 1 --2- 10.20.193.4:0/1606934594 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010d850 0x7f2f5016f5e0 unknown :-1 s=CLOSED pgs=14 gs=3 cs=0 l=1 c_cookie=2866042518984411542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.136+0000 7f2f5601f640 1 --2- 10.20.193.4:0/1606934594 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f5010cea0 0x7f2f5010d310 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.136+0000 7f2f5601f640 1 --2- 10.20.193.4:0/1606934594 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f5010e610 0x7f2f5010ea00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.136+0000 7f2f5601f640 1 -- 10.20.193.4:0/1606934594 >> 10.20.193.4:0/1606934594 conn(0x7f2f500ea860 msgr2=0x7f2f5010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.136+0000 7f2f5601f640 1 -- 10.20.193.4:0/1606934594 shutdown_connections 2026-02-24T09:07:28.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.136+0000 7f2f5601f640 1 -- 10.20.193.4:0/1606934594 wait complete. 2026-02-24T09:07:28.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.137+0000 7f2f5601f640 1 Processor -- start 2026-02-24T09:07:28.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.137+0000 7f2f5601f640 1 -- start start 2026-02-24T09:07:28.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.137+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fb9e406cc20 con 0x7fb9e4068ac0 2026-02-24T09:07:28.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.137+0000 7f2f5601f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f5010cea0 0x7f2f500f7170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.137+0000 7f2f5601f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010d850 0x7f2f5016f5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.137+0000 7f2f5601f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f5010e610 0x7f2f500f79d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.137+0000 7f2f5601f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2f500f85c0 con 0x7f2f5010cea0 2026-02-24T09:07:28.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.137+0000 7f2f5601f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2f500f8730 con 0x7f2f5010e610 2026-02-24T09:07:28.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.137+0000 7f2f4f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f5010cea0 0x7f2f500f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f5601f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f500f88f0 con 0x7f2f5010d850 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f5010cea0 0x7f2f500f7170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56472/0 (socket says 10.20.193.4:56472) 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4f7fe640 1 -- 10.20.193.4:0/3756215298 learned_addr learned my addr 10.20.193.4:0/3756215298 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4ffff640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f5010e610 0x7f2f500f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4effd640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010d850 0x7f2f5016f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4f7fe640 1 -- 10.20.193.4:0/3756215298 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010d850 msgr2=0x7f2f5016f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4f7fe640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010d850 0x7f2f5016f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4f7fe640 1 -- 10.20.193.4:0/3756215298 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f5010e610 msgr2=0x7f2f500f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4f7fe640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f5010e610 0x7f2f500f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4f7fe640 1 -- 10.20.193.4:0/3756215298 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4400a650 con 0x7f2f5010cea0 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4f7fe640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f5010cea0 0x7f2f500f7170 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f3c00b500 tx=0x7f2f3c00b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4cff9640 1 -- 10.20.193.4:0/3756215298 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f3c0044a0 con 0x7f2f5010cea0 2026-02-24T09:07:28.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f5601f640 1 -- 10.20.193.4:0/3756215298 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f500f8bd0 con 0x7f2f5010cea0 2026-02-24T09:07:28.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4cff9640 1 -- 10.20.193.4:0/3756215298 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2f3c002b80 con 0x7f2f5010cea0 2026-02-24T09:07:28.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f4cff9640 1 -- 10.20.193.4:0/3756215298 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f3c010db0 con 0x7f2f5010cea0 2026-02-24T09:07:28.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.138+0000 7f2f5601f640 1 -- 10.20.193.4:0/3756215298 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f500f9170 con 0x7f2f5010cea0 2026-02-24T09:07:28.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.139+0000 7f2f4cff9640 1 -- 10.20.193.4:0/3756215298 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f2f3c002cf0 con 0x7f2f5010cea0 2026-02-24T09:07:28.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.139+0000 7f2f5601f640 1 -- 10.20.193.4:0/3756215298 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f50171530 con 0x7f2f5010cea0 2026-02-24T09:07:28.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.139+0000 7f2f4cff9640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f2403f9d0 0x7f2f2405fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.139+0000 7f2f4cff9640 1 -- 10.20.193.4:0/3756215298 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f2f3c0538f0 con 0x7f2f5010cea0 2026-02-24T09:07:28.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.139+0000 7f2f4effd640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f2403f9d0 0x7f2f2405fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.140+0000 7f2f4effd640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f2403f9d0 0x7f2f2405fe80 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f40004740 tx=0x7f2f40005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.142+0000 7f2f4cff9640 1 -- 10.20.193.4:0/3756215298 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f2f3c00d780 con 0x7f2f5010cea0 2026-02-24T09:07:28.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.145+0000 7fb9d9ffb640 1 -- 10.20.193.4:0/1390168776 <== mon.0 v2:10.20.193.4:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v18)=0 v18) ==== 127+0+0 (secure 0 0 0) 0x7fb9e0037370 con 0x7fb9e4068ac0 2026-02-24T09:07:28.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fcc30110a60 con 0x7fcc30061610 2026-02-24T09:07:28.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9b403f950 msgr2=0x7fb9b405fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9b403f950 0x7fb9b405fe00 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9cc004740 tx=0x7fb9cc02d040 comp rx=0 tx=0).stop 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9e4068ac0 msgr2=0x7fb9e41a49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9e4068ac0 0x7fb9e41a49b0 secure :-1 s=READY pgs=125 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9e000aa30 tx=0x7fb9e0003d20 comp rx=0 tx=0).stop 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 shutdown_connections 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9b403f950 0x7fb9b405fe00 unknown :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9e4068ac0 0x7fb9e41a49b0 unknown :-1 s=CLOSED pgs=125 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9e4068110 0x7fb9e41a3db0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 --2- 10.20.193.4:0/1390168776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9e4066f80 0x7fb9e41a3760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 >> 10.20.193.4:0/1390168776 conn(0x7fb9e4064700 msgr2=0x7fb9e40652b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 shutdown_connections 2026-02-24T09:07:28.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.148+0000 7fb9eaeab640 1 -- 10.20.193.4:0/1390168776 wait complete. 2026-02-24T09:07:28.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.150+0000 7fcc2cff9640 1 -- 10.20.193.4:0/4001836838 <== mon.0 v2:10.20.193.4:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7fcc24006cd0 con 0x7fcc30061610 2026-02-24T09:07:28.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.152+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc0803f9a0 msgr2=0x7fcc0805fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.152+0000 7fcc35d39640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc0803f9a0 0x7fcc0805fe50 secure :-1 s=READY pgs=53 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc1c004780 tx=0x7fcc1c006c80 comp rx=0 tx=0).stop 2026-02-24T09:07:28.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.152+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc30061610 msgr2=0x7fcc300febe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.152+0000 7fcc35d39640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc30061610 0x7fcc300febe0 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc2400a230 tx=0x7fcc24030dd0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.153+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 shutdown_connections 2026-02-24T09:07:28.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.153+0000 7fcc35d39640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc0803f9a0 0x7fcc0805fe50 unknown :-1 s=CLOSED pgs=53 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.153+0000 7fcc35d39640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3010cb20 0x7fcc300ffe30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.153+0000 7fcc35d39640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc30062a40 0x7fcc300ff230 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.153+0000 7fcc35d39640 1 --2- 10.20.193.4:0/4001836838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc30061610 0x7fcc300febe0 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.153+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 >> 10.20.193.4:0/4001836838 conn(0x7fcc300ea760 msgr2=0x7fcc30056270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.153+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 shutdown_connections 2026-02-24T09:07:28.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.153+0000 7fcc35d39640 1 -- 10.20.193.4:0/4001836838 wait complete. 2026-02-24T09:07:28.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.158+0000 7f4725f41640 1 -- 10.20.193.4:0/1663445202 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f472010f260 msgr2=0x7f472010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.158+0000 7f4725f41640 1 --2- 10.20.193.4:0/1663445202 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f472010f260 0x7f472010f650 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=2279049147501355352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f470c009950 tx=0x7f470c02f1b0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.158+0000 7f4725f41640 1 -- 10.20.193.4:0/1663445202 shutdown_connections 2026-02-24T09:07:28.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.158+0000 7f4725f41640 1 --2- 10.20.193.4:0/1663445202 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4720110da0 0x7f4720171730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.158+0000 7f4725f41640 1 --2- 10.20.193.4:0/1663445202 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f47201103f0 0x7f4720110860 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.158+0000 7f4725f41640 1 --2- 10.20.193.4:0/1663445202 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f472010f260 0x7f472010f650 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=2279049147501355352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.158+0000 7f4725f41640 1 -- 10.20.193.4:0/1663445202 >> 10.20.193.4:0/1663445202 conn(0x7f47200ec9f0 msgr2=0x7f472010ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.158+0000 7f4725f41640 1 -- 10.20.193.4:0/1663445202 shutdown_connections 2026-02-24T09:07:28.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.158+0000 7f4725f41640 1 -- 10.20.193.4:0/1663445202 wait complete. 2026-02-24T09:07:28.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f4725f41640 1 Processor -- start 2026-02-24T09:07:28.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f4725f41640 1 -- start start 2026-02-24T09:07:28.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f4725f41640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f472010f260 0x7f47200ee910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f4725f41640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47201103f0 0x7f4720171730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f471effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47201103f0 0x7f4720171730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f471effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47201103f0 0x7f4720171730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56510/0 (socket says 10.20.193.4:56510) 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f4725f41640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4720110da0 0x7f47200ef170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f471f7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f472010f260 0x7f47200ee910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f471ffff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4720110da0 0x7f47200ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f471effd640 1 -- 10.20.193.4:0/2646811436 learned_addr learned my addr 10.20.193.4:0/2646811436 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f47200efd60 con 0x7f47201103f0 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f47200efed0 con 0x7f4720110da0 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47200f0090 con 0x7f472010f260 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f471ffff640 1 -- 10.20.193.4:0/2646811436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f472010f260 msgr2=0x7f47200ee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.159+0000 7f471ffff640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f472010f260 0x7f47200ee910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7f471ffff640 1 -- 10.20.193.4:0/2646811436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47201103f0 msgr2=0x7f4720171730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7f471ffff640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47201103f0 0x7f4720171730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7f471ffff640 1 -- 10.20.193.4:0/2646811436 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c009570 con 0x7f4720110da0 2026-02-24T09:07:28.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7f471ffff640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4720110da0 0x7f47200ef170 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f471400e720 tx=0x7f471400ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7f471cff9640 1 -- 10.20.193.4:0/2646811436 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4714005500 con 0x7f4720110da0 2026-02-24T09:07:28.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7f471cff9640 1 -- 10.20.193.4:0/2646811436 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4714005660 con 0x7f4720110da0 2026-02-24T09:07:28.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47200f0370 con 0x7f4720110da0 2026-02-24T09:07:28.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7f471cff9640 1 -- 10.20.193.4:0/2646811436 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4714011460 con 0x7f4720110da0 2026-02-24T09:07:28.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47200f07b0 con 0x7f4720110da0 2026-02-24T09:07:28.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7ff320388640 1 -- 10.20.193.4:0/3227911776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff31810f260 msgr2=0x7ff31810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7ff320388640 1 --2- 10.20.193.4:0/3227911776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff31810f260 0x7ff31810f650 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=14798535213772565916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff308009890 tx=0x7ff30802f0e0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7ff320388640 1 -- 10.20.193.4:0/3227911776 shutdown_connections 2026-02-24T09:07:28.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7ff320388640 1 --2- 10.20.193.4:0/3227911776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff318110da0 0x7ff318171730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7ff320388640 1 --2- 10.20.193.4:0/3227911776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff3181103f0 0x7ff318110860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7ff320388640 1 --2- 10.20.193.4:0/3227911776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff31810f260 0x7ff31810f650 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=14798535213772565916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7ff320388640 1 -- 10.20.193.4:0/3227911776 >> 10.20.193.4:0/3227911776 conn(0x7ff3180ec9f0 msgr2=0x7ff31810ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7ff320388640 1 -- 10.20.193.4:0/3227911776 shutdown_connections 2026-02-24T09:07:28.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.160+0000 7ff320388640 1 -- 10.20.193.4:0/3227911776 wait complete. 2026-02-24T09:07:28.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.161+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4720175820 con 0x7f4720110da0 2026-02-24T09:07:28.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.161+0000 7f471f7fe640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f472010f260 0x7f47200ee910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:07:28.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.161+0000 7ff320388640 1 Processor -- start 2026-02-24T09:07:28.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.161+0000 7ff320388640 1 -- start start 2026-02-24T09:07:28.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff320388640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff31810f260 0x7ff3180f8930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7f471cff9640 1 -- 10.20.193.4:0/2646811436 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f471400c7e0 con 0x7f4720110da0 2026-02-24T09:07:28.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff320388640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3181103f0 0x7ff318171710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff320388640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff318110da0 0x7ff3180f9170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff320388640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff3180f9dd0 con 0x7ff3181103f0 2026-02-24T09:07:28.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31d8fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3181103f0 0x7ff318171710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff320388640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff3180f9f40 con 0x7ff318110da0 2026-02-24T09:07:28.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31d8fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3181103f0 0x7ff318171710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56516/0 (socket says 10.20.193.4:56516) 2026-02-24T09:07:28.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31d8fc640 1 -- 10.20.193.4:0/3260353127 learned_addr learned my addr 10.20.193.4:0/3260353127 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7f471cff9640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46f403f9d0 0x7f46f405fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3180fa100 con 0x7ff31810f260 2026-02-24T09:07:28.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31e8fe640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff318110da0 0x7ff3180f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7f471cff9640 1 -- 10.20.193.4:0/2646811436 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4714055340 con 0x7f4720110da0 2026-02-24T09:07:28.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31e0fd640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff31810f260 0x7ff3180f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31d8fc640 1 -- 10.20.193.4:0/3260353127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff31810f260 msgr2=0x7ff3180f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7f471f7fe640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46f403f9d0 0x7f46f405fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31d8fc640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff31810f260 0x7ff3180f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31d8fc640 1 -- 10.20.193.4:0/3260353127 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff318110da0 msgr2=0x7ff3180f9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31d8fc640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff318110da0 0x7ff3180f9170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31d8fc640 1 -- 10.20.193.4:0/3260353127 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3080094b0 con 0x7ff3181103f0 2026-02-24T09:07:28.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff31d8fc640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3181103f0 0x7ff318171710 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff30c009480 tx=0x7ff30c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff2ff7fe640 1 -- 10.20.193.4:0/3260353127 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff30c00ccd0 con 0x7ff3181103f0 2026-02-24T09:07:28.175 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:28.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff2ff7fe640 1 -- 10.20.193.4:0/3260353127 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff30c00ce30 con 0x7ff3181103f0 2026-02-24T09:07:28.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.162+0000 7ff2ff7fe640 1 -- 10.20.193.4:0/3260353127 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff30c0106b0 con 0x7ff3181103f0 2026-02-24T09:07:28.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.163+0000 7f471f7fe640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46f403f9d0 0x7f46f405fe80 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f470c0098a0 tx=0x7f470c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.163+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3180fa3e0 con 0x7ff3181103f0 2026-02-24T09:07:28.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.163+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3180fa860 con 0x7ff3181103f0 2026-02-24T09:07:28.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.163+0000 7ff2ff7fe640 1 -- 10.20.193.4:0/3260353127 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7ff30c01f060 con 0x7ff3181103f0 2026-02-24T09:07:28.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.164+0000 7ff2ff7fe640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f403f9d0 0x7ff2f405fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.164+0000 7ff2ff7fe640 1 -- 10.20.193.4:0/3260353127 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7ff30c014070 con 0x7ff3181103f0 2026-02-24T09:07:28.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.164+0000 7ff31e0fd640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f403f9d0 0x7ff2f405fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.164+0000 7ff31e0fd640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f403f9d0 0x7ff2f405fe80 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3080097e0 tx=0x7ff308031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.164+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff318175770 con 0x7ff3181103f0 2026-02-24T09:07:28.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.164+0000 7f471cff9640 1 -- 10.20.193.4:0/2646811436 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f47140186f0 con 0x7f4720110da0 2026-02-24T09:07:28.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.167+0000 7ff2ff7fe640 1 -- 10.20.193.4:0/3260353127 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff30c004b00 con 0x7ff3181103f0 2026-02-24T09:07:28.187 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:28.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.184+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f7200110860 con 0x7f720010f260 2026-02-24T09:07:28.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.187+0000 7f71eeffd640 1 -- 10.20.193.4:0/14706969 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v20)=0 v20) ==== 116+0+0 (secure 0 0 0) 0x7f71f007f0b0 con 0x7f720010f260 2026-02-24T09:07:28.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 -- 10.20.193.4:0/2107616839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f521814ed80 msgr2=0x7f521816f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 --2- 10.20.193.4:0/2107616839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f521814ed80 0x7f521816f230 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=11447183081063301217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f521400aa30 tx=0x7f5214030270 comp rx=0 tx=0).stop 2026-02-24T09:07:28.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 -- 10.20.193.4:0/2107616839 shutdown_connections 2026-02-24T09:07:28.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 --2- 10.20.193.4:0/2107616839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f521814ed80 0x7f521816f230 unknown :-1 s=CLOSED pgs=134 gs=1 cs=0 l=1 c_cookie=11447183081063301217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 --2- 10.20.193.4:0/2107616839 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f521812e280 0x7f521814e660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 --2- 10.20.193.4:0/2107616839 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f52180608c0 0x7f521812dd40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 -- 10.20.193.4:0/2107616839 >> 10.20.193.4:0/2107616839 conn(0x7f52180e96c0 msgr2=0x7f5218109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 -- 10.20.193.4:0/2107616839 shutdown_connections 2026-02-24T09:07:28.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 -- 10.20.193.4:0/2107616839 wait complete. 2026-02-24T09:07:28.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 Processor -- start 2026-02-24T09:07:28.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.190+0000 7f521f4a7640 1 -- start start 2026-02-24T09:07:28.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521f4a7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52180608c0 0x7f521814e660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521f4a7640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f521812e280 0x7f5218109aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521f4a7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f521814ed80 0x7f521812b8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521f4a7640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f521812bf60 con 0x7f52180608c0 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521f4a7640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f521812c0d0 con 0x7f521812e280 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521f4a7640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f521812c290 con 0x7f521814ed80 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521d21c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52180608c0 0x7f521814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521d21c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52180608c0 0x7f521814e660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56538/0 (socket says 10.20.193.4:56538) 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521d21c640 1 -- 10.20.193.4:0/2925286419 learned_addr learned my addr 10.20.193.4:0/2925286419 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521da1d640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f521814ed80 0x7f521812b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521ca1b640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f521812e280 0x7f5218109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521d21c640 1 -- 10.20.193.4:0/2925286419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f521814ed80 msgr2=0x7f521812b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521d21c640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f521814ed80 0x7f521812b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521d21c640 1 -- 10.20.193.4:0/2925286419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f521812e280 msgr2=0x7f5218109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521d21c640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f521812e280 0x7f5218109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521d21c640 1 -- 10.20.193.4:0/2925286419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521400a650 con 0x7f52180608c0 2026-02-24T09:07:28.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521d21c640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52180608c0 0x7f521814e660 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5208009480 tx=0x7f520800ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f52067fc640 1 -- 10.20.193.4:0/2925286419 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f520800cce0 con 0x7f52180608c0 2026-02-24T09:07:28.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.192+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71dc03f9d0 msgr2=0x7f71dc05fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.192+0000 7f7207aca640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71dc03f9d0 0x7f71dc05fe80 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71f4005970 tx=0x7f71f4005900 comp rx=0 tx=0).stop 2026-02-24T09:07:28.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.192+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f720010f260 msgr2=0x7f72000f8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.192+0000 7f7207aca640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f720010f260 0x7f72000f8960 secure :-1 s=READY pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71f0002d80 tx=0x7f71f00028d0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 shutdown_connections 2026-02-24T09:07:28.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f7207aca640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71dc03f9d0 0x7f71dc05fe80 unknown :-1 s=CLOSED pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f7207aca640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7200110da0 0x7f72000f91c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f7207aca640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72001103f0 0x7f7200171730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f7207aca640 1 --2- 10.20.193.4:0/14706969 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f720010f260 0x7f72000f8960 unknown :-1 s=CLOSED pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 >> 10.20.193.4:0/14706969 conn(0x7f72000ec9f0 msgr2=0x7f72000eef80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f521f4a7640 1 -- 10.20.193.4:0/2925286419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521812c570 con 0x7f52180608c0 2026-02-24T09:07:28.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f52067fc640 1 -- 10.20.193.4:0/2925286419 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f520800ce40 con 0x7f52180608c0 2026-02-24T09:07:28.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.191+0000 7f52067fc640 1 -- 10.20.193.4:0/2925286419 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52080106b0 con 0x7f52180608c0 2026-02-24T09:07:28.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.192+0000 7f521f4a7640 1 -- 10.20.193.4:0/2925286419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521812cac0 con 0x7f52180608c0 2026-02-24T09:07:28.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.192+0000 7f52067fc640 1 -- 10.20.193.4:0/2925286419 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f520801f060 con 0x7f52180608c0 2026-02-24T09:07:28.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f52067fc640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51f403f9d0 0x7f51f405fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f52067fc640 1 -- 10.20.193.4:0/2925286419 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f5208014070 con 0x7f52180608c0 2026-02-24T09:07:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f521ca1b640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51f403f9d0 0x7f51f405fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f521ca1b640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51f403f9d0 0x7f51f405fe80 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f520c004740 tx=0x7f520c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f521f4a7640 1 -- 10.20.193.4:0/2925286419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5218062010 con 0x7f52180608c0 2026-02-24T09:07:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 shutdown_connections 2026-02-24T09:07:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.193+0000 7f7207aca640 1 -- 10.20.193.4:0/14706969 wait complete. 2026-02-24T09:07:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.198+0000 7f52067fc640 1 -- 10.20.193.4:0/2925286419 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f520805a060 con 0x7f52180608c0 2026-02-24T09:07:28.212 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:28.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.219+0000 7f59d9a15640 1 -- 10.20.193.4:0/381251806 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59d4114b90 msgr2=0x7f59d4115000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.219+0000 7f59d9a15640 1 --2- 10.20.193.4:0/381251806 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59d4114b90 0x7f59d4115000 secure :-1 s=READY pgs=136 gs=2 cs=0 l=1 c_cookie=15792007743756892517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59c4009890 tx=0x7f59c402f160 comp rx=0 tx=0).stop 2026-02-24T09:07:28.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.219+0000 7f59d9a15640 1 -- 10.20.193.4:0/381251806 shutdown_connections 2026-02-24T09:07:28.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.219+0000 7f59d9a15640 1 --2- 10.20.193.4:0/381251806 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59d4115540 0x7f59d41159c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.219+0000 7f59d9a15640 1 --2- 10.20.193.4:0/381251806 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59d4114b90 0x7f59d4115000 unknown :-1 s=CLOSED pgs=136 gs=2 cs=0 l=1 c_cookie=15792007743756892517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.219+0000 7f59d9a15640 1 --2- 10.20.193.4:0/381251806 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59d405e570 0x7f59d4114650 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.219+0000 7f59d9a15640 1 -- 10.20.193.4:0/381251806 >> 10.20.193.4:0/381251806 conn(0x7f59d405b580 msgr2=0x7f59d405b980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.221+0000 7f59d9a15640 1 -- 10.20.193.4:0/381251806 shutdown_connections 2026-02-24T09:07:28.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.221+0000 7f59d9a15640 1 -- 10.20.193.4:0/381251806 wait complete. 2026-02-24T09:07:28.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d9a15640 1 Processor -- start 2026-02-24T09:07:28.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d9a15640 1 -- start start 2026-02-24T09:07:28.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d9a15640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59d405e570 0x7f59d41b4ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d9a15640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59d4115540 0x7f59d41b52f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f2e439b2640 1 -- 10.20.193.4:0/121478070 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f2e3c063190 con 0x7f2e3c062b40 2026-02-24T09:07:28.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d2ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59d405e570 0x7f59d41b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d2ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59d405e570 0x7f59d41b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:46000/0 (socket says 10.20.193.4:46000) 2026-02-24T09:07:28.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d2ffd640 1 -- 10.20.193.4:0/951877145 learned_addr learned my addr 10.20.193.4:0/951877145 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d9a15640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59d41b5ef0 0x7f59d41b6390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f59d41b6a00 con 0x7f59d41b5ef0 2026-02-24T09:07:28.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f59d41b6b70 con 0x7f59d4115540 2026-02-24T09:07:28.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59d41b6d30 con 0x7f59d405e570 2026-02-24T09:07:28.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.222+0000 7f59d37fe640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59d41b5ef0 0x7f59d41b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59ca5ff640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59d4115540 0x7f59d41b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d37fe640 1 -- 10.20.193.4:0/951877145 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59d405e570 msgr2=0x7f59d41b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d37fe640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59d405e570 0x7f59d41b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d37fe640 1 -- 10.20.193.4:0/951877145 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59d4115540 msgr2=0x7f59d41b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d37fe640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59d4115540 0x7f59d41b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d37fe640 1 -- 10.20.193.4:0/951877145 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c40094b0 con 0x7f59d41b5ef0 2026-02-24T09:07:28.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d37fe640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59d41b5ef0 0x7f59d41b6390 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59cc00faa0 tx=0x7f59cc00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f3bf1d63640 1 -- 10.20.193.4:0/3926477984 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3bec060150 msgr2=0x7f3bec060ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f3bf1d63640 1 --2- 10.20.193.4:0/3926477984 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3bec060150 0x7f3bec060ab0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=3394523765966153294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3be400aa30 tx=0x7f3be4030290 comp rx=0 tx=0).stop 2026-02-24T09:07:28.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d8a13640 1 -- 10.20.193.4:0/951877145 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59cc00dd80 con 0x7f59d41b5ef0 2026-02-24T09:07:28.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d8a13640 1 -- 10.20.193.4:0/951877145 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f59cc005e10 con 0x7f59d41b5ef0 2026-02-24T09:07:28.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d8a13640 1 -- 10.20.193.4:0/951877145 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59cc004bc0 con 0x7f59d41b5ef0 2026-02-24T09:07:28.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d42170b0 con 0x7f59d41b5ef0 2026-02-24T09:07:28.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d4217550 con 0x7f59d41b5ef0 2026-02-24T09:07:28.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f3bf1d63640 1 -- 10.20.193.4:0/3926477984 shutdown_connections 2026-02-24T09:07:28.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f3bf1d63640 1 --2- 10.20.193.4:0/3926477984 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3bec060150 0x7f3bec060ab0 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=3394523765966153294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f3bf1d63640 1 --2- 10.20.193.4:0/3926477984 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3bec05f7a0 0x7f3bec05fc10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f3bf1d63640 1 --2- 10.20.193.4:0/3926477984 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bec05de20 0x7f3bec05e210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.223+0000 7f3bf1d63640 1 -- 10.20.193.4:0/3926477984 >> 10.20.193.4:0/3926477984 conn(0x7f3bec05b580 msgr2=0x7f3bec05b980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3bf1d63640 1 -- 10.20.193.4:0/3926477984 shutdown_connections 2026-02-24T09:07:28.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3bf1d63640 1 -- 10.20.193.4:0/3926477984 wait complete. 2026-02-24T09:07:28.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3bf1d63640 1 Processor -- start 2026-02-24T09:07:28.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f59d8a13640 1 -- 10.20.193.4:0/951877145 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f59cc005930 con 0x7f59d41b5ef0 2026-02-24T09:07:28.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f59d8a13640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59a403f9d0 0x7f59a405fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f59d8a13640 1 -- 10.20.193.4:0/951877145 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f59cc015070 con 0x7f59d41b5ef0 2026-02-24T09:07:28.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d4119e00 con 0x7f59d41b5ef0 2026-02-24T09:07:28.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f59d2ffd640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59a403f9d0 0x7f59a405fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f59d2ffd640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59a403f9d0 0x7f59a405fe80 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59bc006f30 tx=0x7f59bc009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3bf1d63640 1 -- start start 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3bf1d63640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bec05de20 0x7f3bec105c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3bf1d63640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3bec05f7a0 0x7f3bec1062c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3bf1d63640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3bec060150 0x7f3bec106b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3bf1d63640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec107240 con 0x7f3bec05f7a0 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3bf1d63640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec1073b0 con 0x7f3bec060150 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3bf1d63640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec107570 con 0x7f3bec05de20 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3beb7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bec05de20 0x7f3bec105c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3beb7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bec05de20 0x7f3bec105c70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:46014/0 (socket says 10.20.193.4:46014) 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3beb7fe640 1 -- 10.20.193.4:0/4134353899 learned_addr learned my addr 10.20.193.4:0/4134353899 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.224+0000 7f3beaffd640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3bec05f7a0 0x7f3bec1062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3bebfff640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3bec060150 0x7f3bec106b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3beb7fe640 1 -- 10.20.193.4:0/4134353899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3bec060150 msgr2=0x7f3bec106b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3beb7fe640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3bec060150 0x7f3bec106b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3beb7fe640 1 -- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3bec05f7a0 msgr2=0x7f3bec1062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3beb7fe640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3bec05f7a0 0x7f3bec1062c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3beb7fe640 1 -- 10.20.193.4:0/4134353899 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be400a650 con 0x7f3bec05de20 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3bebfff640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3bec060150 0x7f3bec106b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3beaffd640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3bec05f7a0 0x7f3bec1062c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3beb7fe640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bec05de20 0x7f3bec105c70 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bdc00d950 tx=0x7f3bdc00de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3be8ff9640 1 -- 10.20.193.4:0/4134353899 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bdc004540 con 0x7f3bec05de20 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3be8ff9640 1 -- 10.20.193.4:0/4134353899 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3bdc009d00 con 0x7f3bec05de20 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3be8ff9640 1 -- 10.20.193.4:0/4134353899 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bdc0106e0 con 0x7f3bec05de20 2026-02-24T09:07:28.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3bf1d63640 1 -- 10.20.193.4:0/4134353899 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bec107850 con 0x7f3bec05de20 2026-02-24T09:07:28.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.225+0000 7f3bf1d63640 1 -- 10.20.193.4:0/4134353899 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bec107db0 con 0x7f3bec05de20 2026-02-24T09:07:28.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.226+0000 7f3be8ff9640 1 -- 10.20.193.4:0/4134353899 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f3bdc010870 con 0x7f3bec05de20 2026-02-24T09:07:28.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.226+0000 7f3be8ff9640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3bc803fa20 0x7f3bc805fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.226+0000 7f3be8ff9640 1 -- 10.20.193.4:0/4134353899 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f3bdc054570 con 0x7f3bec05de20 2026-02-24T09:07:28.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.226+0000 7f3beaffd640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3bc803fa20 0x7f3bc805fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.227+0000 7f3beaffd640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3bc803fa20 0x7f3bc805fed0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3be0004780 tx=0x7f3be0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.227+0000 7f59d8a13640 1 -- 10.20.193.4:0/951877145 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f59cc006710 con 0x7f59d41b5ef0 2026-02-24T09:07:28.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.228+0000 7f3bf1d63640 1 -- 10.20.193.4:0/4134353899 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bec064c10 con 0x7f3bec05de20 2026-02-24T09:07:28.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.231+0000 7f3be8ff9640 1 -- 10.20.193.4:0/4134353899 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3bdc021730 con 0x7f3bec05de20 2026-02-24T09:07:28.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.236+0000 7f2e2a7fc640 1 -- 10.20.193.4:0/121478070 <== mon.2 v2:10.20.193.14:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v21)=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7f2e3000e360 con 0x7f2e3c062b40 2026-02-24T09:07:28.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.238+0000 7f2e439b2640 1 -- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e1803f950 msgr2=0x7f2e1805fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.238+0000 7f2e439b2640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e1803f950 0x7f2e1805fe00 secure :-1 s=READY pgs=56 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e2c02f6c0 tx=0x7f2e2c002390 comp rx=0 tx=0).stop 2026-02-24T09:07:28.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.238+0000 7f2e439b2640 1 -- 10.20.193.4:0/121478070 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e3c062b40 msgr2=0x7f2e3c0f7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.238+0000 7f2e439b2640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e3c062b40 0x7f2e3c0f7280 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e3000b520 tx=0x7f2e3000b9f0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.239+0000 7f2e439b2640 1 -- 10.20.193.4:0/121478070 shutdown_connections 2026-02-24T09:07:28.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.239+0000 7f2e439b2640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e1803f950 0x7f2e1805fe00 unknown :-1 s=CLOSED pgs=56 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.239+0000 7f2e439b2640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e3c10cc90 0x7f2e3c0f7e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.239+0000 7f2e439b2640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e3c062b40 0x7f2e3c0f7280 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.239+0000 7f2e439b2640 1 --2- 10.20.193.4:0/121478070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e3c061610 0x7f2e3c0f6c30 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.239+0000 7f2e439b2640 1 -- 10.20.193.4:0/121478070 >> 10.20.193.4:0/121478070 conn(0x7f2e3c0ea860 msgr2=0x7f2e3c0ed2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.239+0000 7f2e439b2640 1 -- 10.20.193.4:0/121478070 shutdown_connections 2026-02-24T09:07:28.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.239+0000 7f2e439b2640 1 -- 10.20.193.4:0/121478070 wait complete. 2026-02-24T09:07:28.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.276+0000 7fc22cb22640 1 -- 10.20.193.4:0/3638424708 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc224030cf0 con 0x7fc22810ebb0 2026-02-24T09:07:28.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.277+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3638424708 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc22810ebb0 msgr2=0x7fc22816f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.277+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3638424708 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc22810ebb0 0x7fc22816f540 secure :-1 s=READY pgs=139 gs=1 cs=0 l=1 c_cookie=1878527696427174023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc22400a970 tx=0x7fc2240301b0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.277+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3638424708 shutdown_connections 2026-02-24T09:07:28.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.277+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3638424708 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc22810ebb0 0x7fc22816f540 unknown :-1 s=CLOSED pgs=139 gs=1 cs=0 l=1 c_cookie=1878527696427174023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.277+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3638424708 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc22810e200 0x7fc22810e670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.277+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3638424708 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc22810d070 0x7fc22810d460 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.277+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3638424708 >> 10.20.193.4:0/3638424708 conn(0x7fc2280ea7a0 msgr2=0x7fc22810abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.277+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3638424708 shutdown_connections 2026-02-24T09:07:28.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.277+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3638424708 wait complete. 2026-02-24T09:07:28.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.278+0000 7fc22fdaf640 1 Processor -- start 2026-02-24T09:07:28.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.278+0000 7fc22fdaf640 1 -- start start 2026-02-24T09:07:28.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.278+0000 7fc22fdaf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc22810d070 0x7fc2280f88b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.278+0000 7fc22fdaf640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc22810e200 0x7fc22816f540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.278+0000 7fc22db24640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc22810d070 0x7fc2280f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.278+0000 7fc22db24640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc22810d070 0x7fc2280f88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56590/0 (socket says 10.20.193.4:56590) 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.278+0000 7fc22db24640 1 -- 10.20.193.4:0/3181437839 learned_addr learned my addr 10.20.193.4:0/3181437839 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.278+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc22810ebb0 0x7fc2280f9110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fc2280f9d00 con 0x7fc22810d070 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fc2280f9e70 con 0x7fc22810e200 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc2280fa030 con 0x7fc22810ebb0 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22db24640 1 -- 10.20.193.4:0/3181437839 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc22810ebb0 msgr2=0x7fc2280f9110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22db24640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc22810ebb0 0x7fc2280f9110 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22db24640 1 -- 10.20.193.4:0/3181437839 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc22810e200 msgr2=0x7fc22816f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22db24640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc22810e200 0x7fc22816f540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22db24640 1 -- 10.20.193.4:0/3181437839 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22400a590 con 0x7fc22810d070 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22db24640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc22810d070 0x7fc2280f88b0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc21800e9c0 tx=0x7fc21800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc216ffd640 1 -- 10.20.193.4:0/3181437839 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc21800cd70 con 0x7fc22810d070 2026-02-24T09:07:28.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2280fa310 con 0x7fc22810d070 2026-02-24T09:07:28.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc216ffd640 1 -- 10.20.193.4:0/3181437839 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc218004d30 con 0x7fc22810d070 2026-02-24T09:07:28.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.279+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2280fa830 con 0x7fc22810d070 2026-02-24T09:07:28.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.281+0000 7fc216ffd640 1 -- 10.20.193.4:0/3181437839 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc21800cd70 con 0x7fc22810d070 2026-02-24T09:07:28.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.281+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2281734a0 con 0x7fc22810d070 2026-02-24T09:07:28.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.286+0000 7fc216ffd640 1 -- 10.20.193.4:0/3181437839 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7fc218004770 con 0x7fc22810d070 2026-02-24T09:07:28.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.286+0000 7fc216ffd640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc20403fa90 0x7fc20405ff40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.286+0000 7fc216ffd640 1 -- 10.20.193.4:0/3181437839 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fc218014070 con 0x7fc22810d070 2026-02-24T09:07:28.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.286+0000 7fc22d323640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc20403fa90 0x7fc20405ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.287+0000 7fc216ffd640 1 -- 10.20.193.4:0/3181437839 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc218021940 con 0x7fc22810d070 2026-02-24T09:07:28.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.287+0000 7fc22d323640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc20403fa90 0x7fc20405ff40 secure :-1 s=READY pgs=64 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc21c004740 tx=0x7fc21c009690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.290+0000 7fcc720e5640 1 -- 10.20.193.4:0/1483895436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc6c10c8a0 msgr2=0x7fcc6c10d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.290+0000 7fcc720e5640 1 --2- 10.20.193.4:0/1483895436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc6c10c8a0 0x7fcc6c10d370 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=15497134823759990336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc6000aa80 tx=0x7fcc60030310 comp rx=0 tx=0).stop 2026-02-24T09:07:28.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.290+0000 7fcc720e5640 1 -- 10.20.193.4:0/1483895436 shutdown_connections 2026-02-24T09:07:28.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.290+0000 7fcc720e5640 1 --2- 10.20.193.4:0/1483895436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc6c10c8a0 0x7fcc6c10d370 unknown :-1 s=CLOSED pgs=141 gs=1 cs=0 l=1 c_cookie=15497134823759990336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.290+0000 7fcc720e5640 1 --2- 10.20.193.4:0/1483895436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc6c10bcf0 0x7fcc6c10c160 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.290+0000 7fcc720e5640 1 --2- 10.20.193.4:0/1483895436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc6c10b2c0 0x7fcc6c10b6b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.290+0000 7fcc720e5640 1 -- 10.20.193.4:0/1483895436 >> 10.20.193.4:0/1483895436 conn(0x7fcc6c0e8e20 msgr2=0x7fcc6c109230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.290+0000 7fcc720e5640 1 -- 10.20.193.4:0/1483895436 shutdown_connections 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.290+0000 7fcc720e5640 1 -- 10.20.193.4:0/1483895436 wait complete. 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc720e5640 1 Processor -- start 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc720e5640 1 -- start start 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc720e5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc6c10b2c0 0x7fcc6c0fca90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc720e5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc6c10bcf0 0x7fcc6c0fd0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc720e5640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc6c10c8a0 0x7fcc6c0fdce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc720e5640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c0fe420 con 0x7fcc6c10b2c0 2026-02-24T09:07:28.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc720e5640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c0fe590 con 0x7fcc6c10c8a0 2026-02-24T09:07:28.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc720e5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c0fe750 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7f16668e7640 1 -- 10.20.193.4:0/727159213 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f166010b410 msgr2=0x7f166010b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7f16668e7640 1 --2- 10.20.193.4:0/727159213 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f166010b410 0x7f166010b800 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=9457204786227106946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1650009950 tx=0x7f165002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6affd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc6c10bcf0 0x7fcc6c0fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6affd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc6c10bcf0 0x7fcc6c0fd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:46040/0 (socket says 10.20.193.4:46040) 2026-02-24T09:07:28.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6affd640 1 -- 10.20.193.4:0/3722194875 learned_addr learned my addr 10.20.193.4:0/3722194875 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6bfff640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc6c10c8a0 0x7fcc6c0fdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6b7fe640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc6c10b2c0 0x7fcc6c0fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7f16668e7640 1 -- 10.20.193.4:0/727159213 shutdown_connections 2026-02-24T09:07:28.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7f16668e7640 1 --2- 10.20.193.4:0/727159213 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f166014ed80 0x7f166016f230 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7f16668e7640 1 --2- 10.20.193.4:0/727159213 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f166010be20 0x7f166014e640 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7f16668e7640 1 --2- 10.20.193.4:0/727159213 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f166010b410 0x7f166010b800 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=9457204786227106946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7f16668e7640 1 -- 10.20.193.4:0/727159213 >> 10.20.193.4:0/727159213 conn(0x7f16600e8e20 msgr2=0x7f1660109230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6affd640 1 -- 10.20.193.4:0/3722194875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc6c10c8a0 msgr2=0x7fcc6c0fdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6affd640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc6c10c8a0 0x7fcc6c0fdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6affd640 1 -- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc6c10b2c0 msgr2=0x7fcc6c0fca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6affd640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc6c10b2c0 0x7fcc6c0fca90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6affd640 1 -- 10.20.193.4:0/3722194875 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6000a650 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.291+0000 7fcc6bfff640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc6c10c8a0 0x7fcc6c0fdce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:07:28.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7fcc6b7fe640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc6c10b2c0 0x7fcc6c0fca90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:07:28.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7f16668e7640 1 -- 10.20.193.4:0/727159213 shutdown_connections 2026-02-24T09:07:28.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7fcc6affd640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc6c10bcf0 0x7fcc6c0fd0e0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc5c00b520 tx=0x7fcc5c00b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7fcc68ff9640 1 -- 10.20.193.4:0/3722194875 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc5c0044a0 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7fcc720e5640 1 -- 10.20.193.4:0/3722194875 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c0fea30 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7fcc68ff9640 1 -- 10.20.193.4:0/3722194875 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc5c002c20 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7fcc68ff9640 1 -- 10.20.193.4:0/3722194875 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc5c00fd90 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7fcc720e5640 1 -- 10.20.193.4:0/3722194875 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c0fef50 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.302 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.303 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.303 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.303 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.303 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.292+0000 7f16668e7640 1 -- 10.20.193.4:0/727159213 wait complete. 2026-02-24T09:07:28.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7fcc720e5640 1 -- 10.20.193.4:0/3722194875 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6c111430 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7fcc68ff9640 1 -- 10.20.193.4:0/3722194875 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7fcc5c018400 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7fcc68ff9640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc4003f9d0 0x7fcc4005fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7fcc68ff9640 1 -- 10.20.193.4:0/3722194875 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fcc5c053c90 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f16668e7640 1 Processor -- start 2026-02-24T09:07:28.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f16668e7640 1 -- start start 2026-02-24T09:07:28.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f16668e7640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f166010b410 0x7f166016f210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f16668e7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f166010be20 0x7f1660109200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f16668e7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f166014ed80 0x7f166010dcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7fcc6b7fe640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc4003f9d0 0x7fcc4005fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f16668e7640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f166010e480 con 0x7f166014ed80 2026-02-24T09:07:28.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f16668e7640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f166010c520 con 0x7f166010b410 2026-02-24T09:07:28.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f16668e7640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f166010c6e0 con 0x7f166010be20 2026-02-24T09:07:28.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f1664e5d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f166014ed80 0x7f166010dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f165ffff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f166010b410 0x7f166016f210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f165ffff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f166010b410 0x7f166016f210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:43386/0 (socket says 10.20.193.4:43386) 2026-02-24T09:07:28.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.293+0000 7f165ffff640 1 -- 10.20.193.4:0/4020548321 learned_addr learned my addr 10.20.193.4:0/4020548321 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7fcc6b7fe640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc4003f9d0 0x7fcc4005fe80 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc58004780 tx=0x7fcc58009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f2f5601f640 1 -- 10.20.193.4:0/3756215298 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f2f5010d2f0 con 0x7f2f5010cea0 2026-02-24T09:07:28.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f1664e5d640 1 -- 10.20.193.4:0/4020548321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f166010be20 msgr2=0x7f1660109200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T09:07:28.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f1664e5d640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f166010be20 0x7f1660109200 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f1664e5d640 1 -- 10.20.193.4:0/4020548321 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f166010b410 msgr2=0x7f166016f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f1664e5d640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f166010b410 0x7f166016f210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f1664e5d640 1 -- 10.20.193.4:0/4020548321 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1650009570 con 0x7f166014ed80 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f165ffff640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f166010b410 0x7f166016f210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f1664e5d640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f166014ed80 0x7f166010dcf0 secure :-1 s=READY pgs=143 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f165400c470 tx=0x7f165400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f165d7fa640 1 -- 10.20.193.4:0/4020548321 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16540054a0 con 0x7f166014ed80 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f16668e7640 1 -- 10.20.193.4:0/4020548321 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166010c9c0 con 0x7f166014ed80 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f16668e7640 1 -- 10.20.193.4:0/4020548321 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166010cee0 con 0x7f166014ed80 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f165d7fa640 1 -- 10.20.193.4:0/4020548321 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1654005600 con 0x7f166014ed80 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.294+0000 7f165d7fa640 1 -- 10.20.193.4:0/4020548321 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1654011d80 con 0x7f166014ed80 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.295+0000 7f16668e7640 1 -- 10.20.193.4:0/4020548321 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1624005300 con 0x7f166014ed80 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.295+0000 7f165d7fa640 1 -- 10.20.193.4:0/4020548321 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f165401b460 con 0x7f166014ed80 2026-02-24T09:07:28.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.295+0000 7f165d7fa640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f163403f9d0 0x7f163405fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.295+0000 7f165d7fa640 1 -- 10.20.193.4:0/4020548321 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f16540548f0 con 0x7f166014ed80 2026-02-24T09:07:28.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.295+0000 7f165ffff640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f163403f9d0 0x7f163405fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.296+0000 7f165ffff640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f163403f9d0 0x7f163405fe80 secure :-1 s=READY pgs=66 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1650038820 tx=0x7f165003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.296+0000 7fcc68ff9640 1 -- 10.20.193.4:0/3722194875 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fcc5c0152c0 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.299+0000 7f165d7fa640 1 -- 10.20.193.4:0/4020548321 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f165401a840 con 0x7f166014ed80 2026-02-24T09:07:28.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.302+0000 7f2f4cff9640 1 -- 10.20.193.4:0/3756215298 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f2f3c017ba0 con 0x7f2f5010cea0 2026-02-24T09:07:28.313 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 -- 10.20.193.4:0/3756215298 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f2403f9d0 msgr2=0x7f2f2405fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f2403f9d0 0x7f2f2405fe80 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f40004740 tx=0x7f2f40005f90 comp rx=0 tx=0).stop 2026-02-24T09:07:28.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 -- 10.20.193.4:0/3756215298 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f5010cea0 msgr2=0x7f2f500f7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f5010cea0 0x7f2f500f7170 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f3c00b500 tx=0x7f2f3c00b9d0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 -- 10.20.193.4:0/3756215298 shutdown_connections 2026-02-24T09:07:28.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f2403f9d0 0x7f2f2405fe80 unknown :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f5010e610 0x7f2f500f79d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010d850 0x7f2f5016f5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 --2- 10.20.193.4:0/3756215298 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f5010cea0 0x7f2f500f7170 unknown :-1 s=CLOSED pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 -- 10.20.193.4:0/3756215298 >> 10.20.193.4:0/3756215298 conn(0x7f2f500ea860 msgr2=0x7f2f500ed790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 -- 10.20.193.4:0/3756215298 shutdown_connections 2026-02-24T09:07:28.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.306+0000 7f2f5601f640 1 -- 10.20.193.4:0/3756215298 wait complete. 2026-02-24T09:07:28.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.311+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f472005f470 con 0x7f4720110da0 2026-02-24T09:07:28.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.315+0000 7f471cff9640 1 -- 10.20.193.4:0/2646811436 <== mon.2 v2:10.20.193.14:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f47140193b0 con 0x7f4720110da0 2026-02-24T09:07:28.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.315+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fdfd010d860 con 0x7fdfd010c680 2026-02-24T09:07:28.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.315+0000 7fdb238ef640 1 -- 10.20.193.4:0/3266549771 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdb1c10c990 msgr2=0x7fdb1c10ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.315+0000 7fdb238ef640 1 --2- 10.20.193.4:0/3266549771 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdb1c10c990 0x7fdb1c10ce30 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=16640783220082061245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb1800a970 tx=0x7fdb180301b0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.316+0000 7fdb238ef640 1 -- 10.20.193.4:0/3266549771 shutdown_connections 2026-02-24T09:07:28.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.316+0000 7fdb238ef640 1 --2- 10.20.193.4:0/3266549771 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdb1c10c990 0x7fdb1c10ce30 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=16640783220082061245 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.316+0000 7fdb238ef640 1 --2- 10.20.193.4:0/3266549771 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdb1c10bfe0 0x7fdb1c10c450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.316+0000 7fdb238ef640 1 --2- 10.20.193.4:0/3266549771 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb1c0607b0 0x7fdb1c10baa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.316+0000 7fdb238ef640 1 -- 10.20.193.4:0/3266549771 >> 10.20.193.4:0/3266549771 conn(0x7fdb1c0e96c0 msgr2=0x7fdb1c109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.316+0000 7fdb238ef640 1 -- 10.20.193.4:0/3266549771 shutdown_connections 2026-02-24T09:07:28.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.316+0000 7fdb238ef640 1 -- 10.20.193.4:0/3266549771 wait complete. 2026-02-24T09:07:28.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb238ef640 1 Processor -- start 2026-02-24T09:07:28.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb238ef640 1 -- start start 2026-02-24T09:07:28.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb238ef640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdb1c0607b0 0x7fdb1c0f50a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb238ef640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb1c10bfe0 0x7fdb1c0f56f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb238ef640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdb1c10c990 0x7fdb1c0f62f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb238ef640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c0f6a30 con 0x7fdb1c0607b0 2026-02-24T09:07:28.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb238ef640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c0f6ba0 con 0x7fdb1c10c990 2026-02-24T09:07:28.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb238ef640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c0f6d60 con 0x7fdb1c10bfe0 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb21664640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdb1c0607b0 0x7fdb1c0f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb20e63640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb1c10bfe0 0x7fdb1c0f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb21664640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdb1c0607b0 0x7fdb1c0f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56652/0 (socket says 10.20.193.4:56652) 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb21664640 1 -- 10.20.193.4:0/2346945916 learned_addr learned my addr 10.20.193.4:0/2346945916 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb20e63640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb1c10bfe0 0x7fdb1c0f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:46066/0 (socket says 10.20.193.4:46066) 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb21e65640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdb1c10c990 0x7fdb1c0f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb21664640 1 -- 10.20.193.4:0/2346945916 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb1c10bfe0 msgr2=0x7fdb1c0f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb21664640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb1c10bfe0 0x7fdb1c0f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb21664640 1 -- 10.20.193.4:0/2346945916 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdb1c10c990 msgr2=0x7fdb1c0f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb21664640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdb1c10c990 0x7fdb1c0f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb21664640 1 -- 10.20.193.4:0/2346945916 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1800a590 con 0x7fdb1c0607b0 2026-02-24T09:07:28.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.317+0000 7fdb21664640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdb1c0607b0 0x7fdb1c0f50a0 secure :-1 s=READY pgs=144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb0c00e9c0 tx=0x7fdb0c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.318+0000 7fdfaffff640 1 -- 10.20.193.4:0/3712150437 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v24)=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fdfb8017760 con 0x7fdfd010c680 2026-02-24T09:07:28.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.318+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46f403f9d0 msgr2=0x7f46f405fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.318+0000 7f4725f41640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46f403f9d0 0x7f46f405fe80 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f470c0098a0 tx=0x7f470c031040 comp rx=0 tx=0).stop 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.318+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4720110da0 msgr2=0x7f47200ef170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.318+0000 7f4725f41640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4720110da0 0x7f47200ef170 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f471400e720 tx=0x7f471400ebf0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.318+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 shutdown_connections 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.318+0000 7f4725f41640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46f403f9d0 0x7f46f405fe80 unknown :-1 s=CLOSED pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.318+0000 7f4725f41640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4720110da0 0x7f47200ef170 unknown :-1 s=CLOSED pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.318+0000 7f4725f41640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47201103f0 0x7f4720171730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.318+0000 7f4725f41640 1 --2- 10.20.193.4:0/2646811436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f472010f260 0x7f47200ee910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.319+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 >> 10.20.193.4:0/2646811436 conn(0x7f47200ec9f0 msgr2=0x7f4720064470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.319+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 shutdown_connections 2026-02-24T09:07:28.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.319+0000 7f4725f41640 1 -- 10.20.193.4:0/2646811436 wait complete. 2026-02-24T09:07:28.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.319+0000 7fdb0a7fc640 1 -- 10.20.193.4:0/2346945916 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb0c00ccb0 con 0x7fdb1c0607b0 2026-02-24T09:07:28.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.319+0000 7fdb0a7fc640 1 -- 10.20.193.4:0/2346945916 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb0c00ce10 con 0x7fdb1c0607b0 2026-02-24T09:07:28.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.319+0000 7fdb238ef640 1 -- 10.20.193.4:0/2346945916 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1c0f7040 con 0x7fdb1c0607b0 2026-02-24T09:07:28.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.319+0000 7fdb238ef640 1 -- 10.20.193.4:0/2346945916 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1c0f75c0 con 0x7fdb1c0607b0 2026-02-24T09:07:28.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.320+0000 7fbfe6fde640 1 -- 10.20.193.4:0/3624619675 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbfe010b2c0 msgr2=0x7fbfe010b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.320+0000 7fbfe6fde640 1 --2- 10.20.193.4:0/3624619675 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbfe010b2c0 0x7fbfe010b6b0 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=16934723399027157894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfd000aa30 tx=0x7fbfd0030280 comp rx=0 tx=0).stop 2026-02-24T09:07:28.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.320+0000 7fdb0a7fc640 1 -- 10.20.193.4:0/2346945916 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb0c010690 con 0x7fdb1c0607b0 2026-02-24T09:07:28.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.320+0000 7fdb0a7fc640 1 -- 10.20.193.4:0/2346945916 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7fdb0c01f060 con 0x7fdb1c0607b0 2026-02-24T09:07:28.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.320+0000 7fdb0a7fc640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdaf803f9d0 0x7fdaf805fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fbfe6fde640 1 -- 10.20.193.4:0/3624619675 shutdown_connections 2026-02-24T09:07:28.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fbfe6fde640 1 --2- 10.20.193.4:0/3624619675 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbfe010c8a0 0x7fbfe010d370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fbfe6fde640 1 --2- 10.20.193.4:0/3624619675 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbfe010bcf0 0x7fbfe010c160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fbfe6fde640 1 --2- 10.20.193.4:0/3624619675 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbfe010b2c0 0x7fbfe010b6b0 unknown :-1 s=CLOSED pgs=145 gs=1 cs=0 l=1 c_cookie=16934723399027157894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fdb0a7fc640 1 -- 10.20.193.4:0/2346945916 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fdb0c014070 con 0x7fdb1c0607b0 2026-02-24T09:07:28.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fdb238ef640 1 -- 10.20.193.4:0/2346945916 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1c175660 con 0x7fdb1c0607b0 2026-02-24T09:07:28.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fdb20e63640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdaf803f9d0 0x7fdaf805fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fbfe6fde640 1 -- 10.20.193.4:0/3624619675 >> 10.20.193.4:0/3624619675 conn(0x7fbfe00e8e20 msgr2=0x7fbfe0109230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fbfe6fde640 1 -- 10.20.193.4:0/3624619675 shutdown_connections 2026-02-24T09:07:28.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fbfe6fde640 1 -- 10.20.193.4:0/3624619675 wait complete. 2026-02-24T09:07:28.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.321+0000 7fdb20e63640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdaf803f9d0 0x7fdaf805fe80 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb10004740 tx=0x7fdb10005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fbfe6fde640 1 Processor -- start 2026-02-24T09:07:28.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fbfe6fde640 1 -- start start 2026-02-24T09:07:28.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fbfe6fde640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbfe010b2c0 0x7fbfe00f3e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fbfe6fde640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbfe010bcf0 0x7fbfe00f44a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfa403f9a0 msgr2=0x7fdfa405fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fdfd5193640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfa403f9a0 0x7fdfa405fe50 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfc4006f30 tx=0x7fdfc4008040 comp rx=0 tx=0).stop 2026-02-24T09:07:28.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fbfe6fde640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbfe010c8a0 0x7fbfe00f5050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fbfe4d53640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbfe010b2c0 0x7fbfe00f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fbfe4d53640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbfe010b2c0 0x7fbfe00f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56672/0 (socket says 10.20.193.4:56672) 2026-02-24T09:07:28.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfd010c680 msgr2=0x7fdfd016e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fdfd5193640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfd010c680 0x7fdfd016e410 secure :-1 s=READY pgs=130 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfb8004740 tx=0x7fdfb800eef0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fbfe4d53640 1 -- 10.20.193.4:0/731025632 learned_addr learned my addr 10.20.193.4:0/731025632 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.322+0000 7fbfe6fde640 1 -- 10.20.193.4:0/731025632 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe00f5790 con 0x7fbfe010b2c0 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.323+0000 7fbfe5554640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbfe010c8a0 0x7fbfe00f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.323+0000 7fbfe6fde640 1 -- 10.20.193.4:0/731025632 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe00f5900 con 0x7fbfe010c8a0 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.323+0000 7fbfe6fde640 1 -- 10.20.193.4:0/731025632 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe00f5ac0 con 0x7fbfe010bcf0 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.323+0000 7fbfe4d53640 1 -- 10.20.193.4:0/731025632 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbfe010bcf0 msgr2=0x7fbfe00f44a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.323+0000 7fbfe4d53640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbfe010bcf0 0x7fbfe00f44a0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.323+0000 7fbfe4d53640 1 -- 10.20.193.4:0/731025632 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbfe010c8a0 msgr2=0x7fbfe00f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.323+0000 7fbfe4d53640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbfe010c8a0 0x7fbfe00f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.323+0000 7fbfe4d53640 1 -- 10.20.193.4:0/731025632 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd000a650 con 0x7fbfe010b2c0 2026-02-24T09:07:28.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.323+0000 7fbfe4d53640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbfe010b2c0 0x7fbfe00f3e50 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfd00034b0 tx=0x7fbfd00039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fdb0a7fc640 1 -- 10.20.193.4:0/2346945916 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fdb0c021620 con 0x7fdb1c0607b0 2026-02-24T09:07:28.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.325+0000 7fbfd5ffb640 1 -- 10.20.193.4:0/731025632 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfd003e070 con 0x7fbfe010b2c0 2026-02-24T09:07:28.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.325+0000 7fbfd5ffb640 1 -- 10.20.193.4:0/731025632 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbfd00055a0 con 0x7fbfe010b2c0 2026-02-24T09:07:28.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.325+0000 7fbfd5ffb640 1 -- 10.20.193.4:0/731025632 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfd0042c10 con 0x7fbfe010b2c0 2026-02-24T09:07:28.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.325+0000 7fbfe6fde640 1 -- 10.20.193.4:0/731025632 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe00f5d40 con 0x7fbfe010b2c0 2026-02-24T09:07:28.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.325+0000 7fbfe6fde640 1 -- 10.20.193.4:0/731025632 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe00f62e0 con 0x7fbfe010b2c0 2026-02-24T09:07:28.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 shutdown_connections 2026-02-24T09:07:28.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fdfd5193640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfa403f9a0 0x7fdfa405fe50 unknown :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fdfd5193640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfd010d440 0x7fdfd00f6f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fdfd5193640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfd010c680 0x7fdfd016e410 unknown :-1 s=CLOSED pgs=130 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fdfd5193640 1 --2- 10.20.193.4:0/3712150437 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfd010bcd0 0x7fdfd00f6700 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 >> 10.20.193.4:0/3712150437 conn(0x7fdfd00e9690 msgr2=0x7fdfd005f530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 shutdown_connections 2026-02-24T09:07:28.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fdfd5193640 1 -- 10.20.193.4:0/3712150437 wait complete. 2026-02-24T09:07:28.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fbfaf7fe640 1 -- 10.20.193.4:0/731025632 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa0005300 con 0x7fbfe010b2c0 2026-02-24T09:07:28.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.326+0000 7fbfd5ffb640 1 -- 10.20.193.4:0/731025632 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7fbfd00050c0 con 0x7fbfe010b2c0 2026-02-24T09:07:28.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.327+0000 7fbfd5ffb640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbfbc03f9d0 0x7fbfbc05fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.327+0000 7fbfd5ffb640 1 -- 10.20.193.4:0/731025632 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fbfd0079ff0 con 0x7fbfe010b2c0 2026-02-24T09:07:28.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.327+0000 7fbfd7fff640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbfbc03f9d0 0x7fbfbc05fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.327+0000 7fbfd7fff640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbfbc03f9d0 0x7fbfbc05fe80 secure :-1 s=READY pgs=68 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc8004740 tx=0x7fbfc800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.331+0000 7fbfd5ffb640 1 -- 10.20.193.4:0/731025632 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbfd00b9890 con 0x7fbfe010b2c0 2026-02-24T09:07:28.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.338+0000 7f6694ae8640 1 -- 10.20.193.4:0/676431205 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66900601d0 msgr2=0x7f669012dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.338+0000 7f6694ae8640 1 --2- 10.20.193.4:0/676431205 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66900601d0 0x7f669012dd30 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=11594806417624939400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6684009950 tx=0x7f668402f220 comp rx=0 tx=0).stop 2026-02-24T09:07:28.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.338+0000 7f6694ae8640 1 -- 10.20.193.4:0/676431205 shutdown_connections 2026-02-24T09:07:28.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.338+0000 7f6694ae8640 1 --2- 10.20.193.4:0/676431205 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f669014ee80 0x7f669016f330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.338+0000 7f6694ae8640 1 --2- 10.20.193.4:0/676431205 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f669012e2c0 0x7f669014e740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.338+0000 7f6694ae8640 1 --2- 10.20.193.4:0/676431205 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66900601d0 0x7f669012dd30 unknown :-1 s=CLOSED pgs=147 gs=1 cs=0 l=1 c_cookie=11594806417624939400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.338+0000 7f6694ae8640 1 -- 10.20.193.4:0/676431205 >> 10.20.193.4:0/676431205 conn(0x7f66900e9690 msgr2=0x7f6690109aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.338+0000 7f6694ae8640 1 -- 10.20.193.4:0/676431205 shutdown_connections 2026-02-24T09:07:28.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.338+0000 7f6694ae8640 1 -- 10.20.193.4:0/676431205 wait complete. 2026-02-24T09:07:28.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.339+0000 7f6694ae8640 1 Processor -- start 2026-02-24T09:07:28.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.342+0000 7f6694ae8640 1 -- start start 2026-02-24T09:07:28.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.342+0000 7f6694ae8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66900601d0 0x7f669016f330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.342+0000 7f6694ae8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f669012e2c0 0x7f6690109a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.342+0000 7f668dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f669012e2c0 0x7f6690109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f668dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f669012e2c0 0x7f6690109a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56686/0 (socket says 10.20.193.4:56686) 2026-02-24T09:07:28.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f668dd74640 1 -- 10.20.193.4:0/2856118056 learned_addr learned my addr 10.20.193.4:0/2856118056 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f6694ae8640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f669014ee80 0x7f669013a700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f669013ae90 con 0x7f669012e2c0 2026-02-24T09:07:28.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f669013b000 con 0x7f669014ee80 2026-02-24T09:07:28.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f669013b1c0 con 0x7f66900601d0 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f668dd74640 1 -- 10.20.193.4:0/2856118056 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66900601d0 msgr2=0x7f669016f330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f668dd74640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66900601d0 0x7f669016f330 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f668dd74640 1 -- 10.20.193.4:0/2856118056 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f669014ee80 msgr2=0x7f669013a700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f668dd74640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f669014ee80 0x7f669013a700 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f668dd74640 1 -- 10.20.193.4:0/2856118056 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6684009570 con 0x7f669012e2c0 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f668dd74640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f669012e2c0 0x7f6690109a70 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6678009480 tx=0x7f667800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.343+0000 7f66777fe640 1 -- 10.20.193.4:0/2856118056 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f667800cd30 con 0x7f669012e2c0 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.344+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669013b940 con 0x7f669012e2c0 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.344+0000 7f66777fe640 1 -- 10.20.193.4:0/2856118056 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f667800ce90 con 0x7f669012e2c0 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.344+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669013bda0 con 0x7f669012e2c0 2026-02-24T09:07:28.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.344+0000 7f66777fe640 1 -- 10.20.193.4:0/2856118056 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6678005310 con 0x7f669012e2c0 2026-02-24T09:07:28.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.345+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6690173550 con 0x7f669012e2c0 2026-02-24T09:07:28.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.345+0000 7f66777fe640 1 -- 10.20.193.4:0/2856118056 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f66780054a0 con 0x7f669012e2c0 2026-02-24T09:07:28.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.345+0000 7f66777fe640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f666803f9d0 0x7f666805fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.345+0000 7f66777fe640 1 -- 10.20.193.4:0/2856118056 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f66780588b0 con 0x7f669012e2c0 2026-02-24T09:07:28.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.346+0000 7f668e575640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f666803f9d0 0x7f666805fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.346+0000 7f668e575640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f666803f9d0 0x7f666805fe80 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f668402f730 tx=0x7f6684002d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.347+0000 7f292b75f640 1 -- 10.20.193.4:0/3917253546 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f292410e180 msgr2=0x7f292410e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.347+0000 7f292b75f640 1 --2- 10.20.193.4:0/3917253546 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f292410e180 0x7f292410e5f0 secure :-1 s=READY pgs=18 gs=3 cs=0 l=1 c_cookie=5893456573646386729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2914009890 tx=0x7f291402f100 comp rx=0 tx=0).stop 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.347+0000 7f292b75f640 1 -- 10.20.193.4:0/3917253546 shutdown_connections 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.347+0000 7f292b75f640 1 --2- 10.20.193.4:0/3917253546 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292410eb30 0x7f292416f4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.347+0000 7f292b75f640 1 --2- 10.20.193.4:0/3917253546 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f292410e180 0x7f292410e5f0 unknown :-1 s=CLOSED pgs=18 gs=3 cs=0 l=1 c_cookie=5893456573646386729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.347+0000 7f292b75f640 1 --2- 10.20.193.4:0/3917253546 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292410cff0 0x7f292410d3e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.347+0000 7f292b75f640 1 -- 10.20.193.4:0/3917253546 >> 10.20.193.4:0/3917253546 conn(0x7f29240ea760 msgr2=0x7f292410ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.347+0000 7f292b75f640 1 -- 10.20.193.4:0/3917253546 shutdown_connections 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.347+0000 7f292b75f640 1 -- 10.20.193.4:0/3917253546 wait complete. 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f292b75f640 1 Processor -- start 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f292b75f640 1 -- start start 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f292b75f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f292410cff0 0x7f29240f3180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f292b75f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292410e180 0x7f292416f4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f292b75f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292410eb30 0x7f29240f39c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f292b75f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f29240f4620 con 0x7f292410e180 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f292b75f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f29240f4760 con 0x7f292410eb30 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f292b75f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f29240f4920 con 0x7f292410cff0 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f2928cd3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292410e180 0x7f292416f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f2928cd3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292410e180 0x7f292416f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56704/0 (socket says 10.20.193.4:56704) 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f2928cd3640 1 -- 10.20.193.4:0/3602838799 learned_addr learned my addr 10.20.193.4:0/3602838799 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f29294d4640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f292410cff0 0x7f29240f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f2929cd5640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292410eb30 0x7f29240f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f2928cd3640 1 -- 10.20.193.4:0/3602838799 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f292410cff0 msgr2=0x7f29240f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f2928cd3640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f292410cff0 0x7f29240f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f2928cd3640 1 -- 10.20.193.4:0/3602838799 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292410eb30 msgr2=0x7f29240f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f2928cd3640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292410eb30 0x7f29240f39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f2928cd3640 1 -- 10.20.193.4:0/3602838799 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292000a590 con 0x7f292410e180 2026-02-24T09:07:28.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.348+0000 7f2928cd3640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292410e180 0x7f292416f4a0 secure :-1 s=READY pgs=149 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2914009990 tx=0x7f29140028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.349+0000 7f29127fc640 1 -- 10.20.193.4:0/3602838799 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f291403d070 con 0x7f292410e180 2026-02-24T09:07:28.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.349+0000 7f29127fc640 1 -- 10.20.193.4:0/3602838799 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f29140044f0 con 0x7f292410e180 2026-02-24T09:07:28.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.349+0000 7f292b75f640 1 -- 10.20.193.4:0/3602838799 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29140094b0 con 0x7f292410e180 2026-02-24T09:07:28.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f292b75f640 1 -- 10.20.193.4:0/3602838799 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29240f4ed0 con 0x7f292410e180 2026-02-24T09:07:28.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f29127fc640 1 -- 10.20.193.4:0/3602838799 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2914041b00 con 0x7f292410e180 2026-02-24T09:07:28.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f957e583640 1 -- 10.20.193.4:0/3391262646 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f957810f330 msgr2=0x7f957810f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f957e583640 1 --2- 10.20.193.4:0/3391262646 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f957810f330 0x7f957810f720 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=15862031063397117835 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95640099a0 tx=0x7f956402f1f0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f957e583640 1 -- 10.20.193.4:0/3391262646 shutdown_connections 2026-02-24T09:07:28.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f957e583640 1 --2- 10.20.193.4:0/3391262646 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9578110e70 0x7f9578171800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f957e583640 1 --2- 10.20.193.4:0/3391262646 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f95781104c0 0x7f9578110930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f957e583640 1 --2- 10.20.193.4:0/3391262646 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f957810f330 0x7f957810f720 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=15862031063397117835 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f957e583640 1 -- 10.20.193.4:0/3391262646 >> 10.20.193.4:0/3391262646 conn(0x7f95780eca60 msgr2=0x7f957810ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957e583640 1 -- 10.20.193.4:0/3391262646 shutdown_connections 2026-02-24T09:07:28.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957e583640 1 -- 10.20.193.4:0/3391262646 wait complete. 2026-02-24T09:07:28.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f29127fc640 1 -- 10.20.193.4:0/3602838799 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f291404a3b0 con 0x7f292410e180 2026-02-24T09:07:28.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.350+0000 7f29127fc640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f403f950 0x7f28f405fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f29127fc640 1 -- 10.20.193.4:0/3602838799 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f291407ab50 con 0x7f292410e180 2026-02-24T09:07:28.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f292b75f640 1 -- 10.20.193.4:0/3602838799 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2924173510 con 0x7f292410e180 2026-02-24T09:07:28.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f29294d4640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f403f950 0x7f28f405fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957e583640 1 Processor -- start 2026-02-24T09:07:28.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957e583640 1 -- start start 2026-02-24T09:07:28.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957e583640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f957810f330 0x7f95780f89e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957e583640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f95781104c0 0x7f9578171800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f66777fe640 1 -- 10.20.193.4:0/2856118056 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f66780138d0 con 0x7f669012e2c0 2026-02-24T09:07:28.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957e583640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9578110e70 0x7f95780f9240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957e583640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f95780f9e30 con 0x7f9578110e70 2026-02-24T09:07:28.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957e583640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f95780f9fa0 con 0x7f957810f330 2026-02-24T09:07:28.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957e583640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f95780fa160 con 0x7f95781104c0 2026-02-24T09:07:28.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957caf9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9578110e70 0x7f95780f9240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957caf9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9578110e70 0x7f95780f9240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56728/0 (socket says 10.20.193.4:56728) 2026-02-24T09:07:28.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f29294d4640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f403f950 0x7f28f405fe00 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2918005b30 tx=0x7f2918009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.351+0000 7f957caf9640 1 -- 10.20.193.4:0/25758951 learned_addr learned my addr 10.20.193.4:0/25758951 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.352+0000 7f957caf9640 1 -- 10.20.193.4:0/25758951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f95781104c0 msgr2=0x7f9578171800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:28.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.352+0000 7f957caf9640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f95781104c0 0x7f9578171800 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.352+0000 7f957caf9640 1 -- 10.20.193.4:0/25758951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f957810f330 msgr2=0x7f95780f89e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:28.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.352+0000 7f957caf9640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f957810f330 0x7f95780f89e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.352+0000 7f957caf9640 1 -- 10.20.193.4:0/25758951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9564009570 con 0x7f9578110e70 2026-02-24T09:07:28.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.352+0000 7f957caf9640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9578110e70 0x7f95780f9240 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f956c006e90 tx=0x7f956c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.353+0000 7f521f4a7640 1 -- 10.20.193.4:0/2925286419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f5218175840 con 0x7f52180608c0 2026-02-24T09:07:28.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.355+0000 7f29127fc640 1 -- 10.20.193.4:0/3602838799 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f291407f060 con 0x7f292410e180 2026-02-24T09:07:28.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.355+0000 7f95757fa640 1 -- 10.20.193.4:0/25758951 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f956c00cb80 con 0x7f9578110e70 2026-02-24T09:07:28.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.355+0000 7f95757fa640 1 -- 10.20.193.4:0/25758951 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f956c005e10 con 0x7f9578110e70 2026-02-24T09:07:28.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.355+0000 7f95757fa640 1 -- 10.20.193.4:0/25758951 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f956c003a70 con 0x7f9578110e70 2026-02-24T09:07:28.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.355+0000 7f957e583640 1 -- 10.20.193.4:0/25758951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95780fa440 con 0x7f9578110e70 2026-02-24T09:07:28.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.355+0000 7f957e583640 1 -- 10.20.193.4:0/25758951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95780fa8c0 con 0x7f9578110e70 2026-02-24T09:07:28.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.357+0000 7f954affd640 1 -- 10.20.193.4:0/25758951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9540005300 con 0x7f9578110e70 2026-02-24T09:07:28.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.357+0000 7f95757fa640 1 -- 10.20.193.4:0/25758951 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7f956c003c00 con 0x7f9578110e70 2026-02-24T09:07:28.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.357+0000 7f95757fa640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f954c03fa20 0x7f954c05fed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.357+0000 7f95757fa640 1 -- 10.20.193.4:0/25758951 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f956c0551a0 con 0x7f9578110e70 2026-02-24T09:07:28.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.357+0000 7f9577fff640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f954c03fa20 0x7f954c05fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.358+0000 7f9577fff640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f954c03fa20 0x7f954c05fed0 secure :-1 s=READY pgs=71 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f956402f700 tx=0x7f9564002390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.367 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.363+0000 7f95757fa640 1 -- 10.20.193.4:0/25758951 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f956c006210 con 0x7f9578110e70 2026-02-24T09:07:28.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.364+0000 7f52067fc640 1 -- 10.20.193.4:0/2925286419 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v25)=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7f5208017760 con 0x7f52180608c0 2026-02-24T09:07:28.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.366+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7ff31805f570 con 0x7ff3181103f0 2026-02-24T09:07:28.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 -- 10.20.193.4:0/2925286419 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51f403f9d0 msgr2=0x7f51f405fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51f403f9d0 0x7f51f405fe80 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f520c004740 tx=0x7f520c008040 comp rx=0 tx=0).stop 2026-02-24T09:07:28.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 -- 10.20.193.4:0/2925286419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52180608c0 msgr2=0x7f521814e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52180608c0 0x7f521814e660 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5208009480 tx=0x7f520800ede0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 -- 10.20.193.4:0/2925286419 shutdown_connections 2026-02-24T09:07:28.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51f403f9d0 0x7f51f405fe80 unknown :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f521814ed80 0x7f521812b8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f521812e280 0x7f5218109aa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 --2- 10.20.193.4:0/2925286419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52180608c0 0x7f521814e660 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 -- 10.20.193.4:0/2925286419 >> 10.20.193.4:0/2925286419 conn(0x7f52180e96c0 msgr2=0x7f5218110a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 -- 10.20.193.4:0/2925286419 shutdown_connections 2026-02-24T09:07:28.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.367+0000 7f521f4a7640 1 -- 10.20.193.4:0/2925286419 wait complete. 2026-02-24T09:07:28.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.368+0000 7ff2ff7fe640 1 -- 10.20.193.4:0/3260353127 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7ff30c01f340 con 0x7ff3181103f0 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f403f9d0 msgr2=0x7ff2f405fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f403f9d0 0x7ff2f405fe80 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3080097e0 tx=0x7ff308031040 comp rx=0 tx=0).stop 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3181103f0 msgr2=0x7ff318171710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3181103f0 0x7ff318171710 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff30c009480 tx=0x7ff30c00c2d0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 shutdown_connections 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f403f9d0 0x7ff2f405fe80 unknown :-1 s=CLOSED pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff318110da0 0x7ff3180f9170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3181103f0 0x7ff318171710 unknown :-1 s=CLOSED pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 --2- 10.20.193.4:0/3260353127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff31810f260 0x7ff3180f8930 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 >> 10.20.193.4:0/3260353127 conn(0x7ff3180ec9f0 msgr2=0x7ff3180eef50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 shutdown_connections 2026-02-24T09:07:28.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.371+0000 7ff320388640 1 -- 10.20.193.4:0/3260353127 wait complete. 2026-02-24T09:07:28.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.374+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}] v 0) -- 0x7f59d4114f60 con 0x7f59d41b5ef0 2026-02-24T09:07:28.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.376+0000 7f59d8a13640 1 -- 10.20.193.4:0/951877145 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}]=0 v27)=0 v27) ==== 141+0+0 (secure 0 0 0) 0x7f59cc017bc0 con 0x7f59d41b5ef0 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59a403f9d0 msgr2=0x7f59a405fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59a403f9d0 0x7f59a405fe80 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59bc006f30 tx=0x7f59bc009210 comp rx=0 tx=0).stop 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59d41b5ef0 msgr2=0x7f59d41b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59d41b5ef0 0x7f59d41b6390 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59cc00faa0 tx=0x7f59cc00ff70 comp rx=0 tx=0).stop 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 shutdown_connections 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59a403f9d0 0x7f59a405fe80 unknown :-1 s=CLOSED pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59d41b5ef0 0x7f59d41b6390 unknown :-1 s=CLOSED pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59d4115540 0x7f59d41b52f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 --2- 10.20.193.4:0/951877145 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59d405e570 0x7f59d41b4ca0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 >> 10.20.193.4:0/951877145 conn(0x7f59d405b580 msgr2=0x7f59d41146f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.379+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 shutdown_connections 2026-02-24T09:07:28.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.380+0000 7f59d9a15640 1 -- 10.20.193.4:0/951877145 wait complete. 2026-02-24T09:07:28.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.384+0000 7f3bf1d63640 1 -- 10.20.193.4:0/4134353899 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f3bec05fc10 con 0x7f3bec05de20 2026-02-24T09:07:28.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.385+0000 7f3be8ff9640 1 -- 10.20.193.4:0/4134353899 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v27)=0 v27) ==== 106+0+0 (secure 0 0 0) 0x7f3bdc00ebe0 con 0x7f3bec05de20 2026-02-24T09:07:28.392 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.388+0000 7f3bf1d63640 1 -- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3bc803fa20 msgr2=0x7f3bc805fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.388+0000 7f3bf1d63640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3bc803fa20 0x7f3bc805fed0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3be0004780 tx=0x7f3be0009190 comp rx=0 tx=0).stop 2026-02-24T09:07:28.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.388+0000 7f3bf1d63640 1 -- 10.20.193.4:0/4134353899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bec05de20 msgr2=0x7f3bec105c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.388+0000 7f3bf1d63640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bec05de20 0x7f3bec105c70 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bdc00d950 tx=0x7f3bdc00de20 comp rx=0 tx=0).stop 2026-02-24T09:07:28.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.389+0000 7f3bf1d63640 1 -- 10.20.193.4:0/4134353899 shutdown_connections 2026-02-24T09:07:28.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.389+0000 7f3bf1d63640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3bc803fa20 0x7f3bc805fed0 unknown :-1 s=CLOSED pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.389+0000 7f3bf1d63640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3bec060150 0x7f3bec106b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.389+0000 7f3bf1d63640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3bec05f7a0 0x7f3bec1062c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.389+0000 7f3bf1d63640 1 --2- 10.20.193.4:0/4134353899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bec05de20 0x7f3bec105c70 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.389+0000 7f3bf1d63640 1 -- 10.20.193.4:0/4134353899 >> 10.20.193.4:0/4134353899 conn(0x7f3bec05b580 msgr2=0x7f3bec05ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.389+0000 7f3bf1d63640 1 -- 10.20.193.4:0/4134353899 shutdown_connections 2026-02-24T09:07:28.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.389+0000 7f3bf1d63640 1 -- 10.20.193.4:0/4134353899 wait complete. 2026-02-24T09:07:28.428 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.429 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_use_global_snaprealm_seq_for_subvol', 'False'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.430+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fc228062910 con 0x7fc22810d070 2026-02-24T09:07:28.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.432+0000 7fc216ffd640 1 -- 10.20.193.4:0/3181437839 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7fc218021940 con 0x7fc22810d070 2026-02-24T09:07:28.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.435+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc20403fa90 msgr2=0x7fc20405ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.435+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc20403fa90 0x7fc20405ff40 secure :-1 s=READY pgs=64 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc21c004740 tx=0x7fc21c009690 comp rx=0 tx=0).stop 2026-02-24T09:07:28.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.435+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc22810d070 msgr2=0x7fc2280f88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.435+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc22810d070 0x7fc2280f88b0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc21800e9c0 tx=0x7fc21800ee90 comp rx=0 tx=0).stop 2026-02-24T09:07:28.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.436+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 shutdown_connections 2026-02-24T09:07:28.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.436+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc20403fa90 0x7fc20405ff40 unknown :-1 s=CLOSED pgs=64 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.436+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc22810ebb0 0x7fc2280f9110 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.436+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc22810e200 0x7fc22816f540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.436+0000 7fc22fdaf640 1 --2- 10.20.193.4:0/3181437839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc22810d070 0x7fc2280f88b0 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.436+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 >> 10.20.193.4:0/3181437839 conn(0x7fc2280ea7a0 msgr2=0x7fc228061130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.436+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 shutdown_connections 2026-02-24T09:07:28.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.436+0000 7fc22fdaf640 1 -- 10.20.193.4:0/3181437839 wait complete. 2026-02-24T09:07:28.442 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.442 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.443+0000 7f16668e7640 1 -- 10.20.193.4:0/4020548321 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1624005b30 con 0x7f166014ed80 2026-02-24T09:07:28.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.445+0000 7f165d7fa640 1 -- 10.20.193.4:0/4020548321 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f165400e2e0 con 0x7f166014ed80 2026-02-24T09:07:28.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 -- 10.20.193.4:0/4020548321 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f163403f9d0 msgr2=0x7f163405fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f163403f9d0 0x7f163405fe80 secure :-1 s=READY pgs=66 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1650038820 tx=0x7f165003a040 comp rx=0 tx=0).stop 2026-02-24T09:07:28.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 -- 10.20.193.4:0/4020548321 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f166014ed80 msgr2=0x7f166010dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f166014ed80 0x7f166010dcf0 secure :-1 s=READY pgs=143 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f165400c470 tx=0x7f165400c940 comp rx=0 tx=0).stop 2026-02-24T09:07:28.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 -- 10.20.193.4:0/4020548321 shutdown_connections 2026-02-24T09:07:28.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f163403f9d0 0x7f163405fe80 unknown :-1 s=CLOSED pgs=66 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f166014ed80 0x7f166010dcf0 unknown :-1 s=CLOSED pgs=143 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f166010be20 0x7f1660109200 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 --2- 10.20.193.4:0/4020548321 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f166010b410 0x7f166016f210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 -- 10.20.193.4:0/4020548321 >> 10.20.193.4:0/4020548321 conn(0x7f16600e8e20 msgr2=0x7f1660110e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 -- 10.20.193.4:0/4020548321 shutdown_connections 2026-02-24T09:07:28.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.448+0000 7f16668e7640 1 -- 10.20.193.4:0/4020548321 wait complete. 2026-02-24T09:07:28.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.459+0000 7fcc720e5640 1 -- 10.20.193.4:0/3722194875 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fcc6c110ad0 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.461+0000 7fcc68ff9640 1 -- 10.20.193.4:0/3722194875 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v30)=0 v30) ==== 125+0+0 (secure 0 0 0) 0x7fcc5c01f810 con 0x7fcc6c10bcf0 2026-02-24T09:07:28.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.464+0000 7fcc720e5640 1 -- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc4003f9d0 msgr2=0x7fcc4005fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.464+0000 7fcc720e5640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc4003f9d0 0x7fcc4005fe80 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc58004780 tx=0x7fcc58009190 comp rx=0 tx=0).stop 2026-02-24T09:07:28.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.464+0000 7fcc720e5640 1 -- 10.20.193.4:0/3722194875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc6c10bcf0 msgr2=0x7fcc6c0fd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.464+0000 7fcc720e5640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc6c10bcf0 0x7fcc6c0fd0e0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc5c00b520 tx=0x7fcc5c00b9f0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.465+0000 7fcc720e5640 1 -- 10.20.193.4:0/3722194875 shutdown_connections 2026-02-24T09:07:28.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.465+0000 7fcc720e5640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc4003f9d0 0x7fcc4005fe80 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.465+0000 7fcc720e5640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc6c10c8a0 0x7fcc6c0fdce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.465+0000 7fcc720e5640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc6c10bcf0 0x7fcc6c0fd0e0 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.465+0000 7fcc720e5640 1 --2- 10.20.193.4:0/3722194875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc6c10b2c0 0x7fcc6c0fca90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.465+0000 7fcc720e5640 1 -- 10.20.193.4:0/3722194875 >> 10.20.193.4:0/3722194875 conn(0x7fcc6c0e8e20 msgr2=0x7fcc6c056270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.465+0000 7fcc720e5640 1 -- 10.20.193.4:0/3722194875 shutdown_connections 2026-02-24T09:07:28.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.465+0000 7fcc720e5640 1 -- 10.20.193.4:0/3722194875 wait complete. 2026-02-24T09:07:28.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.470+0000 7fbfaf7fe640 1 -- 10.20.193.4:0/731025632 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fbfa0005b30 con 0x7fbfe010b2c0 2026-02-24T09:07:28.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.471+0000 7fbfd5ffb640 1 -- 10.20.193.4:0/731025632 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7fbfd004b5a0 con 0x7fbfe010b2c0 2026-02-24T09:07:28.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 -- 10.20.193.4:0/731025632 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbfbc03f9d0 msgr2=0x7fbfbc05fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbfbc03f9d0 0x7fbfbc05fe80 secure :-1 s=READY pgs=68 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfc8004740 tx=0x7fbfc800b410 comp rx=0 tx=0).stop 2026-02-24T09:07:28.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 -- 10.20.193.4:0/731025632 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbfe010b2c0 msgr2=0x7fbfe00f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbfe010b2c0 0x7fbfe00f3e50 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfd00034b0 tx=0x7fbfd00039b0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 -- 10.20.193.4:0/731025632 shutdown_connections 2026-02-24T09:07:28.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbfbc03f9d0 0x7fbfbc05fe80 unknown :-1 s=CLOSED pgs=68 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbfe010c8a0 0x7fbfe00f5050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbfe010bcf0 0x7fbfe00f44a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 --2- 10.20.193.4:0/731025632 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbfe010b2c0 0x7fbfe00f3e50 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 -- 10.20.193.4:0/731025632 >> 10.20.193.4:0/731025632 conn(0x7fbfe00e8e20 msgr2=0x7fbfe00ea400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 -- 10.20.193.4:0/731025632 shutdown_connections 2026-02-24T09:07:28.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.474+0000 7fbfaf7fe640 1 -- 10.20.193.4:0/731025632 wait complete. 2026-02-24T09:07:28.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.482+0000 7fdb238ef640 1 -- 10.20.193.4:0/2346945916 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fdb1c174d40 con 0x7fdb1c0607b0 2026-02-24T09:07:28.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.484+0000 7fdb0a7fc640 1 -- 10.20.193.4:0/2346945916 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v31)=0 v31) ==== 120+0+0 (secure 0 0 0) 0x7fdb0c025070 con 0x7fdb1c0607b0 2026-02-24T09:07:28.492 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.493 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 -- 10.20.193.4:0/2346945916 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdaf803f9d0 msgr2=0x7fdaf805fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdaf803f9d0 0x7fdaf805fe80 secure :-1 s=READY pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb10004740 tx=0x7fdb10005f90 comp rx=0 tx=0).stop 2026-02-24T09:07:28.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 -- 10.20.193.4:0/2346945916 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdb1c0607b0 msgr2=0x7fdb1c0f50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdb1c0607b0 0x7fdb1c0f50a0 secure :-1 s=READY pgs=144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb0c00e9c0 tx=0x7fdb0c00ee90 comp rx=0 tx=0).stop 2026-02-24T09:07:28.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 -- 10.20.193.4:0/2346945916 shutdown_connections 2026-02-24T09:07:28.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdaf803f9d0 0x7fdaf805fe80 unknown :-1 s=CLOSED pgs=67 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdb1c10c990 0x7fdb1c0f62f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb1c10bfe0 0x7fdb1c0f56f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 --2- 10.20.193.4:0/2346945916 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdb1c0607b0 0x7fdb1c0f50a0 unknown :-1 s=CLOSED pgs=144 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 -- 10.20.193.4:0/2346945916 >> 10.20.193.4:0/2346945916 conn(0x7fdb1c0e96c0 msgr2=0x7fdb1c0eb370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 -- 10.20.193.4:0/2346945916 shutdown_connections 2026-02-24T09:07:28.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.488+0000 7fdb238ef640 1 -- 10.20.193.4:0/2346945916 wait complete. 2026-02-24T09:07:28.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.491+0000 7f292b75f640 1 -- 10.20.193.4:0/3602838799 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f292405f470 con 0x7f292410e180 2026-02-24T09:07:28.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.492+0000 7f954affd640 1 -- 10.20.193.4:0/25758951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f9540005b30 con 0x7f9578110e70 2026-02-24T09:07:28.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.493+0000 7f29127fc640 1 -- 10.20.193.4:0/3602838799 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f2914049720 con 0x7f292410e180 2026-02-24T09:07:28.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.495+0000 7f95757fa640 1 -- 10.20.193.4:0/25758951 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f956c01e030 con 0x7f9578110e70 2026-02-24T09:07:28.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 -- 10.20.193.4:0/3602838799 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f403f950 msgr2=0x7f28f405fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f403f950 0x7f28f405fe00 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2918005b30 tx=0x7f2918009310 comp rx=0 tx=0).stop 2026-02-24T09:07:28.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 -- 10.20.193.4:0/3602838799 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292410e180 msgr2=0x7f292416f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292410e180 0x7f292416f4a0 secure :-1 s=READY pgs=149 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2914009990 tx=0x7f29140028d0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 -- 10.20.193.4:0/3602838799 shutdown_connections 2026-02-24T09:07:28.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f403f950 0x7f28f405fe00 unknown :-1 s=CLOSED pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292410eb30 0x7f29240f39c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292410e180 0x7f292416f4a0 unknown :-1 s=CLOSED pgs=149 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 --2- 10.20.193.4:0/3602838799 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f292410cff0 0x7f29240f3180 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 -- 10.20.193.4:0/3602838799 >> 10.20.193.4:0/3602838799 conn(0x7f29240ea760 msgr2=0x7f2924061660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f66901339f0 con 0x7f669012e2c0 2026-02-24T09:07:28.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 -- 10.20.193.4:0/3602838799 shutdown_connections 2026-02-24T09:07:28.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.496+0000 7f292b75f640 1 -- 10.20.193.4:0/3602838799 wait complete. 2026-02-24T09:07:28.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.498+0000 7f66777fe640 1 -- 10.20.193.4:0/2856118056 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v34)=0 v34) ==== 111+0+0 (secure 0 0 0) 0x7f6678022310 con 0x7f669012e2c0 2026-02-24T09:07:28.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.498+0000 7f954affd640 1 -- 10.20.193.4:0/25758951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f954c03fa20 msgr2=0x7f954c05fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.498+0000 7f954affd640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f954c03fa20 0x7f954c05fed0 secure :-1 s=READY pgs=71 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f956402f700 tx=0x7f9564002390 comp rx=0 tx=0).stop 2026-02-24T09:07:28.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.498+0000 7f954affd640 1 -- 10.20.193.4:0/25758951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9578110e70 msgr2=0x7f95780f9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.498+0000 7f954affd640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9578110e70 0x7f95780f9240 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f956c006e90 tx=0x7f956c00eeb0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.498+0000 7f954affd640 1 -- 10.20.193.4:0/25758951 shutdown_connections 2026-02-24T09:07:28.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.498+0000 7f954affd640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f954c03fa20 0x7f954c05fed0 unknown :-1 s=CLOSED pgs=71 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.498+0000 7f954affd640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9578110e70 0x7f95780f9240 unknown :-1 s=CLOSED pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.498+0000 7f954affd640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f95781104c0 0x7f9578171800 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.498+0000 7f954affd640 1 --2- 10.20.193.4:0/25758951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f957810f330 0x7f95780f89e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.499+0000 7f954affd640 1 -- 10.20.193.4:0/25758951 >> 10.20.193.4:0/25758951 conn(0x7f95780eca60 msgr2=0x7f95780eefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.499+0000 7f954affd640 1 -- 10.20.193.4:0/25758951 shutdown_connections 2026-02-24T09:07:28.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.499+0000 7f954affd640 1 -- 10.20.193.4:0/25758951 wait complete. 2026-02-24T09:07:28.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f666803f9d0 msgr2=0x7f666805fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f666803f9d0 0x7f666805fe80 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f668402f730 tx=0x7f6684002d40 comp rx=0 tx=0).stop 2026-02-24T09:07:28.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f669012e2c0 msgr2=0x7f6690109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f669012e2c0 0x7f6690109a70 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6678009480 tx=0x7f667800c2d0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 shutdown_connections 2026-02-24T09:07:28.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f666803f9d0 0x7f666805fe80 unknown :-1 s=CLOSED pgs=69 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f669014ee80 0x7f669013a700 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f669012e2c0 0x7f6690109a70 unknown :-1 s=CLOSED pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 --2- 10.20.193.4:0/2856118056 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66900601d0 0x7f669016f330 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 >> 10.20.193.4:0/2856118056 conn(0x7f66900e9690 msgr2=0x7f6690131150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 shutdown_connections 2026-02-24T09:07:28.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.501+0000 7f6694ae8640 1 -- 10.20.193.4:0/2856118056 wait complete. 2026-02-24T09:07:28.555 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.555 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.600 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.601 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.601 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.601 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.601 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '19e0945d-1160-11f1-92cf-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial004') 2026-02-24T09:07:28.601 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config dump 2026-02-24T09:07:28.757 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:28.843 INFO:journalctl@ceph.mgr.y.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mgr[48060]: -- 10.20.193.14:0/55389691 <== mon.2 v2:10.20.193.14:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x2575a00 con 0x2549800 2026-02-24T09:07:28.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.856+0000 7fa265005640 1 -- 10.20.193.4:0/2075505028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa26010f250 msgr2=0x7fa26010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.856+0000 7fa265005640 1 --2- 10.20.193.4:0/2075505028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa26010f250 0x7fa26010f640 secure :-1 s=READY pgs=152 gs=1 cs=0 l=1 c_cookie=5892983348299029584 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa254009950 tx=0x7fa25402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.856+0000 7fa265005640 1 -- 10.20.193.4:0/2075505028 shutdown_connections 2026-02-24T09:07:28.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.856+0000 7fa265005640 1 --2- 10.20.193.4:0/2075505028 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa260110d90 0x7fa260171720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.856+0000 7fa265005640 1 --2- 10.20.193.4:0/2075505028 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2601103e0 0x7fa260110850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.856+0000 7fa265005640 1 --2- 10.20.193.4:0/2075505028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa26010f250 0x7fa26010f640 unknown :-1 s=CLOSED pgs=152 gs=1 cs=0 l=1 c_cookie=5892983348299029584 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.856+0000 7fa265005640 1 -- 10.20.193.4:0/2075505028 >> 10.20.193.4:0/2075505028 conn(0x7fa2600ec980 msgr2=0x7fa26010cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.856+0000 7fa265005640 1 -- 10.20.193.4:0/2075505028 shutdown_connections 2026-02-24T09:07:28.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.856+0000 7fa265005640 1 -- 10.20.193.4:0/2075505028 wait complete. 2026-02-24T09:07:28.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.856+0000 7fa265005640 1 Processor -- start 2026-02-24T09:07:28.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa265005640 1 -- start start 2026-02-24T09:07:28.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa265005640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa26010f250 0x7fa2600f88e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa265005640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2601103e0 0x7fa260171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa265005640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa260110d90 0x7fa2600f9140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa265005640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600f9d30 con 0x7fa2601103e0 2026-02-24T09:07:28.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa265005640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600f9ea0 con 0x7fa260110d90 2026-02-24T09:07:28.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa265005640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600fa060 con 0x7fa26010f250 2026-02-24T09:07:28.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa25e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2601103e0 0x7fa260171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa25e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2601103e0 0x7fa260171720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56734/0 (socket says 10.20.193.4:56734) 2026-02-24T09:07:28.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa25e575640 1 -- 10.20.193.4:0/2287653400 learned_addr learned my addr 10.20.193.4:0/2287653400 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:28.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa25ed76640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa26010f250 0x7fa2600f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa25e575640 1 -- 10.20.193.4:0/2287653400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa26010f250 msgr2=0x7fa2600f88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa25e575640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa26010f250 0x7fa2600f88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa25e575640 1 -- 10.20.193.4:0/2287653400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa260110d90 msgr2=0x7fa2600f9140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:07:28.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.857+0000 7fa25f577640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa260110d90 0x7fa2600f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.858+0000 7fa25e575640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa260110d90 0x7fa2600f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.858+0000 7fa25e575640 1 -- 10.20.193.4:0/2287653400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa254009570 con 0x7fa2601103e0 2026-02-24T09:07:28.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.858+0000 7fa25ed76640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa26010f250 0x7fa2600f88e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:07:28.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.858+0000 7fa25e575640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2601103e0 0x7fa260171720 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa24800d950 tx=0x7fa24800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.859+0000 7fa23ffff640 1 -- 10.20.193.4:0/2287653400 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa248004540 con 0x7fa2601103e0 2026-02-24T09:07:28.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.859+0000 7fa23ffff640 1 -- 10.20.193.4:0/2287653400 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa248009d00 con 0x7fa2601103e0 2026-02-24T09:07:28.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.859+0000 7fa23ffff640 1 -- 10.20.193.4:0/2287653400 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2480106e0 con 0x7fa2601103e0 2026-02-24T09:07:28.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.859+0000 7fa265005640 1 -- 10.20.193.4:0/2287653400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2600fa340 con 0x7fa2601103e0 2026-02-24T09:07:28.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.859+0000 7fa265005640 1 -- 10.20.193.4:0/2287653400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2600fa860 con 0x7fa2601103e0 2026-02-24T09:07:28.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.860+0000 7fa265005640 1 -- 10.20.193.4:0/2287653400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa260175720 con 0x7fa2601103e0 2026-02-24T09:07:28.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.860+0000 7fa23ffff640 1 -- 10.20.193.4:0/2287653400 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 13) ==== 52869+0+0 (secure 0 0 0) 0x7fa248010870 con 0x7fa2601103e0 2026-02-24T09:07:28.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.860+0000 7fa23ffff640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa23403f9d0 0x7fa23405fe80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:28.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.860+0000 7fa23ffff640 1 -- 10.20.193.4:0/2287653400 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fa2480545f0 con 0x7fa2601103e0 2026-02-24T09:07:28.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.860+0000 7fa25ed76640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa23403f9d0 0x7fa23405fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:28.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.860+0000 7fa25ed76640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa23403f9d0 0x7fa23405fe80 secure :-1 s=READY pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2540023d0 tx=0x7fa254031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:28.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.863+0000 7fa23ffff640 1 -- 10.20.193.4:0/2287653400 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa248021730 con 0x7fa2601103e0 2026-02-24T09:07:28.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.967+0000 7fa265005640 1 -- 10.20.193.4:0/2287653400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fa26005f470 con 0x7fa2601103e0 2026-02-24T09:07:28.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.967+0000 7fa23ffff640 1 -- 10.20.193.4:0/2287653400 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v34) ==== 59+0+19224 (secure 0 0 0) 0x7fa24800ebe0 con 0x7fa2601103e0 2026-02-24T09:07:28.972 INFO:teuthology.orchestra.run.trial004.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-24T09:07:28.972 INFO:teuthology.orchestra.run.trial004.stdout:global dev auth_debug true 2026-02-24T09:07:28.972 INFO:teuthology.orchestra.run.trial004.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b * 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global dev debug_asserts_on_shutdown true 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global basic log_to_file true 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global basic log_to_journald false 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global basic log_to_stderr false 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global advanced mon_allow_pool_delete true 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global advanced mon_cluster_log_to_file true 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-24T09:07:28.973 INFO:teuthology.orchestra.run.trial004.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:global dev ms_die_on_bug true 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:global dev ms_die_on_old_message true 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:global dev ms_die_on_skipped_message false 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-24T09:07:28.974 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-24T09:07:28.975 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced debug_mon 20/20 2026-02-24T09:07:28.975 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced debug_ms 1/1 2026-02-24T09:07:28.975 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced debug_paxos 20/20 2026-02-24T09:07:28.975 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced mon_data_avail_warn 5 2026-02-24T09:07:28.975 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-24T09:07:28.975 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-24T09:07:28.975 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced mon_op_complaint_time 120 2026-02-24T09:07:28.975 INFO:teuthology.orchestra.run.trial004.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-24T09:07:28.975 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced client_mount_timeout 30 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced debug_client 20/20 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced debug_mgr 20/20 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced debug_ms 1/1 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-24T09:07:28.976 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:osd dev bdev_debug_aio true 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced bluestore_compression_mode aggressive 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:osd dev bluestore_fsck_on_mount true 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced debug_bluefs 20/20 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced debug_bluestore 20/20 2026-02-24T09:07:28.977 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced debug_ms 1/1 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced debug_osd 20/20 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced debug_rocksdb 10/10 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd dev osd_debug_misdirected_ops true 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd dev osd_debug_op_order true 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd dev osd_debug_shutdown true 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-24T09:07:28.978 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_max_omap_entries_per_request 10000 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_memory_target_autotune true 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_objectstore bluestore * 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_op_queue debug_random * 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_recover_clone_overlap true 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced debug_mds 20/20 2026-02-24T09:07:28.979 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced debug_mds_balancer 20/20 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced debug_ms 2/2 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced mds_bal_merge_size 5 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced mds_bal_split_bits 3 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced mds_bal_split_size 100 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds dev mds_debug_frag true 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds dev mds_debug_scatterstat true 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced mds_export_ephemeral_random_max 0.200000 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced mds_use_global_snaprealm_seq_for_subvol false 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds dev mds_verify_scatter true 2026-02-24T09:07:28.980 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced rados_mon_op_timeout 900 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:mds advanced rados_osd_op_timeout 900 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:client advanced client_mount_timeout 600 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:client advanced debug_client 20/20 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:client advanced debug_ms 1/1 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:client advanced rados_mon_op_timeout 900 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:client advanced rados_osd_op_timeout 900 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-24T09:07:28.981 INFO:teuthology.orchestra.run.trial004.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-24T09:07:28.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 -- 10.20.193.4:0/2287653400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa23403f9d0 msgr2=0x7fa23405fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa23403f9d0 0x7fa23405fe80 secure :-1 s=READY pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2540023d0 tx=0x7fa254031040 comp rx=0 tx=0).stop 2026-02-24T09:07:28.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 -- 10.20.193.4:0/2287653400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2601103e0 msgr2=0x7fa260171720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:28.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2601103e0 0x7fa260171720 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa24800d950 tx=0x7fa24800de20 comp rx=0 tx=0).stop 2026-02-24T09:07:28.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 -- 10.20.193.4:0/2287653400 shutdown_connections 2026-02-24T09:07:28.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa23403f9d0 0x7fa23405fe80 unknown :-1 s=CLOSED pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa260110d90 0x7fa2600f9140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2601103e0 0x7fa260171720 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 --2- 10.20.193.4:0/2287653400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa26010f250 0x7fa2600f88e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:28.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 -- 10.20.193.4:0/2287653400 >> 10.20.193.4:0/2287653400 conn(0x7fa2600ec980 msgr2=0x7fa2600eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:28.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 -- 10.20.193.4:0/2287653400 shutdown_connections 2026-02-24T09:07:28.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:28.968+0000 7fa265005640 1 -- 10.20.193.4:0/2287653400 wait complete. 2026-02-24T09:07:29.009 INFO:tasks.cephadm:Deploying OSDs... 2026-02-24T09:07:29.009 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:07:29.009 DEBUG:teuthology.orchestra.run.trial004:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T09:07:29.026 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T09:07:29.026 DEBUG:teuthology.orchestra.run.trial004:> stat /dev/vg_nvme/lv_1 2026-02-24T09:07:29.084 INFO:teuthology.orchestra.run.trial004.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T09:07:29.084 INFO:teuthology.orchestra.run.trial004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:29.084 INFO:teuthology.orchestra.run.trial004.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-24T09:07:29.084 INFO:teuthology.orchestra.run.trial004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:29.084 INFO:teuthology.orchestra.run.trial004.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:29.084 INFO:teuthology.orchestra.run.trial004.stdout:Access: 2026-02-24 09:07:06.663604403 +0000 2026-02-24T09:07:29.084 INFO:teuthology.orchestra.run.trial004.stdout:Modify: 2026-02-24 09:05:42.556141364 +0000 2026-02-24T09:07:29.084 INFO:teuthology.orchestra.run.trial004.stdout:Change: 2026-02-24 09:05:42.556141364 +0000 2026-02-24T09:07:29.085 INFO:teuthology.orchestra.run.trial004.stdout: Birth: 2026-02-24 09:05:42.556141364 +0000 2026-02-24T09:07:29.085 DEBUG:teuthology.orchestra.run.trial004:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T09:07:29.145 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial004=x;trial014=y;trial090=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: Saving service mgr spec with placement trial004=x;trial014=y;trial090=z;count:3 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: Deploying daemon mgr.z on trial090 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1002409269' entity='client.admin' 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:07:29.146 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2935621479' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2411656796' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4011476989' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1390168776' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4001836838' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/14706969' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3756215298' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3712150437' entity='client.admin' 2026-02-24T09:07:29.147 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2925286419' entity='client.admin' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3260353127' entity='client.admin' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/951877145' entity='client.admin' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3181437839' entity='client.admin' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4020548321' entity='client.admin' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2346945916' entity='client.admin' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3602838799' entity='client.admin' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/25758951' entity='client.admin' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2856118056' entity='client.admin' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.148 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.149 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:29.150 INFO:teuthology.orchestra.run.trial004.stderr:1+0 records in 2026-02-24T09:07:29.150 INFO:teuthology.orchestra.run.trial004.stderr:1+0 records out 2026-02-24T09:07:29.150 INFO:teuthology.orchestra.run.trial004.stderr:512 bytes copied, 0.000177413 s, 2.9 MB/s 2026-02-24T09:07:29.150 DEBUG:teuthology.orchestra.run.trial004:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T09:07:29.207 DEBUG:teuthology.orchestra.run.trial004:> stat /dev/vg_nvme/lv_2 2026-02-24T09:07:29.265 INFO:teuthology.orchestra.run.trial004.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T09:07:29.265 INFO:teuthology.orchestra.run.trial004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:29.265 INFO:teuthology.orchestra.run.trial004.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-24T09:07:29.265 INFO:teuthology.orchestra.run.trial004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:29.266 INFO:teuthology.orchestra.run.trial004.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:29.266 INFO:teuthology.orchestra.run.trial004.stdout:Access: 2026-02-24 09:07:06.697604238 +0000 2026-02-24T09:07:29.266 INFO:teuthology.orchestra.run.trial004.stdout:Modify: 2026-02-24 09:05:42.556141364 +0000 2026-02-24T09:07:29.266 INFO:teuthology.orchestra.run.trial004.stdout:Change: 2026-02-24 09:05:42.556141364 +0000 2026-02-24T09:07:29.266 INFO:teuthology.orchestra.run.trial004.stdout: Birth: 2026-02-24 09:05:42.556141364 +0000 2026-02-24T09:07:29.266 DEBUG:teuthology.orchestra.run.trial004:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T09:07:29.332 INFO:teuthology.orchestra.run.trial004.stderr:1+0 records in 2026-02-24T09:07:29.332 INFO:teuthology.orchestra.run.trial004.stderr:1+0 records out 2026-02-24T09:07:29.332 INFO:teuthology.orchestra.run.trial004.stderr:512 bytes copied, 0.000152847 s, 3.3 MB/s 2026-02-24T09:07:29.333 INFO:journalctl@ceph.mgr.z.trial090.stdout:Feb 24 09:07:28 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-z[48604]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:07:29.334 INFO:journalctl@ceph.mgr.z.trial090.stdout:Feb 24 09:07:28 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-z[48604]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:07:29.334 INFO:journalctl@ceph.mgr.z.trial090.stdout:Feb 24 09:07:28 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-z[48604]: from numpy import show_config as show_numpy_config 2026-02-24T09:07:29.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial004=x;trial014=y;trial090=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:29.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: Saving service mgr spec with placement trial004=x;trial014=y;trial090=z;count:3 2026-02-24T09:07:29.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: Deploying daemon mgr.z on trial090 2026-02-24T09:07:29.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:29.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1002409269' entity='client.admin' 2026-02-24T09:07:29.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:07:29.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:07:29.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:07:29.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:29.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2935621479' entity='client.admin' 2026-02-24T09:07:29.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2411656796' entity='client.admin' 2026-02-24T09:07:29.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4011476989' entity='client.admin' 2026-02-24T09:07:29.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1390168776' entity='client.admin' 2026-02-24T09:07:29.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4001836838' entity='client.admin' 2026-02-24T09:07:29.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/14706969' entity='client.admin' 2026-02-24T09:07:29.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3756215298' entity='client.admin' 2026-02-24T09:07:29.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3712150437' entity='client.admin' 2026-02-24T09:07:29.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2925286419' entity='client.admin' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3260353127' entity='client.admin' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/951877145' entity='client.admin' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3181437839' entity='client.admin' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4020548321' entity='client.admin' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2346945916' entity='client.admin' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3602838799' entity='client.admin' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/25758951' entity='client.admin' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2856118056' entity='client.admin' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.338 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.339 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.339 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.339 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:29.339 DEBUG:teuthology.orchestra.run.trial004:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial004=x;trial014=y;trial090=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: Saving service mgr spec with placement trial004=x;trial014=y;trial090=z;count:3 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: Deploying daemon mgr.z on trial090 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1002409269' entity='client.admin' 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2935621479' entity='client.admin' 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2411656796' entity='client.admin' 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4011476989' entity='client.admin' 2026-02-24T09:07:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1390168776' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4001836838' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/14706969' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3756215298' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3712150437' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2925286419' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3260353127' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/951877145' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3181437839' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4020548321' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? ' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2346945916' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3602838799' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/25758951' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2856118056' entity='client.admin' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:29.397 DEBUG:teuthology.orchestra.run.trial004:> stat /dev/vg_nvme/lv_3 2026-02-24T09:07:29.455 INFO:teuthology.orchestra.run.trial004.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T09:07:29.455 INFO:teuthology.orchestra.run.trial004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:29.455 INFO:teuthology.orchestra.run.trial004.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-24T09:07:29.455 INFO:teuthology.orchestra.run.trial004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:29.455 INFO:teuthology.orchestra.run.trial004.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:29.455 INFO:teuthology.orchestra.run.trial004.stdout:Access: 2026-02-24 09:07:06.731604074 +0000 2026-02-24T09:07:29.455 INFO:teuthology.orchestra.run.trial004.stdout:Modify: 2026-02-24 09:05:42.555141401 +0000 2026-02-24T09:07:29.455 INFO:teuthology.orchestra.run.trial004.stdout:Change: 2026-02-24 09:05:42.555141401 +0000 2026-02-24T09:07:29.456 INFO:teuthology.orchestra.run.trial004.stdout: Birth: 2026-02-24 09:05:42.555141401 +0000 2026-02-24T09:07:29.456 DEBUG:teuthology.orchestra.run.trial004:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T09:07:29.519 INFO:teuthology.orchestra.run.trial004.stderr:1+0 records in 2026-02-24T09:07:29.519 INFO:teuthology.orchestra.run.trial004.stderr:1+0 records out 2026-02-24T09:07:29.519 INFO:teuthology.orchestra.run.trial004.stderr:512 bytes copied, 0.000167976 s, 3.0 MB/s 2026-02-24T09:07:29.520 DEBUG:teuthology.orchestra.run.trial004:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T09:07:29.578 DEBUG:teuthology.orchestra.run.trial004:> stat /dev/vg_nvme/lv_4 2026-02-24T09:07:29.635 INFO:teuthology.orchestra.run.trial004.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T09:07:29.635 INFO:teuthology.orchestra.run.trial004.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:29.636 INFO:teuthology.orchestra.run.trial004.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-24T09:07:29.636 INFO:teuthology.orchestra.run.trial004.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:29.636 INFO:teuthology.orchestra.run.trial004.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:29.636 INFO:teuthology.orchestra.run.trial004.stdout:Access: 2026-02-24 09:07:06.763603919 +0000 2026-02-24T09:07:29.636 INFO:teuthology.orchestra.run.trial004.stdout:Modify: 2026-02-24 09:05:42.555141401 +0000 2026-02-24T09:07:29.636 INFO:teuthology.orchestra.run.trial004.stdout:Change: 2026-02-24 09:05:42.555141401 +0000 2026-02-24T09:07:29.636 INFO:teuthology.orchestra.run.trial004.stdout: Birth: 2026-02-24 09:05:42.555141401 +0000 2026-02-24T09:07:29.636 DEBUG:teuthology.orchestra.run.trial004:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T09:07:29.699 INFO:teuthology.orchestra.run.trial004.stderr:1+0 records in 2026-02-24T09:07:29.699 INFO:teuthology.orchestra.run.trial004.stderr:1+0 records out 2026-02-24T09:07:29.700 INFO:teuthology.orchestra.run.trial004.stderr:512 bytes copied, 0.000141205 s, 3.6 MB/s 2026-02-24T09:07:29.701 DEBUG:teuthology.orchestra.run.trial004:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T09:07:29.758 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T09:07:29.758 DEBUG:teuthology.orchestra.run.trial014:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T09:07:29.775 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T09:07:29.775 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_1 2026-02-24T09:07:29.830 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T09:07:29.831 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:29.831 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-24T09:07:29.831 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:29.831 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:29.831 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-24 09:07:28.384461779 +0000 2026-02-24T09:07:29.831 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-24 09:05:53.635840531 +0000 2026-02-24T09:07:29.831 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-24 09:05:53.635840531 +0000 2026-02-24T09:07:29.831 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-24 09:05:53.635840531 +0000 2026-02-24T09:07:29.832 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T09:07:29.843 INFO:journalctl@ceph.mgr.y.trial014.stdout:Feb 24 09:07:29 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-y[48056]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T09:07:29.843 INFO:journalctl@ceph.mgr.y.trial014.stdout:Feb 24 09:07:29 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-y[48056]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T09:07:29.843 INFO:journalctl@ceph.mgr.y.trial014.stdout:Feb 24 09:07:29 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-y[48056]: from numpy import show_config as show_numpy_config 2026-02-24T09:07:29.867 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-24T09:07:29.868 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-24T09:07:29.868 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000154296 s, 3.3 MB/s 2026-02-24T09:07:29.869 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T09:07:29.926 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_2 2026-02-24T09:07:29.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: Deploying daemon mgr.y on trial014 2026-02-24T09:07:29.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2287653400' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-24T09:07:29.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:29.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:29.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:07:29.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:07:29.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:29.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:29.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:29.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:29.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:29.983 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T09:07:29.983 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:29.983 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-24T09:07:29.983 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:29.983 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:29.983 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-24 09:07:28.385461753 +0000 2026-02-24T09:07:29.983 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-24 09:05:53.636840505 +0000 2026-02-24T09:07:29.983 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-24 09:05:53.636840505 +0000 2026-02-24T09:07:29.983 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-24 09:05:53.636840505 +0000 2026-02-24T09:07:29.984 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T09:07:30.046 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-24T09:07:30.046 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-24T09:07:30.046 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000151311 s, 3.4 MB/s 2026-02-24T09:07:30.047 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T09:07:30.105 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_3 2026-02-24T09:07:30.161 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T09:07:30.161 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:30.162 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-24T09:07:30.162 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:30.162 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:30.162 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-24 09:07:28.385461753 +0000 2026-02-24T09:07:30.162 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-24 09:05:53.635840531 +0000 2026-02-24T09:07:30.162 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-24 09:05:53.635840531 +0000 2026-02-24T09:07:30.162 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-24 09:05:53.635840531 +0000 2026-02-24T09:07:30.162 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T09:07:30.221 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: Deploying daemon mgr.y on trial014 2026-02-24T09:07:30.221 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2287653400' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-24T09:07:30.222 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.222 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.222 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.222 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.222 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:30.222 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:30.222 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.222 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:07:30.222 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:07:30.222 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:30.223 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.223 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.223 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:30.223 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:30.223 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:30.223 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.224 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-24T09:07:30.224 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-24T09:07:30.224 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000164424 s, 3.1 MB/s 2026-02-24T09:07:30.225 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T09:07:30.281 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_4 2026-02-24T09:07:30.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: Deploying daemon mgr.y on trial014 2026-02-24T09:07:30.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2287653400' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-24T09:07:30.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:30.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:30.338 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T09:07:30.338 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:30.338 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 1315 Links: 1 2026-02-24T09:07:30.338 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:30.339 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:30.339 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-24 09:07:28.385461753 +0000 2026-02-24T09:07:30.339 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-24 09:05:53.636840505 +0000 2026-02-24T09:07:30.339 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-24 09:05:53.636840505 +0000 2026-02-24T09:07:30.339 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-24 09:05:53.636840505 +0000 2026-02-24T09:07:30.339 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T09:07:30.400 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-24T09:07:30.401 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-24T09:07:30.401 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000158583 s, 3.2 MB/s 2026-02-24T09:07:30.402 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T09:07:30.460 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-24T09:07:30.460 DEBUG:teuthology.orchestra.run.trial090:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T09:07:30.478 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T09:07:30.478 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_1 2026-02-24T09:07:30.535 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T09:07:30.536 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:30.536 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-24T09:07:30.536 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:30.536 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:30.536 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-24 09:07:27.714802876 +0000 2026-02-24T09:07:30.536 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:30.536 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:30.536 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:30.537 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T09:07:30.600 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-24T09:07:30.600 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-24T09:07:30.600 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.00016158 s, 3.2 MB/s 2026-02-24T09:07:30.601 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T09:07:30.658 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_2 2026-02-24T09:07:30.715 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T09:07:30.716 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:30.716 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-24T09:07:30.716 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:30.716 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:30.716 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-24 09:07:27.714802876 +0000 2026-02-24T09:07:30.716 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:30.716 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:30.716 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:30.716 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T09:07:30.781 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-24T09:07:30.781 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-24T09:07:30.781 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000151712 s, 3.4 MB/s 2026-02-24T09:07:30.783 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T09:07:30.840 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_3 2026-02-24T09:07:30.897 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T09:07:30.897 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:30.897 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-24T09:07:30.897 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:30.897 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:30.897 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-24 09:07:27.714802876 +0000 2026-02-24T09:07:30.897 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:30.897 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:30.897 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:30.898 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T09:07:30.960 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-24T09:07:30.960 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-24T09:07:30.960 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000159977 s, 3.2 MB/s 2026-02-24T09:07:30.961 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T09:07:31.019 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_4 2026-02-24T09:07:31.075 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T09:07:31.075 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T09:07:31.075 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-24T09:07:31.075 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:07:31.075 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T09:07:31.075 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-24 09:07:27.714802876 +0000 2026-02-24T09:07:31.076 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:31.076 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:31.076 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-24 09:06:06.661159945 +0000 2026-02-24T09:07:31.076 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T09:07:31.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:30 trial090 ceph-mon[47278]: Reconfiguring mgr.x (unknown last config time)... 2026-02-24T09:07:31.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:30 trial090 ceph-mon[47278]: Reconfiguring daemon mgr.x on trial004 2026-02-24T09:07:31.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:30 trial090 ceph-mon[47278]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:31.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:30 trial090 ceph-mon[47278]: Standby manager daemon z started 2026-02-24T09:07:31.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:30 trial090 ceph-mon[47278]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2026-02-24T09:07:31.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:30 trial090 ceph-mon[47278]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:07:31.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:30 trial090 ceph-mon[47278]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2026-02-24T09:07:31.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:30 trial090 ceph-mon[47278]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:07:31.139 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:31.140 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-24T09:07:31.140 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-24T09:07:31.140 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000148105 s, 3.5 MB/s 2026-02-24T09:07:31.141 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T09:07:31.198 INFO:tasks.cephadm:Deploying osd.0 on trial004 with /dev/vg_nvme/lv_4... 2026-02-24T09:07:31.199 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T09:07:31.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:30 trial004 ceph-mon[41596]: Reconfiguring mgr.x (unknown last config time)... 2026-02-24T09:07:31.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:30 trial004 ceph-mon[41596]: Reconfiguring daemon mgr.x on trial004 2026-02-24T09:07:31.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:30 trial004 ceph-mon[41596]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:31.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:30 trial004 ceph-mon[41596]: Standby manager daemon z started 2026-02-24T09:07:31.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:30 trial004 ceph-mon[41596]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2026-02-24T09:07:31.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:30 trial004 ceph-mon[41596]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:07:31.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:30 trial004 ceph-mon[41596]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2026-02-24T09:07:31.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:30 trial004 ceph-mon[41596]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:07:31.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:31.316 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:30 trial014 ceph-mon[46941]: Reconfiguring mgr.x (unknown last config time)... 2026-02-24T09:07:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:30 trial014 ceph-mon[46941]: Reconfiguring daemon mgr.x on trial004 2026-02-24T09:07:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:30 trial014 ceph-mon[46941]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:30 trial014 ceph-mon[46941]: Standby manager daemon z started 2026-02-24T09:07:31.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:30 trial014 ceph-mon[46941]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2026-02-24T09:07:31.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:30 trial014 ceph-mon[46941]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:07:31.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:30 trial014 ceph-mon[46941]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2026-02-24T09:07:31.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:30 trial014 ceph-mon[46941]: from='mgr.? 10.20.193.90:0/1552473827' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:07:31.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:31.768 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:31.786 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial004:vg_nvme/lv_4 --skip-validation 2026-02-24T09:07:31.943 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:32.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.051+0000 7faa12d8e640 1 -- 10.20.193.4:0/3145001782 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0c10c870 msgr2=0x7faa0c10d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:32.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.051+0000 7faa12d8e640 1 --2- 10.20.193.4:0/3145001782 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0c10c870 0x7faa0c10d1d0 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=4201866373578797514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa0800aa30 tx=0x7faa08030280 comp rx=0 tx=0).stop 2026-02-24T09:07:32.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.051+0000 7faa12d8e640 1 -- 10.20.193.4:0/3145001782 shutdown_connections 2026-02-24T09:07:32.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.051+0000 7faa12d8e640 1 --2- 10.20.193.4:0/3145001782 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0c10c870 0x7faa0c10d1d0 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=4201866373578797514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:32.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.051+0000 7faa12d8e640 1 --2- 10.20.193.4:0/3145001782 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0c10bec0 0x7faa0c10c330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:32.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.051+0000 7faa12d8e640 1 --2- 10.20.193.4:0/3145001782 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa0c10ae90 0x7faa0c10b280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:32.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.051+0000 7faa12d8e640 1 -- 10.20.193.4:0/3145001782 >> 10.20.193.4:0/3145001782 conn(0x7faa0c0e88b0 msgr2=0x7faa0c108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:32.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.051+0000 7faa12d8e640 1 -- 10.20.193.4:0/3145001782 shutdown_connections 2026-02-24T09:07:32.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.051+0000 7faa12d8e640 1 -- 10.20.193.4:0/3145001782 wait complete. 2026-02-24T09:07:32.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.051+0000 7faa12d8e640 1 Processor -- start 2026-02-24T09:07:32.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa12d8e640 1 -- start start 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa12d8e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0c10ae90 0x7faa0c0f42e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa12d8e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0c10bec0 0x7faa0c0f4930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa12d8e640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa0c10c870 0x7faa0c0f5530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa12d8e640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0f5c20 con 0x7faa0c10ae90 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa12d8e640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0f5d90 con 0x7faa0c10c870 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa12d8e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0f5f50 con 0x7faa0c10bec0 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa10b03640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0c10ae90 0x7faa0c0f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa10b03640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0c10ae90 0x7faa0c0f42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56750/0 (socket says 10.20.193.4:56750) 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa10b03640 1 -- 10.20.193.4:0/1031662124 learned_addr learned my addr 10.20.193.4:0/1031662124 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa03fff640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0c10bec0 0x7faa0c0f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa10b03640 1 -- 10.20.193.4:0/1031662124 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0c10bec0 msgr2=0x7faa0c0f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:32.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa10b03640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0c10bec0 0x7faa0c0f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa10b03640 1 -- 10.20.193.4:0/1031662124 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa0c10c870 msgr2=0x7faa0c0f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa10b03640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa0c10c870 0x7faa0c0f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa10b03640 1 -- 10.20.193.4:0/1031662124 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0800a650 con 0x7faa0c10ae90 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa10b03640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0c10ae90 0x7faa0c0f42e0 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9fc00d950 tx=0x7fa9fc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa01ffb640 1 -- 10.20.193.4:0/1031662124 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9fc004540 con 0x7faa0c10ae90 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa01ffb640 1 -- 10.20.193.4:0/1031662124 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9fc009d00 con 0x7faa0c10ae90 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa12d8e640 1 -- 10.20.193.4:0/1031662124 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c0f6230 con 0x7faa0c10ae90 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa01ffb640 1 -- 10.20.193.4:0/1031662124 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9fc0106e0 con 0x7faa0c10ae90 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.052+0000 7faa12d8e640 1 -- 10.20.193.4:0/1031662124 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c0f6790 con 0x7faa0c10ae90 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.053+0000 7faa12d8e640 1 -- 10.20.193.4:0/1031662124 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c175730 con 0x7faa0c10ae90 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.053+0000 7faa01ffb640 1 -- 10.20.193.4:0/1031662124 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 14) ==== 104967+0+0 (secure 0 0 0) 0x7fa9fc0097c0 con 0x7faa0c10ae90 2026-02-24T09:07:32.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.054+0000 7faa01ffb640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9e807a750 0x7fa9e809ac00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:32.062 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.054+0000 7faa01ffb640 1 -- 10.20.193.4:0/1031662124 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fa9fc09cb70 con 0x7faa0c10ae90 2026-02-24T09:07:32.062 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.054+0000 7faa03fff640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9e807a750 0x7fa9e809ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:32.062 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.054+0000 7faa03fff640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9e807a750 0x7fa9e809ac00 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9f4005970 tx=0x7fa9f4005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:32.062 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.056+0000 7faa01ffb640 1 -- 10.20.193.4:0/1031662124 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa9fc0613a0 con 0x7faa0c10ae90 2026-02-24T09:07:32.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.168+0000 7faa12d8e640 1 -- 10.20.193.4:0/1031662124 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7faa0c174f60 con 0x7fa9e807a750 2026-02-24T09:07:32.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:32.309+0000 7faa01ffb640 1 -- 10.20.193.4:0/1031662124 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mgrmap(e 15) ==== 157065+0+0 (secure 0 0 0) 0x7fa9fc060fc0 con 0x7faa0c10ae90 2026-02-24T09:07:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: mgrmap e14: x(active, since 29s), standbys: z 2026-02-24T09:07:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-24T09:07:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: Standby manager daemon y started 2026-02-24T09:07:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2026-02-24T09:07:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:32.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:32.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:32.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:32.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:32.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:32.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: mgrmap e14: x(active, since 29s), standbys: z 2026-02-24T09:07:32.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-24T09:07:32.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: Standby manager daemon y started 2026-02-24T09:07:32.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2026-02-24T09:07:32.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:07:32.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2026-02-24T09:07:32.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:07:32.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:32.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:32.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:32.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:32.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:32.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:32.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:32.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:32.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:32.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:32.674 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: mgrmap e14: x(active, since 29s), standbys: z 2026-02-24T09:07:32.674 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-24T09:07:32.674 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: Standby manager daemon y started 2026-02-24T09:07:32.674 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2026-02-24T09:07:32.674 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2026-02-24T09:07:32.674 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2026-02-24T09:07:32.674 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.? 10.20.193.14:0/3202905612' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:32.675 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:32.676 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:32.676 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:33.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:33.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:07:33.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_4'] 2026-02-24T09:07:33.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:07:33.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial004 2026-02-24T09:07:33.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: mgrmap e15: x(active, since 30s), standbys: z, y 2026-02-24T09:07:33.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-24T09:07:33.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2841532374' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b567c39f-8e27-4d34-80f4-602463d6baa0"} : dispatch 2026-02-24T09:07:33.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2841532374' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b567c39f-8e27-4d34-80f4-602463d6baa0"}]': finished 2026-02-24T09:07:33.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: osdmap e5: 1 total, 0 up, 1 in 2026-02-24T09:07:33.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:33.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:33 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/190122722' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:33.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:33.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:07:33.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_4'] 2026-02-24T09:07:33.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:07:33.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial004 2026-02-24T09:07:33.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: mgrmap e15: x(active, since 30s), standbys: z, y 2026-02-24T09:07:33.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-24T09:07:33.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2841532374' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b567c39f-8e27-4d34-80f4-602463d6baa0"} : dispatch 2026-02-24T09:07:33.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2841532374' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b567c39f-8e27-4d34-80f4-602463d6baa0"}]': finished 2026-02-24T09:07:33.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: osdmap e5: 1 total, 0 up, 1 in 2026-02-24T09:07:33.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:33.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:33 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/190122722' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:33.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:33.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:07:33.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_4'] 2026-02-24T09:07:33.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:07:33.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial004 2026-02-24T09:07:33.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: mgrmap e15: x(active, since 30s), standbys: z, y 2026-02-24T09:07:33.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-24T09:07:33.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2841532374' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b567c39f-8e27-4d34-80f4-602463d6baa0"} : dispatch 2026-02-24T09:07:33.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2841532374' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b567c39f-8e27-4d34-80f4-602463d6baa0"}]': finished 2026-02-24T09:07:33.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: osdmap e5: 1 total, 0 up, 1 in 2026-02-24T09:07:33.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:33.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:33 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/190122722' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:34.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:34 trial090 ceph-mon[47278]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:34.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:34 trial014 ceph-mon[46941]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:34.603 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:34 trial004 ceph-mon[41596]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:35.433 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:35 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:07:35.433 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:35 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:35.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:35 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:07:35.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:35 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:35.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:35 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:07:35.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:35 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:36.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:36 trial090 ceph-mon[47278]: Deploying daemon osd.0 on trial004 2026-02-24T09:07:36.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:07:36.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:36.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:36 trial090 ceph-mon[47278]: Deploying daemon osd.0 on trial004 2026-02-24T09:07:36.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:36 trial090 ceph-mon[47278]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:36.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:36 trial014 ceph-mon[46941]: Deploying daemon osd.0 on trial004 2026-02-24T09:07:36.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:07:36.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:36.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:36 trial014 ceph-mon[46941]: Deploying daemon osd.0 on trial004 2026-02-24T09:07:36.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:36 trial014 ceph-mon[46941]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:36.676 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:36 trial004 ceph-mon[41596]: Deploying daemon osd.0 on trial004 2026-02-24T09:07:36.676 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T09:07:36.676 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:36.676 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:36 trial004 ceph-mon[41596]: Deploying daemon osd.0 on trial004 2026-02-24T09:07:36.677 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:36 trial004 ceph-mon[41596]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:38.112 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:38.112 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:38.112 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:37 trial004 ceph-mon[41596]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:37 trial090 ceph-mon[47278]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:37 trial014 ceph-mon[46941]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:39.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.436+0000 7faa01ffb640 1 -- 10.20.193.4:0/1031662124 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7faa0c174f60 con 0x7fa9e807a750 2026-02-24T09:07:39.441 INFO:teuthology.orchestra.run.trial004.stdout:Created osd(s) 0 on host 'trial004' 2026-02-24T09:07:39.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 -- 10.20.193.4:0/1031662124 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9e807a750 msgr2=0x7fa9e809ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:39.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9e807a750 0x7fa9e809ac00 secure :-1 s=READY pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9f4005970 tx=0x7fa9f4005900 comp rx=0 tx=0).stop 2026-02-24T09:07:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 -- 10.20.193.4:0/1031662124 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0c10ae90 msgr2=0x7faa0c0f42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0c10ae90 0x7faa0c0f42e0 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9fc00d950 tx=0x7fa9fc00de20 comp rx=0 tx=0).stop 2026-02-24T09:07:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 -- 10.20.193.4:0/1031662124 shutdown_connections 2026-02-24T09:07:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9e807a750 0x7fa9e809ac00 unknown :-1 s=CLOSED pgs=76 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa0c10c870 0x7faa0c0f5530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0c10bec0 0x7faa0c0f4930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 --2- 10.20.193.4:0/1031662124 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0c10ae90 0x7faa0c0f42e0 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 -- 10.20.193.4:0/1031662124 >> 10.20.193.4:0/1031662124 conn(0x7faa0c0e88b0 msgr2=0x7faa0c0ea560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 -- 10.20.193.4:0/1031662124 shutdown_connections 2026-02-24T09:07:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:39.439+0000 7faa12d8e640 1 -- 10.20.193.4:0/1031662124 wait complete. 2026-02-24T09:07:39.484 DEBUG:teuthology.orchestra.run.trial004:osd.0> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.0.service 2026-02-24T09:07:39.486 INFO:tasks.cephadm:Deploying osd.1 on trial014 with /dev/vg_nvme/lv_4... 2026-02-24T09:07:39.487 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T09:07:39.602 INFO:teuthology.orchestra.run.trial014.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.b/config 2026-02-24T09:07:40.068 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:07:40.081 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:39 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.082 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:39 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.082 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:39 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.082 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:39 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.082 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:39 trial014 ceph-mon[46941]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:40.082 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:39 trial014 ceph-mon[46941]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:07:40.084 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial014:vg_nvme/lv_4 --skip-validation 2026-02-24T09:07:40.199 INFO:teuthology.orchestra.run.trial014.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.b/config 2026-02-24T09:07:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:39 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:39 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:39 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:39 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:39 trial004 ceph-mon[41596]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:40.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:39 trial004 ceph-mon[41596]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:07:40.215 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:07:39 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0[61127]: 2026-02-24T09:07:39.722+0000 7f998e1da780 -1 osd.0 0 log_to_monitors true 2026-02-24T09:07:40.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 -- 10.20.193.14:0/104758485 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3484110d90 msgr2=0x7f3484171720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:40.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 --2- 10.20.193.14:0/104758485 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3484110d90 0x7f3484171720 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=1719168022926616087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f348000aa30 tx=0x7f3480030280 comp rx=0 tx=0).stop 2026-02-24T09:07:40.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 -- 10.20.193.14:0/104758485 shutdown_connections 2026-02-24T09:07:40.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 --2- 10.20.193.14:0/104758485 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3484110d90 0x7f3484171720 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=1719168022926616087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:40.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 --2- 10.20.193.14:0/104758485 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f34841103e0 0x7f3484110850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:40.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 --2- 10.20.193.14:0/104758485 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f348410f250 0x7f348410f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:40.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 -- 10.20.193.14:0/104758485 >> 10.20.193.14:0/104758485 conn(0x7f34840ec980 msgr2=0x7f348410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:40.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 -- 10.20.193.14:0/104758485 shutdown_connections 2026-02-24T09:07:40.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 -- 10.20.193.14:0/104758485 wait complete. 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 Processor -- start 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 -- start start 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f348410f250 0x7f34840f88f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f34841103e0 0x7f3484171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3484110d90 0x7f34840f9150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f34840f9d40 con 0x7f348410f250 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f34840f9eb0 con 0x7f34841103e0 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.299+0000 7f348b177640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f34840fa070 con 0x7f3484110d90 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f347bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f34841103e0 0x7f3484171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f347bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f34841103e0 0x7f3484171720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.14:55672/0 (socket says 10.20.193.14:55672) 2026-02-24T09:07:40.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f347bfff640 1 -- 10.20.193.14:0/4269668589 learned_addr learned my addr 10.20.193.14:0/4269668589 (peer_addr_for_me v2:10.20.193.14:0/0) 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f34896ed640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3484110d90 0x7f34840f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f3488eec640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f348410f250 0x7f34840f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f347bfff640 1 -- 10.20.193.14:0/4269668589 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3484110d90 msgr2=0x7f34840f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f347bfff640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3484110d90 0x7f34840f9150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f347bfff640 1 -- 10.20.193.14:0/4269668589 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f348410f250 msgr2=0x7f34840f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f347bfff640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f348410f250 0x7f34840f88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f347bfff640 1 -- 10.20.193.14:0/4269668589 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348000a650 con 0x7f34841103e0 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f347bfff640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f34841103e0 0x7f3484171720 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f346c00d950 tx=0x7f346c00de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f3479ffb640 1 -- 10.20.193.14:0/4269668589 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f346c004540 con 0x7f34841103e0 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f348b177640 1 -- 10.20.193.14:0/4269668589 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34840fa350 con 0x7f34841103e0 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f3479ffb640 1 -- 10.20.193.14:0/4269668589 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f346c009d00 con 0x7f34841103e0 2026-02-24T09:07:40.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f3479ffb640 1 -- 10.20.193.14:0/4269668589 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f346c0106e0 con 0x7f34841103e0 2026-02-24T09:07:40.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f348b177640 1 -- 10.20.193.14:0/4269668589 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34840fa820 con 0x7f34841103e0 2026-02-24T09:07:40.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.300+0000 7f348b177640 1 -- 10.20.193.14:0/4269668589 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3484175740 con 0x7f34841103e0 2026-02-24T09:07:40.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.302+0000 7f3479ffb640 1 -- 10.20.193.14:0/4269668589 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 15) ==== 157065+0+0 (secure 0 0 0) 0x7f346c0097c0 con 0x7f34841103e0 2026-02-24T09:07:40.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.302+0000 7f3479ffb640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34600b5650 0x7f34600d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:40.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.303+0000 7f3479ffb640 1 -- 10.20.193.14:0/4269668589 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1265+0+0 (secure 0 0 0) 0x7f346c0e5610 con 0x7f34841103e0 2026-02-24T09:07:40.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.303+0000 7f3488eec640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34600b5650 0x7f34600d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:40.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.303+0000 7f3488eec640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34600b5650 0x7f34600d5b00 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3474005970 tx=0x7f3474005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:40.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.304+0000 7f3479ffb640 1 -- 10.20.193.14:0/4269668589 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f346c0a9bd0 con 0x7f34841103e0 2026-02-24T09:07:40.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:39 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:39 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:39 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:39 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:40.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:39 trial090 ceph-mon[47278]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:40.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:39 trial090 ceph-mon[47278]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T09:07:40.415 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:40.415+0000 7f348b177640 1 -- 10.20.193.14:0/4269668589 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f3484174e70 con 0x7f34600b5650 2026-02-24T09:07:41.231 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.231 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_4'] 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial014 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.232 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:41.233 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:41.233 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:41.233 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T09:07:41.233 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: osdmap e6: 1 total, 0 up, 1 in 2026-02-24T09:07:41.233 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:41.233 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:40 trial014 ceph-mon[46941]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:07:41.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_4'] 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial014 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: osdmap e6: 1 total, 0 up, 1 in 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:40 trial090 ceph-mon[47278]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:07:41.415 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:07:41 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0[61127]: 2026-02-24T09:07:41.085+0000 7f998a15c640 -1 osd.0 0 waiting for initial osdmap 2026-02-24T09:07:41.415 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:07:41 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0[61127]: 2026-02-24T09:07:41.088+0000 7f998201b640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:07:41.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:41.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:41.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:07:41.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_4'] 2026-02-24T09:07:41.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.417 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:07:41.417 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial014 2026-02-24T09:07:41.417 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:41.417 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:41.417 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:41.417 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:41.417 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T09:07:41.417 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: osdmap e6: 1 total, 0 up, 1 in 2026-02-24T09:07:41.417 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:41.417 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:40 trial004 ceph-mon[41596]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:07:42.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f911e6cb-66df-49e1-b032-3df5206c1b44"} : dispatch 2026-02-24T09:07:42.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:07:42.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f911e6cb-66df-49e1-b032-3df5206c1b44"}]': finished 2026-02-24T09:07:42.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: osdmap e7: 2 total, 0 up, 2 in 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='client.? 10.20.193.14:0/1698149574' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f911e6cb-66df-49e1-b032-3df5206c1b44"} : dispatch 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='client.? 10.20.193.14:0/1110360888' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: Detected new or changed devices on trial004 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial004 to 84047M 2026-02-24T09:07:42.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:42.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:42.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:42.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:42.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:42.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:41 trial090 ceph-mon[47278]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f911e6cb-66df-49e1-b032-3df5206c1b44"} : dispatch 2026-02-24T09:07:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:07:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f911e6cb-66df-49e1-b032-3df5206c1b44"}]': finished 2026-02-24T09:07:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: osdmap e7: 2 total, 0 up, 2 in 2026-02-24T09:07:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='client.? 10.20.193.14:0/1698149574' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f911e6cb-66df-49e1-b032-3df5206c1b44"} : dispatch 2026-02-24T09:07:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='client.? 10.20.193.14:0/1110360888' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: Detected new or changed devices on trial004 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial004 to 84047M 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:42.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:42.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:42.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:41 trial014 ceph-mon[46941]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:42.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f911e6cb-66df-49e1-b032-3df5206c1b44"} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f911e6cb-66df-49e1-b032-3df5206c1b44"}]': finished 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: osdmap e7: 2 total, 0 up, 2 in 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='client.? 10.20.193.14:0/1698149574' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f911e6cb-66df-49e1-b032-3df5206c1b44"} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='client.? 10.20.193.14:0/1110360888' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: Detected new or changed devices on trial004 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial004 to 84047M 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:42.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:41 trial004 ceph-mon[41596]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T09:07:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:43 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:07:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:43 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:07:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:43 trial014 ceph-mon[46941]: osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] boot 2026-02-24T09:07:43.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:43 trial014 ceph-mon[46941]: osdmap e8: 2 total, 1 up, 2 in 2026-02-24T09:07:43.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:43 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:43.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:43 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:43.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:43 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:07:43.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:43 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:07:43.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:43 trial004 ceph-mon[41596]: osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] boot 2026-02-24T09:07:43.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:43 trial004 ceph-mon[41596]: osdmap e8: 2 total, 1 up, 2 in 2026-02-24T09:07:43.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:43 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:43.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:43 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:43.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:43 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:07:43.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:43 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:07:43.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:43 trial090 ceph-mon[47278]: osd.0 [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] boot 2026-02-24T09:07:43.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:43 trial090 ceph-mon[47278]: osdmap e8: 2 total, 1 up, 2 in 2026-02-24T09:07:43.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:43 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T09:07:43.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:43 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:44.198 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:07:44.199 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:44.199 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:44 trial014 ceph-mon[46941]: Deploying daemon osd.1 on trial014 2026-02-24T09:07:44.199 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:44 trial014 ceph-mon[46941]: osdmap e9: 2 total, 1 up, 2 in 2026-02-24T09:07:44.199 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:44.199 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:07:44.199 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:44.199 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:44 trial014 ceph-mon[46941]: Deploying daemon osd.1 on trial014 2026-02-24T09:07:44.199 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:44 trial014 ceph-mon[46941]: pgmap v20: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:07:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:44 trial004 ceph-mon[41596]: Deploying daemon osd.1 on trial014 2026-02-24T09:07:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:44 trial004 ceph-mon[41596]: osdmap e9: 2 total, 1 up, 2 in 2026-02-24T09:07:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:07:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:44 trial004 ceph-mon[41596]: Deploying daemon osd.1 on trial014 2026-02-24T09:07:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:44 trial004 ceph-mon[41596]: pgmap v20: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:07:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:44 trial090 ceph-mon[47278]: Deploying daemon osd.1 on trial014 2026-02-24T09:07:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:44 trial090 ceph-mon[47278]: osdmap e9: 2 total, 1 up, 2 in 2026-02-24T09:07:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T09:07:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:44.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:44 trial090 ceph-mon[47278]: Deploying daemon osd.1 on trial014 2026-02-24T09:07:44.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:44 trial090 ceph-mon[47278]: pgmap v20: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:46.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:46 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:46.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:46 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:46.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:46 trial014 ceph-mon[46941]: pgmap v21: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:46.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:46 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:46.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:46 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:46.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:46 trial090 ceph-mon[47278]: pgmap v21: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:46.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:46 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:46.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:46 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:46.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:46 trial004 ceph-mon[41596]: pgmap v21: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:47.414 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.412+0000 7f3479ffb640 1 -- 10.20.193.14:0/4269668589 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f3484174e70 con 0x7f34600b5650 2026-02-24T09:07:47.414 INFO:teuthology.orchestra.run.trial014.stdout:Created osd(s) 1 on host 'trial014' 2026-02-24T09:07:47.417 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 -- 10.20.193.14:0/4269668589 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34600b5650 msgr2=0x7f34600d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:47.417 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34600b5650 0x7f34600d5b00 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3474005970 tx=0x7f3474005900 comp rx=0 tx=0).stop 2026-02-24T09:07:47.417 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 -- 10.20.193.14:0/4269668589 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f34841103e0 msgr2=0x7f3484171720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:47.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f34841103e0 0x7f3484171720 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f346c00d950 tx=0x7f346c00de20 comp rx=0 tx=0).stop 2026-02-24T09:07:47.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 -- 10.20.193.14:0/4269668589 shutdown_connections 2026-02-24T09:07:47.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34600b5650 0x7f34600d5b00 unknown :-1 s=CLOSED pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:47.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3484110d90 0x7f34840f9150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:47.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f34841103e0 0x7f3484171720 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:47.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 --2- 10.20.193.14:0/4269668589 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f348410f250 0x7f34840f88f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:47.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 -- 10.20.193.14:0/4269668589 >> 10.20.193.14:0/4269668589 conn(0x7f34840ec980 msgr2=0x7f34840eeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:47.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 -- 10.20.193.14:0/4269668589 shutdown_connections 2026-02-24T09:07:47.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:07:47.415+0000 7f348b177640 1 -- 10.20.193.14:0/4269668589 wait complete. 2026-02-24T09:07:47.453 DEBUG:teuthology.orchestra.run.trial014:osd.1> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.1.service 2026-02-24T09:07:47.454 INFO:tasks.cephadm:Deploying osd.2 on trial090 with /dev/vg_nvme/lv_4... 2026-02-24T09:07:47.454 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T09:07:47.570 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:07:47.732 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:07:47 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1[52698]: 2026-02-24T09:07:47.729+0000 7fe47e842780 -1 osd.1 0 log_to_monitors true 2026-02-24T09:07:47.988 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:47 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:47.988 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:47 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:47.988 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:47 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:47.989 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:47 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:47.989 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:47 trial090 ceph-mon[47278]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:07:47.989 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:47 trial090 ceph-mon[47278]: from='osd.1 [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:07:48.037 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:07:48.054 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_4 --skip-validation 2026-02-24T09:07:48.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:47 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:48.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:47 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:48.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:47 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:48.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:47 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:48.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:47 trial014 ceph-mon[46941]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:07:48.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:47 trial014 ceph-mon[46941]: from='osd.1 [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:07:48.170 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:07:48.210 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:47 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:48.211 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:47 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:48.211 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:47 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:48.211 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:47 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:48.211 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:47 trial004 ceph-mon[41596]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:07:48.211 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:47 trial004 ceph-mon[41596]: from='osd.1 [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T09:07:48.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.268+0000 7f6b6a776640 1 -- 10.20.193.90:0/2152851724 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6b6410f250 msgr2=0x7f6b6410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:48.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.268+0000 7f6b6a776640 1 --2- 10.20.193.90:0/2152851724 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6b6410f250 0x7f6b6410f640 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=1381902097502104945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b50009950 tx=0x7f6b5002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:07:48.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.268+0000 7f6b6a776640 1 -- 10.20.193.90:0/2152851724 shutdown_connections 2026-02-24T09:07:48.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.268+0000 7f6b6a776640 1 --2- 10.20.193.90:0/2152851724 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6b64110d90 0x7f6b64171720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:48.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.268+0000 7f6b6a776640 1 --2- 10.20.193.90:0/2152851724 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6b641103e0 0x7f6b64110850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:48.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.268+0000 7f6b6a776640 1 --2- 10.20.193.90:0/2152851724 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6b6410f250 0x7f6b6410f640 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=1381902097502104945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:48.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.268+0000 7f6b6a776640 1 -- 10.20.193.90:0/2152851724 >> 10.20.193.90:0/2152851724 conn(0x7f6b640ec980 msgr2=0x7f6b6410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.268+0000 7f6b6a776640 1 -- 10.20.193.90:0/2152851724 shutdown_connections 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.268+0000 7f6b6a776640 1 -- 10.20.193.90:0/2152851724 wait complete. 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b6a776640 1 Processor -- start 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b6a776640 1 -- start start 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b6a776640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6b6410f250 0x7f6b640f8950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b6a776640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6b641103e0 0x7f6b64171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b6a776640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6b64110d90 0x7f6b640f91b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b6a776640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f6b640f9da0 con 0x7f6b6410f250 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b6a776640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f6b640f9f10 con 0x7f6b641103e0 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b6a776640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b640fa0d0 con 0x7f6b64110d90 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b68cec640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6b64110d90 0x7f6b640f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:48.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b68cec640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6b64110d90 0x7f6b640f91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:44310/0 (socket says 10.20.193.90:44310) 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b68cec640 1 -- 10.20.193.90:0/466160535 learned_addr learned my addr 10.20.193.90:0/466160535 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b63fff640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6b6410f250 0x7f6b640f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b637fe640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6b641103e0 0x7f6b64171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b68cec640 1 -- 10.20.193.90:0/466160535 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6b641103e0 msgr2=0x7f6b64171720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b68cec640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6b641103e0 0x7f6b64171720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b68cec640 1 -- 10.20.193.90:0/466160535 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6b6410f250 msgr2=0x7f6b640f8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b68cec640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6b6410f250 0x7f6b640f8950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b68cec640 1 -- 10.20.193.90:0/466160535 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b50009570 con 0x7f6b64110d90 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b68cec640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6b64110d90 0x7f6b640f91b0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b58006e90 tx=0x7f6b5800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b617fa640 1 -- 10.20.193.90:0/466160535 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b58005500 con 0x7f6b64110d90 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b617fa640 1 -- 10.20.193.90:0/466160535 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6b58005e10 con 0x7f6b64110d90 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b6a776640 1 -- 10.20.193.90:0/466160535 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b640fa3b0 con 0x7f6b64110d90 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b617fa640 1 -- 10.20.193.90:0/466160535 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b58003a90 con 0x7f6b64110d90 2026-02-24T09:07:48.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.269+0000 7f6b6a776640 1 -- 10.20.193.90:0/466160535 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b640fa880 con 0x7f6b64110d90 2026-02-24T09:07:48.277 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.270+0000 7f6b6a776640 1 -- 10.20.193.90:0/466160535 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b64175790 con 0x7f6b64110d90 2026-02-24T09:07:48.277 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.271+0000 7f6b617fa640 1 -- 10.20.193.90:0/466160535 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157065+0+0 (secure 0 0 0) 0x7f6b5800c840 con 0x7f6b64110d90 2026-02-24T09:07:48.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.272+0000 7f6b617fa640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6b380b56d0 0x7f6b380d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:48.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.272+0000 7f6b63fff640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6b380b56d0 0x7f6b380d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:48.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.272+0000 7f6b617fa640 1 -- 10.20.193.90:0/466160535 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1875+0+0 (secure 0 0 0) 0x7f6b580e6250 con 0x7f6b64110d90 2026-02-24T09:07:48.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.273+0000 7f6b63fff640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6b380b56d0 0x7f6b380d5b80 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b50002d80 tx=0x7f6b5003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:48.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.273+0000 7f6b617fa640 1 -- 10.20.193.90:0/466160535 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f6b580aa5f0 con 0x7f6b64110d90 2026-02-24T09:07:48.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:48.383+0000 7f6b6a776640 1 -- 10.20.193.90:0/466160535 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f6b64174ec0 con 0x7f6b380b56d0 2026-02-24T09:07:49.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:49.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:49.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: osdmap e10: 2 total, 1 up, 2 in 2026-02-24T09:07:49.136 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:49.137 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:07:49.137 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:48 trial090 ceph-mon[47278]: from='osd.1 [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:07:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T09:07:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: osdmap e10: 2 total, 1 up, 2 in 2026-02-24T09:07:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:07:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:48 trial004 ceph-mon[41596]: from='osd.1 [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:07:49.319 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:07:49 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1[52698]: 2026-02-24T09:07:49.049+0000 7fe47a7c4640 -1 osd.1 0 waiting for initial osdmap 2026-02-24T09:07:49.320 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:07:49 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1[52698]: 2026-02-24T09:07:49.051+0000 7fe47668b640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:07:49.320 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:49.320 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.320 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.321 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:49.321 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.321 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.321 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.321 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.322 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.322 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:49.322 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:49.322 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:49.322 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:49.322 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T09:07:49.322 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: osdmap e10: 2 total, 1 up, 2 in 2026-02-24T09:07:49.323 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:49.323 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:07:49.323 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:48 trial014 ceph-mon[46941]: from='osd.1 [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:07:50.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:50.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:07:50.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_4'] 2026-02-24T09:07:50.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:07:50.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial090 2026-02-24T09:07:50.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4a3bca-f02a-4c44-bf95-807c6df67daa"} : dispatch 2026-02-24T09:07:50.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/4090347787' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4a3bca-f02a-4c44-bf95-807c6df67daa"} : dispatch 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd4a3bca-f02a-4c44-bf95-807c6df67daa"}]': finished 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: osdmap e11: 3 total, 1 up, 3 in 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/2464092759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:50.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:50.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:50.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:50.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:50.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:50.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:50.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:07:50.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_4'] 2026-02-24T09:07:50.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:07:50.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial090 2026-02-24T09:07:50.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4a3bca-f02a-4c44-bf95-807c6df67daa"} : dispatch 2026-02-24T09:07:50.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='client.? 10.20.193.90:0/4090347787' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4a3bca-f02a-4c44-bf95-807c6df67daa"} : dispatch 2026-02-24T09:07:50.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:07:50.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd4a3bca-f02a-4c44-bf95-807c6df67daa"}]': finished 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: osdmap e11: 3 total, 1 up, 3 in 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='client.? 10.20.193.90:0/2464092759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:50.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:50.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:50.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:50.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_4'] 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial090 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4a3bca-f02a-4c44-bf95-807c6df67daa"} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='client.? 10.20.193.90:0/4090347787' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4a3bca-f02a-4c44-bf95-807c6df67daa"} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd4a3bca-f02a-4c44-bf95-807c6df67daa"}]': finished 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: osdmap e11: 3 total, 1 up, 3 in 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='client.? 10.20.193.90:0/2464092759' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:51.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:50 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:07:51.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:50 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:07:51.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:50 trial090 ceph-mon[47278]: Detected new or changed devices on trial014 2026-02-24T09:07:51.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:50 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial014 to 84047M 2026-02-24T09:07:51.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:50 trial090 ceph-mon[47278]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:51.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:50 trial090 ceph-mon[47278]: osd.1 [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] boot 2026-02-24T09:07:51.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:50 trial090 ceph-mon[47278]: osdmap e12: 3 total, 2 up, 3 in 2026-02-24T09:07:51.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:50 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:51.052 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:50 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:51.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:50 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:07:51.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:50 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:07:51.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:50 trial004 ceph-mon[41596]: Detected new or changed devices on trial014 2026-02-24T09:07:51.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:50 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial014 to 84047M 2026-02-24T09:07:51.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:50 trial004 ceph-mon[41596]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:51.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:50 trial004 ceph-mon[41596]: osd.1 [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] boot 2026-02-24T09:07:51.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:50 trial004 ceph-mon[41596]: osdmap e12: 3 total, 2 up, 3 in 2026-02-24T09:07:51.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:50 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:51.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:50 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:51.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:50 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:07:51.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:50 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:07:51.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:50 trial014 ceph-mon[46941]: Detected new or changed devices on trial014 2026-02-24T09:07:51.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:50 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial014 to 84047M 2026-02-24T09:07:51.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:50 trial014 ceph-mon[46941]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T09:07:51.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:50 trial014 ceph-mon[46941]: osd.1 [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] boot 2026-02-24T09:07:51.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:50 trial014 ceph-mon[46941]: osdmap e12: 3 total, 2 up, 3 in 2026-02-24T09:07:51.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:50 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T09:07:51.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:50 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:51.913 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:51 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:07:51.914 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:51 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:51.914 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:51 trial090 ceph-mon[47278]: osdmap e13: 3 total, 2 up, 3 in 2026-02-24T09:07:51.914 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:51 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:51.914 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:51 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:07:51.914 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:51 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:52.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:51 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:07:52.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:51 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:52.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:51 trial004 ceph-mon[41596]: osdmap e13: 3 total, 2 up, 3 in 2026-02-24T09:07:52.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:51 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:52.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:51 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:07:52.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:51 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:52.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:51 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:07:52.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:51 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:52.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:51 trial014 ceph-mon[46941]: osdmap e13: 3 total, 2 up, 3 in 2026-02-24T09:07:52.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:51 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:52.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:51 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T09:07:52.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:51 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:53.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:52 trial090 ceph-mon[47278]: Deploying daemon osd.2 on trial090 2026-02-24T09:07:53.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:52 trial090 ceph-mon[47278]: Deploying daemon osd.2 on trial090 2026-02-24T09:07:53.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:52 trial090 ceph-mon[47278]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:53.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:52 trial004 ceph-mon[41596]: Deploying daemon osd.2 on trial090 2026-02-24T09:07:53.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:52 trial004 ceph-mon[41596]: Deploying daemon osd.2 on trial090 2026-02-24T09:07:53.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:52 trial004 ceph-mon[41596]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:53.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:52 trial014 ceph-mon[46941]: Deploying daemon osd.2 on trial090 2026-02-24T09:07:53.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:52 trial014 ceph-mon[46941]: Deploying daemon osd.2 on trial090 2026-02-24T09:07:53.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:52 trial014 ceph-mon[46941]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:54.182 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:54 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:54.182 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:54 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:54.182 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:54 trial090 ceph-mon[47278]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:54.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:54 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:54.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:54 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:54.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:54 trial014 ceph-mon[46941]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:54.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:54 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:54.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:54 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:54.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:54 trial004 ceph-mon[41596]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:55.455 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.452+0000 7f6b617fa640 1 -- 10.20.193.90:0/466160535 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f6b64174ec0 con 0x7f6b380b56d0 2026-02-24T09:07:55.455 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 2 on host 'trial090' 2026-02-24T09:07:55.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.454+0000 7f6b6a776640 1 -- 10.20.193.90:0/466160535 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6b380b56d0 msgr2=0x7f6b380d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:55.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.454+0000 7f6b6a776640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6b380b56d0 0x7f6b380d5b80 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b50002d80 tx=0x7f6b5003a040 comp rx=0 tx=0).stop 2026-02-24T09:07:55.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.454+0000 7f6b6a776640 1 -- 10.20.193.90:0/466160535 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6b64110d90 msgr2=0x7f6b640f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:55.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.454+0000 7f6b6a776640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6b64110d90 0x7f6b640f91b0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b58006e90 tx=0x7f6b5800edf0 comp rx=0 tx=0).stop 2026-02-24T09:07:55.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.455+0000 7f6b6a776640 1 -- 10.20.193.90:0/466160535 shutdown_connections 2026-02-24T09:07:55.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.455+0000 7f6b6a776640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6b380b56d0 0x7f6b380d5b80 unknown :-1 s=CLOSED pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:55.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.455+0000 7f6b6a776640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6b64110d90 0x7f6b640f91b0 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:55.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.455+0000 7f6b6a776640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6b641103e0 0x7f6b64171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:55.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.455+0000 7f6b6a776640 1 --2- 10.20.193.90:0/466160535 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6b6410f250 0x7f6b640f8950 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:55.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.455+0000 7f6b6a776640 1 -- 10.20.193.90:0/466160535 >> 10.20.193.90:0/466160535 conn(0x7f6b640ec980 msgr2=0x7f6b640eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:55.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.455+0000 7f6b6a776640 1 -- 10.20.193.90:0/466160535 shutdown_connections 2026-02-24T09:07:55.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:07:55.455+0000 7f6b6a776640 1 -- 10.20.193.90:0/466160535 wait complete. 2026-02-24T09:07:55.496 DEBUG:teuthology.orchestra.run.trial090:osd.2> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.2.service 2026-02-24T09:07:55.498 INFO:tasks.cephadm:Deploying osd.3 on trial004 with /dev/vg_nvme/lv_3... 2026-02-24T09:07:55.499 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T09:07:55.620 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:56.028 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:55 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.028 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:55 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.028 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:55 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.028 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:55 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.028 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:55 trial004 ceph-mon[41596]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:56.028 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:55 trial004 ceph-mon[41596]: from='osd.2 [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:07:56.028 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:55 trial004 ceph-mon[41596]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:07:56.081 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:07:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:55 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:55 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:55 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:55 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:55 trial090 ceph-mon[47278]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:55 trial090 ceph-mon[47278]: from='osd.2 [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:07:56.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:55 trial090 ceph-mon[47278]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:07:56.084 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:07:55 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2[53252]: 2026-02-24T09:07:55.779+0000 7f19df644780 -1 osd.2 0 log_to_monitors true 2026-02-24T09:07:56.100 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial004:vg_nvme/lv_3 --skip-validation 2026-02-24T09:07:56.218 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:07:56.241 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:55 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.241 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:55 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.241 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:55 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.241 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:55 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:56.241 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:55 trial014 ceph-mon[46941]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:56.241 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:55 trial014 ceph-mon[46941]: from='osd.2 [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:07:56.241 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:55 trial014 ceph-mon[46941]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T09:07:56.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.321+0000 7fc67cfde640 1 -- 10.20.193.4:0/2513831209 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc67810eb10 msgr2=0x7fc67816f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:56.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.321+0000 7fc67cfde640 1 --2- 10.20.193.4:0/2513831209 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc67810eb10 0x7fc67816f4a0 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=17859708729330410437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc66800aa30 tx=0x7fc668030280 comp rx=0 tx=0).stop 2026-02-24T09:07:56.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.321+0000 7fc67cfde640 1 -- 10.20.193.4:0/2513831209 shutdown_connections 2026-02-24T09:07:56.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.321+0000 7fc67cfde640 1 --2- 10.20.193.4:0/2513831209 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc67810eb10 0x7fc67816f4a0 unknown :-1 s=CLOSED pgs=164 gs=1 cs=0 l=1 c_cookie=17859708729330410437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.321+0000 7fc67cfde640 1 --2- 10.20.193.4:0/2513831209 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc67810e160 0x7fc67810e5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.321+0000 7fc67cfde640 1 --2- 10.20.193.4:0/2513831209 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc67810cfd0 0x7fc67810d3c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.321+0000 7fc67cfde640 1 -- 10.20.193.4:0/2513831209 >> 10.20.193.4:0/2513831209 conn(0x7fc6780ea700 msgr2=0x7fc67810ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:07:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.321+0000 7fc67cfde640 1 -- 10.20.193.4:0/2513831209 shutdown_connections 2026-02-24T09:07:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.321+0000 7fc67cfde640 1 -- 10.20.193.4:0/2513831209 wait complete. 2026-02-24T09:07:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc67cfde640 1 Processor -- start 2026-02-24T09:07:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc67cfde640 1 -- start start 2026-02-24T09:07:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc67cfde640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc67810cfd0 0x7fc678062720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc67cfde640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc67810e160 0x7fc67816f4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc67cfde640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc67810eb10 0x7fc678061030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc67cfde640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fc678061680 con 0x7fc67810eb10 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc67cfde640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fc6780617f0 con 0x7fc67810cfd0 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc67cfde640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6780619b0 con 0x7fc67810e160 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc676d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc67810eb10 0x7fc678061030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc676d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc67810eb10 0x7fc678061030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41626/0 (socket says 10.20.193.4:41626) 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc676d76640 1 -- 10.20.193.4:0/2906745703 learned_addr learned my addr 10.20.193.4:0/2906745703 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc675d74640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc67810e160 0x7fc67816f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc676575640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc67810cfd0 0x7fc678062720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc676d76640 1 -- 10.20.193.4:0/2906745703 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc67810e160 msgr2=0x7fc67816f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc676d76640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc67810e160 0x7fc67816f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc676d76640 1 -- 10.20.193.4:0/2906745703 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc67810cfd0 msgr2=0x7fc678062720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:07:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc676d76640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc67810cfd0 0x7fc678062720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:07:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc676d76640 1 -- 10.20.193.4:0/2906745703 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66800a650 con 0x7fc67810eb10 2026-02-24T09:07:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc676d76640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc67810eb10 0x7fc678061030 secure :-1 s=READY pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc66800a360 tx=0x7fc6680039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc65f7fe640 1 -- 10.20.193.4:0/2906745703 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc66803e070 con 0x7fc67810eb10 2026-02-24T09:07:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc67cfde640 1 -- 10.20.193.4:0/2906745703 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc678061c30 con 0x7fc67810eb10 2026-02-24T09:07:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc65f7fe640 1 -- 10.20.193.4:0/2906745703 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc6680055a0 con 0x7fc67810eb10 2026-02-24T09:07:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc65f7fe640 1 -- 10.20.193.4:0/2906745703 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc668042b40 con 0x7fc67810eb10 2026-02-24T09:07:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.322+0000 7fc67cfde640 1 -- 10.20.193.4:0/2906745703 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6780fa8f0 con 0x7fc67810eb10 2026-02-24T09:07:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.323+0000 7fc67cfde640 1 -- 10.20.193.4:0/2906745703 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc678061f00 con 0x7fc67810eb10 2026-02-24T09:07:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.324+0000 7fc65f7fe640 1 -- 10.20.193.4:0/2906745703 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 15) ==== 157065+0+0 (secure 0 0 0) 0x7fc6680050c0 con 0x7fc67810eb10 2026-02-24T09:07:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.325+0000 7fc65f7fe640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc6500b5650 0x7fc6500d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:07:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.325+0000 7fc676575640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc6500b5650 0x7fc6500d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:07:56.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.325+0000 7fc65f7fe640 1 -- 10.20.193.4:0/2906745703 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2415+0+0 (secure 0 0 0) 0x7fc66810b9c0 con 0x7fc67810eb10 2026-02-24T09:07:56.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.325+0000 7fc676575640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc6500b5650 0x7fc6500d5b00 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc66c006fd0 tx=0x7fc66c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:07:56.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.326+0000 7fc65f7fe640 1 -- 10.20.193.4:0/2906745703 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc6680cfb50 con 0x7fc67810eb10 2026-02-24T09:07:56.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:07:56.435+0000 7fc67cfde640 1 -- 10.20.193.4:0/2906745703 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fc678061f00 con 0x7fc6500b5650 2026-02-24T09:07:57.201 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.201 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.201 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:57.201 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.201 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.201 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_3'] 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial004 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: osdmap e14: 3 total, 2 up, 3 in 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:07:57.202 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:56 trial004 ceph-mon[41596]: from='osd.2 [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:07:57.333 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:07:57 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2[53252]: 2026-02-24T09:07:57.107+0000 7f19db5c6640 -1 osd.2 0 waiting for initial osdmap 2026-02-24T09:07:57.333 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:07:57 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2[53252]: 2026-02-24T09:07:57.110+0000 7f19d3485640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:07:57.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:57.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_3'] 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial004 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T09:07:57.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: osdmap e14: 3 total, 2 up, 3 in 2026-02-24T09:07:57.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:57.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:07:57.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:56 trial090 ceph-mon[47278]: from='osd.2 [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:07:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:07:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_3'] 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial004 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T09:07:57.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: osdmap e14: 3 total, 2 up, 3 in 2026-02-24T09:07:57.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:57.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:07:57.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:56 trial014 ceph-mon[46941]: from='osd.2 [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:07:58.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3004323735' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df7ad596-6759-4a7f-9699-264361763b82"} : dispatch 2026-02-24T09:07:58.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:07:58.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3004323735' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df7ad596-6759-4a7f-9699-264361763b82"}]': finished 2026-02-24T09:07:58.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: osdmap e15: 4 total, 2 up, 4 in 2026-02-24T09:07:58.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1074201509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: Detected new or changed devices on trial090 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial090 to 84047M 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:58.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:58.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:58.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:58.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:58.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:57 trial090 ceph-mon[47278]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:58.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3004323735' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df7ad596-6759-4a7f-9699-264361763b82"} : dispatch 2026-02-24T09:07:58.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:07:58.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3004323735' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df7ad596-6759-4a7f-9699-264361763b82"}]': finished 2026-02-24T09:07:58.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: osdmap e15: 4 total, 2 up, 4 in 2026-02-24T09:07:58.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:58.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:07:58.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:58.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1074201509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: Detected new or changed devices on trial090 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial090 to 84047M 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:58.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:58.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:58.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:57 trial014 ceph-mon[46941]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:58.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3004323735' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df7ad596-6759-4a7f-9699-264361763b82"} : dispatch 2026-02-24T09:07:58.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:07:58.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3004323735' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df7ad596-6759-4a7f-9699-264361763b82"}]': finished 2026-02-24T09:07:58.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: osdmap e15: 4 total, 2 up, 4 in 2026-02-24T09:07:58.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:58.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:07:58.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:58.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1074201509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:07:58.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: Detected new or changed devices on trial090 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial090 to 84047M 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:07:58.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:07:58.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:07:58.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:57 trial004 ceph-mon[41596]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T09:07:59.373 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:59 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:07:59.373 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:59 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:07:59.373 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:59 trial004 ceph-mon[41596]: osd.2 [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] boot 2026-02-24T09:07:59.374 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:59 trial004 ceph-mon[41596]: osdmap e16: 4 total, 3 up, 4 in 2026-02-24T09:07:59.374 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:59 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:59.374 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:07:59 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:07:59.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:59 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:07:59.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:59 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:07:59.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:59 trial090 ceph-mon[47278]: osd.2 [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] boot 2026-02-24T09:07:59.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:59 trial090 ceph-mon[47278]: osdmap e16: 4 total, 3 up, 4 in 2026-02-24T09:07:59.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:59 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:59.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:07:59 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:07:59.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:59 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:07:59.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:59 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:07:59.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:59 trial014 ceph-mon[46941]: osd.2 [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] boot 2026-02-24T09:07:59.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:59 trial014 ceph-mon[46941]: osdmap e16: 4 total, 3 up, 4 in 2026-02-24T09:07:59.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:59 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T09:07:59.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:07:59 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:08:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:00 trial004 ceph-mon[41596]: Deploying daemon osd.3 on trial004 2026-02-24T09:08:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:00 trial004 ceph-mon[41596]: osdmap e17: 4 total, 3 up, 4 in 2026-02-24T09:08:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:00 trial004 ceph-mon[41596]: pgmap v36: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:08:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:00 trial004 ceph-mon[41596]: Deploying daemon osd.3 on trial004 2026-02-24T09:08:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:08:00.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:08:00.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:00.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:00 trial090 ceph-mon[47278]: Deploying daemon osd.3 on trial004 2026-02-24T09:08:00.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:00 trial090 ceph-mon[47278]: osdmap e17: 4 total, 3 up, 4 in 2026-02-24T09:08:00.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:00.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:00 trial090 ceph-mon[47278]: pgmap v36: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:00.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:08:00.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:00.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:00 trial090 ceph-mon[47278]: Deploying daemon osd.3 on trial004 2026-02-24T09:08:00.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:08:00.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:08:00.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:00.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:00 trial014 ceph-mon[46941]: Deploying daemon osd.3 on trial004 2026-02-24T09:08:00.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:00 trial014 ceph-mon[46941]: osdmap e17: 4 total, 3 up, 4 in 2026-02-24T09:08:00.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:00.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:00 trial014 ceph-mon[46941]: pgmap v36: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:00.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T09:08:00.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:00.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:00 trial014 ceph-mon[46941]: Deploying daemon osd.3 on trial004 2026-02-24T09:08:00.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:08:01.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-24T09:08:01.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 ceph-mon[41596]: osdmap e18: 4 total, 3 up, 4 in 2026-02-24T09:08:01.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:01.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:08:01.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:01.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:01.705 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57831]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T09:08:01.706 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57831]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:01.706 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:01.706 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57831]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:01.706 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57835]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T09:08:01.706 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57835]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:01.706 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:01.706 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57835]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:01.707 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-24T09:08:01.707 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 ceph-mon[47278]: osdmap e18: 4 total, 3 up, 4 in 2026-02-24T09:08:01.707 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:01.707 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:08:01.707 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:01.707 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:01.707 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57839]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-24T09:08:01.707 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57839]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:01.707 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:01.708 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57839]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:01.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72902]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-24T09:08:01.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72902]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:01.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:01.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72902]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:01.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72906]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-24T09:08:01.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72906]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:01.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:01.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72906]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:01.715 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72820]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T09:08:01.715 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72820]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:01.715 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:01.716 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72820]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:01.716 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72833]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T09:08:01.716 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72833]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:01.716 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:01.716 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:08:01 trial004 sudo[72833]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:01.731 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-24T09:08:01.732 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 ceph-mon[46941]: osdmap e18: 4 total, 3 up, 4 in 2026-02-24T09:08:01.732 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:01.732 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:08:01.732 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:01.732 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:01.732 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60650]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T09:08:01.733 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60650]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:01.733 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:01.733 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60650]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:01.733 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60654]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T09:08:01.733 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60654]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:01.733 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:01.733 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60654]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57843]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-24T09:08:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57843]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:01 trial090 sudo[57843]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60658]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-24T09:08:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60658]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60658]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60662]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-24T09:08:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60662]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T09:08:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T09:08:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:01 trial014 sudo[60662]: pam_unix(sudo:session): session closed for user root 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: osdmap e19: 4 total, 3 up, 4 in 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: pgmap v39: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:08:02.637 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:08:02.638 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.638 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:08:02.638 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:08:02.638 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:08:02.638 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:08:02.638 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:08:02.638 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.638 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: osdmap e20: 4 total, 3 up, 4 in 2026-02-24T09:08:02.638 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:02.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:02.634+0000 7fc65f7fe640 1 -- 10.20.193.4:0/2906745703 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7fc6680cf770 con 0x7fc67810eb10 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: osdmap e19: 4 total, 3 up, 4 in 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: pgmap v39: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:08:02.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: osdmap e20: 4 total, 3 up, 4 in 2026-02-24T09:08:02.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: osdmap e19: 4 total, 3 up, 4 in 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: pgmap v39: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:08:02.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: osdmap e20: 4 total, 3 up, 4 in 2026-02-24T09:08:02.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:03.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.544+0000 7fc65f7fe640 1 -- 10.20.193.4:0/2906745703 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fc678061f00 con 0x7fc6500b5650 2026-02-24T09:08:03.548 INFO:teuthology.orchestra.run.trial004.stdout:Created osd(s) 3 on host 'trial004' 2026-02-24T09:08:03.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 -- 10.20.193.4:0/2906745703 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc6500b5650 msgr2=0x7fc6500d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:03.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc6500b5650 0x7fc6500d5b00 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc66c006fd0 tx=0x7fc66c008040 comp rx=0 tx=0).stop 2026-02-24T09:08:03.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 -- 10.20.193.4:0/2906745703 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc67810eb10 msgr2=0x7fc678061030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:03.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc67810eb10 0x7fc678061030 secure :-1 s=READY pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc66800a360 tx=0x7fc6680039b0 comp rx=0 tx=0).stop 2026-02-24T09:08:03.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 -- 10.20.193.4:0/2906745703 shutdown_connections 2026-02-24T09:08:03.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc6500b5650 0x7fc6500d5b00 unknown :-1 s=CLOSED pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:03.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc67810eb10 0x7fc678061030 unknown :-1 s=CLOSED pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:03.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc67810e160 0x7fc67816f4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:03.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 --2- 10.20.193.4:0/2906745703 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc67810cfd0 0x7fc678062720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:03.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 -- 10.20.193.4:0/2906745703 >> 10.20.193.4:0/2906745703 conn(0x7fc6780ea700 msgr2=0x7fc6780ecca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:03.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 -- 10.20.193.4:0/2906745703 shutdown_connections 2026-02-24T09:08:03.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:03.547+0000 7fc67cfde640 1 -- 10.20.193.4:0/2906745703 wait complete. 2026-02-24T09:08:03.587 DEBUG:teuthology.orchestra.run.trial004:osd.3> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.3.service 2026-02-24T09:08:03.590 INFO:tasks.cephadm:Deploying osd.4 on trial014 with /dev/vg_nvme/lv_3... 2026-02-24T09:08:03.590 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T09:08:03.712 INFO:teuthology.orchestra.run.trial014.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.b/config 2026-02-24T09:08:03.867 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:03 trial014 ceph-mon[46941]: mgrmap e16: x(active, since 60s), standbys: z, y 2026-02-24T09:08:03.867 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:03 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:03.867 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:03 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:03.868 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:03 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:03.868 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:03 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:03.868 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:03 trial004 ceph-mon[41596]: mgrmap e16: x(active, since 60s), standbys: z, y 2026-02-24T09:08:03.869 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:03 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:03.869 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:03 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:03.869 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:03 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:03.869 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:03 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:03 trial090 ceph-mon[47278]: mgrmap e16: x(active, since 60s), standbys: z, y 2026-02-24T09:08:04.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:03 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:03 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:03 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:03 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.162 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:08:04.179 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial014:vg_nvme/lv_3 --skip-validation 2026-02-24T09:08:04.214 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:08:03 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3[73485]: 2026-02-24T09:08:03.920+0000 7fd121914780 -1 osd.3 0 log_to_monitors true 2026-02-24T09:08:04.293 INFO:teuthology.orchestra.run.trial014.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.b/config 2026-02-24T09:08:04.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.398+0000 7f568c8ca640 1 -- 10.20.193.14:0/1120083908 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f56841103e0 msgr2=0x7f5684110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:04.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.398+0000 7f568c8ca640 1 --2- 10.20.193.14:0/1120083908 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f56841103e0 0x7f5684110850 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=2031334538585055287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5670009950 tx=0x7f567002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:08:04.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.398+0000 7f568c8ca640 1 -- 10.20.193.14:0/1120083908 shutdown_connections 2026-02-24T09:08:04.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.398+0000 7f568c8ca640 1 --2- 10.20.193.14:0/1120083908 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5684110d90 0x7f5684171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:04.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.398+0000 7f568c8ca640 1 --2- 10.20.193.14:0/1120083908 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f56841103e0 0x7f5684110850 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=2031334538585055287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:04.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.398+0000 7f568c8ca640 1 --2- 10.20.193.14:0/1120083908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f568410f250 0x7f568410f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:04.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.398+0000 7f568c8ca640 1 -- 10.20.193.14:0/1120083908 >> 10.20.193.14:0/1120083908 conn(0x7f56840ec980 msgr2=0x7f568410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:04.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.398+0000 7f568c8ca640 1 -- 10.20.193.14:0/1120083908 shutdown_connections 2026-02-24T09:08:04.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.398+0000 7f568c8ca640 1 -- 10.20.193.14:0/1120083908 wait complete. 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568c8ca640 1 Processor -- start 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568c8ca640 1 -- start start 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568c8ca640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f568410f250 0x7f56840f8940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568c8ca640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56841103e0 0x7f5684171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568c8ca640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5684110d90 0x7f56840f91a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568c8ca640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f56840f9d90 con 0x7f56841103e0 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568c8ca640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f56840f9f00 con 0x7f568410f250 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568c8ca640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56840fa0c0 con 0x7f5684110d90 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568a63f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f568410f250 0x7f56840f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568a63f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f568410f250 0x7f56840f8940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.14:53054/0 (socket says 10.20.193.14:53054) 2026-02-24T09:08:04.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568a63f640 1 -- 10.20.193.14:0/884302295 learned_addr learned my addr 10.20.193.14:0/884302295 (peer_addr_for_me v2:10.20.193.14:0/0) 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568ae40640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5684110d90 0x7f56840f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568a63f640 1 -- 10.20.193.14:0/884302295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5684110d90 msgr2=0x7f56840f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568a63f640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5684110d90 0x7f56840f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568a63f640 1 -- 10.20.193.14:0/884302295 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56841103e0 msgr2=0x7f5684171720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568a63f640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56841103e0 0x7f5684171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568a63f640 1 -- 10.20.193.14:0/884302295 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5670009570 con 0x7f568410f250 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568ae40640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5684110d90 0x7f56840f91a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568a63f640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f568410f250 0x7f56840f8940 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f567c00d950 tx=0x7f567c00de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f566f7fe640 1 -- 10.20.193.14:0/884302295 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f567c004540 con 0x7f568410f250 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568c8ca640 1 -- 10.20.193.14:0/884302295 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56840fa3a0 con 0x7f568410f250 2026-02-24T09:08:04.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f566f7fe640 1 -- 10.20.193.14:0/884302295 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f567c009d00 con 0x7f568410f250 2026-02-24T09:08:04.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f566f7fe640 1 -- 10.20.193.14:0/884302295 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f567c0106e0 con 0x7f568410f250 2026-02-24T09:08:04.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.399+0000 7f568c8ca640 1 -- 10.20.193.14:0/884302295 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56840fa8c0 con 0x7f568410f250 2026-02-24T09:08:04.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.400+0000 7f568c8ca640 1 -- 10.20.193.14:0/884302295 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5684175720 con 0x7f568410f250 2026-02-24T09:08:04.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.401+0000 7f566f7fe640 1 -- 10.20.193.14:0/884302295 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f567c0027c0 con 0x7f568410f250 2026-02-24T09:08:04.406 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.402+0000 7f566f7fe640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56600b5760 0x7f56600d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:04.406 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.402+0000 7f5689e3e640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56600b5760 0x7f56600d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:04.406 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.402+0000 7f566f7fe640 1 -- 10.20.193.14:0/884302295 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3344+0+0 (secure 0 0 0) 0x7f567c0e5ed0 con 0x7f568410f250 2026-02-24T09:08:04.406 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.402+0000 7f5689e3e640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56600b5760 0x7f56600d5c10 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f567002f6e0 tx=0x7f5670005e90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:04.406 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.403+0000 7f566f7fe640 1 -- 10.20.193.14:0/884302295 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f567c0a9c00 con 0x7f568410f250 2026-02-24T09:08:04.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:04.512+0000 7f568c8ca640 1 -- 10.20.193.14:0/884302295 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f5684174f30 con 0x7f56600b5760 2026-02-24T09:08:04.670 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: pgmap v41: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.671 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:04 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.935 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: pgmap v41: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:04.935 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T09:08:04.935 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.935 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.935 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:04.935 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.935 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.935 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:04.935 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:04.936 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:04.936 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.936 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.936 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:04.936 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:04 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: pgmap v41: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:05.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T09:08:05.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:05.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:05.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:05.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:05.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:04 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.464 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:08:05 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3[73485]: 2026-02-24T09:08:05.199+0000 7fd11d896640 -1 osd.3 0 waiting for initial osdmap 2026-02-24T09:08:05.464 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:08:05 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3[73485]: 2026-02-24T09:08:05.202+0000 7fd11975d640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:08:05.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:05.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:08:05.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_3'] 2026-02-24T09:08:05.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:08:05.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial014 2026-02-24T09:08:05.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T09:08:05.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: osdmap e21: 4 total, 3 up, 4 in 2026-02-24T09:08:05.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:08:05.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:05.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2242ac52-60ee-4ca6-8a5d-a50e99be2cca"} : dispatch 2026-02-24T09:08:05.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='client.? 10.20.193.14:0/71528356' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2242ac52-60ee-4ca6-8a5d-a50e99be2cca"} : dispatch 2026-02-24T09:08:05.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:08:05.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2242ac52-60ee-4ca6-8a5d-a50e99be2cca"}]': finished 2026-02-24T09:08:05.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: osdmap e22: 5 total, 3 up, 5 in 2026-02-24T09:08:05.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:05.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:05.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:05.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='client.? 10.20.193.14:0/1835089278' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:05.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:05 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.903 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:05.904 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:08:05.904 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_3'] 2026-02-24T09:08:05.904 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:08:05.904 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial014 2026-02-24T09:08:05.904 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: osdmap e21: 4 total, 3 up, 4 in 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2242ac52-60ee-4ca6-8a5d-a50e99be2cca"} : dispatch 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='client.? 10.20.193.14:0/71528356' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2242ac52-60ee-4ca6-8a5d-a50e99be2cca"} : dispatch 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2242ac52-60ee-4ca6-8a5d-a50e99be2cca"}]': finished 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: osdmap e22: 5 total, 3 up, 5 in 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:05.905 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='client.? 10.20.193.14:0/1835089278' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:05.906 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.906 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:05 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:05.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:08:05.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_3'] 2026-02-24T09:08:05.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:08:05.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial014 2026-02-24T09:08:05.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T09:08:05.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: osdmap e21: 4 total, 3 up, 4 in 2026-02-24T09:08:05.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:08:05.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:05.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2242ac52-60ee-4ca6-8a5d-a50e99be2cca"} : dispatch 2026-02-24T09:08:05.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='client.? 10.20.193.14:0/71528356' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2242ac52-60ee-4ca6-8a5d-a50e99be2cca"} : dispatch 2026-02-24T09:08:05.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:08:05.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2242ac52-60ee-4ca6-8a5d-a50e99be2cca"}]': finished 2026-02-24T09:08:05.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: osdmap e22: 5 total, 3 up, 5 in 2026-02-24T09:08:05.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:05.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:05.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:05.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='client.? 10.20.193.14:0/1835089278' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:05.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:05.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:05 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:06.978 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:06.979 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: Detected new or changed devices on trial004 2026-02-24T09:08:06.979 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:06.979 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:06.979 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:06.979 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:06.979 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:06.979 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:06.980 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial004 to 42023M 2026-02-24T09:08:06.980 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:06.980 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:06.980 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:06.980 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:06.980 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:06.980 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:06.980 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:06.980 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] boot 2026-02-24T09:08:06.980 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: osdmap e23: 5 total, 4 up, 5 in 2026-02-24T09:08:06.981 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:06.981 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:07.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:07.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: Detected new or changed devices on trial004 2026-02-24T09:08:07.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:07.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:07.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial004 to 42023M 2026-02-24T09:08:07.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:07.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:07.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:07.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:07.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:07.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] boot 2026-02-24T09:08:07.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: osdmap e23: 5 total, 4 up, 5 in 2026-02-24T09:08:07.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:07.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:07.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T09:08:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: Detected new or changed devices on trial004 2026-02-24T09:08:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial004 to 42023M 2026-02-24T09:08:07.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:07.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:07.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:07.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:07.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:07.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:07.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: osd.3 [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] boot 2026-02-24T09:08:07.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: osdmap e23: 5 total, 4 up, 5 in 2026-02-24T09:08:07.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T09:08:07.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:07.816 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:07 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:08:07.816 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:07 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:08:07.816 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:07 trial014 ceph-mon[46941]: osdmap e24: 5 total, 4 up, 5 in 2026-02-24T09:08:07.816 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:07 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:07.816 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:07 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:08:07.816 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:07 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:08.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:07 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:08:08.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:07 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:08:08.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:07 trial090 ceph-mon[47278]: osdmap e24: 5 total, 4 up, 5 in 2026-02-24T09:08:08.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:07 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:08.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:07 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:08:08.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:07 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:08.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:07 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:08:08.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:07 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:08:08.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:07 trial004 ceph-mon[41596]: osdmap e24: 5 total, 4 up, 5 in 2026-02-24T09:08:08.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:08.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:08:08.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:08.982 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:08 trial014 ceph-mon[46941]: Deploying daemon osd.4 on trial014 2026-02-24T09:08:08.983 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:08 trial014 ceph-mon[46941]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:08:08.983 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:08:08.983 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:08.983 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:08 trial014 ceph-mon[46941]: Deploying daemon osd.4 on trial014 2026-02-24T09:08:08.983 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:08 trial014 ceph-mon[46941]: osdmap e25: 5 total, 4 up, 5 in 2026-02-24T09:08:08.983 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:09.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:08 trial090 ceph-mon[47278]: Deploying daemon osd.4 on trial014 2026-02-24T09:08:09.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:08 trial090 ceph-mon[47278]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:08:09.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:08:09.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:09.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:08 trial090 ceph-mon[47278]: Deploying daemon osd.4 on trial014 2026-02-24T09:08:09.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:08 trial090 ceph-mon[47278]: osdmap e25: 5 total, 4 up, 5 in 2026-02-24T09:08:09.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:08 trial004 ceph-mon[41596]: Deploying daemon osd.4 on trial014 2026-02-24T09:08:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:08 trial004 ceph-mon[41596]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:08:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-24T09:08:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:08 trial004 ceph-mon[41596]: Deploying daemon osd.4 on trial014 2026-02-24T09:08:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:08 trial004 ceph-mon[41596]: osdmap e25: 5 total, 4 up, 5 in 2026-02-24T09:08:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:10.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:10 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:10.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:10 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:10.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:10 trial014 ceph-mon[46941]: osdmap e26: 5 total, 4 up, 5 in 2026-02-24T09:08:10.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:10 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:10.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:10 trial014 ceph-mon[46941]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:08:10.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:10.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:10.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:10 trial004 ceph-mon[41596]: osdmap e26: 5 total, 4 up, 5 in 2026-02-24T09:08:10.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:10.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:10 trial004 ceph-mon[41596]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:08:10.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:10 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:10.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:10 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:10.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:10 trial090 ceph-mon[47278]: osdmap e26: 5 total, 4 up, 5 in 2026-02-24T09:08:10.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:10 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:10.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:10 trial090 ceph-mon[47278]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T09:08:11.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:11 trial004 ceph-mon[41596]: osdmap e27: 5 total, 4 up, 5 in 2026-02-24T09:08:11.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:11 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:11.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:11 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:11.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:11 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:11.520 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:11 trial014 ceph-mon[46941]: osdmap e27: 5 total, 4 up, 5 in 2026-02-24T09:08:11.520 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:11 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:11.520 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:11 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:11.520 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:11 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:11.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.566+0000 7f566f7fe640 1 -- 10.20.193.14:0/884302295 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f5684174f30 con 0x7f56600b5760 2026-02-24T09:08:11.567 INFO:teuthology.orchestra.run.trial014.stdout:Created osd(s) 4 on host 'trial014' 2026-02-24T09:08:11.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 -- 10.20.193.14:0/884302295 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56600b5760 msgr2=0x7f56600d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:11.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56600b5760 0x7f56600d5c10 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f567002f6e0 tx=0x7f5670005e90 comp rx=0 tx=0).stop 2026-02-24T09:08:11.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 -- 10.20.193.14:0/884302295 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f568410f250 msgr2=0x7f56840f8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:11.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f568410f250 0x7f56840f8940 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f567c00d950 tx=0x7f567c00de20 comp rx=0 tx=0).stop 2026-02-24T09:08:11.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 -- 10.20.193.14:0/884302295 shutdown_connections 2026-02-24T09:08:11.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56600b5760 0x7f56600d5c10 unknown :-1 s=CLOSED pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:11.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5684110d90 0x7f56840f91a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:11.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56841103e0 0x7f5684171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:11.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 --2- 10.20.193.14:0/884302295 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f568410f250 0x7f56840f8940 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:11.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 -- 10.20.193.14:0/884302295 >> 10.20.193.14:0/884302295 conn(0x7f56840ec980 msgr2=0x7f56840eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:11.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 -- 10.20.193.14:0/884302295 shutdown_connections 2026-02-24T09:08:11.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:11.569+0000 7f568c8ca640 1 -- 10.20.193.14:0/884302295 wait complete. 2026-02-24T09:08:11.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:11 trial090 ceph-mon[47278]: osdmap e27: 5 total, 4 up, 5 in 2026-02-24T09:08:11.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:11 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:11.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:11 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:11.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:11 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:11.610 DEBUG:teuthology.orchestra.run.trial014:osd.4> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.4.service 2026-02-24T09:08:11.612 INFO:tasks.cephadm:Deploying osd.5 on trial090 with /dev/vg_nvme/lv_3... 2026-02-24T09:08:11.613 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T09:08:11.734 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:08:12.211 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:08:12.228 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_3 --skip-validation 2026-02-24T09:08:12.343 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:08:11 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4[64822]: 2026-02-24T09:08:11.900+0000 7f93d5fb6780 -1 osd.4 0 log_to_monitors true 2026-02-24T09:08:12.348 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:08:12.455 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 -- 10.20.193.90:0/1731482833 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f20fc10bf30 msgr2=0x7f20fc10c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:12.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 --2- 10.20.193.90:0/1731482833 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f20fc10bf30 0x7f20fc10c320 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=9442028387639812092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20ec009950 tx=0x7f20ec02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:08:12.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 -- 10.20.193.90:0/1731482833 shutdown_connections 2026-02-24T09:08:12.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 --2- 10.20.193.90:0/1731482833 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f20fc10da70 0x7f20fc16e400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:12.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 --2- 10.20.193.90:0/1731482833 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f20fc10d0c0 0x7f20fc10d530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:12.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 --2- 10.20.193.90:0/1731482833 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f20fc10bf30 0x7f20fc10c320 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=9442028387639812092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:12.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 -- 10.20.193.90:0/1731482833 >> 10.20.193.90:0/1731482833 conn(0x7f20fc0e9660 msgr2=0x7f20fc109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:12.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 -- 10.20.193.90:0/1731482833 shutdown_connections 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 -- 10.20.193.90:0/1731482833 wait complete. 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 Processor -- start 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.450+0000 7f2103843640 1 -- start start 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2103843640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f20fc10bf30 0x7f20fc0f89d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2103843640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f20fc10d0c0 0x7f20fc16e400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2103843640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f20fc10da70 0x7f20fc0f9230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2103843640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc0f9e20 con 0x7f20fc10da70 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2103843640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc0f9f90 con 0x7f20fc10bf30 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2103843640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc0fa150 con 0x7f20fc10d0c0 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2100db7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f20fc10d0c0 0x7f20fc16e400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2100db7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f20fc10d0c0 0x7f20fc16e400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:44224/0 (socket says 10.20.193.90:44224) 2026-02-24T09:08:12.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2100db7640 1 -- 10.20.193.90:0/1272331176 learned_addr learned my addr 10.20.193.90:0/1272331176 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f21015b8640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f20fc10bf30 0x7f20fc0f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2101db9640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f20fc10da70 0x7f20fc0f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2100db7640 1 -- 10.20.193.90:0/1272331176 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f20fc10bf30 msgr2=0x7f20fc0f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2100db7640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f20fc10bf30 0x7f20fc0f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2100db7640 1 -- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f20fc10da70 msgr2=0x7f20fc0f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2100db7640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f20fc10da70 0x7f20fc0f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2100db7640 1 -- 10.20.193.90:0/1272331176 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec009570 con 0x7f20fc10d0c0 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2101db9640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f20fc10da70 0x7f20fc0f9230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2100db7640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f20fc10d0c0 0x7f20fc16e400 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20f000b500 tx=0x7f20f000b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f20ea7fc640 1 -- 10.20.193.90:0/1272331176 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f20f00044a0 con 0x7f20fc10d0c0 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f20ea7fc640 1 -- 10.20.193.90:0/1272331176 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f20f0002b80 con 0x7f20fc10d0c0 2026-02-24T09:08:12.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2103843640 1 -- 10.20.193.90:0/1272331176 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20fc0fa430 con 0x7f20fc10d0c0 2026-02-24T09:08:12.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f20ea7fc640 1 -- 10.20.193.90:0/1272331176 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f20f000fd90 con 0x7f20fc10d0c0 2026-02-24T09:08:12.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.451+0000 7f2103843640 1 -- 10.20.193.90:0/1272331176 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20fc0fa9d0 con 0x7f20fc10d0c0 2026-02-24T09:08:12.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.452+0000 7f2103843640 1 -- 10.20.193.90:0/1272331176 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20fc1722f0 con 0x7f20fc10d0c0 2026-02-24T09:08:12.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.453+0000 7f20ea7fc640 1 -- 10.20.193.90:0/1272331176 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f20f00026a0 con 0x7f20fc10d0c0 2026-02-24T09:08:12.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.453+0000 7f20ea7fc640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20d80b5760 0x7f20d80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:12.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.453+0000 7f20ea7fc640 1 -- 10.20.193.90:0/1272331176 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3776+0+0 (secure 0 0 0) 0x7f20f00e55b0 con 0x7f20fc10d0c0 2026-02-24T09:08:12.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.454+0000 7f21015b8640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20d80b5760 0x7f20d80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:12.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.454+0000 7f21015b8640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20d80b5760 0x7f20d80d5c10 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20ec0023d0 tx=0x7f20ec031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:12.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.455+0000 7f20ea7fc640 1 -- 10.20.193.90:0/1272331176 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f20f00a9130 con 0x7f20fc10d0c0 2026-02-24T09:08:12.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:12.568+0000 7f2103843640 1 -- 10.20.193.90:0/1272331176 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f20fc171ba0 con 0x7f20d80b5760 2026-02-24T09:08:12.708 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: pgmap v52: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s, 0 objects/s recovering 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='osd.4 [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.709 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.723 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.723 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.723 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: pgmap v52: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s, 0 objects/s recovering 2026-02-24T09:08:12.723 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:08:12.724 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='osd.4 [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:08:12.724 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.724 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.724 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:12.724 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.724 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.724 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.724 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: pgmap v52: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s, 0 objects/s recovering 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='osd.4 [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:12.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.570 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:08:13 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4[64822]: 2026-02-24T09:08:13.253+0000 7f93d1f38640 -1 osd.4 0 waiting for initial osdmap 2026-02-24T09:08:13.570 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:08:13 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4[64822]: 2026-02-24T09:08:13.257+0000 7f93c9df7640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:08:13.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-24T09:08:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: osdmap e28: 5 total, 4 up, 5 in 2026-02-24T09:08:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:08:13.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_3'] 2026-02-24T09:08:13.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='osd.4 [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:13.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:08:13.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial090 2026-02-24T09:08:13.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:13.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:13.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:13.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='client.? 10.20.193.90:0/1576266476' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e41925be-d3db-4038-a54b-50329f4f89b3"} : dispatch 2026-02-24T09:08:13.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e41925be-d3db-4038-a54b-50329f4f89b3"} : dispatch 2026-02-24T09:08:13.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:08:13.837 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e41925be-d3db-4038-a54b-50329f4f89b3"}]': finished 2026-02-24T09:08:13.837 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: osdmap e29: 6 total, 4 up, 6 in 2026-02-24T09:08:13.837 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:13.837 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:13.837 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:13.837 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='client.? 10.20.193.90:0/3325262640' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:13.838 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.838 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: osdmap e28: 5 total, 4 up, 5 in 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_3'] 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='osd.4 [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial090 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='client.? 10.20.193.90:0/1576266476' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e41925be-d3db-4038-a54b-50329f4f89b3"} : dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e41925be-d3db-4038-a54b-50329f4f89b3"} : dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e41925be-d3db-4038-a54b-50329f4f89b3"}]': finished 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: osdmap e29: 6 total, 4 up, 6 in 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:13.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:13.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='client.? 10.20.193.90:0/3325262640' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:13.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-24T09:08:13.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: osdmap e28: 5 total, 4 up, 5 in 2026-02-24T09:08:13.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:13.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:13.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:13.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:08:13.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_3'] 2026-02-24T09:08:13.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='osd.4 [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:13.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial090 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/1576266476' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e41925be-d3db-4038-a54b-50329f4f89b3"} : dispatch 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e41925be-d3db-4038-a54b-50329f4f89b3"} : dispatch 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e41925be-d3db-4038-a54b-50329f4f89b3"}]': finished 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: osdmap e29: 6 total, 4 up, 6 in 2026-02-24T09:08:13.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:13.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:13.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:13.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/3325262640' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:13.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:13.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.024 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: pgmap v55: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s, 0 objects/s recovering 2026-02-24T09:08:15.024 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: Detected new or changed devices on trial014 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial014 to 42023M 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:15.025 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.026 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:15.026 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:15.026 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:15.026 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: osd.4 [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] boot 2026-02-24T09:08:15.026 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: osdmap e30: 6 total, 5 up, 6 in 2026-02-24T09:08:15.026 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:15.026 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: pgmap v55: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s, 0 objects/s recovering 2026-02-24T09:08:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: Detected new or changed devices on trial014 2026-02-24T09:08:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial014 to 42023M 2026-02-24T09:08:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:15.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:15.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:15.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: osd.4 [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] boot 2026-02-24T09:08:15.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: osdmap e30: 6 total, 5 up, 6 in 2026-02-24T09:08:15.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:15.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:15.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: pgmap v55: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 129 KiB/s, 0 objects/s recovering 2026-02-24T09:08:15.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: Detected new or changed devices on trial014 2026-02-24T09:08:15.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial014 to 42023M 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: osd.4 [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] boot 2026-02-24T09:08:15.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: osdmap e30: 6 total, 5 up, 6 in 2026-02-24T09:08:15.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-24T09:08:15.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:15.816 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:15 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:08:15.816 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:15 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:08:15.816 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:15 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:08:15.816 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:15 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:15 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:08:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:15 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:08:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:15 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:08:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:15 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:16.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:15 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:08:16.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:15 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:08:16.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:08:16.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:16.979 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:16 trial090 ceph-mon[47278]: Deploying daemon osd.5 on trial090 2026-02-24T09:08:16.979 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:16 trial090 ceph-mon[47278]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:16.979 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:08:16.979 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:16.979 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:16 trial090 ceph-mon[47278]: osdmap e31: 6 total, 5 up, 6 in 2026-02-24T09:08:16.979 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:16.979 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:16 trial090 ceph-mon[47278]: Deploying daemon osd.5 on trial090 2026-02-24T09:08:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:16 trial014 ceph-mon[46941]: Deploying daemon osd.5 on trial090 2026-02-24T09:08:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:16 trial014 ceph-mon[46941]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:08:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:16 trial014 ceph-mon[46941]: osdmap e31: 6 total, 5 up, 6 in 2026-02-24T09:08:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:16 trial014 ceph-mon[46941]: Deploying daemon osd.5 on trial090 2026-02-24T09:08:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:16 trial004 ceph-mon[41596]: Deploying daemon osd.5 on trial090 2026-02-24T09:08:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:16 trial004 ceph-mon[41596]: pgmap v57: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-24T09:08:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:16 trial004 ceph-mon[41596]: osdmap e31: 6 total, 5 up, 6 in 2026-02-24T09:08:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:16 trial004 ceph-mon[41596]: Deploying daemon osd.5 on trial090 2026-02-24T09:08:18.316 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:18.316 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:18.316 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:18 trial090 ceph-mon[47278]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:18.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:18.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:18.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:18 trial004 ceph-mon[41596]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:18.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:18.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:18.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:18 trial014 ceph-mon[46941]: pgmap v59: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:19.487 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.484+0000 7f20ea7fc640 1 -- 10.20.193.90:0/1272331176 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f20fc171ba0 con 0x7f20d80b5760 2026-02-24T09:08:19.487 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 5 on host 'trial090' 2026-02-24T09:08:19.490 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 -- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20d80b5760 msgr2=0x7f20d80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:19.490 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20d80b5760 0x7f20d80d5c10 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20ec0023d0 tx=0x7f20ec031040 comp rx=0 tx=0).stop 2026-02-24T09:08:19.490 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 -- 10.20.193.90:0/1272331176 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f20fc10d0c0 msgr2=0x7f20fc16e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:19.490 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f20fc10d0c0 0x7f20fc16e400 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20f000b500 tx=0x7f20f000b9d0 comp rx=0 tx=0).stop 2026-02-24T09:08:19.490 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 -- 10.20.193.90:0/1272331176 shutdown_connections 2026-02-24T09:08:19.490 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20d80b5760 0x7f20d80d5c10 unknown :-1 s=CLOSED pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:19.490 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f20fc10da70 0x7f20fc0f9230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:19.491 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f20fc10d0c0 0x7f20fc16e400 unknown :-1 s=CLOSED pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:19.491 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 --2- 10.20.193.90:0/1272331176 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f20fc10bf30 0x7f20fc0f89d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:19.491 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 -- 10.20.193.90:0/1272331176 >> 10.20.193.90:0/1272331176 conn(0x7f20fc0e9660 msgr2=0x7f20fc060570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:19.491 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 -- 10.20.193.90:0/1272331176 shutdown_connections 2026-02-24T09:08:19.491 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:19.486+0000 7f2103843640 1 -- 10.20.193.90:0/1272331176 wait complete. 2026-02-24T09:08:19.528 DEBUG:teuthology.orchestra.run.trial090:osd.5> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.5.service 2026-02-24T09:08:19.531 INFO:tasks.cephadm:Deploying osd.6 on trial004 with /dev/vg_nvme/lv_2... 2026-02-24T09:08:19.531 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-24T09:08:19.662 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:08:20.070 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.071 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.071 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.071 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.071 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:19 trial004 ceph-mon[41596]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:20.071 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:19 trial004 ceph-mon[41596]: from='osd.5 [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:08:20.071 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:19 trial004 ceph-mon[41596]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:08:20.161 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:08:20.180 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial004:vg_nvme/lv_2 --skip-validation 2026-02-24T09:08:20.261 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.261 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.261 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.261 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.261 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:19 trial090 ceph-mon[47278]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:20.262 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:19 trial090 ceph-mon[47278]: from='osd.5 [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:08:20.262 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:19 trial090 ceph-mon[47278]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:08:20.262 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:08:19 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5[65851]: 2026-02-24T09:08:19.848+0000 7fa012a0f780 -1 osd.5 0 log_to_monitors true 2026-02-24T09:08:20.263 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.263 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.263 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.263 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:20.263 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:19 trial014 ceph-mon[46941]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:20.263 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:19 trial014 ceph-mon[46941]: from='osd.5 [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:08:20.263 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:19 trial014 ceph-mon[46941]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-24T09:08:20.296 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:08:20.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 -- 10.20.193.4:0/2966516973 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8541103e0 msgr2=0x7fe854110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:20.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 --2- 10.20.193.4:0/2966516973 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8541103e0 0x7fe854110850 secure :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=11682939441081370774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe848009950 tx=0x7fe84802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:08:20.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 -- 10.20.193.4:0/2966516973 shutdown_connections 2026-02-24T09:08:20.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 --2- 10.20.193.4:0/2966516973 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe854110d90 0x7fe854171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:20.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 --2- 10.20.193.4:0/2966516973 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8541103e0 0x7fe854110850 unknown :-1 s=CLOSED pgs=177 gs=1 cs=0 l=1 c_cookie=11682939441081370774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:20.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 --2- 10.20.193.4:0/2966516973 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe85410f250 0x7fe85410f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:20.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 -- 10.20.193.4:0/2966516973 >> 10.20.193.4:0/2966516973 conn(0x7fe8540ec980 msgr2=0x7fe85410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:20.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 -- 10.20.193.4:0/2966516973 shutdown_connections 2026-02-24T09:08:20.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 -- 10.20.193.4:0/2966516973 wait complete. 2026-02-24T09:08:20.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 Processor -- start 2026-02-24T09:08:20.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 -- start start 2026-02-24T09:08:20.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe85410f250 0x7fe8540f8940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8541103e0 0x7fe854171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe854110d90 0x7fe8540f91a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe8540f9d90 con 0x7fe854110d90 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe8540f9f00 con 0x7fe85410f250 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.394+0000 7fe85bb21640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8540fa0c0 con 0x7fe8541103e0 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85a097640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe854110d90 0x7fe8540f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85a097640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe854110d90 0x7fe8540f91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:53318/0 (socket says 10.20.193.4:53318) 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85a097640 1 -- 10.20.193.4:0/1247861900 learned_addr learned my addr 10.20.193.4:0/1247861900 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe859896640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe85410f250 0x7fe8540f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe859095640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8541103e0 0x7fe854171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85a097640 1 -- 10.20.193.4:0/1247861900 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8541103e0 msgr2=0x7fe854171720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:20.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85a097640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8541103e0 0x7fe854171720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85a097640 1 -- 10.20.193.4:0/1247861900 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe85410f250 msgr2=0x7fe8540f8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85a097640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe85410f250 0x7fe8540f8940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85a097640 1 -- 10.20.193.4:0/1247861900 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe848009570 con 0x7fe854110d90 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85a097640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe854110d90 0x7fe8540f91a0 secure :-1 s=READY pgs=178 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe850006e90 tx=0x7fe85000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe842ffd640 1 -- 10.20.193.4:0/1247861900 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe850005500 con 0x7fe854110d90 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe842ffd640 1 -- 10.20.193.4:0/1247861900 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe850005e10 con 0x7fe854110d90 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85bb21640 1 -- 10.20.193.4:0/1247861900 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8540fa3a0 con 0x7fe854110d90 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe842ffd640 1 -- 10.20.193.4:0/1247861900 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe850003a90 con 0x7fe854110d90 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85bb21640 1 -- 10.20.193.4:0/1247861900 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8540fa8c0 con 0x7fe854110d90 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.395+0000 7fe85bb21640 1 -- 10.20.193.4:0/1247861900 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe854175720 con 0x7fe854110d90 2026-02-24T09:08:20.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.397+0000 7fe842ffd640 1 -- 10.20.193.4:0/1247861900 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7fe85000c840 con 0x7fe854110d90 2026-02-24T09:08:20.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.397+0000 7fe842ffd640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8300b5760 0x7fe8300d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:20.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.397+0000 7fe859896640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8300b5760 0x7fe8300d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:20.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.398+0000 7fe842ffd640 1 -- 10.20.193.4:0/1247861900 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4208+0+0 (secure 0 0 0) 0x7fe8500e6b30 con 0x7fe854110d90 2026-02-24T09:08:20.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.398+0000 7fe859896640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8300b5760 0x7fe8300d5c10 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe844004740 tx=0x7fe84400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:20.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.398+0000 7fe842ffd640 1 -- 10.20.193.4:0/1247861900 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe8500aa570 con 0x7fe854110d90 2026-02-24T09:08:20.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:20.513+0000 7fe85bb21640 1 -- 10.20.193.4:0/1247861900 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fe854174e30 con 0x7fe8300b5760 2026-02-24T09:08:21.283 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.283 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.284 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:21.284 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.284 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.284 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.284 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.284 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-24T09:08:21.284 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: osdmap e32: 6 total, 5 up, 6 in 2026-02-24T09:08:21.284 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:21.284 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='osd.5 [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:21.284 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:21.285 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:21.285 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:08:21.285 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_2'] 2026-02-24T09:08:21.285 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.285 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:08:21.285 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial004 2026-02-24T09:08:21.285 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.285 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:21.285 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:21.285 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:21.333 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:08:21 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5[65851]: 2026-02-24T09:08:21.193+0000 7fa00e991640 -1 osd.5 0 waiting for initial osdmap 2026-02-24T09:08:21.333 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:08:21 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5[65851]: 2026-02-24T09:08:21.197+0000 7fa00a858640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: osdmap e32: 6 total, 5 up, 6 in 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='osd.5 [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_2'] 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:08:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial004 2026-02-24T09:08:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: osdmap e32: 6 total, 5 up, 6 in 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='osd.5 [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_2'] 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial004 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/5056556' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "43940c98-7188-4b67-b1c0-b7f7d7b73a0f"} : dispatch 2026-02-24T09:08:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:08:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/5056556' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43940c98-7188-4b67-b1c0-b7f7d7b73a0f"}]': finished 2026-02-24T09:08:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: osdmap e33: 7 total, 5 up, 7 in 2026-02-24T09:08:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: Detected new or changed devices on trial090 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial090 to 42023M 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/909499966' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:22.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:22 trial090 ceph-mon[47278]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/5056556' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "43940c98-7188-4b67-b1c0-b7f7d7b73a0f"} : dispatch 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/5056556' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43940c98-7188-4b67-b1c0-b7f7d7b73a0f"}]': finished 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: osdmap e33: 7 total, 5 up, 7 in 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: Detected new or changed devices on trial090 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial090 to 42023M 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:22.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:22.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:22.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/909499966' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:22.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:22 trial014 ceph-mon[46941]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:22.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/5056556' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "43940c98-7188-4b67-b1c0-b7f7d7b73a0f"} : dispatch 2026-02-24T09:08:22.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:08:22.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/5056556' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43940c98-7188-4b67-b1c0-b7f7d7b73a0f"}]': finished 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: osdmap e33: 7 total, 5 up, 7 in 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: Detected new or changed devices on trial090 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:22.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:22.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial090 to 42023M 2026-02-24T09:08:22.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:22.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:22.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:22.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:22.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:22.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:22.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/909499966' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:22.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:22 trial004 ceph-mon[41596]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-24T09:08:23.274 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:23 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:08:23.274 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:23 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:08:23.274 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:23 trial004 ceph-mon[41596]: osd.5 [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] boot 2026-02-24T09:08:23.274 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:23 trial004 ceph-mon[41596]: osdmap e34: 7 total, 6 up, 7 in 2026-02-24T09:08:23.274 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:23.274 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:23.274 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:23 trial004 ceph-mon[41596]: osdmap e35: 7 total, 6 up, 7 in 2026-02-24T09:08:23.274 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:23.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:23 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:08:23.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:23 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:08:23.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:23 trial090 ceph-mon[47278]: osd.5 [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] boot 2026-02-24T09:08:23.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:23 trial090 ceph-mon[47278]: osdmap e34: 7 total, 6 up, 7 in 2026-02-24T09:08:23.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:23.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:23.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:23 trial090 ceph-mon[47278]: osdmap e35: 7 total, 6 up, 7 in 2026-02-24T09:08:23.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:23.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:23 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:08:23.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:23 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:08:23.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:23 trial014 ceph-mon[46941]: osd.5 [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] boot 2026-02-24T09:08:23.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:23 trial014 ceph-mon[46941]: osdmap e34: 7 total, 6 up, 7 in 2026-02-24T09:08:23.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-24T09:08:23.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:23.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:23 trial014 ceph-mon[46941]: osdmap e35: 7 total, 6 up, 7 in 2026-02-24T09:08:23.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:24.445 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:08:24.445 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:24.445 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:24 trial004 ceph-mon[41596]: Deploying daemon osd.6 on trial004 2026-02-24T09:08:24.445 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:24 trial004 ceph-mon[41596]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:08:24.445 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:08:24.445 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:24.445 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:24 trial004 ceph-mon[41596]: Deploying daemon osd.6 on trial004 2026-02-24T09:08:24.446 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:24 trial004 ceph-mon[41596]: osdmap e36: 7 total, 6 up, 7 in 2026-02-24T09:08:24.446 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:24.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:08:24.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:24.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:24 trial090 ceph-mon[47278]: Deploying daemon osd.6 on trial004 2026-02-24T09:08:24.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:24 trial090 ceph-mon[47278]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:08:24.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:08:24.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:24.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:24 trial090 ceph-mon[47278]: Deploying daemon osd.6 on trial004 2026-02-24T09:08:24.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:24 trial090 ceph-mon[47278]: osdmap e36: 7 total, 6 up, 7 in 2026-02-24T09:08:24.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:08:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:24 trial014 ceph-mon[46941]: Deploying daemon osd.6 on trial004 2026-02-24T09:08:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:24 trial014 ceph-mon[46941]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-24T09:08:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-24T09:08:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:24 trial014 ceph-mon[46941]: Deploying daemon osd.6 on trial004 2026-02-24T09:08:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:24 trial014 ceph-mon[46941]: osdmap e36: 7 total, 6 up, 7 in 2026-02-24T09:08:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:25.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:25 trial004 ceph-mon[41596]: osdmap e37: 7 total, 6 up, 7 in 2026-02-24T09:08:25.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:25.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:25.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:25.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:25 trial004 ceph-mon[41596]: pgmap v69: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-24T09:08:26.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:25 trial090 ceph-mon[47278]: osdmap e37: 7 total, 6 up, 7 in 2026-02-24T09:08:26.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:26.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:26.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:26.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:25 trial090 ceph-mon[47278]: pgmap v69: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-24T09:08:26.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:25 trial014 ceph-mon[46941]: osdmap e37: 7 total, 6 up, 7 in 2026-02-24T09:08:26.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:26.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:26.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:26.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:25 trial014 ceph-mon[46941]: pgmap v69: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-24T09:08:27.011 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:26 trial004 ceph-mon[41596]: osdmap e38: 7 total, 6 up, 7 in 2026-02-24T09:08:27.011 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:27.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:26 trial090 ceph-mon[47278]: osdmap e38: 7 total, 6 up, 7 in 2026-02-24T09:08:27.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:27.342 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:26 trial014 ceph-mon[46941]: osdmap e38: 7 total, 6 up, 7 in 2026-02-24T09:08:27.342 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:27.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.584+0000 7fe842ffd640 1 -- 10.20.193.4:0/1247861900 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fe854174e30 con 0x7fe8300b5760 2026-02-24T09:08:27.588 INFO:teuthology.orchestra.run.trial004.stdout:Created osd(s) 6 on host 'trial004' 2026-02-24T09:08:27.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.586+0000 7fe85bb21640 1 -- 10.20.193.4:0/1247861900 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8300b5760 msgr2=0x7fe8300d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.586+0000 7fe85bb21640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8300b5760 0x7fe8300d5c10 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe844004740 tx=0x7fe84400b410 comp rx=0 tx=0).stop 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.586+0000 7fe85bb21640 1 -- 10.20.193.4:0/1247861900 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe854110d90 msgr2=0x7fe8540f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.586+0000 7fe85bb21640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe854110d90 0x7fe8540f91a0 secure :-1 s=READY pgs=178 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe850006e90 tx=0x7fe85000edf0 comp rx=0 tx=0).stop 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.587+0000 7fe85bb21640 1 -- 10.20.193.4:0/1247861900 shutdown_connections 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.587+0000 7fe85bb21640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8300b5760 0x7fe8300d5c10 unknown :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.587+0000 7fe85bb21640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe854110d90 0x7fe8540f91a0 unknown :-1 s=CLOSED pgs=178 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.587+0000 7fe85bb21640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8541103e0 0x7fe854171720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.587+0000 7fe85bb21640 1 --2- 10.20.193.4:0/1247861900 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe85410f250 0x7fe8540f8940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.587+0000 7fe85bb21640 1 -- 10.20.193.4:0/1247861900 >> 10.20.193.4:0/1247861900 conn(0x7fe8540ec980 msgr2=0x7fe8540eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.587+0000 7fe85bb21640 1 -- 10.20.193.4:0/1247861900 shutdown_connections 2026-02-24T09:08:27.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:27.587+0000 7fe85bb21640 1 -- 10.20.193.4:0/1247861900 wait complete. 2026-02-24T09:08:27.629 DEBUG:teuthology.orchestra.run.trial004:osd.6> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.6.service 2026-02-24T09:08:27.632 INFO:tasks.cephadm:Deploying osd.7 on trial014 with /dev/vg_nvme/lv_2... 2026-02-24T09:08:27.632 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-24T09:08:27.753 INFO:teuthology.orchestra.run.trial014.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.b/config 2026-02-24T09:08:28.194 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:08:28.210 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial014:vg_nvme/lv_2 --skip-validation 2026-02-24T09:08:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:28 trial004 ceph-mon[41596]: pgmap v71: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-24T09:08:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:28 trial004 ceph-mon[41596]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-24T09:08:28.214 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:08:27 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:08:27.945+0000 7f671b55b780 -1 osd.6 0 log_to_monitors true 2026-02-24T09:08:28.220 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.220 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.220 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.220 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.220 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:28 trial014 ceph-mon[46941]: pgmap v71: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-24T09:08:28.220 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:28 trial014 ceph-mon[46941]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-24T09:08:28.327 INFO:teuthology.orchestra.run.trial014.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.b/config 2026-02-24T09:08:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:28 trial090 ceph-mon[47278]: pgmap v71: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-24T09:08:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:28 trial090 ceph-mon[47278]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 -- 10.20.193.14:0/2093708396 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f359c1103e0 msgr2=0x7f359c110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 --2- 10.20.193.14:0/2093708396 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f359c1103e0 0x7f359c110850 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=7371809505030010383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3584009950 tx=0x7f358402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 -- 10.20.193.14:0/2093708396 shutdown_connections 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 --2- 10.20.193.14:0/2093708396 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f359c110d90 0x7f359c171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 --2- 10.20.193.14:0/2093708396 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f359c1103e0 0x7f359c110850 unknown :-1 s=CLOSED pgs=32 gs=1 cs=0 l=1 c_cookie=7371809505030010383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 --2- 10.20.193.14:0/2093708396 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f359c10f250 0x7f359c10f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 -- 10.20.193.14:0/2093708396 >> 10.20.193.14:0/2093708396 conn(0x7f359c0ec980 msgr2=0x7f359c10cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 -- 10.20.193.14:0/2093708396 shutdown_connections 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 -- 10.20.193.14:0/2093708396 wait complete. 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 Processor -- start 2026-02-24T09:08:28.434 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 -- start start 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f359c10f250 0x7f359c0f8900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f359c1103e0 0x7f359c171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f359c110d90 0x7f359c0f9160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f359c0f9d50 con 0x7f359c110d90 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f359c0f9ec0 con 0x7f359c10f250 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a3264640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f359c0fa080 con 0x7f359c1103e0 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a0fd9640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f359c10f250 0x7f359c0f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a0fd9640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f359c10f250 0x7f359c0f8900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.14:59676/0 (socket says 10.20.193.14:59676) 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.434+0000 7f35a0fd9640 1 -- 10.20.193.14:0/1783201000 learned_addr learned my addr 10.20.193.14:0/1783201000 (peer_addr_for_me v2:10.20.193.14:0/0) 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f3593fff640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f359c1103e0 0x7f359c171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f35a17da640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f359c110d90 0x7f359c0f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f35a0fd9640 1 -- 10.20.193.14:0/1783201000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f359c1103e0 msgr2=0x7f359c171720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f35a0fd9640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f359c1103e0 0x7f359c171720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f35a0fd9640 1 -- 10.20.193.14:0/1783201000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f359c110d90 msgr2=0x7f359c0f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f35a0fd9640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f359c110d90 0x7f359c0f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f35a0fd9640 1 -- 10.20.193.14:0/1783201000 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3584009570 con 0x7f359c10f250 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f35a0fd9640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f359c10f250 0x7f359c0f8900 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f358c00d950 tx=0x7f358c00de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f3591ffb640 1 -- 10.20.193.14:0/1783201000 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f358c004540 con 0x7f359c10f250 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f35a3264640 1 -- 10.20.193.14:0/1783201000 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359c0fa360 con 0x7f359c10f250 2026-02-24T09:08:28.435 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f3591ffb640 1 -- 10.20.193.14:0/1783201000 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f358c009d00 con 0x7f359c10f250 2026-02-24T09:08:28.436 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f3591ffb640 1 -- 10.20.193.14:0/1783201000 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f358c0106e0 con 0x7f359c10f250 2026-02-24T09:08:28.436 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f35a3264640 1 -- 10.20.193.14:0/1783201000 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359c0fa830 con 0x7f359c10f250 2026-02-24T09:08:28.436 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.435+0000 7f35a3264640 1 -- 10.20.193.14:0/1783201000 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359c175790 con 0x7f359c10f250 2026-02-24T09:08:28.436 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.436+0000 7f3591ffb640 1 -- 10.20.193.14:0/1783201000 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f358c0097c0 con 0x7f359c10f250 2026-02-24T09:08:28.437 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.437+0000 7f3591ffb640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35780b56e0 0x7f35780d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:28.437 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.437+0000 7f3593fff640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35780b56e0 0x7f35780d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:28.437 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.437+0000 7f3591ffb640 1 -- 10.20.193.14:0/1783201000 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4640+0+0 (secure 0 0 0) 0x7f358c0e6430 con 0x7f359c10f250 2026-02-24T09:08:28.438 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.438+0000 7f3593fff640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35780b56e0 0x7f35780d5b90 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35840023d0 tx=0x7f3584031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:28.438 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.438+0000 7f3591ffb640 1 -- 10.20.193.14:0/1783201000 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f358c0a9c10 con 0x7f359c10f250 2026-02-24T09:08:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:28.549+0000 7f35a3264640 1 -- 10.20.193.14:0/1783201000 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f359c174ec0 con 0x7f35780b56e0 2026-02-24T09:08:29.361 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.362 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.362 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:29.362 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.362 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.362 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:29.362 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:08:29.362 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_2'] 2026-02-24T09:08:29.362 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.362 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:08:29.363 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial014 2026-02-24T09:08:29.363 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.363 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:29.363 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:29.363 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:29.363 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.363 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.363 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-24T09:08:29.363 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: osdmap e39: 7 total, 6 up, 7 in 2026-02-24T09:08:29.363 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:08:29.364 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:29 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:29.387 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.387 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_2'] 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial014 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.388 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:29.389 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:29.389 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:29.389 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.389 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.389 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-24T09:08:29.389 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: osdmap e39: 7 total, 6 up, 7 in 2026-02-24T09:08:29.389 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:08:29.389 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:29 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:29.402 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.402 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.402 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:29.403 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.403 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.403 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:29.403 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:08:29.403 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_2'] 2026-02-24T09:08:29.403 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.403 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:08:29.403 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial014 2026-02-24T09:08:29.403 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.404 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:29.404 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:29.404 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:29.404 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.404 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:29.404 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-24T09:08:29.404 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: osdmap e39: 7 total, 6 up, 7 in 2026-02-24T09:08:29.404 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:08:29.404 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:29 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:29.405 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:08:29 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:08:29.219+0000 7f67174dd640 -1 osd.6 0 waiting for initial osdmap 2026-02-24T09:08:29.405 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:08:29 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:08:29.224+0000 7f67133a4640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:08:30.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09b73119-5f2d-4d33-b62a-1b2f2421232e"} : dispatch 2026-02-24T09:08:30.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:08:30.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09b73119-5f2d-4d33-b62a-1b2f2421232e"}]': finished 2026-02-24T09:08:30.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='client.? 10.20.193.14:0/1274330612' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09b73119-5f2d-4d33-b62a-1b2f2421232e"} : dispatch 2026-02-24T09:08:30.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: osdmap e40: 8 total, 6 up, 8 in 2026-02-24T09:08:30.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:30.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:30.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:30.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: Detected new or changed devices on trial004 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial004 to 28015M 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:30.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:30.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:30.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:30.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: from='client.? 10.20.193.14:0/2203571356' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:30.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:30 trial004 ceph-mon[41596]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-24T09:08:30.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09b73119-5f2d-4d33-b62a-1b2f2421232e"} : dispatch 2026-02-24T09:08:30.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:08:30.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09b73119-5f2d-4d33-b62a-1b2f2421232e"}]': finished 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='client.? 10.20.193.14:0/1274330612' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09b73119-5f2d-4d33-b62a-1b2f2421232e"} : dispatch 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: osdmap e40: 8 total, 6 up, 8 in 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: Detected new or changed devices on trial004 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial004 to 28015M 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:30.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:30.586 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: from='client.? 10.20.193.14:0/2203571356' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:30.586 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:30 trial090 ceph-mon[47278]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-24T09:08:30.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09b73119-5f2d-4d33-b62a-1b2f2421232e"} : dispatch 2026-02-24T09:08:30.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:08:30.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09b73119-5f2d-4d33-b62a-1b2f2421232e"}]': finished 2026-02-24T09:08:30.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='client.? 10.20.193.14:0/1274330612' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "09b73119-5f2d-4d33-b62a-1b2f2421232e"} : dispatch 2026-02-24T09:08:30.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: osdmap e40: 8 total, 6 up, 8 in 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: Detected new or changed devices on trial004 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:30.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial004 to 28015M 2026-02-24T09:08:30.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:30.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:30.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:30.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:30.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:30.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:30.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: from='client.? 10.20.193.14:0/2203571356' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:30.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:30 trial014 ceph-mon[46941]: pgmap v74: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-24T09:08:31.488 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:31 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:08:31.488 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:31 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:08:31.488 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:31 trial014 ceph-mon[46941]: osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] boot 2026-02-24T09:08:31.488 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:31 trial014 ceph-mon[46941]: osdmap e41: 8 total, 7 up, 8 in 2026-02-24T09:08:31.488 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:31 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:31.488 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:31 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:31.510 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:31 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:08:31.510 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:31 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:08:31.510 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:31 trial004 ceph-mon[41596]: osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] boot 2026-02-24T09:08:31.510 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:31 trial004 ceph-mon[41596]: osdmap e41: 8 total, 7 up, 8 in 2026-02-24T09:08:31.510 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:31 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:31.510 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:31 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:31.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:31 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:08:31.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:31 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:08:31.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:31 trial090 ceph-mon[47278]: osd.6 [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] boot 2026-02-24T09:08:31.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:31 trial090 ceph-mon[47278]: osdmap e41: 8 total, 7 up, 8 in 2026-02-24T09:08:31.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:31 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-24T09:08:31.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:31 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:32.283 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:08:32.283 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:32.283 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:32 trial014 ceph-mon[46941]: Deploying daemon osd.7 on trial014 2026-02-24T09:08:32.283 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:32 trial014 ceph-mon[46941]: osdmap e42: 8 total, 7 up, 8 in 2026-02-24T09:08:32.283 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:32.284 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:32 trial014 ceph-mon[46941]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:32.284 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:08:32.284 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:32 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:32.284 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:32 trial014 ceph-mon[46941]: Deploying daemon osd.7 on trial014 2026-02-24T09:08:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:08:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:32 trial090 ceph-mon[47278]: Deploying daemon osd.7 on trial014 2026-02-24T09:08:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:32 trial090 ceph-mon[47278]: osdmap e42: 8 total, 7 up, 8 in 2026-02-24T09:08:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:32 trial090 ceph-mon[47278]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:08:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:32 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:32.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:32 trial090 ceph-mon[47278]: Deploying daemon osd.7 on trial014 2026-02-24T09:08:32.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:08:32.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:32.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:32 trial004 ceph-mon[41596]: Deploying daemon osd.7 on trial014 2026-02-24T09:08:32.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:32 trial004 ceph-mon[41596]: osdmap e42: 8 total, 7 up, 8 in 2026-02-24T09:08:32.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:32.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:32 trial004 ceph-mon[41596]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:32.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-24T09:08:32.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:32 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:32.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:32 trial004 ceph-mon[41596]: Deploying daemon osd.7 on trial014 2026-02-24T09:08:34.252 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:34 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:34.253 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:34 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:34.253 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:34 trial014 ceph-mon[46941]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:34.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:34 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:34.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:34 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:34.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:34 trial090 ceph-mon[47278]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:34.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:34 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:34.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:34 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:34.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:34 trial004 ceph-mon[41596]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:35.385 INFO:teuthology.orchestra.run.trial014.stdout:Created osd(s) 7 on host 'trial014' 2026-02-24T09:08:35.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.384+0000 7f3591ffb640 1 -- 10.20.193.14:0/1783201000 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f359c174ec0 con 0x7f35780b56e0 2026-02-24T09:08:35.387 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 -- 10.20.193.14:0/1783201000 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35780b56e0 msgr2=0x7f35780d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:35.387 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35780b56e0 0x7f35780d5b90 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35840023d0 tx=0x7f3584031040 comp rx=0 tx=0).stop 2026-02-24T09:08:35.387 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 -- 10.20.193.14:0/1783201000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f359c10f250 msgr2=0x7f359c0f8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:35.388 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f359c10f250 0x7f359c0f8900 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f358c00d950 tx=0x7f358c00de20 comp rx=0 tx=0).stop 2026-02-24T09:08:35.388 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 -- 10.20.193.14:0/1783201000 shutdown_connections 2026-02-24T09:08:35.388 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35780b56e0 0x7f35780d5b90 unknown :-1 s=CLOSED pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:35.388 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f359c110d90 0x7f359c0f9160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:35.388 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f359c1103e0 0x7f359c171720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:35.388 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 --2- 10.20.193.14:0/1783201000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f359c10f250 0x7f359c0f8900 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:35.388 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 -- 10.20.193.14:0/1783201000 >> 10.20.193.14:0/1783201000 conn(0x7f359c0ec980 msgr2=0x7f359c0eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:35.388 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 -- 10.20.193.14:0/1783201000 shutdown_connections 2026-02-24T09:08:35.388 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:35.387+0000 7f35a3264640 1 -- 10.20.193.14:0/1783201000 wait complete. 2026-02-24T09:08:35.428 DEBUG:teuthology.orchestra.run.trial014:osd.7> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.7.service 2026-02-24T09:08:35.470 INFO:tasks.cephadm:Deploying osd.8 on trial090 with /dev/vg_nvme/lv_2... 2026-02-24T09:08:35.471 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-24T09:08:35.593 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:08:36.011 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:35 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:35 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:35 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:35 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:35 trial090 ceph-mon[47278]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:36.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:35 trial090 ceph-mon[47278]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:08:36.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:35 trial090 ceph-mon[47278]: from='osd.7 [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:08:36.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:35 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.012 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:35 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.075 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:08:36.091 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_2 --skip-validation 2026-02-24T09:08:36.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:35 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:35 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:35 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:35 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:35 trial014 ceph-mon[46941]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:36.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:35 trial014 ceph-mon[46941]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:08:36.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:35 trial014 ceph-mon[46941]: from='osd.7 [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:08:36.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:35 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:35 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.094 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:08:35 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:08:35.769+0000 7ffb9982f780 -1 osd.7 0 log_to_monitors true 2026-02-24T09:08:36.163 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:35 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.164 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:35 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.164 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:35 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.164 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:35 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.164 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:35 trial004 ceph-mon[41596]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:36.164 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:35 trial004 ceph-mon[41596]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:08:36.164 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:35 trial004 ceph-mon[41596]: from='osd.7 [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-24T09:08:36.164 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:35 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.164 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:35 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:36.207 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:08:36.310 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 -- 10.20.193.90:0/1544772923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa5581103e0 msgr2=0x7fa558110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:36.310 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 --2- 10.20.193.90:0/1544772923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa5581103e0 0x7fa558110850 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=3299240813698541351 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa54c009950 tx=0x7fa54c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:08:36.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 -- 10.20.193.90:0/1544772923 shutdown_connections 2026-02-24T09:08:36.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 --2- 10.20.193.90:0/1544772923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa558110d90 0x7fa558171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:36.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 --2- 10.20.193.90:0/1544772923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa5581103e0 0x7fa558110850 unknown :-1 s=CLOSED pgs=40 gs=1 cs=0 l=1 c_cookie=3299240813698541351 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:36.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 --2- 10.20.193.90:0/1544772923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa55810f250 0x7fa55810f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:36.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 -- 10.20.193.90:0/1544772923 >> 10.20.193.90:0/1544772923 conn(0x7fa5580ec980 msgr2=0x7fa55810cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:36.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 -- 10.20.193.90:0/1544772923 shutdown_connections 2026-02-24T09:08:36.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 -- 10.20.193.90:0/1544772923 wait complete. 2026-02-24T09:08:36.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 Processor -- start 2026-02-24T09:08:36.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 -- start start 2026-02-24T09:08:36.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa55810f250 0x7fa5580f8950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.307+0000 7fa55f7fb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa5581103e0 0x7fa558171700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55f7fb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa558110d90 0x7fa5580f9190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55f7fb640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580f9df0 con 0x7fa558110d90 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55f7fb640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580f9f60 con 0x7fa55810f250 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55f7fb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580fa120 con 0x7fa5581103e0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55cd6f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa5581103e0 0x7fa558171700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55cd6f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa5581103e0 0x7fa558171700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38904/0 (socket says 10.20.193.90:38904) 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55cd6f640 1 -- 10.20.193.90:0/861420892 learned_addr learned my addr 10.20.193.90:0/861420892 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55d570640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa55810f250 0x7fa5580f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55dd71640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa558110d90 0x7fa5580f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55cd6f640 1 -- 10.20.193.90:0/861420892 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa55810f250 msgr2=0x7fa5580f8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55cd6f640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa55810f250 0x7fa5580f8950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55cd6f640 1 -- 10.20.193.90:0/861420892 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa558110d90 msgr2=0x7fa5580f9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55cd6f640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa558110d90 0x7fa5580f9190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55cd6f640 1 -- 10.20.193.90:0/861420892 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c009570 con 0x7fa5581103e0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55cd6f640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa5581103e0 0x7fa558171700 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa54c002d80 tx=0x7fa54c0028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa5467fc640 1 -- 10.20.193.90:0/861420892 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa54c03d070 con 0x7fa5581103e0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa5467fc640 1 -- 10.20.193.90:0/861420892 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa54c002e20 con 0x7fa5581103e0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa5467fc640 1 -- 10.20.193.90:0/861420892 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa54c041a90 con 0x7fa5581103e0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55f7fb640 1 -- 10.20.193.90:0/861420892 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5580fa3a0 con 0x7fa5581103e0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55f7fb640 1 -- 10.20.193.90:0/861420892 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5580fa7c0 con 0x7fa5581103e0 2026-02-24T09:08:36.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.308+0000 7fa55f7fb640 1 -- 10.20.193.90:0/861420892 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5580fa9e0 con 0x7fa5581103e0 2026-02-24T09:08:36.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.310+0000 7fa5467fc640 1 -- 10.20.193.90:0/861420892 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7fa54c02fca0 con 0x7fa5581103e0 2026-02-24T09:08:36.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.310+0000 7fa5467fc640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa5340b5760 0x7fa5340d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:36.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.310+0000 7fa5467fc640 1 -- 10.20.193.90:0/861420892 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5072+0+0 (secure 0 0 0) 0x7fa54c10ad60 con 0x7fa5581103e0 2026-02-24T09:08:36.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.310+0000 7fa55d570640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa5340b5760 0x7fa5340d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:36.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.311+0000 7fa55d570640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa5340b5760 0x7fa5340d5c10 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa548004740 tx=0x7fa548005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:36.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.311+0000 7fa5467fc640 1 -- 10.20.193.90:0/861420892 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa54c0ce3d0 con 0x7fa5581103e0 2026-02-24T09:08:36.424 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:36.420+0000 7fa55f7fb640 1 -- 10.20.193.90:0/861420892 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fa558174e50 con 0x7fa5340b5760 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: osdmap e43: 8 total, 7 up, 8 in 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='osd.7 [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_2'] 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial090 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:37.186 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:36 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:37.202 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:37.202 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: osdmap e43: 8 total, 7 up, 8 in 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='osd.7 [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_2'] 2026-02-24T09:08:37.203 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.204 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:08:37.204 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial090 2026-02-24T09:08:37.204 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.204 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:37.204 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:37.204 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:36 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:37.225 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:08:37 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:08:37.104+0000 7ffb957b1640 -1 osd.7 0 waiting for initial osdmap 2026-02-24T09:08:37.226 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:08:37 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:08:37.108+0000 7ffb91678640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:08:37.226 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:37.226 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.226 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.226 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.226 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.226 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-24T09:08:37.226 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: osdmap e43: 8 total, 7 up, 8 in 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='osd.7 [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_2'] 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial090 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:37.227 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:37.228 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:36 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:38.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/1049472610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df60627d-303b-4c18-80fc-21774d90b61c"} : dispatch 2026-02-24T09:08:38.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df60627d-303b-4c18-80fc-21774d90b61c"} : dispatch 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df60627d-303b-4c18-80fc-21774d90b61c"}]': finished 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: osdmap e44: 9 total, 7 up, 9 in 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: Detected new or changed devices on trial014 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial014 to 28015M 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:38.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:38.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:38.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/3931404283' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:38.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:37 trial004 ceph-mon[41596]: pgmap v82: 1 pgs: 1 unknown; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.90:0/1049472610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df60627d-303b-4c18-80fc-21774d90b61c"} : dispatch 2026-02-24T09:08:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df60627d-303b-4c18-80fc-21774d90b61c"} : dispatch 2026-02-24T09:08:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:08:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df60627d-303b-4c18-80fc-21774d90b61c"}]': finished 2026-02-24T09:08:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: osdmap e44: 9 total, 7 up, 9 in 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: Detected new or changed devices on trial014 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial014 to 28015M 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.90:0/3931404283' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:38.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:37 trial090 ceph-mon[47278]: pgmap v82: 1 pgs: 1 unknown; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.90:0/1049472610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df60627d-303b-4c18-80fc-21774d90b61c"} : dispatch 2026-02-24T09:08:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "df60627d-303b-4c18-80fc-21774d90b61c"} : dispatch 2026-02-24T09:08:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:08:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df60627d-303b-4c18-80fc-21774d90b61c"}]': finished 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: osdmap e44: 9 total, 7 up, 9 in 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: Detected new or changed devices on trial014 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial014 to 28015M 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.90:0/3931404283' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:38.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:37 trial014 ceph-mon[46941]: pgmap v82: 1 pgs: 1 unknown; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-24T09:08:39.149 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:38 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:08:39.149 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:38 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:08:39.149 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:38 trial090 ceph-mon[47278]: osd.7 [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] boot 2026-02-24T09:08:39.149 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:38 trial090 ceph-mon[47278]: osdmap e45: 9 total, 8 up, 9 in 2026-02-24T09:08:39.149 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:38 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:39.149 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:38 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:38 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:08:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:38 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:08:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:38 trial004 ceph-mon[41596]: osd.7 [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] boot 2026-02-24T09:08:39.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:38 trial004 ceph-mon[41596]: osdmap e45: 9 total, 8 up, 9 in 2026-02-24T09:08:39.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:38 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:39.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:38 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:38 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:08:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:38 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:08:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:38 trial014 ceph-mon[46941]: osd.7 [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] boot 2026-02-24T09:08:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:38 trial014 ceph-mon[46941]: osdmap e45: 9 total, 8 up, 9 in 2026-02-24T09:08:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:38 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-24T09:08:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:38 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:39.975 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:39 trial090 ceph-mon[47278]: osdmap e46: 9 total, 8 up, 9 in 2026-02-24T09:08:39.975 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:39 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:39.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:39 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:08:39.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:39 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:39.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:39 trial090 ceph-mon[47278]: Deploying daemon osd.8 on trial090 2026-02-24T09:08:39.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:39 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:08:39.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:39 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:39.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:39 trial090 ceph-mon[47278]: Deploying daemon osd.8 on trial090 2026-02-24T09:08:39.977 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:39 trial090 ceph-mon[47278]: pgmap v85: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:39 trial004 ceph-mon[41596]: osdmap e46: 9 total, 8 up, 9 in 2026-02-24T09:08:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:39 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:39 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:08:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:39 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:39 trial004 ceph-mon[41596]: Deploying daemon osd.8 on trial090 2026-02-24T09:08:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:39 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:08:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:39 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:39 trial004 ceph-mon[41596]: Deploying daemon osd.8 on trial090 2026-02-24T09:08:40.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:39 trial004 ceph-mon[41596]: pgmap v85: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:40.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:39 trial014 ceph-mon[46941]: osdmap e46: 9 total, 8 up, 9 in 2026-02-24T09:08:40.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:39 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:40.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:39 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:08:40.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:39 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:40.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:39 trial014 ceph-mon[46941]: Deploying daemon osd.8 on trial090 2026-02-24T09:08:40.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:39 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-24T09:08:40.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:39 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:40.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:39 trial014 ceph-mon[46941]: Deploying daemon osd.8 on trial090 2026-02-24T09:08:40.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:39 trial014 ceph-mon[46941]: pgmap v85: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:40.961 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:40 trial090 ceph-mon[47278]: osdmap e47: 9 total, 8 up, 9 in 2026-02-24T09:08:40.961 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:40 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:41.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:40 trial004 ceph-mon[41596]: osdmap e47: 9 total, 8 up, 9 in 2026-02-24T09:08:41.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:40 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:41.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:40 trial014 ceph-mon[46941]: osdmap e47: 9 total, 8 up, 9 in 2026-02-24T09:08:41.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:40 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:42.081 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:41 trial090 ceph-mon[47278]: osdmap e48: 9 total, 8 up, 9 in 2026-02-24T09:08:42.081 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:42.081 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:42.081 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:41 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:42.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:41 trial090 ceph-mon[47278]: pgmap v88: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:42.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:41 trial004 ceph-mon[41596]: osdmap e48: 9 total, 8 up, 9 in 2026-02-24T09:08:42.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:42.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:42.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:41 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:42.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:41 trial004 ceph-mon[41596]: pgmap v88: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:41 trial014 ceph-mon[46941]: osdmap e48: 9 total, 8 up, 9 in 2026-02-24T09:08:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:41 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:41 trial014 ceph-mon[46941]: pgmap v88: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:43.017 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:42 trial090 ceph-mon[47278]: osdmap e49: 9 total, 8 up, 9 in 2026-02-24T09:08:43.018 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:42 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:43.018 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:42 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:43.018 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:42 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:42 trial004 ceph-mon[41596]: osdmap e49: 9 total, 8 up, 9 in 2026-02-24T09:08:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:42 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:42 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:42 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:43.330 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.328+0000 7fa5467fc640 1 -- 10.20.193.90:0/861420892 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fa558174e50 con 0x7fa5340b5760 2026-02-24T09:08:43.331 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 8 on host 'trial090' 2026-02-24T09:08:43.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.330+0000 7fa55f7fb640 1 -- 10.20.193.90:0/861420892 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa5340b5760 msgr2=0x7fa5340d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:43.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.330+0000 7fa55f7fb640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa5340b5760 0x7fa5340d5c10 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa548004740 tx=0x7fa548005f90 comp rx=0 tx=0).stop 2026-02-24T09:08:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.330+0000 7fa55f7fb640 1 -- 10.20.193.90:0/861420892 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa5581103e0 msgr2=0x7fa558171700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.330+0000 7fa55f7fb640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa5581103e0 0x7fa558171700 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa54c002d80 tx=0x7fa54c0028d0 comp rx=0 tx=0).stop 2026-02-24T09:08:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.330+0000 7fa55f7fb640 1 -- 10.20.193.90:0/861420892 shutdown_connections 2026-02-24T09:08:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.330+0000 7fa55f7fb640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa5340b5760 0x7fa5340d5c10 unknown :-1 s=CLOSED pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.330+0000 7fa55f7fb640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa558110d90 0x7fa5580f9190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.330+0000 7fa55f7fb640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa5581103e0 0x7fa558171700 unknown :-1 s=CLOSED pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.330+0000 7fa55f7fb640 1 --2- 10.20.193.90:0/861420892 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa55810f250 0x7fa5580f8950 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.330+0000 7fa55f7fb640 1 -- 10.20.193.90:0/861420892 >> 10.20.193.90:0/861420892 conn(0x7fa5580ec980 msgr2=0x7fa5580eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.331+0000 7fa55f7fb640 1 -- 10.20.193.90:0/861420892 shutdown_connections 2026-02-24T09:08:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:43.331+0000 7fa55f7fb640 1 -- 10.20.193.90:0/861420892 wait complete. 2026-02-24T09:08:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:42 trial014 ceph-mon[46941]: osdmap e49: 9 total, 8 up, 9 in 2026-02-24T09:08:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:42 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:42 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:42 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:43.372 DEBUG:teuthology.orchestra.run.trial090:osd.8> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.8.service 2026-02-24T09:08:43.375 INFO:tasks.cephadm:Deploying osd.9 on trial004 with /dev/vg_nvme/lv_1... 2026-02-24T09:08:43.375 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-24T09:08:43.496 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:08:43.971 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:08:43.989 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial004:vg_nvme/lv_1 --skip-validation 2026-02-24T09:08:44.075 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:08:43 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:08:43.727+0000 7efd2a677780 -1 osd.8 0 log_to_monitors true 2026-02-24T09:08:44.108 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:08:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.210+0000 7f378e323640 1 -- 10.20.193.4:0/443535077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3788110d90 msgr2=0x7f3788171720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.210+0000 7f378e323640 1 --2- 10.20.193.4:0/443535077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3788110d90 0x7f3788171720 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=12961747839402771505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f377c00aa30 tx=0x7f377c030280 comp rx=0 tx=0).stop 2026-02-24T09:08:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.210+0000 7f378e323640 1 -- 10.20.193.4:0/443535077 shutdown_connections 2026-02-24T09:08:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.210+0000 7f378e323640 1 --2- 10.20.193.4:0/443535077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3788110d90 0x7f3788171720 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=12961747839402771505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.210+0000 7f378e323640 1 --2- 10.20.193.4:0/443535077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37881103e0 0x7f3788110850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.210+0000 7f378e323640 1 --2- 10.20.193.4:0/443535077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f378810f250 0x7f378810f640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.210+0000 7f378e323640 1 -- 10.20.193.4:0/443535077 >> 10.20.193.4:0/443535077 conn(0x7f37880ec980 msgr2=0x7f378810cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.210+0000 7f378e323640 1 -- 10.20.193.4:0/443535077 shutdown_connections 2026-02-24T09:08:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.210+0000 7f378e323640 1 -- 10.20.193.4:0/443535077 wait complete. 2026-02-24T09:08:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f378e323640 1 Processor -- start 2026-02-24T09:08:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f378e323640 1 -- start start 2026-02-24T09:08:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f378e323640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f378810f250 0x7f37880f88a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f378e323640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37881103e0 0x7f3788171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f378e323640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3788110d90 0x7f37880f9100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f378e323640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f37880f9cf0 con 0x7f378810f250 2026-02-24T09:08:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f378e323640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f37880f9e60 con 0x7f37881103e0 2026-02-24T09:08:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f378e323640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37880fa020 con 0x7f3788110d90 2026-02-24T09:08:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f3787fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f378810f250 0x7f37880f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f3787fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f378810f250 0x7f37880f88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:37710/0 (socket says 10.20.193.4:37710) 2026-02-24T09:08:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f3787fff640 1 -- 10.20.193.4:0/450847941 learned_addr learned my addr 10.20.193.4:0/450847941 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:08:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f378c899640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3788110d90 0x7f37880f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f37877fe640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37881103e0 0x7f3788171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f3787fff640 1 -- 10.20.193.4:0/450847941 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3788110d90 msgr2=0x7f37880f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f3787fff640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3788110d90 0x7f37880f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f3787fff640 1 -- 10.20.193.4:0/450847941 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37881103e0 msgr2=0x7f3788171720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f3787fff640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37881103e0 0x7f3788171720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f3787fff640 1 -- 10.20.193.4:0/450847941 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c00a650 con 0x7f378810f250 2026-02-24T09:08:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f37877fe640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37881103e0 0x7f3788171720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:08:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f3787fff640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f378810f250 0x7f37880f88a0 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f377400d950 tx=0x7f377400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.211+0000 7f37857fa640 1 -- 10.20.193.4:0/450847941 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3774004540 con 0x7f378810f250 2026-02-24T09:08:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.212+0000 7f37857fa640 1 -- 10.20.193.4:0/450847941 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3774009d00 con 0x7f378810f250 2026-02-24T09:08:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.212+0000 7f378e323640 1 -- 10.20.193.4:0/450847941 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37880fa300 con 0x7f378810f250 2026-02-24T09:08:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.212+0000 7f37857fa640 1 -- 10.20.193.4:0/450847941 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37740106e0 con 0x7f378810f250 2026-02-24T09:08:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.212+0000 7f378e323640 1 -- 10.20.193.4:0/450847941 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37880fa7d0 con 0x7f378810f250 2026-02-24T09:08:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.212+0000 7f378e323640 1 -- 10.20.193.4:0/450847941 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3788175740 con 0x7f378810f250 2026-02-24T09:08:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.213+0000 7f37857fa640 1 -- 10.20.193.4:0/450847941 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f37740097c0 con 0x7f378810f250 2026-02-24T09:08:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.214+0000 7f37857fa640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f375c0b56e0 0x7f375c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.214+0000 7f37877fe640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f375c0b56e0 0x7f375c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.214+0000 7f37857fa640 1 -- 10.20.193.4:0/450847941 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5504+0+0 (secure 0 0 0) 0x7f37740e6750 con 0x7f378810f250 2026-02-24T09:08:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.214+0000 7f37877fe640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f375c0b56e0 0x7f375c0d5b90 secure :-1 s=READY pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3778004740 tx=0x7f3778005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.214+0000 7f37857fa640 1 -- 10.20.193.4:0/450847941 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f37740a9bd0 con 0x7f378810f250 2026-02-24T09:08:44.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:44.324+0000 7f378e323640 1 -- 10.20.193.4:0/450847941 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f3788174e70 con 0x7f375c0b56e0 2026-02-24T09:08:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:08:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='osd.8 [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:08:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:44 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:44.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:08:44.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='osd.8 [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:08:44.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:44.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:44 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:44.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:08:44.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='osd.8 [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-24T09:08:44.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:44.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:44.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:44 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.333 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:08:45 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:08:45.001+0000 7efd265f9640 -1 osd.8 0 waiting for initial osdmap 2026-02-24T09:08:45.333 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:08:45 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:08:45.006+0000 7efd1e4b8640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:08:45.388 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:45.388 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:08:45.388 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_1'] 2026-02-24T09:08:45.389 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-24T09:08:45.389 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.389 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: osdmap e50: 9 total, 8 up, 9 in 2026-02-24T09:08:45.389 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:45.389 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:08:45.389 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial004 2026-02-24T09:08:45.389 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='osd.8 [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:45.389 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.389 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:45.389 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:45.390 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:45.390 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:45.390 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/149296052' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b446de8d-9063-4793-ad1f-a3db68e735ff"} : dispatch 2026-02-24T09:08:45.390 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:08:45.390 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/149296052' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b446de8d-9063-4793-ad1f-a3db68e735ff"}]': finished 2026-02-24T09:08:45.390 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: osdmap e51: 10 total, 8 up, 10 in 2026-02-24T09:08:45.390 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:45.390 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:45.390 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:45.390 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:45.391 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:45.392 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.392 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:45.392 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:45.392 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:45.392 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:45 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/843992971' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:45.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:45.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:08:45.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_1'] 2026-02-24T09:08:45.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-24T09:08:45.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: osdmap e50: 9 total, 8 up, 9 in 2026-02-24T09:08:45.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial004 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='osd.8 [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/149296052' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b446de8d-9063-4793-ad1f-a3db68e735ff"} : dispatch 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/149296052' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b446de8d-9063-4793-ad1f-a3db68e735ff"}]': finished 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: osdmap e51: 10 total, 8 up, 10 in 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:45.595 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:45 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/843992971' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:45.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='client.14625 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial004:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:45.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:08:45.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial004:['vg_nvme/lv_1'] 2026-02-24T09:08:45.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-24T09:08:45.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: osdmap e50: 9 total, 8 up, 9 in 2026-02-24T09:08:45.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:45.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: Marking host: trial004 for OSDSpec preview refresh. 2026-02-24T09:08:45.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial004 2026-02-24T09:08:45.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='osd.8 [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:45.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/149296052' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b446de8d-9063-4793-ad1f-a3db68e735ff"} : dispatch 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/149296052' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b446de8d-9063-4793-ad1f-a3db68e735ff"}]': finished 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: osdmap e51: 10 total, 8 up, 10 in 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:45.836 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:45.837 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:45.837 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:45.837 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:45 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/843992971' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:46.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:46 trial014 ceph-mon[46941]: Detected new or changed devices on trial090 2026-02-24T09:08:46.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:46 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial090 to 28015M 2026-02-24T09:08:46.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:46 trial014 ceph-mon[46941]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:46.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:46 trial014 ceph-mon[46941]: osd.8 [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] boot 2026-02-24T09:08:46.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:46 trial014 ceph-mon[46941]: osdmap e52: 10 total, 9 up, 10 in 2026-02-24T09:08:46.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:46 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:46.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:46 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:46.624 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:46 trial004 ceph-mon[41596]: Detected new or changed devices on trial090 2026-02-24T09:08:46.625 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:46 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial090 to 28015M 2026-02-24T09:08:46.625 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:46 trial004 ceph-mon[41596]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:46.625 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:46 trial004 ceph-mon[41596]: osd.8 [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] boot 2026-02-24T09:08:46.625 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:46 trial004 ceph-mon[41596]: osdmap e52: 10 total, 9 up, 10 in 2026-02-24T09:08:46.625 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:46 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:46.625 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:46 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:46.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:46 trial090 ceph-mon[47278]: Detected new or changed devices on trial090 2026-02-24T09:08:46.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:46 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial090 to 28015M 2026-02-24T09:08:46.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:46 trial090 ceph-mon[47278]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-24T09:08:46.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:46 trial090 ceph-mon[47278]: osd.8 [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] boot 2026-02-24T09:08:46.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:46 trial090 ceph-mon[47278]: osdmap e52: 10 total, 9 up, 10 in 2026-02-24T09:08:46.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:46 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-24T09:08:46.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:46 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:47.433 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:47 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:08:47.434 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:47 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:08:47.434 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:47 trial004 ceph-mon[41596]: osdmap e53: 10 total, 9 up, 10 in 2026-02-24T09:08:47.434 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:47 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:47.434 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:47 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:08:47.434 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:47 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:47.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:47 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:08:47.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:47 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:08:47.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:47 trial014 ceph-mon[46941]: osdmap e53: 10 total, 9 up, 10 in 2026-02-24T09:08:47.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:47 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:47.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:47 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:08:47.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:47 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:47.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:47 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:08:47.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:47 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:08:47.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:47 trial090 ceph-mon[47278]: osdmap e53: 10 total, 9 up, 10 in 2026-02-24T09:08:47.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:47 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:47.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:47 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:08:47.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:47 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:48.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:48 trial014 ceph-mon[46941]: Deploying daemon osd.9 on trial004 2026-02-24T09:08:48.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:08:48.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:48.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:48 trial014 ceph-mon[46941]: Deploying daemon osd.9 on trial004 2026-02-24T09:08:48.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:48 trial014 ceph-mon[46941]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:08:48.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:48 trial014 ceph-mon[46941]: osdmap e54: 10 total, 9 up, 10 in 2026-02-24T09:08:48.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:48 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:48.682 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:48 trial004 ceph-mon[41596]: Deploying daemon osd.9 on trial004 2026-02-24T09:08:48.683 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:08:48.683 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:48.683 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:48 trial004 ceph-mon[41596]: Deploying daemon osd.9 on trial004 2026-02-24T09:08:48.683 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:48 trial004 ceph-mon[41596]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:08:48.683 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:48 trial004 ceph-mon[41596]: osdmap e54: 10 total, 9 up, 10 in 2026-02-24T09:08:48.683 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:48 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:48.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:48 trial090 ceph-mon[47278]: Deploying daemon osd.9 on trial004 2026-02-24T09:08:48.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-24T09:08:48.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:48.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:48 trial090 ceph-mon[47278]: Deploying daemon osd.9 on trial004 2026-02-24T09:08:48.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:48 trial090 ceph-mon[47278]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-24T09:08:48.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:48 trial090 ceph-mon[47278]: osdmap e54: 10 total, 9 up, 10 in 2026-02-24T09:08:48.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:48 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:50.037 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:50.037 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:50.037 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:49 trial004 ceph-mon[41596]: osdmap e55: 10 total, 9 up, 10 in 2026-02-24T09:08:50.037 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:49 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:50.037 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:49 trial004 ceph-mon[41596]: pgmap v99: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 2/6 objects degraded (33.333%) 2026-02-24T09:08:50.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:50.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:50.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:49 trial090 ceph-mon[47278]: osdmap e55: 10 total, 9 up, 10 in 2026-02-24T09:08:50.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:49 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:50.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:49 trial090 ceph-mon[47278]: pgmap v99: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 2/6 objects degraded (33.333%) 2026-02-24T09:08:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:49 trial014 ceph-mon[46941]: osdmap e55: 10 total, 9 up, 10 in 2026-02-24T09:08:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:49 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:50.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:49 trial014 ceph-mon[46941]: pgmap v99: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 2/6 objects degraded (33.333%) 2026-02-24T09:08:51.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.203+0000 7f37857fa640 1 -- 10.20.193.4:0/450847941 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f3788174e70 con 0x7f375c0b56e0 2026-02-24T09:08:51.205 INFO:teuthology.orchestra.run.trial004.stdout:Created osd(s) 9 on host 'trial004' 2026-02-24T09:08:51.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:50 trial004 ceph-mon[41596]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-24T09:08:51.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:50 trial004 ceph-mon[41596]: osdmap e56: 10 total, 9 up, 10 in 2026-02-24T09:08:51.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:50 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:51.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:50 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:51.206 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:50 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 -- 10.20.193.4:0/450847941 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f375c0b56e0 msgr2=0x7f375c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f375c0b56e0 0x7f375c0d5b90 secure :-1 s=READY pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3778004740 tx=0x7f3778005f90 comp rx=0 tx=0).stop 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 -- 10.20.193.4:0/450847941 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f378810f250 msgr2=0x7f37880f88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f378810f250 0x7f37880f88a0 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f377400d950 tx=0x7f377400de20 comp rx=0 tx=0).stop 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 -- 10.20.193.4:0/450847941 shutdown_connections 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f375c0b56e0 0x7f375c0d5b90 unknown :-1 s=CLOSED pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3788110d90 0x7f37880f9100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37881103e0 0x7f3788171720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 --2- 10.20.193.4:0/450847941 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f378810f250 0x7f37880f88a0 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 -- 10.20.193.4:0/450847941 >> 10.20.193.4:0/450847941 conn(0x7f37880ec980 msgr2=0x7f37880eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 -- 10.20.193.4:0/450847941 shutdown_connections 2026-02-24T09:08:51.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:08:51.205+0000 7f378e323640 1 -- 10.20.193.4:0/450847941 wait complete. 2026-02-24T09:08:51.250 DEBUG:teuthology.orchestra.run.trial004:osd.9> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.9.service 2026-02-24T09:08:51.253 INFO:tasks.cephadm:Deploying osd.10 on trial014 with /dev/vg_nvme/lv_1... 2026-02-24T09:08:51.254 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-24T09:08:51.278 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:50 trial014 ceph-mon[46941]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-24T09:08:51.278 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:50 trial014 ceph-mon[46941]: osdmap e56: 10 total, 9 up, 10 in 2026-02-24T09:08:51.278 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:50 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:51.278 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:50 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:51.278 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:50 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:51.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:50 trial090 ceph-mon[47278]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-24T09:08:51.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:50 trial090 ceph-mon[47278]: osdmap e56: 10 total, 9 up, 10 in 2026-02-24T09:08:51.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:50 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:51.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:50 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:51.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:50 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:51.372 INFO:teuthology.orchestra.run.trial014.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.b/config 2026-02-24T09:08:51.850 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T09:08:51.865 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial014:vg_nvme/lv_1 --skip-validation 2026-02-24T09:08:51.950 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:08:51 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:08:51.631+0000 7fe569efd780 -1 osd.9 0 log_to_monitors true 2026-02-24T09:08:52.021 INFO:teuthology.orchestra.run.trial014.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.b/config 2026-02-24T09:08:52.130 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/2046087963 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe9d01103e0 msgr2=0x7fe9d0110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:52.130 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 --2- 10.20.193.14:0/2046087963 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe9d01103e0 0x7fe9d0110850 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=7631594361435683071 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9b4009950 tx=0x7fe9b402f190 comp rx=0 tx=0).stop 2026-02-24T09:08:52.130 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/2046087963 shutdown_connections 2026-02-24T09:08:52.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 --2- 10.20.193.14:0/2046087963 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9d0110d90 0x7fe9d0171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:52.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 --2- 10.20.193.14:0/2046087963 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe9d01103e0 0x7fe9d0110850 unknown :-1 s=CLOSED pgs=42 gs=1 cs=0 l=1 c_cookie=7631594361435683071 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:52.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 --2- 10.20.193.14:0/2046087963 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe9d010f250 0x7fe9d010f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:52.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/2046087963 >> 10.20.193.14:0/2046087963 conn(0x7fe9d00ec980 msgr2=0x7fe9d010cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:52.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/2046087963 shutdown_connections 2026-02-24T09:08:52.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/2046087963 wait complete. 2026-02-24T09:08:52.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 Processor -- start 2026-02-24T09:08:52.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.127+0000 7fe9d6ddd640 1 -- start start 2026-02-24T09:08:52.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9d6ddd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe9d010f250 0x7fe9d00f88f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:52.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9d6ddd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe9d01103e0 0x7fe9d0171700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9d6ddd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9d0110d90 0x7fe9d00f9130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9d6ddd640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d00f9d00 con 0x7fe9d010f250 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9d6ddd640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d00f9e70 con 0x7fe9d01103e0 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9d6ddd640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d00fa030 con 0x7fe9d0110d90 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cffff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe9d01103e0 0x7fe9d0171700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cffff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe9d01103e0 0x7fe9d0171700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.14:35580/0 (socket says 10.20.193.14:35580) 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cffff640 1 -- 10.20.193.14:0/23157572 learned_addr learned my addr 10.20.193.14:0/23157572 (peer_addr_for_me v2:10.20.193.14:0/0) 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9d5353640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9d0110d90 0x7fe9d00f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cffff640 1 -- 10.20.193.14:0/23157572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9d0110d90 msgr2=0x7fe9d00f9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cffff640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9d0110d90 0x7fe9d00f9130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:52.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cffff640 1 -- 10.20.193.14:0/23157572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe9d010f250 msgr2=0x7fe9d00f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:52.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cffff640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe9d010f250 0x7fe9d00f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:52.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cffff640 1 -- 10.20.193.14:0/23157572 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b4009570 con 0x7fe9d01103e0 2026-02-24T09:08:52.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cffff640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe9d01103e0 0x7fe9d0171700 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9b4005b30 tx=0x7fe9b40028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:52.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cdffb640 1 -- 10.20.193.14:0/23157572 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9b403d070 con 0x7fe9d01103e0 2026-02-24T09:08:52.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cdffb640 1 -- 10.20.193.14:0/23157572 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe9b4038e00 con 0x7fe9d01103e0 2026-02-24T09:08:52.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/23157572 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d00fa2b0 con 0x7fe9d01103e0 2026-02-24T09:08:52.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9cdffb640 1 -- 10.20.193.14:0/23157572 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9b4041c20 con 0x7fe9d01103e0 2026-02-24T09:08:52.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.128+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/23157572 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d00fa720 con 0x7fe9d01103e0 2026-02-24T09:08:52.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.129+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/23157572 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d0175720 con 0x7fe9d01103e0 2026-02-24T09:08:52.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.130+0000 7fe9cdffb640 1 -- 10.20.193.14:0/23157572 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7fe9b402fc10 con 0x7fe9d01103e0 2026-02-24T09:08:52.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.131+0000 7fe9cdffb640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe9a80b56e0 0x7fe9a80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:52.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.131+0000 7fe9cdffb640 1 -- 10.20.193.14:0/23157572 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5936+0+0 (secure 0 0 0) 0x7fe9b410b440 con 0x7fe9d01103e0 2026-02-24T09:08:52.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.131+0000 7fe9d4b52640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe9a80b56e0 0x7fe9a80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:52.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.131+0000 7fe9d4b52640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe9a80b56e0 0x7fe9a80d5b90 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9bc004740 tx=0x7fe9bc005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:52.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.131+0000 7fe9cdffb640 1 -- 10.20.193.14:0/23157572 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe9b40ce710 con 0x7fe9d01103e0 2026-02-24T09:08:52.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:52.241+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/23157572 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fe9d0174e00 con 0x7fe9a80b56e0 2026-02-24T09:08:52.392 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:52 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.392 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:52 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.393 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:52 trial014 ceph-mon[46941]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-24T09:08:52.393 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:52 trial014 ceph-mon[46941]: pgmap v101: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 2/6 objects degraded (33.333%) 2026-02-24T09:08:52.393 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:52 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.393 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:52 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.393 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:52 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:52.393 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:52 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.393 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:52 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:52 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:52 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:52 trial004 ceph-mon[41596]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-24T09:08:52.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:52 trial004 ceph-mon[41596]: pgmap v101: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 2/6 objects degraded (33.333%) 2026-02-24T09:08:52.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:52 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:52 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:52 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:52.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:52 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:52 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.504 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:52 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.504 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:52 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.504 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:52 trial090 ceph-mon[47278]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-24T09:08:52.504 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:52 trial090 ceph-mon[47278]: pgmap v101: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 2/6 objects degraded (33.333%) 2026-02-24T09:08:52.504 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:52 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.504 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:52 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.504 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:52 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:08:52.504 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:52 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:52.505 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:52 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.203 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:08:52 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:08:52.900+0000 7fe565e7f640 -1 osd.9 0 waiting for initial osdmap 2026-02-24T09:08:53.203 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:08:52 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:08:52.906+0000 7fe561d46640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:08:53.256 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.256 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.256 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: osdmap e57: 10 total, 9 up, 10 in 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='client.24464 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_1'] 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial014 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:53.257 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8825787e-e402-47ad-ae91-e3c270aefd15"} : dispatch 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8825787e-e402-47ad-ae91-e3c270aefd15"}]': finished 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='client.? 10.20.193.14:0/1273629782' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8825787e-e402-47ad-ae91-e3c270aefd15"} : dispatch 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: osdmap e58: 11 total, 9 up, 11 in 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.258 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:53.259 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:53 trial014 ceph-mon[46941]: from='client.? 10.20.193.14:0/2893039890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:53.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-24T09:08:53.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: osdmap e57: 10 total, 9 up, 10 in 2026-02-24T09:08:53.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:08:53.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:53.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='client.24464 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:53.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:08:53.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_1'] 2026-02-24T09:08:53.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial014 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8825787e-e402-47ad-ae91-e3c270aefd15"} : dispatch 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8825787e-e402-47ad-ae91-e3c270aefd15"}]': finished 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='client.? 10.20.193.14:0/1273629782' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8825787e-e402-47ad-ae91-e3c270aefd15"} : dispatch 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: osdmap e58: 11 total, 9 up, 11 in 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:53.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:53.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:53.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:53.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:53.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:53.337 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:53 trial090 ceph-mon[47278]: from='client.? 10.20.193.14:0/2893039890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:53.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-24T09:08:53.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: osdmap e57: 10 total, 9 up, 10 in 2026-02-24T09:08:53.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial004", "root=default"]} : dispatch 2026-02-24T09:08:53.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:53.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='client.24464 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial014:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:08:53.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:08:53.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial014:['vg_nvme/lv_1'] 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: Marking host: trial014 for OSDSpec preview refresh. 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial014 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8825787e-e402-47ad-ae91-e3c270aefd15"} : dispatch 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial004", "root=default"]}]': finished 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8825787e-e402-47ad-ae91-e3c270aefd15"}]': finished 2026-02-24T09:08:53.466 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='client.? 10.20.193.14:0/1273629782' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8825787e-e402-47ad-ae91-e3c270aefd15"} : dispatch 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: osdmap e58: 11 total, 9 up, 11 in 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:08:53.467 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.468 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.468 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.468 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:53.468 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:08:53.468 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:53.468 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:08:53.468 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:08:53.468 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:53.468 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:53 trial004 ceph-mon[41596]: from='client.? 10.20.193.14:0/2893039890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:08:54.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:54 trial004 ceph-mon[41596]: Detected new or changed devices on trial004 2026-02-24T09:08:54.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:54 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial004 to 21011M 2026-02-24T09:08:54.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:54 trial004 ceph-mon[41596]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 133 KiB/s, 0 objects/s recovering 2026-02-24T09:08:54.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:54 trial004 ceph-mon[41596]: osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] boot 2026-02-24T09:08:54.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:54 trial004 ceph-mon[41596]: osdmap e59: 11 total, 10 up, 11 in 2026-02-24T09:08:54.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:54 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:54.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:54 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:08:54.477 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:54 trial014 ceph-mon[46941]: Detected new or changed devices on trial004 2026-02-24T09:08:54.477 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:54 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial004 to 21011M 2026-02-24T09:08:54.477 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:54 trial014 ceph-mon[46941]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 133 KiB/s, 0 objects/s recovering 2026-02-24T09:08:54.477 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:54 trial014 ceph-mon[46941]: osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] boot 2026-02-24T09:08:54.477 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:54 trial014 ceph-mon[46941]: osdmap e59: 11 total, 10 up, 11 in 2026-02-24T09:08:54.477 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:54 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:54.477 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:54 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:08:54.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:54 trial090 ceph-mon[47278]: Detected new or changed devices on trial004 2026-02-24T09:08:54.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:54 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial004 to 21011M 2026-02-24T09:08:54.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:54 trial090 ceph-mon[47278]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 133 KiB/s, 0 objects/s recovering 2026-02-24T09:08:54.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:54 trial090 ceph-mon[47278]: osd.9 [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] boot 2026-02-24T09:08:54.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:54 trial090 ceph-mon[47278]: osdmap e59: 11 total, 10 up, 11 in 2026-02-24T09:08:54.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:54 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-24T09:08:54.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:54 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:08:55.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:55 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:08:55.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:55 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:08:55.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:55 trial014 ceph-mon[46941]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-24T09:08:55.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:55 trial014 ceph-mon[46941]: Cluster is now healthy 2026-02-24T09:08:55.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:55 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:08:55.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:55 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:55.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:55 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:08:55.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:55 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:08:55.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:55 trial004 ceph-mon[41596]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-24T09:08:55.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:55 trial004 ceph-mon[41596]: Cluster is now healthy 2026-02-24T09:08:55.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:55 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:08:55.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:55 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:55.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:55 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:08:55.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:55 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:08:55.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:55 trial090 ceph-mon[47278]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-24T09:08:55.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:55 trial090 ceph-mon[47278]: Cluster is now healthy 2026-02-24T09:08:55.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:55 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:08:55.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:55 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:56.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:56 trial004 ceph-mon[41596]: Deploying daemon osd.10 on trial014 2026-02-24T09:08:56.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:56 trial004 ceph-mon[41596]: osdmap e60: 11 total, 10 up, 11 in 2026-02-24T09:08:56.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:08:56.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:08:56.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:56 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:56.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:56 trial004 ceph-mon[41596]: Deploying daemon osd.10 on trial014 2026-02-24T09:08:56.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:56 trial004 ceph-mon[41596]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-24T09:08:56.508 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:56 trial014 ceph-mon[46941]: Deploying daemon osd.10 on trial014 2026-02-24T09:08:56.508 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:56 trial014 ceph-mon[46941]: osdmap e60: 11 total, 10 up, 11 in 2026-02-24T09:08:56.508 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:08:56.508 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:08:56.509 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:56 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:56.509 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:56 trial014 ceph-mon[46941]: Deploying daemon osd.10 on trial014 2026-02-24T09:08:56.509 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:56 trial014 ceph-mon[46941]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-24T09:08:56.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:56 trial090 ceph-mon[47278]: Deploying daemon osd.10 on trial014 2026-02-24T09:08:56.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:56 trial090 ceph-mon[47278]: osdmap e60: 11 total, 10 up, 11 in 2026-02-24T09:08:56.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:08:56.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-24T09:08:56.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:56 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:08:56.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:56 trial090 ceph-mon[47278]: Deploying daemon osd.10 on trial014 2026-02-24T09:08:56.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:56 trial090 ceph-mon[47278]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-24T09:08:58.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:58.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:57 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:58.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:58.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:57 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:58.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:58.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:57 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:58.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.945+0000 7fe9cdffb640 1 -- 10.20.193.14:0/23157572 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe9d0174e00 con 0x7fe9a80b56e0 2026-02-24T09:08:58.946 INFO:teuthology.orchestra.run.trial014.stdout:Created osd(s) 10 on host 'trial014' 2026-02-24T09:08:58.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/23157572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe9a80b56e0 msgr2=0x7fe9a80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:58.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe9a80b56e0 0x7fe9a80d5b90 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9bc004740 tx=0x7fe9bc005d20 comp rx=0 tx=0).stop 2026-02-24T09:08:58.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/23157572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe9d01103e0 msgr2=0x7fe9d0171700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:58.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe9d01103e0 0x7fe9d0171700 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9b4005b30 tx=0x7fe9b40028d0 comp rx=0 tx=0).stop 2026-02-24T09:08:58.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/23157572 shutdown_connections 2026-02-24T09:08:58.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe9a80b56e0 0x7fe9a80d5b90 unknown :-1 s=CLOSED pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:58.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9d0110d90 0x7fe9d00f9130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:58.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe9d01103e0 0x7fe9d0171700 unknown :-1 s=CLOSED pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:58.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 --2- 10.20.193.14:0/23157572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe9d010f250 0x7fe9d00f88f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:58.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/23157572 >> 10.20.193.14:0/23157572 conn(0x7fe9d00ec980 msgr2=0x7fe9d00eefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:58.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/23157572 shutdown_connections 2026-02-24T09:08:58.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T09:08:58.947+0000 7fe9d6ddd640 1 -- 10.20.193.14:0/23157572 wait complete. 2026-02-24T09:08:58.985 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:58 trial014 ceph-mon[46941]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail; 106 KiB/s, 0 objects/s recovering 2026-02-24T09:08:58.985 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:58 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:58.985 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:58 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:58.987 DEBUG:teuthology.orchestra.run.trial014:osd.10> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.10.service 2026-02-24T09:08:58.990 INFO:tasks.cephadm:Deploying osd.11 on trial090 with /dev/vg_nvme/lv_1... 2026-02-24T09:08:58.990 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-24T09:08:59.017 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:58 trial090 ceph-mon[47278]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail; 106 KiB/s, 0 objects/s recovering 2026-02-24T09:08:59.017 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:58 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:59.017 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:58 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:59.111 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:08:59.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:58 trial004 ceph-mon[41596]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail; 106 KiB/s, 0 objects/s recovering 2026-02-24T09:08:59.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:58 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:59.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:58 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:08:59.590 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-24T09:08:59.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:08:59 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:08:59.332+0000 7f3897858780 -1 osd.10 0 log_to_monitors true 2026-02-24T09:08:59.606 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_1 --skip-validation 2026-02-24T09:08:59.766 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:08:59.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 -- 10.20.193.90:0/1236833718 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f849c1103e0 msgr2=0x7f849c110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:59.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 --2- 10.20.193.90:0/1236833718 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f849c1103e0 0x7f849c110850 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=8765979583273198378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8488009950 tx=0x7f848802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:08:59.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 -- 10.20.193.90:0/1236833718 shutdown_connections 2026-02-24T09:08:59.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 --2- 10.20.193.90:0/1236833718 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f849c110d90 0x7f849c171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:59.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 --2- 10.20.193.90:0/1236833718 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f849c1103e0 0x7f849c110850 unknown :-1 s=CLOSED pgs=50 gs=1 cs=0 l=1 c_cookie=8765979583273198378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:59.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 --2- 10.20.193.90:0/1236833718 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f849c10f250 0x7f849c10f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:59.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 -- 10.20.193.90:0/1236833718 >> 10.20.193.90:0/1236833718 conn(0x7f849c0ec980 msgr2=0x7f849c10cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:08:59.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 -- 10.20.193.90:0/1236833718 shutdown_connections 2026-02-24T09:08:59.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 -- 10.20.193.90:0/1236833718 wait complete. 2026-02-24T09:08:59.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 Processor -- start 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 -- start start 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f849c10f250 0x7f849c0f8990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f849c1103e0 0x7f849c171700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f849c110d90 0x7f849c0f91d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f849c0f9e30 con 0x7f849c110d90 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f849c0f9fa0 con 0x7f849c10f250 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a4901640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f849c0fa160 con 0x7f849c1103e0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a1e75640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f849c1103e0 0x7f849c171700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a1e75640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f849c1103e0 0x7f849c171700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50156/0 (socket says 10.20.193.90:50156) 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a1e75640 1 -- 10.20.193.90:0/1410877518 learned_addr learned my addr 10.20.193.90:0/1410877518 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.866+0000 7f84a2676640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f849c10f250 0x7f849c0f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84a1e75640 1 -- 10.20.193.90:0/1410877518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f849c10f250 msgr2=0x7f849c0f8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84a1e75640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f849c10f250 0x7f849c0f8990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84a1e75640 1 -- 10.20.193.90:0/1410877518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f849c110d90 msgr2=0x7f849c0f91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84a1e75640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f849c110d90 0x7f849c0f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84a1e75640 1 -- 10.20.193.90:0/1410877518 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8488009570 con 0x7f849c1103e0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84a1e75640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f849c1103e0 0x7f849c171700 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8488002d80 tx=0x7f84880028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84877fe640 1 -- 10.20.193.90:0/1410877518 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f848803d070 con 0x7f849c1103e0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84877fe640 1 -- 10.20.193.90:0/1410877518 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f84880043d0 con 0x7f849c1103e0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84877fe640 1 -- 10.20.193.90:0/1410877518 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8488041aa0 con 0x7f849c1103e0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84a4901640 1 -- 10.20.193.90:0/1410877518 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849c0fa3e0 con 0x7f849c1103e0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84a4901640 1 -- 10.20.193.90:0/1410877518 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849c0fa800 con 0x7f849c1103e0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.867+0000 7f84a4901640 1 -- 10.20.193.90:0/1410877518 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849c0faa20 con 0x7f849c1103e0 2026-02-24T09:08:59.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.868+0000 7f84877fe640 1 -- 10.20.193.90:0/1410877518 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f8488038920 con 0x7f849c1103e0 2026-02-24T09:08:59.871 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.869+0000 7f84877fe640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84780b5760 0x7f84780d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:08:59.871 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.869+0000 7f84877fe640 1 -- 10.20.193.90:0/1410877518 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6368+0+0 (secure 0 0 0) 0x7f848810b520 con 0x7f849c1103e0 2026-02-24T09:08:59.871 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.869+0000 7f84a2676640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84780b5760 0x7f84780d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:08:59.872 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.870+0000 7f84a2676640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84780b5760 0x7f84780d5c10 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8494004740 tx=0x7f8494004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:08:59.872 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.870+0000 7f84877fe640 1 -- 10.20.193.90:0/1410877518 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f84880ce640 con 0x7f849c1103e0 2026-02-24T09:08:59.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:08:59.980+0000 7f84a4901640 1 -- 10.20.193.90:0/1410877518 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f849c174e70 con 0x7f84780b5760 2026-02-24T09:09:00.137 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:59 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.137 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:59 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.137 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:59 trial090 ceph-mon[47278]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:09:00.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:59 trial090 ceph-mon[47278]: from='osd.10 [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:09:00.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:59 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:59 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:59 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:00.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:59 trial090 ceph-mon[47278]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail; 85 KiB/s, 0 objects/s recovering 2026-02-24T09:09:00.138 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:08:59 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.211 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:59 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.211 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:59 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.211 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:59 trial014 ceph-mon[46941]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:09:00.211 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:59 trial014 ceph-mon[46941]: from='osd.10 [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:09:00.211 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:59 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.211 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:59 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.211 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:59 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:00.211 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:59 trial014 ceph-mon[46941]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail; 85 KiB/s, 0 objects/s recovering 2026-02-24T09:09:00.211 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:08:59 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:59 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:59 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:59 trial004 ceph-mon[41596]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:09:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:59 trial004 ceph-mon[41596]: from='osd.10 [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-24T09:09:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:59 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:59 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:59 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:59 trial004 ceph-mon[41596]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail; 85 KiB/s, 0 objects/s recovering 2026-02-24T09:09:00.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:08:59 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:00.947 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:09:00 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:09:00.658+0000 7f38937da640 -1 osd.10 0 waiting for initial osdmap 2026-02-24T09:09:00.947 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:09:00 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:09:00.664+0000 7f388f6a1640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:09:01.004 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.004 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-24T09:09:01.004 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.004 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: osdmap e61: 11 total, 10 up, 11 in 2026-02-24T09:09:01.004 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:01.004 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:09:01.004 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.004 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='osd.10 [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:09:01.005 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:01.005 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: osd.default does not exist. Creating it now. 2026-02-24T09:09:01.005 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_1'] 2026-02-24T09:09:01.005 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.005 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:09:01.005 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: Saving service osd.default spec with placement trial090 2026-02-24T09:09:01.005 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.005 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8"} : dispatch 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='client.? 10.20.193.90:0/1438601061' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8"} : dispatch 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8"}]': finished 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: osdmap e62: 12 total, 10 up, 12 in 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:01.006 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: Detected new or changed devices on trial014 2026-02-24T09:09:01.007 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.007 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.007 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.007 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.007 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.007 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.007 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.007 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.007 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial014 to 21011M 2026-02-24T09:09:01.007 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.008 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.008 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.008 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:01.008 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:01.008 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.008 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:01.008 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:09:01.008 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:00 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:01.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-24T09:09:01.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: osdmap e61: 11 total, 10 up, 11 in 2026-02-24T09:09:01.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:01.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:09:01.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='osd.10 [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:09:01.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:01.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: osd.default does not exist. Creating it now. 2026-02-24T09:09:01.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_1'] 2026-02-24T09:09:01.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:09:01.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: Saving service osd.default spec with placement trial090 2026-02-24T09:09:01.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:01.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:09:01.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:01.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8"} : dispatch 2026-02-24T09:09:01.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/1438601061' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8"} : dispatch 2026-02-24T09:09:01.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:09:01.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8"}]': finished 2026-02-24T09:09:01.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: osdmap e62: 12 total, 10 up, 12 in 2026-02-24T09:09:01.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:01.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:01.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:01.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: Detected new or changed devices on trial014 2026-02-24T09:09:01.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.219 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.219 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.219 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.219 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.219 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.219 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial014 to 21011M 2026-02-24T09:09:01.219 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.219 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.219 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.220 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:01.220 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:01.220 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.220 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:01.220 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:09:01.220 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:00 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:01.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-24T09:09:01.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: osdmap e61: 11 total, 10 up, 11 in 2026-02-24T09:09:01.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:01.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:09:01.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='osd.10 [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial014", "root=default"]} : dispatch 2026-02-24T09:09:01.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:01.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: osd.default does not exist. Creating it now. 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: Creating OSDs with service ID: default on trial090:['vg_nvme/lv_1'] 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: Marking host: trial090 for OSDSpec preview refresh. 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: Saving service osd.default spec with placement trial090 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8"} : dispatch 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='client.? 10.20.193.90:0/1438601061' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8"} : dispatch 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial014", "root=default"]}]': finished 2026-02-24T09:09:01.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8"}]': finished 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: osdmap e62: 12 total, 10 up, 12 in 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: Detected new or changed devices on trial014 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:01.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial014 to 21011M 2026-02-24T09:09:01.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:01.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:01.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:01.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:01.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:09:01.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:00 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:02.201 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:01 trial090 ceph-mon[47278]: from='client.? 10.20.193.90:0/3629803356' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:09:02.201 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:01 trial090 ceph-mon[47278]: osd.10 [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] boot 2026-02-24T09:09:02.201 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:01 trial090 ceph-mon[47278]: osdmap e63: 12 total, 11 up, 12 in 2026-02-24T09:09:02.201 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:02.201 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:02.202 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:01 trial090 ceph-mon[47278]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:09:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:01 trial004 ceph-mon[41596]: from='client.? 10.20.193.90:0/3629803356' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:09:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:01 trial004 ceph-mon[41596]: osd.10 [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] boot 2026-02-24T09:09:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:01 trial004 ceph-mon[41596]: osdmap e63: 12 total, 11 up, 12 in 2026-02-24T09:09:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:02.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:01 trial004 ceph-mon[41596]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:09:02.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:01 trial014 ceph-mon[46941]: from='client.? 10.20.193.90:0/3629803356' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T09:09:02.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:01 trial014 ceph-mon[46941]: osd.10 [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] boot 2026-02-24T09:09:02.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:01 trial014 ceph-mon[46941]: osdmap e63: 12 total, 11 up, 12 in 2026-02-24T09:09:02.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-24T09:09:02.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:02.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:01 trial014 ceph-mon[46941]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-24T09:09:02.984 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:02 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:09:02.985 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:02 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:09:02.985 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:02 trial090 ceph-mon[47278]: osdmap e64: 12 total, 11 up, 12 in 2026-02-24T09:09:02.985 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:02.985 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:09:02.985 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:02 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:09:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:02 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:09:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:02 trial004 ceph-mon[41596]: osdmap e64: 12 total, 11 up, 12 in 2026-02-24T09:09:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:09:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:02 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:09:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:02 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:09:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:02 trial014 ceph-mon[46941]: osdmap e64: 12 total, 11 up, 12 in 2026-02-24T09:09:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:09:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:03 trial004 ceph-mon[41596]: Deploying daemon osd.11 on trial090 2026-02-24T09:09:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:03 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:09:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:03 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:03 trial004 ceph-mon[41596]: Deploying daemon osd.11 on trial090 2026-02-24T09:09:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:03 trial004 ceph-mon[41596]: osdmap e65: 12 total, 11 up, 12 in 2026-02-24T09:09:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:03 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:03 trial004 ceph-mon[41596]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:09:04.302 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:03 trial090 ceph-mon[47278]: Deploying daemon osd.11 on trial090 2026-02-24T09:09:04.302 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:03 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:09:04.302 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:03 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:04.302 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:03 trial090 ceph-mon[47278]: Deploying daemon osd.11 on trial090 2026-02-24T09:09:04.302 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:03 trial090 ceph-mon[47278]: osdmap e65: 12 total, 11 up, 12 in 2026-02-24T09:09:04.302 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:03 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:04.302 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:03 trial090 ceph-mon[47278]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:09:04.342 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:03 trial014 ceph-mon[46941]: Deploying daemon osd.11 on trial090 2026-02-24T09:09:04.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:03 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-24T09:09:04.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:03 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:04.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:03 trial014 ceph-mon[46941]: Deploying daemon osd.11 on trial090 2026-02-24T09:09:04.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:03 trial014 ceph-mon[46941]: osdmap e65: 12 total, 11 up, 12 in 2026-02-24T09:09:04.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:03 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:04.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:03 trial014 ceph-mon[46941]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:09:05.665 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:05 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:05.666 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:05 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:05.666 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:05 trial090 ceph-mon[47278]: osdmap e66: 12 total, 11 up, 12 in 2026-02-24T09:09:05.666 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:05 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:05.842 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:05 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:05.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:05 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:05.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:05 trial014 ceph-mon[46941]: osdmap e66: 12 total, 11 up, 12 in 2026-02-24T09:09:05.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:05 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:05.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:05 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:05.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:05 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:05.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:05 trial004 ceph-mon[41596]: osdmap e66: 12 total, 11 up, 12 in 2026-02-24T09:09:05.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:05 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:06.783 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 11 on host 'trial090' 2026-02-24T09:09:06.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.779+0000 7f84877fe640 1 -- 10.20.193.90:0/1410877518 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f849c174e70 con 0x7f84780b5760 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 -- 10.20.193.90:0/1410877518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84780b5760 msgr2=0x7f84780d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84780b5760 0x7f84780d5c10 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8494004740 tx=0x7f8494004420 comp rx=0 tx=0).stop 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 -- 10.20.193.90:0/1410877518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f849c1103e0 msgr2=0x7f849c171700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f849c1103e0 0x7f849c171700 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8488002d80 tx=0x7f84880028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 -- 10.20.193.90:0/1410877518 shutdown_connections 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84780b5760 0x7f84780d5c10 unknown :-1 s=CLOSED pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f849c110d90 0x7f849c0f91d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f849c1103e0 0x7f849c171700 unknown :-1 s=CLOSED pgs=51 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 --2- 10.20.193.90:0/1410877518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f849c10f250 0x7f849c0f8990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 -- 10.20.193.90:0/1410877518 >> 10.20.193.90:0/1410877518 conn(0x7f849c0ec980 msgr2=0x7f849c0eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 -- 10.20.193.90:0/1410877518 shutdown_connections 2026-02-24T09:09:06.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:06.782+0000 7f84a4901640 1 -- 10.20.193.90:0/1410877518 wait complete. 2026-02-24T09:09:06.824 DEBUG:teuthology.orchestra.run.trial090:osd.11> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.11.service 2026-02-24T09:09:06.826 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-24T09:09:06.827 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T09:09:06.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:06 trial014 ceph-mon[46941]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:09:06.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:06 trial014 ceph-mon[46941]: osdmap e67: 12 total, 11 up, 12 in 2026-02-24T09:09:06.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:06.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:06.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:06 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:06.848 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:06 trial090 ceph-mon[47278]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:09:06.848 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:06 trial090 ceph-mon[47278]: osdmap e67: 12 total, 11 up, 12 in 2026-02-24T09:09:06.848 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:06.848 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:06.849 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:06 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:06.852 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:06 trial004 ceph-mon[41596]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:09:06.852 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:06 trial004 ceph-mon[41596]: osdmap e67: 12 total, 11 up, 12 in 2026-02-24T09:09:06.852 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:06.853 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:06.853 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:06 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:06.947 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 -- 10.20.193.4:0/2743716629 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4dec110330 msgr2=0x7f4dec1107a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 --2- 10.20.193.4:0/2743716629 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4dec110330 0x7f4dec1107a0 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=16486091325648923922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dd4009950 tx=0x7f4dd402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 -- 10.20.193.4:0/2743716629 shutdown_connections 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 --2- 10.20.193.4:0/2743716629 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec110ce0 0x7f4dec171670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 --2- 10.20.193.4:0/2743716629 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4dec110330 0x7f4dec1107a0 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=16486091325648923922 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 --2- 10.20.193.4:0/2743716629 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4dec10f1a0 0x7f4dec10f590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 -- 10.20.193.4:0/2743716629 >> 10.20.193.4:0/2743716629 conn(0x7f4dec0ec8d0 msgr2=0x7f4dec10cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 -- 10.20.193.4:0/2743716629 shutdown_connections 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 -- 10.20.193.4:0/2743716629 wait complete. 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 Processor -- start 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 -- start start 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec10f1a0 0x7f4dec0f8810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4dec110330 0x7f4dec171670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:07.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4dec110ce0 0x7f4dec0f9070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0f9c60 con 0x7f4dec110330 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0f9dd0 con 0x7f4dec110ce0 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4df193c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0f9f90 con 0x7f4dec10f1a0 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4de3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4dec110330 0x7f4dec171670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4de3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4dec110330 0x7f4dec171670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49598/0 (socket says 10.20.193.4:49598) 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.053+0000 7f4de3fff640 1 -- 10.20.193.4:0/2481969058 learned_addr learned my addr 10.20.193.4:0/2481969058 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4df093a640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec10f1a0 0x7f4dec0f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4de3fff640 1 -- 10.20.193.4:0/2481969058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec10f1a0 msgr2=0x7f4dec0f8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4de3fff640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec10f1a0 0x7f4dec0f8810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4de3fff640 1 -- 10.20.193.4:0/2481969058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4dec110ce0 msgr2=0x7f4dec0f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4de3fff640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4dec110ce0 0x7f4dec0f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4de3fff640 1 -- 10.20.193.4:0/2481969058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd4009570 con 0x7f4dec110330 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4df093a640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec10f1a0 0x7f4dec0f8810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4de3fff640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4dec110330 0x7f4dec171670 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dd4002d80 tx=0x7f4dd40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4de1ffb640 1 -- 10.20.193.4:0/2481969058 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dd403d070 con 0x7f4dec110330 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4df193c640 1 -- 10.20.193.4:0/2481969058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec0fa210 con 0x7f4dec110330 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4de1ffb640 1 -- 10.20.193.4:0/2481969058 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4dd40043d0 con 0x7f4dec110330 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4de1ffb640 1 -- 10.20.193.4:0/2481969058 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dd4041bb0 con 0x7f4dec110330 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4df193c640 1 -- 10.20.193.4:0/2481969058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec0fa6d0 con 0x7f4dec110330 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.054+0000 7f4df193c640 1 -- 10.20.193.4:0/2481969058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dec0fa8f0 con 0x7f4dec110330 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.055+0000 7f4de1ffb640 1 -- 10.20.193.4:0/2481969058 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f4dd4038920 con 0x7f4dec110330 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.056+0000 7f4de1ffb640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dc80b56e0 0x7f4dc80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.056+0000 7f4df093a640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dc80b56e0 0x7f4dc80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:07.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.056+0000 7f4de1ffb640 1 -- 10.20.193.4:0/2481969058 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6801+0+0 (secure 0 0 0) 0x7f4dd410b5f0 con 0x7f4dec110330 2026-02-24T09:09:07.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.056+0000 7f4df093a640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dc80b56e0 0x7f4dc80d5b90 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ddc004740 tx=0x7f4ddc005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:07.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.057+0000 7f4de1ffb640 1 -- 10.20.193.4:0/2481969058 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f4dd40ce530 con 0x7f4dec110330 2026-02-24T09:09:07.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.161+0000 7f4df193c640 1 -- 10.20.193.4:0/2481969058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4dec0fa8f0 con 0x7f4dec110330 2026-02-24T09:09:07.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.162+0000 7f4de1ffb640 1 -- 10.20.193.4:0/2481969058 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f4dec0fa8f0 con 0x7f4dec110330 2026-02-24T09:09:07.166 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:07.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 -- 10.20.193.4:0/2481969058 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dc80b56e0 msgr2=0x7f4dc80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:07.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dc80b56e0 0x7f4dc80d5b90 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ddc004740 tx=0x7f4ddc005f00 comp rx=0 tx=0).stop 2026-02-24T09:09:07.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 -- 10.20.193.4:0/2481969058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4dec110330 msgr2=0x7f4dec171670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:07.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4dec110330 0x7f4dec171670 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dd4002d80 tx=0x7f4dd40028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 -- 10.20.193.4:0/2481969058 shutdown_connections 2026-02-24T09:09:07.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dc80b56e0 0x7f4dc80d5b90 unknown :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4dec110ce0 0x7f4dec0f9070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4dec110330 0x7f4dec171670 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 --2- 10.20.193.4:0/2481969058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec10f1a0 0x7f4dec0f8810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:07.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 -- 10.20.193.4:0/2481969058 >> 10.20.193.4:0/2481969058 conn(0x7f4dec0ec8d0 msgr2=0x7f4dec0eee10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:07.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 -- 10.20.193.4:0/2481969058 shutdown_connections 2026-02-24T09:09:07.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:07.163+0000 7f4df193c640 1 -- 10.20.193.4:0/2481969058 wait complete. 2026-02-24T09:09:07.223 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1771924141,"num_in_osds":12,"osd_in_since":1771924140,"num_remapped_pgs":0} 2026-02-24T09:09:07.551 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:09:07 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:09:07.245+0000 7f4bbd5c5780 -1 osd.11 0 log_to_monitors true 2026-02-24T09:09:07.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:07 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:07.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:07 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:07.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:07 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2481969058' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:09:07.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:07 trial090 ceph-mon[47278]: from='osd.11 [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:09:07.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:07 trial090 ceph-mon[47278]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:09:07.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:07 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:07.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:07 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:07.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:07 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:07.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:07 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:07.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:07 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:07.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:07 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2481969058' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:09:07.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:07 trial014 ceph-mon[46941]: from='osd.11 [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:09:07.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:07 trial014 ceph-mon[46941]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:09:07.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:07 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:07.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:07 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:07.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:07 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:08.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:07 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2481969058' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:09:08.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:07 trial004 ceph-mon[41596]: from='osd.11 [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:09:08.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:07 trial004 ceph-mon[41596]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-24T09:09:08.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:07 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:08.224 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T09:09:08.343 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:08.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 -- 10.20.193.4:0/1380585930 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59b01103e0 msgr2=0x7f59b0110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:08.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 --2- 10.20.193.4:0/1380585930 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59b01103e0 0x7f59b0110850 secure :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=9093154623113486904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59a0009950 tx=0x7f59a002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:08.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 -- 10.20.193.4:0/1380585930 shutdown_connections 2026-02-24T09:09:08.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 --2- 10.20.193.4:0/1380585930 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59b0110d90 0x7f59b0171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:08.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 --2- 10.20.193.4:0/1380585930 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59b01103e0 0x7f59b0110850 unknown :-1 s=CLOSED pgs=199 gs=1 cs=0 l=1 c_cookie=9093154623113486904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:08.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 --2- 10.20.193.4:0/1380585930 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59b010f250 0x7f59b010f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:08.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 -- 10.20.193.4:0/1380585930 >> 10.20.193.4:0/1380585930 conn(0x7f59b00ec980 msgr2=0x7f59b010cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:08.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 -- 10.20.193.4:0/1380585930 shutdown_connections 2026-02-24T09:09:08.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 -- 10.20.193.4:0/1380585930 wait complete. 2026-02-24T09:09:08.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 Processor -- start 2026-02-24T09:09:08.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.437+0000 7f59b64c1640 1 -- start start 2026-02-24T09:09:08.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59b64c1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59b010f250 0x7f59b00f8950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:08.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59b64c1640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59b01103e0 0x7f59b0171700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:08.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59b64c1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59b0110d90 0x7f59b00f9190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59b64c1640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f59b00f9df0 con 0x7f59b010f250 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59b64c1640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f59b00f9f60 con 0x7f59b01103e0 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59b64c1640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59b00fa120 con 0x7f59b0110d90 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59affff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59b010f250 0x7f59b00f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59affff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59b010f250 0x7f59b00f8950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49610/0 (socket says 10.20.193.4:49610) 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59affff640 1 -- 10.20.193.4:0/1931718179 learned_addr learned my addr 10.20.193.4:0/1931718179 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59af7fe640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59b01103e0 0x7f59b0171700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59b4a37640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59b0110d90 0x7f59b00f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59affff640 1 -- 10.20.193.4:0/1931718179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59b0110d90 msgr2=0x7f59b00f9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59affff640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59b0110d90 0x7f59b00f9190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:08.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59affff640 1 -- 10.20.193.4:0/1931718179 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59b01103e0 msgr2=0x7f59b0171700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:08.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59affff640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59b01103e0 0x7f59b0171700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:08.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59affff640 1 -- 10.20.193.4:0/1931718179 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a0009570 con 0x7f59b010f250 2026-02-24T09:09:08.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59affff640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59b010f250 0x7f59b00f8950 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f599c00d950 tx=0x7f599c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:08.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59ad7fa640 1 -- 10.20.193.4:0/1931718179 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f599c004540 con 0x7f59b010f250 2026-02-24T09:09:08.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59ad7fa640 1 -- 10.20.193.4:0/1931718179 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f599c009d00 con 0x7f59b010f250 2026-02-24T09:09:08.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59b64c1640 1 -- 10.20.193.4:0/1931718179 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b00fa400 con 0x7f59b010f250 2026-02-24T09:09:08.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59ad7fa640 1 -- 10.20.193.4:0/1931718179 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f599c0106e0 con 0x7f59b010f250 2026-02-24T09:09:08.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59b64c1640 1 -- 10.20.193.4:0/1931718179 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b00fa8d0 con 0x7f59b010f250 2026-02-24T09:09:08.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.438+0000 7f59b64c1640 1 -- 10.20.193.4:0/1931718179 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b0175720 con 0x7f59b010f250 2026-02-24T09:09:08.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.440+0000 7f59ad7fa640 1 -- 10.20.193.4:0/1931718179 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f599c0097c0 con 0x7f59b010f250 2026-02-24T09:09:08.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.440+0000 7f59ad7fa640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59840b56e0 0x7f59840d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:08.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.441+0000 7f59ad7fa640 1 -- 10.20.193.4:0/1931718179 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6823+0+0 (secure 0 0 0) 0x7f599c0e6ce0 con 0x7f59b010f250 2026-02-24T09:09:08.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.441+0000 7f59af7fe640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59840b56e0 0x7f59840d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:08.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.441+0000 7f59ad7fa640 1 -- 10.20.193.4:0/1931718179 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f599c0a9c10 con 0x7f59b010f250 2026-02-24T09:09:08.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.441+0000 7f59af7fe640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59840b56e0 0x7f59840d5b90 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59a00023d0 tx=0x7f59a0031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:08.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.546+0000 7f59b64c1640 1 -- 10.20.193.4:0/1931718179 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f59b005f470 con 0x7f59b010f250 2026-02-24T09:09:08.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.546+0000 7f59ad7fa640 1 -- 10.20.193.4:0/1931718179 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f599c0acdc0 con 0x7f59b010f250 2026-02-24T09:09:08.550 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:08.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.547+0000 7f59b64c1640 1 -- 10.20.193.4:0/1931718179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59840b56e0 msgr2=0x7f59840d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.547+0000 7f59b64c1640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59840b56e0 0x7f59840d5b90 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59a00023d0 tx=0x7f59a0031040 comp rx=0 tx=0).stop 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.547+0000 7f59b64c1640 1 -- 10.20.193.4:0/1931718179 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59b010f250 msgr2=0x7f59b00f8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.547+0000 7f59b64c1640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59b010f250 0x7f59b00f8950 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f599c00d950 tx=0x7f599c00de20 comp rx=0 tx=0).stop 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.547+0000 7f59b64c1640 1 -- 10.20.193.4:0/1931718179 shutdown_connections 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.547+0000 7f59b64c1640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f59840b56e0 0x7f59840d5b90 unknown :-1 s=CLOSED pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.547+0000 7f59b64c1640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59b0110d90 0x7f59b00f9190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.547+0000 7f59b64c1640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f59b01103e0 0x7f59b0171700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.547+0000 7f59b64c1640 1 --2- 10.20.193.4:0/1931718179 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f59b010f250 0x7f59b00f8950 unknown :-1 s=CLOSED pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.547+0000 7f59b64c1640 1 -- 10.20.193.4:0/1931718179 >> 10.20.193.4:0/1931718179 conn(0x7f59b00ec980 msgr2=0x7f59b00eef70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.548+0000 7f59b64c1640 1 -- 10.20.193.4:0/1931718179 shutdown_connections 2026-02-24T09:09:08.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:08.548+0000 7f59b64c1640 1 -- 10.20.193.4:0/1931718179 wait complete. 2026-02-24T09:09:08.587 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1771924141,"num_in_osds":12,"osd_in_since":1771924140,"num_remapped_pgs":0} 2026-02-24T09:09:08.831 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:09:08 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:09:08.786+0000 7f4bb9547640 -1 osd.11 0 waiting for initial osdmap 2026-02-24T09:09:08.831 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:09:08 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:09:08.794+0000 7f4bb540e640 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T09:09:08.831 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: pgmap v120: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:09:08.831 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-24T09:09:08.831 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: osdmap e68: 12 total, 11 up, 12 in 2026-02-24T09:09:08.831 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:08.831 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:09:08.831 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='osd.11 [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:09:08.831 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.831 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1931718179' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:09:08.832 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:08 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: pgmap v120: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: osdmap e68: 12 total, 11 up, 12 in 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='osd.11 [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1931718179' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.843 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:08.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:08.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:08.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:09:08.844 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:08 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:08.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: pgmap v120: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-24T09:09:08.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-24T09:09:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: osdmap e68: 12 total, 11 up, 12 in 2026-02-24T09:09:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:09:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='osd.11 [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-24T09:09:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1931718179' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:09:08.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:08.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:08.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:08.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T09:09:08.967 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:08 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:09.589 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T09:09:09.706 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 -- 10.20.193.4:0/2741341639 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4101103e0 msgr2=0x7fd410110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 --2- 10.20.193.4:0/2741341639 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4101103e0 0x7fd410110850 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=4770404650157756235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3f8009950 tx=0x7fd3f802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 -- 10.20.193.4:0/2741341639 shutdown_connections 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 --2- 10.20.193.4:0/2741341639 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd410110d90 0x7fd410171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 --2- 10.20.193.4:0/2741341639 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4101103e0 0x7fd410110850 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=4770404650157756235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 --2- 10.20.193.4:0/2741341639 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd41010f250 0x7fd41010f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 -- 10.20.193.4:0/2741341639 >> 10.20.193.4:0/2741341639 conn(0x7fd4100ec980 msgr2=0x7fd41010cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 -- 10.20.193.4:0/2741341639 shutdown_connections 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 -- 10.20.193.4:0/2741341639 wait complete. 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 Processor -- start 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 -- start start 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd41010f250 0x7fd4100f8b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4101103e0 0x7fd410171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd410110d90 0x7fd4100f93f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd4100f9fe0 con 0x7fd4101103e0 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd4100fa150 con 0x7fd410110d90 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.806+0000 7fd414fe2640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4100fa310 con 0x7fd41010f250 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd40dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4101103e0 0x7fd410171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd40dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4101103e0 0x7fd410171720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49634/0 (socket says 10.20.193.4:49634) 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd40dd74640 1 -- 10.20.193.4:0/153753222 learned_addr learned my addr 10.20.193.4:0/153753222 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd40e575640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd41010f250 0x7fd4100f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd40dd74640 1 -- 10.20.193.4:0/153753222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd41010f250 msgr2=0x7fd4100f8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd40dd74640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd41010f250 0x7fd4100f8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd40dd74640 1 -- 10.20.193.4:0/153753222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd410110d90 msgr2=0x7fd4100f93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd40dd74640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd410110d90 0x7fd4100f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd40dd74640 1 -- 10.20.193.4:0/153753222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f8009570 con 0x7fd4101103e0 2026-02-24T09:09:09.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd40dd74640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4101103e0 0x7fd410171720 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3f8004820 tx=0x7fd3f80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:09.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd3f77fe640 1 -- 10.20.193.4:0/153753222 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3f803d070 con 0x7fd4101103e0 2026-02-24T09:09:09.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd3f77fe640 1 -- 10.20.193.4:0/153753222 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd3f8038e00 con 0x7fd4101103e0 2026-02-24T09:09:09.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd414fe2640 1 -- 10.20.193.4:0/153753222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4100fa590 con 0x7fd4101103e0 2026-02-24T09:09:09.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd3f77fe640 1 -- 10.20.193.4:0/153753222 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3f8041b80 con 0x7fd4101103e0 2026-02-24T09:09:09.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd414fe2640 1 -- 10.20.193.4:0/153753222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4100faa50 con 0x7fd4101103e0 2026-02-24T09:09:09.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.807+0000 7fd414fe2640 1 -- 10.20.193.4:0/153753222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4100fac70 con 0x7fd4101103e0 2026-02-24T09:09:09.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.808+0000 7fd3f77fe640 1 -- 10.20.193.4:0/153753222 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7fd3f8038920 con 0x7fd4101103e0 2026-02-24T09:09:09.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.809+0000 7fd3f77fe640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd3e80b5760 0x7fd3e80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:09.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.809+0000 7fd40e575640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd3e80b5760 0x7fd3e80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:09.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.809+0000 7fd3f77fe640 1 -- 10.20.193.4:0/153753222 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7fd3f810b330 con 0x7fd4101103e0 2026-02-24T09:09:09.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.809+0000 7fd40e575640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd3e80b5760 0x7fd3e80d5c10 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd404004740 tx=0x7fd404008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:09.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.810+0000 7fd3f77fe640 1 -- 10.20.193.4:0/153753222 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fd3f80ce180 con 0x7fd4101103e0 2026-02-24T09:09:09.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.918+0000 7fd414fe2640 1 -- 10.20.193.4:0/153753222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd4100fac70 con 0x7fd4101103e0 2026-02-24T09:09:09.922 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:09 trial004 ceph-mon[41596]: Detected new or changed devices on trial090 2026-02-24T09:09:09.922 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:09 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial090 to 21011M 2026-02-24T09:09:09.922 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:09 trial004 ceph-mon[41596]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:09:09.922 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:09 trial004 ceph-mon[41596]: osdmap e69: 12 total, 11 up, 12 in 2026-02-24T09:09:09.922 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:09 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:09.922 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:09 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:09.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.918+0000 7fd3f77fe640 1 -- 10.20.193.4:0/153753222 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7fd4100fac70 con 0x7fd4101103e0 2026-02-24T09:09:09.922 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 -- 10.20.193.4:0/153753222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd3e80b5760 msgr2=0x7fd3e80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd3e80b5760 0x7fd3e80d5c10 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd404004740 tx=0x7fd404008040 comp rx=0 tx=0).stop 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 -- 10.20.193.4:0/153753222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4101103e0 msgr2=0x7fd410171720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4101103e0 0x7fd410171720 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3f8004820 tx=0x7fd3f80028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 -- 10.20.193.4:0/153753222 shutdown_connections 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd3e80b5760 0x7fd3e80d5c10 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd410110d90 0x7fd4100f93f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4101103e0 0x7fd410171720 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 --2- 10.20.193.4:0/153753222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd41010f250 0x7fd4100f8b90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 -- 10.20.193.4:0/153753222 >> 10.20.193.4:0/153753222 conn(0x7fd4100ec980 msgr2=0x7fd4100ef180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 -- 10.20.193.4:0/153753222 shutdown_connections 2026-02-24T09:09:09.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:09.920+0000 7fd414fe2640 1 -- 10.20.193.4:0/153753222 wait complete. 2026-02-24T09:09:09.961 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1771924149,"num_in_osds":12,"osd_in_since":1771924140,"num_remapped_pgs":0} 2026-02-24T09:09:09.962 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:09:10.080 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:10.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:09 trial090 ceph-mon[47278]: Detected new or changed devices on trial090 2026-02-24T09:09:10.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:09 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial090 to 21011M 2026-02-24T09:09:10.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:09 trial090 ceph-mon[47278]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:09:10.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:09 trial090 ceph-mon[47278]: osdmap e69: 12 total, 11 up, 12 in 2026-02-24T09:09:10.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:09 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:10.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:09 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:10.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:09 trial014 ceph-mon[46941]: Detected new or changed devices on trial090 2026-02-24T09:09:10.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:09 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial090 to 21011M 2026-02-24T09:09:10.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:09 trial014 ceph-mon[46941]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-24T09:09:10.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:09 trial014 ceph-mon[46941]: osdmap e69: 12 total, 11 up, 12 in 2026-02-24T09:09:10.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:09 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:10.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:09 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:10.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.180+0000 7f618268b640 1 -- 10.20.193.4:0/1475908400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f617c10d010 msgr2=0x7f617c10d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.180+0000 7f618268b640 1 --2- 10.20.193.4:0/1475908400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f617c10d010 0x7f617c10d3e0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=5779037103105902274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6168009950 tx=0x7f616802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.180+0000 7f618268b640 1 -- 10.20.193.4:0/1475908400 shutdown_connections 2026-02-24T09:09:10.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.180+0000 7f618268b640 1 --2- 10.20.193.4:0/1475908400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f617c113200 0x7f617c173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.180+0000 7f618268b640 1 --2- 10.20.193.4:0/1475908400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f617c10da00 0x7f617c112a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.180+0000 7f618268b640 1 --2- 10.20.193.4:0/1475908400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f617c10d010 0x7f617c10d3e0 unknown :-1 s=CLOSED pgs=203 gs=1 cs=0 l=1 c_cookie=5779037103105902274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.180+0000 7f618268b640 1 -- 10.20.193.4:0/1475908400 >> 10.20.193.4:0/1475908400 conn(0x7f617c05f830 msgr2=0x7f617c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:10.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.180+0000 7f618268b640 1 -- 10.20.193.4:0/1475908400 shutdown_connections 2026-02-24T09:09:10.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.180+0000 7f618268b640 1 -- 10.20.193.4:0/1475908400 wait complete. 2026-02-24T09:09:10.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f618268b640 1 Processor -- start 2026-02-24T09:09:10.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f618268b640 1 -- start start 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f618268b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f617c10d010 0x7f617c11b990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f618268b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f617c10da00 0x7f617c11bed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f618268b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f617c113200 0x7f617c1212a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f618268b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f617c121830 con 0x7f617c10d010 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f618268b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f617c1219a0 con 0x7f617c10da00 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f618268b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f617c121b60 con 0x7f617c113200 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f617bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f617c10d010 0x7f617c11b990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f617bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f617c10d010 0x7f617c11b990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49642/0 (socket says 10.20.193.4:49642) 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f617bfff640 1 -- 10.20.193.4:0/1242800436 learned_addr learned my addr 10.20.193.4:0/1242800436 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f617b7fe640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f617c10da00 0x7f617c11bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f6180c01640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f617c113200 0x7f617c1212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f617bfff640 1 -- 10.20.193.4:0/1242800436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f617c113200 msgr2=0x7f617c1212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f617bfff640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f617c113200 0x7f617c1212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f617bfff640 1 -- 10.20.193.4:0/1242800436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f617c10da00 msgr2=0x7f617c11bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f617bfff640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f617c10da00 0x7f617c11bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f617bfff640 1 -- 10.20.193.4:0/1242800436 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6168009570 con 0x7f617c10d010 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f617bfff640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f617c10d010 0x7f617c11b990 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61680023d0 tx=0x7f61680043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f61797fa640 1 -- 10.20.193.4:0/1242800436 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f616803d070 con 0x7f617c10d010 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f61797fa640 1 -- 10.20.193.4:0/1242800436 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6168038920 con 0x7f617c10d010 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f618268b640 1 -- 10.20.193.4:0/1242800436 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f617c121de0 con 0x7f617c10d010 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f61797fa640 1 -- 10.20.193.4:0/1242800436 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61680419d0 con 0x7f617c10d010 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.181+0000 7f618268b640 1 -- 10.20.193.4:0/1242800436 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f617c162430 con 0x7f617c10d010 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.182+0000 7f618268b640 1 -- 10.20.193.4:0/1242800436 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617c10e2f0 con 0x7f617c10d010 2026-02-24T09:09:10.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.183+0000 7f61797fa640 1 -- 10.20.193.4:0/1242800436 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f6168038a90 con 0x7f617c10d010 2026-02-24T09:09:10.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.184+0000 7f61797fa640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f61500b5760 0x7f61500d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.184+0000 7f617b7fe640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f61500b5760 0x7f61500d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.184+0000 7f61797fa640 1 -- 10.20.193.4:0/1242800436 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f616810adf0 con 0x7f617c10d010 2026-02-24T09:09:10.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.184+0000 7f617b7fe640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f61500b5760 0x7f61500d5c10 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617c122330 tx=0x7f616c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:10.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.185+0000 7f61797fa640 1 -- 10.20.193.4:0/1242800436 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f61680cdc90 con 0x7f617c10d010 2026-02-24T09:09:10.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.290+0000 7f618268b640 1 -- 10.20.193.4:0/1242800436 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f617c11caf0 con 0x7f617c10d010 2026-02-24T09:09:10.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.291+0000 7f61797fa640 1 -- 10.20.193.4:0/1242800436 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18347 (secure 0 0 0) 0x7f61680d0db0 con 0x7f617c10d010 2026-02-24T09:09:10.294 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:10.294 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":70,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:09.785048+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.291+0000 7f618268b640 1 -- 10.20.193.4:0/1242800436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f61500b5760 msgr2=0x7f61500d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.291+0000 7f618268b640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f61500b5760 0x7f61500d5c10 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617c122330 tx=0x7f616c00a380 comp rx=0 tx=0).stop 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.292+0000 7f618268b640 1 -- 10.20.193.4:0/1242800436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f617c10d010 msgr2=0x7f617c11b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.292+0000 7f618268b640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f617c10d010 0x7f617c11b990 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61680023d0 tx=0x7f61680043d0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.292+0000 7f618268b640 1 -- 10.20.193.4:0/1242800436 shutdown_connections 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.292+0000 7f618268b640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f61500b5760 0x7f61500d5c10 unknown :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.292+0000 7f618268b640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f617c113200 0x7f617c1212a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.292+0000 7f618268b640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f617c10da00 0x7f617c11bed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.292+0000 7f618268b640 1 --2- 10.20.193.4:0/1242800436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f617c10d010 0x7f617c11b990 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.292+0000 7f618268b640 1 -- 10.20.193.4:0/1242800436 >> 10.20.193.4:0/1242800436 conn(0x7f617c05f830 msgr2=0x7f617c10ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.292+0000 7f618268b640 1 -- 10.20.193.4:0/1242800436 shutdown_connections 2026-02-24T09:09:10.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.292+0000 7f618268b640 1 -- 10.20.193.4:0/1242800436 wait complete. 2026-02-24T09:09:10.333 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-24T09:07:59.854959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-24T09:09:10.333 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-24T09:09:10.450 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:10.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 -- 10.20.193.4:0/447096824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff24010ddc0 msgr2=0x7ff240112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 --2- 10.20.193.4:0/447096824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff24010ddc0 0x7ff240112e10 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=16688227249655450458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff234009950 tx=0x7ff23402f190 comp rx=0 tx=0).stop 2026-02-24T09:09:10.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 -- 10.20.193.4:0/447096824 shutdown_connections 2026-02-24T09:09:10.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 --2- 10.20.193.4:0/447096824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff2401135c0 0x7ff240173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 --2- 10.20.193.4:0/447096824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff24010ddc0 0x7ff240112e10 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=16688227249655450458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 --2- 10.20.193.4:0/447096824 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff24010d3d0 0x7ff24010d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 -- 10.20.193.4:0/447096824 >> 10.20.193.4:0/447096824 conn(0x7ff2400eaca0 msgr2=0x7ff24010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:10.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 -- 10.20.193.4:0/447096824 shutdown_connections 2026-02-24T09:09:10.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 -- 10.20.193.4:0/447096824 wait complete. 2026-02-24T09:09:10.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 Processor -- start 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.546+0000 7ff2473b2640 1 -- start start 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff2473b2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff24010d3d0 0x7ff240060f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff2473b2640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff24010ddc0 0x7ff240173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff2473b2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff2401135c0 0x7ff240061480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff2473b2640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff2400619c0 con 0x7ff24010d3d0 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff2473b2640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff240061b30 con 0x7ff24010ddc0 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff2473b2640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff240061cf0 con 0x7ff2401135c0 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245127640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff24010d3d0 0x7ff240060f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245127640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff24010d3d0 0x7ff240060f40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49664/0 (socket says 10.20.193.4:49664) 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245127640 1 -- 10.20.193.4:0/2565905467 learned_addr learned my addr 10.20.193.4:0/2565905467 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:10.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff244926640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff24010ddc0 0x7ff240173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245928640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff2401135c0 0x7ff240061480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245127640 1 -- 10.20.193.4:0/2565905467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff2401135c0 msgr2=0x7ff240061480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245127640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff2401135c0 0x7ff240061480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245127640 1 -- 10.20.193.4:0/2565905467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff24010ddc0 msgr2=0x7ff240173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245127640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff24010ddc0 0x7ff240173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245127640 1 -- 10.20.193.4:0/2565905467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff234009570 con 0x7ff24010d3d0 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245928640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff2401135c0 0x7ff240061480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff244926640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff24010ddc0 0x7ff240173e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff245127640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff24010d3d0 0x7ff240060f40 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff23000d950 tx=0x7ff23000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff22e7fc640 1 -- 10.20.193.4:0/2565905467 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff230004540 con 0x7ff24010d3d0 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff2473b2640 1 -- 10.20.193.4:0/2565905467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2400fb9a0 con 0x7ff24010d3d0 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff22e7fc640 1 -- 10.20.193.4:0/2565905467 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff230009d00 con 0x7ff24010d3d0 2026-02-24T09:09:10.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff22e7fc640 1 -- 10.20.193.4:0/2565905467 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2300106e0 con 0x7ff24010d3d0 2026-02-24T09:09:10.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff2473b2640 1 -- 10.20.193.4:0/2565905467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2400fbec0 con 0x7ff24010d3d0 2026-02-24T09:09:10.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.547+0000 7ff2473b2640 1 -- 10.20.193.4:0/2565905467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff24010e6b0 con 0x7ff24010d3d0 2026-02-24T09:09:10.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.549+0000 7ff22e7fc640 1 -- 10.20.193.4:0/2565905467 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7ff2300097c0 con 0x7ff24010d3d0 2026-02-24T09:09:10.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.550+0000 7ff22e7fc640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff21c0b5760 0x7ff21c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.550+0000 7ff244926640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff21c0b5760 0x7ff21c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.550+0000 7ff22e7fc640 1 -- 10.20.193.4:0/2565905467 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7ff2300e6d00 con 0x7ff24010d3d0 2026-02-24T09:09:10.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.550+0000 7ff244926640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff21c0b5760 0x7ff21c0d5c10 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2340023d0 tx=0x7ff234031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:10.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.550+0000 7ff22e7fc640 1 -- 10.20.193.4:0/2565905467 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff2300a9b50 con 0x7ff24010d3d0 2026-02-24T09:09:10.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.654+0000 7ff2473b2640 1 -- 10.20.193.4:0/2565905467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff24005f850 con 0x7ff24010d3d0 2026-02-24T09:09:10.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.655+0000 7ff22e7fc640 1 -- 10.20.193.4:0/2565905467 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7ff2300acd00 con 0x7ff24010d3d0 2026-02-24T09:09:10.659 INFO:teuthology.orchestra.run.trial004.stdout:pg_num: 1 2026-02-24T09:09:10.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 -- 10.20.193.4:0/2565905467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff21c0b5760 msgr2=0x7ff21c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff21c0b5760 0x7ff21c0d5c10 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2340023d0 tx=0x7ff234031040 comp rx=0 tx=0).stop 2026-02-24T09:09:10.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 -- 10.20.193.4:0/2565905467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff24010d3d0 msgr2=0x7ff240060f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff24010d3d0 0x7ff240060f40 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff23000d950 tx=0x7ff23000de20 comp rx=0 tx=0).stop 2026-02-24T09:09:10.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 -- 10.20.193.4:0/2565905467 shutdown_connections 2026-02-24T09:09:10.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff21c0b5760 0x7ff21c0d5c10 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff2401135c0 0x7ff240061480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff24010ddc0 0x7ff240173e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 --2- 10.20.193.4:0/2565905467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff24010d3d0 0x7ff240060f40 unknown :-1 s=CLOSED pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 -- 10.20.193.4:0/2565905467 >> 10.20.193.4:0/2565905467 conn(0x7ff2400eaca0 msgr2=0x7ff24010b860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:10.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 -- 10.20.193.4:0/2565905467 shutdown_connections 2026-02-24T09:09:10.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:10.656+0000 7ff20ffff640 1 -- 10.20.193.4:0/2565905467 wait complete. 2026-02-24T09:09:10.696 INFO:tasks.cephadm:Adding mds.a on trial004 2026-02-24T09:09:10.696 INFO:tasks.cephadm:Adding mds.d on trial004 2026-02-24T09:09:10.697 INFO:tasks.cephadm:Adding mds.g on trial004 2026-02-24T09:09:10.697 INFO:tasks.cephadm:Adding mds.j on trial004 2026-02-24T09:09:10.697 INFO:tasks.cephadm:Adding mds.b on trial014 2026-02-24T09:09:10.697 INFO:tasks.cephadm:Adding mds.e on trial014 2026-02-24T09:09:10.697 INFO:tasks.cephadm:Adding mds.h on trial014 2026-02-24T09:09:10.697 INFO:tasks.cephadm:Adding mds.k on trial014 2026-02-24T09:09:10.697 INFO:tasks.cephadm:Adding mds.c on trial090 2026-02-24T09:09:10.697 INFO:tasks.cephadm:Adding mds.f on trial090 2026-02-24T09:09:10.697 INFO:tasks.cephadm:Adding mds.i on trial090 2026-02-24T09:09:10.697 INFO:tasks.cephadm:Adding mds.l on trial090 2026-02-24T09:09:10.698 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph orch apply mds all '12;trial004=a;trial004=d;trial004=g;trial004=j;trial014=b;trial014=e;trial014=h;trial014=k;trial090=c;trial090=f;trial090=i;trial090=l' 2026-02-24T09:09:10.815 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.c/config 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.914+0000 7f332bcca640 1 -- 10.20.193.90:0/799756386 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3324110400 msgr2=0x7f3324110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.914+0000 7f332bcca640 1 --2- 10.20.193.90:0/799756386 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3324110400 0x7f3324110870 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=5293587068621428353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3318009950 tx=0x7f331802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 -- 10.20.193.90:0/799756386 shutdown_connections 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 --2- 10.20.193.90:0/799756386 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3324110db0 0x7f3324171740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 --2- 10.20.193.90:0/799756386 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3324110400 0x7f3324110870 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=5293587068621428353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 --2- 10.20.193.90:0/799756386 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f332410f270 0x7f332410f660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 -- 10.20.193.90:0/799756386 >> 10.20.193.90:0/799756386 conn(0x7f33240ec9c0 msgr2=0x7f332410cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 -- 10.20.193.90:0/799756386 shutdown_connections 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 -- 10.20.193.90:0/799756386 wait complete. 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 Processor -- start 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 -- start start 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f332410f270 0x7f33240f8940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3324110400 0x7f3324171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3324110db0 0x7f33240f9180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f33240f9de0 con 0x7f332410f270 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f33240f9f50 con 0x7f3324110db0 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f33240fa110 con 0x7f3324110400 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332923e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3324110400 0x7f3324171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332923e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3324110400 0x7f3324171720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:56056/0 (socket says 10.20.193.90:56056) 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332923e640 1 -- 10.20.193.90:0/2242591572 learned_addr learned my addr 10.20.193.90:0/2242591572 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332923e640 1 -- 10.20.193.90:0/2242591572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3324110db0 msgr2=0x7f33240f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332923e640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3324110db0 0x7f33240f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f3329a3f640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f332410f270 0x7f33240f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332923e640 1 -- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f332410f270 msgr2=0x7f33240f8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332923e640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f332410f270 0x7f33240f8940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332923e640 1 -- 10.20.193.90:0/2242591572 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3318009570 con 0x7f3324110400 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f3329a3f640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f332410f270 0x7f33240f8940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332923e640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3324110400 0x7f3324171720 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3318002d80 tx=0x7f33180028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f3312ffd640 1 -- 10.20.193.90:0/2242591572 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f331803d070 con 0x7f3324110400 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f3312ffd640 1 -- 10.20.193.90:0/2242591572 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f33180043d0 con 0x7f3324110400 2026-02-24T09:09:10.921 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 -- 10.20.193.90:0/2242591572 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33240fa390 con 0x7f3324110400 2026-02-24T09:09:10.922 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f3312ffd640 1 -- 10.20.193.90:0/2242591572 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3318041aa0 con 0x7f3324110400 2026-02-24T09:09:10.922 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.915+0000 7f332bcca640 1 -- 10.20.193.90:0/2242591572 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33240fa850 con 0x7f3324110400 2026-02-24T09:09:10.922 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.916+0000 7f332bcca640 1 -- 10.20.193.90:0/2242591572 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3324175760 con 0x7f3324110400 2026-02-24T09:09:10.922 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.917+0000 7f3312ffd640 1 -- 10.20.193.90:0/2242591572 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f3318038920 con 0x7f3324110400 2026-02-24T09:09:10.922 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.918+0000 7f3312ffd640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33000b5760 0x7f33000d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:10.922 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.918+0000 7f3312ffd640 1 -- 10.20.193.90:0/2242591572 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f331810b830 con 0x7f3324110400 2026-02-24T09:09:10.922 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.918+0000 7f3329a3f640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33000b5760 0x7f33000d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:10.923 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.919+0000 7f3312ffd640 1 -- 10.20.193.90:0/2242591572 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f33180ce640 con 0x7f3324110400 2026-02-24T09:09:10.923 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:10.919+0000 7f3329a3f640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33000b5760 0x7f33000d5c10 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3314004740 tx=0x7f3314005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:11.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.031+0000 7f332bcca640 1 -- 10.20.193.90:0/2242591572 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial004=a;trial004=d;trial004=g;trial004=j;trial014=b;trial014=e;trial014=h;trial014=k;trial090=c;trial090=f;trial090=i;trial090=l", "target": ["mon-mgr", ""]}) -- 0x7f3324174f00 con 0x7f33000b5760 2026-02-24T09:09:11.035 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: purged_snaps scrub starts 2026-02-24T09:09:11.035 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: purged_snaps scrub ok 2026-02-24T09:09:11.035 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-24T09:09:11.035 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: osd.11 [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] boot 2026-02-24T09:09:11.035 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: osdmap e70: 12 total, 12 up, 12 in 2026-02-24T09:09:11.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:11.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/153753222' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:09:11.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:11.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:11.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1242800436' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:11.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:10 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2565905467' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:09:11.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.035+0000 7f3312ffd640 1 -- 10.20.193.90:0/2242591572 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3324174f00 con 0x7f33000b5760 2026-02-24T09:09:11.038 INFO:teuthology.orchestra.run.trial090.stdout:Scheduled mds.all update... 2026-02-24T09:09:11.040 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 -- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33000b5760 msgr2=0x7f33000d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:11.040 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33000b5760 0x7f33000d5c10 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3314004740 tx=0x7f3314005f00 comp rx=0 tx=0).stop 2026-02-24T09:09:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 -- 10.20.193.90:0/2242591572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3324110400 msgr2=0x7f3324171720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3324110400 0x7f3324171720 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3318002d80 tx=0x7f33180028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 -- 10.20.193.90:0/2242591572 shutdown_connections 2026-02-24T09:09:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33000b5760 0x7f33000d5c10 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3324110db0 0x7f33240f9180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3324110400 0x7f3324171720 unknown :-1 s=CLOSED pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 --2- 10.20.193.90:0/2242591572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f332410f270 0x7f33240f8940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 -- 10.20.193.90:0/2242591572 >> 10.20.193.90:0/2242591572 conn(0x7f33240ec9c0 msgr2=0x7f33240eef60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 -- 10.20.193.90:0/2242591572 shutdown_connections 2026-02-24T09:09:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-24T09:09:11.036+0000 7f332bcca640 1 -- 10.20.193.90:0/2242591572 wait complete. 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: purged_snaps scrub starts 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: purged_snaps scrub ok 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: osd.11 [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] boot 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: osdmap e70: 12 total, 12 up, 12 in 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/153753222' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1242800436' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:10 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2565905467' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:09:11.094 DEBUG:teuthology.orchestra.run.trial004:mds.a> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.a.service 2026-02-24T09:09:11.097 DEBUG:teuthology.orchestra.run.trial004:mds.d> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.d.service 2026-02-24T09:09:11.118 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: purged_snaps scrub starts 2026-02-24T09:09:11.118 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: purged_snaps scrub ok 2026-02-24T09:09:11.118 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-24T09:09:11.118 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: osd.11 [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] boot 2026-02-24T09:09:11.118 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: osdmap e70: 12 total, 12 up, 12 in 2026-02-24T09:09:11.119 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-24T09:09:11.119 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/153753222' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T09:09:11.119 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:11.119 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:11.119 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1242800436' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:11.119 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:10 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2565905467' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:09:11.121 DEBUG:teuthology.orchestra.run.trial004:mds.g> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.g.service 2026-02-24T09:09:11.164 DEBUG:teuthology.orchestra.run.trial004:mds.j> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.j.service 2026-02-24T09:09:11.207 DEBUG:teuthology.orchestra.run.trial014:mds.b> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.b.service 2026-02-24T09:09:11.210 DEBUG:teuthology.orchestra.run.trial014:mds.e> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.e.service 2026-02-24T09:09:11.253 DEBUG:teuthology.orchestra.run.trial014:mds.h> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.h.service 2026-02-24T09:09:11.297 DEBUG:teuthology.orchestra.run.trial014:mds.k> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.k.service 2026-02-24T09:09:11.340 DEBUG:teuthology.orchestra.run.trial090:mds.c> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.c.service 2026-02-24T09:09:11.343 DEBUG:teuthology.orchestra.run.trial090:mds.f> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.f.service 2026-02-24T09:09:11.388 DEBUG:teuthology.orchestra.run.trial090:mds.i> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.i.service 2026-02-24T09:09:11.431 DEBUG:teuthology.orchestra.run.trial090:mds.l> sudo journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.l.service 2026-02-24T09:09:11.474 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-24T09:09:11.474 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:11.588 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:11.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.684+0000 7f5b5eca0640 1 -- 10.20.193.4:0/2824155584 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5b5810f280 msgr2=0x7f5b5810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:11.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.684+0000 7f5b5eca0640 1 --2- 10.20.193.4:0/2824155584 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5b5810f280 0x7f5b5810f650 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=18391647069786620033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b48009950 tx=0x7f5b4802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.684+0000 7f5b5eca0640 1 -- 10.20.193.4:0/2824155584 shutdown_connections 2026-02-24T09:09:11.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.684+0000 7f5b5eca0640 1 --2- 10.20.193.4:0/2824155584 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5b58115470 0x7f5b58175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.684+0000 7f5b5eca0640 1 --2- 10.20.193.4:0/2824155584 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b5810fc70 0x7f5b58114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.684+0000 7f5b5eca0640 1 --2- 10.20.193.4:0/2824155584 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5b5810f280 0x7f5b5810f650 unknown :-1 s=CLOSED pgs=207 gs=1 cs=0 l=1 c_cookie=18391647069786620033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.684+0000 7f5b5eca0640 1 -- 10.20.193.4:0/2824155584 >> 10.20.193.4:0/2824155584 conn(0x7f5b5805f830 msgr2=0x7f5b5810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:11.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.684+0000 7f5b5eca0640 1 -- 10.20.193.4:0/2824155584 shutdown_connections 2026-02-24T09:09:11.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.684+0000 7f5b5eca0640 1 -- 10.20.193.4:0/2824155584 wait complete. 2026-02-24T09:09:11.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5eca0640 1 Processor -- start 2026-02-24T09:09:11.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5eca0640 1 -- start start 2026-02-24T09:09:11.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5eca0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5b5810f280 0x7f5b5811dbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:11.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5eca0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5b5810fc70 0x7f5b5811e0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:11.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5eca0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b58115470 0x7f5b581234c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:11.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5eca0640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58123ae0 con 0x7f5b5810f280 2026-02-24T09:09:11.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5eca0640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58123c50 con 0x7f5b5810fc70 2026-02-24T09:09:11.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5eca0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58123e10 con 0x7f5b58115470 2026-02-24T09:09:11.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5ca15640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5b5810f280 0x7f5b5811dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:11.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5ca15640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5b5810f280 0x7f5b5811dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49686/0 (socket says 10.20.193.4:49686) 2026-02-24T09:09:11.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5ca15640 1 -- 10.20.193.4:0/904453561 learned_addr learned my addr 10.20.193.4:0/904453561 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:11.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b4ffff640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5b5810fc70 0x7f5b5811e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:11.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5ca15640 1 -- 10.20.193.4:0/904453561 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b58115470 msgr2=0x7f5b581234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:11.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5ca15640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b58115470 0x7f5b581234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5ca15640 1 -- 10.20.193.4:0/904453561 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5b5810fc70 msgr2=0x7f5b5811e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:11.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5ca15640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5b5810fc70 0x7f5b5811e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5ca15640 1 -- 10.20.193.4:0/904453561 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b48009570 con 0x7f5b5810f280 2026-02-24T09:09:11.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5ca15640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5b5810f280 0x7f5b5811dbb0 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b480023d0 tx=0x7f5b480043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:11.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b4dffb640 1 -- 10.20.193.4:0/904453561 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b4803d070 con 0x7f5b5810f280 2026-02-24T09:09:11.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5eca0640 1 -- 10.20.193.4:0/904453561 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b58124090 con 0x7f5b5810f280 2026-02-24T09:09:11.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b4dffb640 1 -- 10.20.193.4:0/904453561 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5b48038920 con 0x7f5b5810f280 2026-02-24T09:09:11.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b4dffb640 1 -- 10.20.193.4:0/904453561 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b480419d0 con 0x7f5b5810f280 2026-02-24T09:09:11.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.685+0000 7f5b5eca0640 1 -- 10.20.193.4:0/904453561 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b581647f0 con 0x7f5b5810f280 2026-02-24T09:09:11.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.686+0000 7f5b5eca0640 1 -- 10.20.193.4:0/904453561 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b58110560 con 0x7f5b5810f280 2026-02-24T09:09:11.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.687+0000 7f5b4dffb640 1 -- 10.20.193.4:0/904453561 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f5b48038a90 con 0x7f5b5810f280 2026-02-24T09:09:11.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.688+0000 7f5b4dffb640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5b340b56e0 0x7f5b340d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:11.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.688+0000 7f5b4dffb640 1 -- 10.20.193.4:0/904453561 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f5b4810b500 con 0x7f5b5810f280 2026-02-24T09:09:11.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.688+0000 7f5b4ffff640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5b340b56e0 0x7f5b340d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:11.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.688+0000 7f5b4ffff640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5b340b56e0 0x7f5b340d5b90 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b58124550 tx=0x7f5b40004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:11.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.689+0000 7f5b4dffb640 1 -- 10.20.193.4:0/904453561 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f5b480ce3a0 con 0x7f5b5810f280 2026-02-24T09:09:11.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.821+0000 7f5b5eca0640 1 -- 10.20.193.4:0/904453561 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b5810f650 con 0x7f5b5810f280 2026-02-24T09:09:11.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.822+0000 7f5b4dffb640 1 -- 10.20.193.4:0/904453561 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f5b480d14c0 con 0x7f5b5810f280 2026-02-24T09:09:11.826 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 1 2026-02-24T09:09:11.826 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:11.827 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":1,"btime":"2026-02-24T09:06:42:076252+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-24T09:09:11.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 -- 10.20.193.4:0/904453561 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5b340b56e0 msgr2=0x7f5b340d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:11.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5b340b56e0 0x7f5b340d5b90 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b58124550 tx=0x7f5b40004420 comp rx=0 tx=0).stop 2026-02-24T09:09:11.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 -- 10.20.193.4:0/904453561 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5b5810f280 msgr2=0x7f5b5811dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:11.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5b5810f280 0x7f5b5811dbb0 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b480023d0 tx=0x7f5b480043d0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 -- 10.20.193.4:0/904453561 shutdown_connections 2026-02-24T09:09:11.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5b340b56e0 0x7f5b340d5b90 unknown :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b58115470 0x7f5b581234c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5b5810fc70 0x7f5b5811e0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 --2- 10.20.193.4:0/904453561 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5b5810f280 0x7f5b5811dbb0 unknown :-1 s=CLOSED pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:11.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 -- 10.20.193.4:0/904453561 >> 10.20.193.4:0/904453561 conn(0x7f5b5805f830 msgr2=0x7f5b5810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:11.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 -- 10.20.193.4:0/904453561 shutdown_connections 2026-02-24T09:09:11.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:11.823+0000 7f5b5eca0640 1 -- 10.20.193.4:0/904453561 wait complete. 2026-02-24T09:09:12.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:12 trial004 ceph-mon[41596]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial004=a;trial004=d;trial004=g;trial004=j;trial014=b;trial014=e;trial014=h;trial014=k;trial090=c;trial090=f;trial090=i;trial090=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:12.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:12 trial004 ceph-mon[41596]: Saving service mds.all spec with placement trial004=a;trial004=d;trial004=g;trial004=j;trial014=b;trial014=e;trial014=h;trial014=k;trial090=c;trial090=f;trial090=i;trial090=l;count:12 2026-02-24T09:09:12.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:12.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:12.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:12 trial004 ceph-mon[41596]: osdmap e71: 12 total, 12 up, 12 in 2026-02-24T09:09:12.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:12.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:12 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:12.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:12 trial004 ceph-mon[41596]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-24T09:09:12.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:12 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/904453561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:12.312 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:12 trial090 ceph-mon[47278]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial004=a;trial004=d;trial004=g;trial004=j;trial014=b;trial014=e;trial014=h;trial014=k;trial090=c;trial090=f;trial090=i;trial090=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:12.312 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:12 trial090 ceph-mon[47278]: Saving service mds.all spec with placement trial004=a;trial004=d;trial004=g;trial004=j;trial014=b;trial014=e;trial014=h;trial014=k;trial090=c;trial090=f;trial090=i;trial090=l;count:12 2026-02-24T09:09:12.312 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:12.312 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:12.312 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:12 trial090 ceph-mon[47278]: osdmap e71: 12 total, 12 up, 12 in 2026-02-24T09:09:12.312 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:12.312 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:12 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:12.312 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:12 trial090 ceph-mon[47278]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-24T09:09:12.313 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:12 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/904453561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:12 trial014 ceph-mon[46941]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial004=a;trial004=d;trial004=g;trial004=j;trial014=b;trial014=e;trial014=h;trial014=k;trial090=c;trial090=f;trial090=i;trial090=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:12 trial014 ceph-mon[46941]: Saving service mds.all spec with placement trial004=a;trial004=d;trial004=g;trial004=j;trial014=b;trial014=e;trial014=h;trial014=k;trial090=c;trial090=f;trial090=i;trial090=l;count:12 2026-02-24T09:09:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:12 trial014 ceph-mon[46941]: osdmap e71: 12 total, 12 up, 12 in 2026-02-24T09:09:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:12 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:12 trial014 ceph-mon[46941]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-24T09:09:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:12 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/904453561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:13.333 INFO:journalctl@ceph.mds.l.trial090.stdout:Feb 24 09:09:13 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-l[100402]: starting mds.l at 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: Deploying daemon mds.l on trial090 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.90:6832/931807729,v1:10.20.193.90:6833/931807729] up:boot 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: fsmap 1 up:standby 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.590 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:13.591 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:13.591 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:13 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: Deploying daemon mds.l on trial090 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.90:6832/931807729,v1:10.20.193.90:6833/931807729] up:boot 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: fsmap 1 up:standby 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:13.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:13.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:13 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:13.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:13.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:13.833 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: Deploying daemon mds.l on trial090 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.90:6832/931807729,v1:10.20.193.90:6833/931807729] up:boot 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: fsmap 1 up:standby 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:13.834 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:13.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:13.835 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:13 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:13.843 INFO:journalctl@ceph.mds.k.trial014.stdout:Feb 24 09:09:13 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-k[98080]: starting mds.k at 2026-02-24T09:09:13.864 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:13.981 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.201+0000 7fbd4a651640 1 -- 10.20.193.4:0/269320378 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd4410c950 msgr2=0x7fbd44110f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.201+0000 7fbd4a651640 1 --2- 10.20.193.4:0/269320378 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd4410c950 0x7fbd44110f20 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=16448582436336887147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd34009980 tx=0x7fbd3402f180 comp rx=0 tx=0).stop 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.201+0000 7fbd4a651640 1 -- 10.20.193.4:0/269320378 shutdown_connections 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.201+0000 7fbd4a651640 1 --2- 10.20.193.4:0/269320378 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd44111540 0x7fbd441119e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.201+0000 7fbd4a651640 1 --2- 10.20.193.4:0/269320378 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd4410c950 0x7fbd44110f20 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=16448582436336887147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.201+0000 7fbd4a651640 1 --2- 10.20.193.4:0/269320378 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd4410bf60 0x7fbd4410c330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.201+0000 7fbd4a651640 1 -- 10.20.193.4:0/269320378 >> 10.20.193.4:0/269320378 conn(0x7fbd440e9bf0 msgr2=0x7fbd4410a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.201+0000 7fbd4a651640 1 -- 10.20.193.4:0/269320378 shutdown_connections 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.201+0000 7fbd4a651640 1 -- 10.20.193.4:0/269320378 wait complete. 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd4a651640 1 Processor -- start 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd4a651640 1 -- start start 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd4a651640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd4410bf60 0x7fbd44122950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd4a651640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd4410c950 0x7fbd44122e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd4a651640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd44111540 0x7fbd44128260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd4a651640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbd44128880 con 0x7fbd44111540 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd4a651640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbd441289f0 con 0x7fbd4410c950 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd4a651640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbd44128bb0 con 0x7fbd4410bf60 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd48bc7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd44111540 0x7fbd44128260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd48bc7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd44111540 0x7fbd44128260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33352/0 (socket says 10.20.193.4:33352) 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd48bc7640 1 -- 10.20.193.4:0/412167064 learned_addr learned my addr 10.20.193.4:0/412167064 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd43fff640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd4410bf60 0x7fbd44122950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd437fe640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd4410c950 0x7fbd44122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd48bc7640 1 -- 10.20.193.4:0/412167064 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd4410bf60 msgr2=0x7fbd44122950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:14.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd48bc7640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd4410bf60 0x7fbd44122950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd48bc7640 1 -- 10.20.193.4:0/412167064 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd4410c950 msgr2=0x7fbd44122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd48bc7640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd4410c950 0x7fbd44122e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd48bc7640 1 -- 10.20.193.4:0/412167064 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd34009570 con 0x7fbd44111540 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd437fe640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd4410c950 0x7fbd44122e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd48bc7640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd44111540 0x7fbd44128260 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd38006e90 tx=0x7fbd3800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd417fa640 1 -- 10.20.193.4:0/412167064 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd38005500 con 0x7fbd44111540 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd4a651640 1 -- 10.20.193.4:0/412167064 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd44128e90 con 0x7fbd44111540 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd417fa640 1 -- 10.20.193.4:0/412167064 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbd38005e10 con 0x7fbd44111540 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd417fa640 1 -- 10.20.193.4:0/412167064 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd38003a90 con 0x7fbd44111540 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.202+0000 7fbd4a651640 1 -- 10.20.193.4:0/412167064 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd44169590 con 0x7fbd44111540 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.203+0000 7fbd4a651640 1 -- 10.20.193.4:0/412167064 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd44060420 con 0x7fbd44111540 2026-02-24T09:09:14.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.204+0000 7fbd417fa640 1 -- 10.20.193.4:0/412167064 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7fbd3800c840 con 0x7fbd44111540 2026-02-24T09:09:14.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.205+0000 7fbd417fa640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd180b56e0 0x7fbd180d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:14.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.205+0000 7fbd43fff640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd180b56e0 0x7fbd180d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:14.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.205+0000 7fbd417fa640 1 -- 10.20.193.4:0/412167064 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7fbd380e78a0 con 0x7fbd44111540 2026-02-24T09:09:14.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.205+0000 7fbd43fff640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd180b56e0 0x7fbd180d5b90 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd30004740 tx=0x7fbd30004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:14.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.206+0000 7fbd417fa640 1 -- 10.20.193.4:0/412167064 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbd380aa6f0 con 0x7fbd44111540 2026-02-24T09:09:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.339+0000 7fbd4a651640 1 -- 10.20.193.4:0/412167064 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd44110f20 con 0x7fbd44111540 2026-02-24T09:09:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.340+0000 7fbd417fa640 1 -- 10.20.193.4:0/412167064 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1432 (secure 0 0 0) 0x7fbd380ad8a0 con 0x7fbd44111540 2026-02-24T09:09:14.344 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:14.344 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":2,"btime":"2026-02-24T09:09:13:039931+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2026-02-24T09:09:14.344 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 2 2026-02-24T09:09:14.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 -- 10.20.193.4:0/412167064 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd180b56e0 msgr2=0x7fbd180d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:14.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd180b56e0 0x7fbd180d5b90 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd30004740 tx=0x7fbd30004420 comp rx=0 tx=0).stop 2026-02-24T09:09:14.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 -- 10.20.193.4:0/412167064 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd44111540 msgr2=0x7fbd44128260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:14.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd44111540 0x7fbd44128260 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd38006e90 tx=0x7fbd3800edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:14.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 -- 10.20.193.4:0/412167064 shutdown_connections 2026-02-24T09:09:14.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd180b56e0 0x7fbd180d5b90 unknown :-1 s=CLOSED pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:14.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd44111540 0x7fbd44128260 unknown :-1 s=CLOSED pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:14.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd4410c950 0x7fbd44122e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:14.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 --2- 10.20.193.4:0/412167064 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd4410bf60 0x7fbd44122950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:14.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 -- 10.20.193.4:0/412167064 >> 10.20.193.4:0/412167064 conn(0x7fbd440e9bf0 msgr2=0x7fbd44109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:14.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 -- 10.20.193.4:0/412167064 shutdown_connections 2026-02-24T09:09:14.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:14.342+0000 7fbd4a651640 1 -- 10.20.193.4:0/412167064 wait complete. 2026-02-24T09:09:14.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: Deploying daemon mds.k on trial014 2026-02-24T09:09:14.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-24T09:09:14.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:14.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:14.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:14.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:14.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:14.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:14.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: Deploying daemon mds.j on trial004 2026-02-24T09:09:14.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/412167064' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:14.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.14:6832/1885006877,v1:10.20.193.14:6833/1885006877] up:boot 2026-02-24T09:09:14.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: fsmap 2 up:standby 2026-02-24T09:09:14.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-24T09:09:14.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:14.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:14.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:14.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:14.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:14.966 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:14 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:15.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: Deploying daemon mds.k on trial014 2026-02-24T09:09:15.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-24T09:09:15.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: Deploying daemon mds.j on trial004 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/412167064' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.14:6832/1885006877,v1:10.20.193.14:6833/1885006877] up:boot 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: fsmap 2 up:standby 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:15.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:15.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:14 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: Deploying daemon mds.k on trial014 2026-02-24T09:09:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-24T09:09:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: Deploying daemon mds.j on trial004 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/412167064' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.14:6832/1885006877,v1:10.20.193.14:6833/1885006877] up:boot 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: fsmap 2 up:standby 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:15.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:14 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:15.465 INFO:journalctl@ceph.mds.d.trial004.stdout:Feb 24 09:09:15 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-d[107961]: starting mds.d at 2026-02-24T09:09:16.035 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: Deploying daemon mds.d on trial004 2026-02-24T09:09:16.035 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.035 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.035 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:16.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:16.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:16.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.4:6834/1622269315,v1:10.20.193.4:6835/1622269315] up:boot 2026-02-24T09:09:16.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.4:6836/3175863747,v1:10.20.193.4:6837/3175863747] up:boot 2026-02-24T09:09:16.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: fsmap 4 up:standby 2026-02-24T09:09:16.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-24T09:09:16.036 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:15 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: Deploying daemon mds.d on trial004 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.4:6834/1622269315,v1:10.20.193.4:6835/1622269315] up:boot 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.4:6836/3175863747,v1:10.20.193.4:6837/3175863747] up:boot 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: fsmap 4 up:standby 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:15 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-24T09:09:16.093 INFO:journalctl@ceph.mds.e.trial014.stdout:Feb 24 09:09:15 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-e[98416]: starting mds.e at 2026-02-24T09:09:16.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: Deploying daemon mds.d on trial004 2026-02-24T09:09:16.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:16.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:16.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:16.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.4:6834/1622269315,v1:10.20.193.4:6835/1622269315] up:boot 2026-02-24T09:09:16.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.4:6836/3175863747,v1:10.20.193.4:6837/3175863747] up:boot 2026-02-24T09:09:16.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: fsmap 4 up:standby 2026-02-24T09:09:16.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-24T09:09:16.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:15 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-24T09:09:16.391 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:16.512 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:16.623 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- 10.20.193.4:0/2366354894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4628115470 msgr2=0x7f4628175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:16.623 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 --2- 10.20.193.4:0/2366354894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4628115470 0x7f4628175e40 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=17097762520346587747 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f462400aa30 tx=0x7f4624030280 comp rx=0 tx=0).stop 2026-02-24T09:09:16.623 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- 10.20.193.4:0/2366354894 shutdown_connections 2026-02-24T09:09:16.623 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 --2- 10.20.193.4:0/2366354894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4628115470 0x7f4628175e40 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=17097762520346587747 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:16.623 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 --2- 10.20.193.4:0/2366354894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f462810fc70 0x7f4628114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:16.623 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 --2- 10.20.193.4:0/2366354894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f462810f280 0x7f462810f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:16.623 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- 10.20.193.4:0/2366354894 >> 10.20.193.4:0/2366354894 conn(0x7f462805f830 msgr2=0x7f462810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- 10.20.193.4:0/2366354894 shutdown_connections 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- 10.20.193.4:0/2366354894 wait complete. 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 Processor -- start 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- start start 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f462810f280 0x7f462811db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f462810fc70 0x7f462811e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4628115470 0x7f4628123480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4628123aa0 con 0x7f462810fc70 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4628123c10 con 0x7f462810f280 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4628123dd0 con 0x7f4628115470 2026-02-24T09:09:16.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f462810fc70 0x7f462811e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f462810fc70 0x7f462811e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33410/0 (socket says 10.20.193.4:33410) 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461ffff640 1 -- 10.20.193.4:0/3859039193 learned_addr learned my addr 10.20.193.4:0/3859039193 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462cc2c640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f462810f280 0x7f462811db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462d42d640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4628115470 0x7f4628123480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461ffff640 1 -- 10.20.193.4:0/3859039193 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4628115470 msgr2=0x7f4628123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461ffff640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4628115470 0x7f4628123480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461ffff640 1 -- 10.20.193.4:0/3859039193 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f462810f280 msgr2=0x7f462811db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461ffff640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f462810f280 0x7f462811db70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461ffff640 1 -- 10.20.193.4:0/3859039193 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462400a650 con 0x7f462810fc70 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462cc2c640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f462810f280 0x7f462811db70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461ffff640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f462810fc70 0x7f462811e0b0 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f461000d950 tx=0x7f461000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:16.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461dffb640 1 -- 10.20.193.4:0/3859039193 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4610004540 con 0x7f462810fc70 2026-02-24T09:09:16.626 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461dffb640 1 -- 10.20.193.4:0/3859039193 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4610009d00 con 0x7f462810fc70 2026-02-24T09:09:16.626 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f461dffb640 1 -- 10.20.193.4:0/3859039193 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46100106e0 con 0x7f462810fc70 2026-02-24T09:09:16.626 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- 10.20.193.4:0/3859039193 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46281240b0 con 0x7f462810fc70 2026-02-24T09:09:16.626 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- 10.20.193.4:0/3859039193 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46281647b0 con 0x7f462810fc70 2026-02-24T09:09:16.626 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.618+0000 7f462eeb7640 1 -- 10.20.193.4:0/3859039193 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4628110560 con 0x7f462810fc70 2026-02-24T09:09:16.626 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.619+0000 7f461dffb640 1 -- 10.20.193.4:0/3859039193 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f46100097c0 con 0x7f462810fc70 2026-02-24T09:09:16.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.621+0000 7f461dffb640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46040b5760 0x7f46040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:16.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.621+0000 7f461dffb640 1 -- 10.20.193.4:0/3859039193 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f46100e6d00 con 0x7f462810fc70 2026-02-24T09:09:16.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.621+0000 7f462cc2c640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46040b5760 0x7f46040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:16.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.621+0000 7f462cc2c640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46040b5760 0x7f46040d5c10 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4618005970 tx=0x7f4618005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:16.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.622+0000 7f461dffb640 1 -- 10.20.193.4:0/3859039193 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f46100a9b50 con 0x7f462810fc70 2026-02-24T09:09:16.723 INFO:journalctl@ceph.mds.f.trial090.stdout:Feb 24 09:09:16 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-f[100741]: starting mds.f at 2026-02-24T09:09:16.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.752+0000 7f462eeb7640 1 -- 10.20.193.4:0/3859039193 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f462811ed30 con 0x7f462810fc70 2026-02-24T09:09:16.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.753+0000 7f461dffb640 1 -- 10.20.193.4:0/3859039193 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+5551 (secure 0 0 0) 0x7f46100acd00 con 0x7f462810fc70 2026-02-24T09:09:16.757 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:16.757 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":5,"btime":"2026-02-24T09:09:16:740354+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24613,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[]} 2026-02-24T09:09:16.758 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 5 2026-02-24T09:09:16.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 -- 10.20.193.4:0/3859039193 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46040b5760 msgr2=0x7f46040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:16.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46040b5760 0x7f46040d5c10 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4618005970 tx=0x7f4618005900 comp rx=0 tx=0).stop 2026-02-24T09:09:16.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 -- 10.20.193.4:0/3859039193 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f462810fc70 msgr2=0x7f462811e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:16.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f462810fc70 0x7f462811e0b0 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f461000d950 tx=0x7f461000de20 comp rx=0 tx=0).stop 2026-02-24T09:09:16.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 -- 10.20.193.4:0/3859039193 shutdown_connections 2026-02-24T09:09:16.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46040b5760 0x7f46040d5c10 unknown :-1 s=CLOSED pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:16.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4628115470 0x7f4628123480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:16.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f462810fc70 0x7f462811e0b0 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:16.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 --2- 10.20.193.4:0/3859039193 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f462810f280 0x7f462811db70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:16.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 -- 10.20.193.4:0/3859039193 >> 10.20.193.4:0/3859039193 conn(0x7f462805f830 msgr2=0x7f462810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:16.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 -- 10.20.193.4:0/3859039193 shutdown_connections 2026-02-24T09:09:16.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:16.754+0000 7f462eeb7640 1 -- 10.20.193.4:0/3859039193 wait complete. 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: Deploying daemon mds.e on trial014 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: Deploying daemon mds.f on trial090 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.14:6834/4114810438,v1:10.20.193.14:6835/4114810438] up:boot 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.90:6834/1296342299,v1:10.20.193.90:6835/1296342299] up:boot 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: fsmap 6 up:standby 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-24T09:09:16.976 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:16 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3859039193' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: Deploying daemon mds.e on trial014 2026-02-24T09:09:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: Deploying daemon mds.f on trial090 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:17.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:17.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:17.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.14:6834/4114810438,v1:10.20.193.14:6835/4114810438] up:boot 2026-02-24T09:09:17.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.90:6834/1296342299,v1:10.20.193.90:6835/1296342299] up:boot 2026-02-24T09:09:17.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: fsmap 6 up:standby 2026-02-24T09:09:17.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-24T09:09:17.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-24T09:09:17.095 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:16 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3859039193' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: Deploying daemon mds.e on trial014 2026-02-24T09:09:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: Deploying daemon mds.f on trial090 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:17.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:17.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:17.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.14:6834/4114810438,v1:10.20.193.14:6835/4114810438] up:boot 2026-02-24T09:09:17.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.90:6834/1296342299,v1:10.20.193.90:6835/1296342299] up:boot 2026-02-24T09:09:17.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: fsmap 6 up:standby 2026-02-24T09:09:17.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-24T09:09:17.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-24T09:09:17.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:16 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3859039193' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:17.333 INFO:journalctl@ceph.mds.c.trial090.stdout:Feb 24 09:09:17 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-c[101071]: starting mds.c at 2026-02-24T09:09:18.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:17 trial014 ceph-mon[46941]: Deploying daemon mds.c on trial090 2026-02-24T09:09:18.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:17 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:18.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:17 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:18.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:17 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:18.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:17 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:18.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:17 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:18.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:17 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:18.094 INFO:journalctl@ceph.mds.h.trial014.stdout:Feb 24 09:09:17 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-h[98749]: starting mds.h at 2026-02-24T09:09:18.108 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:17 trial090 ceph-mon[47278]: Deploying daemon mds.c on trial090 2026-02-24T09:09:18.108 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:17 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:18.109 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:17 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:18.109 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:17 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:18.109 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:17 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:18.109 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:17 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:18.109 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:17 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:18.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:17 trial004 ceph-mon[41596]: Deploying daemon mds.c on trial090 2026-02-24T09:09:18.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:17 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:18.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:17 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:18.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:17 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:18.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:17 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:18.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:17 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:18.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:17 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:18.797 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:18.833 INFO:journalctl@ceph.mds.i.trial090.stdout:Feb 24 09:09:18 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-i[101407]: starting mds.i at 2026-02-24T09:09:18.928 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: Deploying daemon mds.h on trial014 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] up:boot 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: fsmap 7 up:standby 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:19.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:18 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:19.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.064+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/4082913616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f2410f280 msgr2=0x7f2f2410f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:19.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.064+0000 7f2f2b4ed640 1 --2- 10.20.193.4:0/4082913616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f2410f280 0x7f2f2410f650 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=11924965168824805556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f14009890 tx=0x7f2f1402f0e0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.064+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/4082913616 shutdown_connections 2026-02-24T09:09:19.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.064+0000 7f2f2b4ed640 1 --2- 10.20.193.4:0/4082913616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f24115470 0x7f2f24175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.064+0000 7f2f2b4ed640 1 --2- 10.20.193.4:0/4082913616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f2410fc70 0x7f2f24114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.064+0000 7f2f2b4ed640 1 --2- 10.20.193.4:0/4082913616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f2410f280 0x7f2f2410f650 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=11924965168824805556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.064+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/4082913616 >> 10.20.193.4:0/4082913616 conn(0x7f2f2405f830 msgr2=0x7f2f2410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:19.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.064+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/4082913616 shutdown_connections 2026-02-24T09:09:19.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.064+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/4082913616 wait complete. 2026-02-24T09:09:19.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f2b4ed640 1 Processor -- start 2026-02-24T09:09:19.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f2b4ed640 1 -- start start 2026-02-24T09:09:19.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f2b4ed640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f2410f280 0x7f2f2411db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:19.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f2b4ed640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f2410fc70 0x7f2f2411e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:19.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f2b4ed640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f24115470 0x7f2f24123470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:19.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f2b4ed640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24123a90 con 0x7f2f24115470 2026-02-24T09:09:19.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f2b4ed640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24123c00 con 0x7f2f2410f280 2026-02-24T09:09:19.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f2b4ed640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24123dc0 con 0x7f2f2410fc70 2026-02-24T09:09:19.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29a63640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f24115470 0x7f2f24123470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:19.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29a63640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f24115470 0x7f2f24123470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33418/0 (socket says 10.20.193.4:33418) 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29a63640 1 -- 10.20.193.4:0/622226701 learned_addr learned my addr 10.20.193.4:0/622226701 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f28a61640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f2410fc70 0x7f2f2411e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29262640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f2410f280 0x7f2f2411db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29a63640 1 -- 10.20.193.4:0/622226701 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f2410fc70 msgr2=0x7f2f2411e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29a63640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f2410fc70 0x7f2f2411e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29a63640 1 -- 10.20.193.4:0/622226701 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f2410f280 msgr2=0x7f2f2411db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29a63640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f2410f280 0x7f2f2411db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29a63640 1 -- 10.20.193.4:0/622226701 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f140094b0 con 0x7f2f24115470 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29262640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f2410f280 0x7f2f2411db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f29a63640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f24115470 0x7f2f24123470 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f2000f8d0 tx=0x7f2f2000fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f127fc640 1 -- 10.20.193.4:0/622226701 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f2000dce0 con 0x7f2f24115470 2026-02-24T09:09:19.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/622226701 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f241240a0 con 0x7f2f24115470 2026-02-24T09:09:19.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f127fc640 1 -- 10.20.193.4:0/622226701 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2f2000de40 con 0x7f2f24115470 2026-02-24T09:09:19.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f127fc640 1 -- 10.20.193.4:0/622226701 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f200116b0 con 0x7f2f24115470 2026-02-24T09:09:19.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.065+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/622226701 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f241647a0 con 0x7f2f24115470 2026-02-24T09:09:19.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.066+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/622226701 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f24110560 con 0x7f2f24115470 2026-02-24T09:09:19.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.067+0000 7f2f127fc640 1 -- 10.20.193.4:0/622226701 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f2f20020060 con 0x7f2f24115470 2026-02-24T09:09:19.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.068+0000 7f2f127fc640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f000b56e0 0x7f2f000d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:19.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.068+0000 7f2f29262640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f000b56e0 0x7f2f000d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:19.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.068+0000 7f2f127fc640 1 -- 10.20.193.4:0/622226701 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f2f20015070 con 0x7f2f24115470 2026-02-24T09:09:19.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.068+0000 7f2f29262640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f000b56e0 0x7f2f000d5b90 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f140023d0 tx=0x7f2f1402ff90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:19.072 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.069+0000 7f2f127fc640 1 -- 10.20.193.4:0/622226701 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f2f200aa770 con 0x7f2f24115470 2026-02-24T09:09:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: Deploying daemon mds.h on trial014 2026-02-24T09:09:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] up:boot 2026-02-24T09:09:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: fsmap 7 up:standby 2026-02-24T09:09:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:09:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:19.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:19.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:19.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:19.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:19.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:18 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:19.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.205+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/622226701 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f2410f650 con 0x7f2f24115470 2026-02-24T09:09:19.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.205+0000 7f2f127fc640 1 -- 10.20.193.4:0/622226701 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+8023 (secure 0 0 0) 0x7f2f200ad920 con 0x7f2f24115470 2026-02-24T09:09:19.208 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:19.208 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":7,"btime":"2026-02-24T09:09:18:836632+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24596,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2026-02-24T09:09:19.208 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 7 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/622226701 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f000b56e0 msgr2=0x7f2f000d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f000b56e0 0x7f2f000d5b90 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f140023d0 tx=0x7f2f1402ff90 comp rx=0 tx=0).stop 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/622226701 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f24115470 msgr2=0x7f2f24123470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f24115470 0x7f2f24123470 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f2000f8d0 tx=0x7f2f2000fda0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/622226701 shutdown_connections 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2f000b56e0 0x7f2f000d5b90 unknown :-1 s=CLOSED pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2f24115470 0x7f2f24123470 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f2410fc70 0x7f2f2411e0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 --2- 10.20.193.4:0/622226701 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2f2410f280 0x7f2f2411db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/622226701 >> 10.20.193.4:0/622226701 conn(0x7f2f2405f830 msgr2=0x7f2f2410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/622226701 shutdown_connections 2026-02-24T09:09:19.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:19.208+0000 7f2f2b4ed640 1 -- 10.20.193.4:0/622226701 wait complete. 2026-02-24T09:09:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: Deploying daemon mds.h on trial014 2026-02-24T09:09:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] up:boot 2026-02-24T09:09:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: fsmap 7 up:standby 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:19.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:19.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:18 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:19.464 INFO:journalctl@ceph.mds.g.trial004.stdout:Feb 24 09:09:19 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-g[108500]: starting mds.g at 2026-02-24T09:09:20.205 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: Deploying daemon mds.i on trial090 2026-02-24T09:09:20.205 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: Deploying daemon mds.g on trial004 2026-02-24T09:09:20.205 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.14:6836/524790199,v1:10.20.193.14:6837/524790199] up:boot 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] up:boot 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: fsmap 9 up:standby 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/622226701' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:20.206 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:19 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:20.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: Deploying daemon mds.i on trial090 2026-02-24T09:09:20.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: Deploying daemon mds.g on trial004 2026-02-24T09:09:20.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.14:6836/524790199,v1:10.20.193.14:6837/524790199] up:boot 2026-02-24T09:09:20.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] up:boot 2026-02-24T09:09:20.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: fsmap 9 up:standby 2026-02-24T09:09:20.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:09:20.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:09:20.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/622226701' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:20.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:20.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:20.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:20.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:20.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:20.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:20.216 INFO:journalctl@ceph.mds.a.trial004.stdout:Feb 24 09:09:19 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-a[108838]: starting mds.a at 2026-02-24T09:09:20.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: Deploying daemon mds.i on trial090 2026-02-24T09:09:20.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: Deploying daemon mds.g on trial004 2026-02-24T09:09:20.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.14:6836/524790199,v1:10.20.193.14:6837/524790199] up:boot 2026-02-24T09:09:20.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] up:boot 2026-02-24T09:09:20.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: fsmap 9 up:standby 2026-02-24T09:09:20.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:09:20.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:09:20.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/622226701' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:20.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:20.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:20.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:20.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:20.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:20.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:19 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:20.843 INFO:journalctl@ceph.mds.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-b[99086]: starting mds.b at 2026-02-24T09:09:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: Deploying daemon mds.a on trial004 2026-02-24T09:09:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.4:6838/1186492308,v1:10.20.193.4:6839/1186492308] up:boot 2026-02-24T09:09:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: fsmap 10 up:standby 2026-02-24T09:09:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-24T09:09:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:21.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:21.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:20 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.252 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: Deploying daemon mds.a on trial004 2026-02-24T09:09:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.4:6838/1186492308,v1:10.20.193.4:6839/1186492308] up:boot 2026-02-24T09:09:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: fsmap 10 up:standby 2026-02-24T09:09:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-24T09:09:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:21.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:20 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: Deploying daemon mds.a on trial004 2026-02-24T09:09:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.4:6838/1186492308,v1:10.20.193.4:6839/1186492308] up:boot 2026-02-24T09:09:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: fsmap 10 up:standby 2026-02-24T09:09:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-24T09:09:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-24T09:09:21.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-24T09:09:21.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:21.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:21.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:20 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.384 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:21.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 -- 10.20.193.4:0/132362309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e1810f280 msgr2=0x7f2e1810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:21.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 --2- 10.20.193.4:0/132362309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e1810f280 0x7f2e1810f650 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=8444260667769159924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e10009950 tx=0x7f2e1002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 -- 10.20.193.4:0/132362309 shutdown_connections 2026-02-24T09:09:21.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 --2- 10.20.193.4:0/132362309 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e18115470 0x7f2e18175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 --2- 10.20.193.4:0/132362309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e1810fc70 0x7f2e18114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 --2- 10.20.193.4:0/132362309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e1810f280 0x7f2e1810f650 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=8444260667769159924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 -- 10.20.193.4:0/132362309 >> 10.20.193.4:0/132362309 conn(0x7f2e1805f830 msgr2=0x7f2e1810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:21.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 -- 10.20.193.4:0/132362309 shutdown_connections 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 -- 10.20.193.4:0/132362309 wait complete. 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 Processor -- start 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 -- start start 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e1810f280 0x7f2e1811dc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e1810fc70 0x7f2e1811e190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e18115470 0x7f2e18123560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2e18123b80 con 0x7f2e1810f280 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2e18123cf0 con 0x7f2e18115470 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e20840640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2e18123eb0 con 0x7f2e1810fc70 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e1e5b5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e1810f280 0x7f2e1811dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:21.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e1e5b5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e1810f280 0x7f2e1811dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33486/0 (socket says 10.20.193.4:33486) 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e1e5b5640 1 -- 10.20.193.4:0/3398114398 learned_addr learned my addr 10.20.193.4:0/3398114398 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e1e5b5640 1 -- 10.20.193.4:0/3398114398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e1810fc70 msgr2=0x7f2e1811e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e1e5b5640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e1810fc70 0x7f2e1811e190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e1e5b5640 1 -- 10.20.193.4:0/3398114398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e18115470 msgr2=0x7f2e18123560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e1e5b5640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e18115470 0x7f2e18123560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.487+0000 7f2e1e5b5640 1 -- 10.20.193.4:0/3398114398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e10009570 con 0x7f2e1810f280 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.488+0000 7f2e1e5b5640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e1810f280 0x7f2e1811dc50 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e10038820 tx=0x7f2e10004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.488+0000 7f2e037fe640 1 -- 10.20.193.4:0/3398114398 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e1003d070 con 0x7f2e1810f280 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.488+0000 7f2e037fe640 1 -- 10.20.193.4:0/3398114398 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2e10002ad0 con 0x7f2e1810f280 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.488+0000 7f2e20840640 1 -- 10.20.193.4:0/3398114398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e18124130 con 0x7f2e1810f280 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.488+0000 7f2e037fe640 1 -- 10.20.193.4:0/3398114398 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e10041940 con 0x7f2e1810f280 2026-02-24T09:09:21.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.488+0000 7f2e20840640 1 -- 10.20.193.4:0/3398114398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e18164890 con 0x7f2e1810f280 2026-02-24T09:09:21.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.488+0000 7f2e20840640 1 -- 10.20.193.4:0/3398114398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e18110560 con 0x7f2e1810f280 2026-02-24T09:09:21.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.489+0000 7f2e037fe640 1 -- 10.20.193.4:0/3398114398 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f2e10041ad0 con 0x7f2e1810f280 2026-02-24T09:09:21.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.490+0000 7f2e037fe640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2df40b5760 0x7f2df40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:21.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.490+0000 7f2e1ddb4640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2df40b5760 0x7f2df40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:21.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.490+0000 7f2e037fe640 1 -- 10.20.193.4:0/3398114398 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f2e1010b350 con 0x7f2e1810f280 2026-02-24T09:09:21.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.490+0000 7f2e1ddb4640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2df40b5760 0x7f2df40d5c10 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e04005970 tx=0x7f2e04005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:21.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.491+0000 7f2e037fe640 1 -- 10.20.193.4:0/3398114398 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f2e100ce160 con 0x7f2e1810f280 2026-02-24T09:09:21.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.622+0000 7f2e20840640 1 -- 10.20.193.4:0/3398114398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e1810f650 con 0x7f2e1810f280 2026-02-24T09:09:21.625 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.623+0000 7f2e037fe640 1 -- 10.20.193.4:0/3398114398 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+10492 (secure 0 0 0) 0x7f2e100d1310 con 0x7f2e1810f280 2026-02-24T09:09:21.625 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:21.625 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":9,"btime":"2026-02-24T09:09:20:845554+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24596,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24620,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2026-02-24T09:09:21.626 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 9 2026-02-24T09:09:21.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 -- 10.20.193.4:0/3398114398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2df40b5760 msgr2=0x7f2df40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:21.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2df40b5760 0x7f2df40d5c10 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e04005970 tx=0x7f2e04005900 comp rx=0 tx=0).stop 2026-02-24T09:09:21.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 -- 10.20.193.4:0/3398114398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e1810f280 msgr2=0x7f2e1811dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:21.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e1810f280 0x7f2e1811dc50 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e10038820 tx=0x7f2e10004300 comp rx=0 tx=0).stop 2026-02-24T09:09:21.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 -- 10.20.193.4:0/3398114398 shutdown_connections 2026-02-24T09:09:21.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2df40b5760 0x7f2df40d5c10 unknown :-1 s=CLOSED pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e18115470 0x7f2e18123560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e1810fc70 0x7f2e1811e190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 --2- 10.20.193.4:0/3398114398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e1810f280 0x7f2e1811dc50 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 -- 10.20.193.4:0/3398114398 >> 10.20.193.4:0/3398114398 conn(0x7f2e1805f830 msgr2=0x7f2e1810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:21.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 -- 10.20.193.4:0/3398114398 shutdown_connections 2026-02-24T09:09:21.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.624+0000 7f2e20840640 1 -- 10.20.193.4:0/3398114398 wait complete. 2026-02-24T09:09:21.668 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-24T09:09:21.786 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:21.881 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: Deploying daemon mds.b on trial014 2026-02-24T09:09:21.881 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.4:6840/1594740511,v1:10.20.193.4:6841/1594740511] up:boot 2026-02-24T09:09:21.881 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] up:boot 2026-02-24T09:09:21.881 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: fsmap 12 up:standby 2026-02-24T09:09:21.881 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:21.882 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3398114398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:21.883 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:21 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:21.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.897+0000 7f3cf6452640 1 -- 10.20.193.4:0/4088801511 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3cf010ebd0 msgr2=0x7f3cf0153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:21.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.897+0000 7f3cf6452640 1 --2- 10.20.193.4:0/4088801511 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3cf010ebd0 0x7f3cf0153250 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=9796457265535785192 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ce0009950 tx=0x7f3ce002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.897+0000 7f3cf6452640 1 -- 10.20.193.4:0/4088801511 shutdown_connections 2026-02-24T09:09:21.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.897+0000 7f3cf6452640 1 --2- 10.20.193.4:0/4088801511 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3cf0153790 0x7f3cf0173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.897+0000 7f3cf6452640 1 --2- 10.20.193.4:0/4088801511 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3cf010ebd0 0x7f3cf0153250 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=9796457265535785192 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.897+0000 7f3cf6452640 1 --2- 10.20.193.4:0/4088801511 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cf010e1e0 0x7f3cf010e5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.897+0000 7f3cf6452640 1 -- 10.20.193.4:0/4088801511 >> 10.20.193.4:0/4088801511 conn(0x7f3cf00e9bf0 msgr2=0x7f3cf010a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:21.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.897+0000 7f3cf6452640 1 -- 10.20.193.4:0/4088801511 shutdown_connections 2026-02-24T09:09:21.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.897+0000 7f3cf6452640 1 -- 10.20.193.4:0/4088801511 wait complete. 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.897+0000 7f3cf6452640 1 Processor -- start 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cf6452640 1 -- start start 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cf6452640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3cf010e1e0 0x7f3cf0162190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cf6452640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3cf010ebd0 0x7f3cf01626d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cf6452640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cf0153790 0x7f3cf0167aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cf6452640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01680c0 con 0x7f3cf010ebd0 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cf6452640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf0168230 con 0x7f3cf010e1e0 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cf6452640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf01683f0 con 0x7f3cf0153790 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cef7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3cf010ebd0 0x7f3cf01626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cef7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3cf010ebd0 0x7f3cf01626d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33496/0 (socket says 10.20.193.4:33496) 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cef7fe640 1 -- 10.20.193.4:0/2192599147 learned_addr learned my addr 10.20.193.4:0/2192599147 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:21.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cf49c8640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cf0153790 0x7f3cf0167aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3ceffff640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3cf010e1e0 0x7f3cf0162190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cef7fe640 1 -- 10.20.193.4:0/2192599147 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cf0153790 msgr2=0x7f3cf0167aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cef7fe640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cf0153790 0x7f3cf0167aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cef7fe640 1 -- 10.20.193.4:0/2192599147 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3cf010e1e0 msgr2=0x7f3cf0162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cef7fe640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3cf010e1e0 0x7f3cf0162190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cef7fe640 1 -- 10.20.193.4:0/2192599147 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce0009570 con 0x7f3cf010ebd0 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cef7fe640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3cf010ebd0 0x7f3cf01626d0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ce00023d0 tx=0x7f3ce00043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3ced7fa640 1 -- 10.20.193.4:0/2192599147 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ce003d070 con 0x7f3cf010ebd0 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cf6452640 1 -- 10.20.193.4:0/2192599147 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf0168670 con 0x7f3cf010ebd0 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3ced7fa640 1 -- 10.20.193.4:0/2192599147 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3ce0038920 con 0x7f3cf010ebd0 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3ced7fa640 1 -- 10.20.193.4:0/2192599147 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ce00419d0 con 0x7f3cf010ebd0 2026-02-24T09:09:21.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.898+0000 7f3cf6452640 1 -- 10.20.193.4:0/2192599147 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf014f390 con 0x7f3cf010ebd0 2026-02-24T09:09:21.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.899+0000 7f3cf6452640 1 -- 10.20.193.4:0/2192599147 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf0168940 con 0x7f3cf010ebd0 2026-02-24T09:09:21.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.900+0000 7f3ced7fa640 1 -- 10.20.193.4:0/2192599147 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f3ce0038a90 con 0x7f3cf010ebd0 2026-02-24T09:09:21.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.900+0000 7f3ced7fa640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3cc40b56e0 0x7f3cc40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:21.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.900+0000 7f3ced7fa640 1 -- 10.20.193.4:0/2192599147 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f3ce010b410 con 0x7f3cf010ebd0 2026-02-24T09:09:21.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.900+0000 7f3ceffff640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3cc40b56e0 0x7f3cc40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:21.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.901+0000 7f3ceffff640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3cc40b56e0 0x7f3cc40d5b90 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cdc005970 tx=0x7f3cdc005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:21.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:21.902+0000 7f3ced7fa640 1 -- 10.20.193.4:0/2192599147 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3ce00ce2f0 con 0x7f3cf010ebd0 2026-02-24T09:09:22.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.019+0000 7f3cf6452640 1 -- 10.20.193.4:0/2192599147 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3cf01632f0 con 0x7f3cf010ebd0 2026-02-24T09:09:22.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.019+0000 7f3ced7fa640 1 -- 10.20.193.4:0/2192599147 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f3ce00d1410 con 0x7f3cf010ebd0 2026-02-24T09:09:22.022 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:22.022 INFO:teuthology.orchestra.run.trial004.stdout:[ 2026-02-24T09:09:22.022 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:09:22.022 INFO:teuthology.orchestra.run.trial004.stdout: "poolnum": 1, 2026-02-24T09:09:22.022 INFO:teuthology.orchestra.run.trial004.stdout: "poolname": ".mgr" 2026-02-24T09:09:22.023 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:09:22.023 INFO:teuthology.orchestra.run.trial004.stdout:] 2026-02-24T09:09:22.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 -- 10.20.193.4:0/2192599147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3cc40b56e0 msgr2=0x7f3cc40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:22.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3cc40b56e0 0x7f3cc40d5b90 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3cdc005970 tx=0x7f3cdc005ed0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 -- 10.20.193.4:0/2192599147 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3cf010ebd0 msgr2=0x7f3cf01626d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:22.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3cf010ebd0 0x7f3cf01626d0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ce00023d0 tx=0x7f3ce00043d0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 -- 10.20.193.4:0/2192599147 shutdown_connections 2026-02-24T09:09:22.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3cc40b56e0 0x7f3cc40d5b90 unknown :-1 s=CLOSED pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3cf0153790 0x7f3cf0167aa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3cf010ebd0 0x7f3cf01626d0 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 --2- 10.20.193.4:0/2192599147 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3cf010e1e0 0x7f3cf0162190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 -- 10.20.193.4:0/2192599147 >> 10.20.193.4:0/2192599147 conn(0x7f3cf00e9bf0 msgr2=0x7f3cf0109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:22.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 -- 10.20.193.4:0/2192599147 shutdown_connections 2026-02-24T09:09:22.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.021+0000 7f3cf6452640 1 -- 10.20.193.4:0/2192599147 wait complete. 2026-02-24T09:09:22.062 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-24T09:09:22.062 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-24T09:09:22.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: Deploying daemon mds.b on trial014 2026-02-24T09:09:22.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.4:6840/1594740511,v1:10.20.193.4:6841/1594740511] up:boot 2026-02-24T09:09:22.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] up:boot 2026-02-24T09:09:22.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: fsmap 12 up:standby 2026-02-24T09:09:22.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-24T09:09:22.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:09:22.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:22.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:22.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:22.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3398114398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:22.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:21 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:22.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: Deploying daemon mds.b on trial014 2026-02-24T09:09:22.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.4:6840/1594740511,v1:10.20.193.4:6841/1594740511] up:boot 2026-02-24T09:09:22.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] up:boot 2026-02-24T09:09:22.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: fsmap 12 up:standby 2026-02-24T09:09:22.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-24T09:09:22.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:09:22.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:22.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:22.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:22.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:22.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3398114398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:22.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:21 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:09:22.186 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:22.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.289+0000 7f44ff0c5640 1 -- 10.20.193.4:0/2760847165 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44f80618c0 msgr2=0x7f44f8155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:22.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.289+0000 7f44ff0c5640 1 --2- 10.20.193.4:0/2760847165 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44f80618c0 0x7f44f8155210 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=15614525159312342575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44e0009950 tx=0x7f44e002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.289+0000 7f44ff0c5640 1 -- 10.20.193.4:0/2760847165 shutdown_connections 2026-02-24T09:09:22.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.289+0000 7f44ff0c5640 1 --2- 10.20.193.4:0/2760847165 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44f8155750 0x7f44f8175b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.289+0000 7f44ff0c5640 1 --2- 10.20.193.4:0/2760847165 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44f80618c0 0x7f44f8155210 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=15614525159312342575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.289+0000 7f44ff0c5640 1 --2- 10.20.193.4:0/2760847165 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44f8060fb0 0x7f44f8061380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.289+0000 7f44ff0c5640 1 -- 10.20.193.4:0/2760847165 >> 10.20.193.4:0/2760847165 conn(0x7f44f805f830 msgr2=0x7f44f810ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:22.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.289+0000 7f44ff0c5640 1 -- 10.20.193.4:0/2760847165 shutdown_connections 2026-02-24T09:09:22.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.289+0000 7f44ff0c5640 1 -- 10.20.193.4:0/2760847165 wait complete. 2026-02-24T09:09:22.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44ff0c5640 1 Processor -- start 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44ff0c5640 1 -- start start 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44ff0c5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44f8060fb0 0x7f44f8161ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44ff0c5640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44f80618c0 0x7f44f8162420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44ff0c5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44f8155750 0x7f44f81677f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44ff0c5640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8167e10 con 0x7f44f8060fb0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44ff0c5640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8167f80 con 0x7f44f80618c0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44ff0c5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8168140 con 0x7f44f8155750 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fce3a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44f8060fb0 0x7f44f8161ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fce3a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44f8060fb0 0x7f44f8161ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33512/0 (socket says 10.20.193.4:33512) 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fce3a640 1 -- 10.20.193.4:0/659254360 learned_addr learned my addr 10.20.193.4:0/659254360 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44effff640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44f80618c0 0x7f44f8162420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fd63b640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44f8155750 0x7f44f81677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fce3a640 1 -- 10.20.193.4:0/659254360 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44f8155750 msgr2=0x7f44f81677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fce3a640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44f8155750 0x7f44f81677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fce3a640 1 -- 10.20.193.4:0/659254360 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44f80618c0 msgr2=0x7f44f8162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fce3a640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44f80618c0 0x7f44f8162420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fce3a640 1 -- 10.20.193.4:0/659254360 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e0009570 con 0x7f44f8060fb0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fd63b640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44f8155750 0x7f44f81677f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44fce3a640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44f8060fb0 0x7f44f8161ee0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44e800d950 tx=0x7f44e800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44edffb640 1 -- 10.20.193.4:0/659254360 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44e8004540 con 0x7f44f8060fb0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44ff0c5640 1 -- 10.20.193.4:0/659254360 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f8168420 con 0x7f44f8060fb0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44edffb640 1 -- 10.20.193.4:0/659254360 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f44e8009d00 con 0x7f44f8060fb0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44edffb640 1 -- 10.20.193.4:0/659254360 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44e80106e0 con 0x7f44f8060fb0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.290+0000 7f44ff0c5640 1 -- 10.20.193.4:0/659254360 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f81513f0 con 0x7f44f8060fb0 2026-02-24T09:09:22.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.291+0000 7f44ff0c5640 1 -- 10.20.193.4:0/659254360 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f80624c0 con 0x7f44f8060fb0 2026-02-24T09:09:22.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.292+0000 7f44edffb640 1 -- 10.20.193.4:0/659254360 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f44e80027c0 con 0x7f44f8060fb0 2026-02-24T09:09:22.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.293+0000 7f44edffb640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44d40b5760 0x7f44d40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:22.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.293+0000 7f44effff640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44d40b5760 0x7f44d40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:22.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.293+0000 7f44edffb640 1 -- 10.20.193.4:0/659254360 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f44e80e6dc0 con 0x7f44f8060fb0 2026-02-24T09:09:22.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.293+0000 7f44effff640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44d40b5760 0x7f44d40d5c10 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44e00023d0 tx=0x7f44e0031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:22.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.294+0000 7f44edffb640 1 -- 10.20.193.4:0/659254360 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f44e80a9c10 con 0x7f44f8060fb0 2026-02-24T09:09:22.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:22.400+0000 7f44ff0c5640 1 -- 10.20.193.4:0/659254360 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f44f81791f0 con 0x7f44f8060fb0 2026-02-24T09:09:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2192599147' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:23.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:22 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/659254360' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-24T09:09:23.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.246+0000 7f44edffb640 1 -- 10.20.193.4:0/659254360 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f44e80acdc0 con 0x7f44f8060fb0 2026-02-24T09:09:23.249 INFO:teuthology.orchestra.run.trial004.stderr:pool 'cephfs_metadata' created 2026-02-24T09:09:23.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.251+0000 7f44ff0c5640 1 -- 10.20.193.4:0/659254360 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44d40b5760 msgr2=0x7f44d40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:23.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.251+0000 7f44ff0c5640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44d40b5760 0x7f44d40d5c10 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44e00023d0 tx=0x7f44e0031040 comp rx=0 tx=0).stop 2026-02-24T09:09:23.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.251+0000 7f44ff0c5640 1 -- 10.20.193.4:0/659254360 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44f8060fb0 msgr2=0x7f44f8161ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:23.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.251+0000 7f44ff0c5640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44f8060fb0 0x7f44f8161ee0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44e800d950 tx=0x7f44e800de20 comp rx=0 tx=0).stop 2026-02-24T09:09:23.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.252+0000 7f44ff0c5640 1 -- 10.20.193.4:0/659254360 shutdown_connections 2026-02-24T09:09:23.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.252+0000 7f44ff0c5640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44d40b5760 0x7f44d40d5c10 unknown :-1 s=CLOSED pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:23.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.252+0000 7f44ff0c5640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44f8155750 0x7f44f81677f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:23.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.252+0000 7f44ff0c5640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44f80618c0 0x7f44f8162420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:23.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.252+0000 7f44ff0c5640 1 --2- 10.20.193.4:0/659254360 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44f8060fb0 0x7f44f8161ee0 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:23.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.252+0000 7f44ff0c5640 1 -- 10.20.193.4:0/659254360 >> 10.20.193.4:0/659254360 conn(0x7f44f805f830 msgr2=0x7f44f810ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:23.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.252+0000 7f44ff0c5640 1 -- 10.20.193.4:0/659254360 shutdown_connections 2026-02-24T09:09:23.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.252+0000 7f44ff0c5640 1 -- 10.20.193.4:0/659254360 wait complete. 2026-02-24T09:09:23.314 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-24T09:09:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2192599147' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-24T09:09:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:22 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/659254360' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-24T09:09:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2192599147' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-24T09:09:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:09:23.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:09:23.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:09:23.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:09:23.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:22 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/659254360' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-24T09:09:23.431 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:23.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.533+0000 7efe0e668640 1 -- 10.20.193.4:0/230948226 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efe0810f280 msgr2=0x7efe0810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:23.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.533+0000 7efe0e668640 1 --2- 10.20.193.4:0/230948226 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efe0810f280 0x7efe0810f650 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=16418146990459880087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf4009950 tx=0x7efdf402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:23.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.533+0000 7efe0e668640 1 -- 10.20.193.4:0/230948226 shutdown_connections 2026-02-24T09:09:23.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 --2- 10.20.193.4:0/230948226 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efe08115470 0x7efe08175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:23.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 --2- 10.20.193.4:0/230948226 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efe0810fc70 0x7efe08114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:23.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 --2- 10.20.193.4:0/230948226 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efe0810f280 0x7efe0810f650 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=16418146990459880087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:23.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 -- 10.20.193.4:0/230948226 >> 10.20.193.4:0/230948226 conn(0x7efe0805f830 msgr2=0x7efe0810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:23.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 -- 10.20.193.4:0/230948226 shutdown_connections 2026-02-24T09:09:23.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 -- 10.20.193.4:0/230948226 wait complete. 2026-02-24T09:09:23.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 Processor -- start 2026-02-24T09:09:23.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 -- start start 2026-02-24T09:09:23.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efe0810f280 0x7efe08066fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efe0810fc70 0x7efe08063220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efe08115470 0x7efe080638d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7efe08063fd0 con 0x7efe0810f280 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7efe081683d0 con 0x7efe08115470 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe0e668640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7efe08168590 con 0x7efe0810fc70 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe07fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efe0810f280 0x7efe08066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe07fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efe0810f280 0x7efe08066fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42700/0 (socket says 10.20.193.4:42700) 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe07fff640 1 -- 10.20.193.4:0/345848234 learned_addr learned my addr 10.20.193.4:0/345848234 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe077fe640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efe0810fc70 0x7efe08063220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe07fff640 1 -- 10.20.193.4:0/345848234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efe0810fc70 msgr2=0x7efe08063220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:23.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe07fff640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efe0810fc70 0x7efe08063220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:23.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe07fff640 1 -- 10.20.193.4:0/345848234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efe08115470 msgr2=0x7efe080638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:23.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe07fff640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efe08115470 0x7efe080638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:23.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe07fff640 1 -- 10.20.193.4:0/345848234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf4009570 con 0x7efe0810f280 2026-02-24T09:09:23.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.534+0000 7efe07fff640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efe0810f280 0x7efe08066fb0 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf40023d0 tx=0x7efdf40043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:23.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.535+0000 7efe057fa640 1 -- 10.20.193.4:0/345848234 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdf403d070 con 0x7efe0810f280 2026-02-24T09:09:23.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.535+0000 7efe057fa640 1 -- 10.20.193.4:0/345848234 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efdf4038920 con 0x7efe0810f280 2026-02-24T09:09:23.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.535+0000 7efe0e668640 1 -- 10.20.193.4:0/345848234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe08168810 con 0x7efe0810f280 2026-02-24T09:09:23.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.535+0000 7efe057fa640 1 -- 10.20.193.4:0/345848234 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdf40419d0 con 0x7efe0810f280 2026-02-24T09:09:23.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.535+0000 7efe0e668640 1 -- 10.20.193.4:0/345848234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe08168c80 con 0x7efe0810f280 2026-02-24T09:09:23.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.535+0000 7efe0e668640 1 -- 10.20.193.4:0/345848234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe08110560 con 0x7efe0810f280 2026-02-24T09:09:23.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.536+0000 7efe057fa640 1 -- 10.20.193.4:0/345848234 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7efdf4038a90 con 0x7efe0810f280 2026-02-24T09:09:23.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.537+0000 7efe057fa640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efddc0b56e0 0x7efddc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:23.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.537+0000 7efe057fa640 1 -- 10.20.193.4:0/345848234 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7492+0+0 (secure 0 0 0) 0x7efdf410b640 con 0x7efe0810f280 2026-02-24T09:09:23.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.537+0000 7efe077fe640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efddc0b56e0 0x7efddc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:23.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.537+0000 7efe077fe640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efddc0b56e0 0x7efddc0d5b90 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf8005970 tx=0x7efdf8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:23.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.538+0000 7efe057fa640 1 -- 10.20.193.4:0/345848234 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7efdf40ce3a0 con 0x7efe0810f280 2026-02-24T09:09:23.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:23.645+0000 7efe0e668640 1 -- 10.20.193.4:0/345848234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efe08064520 con 0x7efe0810f280 2026-02-24T09:09:24.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.248+0000 7efe057fa640 1 -- 10.20.193.4:0/345848234 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7efdf40d14c0 con 0x7efe0810f280 2026-02-24T09:09:24.251 INFO:teuthology.orchestra.run.trial004.stderr:pool 'cephfs_data' created 2026-02-24T09:09:24.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.251+0000 7efe0e668640 1 -- 10.20.193.4:0/345848234 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efddc0b56e0 msgr2=0x7efddc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:24.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.251+0000 7efe0e668640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efddc0b56e0 0x7efddc0d5b90 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf8005970 tx=0x7efdf8005900 comp rx=0 tx=0).stop 2026-02-24T09:09:24.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.251+0000 7efe0e668640 1 -- 10.20.193.4:0/345848234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efe0810f280 msgr2=0x7efe08066fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:24.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.251+0000 7efe0e668640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efe0810f280 0x7efe08066fb0 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf40023d0 tx=0x7efdf40043d0 comp rx=0 tx=0).stop 2026-02-24T09:09:24.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.251+0000 7efe0e668640 1 -- 10.20.193.4:0/345848234 shutdown_connections 2026-02-24T09:09:24.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.251+0000 7efe0e668640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efddc0b56e0 0x7efddc0d5b90 unknown :-1 s=CLOSED pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:24.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.251+0000 7efe0e668640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efe08115470 0x7efe080638d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:24.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.251+0000 7efe0e668640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efe0810fc70 0x7efe08063220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:24.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.251+0000 7efe0e668640 1 --2- 10.20.193.4:0/345848234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efe0810f280 0x7efe08066fb0 unknown :-1 s=CLOSED pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:24.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.252+0000 7efe0e668640 1 -- 10.20.193.4:0/345848234 >> 10.20.193.4:0/345848234 conn(0x7efe0805f830 msgr2=0x7efe0810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:24.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.252+0000 7efe0e668640 1 -- 10.20.193.4:0/345848234 shutdown_connections 2026-02-24T09:09:24.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.252+0000 7efe0e668640 1 -- 10.20.193.4:0/345848234 wait complete. 2026-02-24T09:09:24.297 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-24T09:09:24.413 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:24.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 -- 10.20.193.4:0/2493216882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a6c115840 msgr2=0x7f3a6c176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:24.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 --2- 10.20.193.4:0/2493216882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a6c115840 0x7f3a6c176210 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=7345937675858434818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a5c00aa30 tx=0x7f3a5c030280 comp rx=0 tx=0).stop 2026-02-24T09:09:24.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 -- 10.20.193.4:0/2493216882 shutdown_connections 2026-02-24T09:09:24.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 --2- 10.20.193.4:0/2493216882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a6c115840 0x7f3a6c176210 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=7345937675858434818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:24.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 --2- 10.20.193.4:0/2493216882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a6c110040 0x7f3a6c115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:24.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 --2- 10.20.193.4:0/2493216882 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a6c10f650 0x7f3a6c10fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:24.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 -- 10.20.193.4:0/2493216882 >> 10.20.193.4:0/2493216882 conn(0x7f3a6c0ecf20 msgr2=0x7f3a6c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:24.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 -- 10.20.193.4:0/2493216882 shutdown_connections 2026-02-24T09:09:24.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 -- 10.20.193.4:0/2493216882 wait complete. 2026-02-24T09:09:24.520 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:24 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/659254360' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-24T09:09:24.520 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:24 trial004 ceph-mon[41596]: osdmap e72: 12 total, 12 up, 12 in 2026-02-24T09:09:24.520 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:24 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/345848234' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-24T09:09:24.520 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:24 trial004 ceph-mon[41596]: pgmap v133: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 Processor -- start 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 -- start start 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a6c10f650 0x7f3a6c11deb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a6c110040 0x7f3a6c11e3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.517+0000 7f3a7171b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a6c115840 0x7f3a6c1237c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a7171b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c123de0 con 0x7f3a6c115840 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a7171b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c123f50 con 0x7f3a6c10f650 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a7171b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c124110 con 0x7f3a6c110040 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a6c115840 0x7f3a6c1237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a6c115840 0x7f3a6c1237c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42712/0 (socket says 10.20.193.4:42712) 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6b7fe640 1 -- 10.20.193.4:0/354012515 learned_addr learned my addr 10.20.193.4:0/354012515 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6a7fc640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a6c110040 0x7f3a6c11e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6affd640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a6c10f650 0x7f3a6c11deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6b7fe640 1 -- 10.20.193.4:0/354012515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a6c110040 msgr2=0x7f3a6c11e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6b7fe640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a6c110040 0x7f3a6c11e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6b7fe640 1 -- 10.20.193.4:0/354012515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a6c10f650 msgr2=0x7f3a6c11deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6b7fe640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a6c10f650 0x7f3a6c11deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6b7fe640 1 -- 10.20.193.4:0/354012515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c00a650 con 0x7f3a6c115840 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a6b7fe640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a6c115840 0x7f3a6c1237c0 secure :-1 s=READY pgs=232 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a5c00a330 tx=0x7f3a5c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a4bfff640 1 -- 10.20.193.4:0/354012515 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a5c03e070 con 0x7f3a6c115840 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a4bfff640 1 -- 10.20.193.4:0/354012515 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a5c0055a0 con 0x7f3a6c115840 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a7171b640 1 -- 10.20.193.4:0/354012515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6c124390 con 0x7f3a6c115840 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a4bfff640 1 -- 10.20.193.4:0/354012515 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a5c042910 con 0x7f3a6c115840 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.518+0000 7f3a7171b640 1 -- 10.20.193.4:0/354012515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6c164950 con 0x7f3a6c115840 2026-02-24T09:09:24.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.519+0000 7f3a7171b640 1 -- 10.20.193.4:0/354012515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6c110930 con 0x7f3a6c115840 2026-02-24T09:09:24.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.520+0000 7f3a4bfff640 1 -- 10.20.193.4:0/354012515 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f3a5c042b40 con 0x7f3a6c115840 2026-02-24T09:09:24.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.521+0000 7f3a4bfff640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a400b56e0 0x7f3a400d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:24.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.521+0000 7f3a6affd640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a400b56e0 0x7f3a400d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:24.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.521+0000 7f3a4bfff640 1 -- 10.20.193.4:0/354012515 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7877+0+0 (secure 0 0 0) 0x7f3a5c10cb10 con 0x7f3a6c115840 2026-02-24T09:09:24.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.521+0000 7f3a6affd640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a400b56e0 0x7f3a400d5b90 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a60004740 tx=0x7f3a6000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:24.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.521+0000 7f3a4bfff640 1 -- 10.20.193.4:0/354012515 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3a5c0cf6d0 con 0x7f3a6c115840 2026-02-24T09:09:24.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:24 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/659254360' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-24T09:09:24.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:24 trial090 ceph-mon[47278]: osdmap e72: 12 total, 12 up, 12 in 2026-02-24T09:09:24.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:24 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/345848234' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-24T09:09:24.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:24 trial090 ceph-mon[47278]: pgmap v133: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:24.592 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:24 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/659254360' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-24T09:09:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:24 trial014 ceph-mon[46941]: osdmap e72: 12 total, 12 up, 12 in 2026-02-24T09:09:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:24 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/345848234' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-24T09:09:24.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:24 trial014 ceph-mon[46941]: pgmap v133: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:24.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:24.651+0000 7f3a7171b640 1 -- 10.20.193.4:0/354012515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3a6c10fa20 con 0x7f3a6c115840 2026-02-24T09:09:25.267 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.263+0000 7f3a4bfff640 1 -- 10.20.193.4:0/354012515 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v10) ==== 172+0+0 (secure 0 0 0) 0x7f3a5c0d2880 con 0x7f3a6c115840 2026-02-24T09:09:25.267 INFO:teuthology.orchestra.run.trial004.stderr:new fs with metadata pool 2 and data pool 3 2026-02-24T09:09:25.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.266+0000 7f3a7171b640 1 -- 10.20.193.4:0/354012515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a400b56e0 msgr2=0x7f3a400d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:25.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.266+0000 7f3a7171b640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a400b56e0 0x7f3a400d5b90 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a60004740 tx=0x7f3a6000b410 comp rx=0 tx=0).stop 2026-02-24T09:09:25.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.266+0000 7f3a7171b640 1 -- 10.20.193.4:0/354012515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a6c115840 msgr2=0x7f3a6c1237c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:25.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.266+0000 7f3a7171b640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a6c115840 0x7f3a6c1237c0 secure :-1 s=READY pgs=232 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a5c00a330 tx=0x7f3a5c0039b0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.267+0000 7f3a7171b640 1 -- 10.20.193.4:0/354012515 shutdown_connections 2026-02-24T09:09:25.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.267+0000 7f3a7171b640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a400b56e0 0x7f3a400d5b90 unknown :-1 s=CLOSED pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.267+0000 7f3a7171b640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a6c115840 0x7f3a6c1237c0 unknown :-1 s=CLOSED pgs=232 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.267+0000 7f3a7171b640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a6c110040 0x7f3a6c11e3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.267+0000 7f3a7171b640 1 --2- 10.20.193.4:0/354012515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a6c10f650 0x7f3a6c11deb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.267+0000 7f3a7171b640 1 -- 10.20.193.4:0/354012515 >> 10.20.193.4:0/354012515 conn(0x7f3a6c0ecf20 msgr2=0x7f3a6c10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:25.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.267+0000 7f3a7171b640 1 -- 10.20.193.4:0/354012515 shutdown_connections 2026-02-24T09:09:25.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.267+0000 7f3a7171b640 1 -- 10.20.193.4:0/354012515 wait complete. 2026-02-24T09:09:25.307 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:09:25.444 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:25.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.538+0000 7f16fdf3d640 1 -- 10.20.193.4:0/4003864344 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16f810fc70 msgr2=0x7f16f8114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:25.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.538+0000 7f16fdf3d640 1 --2- 10.20.193.4:0/4003864344 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16f810fc70 0x7f16f8114cc0 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=8843292017671430942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e8009950 tx=0x7f16e802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.538+0000 7f16fdf3d640 1 -- 10.20.193.4:0/4003864344 shutdown_connections 2026-02-24T09:09:25.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.538+0000 7f16fdf3d640 1 --2- 10.20.193.4:0/4003864344 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16f8115470 0x7f16f8175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.538+0000 7f16fdf3d640 1 --2- 10.20.193.4:0/4003864344 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16f810fc70 0x7f16f8114cc0 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=8843292017671430942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.538+0000 7f16fdf3d640 1 --2- 10.20.193.4:0/4003864344 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16f810f280 0x7f16f810f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.538+0000 7f16fdf3d640 1 -- 10.20.193.4:0/4003864344 >> 10.20.193.4:0/4003864344 conn(0x7f16f805f830 msgr2=0x7f16f810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:25.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.538+0000 7f16fdf3d640 1 -- 10.20.193.4:0/4003864344 shutdown_connections 2026-02-24T09:09:25.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.538+0000 7f16fdf3d640 1 -- 10.20.193.4:0/4003864344 wait complete. 2026-02-24T09:09:25.543 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:25 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/345848234' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-24T09:09:25.543 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:25 trial004 ceph-mon[41596]: osdmap e73: 12 total, 12 up, 12 in 2026-02-24T09:09:25.543 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:25 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/354012515' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-24T09:09:25.543 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:25 trial004 ceph-mon[41596]: daemon mds.i assigned to filesystem cephfs as rank 0 2026-02-24T09:09:25.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.538+0000 7f16fdf3d640 1 Processor -- start 2026-02-24T09:09:25.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16fdf3d640 1 -- start start 2026-02-24T09:09:25.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16fdf3d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16f810f280 0x7f16f80f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:25.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16fdf3d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16f810fc70 0x7f16f8175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:25.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16fdf3d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16f8115470 0x7f16f80f5cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:25.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16fdf3d640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80faec0 con 0x7f16f810fc70 2026-02-24T09:09:25.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16fdf3d640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80fb030 con 0x7f16f8115470 2026-02-24T09:09:25.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16fdf3d640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80fb1f0 con 0x7f16f810f280 2026-02-24T09:09:25.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16f810fc70 0x7f16f8175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:25.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16f810fc70 0x7f16f8175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42728/0 (socket says 10.20.193.4:42728) 2026-02-24T09:09:25.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f6ffd640 1 -- 10.20.193.4:0/872972260 learned_addr learned my addr 10.20.193.4:0/872972260 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:25.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f77fe640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16f810f280 0x7f16f80f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:25.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f6ffd640 1 -- 10.20.193.4:0/872972260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16f810f280 msgr2=0x7f16f80f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:25.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f6ffd640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16f810f280 0x7f16f80f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f6ffd640 1 -- 10.20.193.4:0/872972260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16f8115470 msgr2=0x7f16f80f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f6ffd640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16f8115470 0x7f16f80f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f6ffd640 1 -- 10.20.193.4:0/872972260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e8009570 con 0x7f16f810fc70 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f6ffd640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16f810fc70 0x7f16f8175d40 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e8038820 tx=0x7f16e8004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f4ff9640 1 -- 10.20.193.4:0/872972260 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16e803d070 con 0x7f16f810fc70 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f4ff9640 1 -- 10.20.193.4:0/872972260 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16e8002ad0 con 0x7f16f810fc70 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16fdf3d640 1 -- 10.20.193.4:0/872972260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f80fb470 con 0x7f16f810fc70 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16f4ff9640 1 -- 10.20.193.4:0/872972260 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16e8041940 con 0x7f16f810fc70 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.539+0000 7f16fdf3d640 1 -- 10.20.193.4:0/872972260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f80fb930 con 0x7f16f810fc70 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.540+0000 7f16fdf3d640 1 -- 10.20.193.4:0/872972260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f8110560 con 0x7f16f810fc70 2026-02-24T09:09:25.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.541+0000 7f16f4ff9640 1 -- 10.20.193.4:0/872972260 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f16e8041ad0 con 0x7f16f810fc70 2026-02-24T09:09:25.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.542+0000 7f16f4ff9640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16cc0b5750 0x7f16cc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:25.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.542+0000 7f16f4ff9640 1 -- 10.20.193.4:0/872972260 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f16e810b720 con 0x7f16f810fc70 2026-02-24T09:09:25.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.542+0000 7f16f77fe640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16cc0b5750 0x7f16cc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:25.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.542+0000 7f16f77fe640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16cc0b5750 0x7f16cc0d5c00 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e4004740 tx=0x7f16e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:25.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.542+0000 7f16f4ff9640 1 -- 10.20.193.4:0/872972260 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f16e80ce210 con 0x7f16f810fc70 2026-02-24T09:09:25.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:25 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/345848234' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-24T09:09:25.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:25 trial090 ceph-mon[47278]: osdmap e73: 12 total, 12 up, 12 in 2026-02-24T09:09:25.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:25 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/354012515' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-24T09:09:25.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:25 trial090 ceph-mon[47278]: daemon mds.i assigned to filesystem cephfs as rank 0 2026-02-24T09:09:25.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:25 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/345848234' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-24T09:09:25.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:25 trial014 ceph-mon[46941]: osdmap e73: 12 total, 12 up, 12 in 2026-02-24T09:09:25.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:25 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/354012515' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-24T09:09:25.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:25 trial014 ceph-mon[46941]: daemon mds.i assigned to filesystem cephfs as rank 0 2026-02-24T09:09:25.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.647+0000 7f16fdf3d640 1 -- 10.20.193.4:0/872972260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16f80fbb50 con 0x7f16f810fc70 2026-02-24T09:09:25.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.648+0000 7f16f4ff9640 1 -- 10.20.193.4:0/872972260 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22244 (secure 0 0 0) 0x7f16e80d13c0 con 0x7f16f810fc70 2026-02-24T09:09:25.651 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:25.651 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":74,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:24.652551+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:25.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 -- 10.20.193.4:0/872972260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16cc0b5750 msgr2=0x7f16cc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:25.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16cc0b5750 0x7f16cc0d5c00 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e4004740 tx=0x7f16e4005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:25.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 -- 10.20.193.4:0/872972260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16f810fc70 msgr2=0x7f16f8175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:25.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16f810fc70 0x7f16f8175d40 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e8038820 tx=0x7f16e8004300 comp rx=0 tx=0).stop 2026-02-24T09:09:25.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 -- 10.20.193.4:0/872972260 shutdown_connections 2026-02-24T09:09:25.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16cc0b5750 0x7f16cc0d5c00 unknown :-1 s=CLOSED pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16f8115470 0x7f16f80f5cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16f810fc70 0x7f16f8175d40 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 --2- 10.20.193.4:0/872972260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16f810f280 0x7f16f80f55b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 -- 10.20.193.4:0/872972260 >> 10.20.193.4:0/872972260 conn(0x7f16f805f830 msgr2=0x7f16f8111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:25.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 -- 10.20.193.4:0/872972260 shutdown_connections 2026-02-24T09:09:25.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.649+0000 7f16fdf3d640 1 -- 10.20.193.4:0/872972260 wait complete. 2026-02-24T09:09:25.690 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:09:25.805 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.907+0000 7f238a40a640 1 -- 10.20.193.4:0/46936003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2384115470 msgr2=0x7f2384175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.907+0000 7f238a40a640 1 --2- 10.20.193.4:0/46936003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2384115470 0x7f2384175e40 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=17648700456594287028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f237800aa30 tx=0x7f2378030280 comp rx=0 tx=0).stop 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.907+0000 7f238a40a640 1 -- 10.20.193.4:0/46936003 shutdown_connections 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.907+0000 7f238a40a640 1 --2- 10.20.193.4:0/46936003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2384115470 0x7f2384175e40 unknown :-1 s=CLOSED pgs=235 gs=1 cs=0 l=1 c_cookie=17648700456594287028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.907+0000 7f238a40a640 1 --2- 10.20.193.4:0/46936003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f238410fc70 0x7f2384114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.907+0000 7f238a40a640 1 --2- 10.20.193.4:0/46936003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f238410f280 0x7f238410f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.907+0000 7f238a40a640 1 -- 10.20.193.4:0/46936003 >> 10.20.193.4:0/46936003 conn(0x7f238405f830 msgr2=0x7f238410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.907+0000 7f238a40a640 1 -- 10.20.193.4:0/46936003 shutdown_connections 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.907+0000 7f238a40a640 1 -- 10.20.193.4:0/46936003 wait complete. 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f238a40a640 1 Processor -- start 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f238a40a640 1 -- start start 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f238a40a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f238410f280 0x7f238411db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f238a40a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f238410fc70 0x7f238411e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f238a40a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2384115470 0x7f2384123480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f238a40a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2384123aa0 con 0x7f238410fc70 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f238a40a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2384123c10 con 0x7f238410f280 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f238a40a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2384123dd0 con 0x7f2384115470 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23837fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f238410fc70 0x7f238411e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:25.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23837fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f238410fc70 0x7f238411e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42740/0 (socket says 10.20.193.4:42740) 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23837fe640 1 -- 10.20.193.4:0/339627564 learned_addr learned my addr 10.20.193.4:0/339627564 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f2383fff640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f238410f280 0x7f238411db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f2388980640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2384115470 0x7f2384123480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23837fe640 1 -- 10.20.193.4:0/339627564 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2384115470 msgr2=0x7f2384123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23837fe640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2384115470 0x7f2384123480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23837fe640 1 -- 10.20.193.4:0/339627564 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f238410f280 msgr2=0x7f238411db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23837fe640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f238410f280 0x7f238411db70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23837fe640 1 -- 10.20.193.4:0/339627564 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237800a650 con 0x7f238410fc70 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23837fe640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f238410fc70 0x7f238411e0b0 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f237400d950 tx=0x7f237400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23817fa640 1 -- 10.20.193.4:0/339627564 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2374004540 con 0x7f238410fc70 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23817fa640 1 -- 10.20.193.4:0/339627564 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2374009d00 con 0x7f238410fc70 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f238a40a640 1 -- 10.20.193.4:0/339627564 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23841240b0 con 0x7f238410fc70 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f23817fa640 1 -- 10.20.193.4:0/339627564 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f23740106e0 con 0x7f238410fc70 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.908+0000 7f238a40a640 1 -- 10.20.193.4:0/339627564 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23841647b0 con 0x7f238410fc70 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.909+0000 7f238a40a640 1 -- 10.20.193.4:0/339627564 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2384110560 con 0x7f238410fc70 2026-02-24T09:09:25.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.910+0000 7f23817fa640 1 -- 10.20.193.4:0/339627564 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f23740097c0 con 0x7f238410fc70 2026-02-24T09:09:25.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.911+0000 7f23817fa640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23580b56e0 0x7f23580d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:25.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.911+0000 7f2383fff640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23580b56e0 0x7f23580d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:25.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.911+0000 7f23817fa640 1 -- 10.20.193.4:0/339627564 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f23740e7160 con 0x7f238410fc70 2026-02-24T09:09:25.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.911+0000 7f2383fff640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23580b56e0 0x7f23580d5b90 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2370005970 tx=0x7f2370005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:25.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:25.911+0000 7f23817fa640 1 -- 10.20.193.4:0/339627564 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f23740a9c10 con 0x7f238410fc70 2026-02-24T09:09:26.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.015+0000 7f238a40a640 1 -- 10.20.193.4:0/339627564 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f238411ecd0 con 0x7f238410fc70 2026-02-24T09:09:26.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.016+0000 7f23817fa640 1 -- 10.20.193.4:0/339627564 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22244 (secure 0 0 0) 0x7f23740acdc0 con 0x7f238410fc70 2026-02-24T09:09:26.019 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:26.019 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":74,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:24.652551+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:26.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 -- 10.20.193.4:0/339627564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23580b56e0 msgr2=0x7f23580d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:26.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23580b56e0 0x7f23580d5b90 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2370005970 tx=0x7f2370005900 comp rx=0 tx=0).stop 2026-02-24T09:09:26.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 -- 10.20.193.4:0/339627564 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f238410fc70 msgr2=0x7f238411e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:26.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f238410fc70 0x7f238411e0b0 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f237400d950 tx=0x7f237400de20 comp rx=0 tx=0).stop 2026-02-24T09:09:26.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 -- 10.20.193.4:0/339627564 shutdown_connections 2026-02-24T09:09:26.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23580b56e0 0x7f23580d5b90 unknown :-1 s=CLOSED pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:26.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2384115470 0x7f2384123480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:26.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f238410fc70 0x7f238411e0b0 unknown :-1 s=CLOSED pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:26.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 --2- 10.20.193.4:0/339627564 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f238410f280 0x7f238411db70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:26.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 -- 10.20.193.4:0/339627564 >> 10.20.193.4:0/339627564 conn(0x7f238405f830 msgr2=0x7f238410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:26.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 -- 10.20.193.4:0/339627564 shutdown_connections 2026-02-24T09:09:26.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.017+0000 7f238a40a640 1 -- 10.20.193.4:0/339627564 wait complete. 2026-02-24T09:09:26.056 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-24T09:09:26.172 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 -- 10.20.193.4:0/4152703600 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde6c115840 msgr2=0x7fde6c176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 --2- 10.20.193.4:0/4152703600 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde6c115840 0x7fde6c176210 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=14660238387926360470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde6800aa30 tx=0x7fde68030280 comp rx=0 tx=0).stop 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 -- 10.20.193.4:0/4152703600 shutdown_connections 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 --2- 10.20.193.4:0/4152703600 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde6c115840 0x7fde6c176210 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=14660238387926360470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 --2- 10.20.193.4:0/4152703600 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde6c110040 0x7fde6c115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 --2- 10.20.193.4:0/4152703600 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde6c10f650 0x7fde6c10fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 -- 10.20.193.4:0/4152703600 >> 10.20.193.4:0/4152703600 conn(0x7fde6c0ecf20 msgr2=0x7fde6c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 -- 10.20.193.4:0/4152703600 shutdown_connections 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 -- 10.20.193.4:0/4152703600 wait complete. 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 Processor -- start 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.276+0000 7fde72bcb640 1 -- start start 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde72bcb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde6c10f650 0x7fde6c11dec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde72bcb640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde6c110040 0x7fde6c11e400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde72bcb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde6c115840 0x7fde6c1237d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:26.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde72bcb640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c123df0 con 0x7fde6c10f650 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde72bcb640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c123f60 con 0x7fde6c110040 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde72bcb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c124120 con 0x7fde6c115840 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde70940640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde6c10f650 0x7fde6c11dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde70940640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde6c10f650 0x7fde6c11dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42756/0 (socket says 10.20.193.4:42756) 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde70940640 1 -- 10.20.193.4:0/2892264995 learned_addr learned my addr 10.20.193.4:0/2892264995 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde63fff640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde6c110040 0x7fde6c11e400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde71141640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde6c115840 0x7fde6c1237d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde70940640 1 -- 10.20.193.4:0/2892264995 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde6c115840 msgr2=0x7fde6c1237d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde70940640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde6c115840 0x7fde6c1237d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde70940640 1 -- 10.20.193.4:0/2892264995 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde6c110040 msgr2=0x7fde6c11e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde70940640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde6c110040 0x7fde6c11e400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde70940640 1 -- 10.20.193.4:0/2892264995 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6800a650 con 0x7fde6c10f650 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde71141640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde6c115840 0x7fde6c1237d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde63fff640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde6c110040 0x7fde6c11e400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde70940640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde6c10f650 0x7fde6c11dec0 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde5c00d950 tx=0x7fde5c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde61ffb640 1 -- 10.20.193.4:0/2892264995 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde5c004540 con 0x7fde6c10f650 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde72bcb640 1 -- 10.20.193.4:0/2892264995 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6c124400 con 0x7fde6c10f650 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde61ffb640 1 -- 10.20.193.4:0/2892264995 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fde5c009d00 con 0x7fde6c10f650 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde61ffb640 1 -- 10.20.193.4:0/2892264995 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde5c0106e0 con 0x7fde6c10f650 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.277+0000 7fde72bcb640 1 -- 10.20.193.4:0/2892264995 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6c164b00 con 0x7fde6c10f650 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.278+0000 7fde72bcb640 1 -- 10.20.193.4:0/2892264995 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde6c110930 con 0x7fde6c10f650 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.279+0000 7fde61ffb640 1 -- 10.20.193.4:0/2892264995 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7fde5c0097c0 con 0x7fde6c10f650 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.279+0000 7fde61ffb640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde480b56e0 0x7fde480d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:26.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.279+0000 7fde61ffb640 1 -- 10.20.193.4:0/2892264995 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fde5c0e7120 con 0x7fde6c10f650 2026-02-24T09:09:26.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.279+0000 7fde63fff640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde480b56e0 0x7fde480d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:26.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.279+0000 7fde63fff640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde480b56e0 0x7fde480d5b90 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde6c124860 tx=0x7fde540043a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:26.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.280+0000 7fde61ffb640 1 -- 10.20.193.4:0/2892264995 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fde5c0a9bd0 con 0x7fde6c10f650 2026-02-24T09:09:26.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:26.412+0000 7fde72bcb640 1 -- 10.20.193.4:0/2892264995 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fde6c11f080 con 0x7fde6c10f650 2026-02-24T09:09:26.415 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:26 trial004 ceph-mon[41596]: osdmap e74: 12 total, 12 up, 12 in 2026-02-24T09:09:26.415 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:26 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/354012515' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-24T09:09:26.415 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:26 trial004 ceph-mon[41596]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2026-02-24T09:09:26.415 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:26 trial004 ceph-mon[41596]: daemon mds.i is now active in filesystem cephfs as rank 0 2026-02-24T09:09:26.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:26 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/872972260' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:26.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:26 trial004 ceph-mon[41596]: pgmap v136: 97 pgs: 17 creating+peering, 72 unknown, 8 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:26.416 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:26 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/339627564' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:26.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:26 trial090 ceph-mon[47278]: osdmap e74: 12 total, 12 up, 12 in 2026-02-24T09:09:26.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:26 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/354012515' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-24T09:09:26.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:26 trial090 ceph-mon[47278]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2026-02-24T09:09:26.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:26 trial090 ceph-mon[47278]: daemon mds.i is now active in filesystem cephfs as rank 0 2026-02-24T09:09:26.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:26 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/872972260' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:26.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:26 trial090 ceph-mon[47278]: pgmap v136: 97 pgs: 17 creating+peering, 72 unknown, 8 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:26.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:26 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/339627564' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:26.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:26 trial014 ceph-mon[46941]: osdmap e74: 12 total, 12 up, 12 in 2026-02-24T09:09:26.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:26 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/354012515' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-24T09:09:26.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:26 trial014 ceph-mon[46941]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2026-02-24T09:09:26.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:26 trial014 ceph-mon[46941]: daemon mds.i is now active in filesystem cephfs as rank 0 2026-02-24T09:09:26.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:26 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/872972260' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:26.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:26 trial014 ceph-mon[46941]: pgmap v136: 97 pgs: 17 creating+peering, 72 unknown, 8 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-24T09:09:26.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:26 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/339627564' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:27.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.271+0000 7fde61ffb640 1 -- 10.20.193.4:0/2892264995 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7fde5c0acd80 con 0x7fde6c10f650 2026-02-24T09:09:27.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 -- 10.20.193.4:0/2892264995 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde480b56e0 msgr2=0x7fde480d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:27.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde480b56e0 0x7fde480d5b90 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde6c124860 tx=0x7fde540043a0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 -- 10.20.193.4:0/2892264995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde6c10f650 msgr2=0x7fde6c11dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:27.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde6c10f650 0x7fde6c11dec0 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde5c00d950 tx=0x7fde5c00de20 comp rx=0 tx=0).stop 2026-02-24T09:09:27.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 -- 10.20.193.4:0/2892264995 shutdown_connections 2026-02-24T09:09:27.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde480b56e0 0x7fde480d5b90 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde6c115840 0x7fde6c1237d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde6c110040 0x7fde6c11e400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 --2- 10.20.193.4:0/2892264995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde6c10f650 0x7fde6c11dec0 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 -- 10.20.193.4:0/2892264995 >> 10.20.193.4:0/2892264995 conn(0x7fde6c0ecf20 msgr2=0x7fde6c10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:27.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 -- 10.20.193.4:0/2892264995 shutdown_connections 2026-02-24T09:09:27.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.273+0000 7fde72bcb640 1 -- 10.20.193.4:0/2892264995 wait complete. 2026-02-24T09:09:27.312 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2026-02-24T09:09:27.313 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs set cephfs max_mds 3 --yes-i-really-mean-it 2026-02-24T09:09:27.428 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:27.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 -- 10.20.193.4:0/2959894487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbf64114a10 msgr2=0x7fbf64119560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:27.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 --2- 10.20.193.4:0/2959894487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbf64114a10 0x7fbf64119560 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=2752115188975257450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf4c009950 tx=0x7fbf4c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 -- 10.20.193.4:0/2959894487 shutdown_connections 2026-02-24T09:09:27.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 --2- 10.20.193.4:0/2959894487 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbf64119d10 0x7fbf6417a6e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 --2- 10.20.193.4:0/2959894487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbf64114a10 0x7fbf64119560 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=2752115188975257450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 --2- 10.20.193.4:0/2959894487 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf64114020 0x7fbf641143f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 -- 10.20.193.4:0/2959894487 >> 10.20.193.4:0/2959894487 conn(0x7fbf64064c40 msgr2=0x7fbf64065040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:27.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 -- 10.20.193.4:0/2959894487 shutdown_connections 2026-02-24T09:09:27.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 -- 10.20.193.4:0/2959894487 wait complete. 2026-02-24T09:09:27.543 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:27 trial004 ceph-mon[41596]: osdmap e75: 12 total, 12 up, 12 in 2026-02-24T09:09:27.543 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:27 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] up:active 2026-02-24T09:09:27.543 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:27 trial004 ceph-mon[41596]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-24T09:09:27.543 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:27 trial004 ceph-mon[41596]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-24T09:09:27.543 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:27 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2892264995' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-24T09:09:27.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 Processor -- start 2026-02-24T09:09:27.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 -- start start 2026-02-24T09:09:27.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbf64114020 0x7fbf640fbc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbf64114a10 0x7fbf6417a5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf64119d10 0x7fbf640fc390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641015a0 con 0x7fbf64114020 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64101710 con 0x7fbf64114a10 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf6b083640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641018d0 con 0x7fbf64119d10 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf68df8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbf64114020 0x7fbf640fbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf68df8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbf64114020 0x7fbf640fbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42780/0 (socket says 10.20.193.4:42780) 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.539+0000 7fbf68df8640 1 -- 10.20.193.4:0/4250526537 learned_addr learned my addr 10.20.193.4:0/4250526537 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf5bfff640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbf64114a10 0x7fbf6417a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf695f9640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf64119d10 0x7fbf640fc390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:27.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf68df8640 1 -- 10.20.193.4:0/4250526537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf64119d10 msgr2=0x7fbf640fc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf68df8640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf64119d10 0x7fbf640fc390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf68df8640 1 -- 10.20.193.4:0/4250526537 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbf64114a10 msgr2=0x7fbf6417a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf68df8640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbf64114a10 0x7fbf6417a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf68df8640 1 -- 10.20.193.4:0/4250526537 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c009570 con 0x7fbf64114020 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf5bfff640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbf64114a10 0x7fbf6417a5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf68df8640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbf64114020 0x7fbf640fbc90 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf5400d950 tx=0x7fbf5400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf59ffb640 1 -- 10.20.193.4:0/4250526537 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf54004540 con 0x7fbf64114020 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf59ffb640 1 -- 10.20.193.4:0/4250526537 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbf54009d00 con 0x7fbf64114020 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf6b083640 1 -- 10.20.193.4:0/4250526537 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf64101bb0 con 0x7fbf64114020 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf59ffb640 1 -- 10.20.193.4:0/4250526537 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf540106e0 con 0x7fbf64114020 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf6b083640 1 -- 10.20.193.4:0/4250526537 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf64102080 con 0x7fbf64114020 2026-02-24T09:09:27.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.540+0000 7fbf6b083640 1 -- 10.20.193.4:0/4250526537 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf64114e00 con 0x7fbf64114020 2026-02-24T09:09:27.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.542+0000 7fbf59ffb640 1 -- 10.20.193.4:0/4250526537 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7fbf540097c0 con 0x7fbf64114020 2026-02-24T09:09:27.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.542+0000 7fbf59ffb640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbf400b56d0 0x7fbf400d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:27.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.542+0000 7fbf5bfff640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbf400b56d0 0x7fbf400d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:27.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.542+0000 7fbf59ffb640 1 -- 10.20.193.4:0/4250526537 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fbf540e71f0 con 0x7fbf64114020 2026-02-24T09:09:27.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.543+0000 7fbf5bfff640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbf400b56d0 0x7fbf400d5b80 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf4c0023d0 tx=0x7fbf4c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:27.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.543+0000 7fbf59ffb640 1 -- 10.20.193.4:0/4250526537 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbf540a9ca0 con 0x7fbf64114020 2026-02-24T09:09:27.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:27 trial090 ceph-mon[47278]: osdmap e75: 12 total, 12 up, 12 in 2026-02-24T09:09:27.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:27 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] up:active 2026-02-24T09:09:27.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:27 trial090 ceph-mon[47278]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-24T09:09:27.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:27 trial090 ceph-mon[47278]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-24T09:09:27.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:27 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2892264995' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-24T09:09:27.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:27 trial014 ceph-mon[46941]: osdmap e75: 12 total, 12 up, 12 in 2026-02-24T09:09:27.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:27 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] up:active 2026-02-24T09:09:27.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:27 trial014 ceph-mon[46941]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-24T09:09:27.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:27 trial014 ceph-mon[46941]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-24T09:09:27.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:27 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2892264995' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-24T09:09:27.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.681+0000 7fbf6b083640 1 -- 10.20.193.4:0/4250526537 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} v 0) -- 0x7fbf641143f0 con 0x7fbf64114020 2026-02-24T09:09:27.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.933+0000 7fbf59ffb640 1 -- 10.20.193.4:0/4250526537 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]=0 v14) ==== 135+0+0 (secure 0 0 0) 0x7fbf540ace50 con 0x7fbf64114020 2026-02-24T09:09:27.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 -- 10.20.193.4:0/4250526537 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbf400b56d0 msgr2=0x7fbf400d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:27.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbf400b56d0 0x7fbf400d5b80 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf4c0023d0 tx=0x7fbf4c031040 comp rx=0 tx=0).stop 2026-02-24T09:09:27.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 -- 10.20.193.4:0/4250526537 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbf64114020 msgr2=0x7fbf640fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:27.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbf64114020 0x7fbf640fbc90 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf5400d950 tx=0x7fbf5400de20 comp rx=0 tx=0).stop 2026-02-24T09:09:27.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 -- 10.20.193.4:0/4250526537 shutdown_connections 2026-02-24T09:09:27.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbf400b56d0 0x7fbf400d5b80 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf64119d10 0x7fbf640fc390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbf64114a10 0x7fbf6417a5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 --2- 10.20.193.4:0/4250526537 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbf64114020 0x7fbf640fbc90 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:27.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 -- 10.20.193.4:0/4250526537 >> 10.20.193.4:0/4250526537 conn(0x7fbf64064c40 msgr2=0x7fbf641187a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:27.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 -- 10.20.193.4:0/4250526537 shutdown_connections 2026-02-24T09:09:27.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:27.935+0000 7fbf6b083640 1 -- 10.20.193.4:0/4250526537 wait complete. 2026-02-24T09:09:27.978 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-24T09:09:28.095 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:28.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 -- 10.20.193.4:0/3998870794 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8b8c10dee0 msgr2=0x7f8b8c10e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 --2- 10.20.193.4:0/3998870794 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8b8c10dee0 0x7f8b8c10e2b0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=1576188926679933184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b80009950 tx=0x7f8b8002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 -- 10.20.193.4:0/3998870794 shutdown_connections 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 --2- 10.20.193.4:0/3998870794 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8b8c10c0d0 0x7f8b8c175e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 --2- 10.20.193.4:0/3998870794 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8b8c10b540 0x7f8b8c10b970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 --2- 10.20.193.4:0/3998870794 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8b8c10dee0 0x7f8b8c10e2b0 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=1576188926679933184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 -- 10.20.193.4:0/3998870794 >> 10.20.193.4:0/3998870794 conn(0x7f8b8c0e92c0 msgr2=0x7f8b8c1096d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 -- 10.20.193.4:0/3998870794 shutdown_connections 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 -- 10.20.193.4:0/3998870794 wait complete. 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 Processor -- start 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 -- start start 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8b8c10b540 0x7f8b8c0f4110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8b8c10c0d0 0x7f8b8c0f4650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8b8c10dee0 0x7f8b8c0f9a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c0fa040 con 0x7f8b8c10dee0 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c0fa1b0 con 0x7f8b8c10c0d0 2026-02-24T09:09:28.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b91273640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c0fa370 con 0x7f8b8c10b540 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b8b577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8b8c10dee0 0x7f8b8c0f9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b8b577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8b8c10dee0 0x7f8b8c0f9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42806/0 (socket says 10.20.193.4:42806) 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b8b577640 1 -- 10.20.193.4:0/1442756337 learned_addr learned my addr 10.20.193.4:0/1442756337 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b8a575640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8b8c10c0d0 0x7f8b8c0f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.197+0000 7f8b8ad76640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8b8c10b540 0x7f8b8c0f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b8b577640 1 -- 10.20.193.4:0/1442756337 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8b8c10b540 msgr2=0x7f8b8c0f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b8b577640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8b8c10b540 0x7f8b8c0f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b8b577640 1 -- 10.20.193.4:0/1442756337 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8b8c10c0d0 msgr2=0x7f8b8c0f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b8b577640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8b8c10c0d0 0x7f8b8c0f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b8b577640 1 -- 10.20.193.4:0/1442756337 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b80009570 con 0x7f8b8c10dee0 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b8a575640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8b8c10c0d0 0x7f8b8c0f4650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b8b577640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8b8c10dee0 0x7f8b8c0f9a20 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b7c006e90 tx=0x7f8b7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b6bfff640 1 -- 10.20.193.4:0/1442756337 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b7c005500 con 0x7f8b8c10dee0 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b91273640 1 -- 10.20.193.4:0/1442756337 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8c0fa650 con 0x7f8b8c10dee0 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b6bfff640 1 -- 10.20.193.4:0/1442756337 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8b7c005e10 con 0x7f8b8c10dee0 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b6bfff640 1 -- 10.20.193.4:0/1442756337 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b7c003a90 con 0x7f8b8c10dee0 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b91273640 1 -- 10.20.193.4:0/1442756337 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8c173000 con 0x7f8b8c10dee0 2026-02-24T09:09:28.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.198+0000 7f8b91273640 1 -- 10.20.193.4:0/1442756337 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b8c10c550 con 0x7f8b8c10dee0 2026-02-24T09:09:28.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.199+0000 7f8b6bfff640 1 -- 10.20.193.4:0/1442756337 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f8b7c00c840 con 0x7f8b8c10dee0 2026-02-24T09:09:28.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.200+0000 7f8b6bfff640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8b600b56e0 0x7f8b600d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:28.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.200+0000 7f8b8ad76640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8b600b56e0 0x7f8b600d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:28.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.200+0000 7f8b6bfff640 1 -- 10.20.193.4:0/1442756337 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f8b7c0e7c20 con 0x7f8b8c10dee0 2026-02-24T09:09:28.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.200+0000 7f8b8ad76640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8b600b56e0 0x7f8b600d5b90 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b800023d0 tx=0x7f8b80031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:28.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.201+0000 7f8b6bfff640 1 -- 10.20.193.4:0/1442756337 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8b7c0aa710 con 0x7f8b8c10dee0 2026-02-24T09:09:28.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.333+0000 7f8b91273640 1 -- 10.20.193.4:0/1442756337 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f8b8c10b970 con 0x7f8b8c10dee0 2026-02-24T09:09:28.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2892264995' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-24T09:09:28.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:28 trial004 ceph-mon[41596]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-24T09:09:28.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:28 trial004 ceph-mon[41596]: pgmap v138: 97 pgs: 17 creating+peering, 20 unknown, 60 active+clean; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 KiB/s wr, 7 op/s 2026-02-24T09:09:28.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4250526537' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:09:28.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:28 trial004 ceph-mon[41596]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-24T09:09:28.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:28 trial004 ceph-mon[41596]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-24T09:09:28.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4250526537' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:09:28.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:28 trial004 ceph-mon[41596]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2026-02-24T09:09:28.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:28 trial004 ceph-mon[41596]: daemon mds.c is now active in filesystem cephfs as rank 1 2026-02-24T09:09:28.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2892264995' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-24T09:09:28.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:28 trial090 ceph-mon[47278]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-24T09:09:28.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:28 trial090 ceph-mon[47278]: pgmap v138: 97 pgs: 17 creating+peering, 20 unknown, 60 active+clean; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 KiB/s wr, 7 op/s 2026-02-24T09:09:28.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4250526537' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:09:28.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:28 trial090 ceph-mon[47278]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-24T09:09:28.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:28 trial090 ceph-mon[47278]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-24T09:09:28.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4250526537' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:09:28.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:28 trial090 ceph-mon[47278]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2026-02-24T09:09:28.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:28 trial090 ceph-mon[47278]: daemon mds.c is now active in filesystem cephfs as rank 1 2026-02-24T09:09:28.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2892264995' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-24T09:09:28.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:28 trial014 ceph-mon[46941]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2026-02-24T09:09:28.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:28 trial014 ceph-mon[46941]: pgmap v138: 97 pgs: 17 creating+peering, 20 unknown, 60 active+clean; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 KiB/s wr, 7 op/s 2026-02-24T09:09:28.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4250526537' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:09:28.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:28 trial014 ceph-mon[46941]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-24T09:09:28.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:28 trial014 ceph-mon[46941]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-24T09:09:28.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4250526537' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:09:28.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:28 trial014 ceph-mon[46941]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2026-02-24T09:09:28.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:28 trial014 ceph-mon[46941]: daemon mds.c is now active in filesystem cephfs as rank 1 2026-02-24T09:09:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.934+0000 7f8b6bfff640 1 -- 10.20.193.4:0/1442756337 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f8b7c0ad8c0 con 0x7f8b8c10dee0 2026-02-24T09:09:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 -- 10.20.193.4:0/1442756337 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8b600b56e0 msgr2=0x7f8b600d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8b600b56e0 0x7f8b600d5b90 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b800023d0 tx=0x7f8b80031040 comp rx=0 tx=0).stop 2026-02-24T09:09:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 -- 10.20.193.4:0/1442756337 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8b8c10dee0 msgr2=0x7f8b8c0f9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8b8c10dee0 0x7f8b8c0f9a20 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b7c006e90 tx=0x7f8b7c00edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 -- 10.20.193.4:0/1442756337 shutdown_connections 2026-02-24T09:09:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8b600b56e0 0x7f8b600d5b90 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8b8c10dee0 0x7f8b8c0f9a20 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8b8c10c0d0 0x7f8b8c0f4650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 --2- 10.20.193.4:0/1442756337 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8b8c10b540 0x7f8b8c0f4110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 -- 10.20.193.4:0/1442756337 >> 10.20.193.4:0/1442756337 conn(0x7f8b8c0e92c0 msgr2=0x7f8b8c0ec8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 -- 10.20.193.4:0/1442756337 shutdown_connections 2026-02-24T09:09:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:28.937+0000 7f8b91273640 1 -- 10.20.193.4:0/1442756337 wait complete. 2026-02-24T09:09:28.977 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-24T09:09:29.092 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:29.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.190+0000 7f5028959640 1 -- 10.20.193.4:0/1592045514 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f502010d3d0 msgr2=0x7f502010d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:29.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.190+0000 7f5028959640 1 --2- 10.20.193.4:0/1592045514 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f502010d3d0 0x7f502010d7a0 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=11263119243107562342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5018009950 tx=0x7f501802f190 comp rx=0 tx=0).stop 2026-02-24T09:09:29.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.190+0000 7f5028959640 1 -- 10.20.193.4:0/1592045514 shutdown_connections 2026-02-24T09:09:29.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.190+0000 7f5028959640 1 --2- 10.20.193.4:0/1592045514 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50201135c0 0x7f5020173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:29.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.190+0000 7f5028959640 1 --2- 10.20.193.4:0/1592045514 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f502010ddc0 0x7f5020112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:29.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.190+0000 7f5028959640 1 --2- 10.20.193.4:0/1592045514 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f502010d3d0 0x7f502010d7a0 unknown :-1 s=CLOSED pgs=70 gs=1 cs=0 l=1 c_cookie=11263119243107562342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:29.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.190+0000 7f5028959640 1 -- 10.20.193.4:0/1592045514 >> 10.20.193.4:0/1592045514 conn(0x7f50200eaca0 msgr2=0x7f502010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:29.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.190+0000 7f5028959640 1 -- 10.20.193.4:0/1592045514 shutdown_connections 2026-02-24T09:09:29.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.190+0000 7f5028959640 1 -- 10.20.193.4:0/1592045514 wait complete. 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5028959640 1 Processor -- start 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5028959640 1 -- start start 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5028959640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f502010d3d0 0x7f50200f5870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5028959640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f502010ddc0 0x7f5020173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5028959640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50201135c0 0x7f50200f5f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5028959640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f50200fb180 con 0x7f502010ddc0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5028959640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f50200fb2f0 con 0x7f50201135c0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5028959640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f50200fb4b0 con 0x7f502010d3d0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5025ecd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f502010ddc0 0x7f5020173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5025ecd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f502010ddc0 0x7f5020173e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42828/0 (socket says 10.20.193.4:42828) 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5025ecd640 1 -- 10.20.193.4:0/522845135 learned_addr learned my addr 10.20.193.4:0/522845135 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f50266ce640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f502010d3d0 0x7f50200f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5026ecf640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50201135c0 0x7f50200f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5025ecd640 1 -- 10.20.193.4:0/522845135 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f502010d3d0 msgr2=0x7f50200f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5025ecd640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f502010d3d0 0x7f50200f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5025ecd640 1 -- 10.20.193.4:0/522845135 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50201135c0 msgr2=0x7f50200f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5025ecd640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50201135c0 0x7f50200f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5025ecd640 1 -- 10.20.193.4:0/522845135 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c0094b0 con 0x7f502010ddc0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f50266ce640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f502010d3d0 0x7f50200f5870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5025ecd640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f502010ddc0 0x7f5020173e90 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f500c009fd0 tx=0x7f500c002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f500b7fe640 1 -- 10.20.193.4:0/522845135 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f500c00ed60 con 0x7f502010ddc0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5028959640 1 -- 10.20.193.4:0/522845135 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5018009570 con 0x7f502010ddc0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f500b7fe640 1 -- 10.20.193.4:0/522845135 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f500c002e20 con 0x7f502010ddc0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f500b7fe640 1 -- 10.20.193.4:0/522845135 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f500c0189f0 con 0x7f502010ddc0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.191+0000 7f5028959640 1 -- 10.20.193.4:0/522845135 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50200fbb20 con 0x7f502010ddc0 2026-02-24T09:09:29.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.192+0000 7f5028959640 1 -- 10.20.193.4:0/522845135 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502010e6b0 con 0x7f502010ddc0 2026-02-24T09:09:29.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.193+0000 7f500b7fe640 1 -- 10.20.193.4:0/522845135 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f500c016020 con 0x7f502010ddc0 2026-02-24T09:09:29.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.193+0000 7f500b7fe640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ffc0b56d0 0x7f4ffc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:29.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.193+0000 7f500b7fe640 1 -- 10.20.193.4:0/522845135 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f500c0e6f40 con 0x7f502010ddc0 2026-02-24T09:09:29.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.194+0000 7f50266ce640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ffc0b56d0 0x7f4ffc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:29.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.194+0000 7f50266ce640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ffc0b56d0 0x7f4ffc0d5b80 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5018038820 tx=0x7f501803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:29.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.194+0000 7f500b7fe640 1 -- 10.20.193.4:0/522845135 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f500c0a99f0 con 0x7f502010ddc0 2026-02-24T09:09:29.278 INFO:journalctl@ceph.mds.i.trial090.stdout:Feb 24 09:09:28 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-i[101407]: 2026-02-24T09:09:28.844+0000 7fe160c3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-24T09:09:29.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.325+0000 7f5028959640 1 -- 10.20.193.4:0/522845135 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f50200f6a00 con 0x7f502010ddc0 2026-02-24T09:09:29.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:29 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1442756337' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-24T09:09:29.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:29 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1442756337' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-24T09:09:29.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:29 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] up:active 2026-02-24T09:09:29.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:29 trial004 ceph-mon[41596]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-24T09:09:29.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:29 trial004 ceph-mon[41596]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-24T09:09:29.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:29 trial004 ceph-mon[41596]: Cluster is now healthy 2026-02-24T09:09:29.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:29 trial004 ceph-mon[41596]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2026-02-24T09:09:29.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:29 trial004 ceph-mon[41596]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:creating} 9 up:standby 2026-02-24T09:09:29.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:29 trial004 ceph-mon[41596]: daemon mds.b is now active in filesystem cephfs as rank 2 2026-02-24T09:09:29.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:29 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1442756337' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-24T09:09:29.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:29 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1442756337' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-24T09:09:29.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:29 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] up:active 2026-02-24T09:09:29.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:29 trial090 ceph-mon[47278]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-24T09:09:29.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:29 trial090 ceph-mon[47278]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-24T09:09:29.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:29 trial090 ceph-mon[47278]: Cluster is now healthy 2026-02-24T09:09:29.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:29 trial090 ceph-mon[47278]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2026-02-24T09:09:29.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:29 trial090 ceph-mon[47278]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:creating} 9 up:standby 2026-02-24T09:09:29.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:29 trial090 ceph-mon[47278]: daemon mds.b is now active in filesystem cephfs as rank 2 2026-02-24T09:09:29.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:29 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1442756337' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-24T09:09:29.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:29 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1442756337' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-24T09:09:29.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:29 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] up:active 2026-02-24T09:09:29.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:29 trial014 ceph-mon[46941]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-24T09:09:29.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:29 trial014 ceph-mon[46941]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-24T09:09:29.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:29 trial014 ceph-mon[46941]: Cluster is now healthy 2026-02-24T09:09:29.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:29 trial014 ceph-mon[46941]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2026-02-24T09:09:29.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:29 trial014 ceph-mon[46941]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:creating} 9 up:standby 2026-02-24T09:09:29.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:29 trial014 ceph-mon[46941]: daemon mds.b is now active in filesystem cephfs as rank 2 2026-02-24T09:09:29.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.937+0000 7f500b7fe640 1 -- 10.20.193.4:0/522845135 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v17) ==== 115+0+0 (secure 0 0 0) 0x7f500c0acba0 con 0x7f502010ddc0 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.939+0000 7f5028959640 1 -- 10.20.193.4:0/522845135 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ffc0b56d0 msgr2=0x7f4ffc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.939+0000 7f5028959640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ffc0b56d0 0x7f4ffc0d5b80 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5018038820 tx=0x7f501803a040 comp rx=0 tx=0).stop 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.939+0000 7f5028959640 1 -- 10.20.193.4:0/522845135 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f502010ddc0 msgr2=0x7f5020173e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.939+0000 7f5028959640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f502010ddc0 0x7f5020173e90 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f500c009fd0 tx=0x7f500c002bc0 comp rx=0 tx=0).stop 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.940+0000 7f5028959640 1 -- 10.20.193.4:0/522845135 shutdown_connections 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.940+0000 7f5028959640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ffc0b56d0 0x7f4ffc0d5b80 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.940+0000 7f5028959640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50201135c0 0x7f50200f5f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.940+0000 7f5028959640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f502010ddc0 0x7f5020173e90 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.940+0000 7f5028959640 1 --2- 10.20.193.4:0/522845135 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f502010d3d0 0x7f50200f5870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.940+0000 7f5028959640 1 -- 10.20.193.4:0/522845135 >> 10.20.193.4:0/522845135 conn(0x7f50200eaca0 msgr2=0x7f50201104e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.940+0000 7f5028959640 1 -- 10.20.193.4:0/522845135 shutdown_connections 2026-02-24T09:09:29.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:29.940+0000 7f5028959640 1 -- 10.20.193.4:0/522845135 wait complete. 2026-02-24T09:09:29.982 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2026-02-24T09:09:29.982 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-24T09:09:30.096 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:30.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.199+0000 7f8888ffd640 1 -- 10.20.193.4:0/3474113657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8884110130 msgr2=0x7f8884115180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:30.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.199+0000 7f8888ffd640 1 --2- 10.20.193.4:0/3474113657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8884110130 0x7f8884115180 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=6189232433831324967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f886c009950 tx=0x7f886c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.199+0000 7f8888ffd640 1 -- 10.20.193.4:0/3474113657 shutdown_connections 2026-02-24T09:09:30.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.199+0000 7f8888ffd640 1 --2- 10.20.193.4:0/3474113657 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8884115930 0x7f8884176300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.199+0000 7f8888ffd640 1 --2- 10.20.193.4:0/3474113657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8884110130 0x7f8884115180 unknown :-1 s=CLOSED pgs=244 gs=1 cs=0 l=1 c_cookie=6189232433831324967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.199+0000 7f8888ffd640 1 --2- 10.20.193.4:0/3474113657 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f888410f740 0x7f888410fb10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.199+0000 7f8888ffd640 1 -- 10.20.193.4:0/3474113657 >> 10.20.193.4:0/3474113657 conn(0x7f88840ed050 msgr2=0x7f888410d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:30.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.200+0000 7f8888ffd640 1 -- 10.20.193.4:0/3474113657 shutdown_connections 2026-02-24T09:09:30.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.200+0000 7f8888ffd640 1 -- 10.20.193.4:0/3474113657 wait complete. 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.200+0000 7f8888ffd640 1 Processor -- start 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.200+0000 7f8888ffd640 1 -- start start 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8888ffd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f888410f740 0x7f88840f5a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8888ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8884110130 0x7f8884176200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8888ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8884115930 0x7f88840f6150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8888ffd640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f88840fb310 con 0x7f8884115930 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8888ffd640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f88840fb480 con 0x7f888410f740 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8888ffd640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88840fb640 con 0x7f8884110130 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8882d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8884115930 0x7f88840f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8882d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8884115930 0x7f88840f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42852/0 (socket says 10.20.193.4:42852) 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8882d76640 1 -- 10.20.193.4:0/1826247803 learned_addr learned my addr 10.20.193.4:0/1826247803 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8881d74640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8884110130 0x7f8884176200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8882575640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f888410f740 0x7f88840f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8882d76640 1 -- 10.20.193.4:0/1826247803 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8884110130 msgr2=0x7f8884176200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8882d76640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8884110130 0x7f8884176200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8882d76640 1 -- 10.20.193.4:0/1826247803 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f888410f740 msgr2=0x7f88840f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:30.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8882d76640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f888410f740 0x7f88840f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8882d76640 1 -- 10.20.193.4:0/1826247803 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f886c009570 con 0x7f8884115930 2026-02-24T09:09:30.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8882d76640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8884115930 0x7f88840f6150 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f887400f8d0 tx=0x7f887400fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:30.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f886b7fe640 1 -- 10.20.193.4:0/1826247803 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f887400dce0 con 0x7f8884115930 2026-02-24T09:09:30.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f886b7fe640 1 -- 10.20.193.4:0/1826247803 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f887400de40 con 0x7f8884115930 2026-02-24T09:09:30.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8888ffd640 1 -- 10.20.193.4:0/1826247803 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88840fb920 con 0x7f8884115930 2026-02-24T09:09:30.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f886b7fe640 1 -- 10.20.193.4:0/1826247803 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88740116b0 con 0x7f8884115930 2026-02-24T09:09:30.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.201+0000 7f8888ffd640 1 -- 10.20.193.4:0/1826247803 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88840fbdf0 con 0x7f8884115930 2026-02-24T09:09:30.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.202+0000 7f8888ffd640 1 -- 10.20.193.4:0/1826247803 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8884110a20 con 0x7f8884115930 2026-02-24T09:09:30.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.203+0000 7f886b7fe640 1 -- 10.20.193.4:0/1826247803 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f8874020060 con 0x7f8884115930 2026-02-24T09:09:30.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.204+0000 7f886b7fe640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f885c0b5750 0x7f885c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:30.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.204+0000 7f8882575640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f885c0b5750 0x7f885c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:30.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.204+0000 7f886b7fe640 1 -- 10.20.193.4:0/1826247803 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f8874015070 con 0x7f8884115930 2026-02-24T09:09:30.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.204+0000 7f8882575640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f885c0b5750 0x7f885c0d5c00 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8878004740 tx=0x7f8878005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:30.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.204+0000 7f886b7fe640 1 -- 10.20.193.4:0/1826247803 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f88740aa6e0 con 0x7f8884115930 2026-02-24T09:09:30.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.327+0000 7f8888ffd640 1 -- 10.20.193.4:0/1826247803 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f88840f6bc0 con 0x7f885c0b5750 2026-02-24T09:09:30.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.341+0000 7f886b7fe640 1 -- 10.20.193.4:0/1826247803 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f88840f6bc0 con 0x7f885c0b5750 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 -- 10.20.193.4:0/1826247803 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f885c0b5750 msgr2=0x7f885c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f885c0b5750 0x7f885c0d5c00 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8878004740 tx=0x7f8878005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 -- 10.20.193.4:0/1826247803 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8884115930 msgr2=0x7f88840f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8884115930 0x7f88840f6150 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f887400f8d0 tx=0x7f887400fda0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 -- 10.20.193.4:0/1826247803 shutdown_connections 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f885c0b5750 0x7f885c0d5c00 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8884115930 0x7f88840f6150 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8884110130 0x7f8884176200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 --2- 10.20.193.4:0/1826247803 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f888410f740 0x7f88840f5a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 -- 10.20.193.4:0/1826247803 >> 10.20.193.4:0/1826247803 conn(0x7f88840ed050 msgr2=0x7f8884111f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 -- 10.20.193.4:0/1826247803 shutdown_connections 2026-02-24T09:09:30.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.343+0000 7f8888ffd640 1 -- 10.20.193.4:0/1826247803 wait complete. 2026-02-24T09:09:30.383 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-24T09:09:30.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:30 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/522845135' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-24T09:09:30.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:30 trial004 ceph-mon[41596]: pgmap v139: 97 pgs: 12 creating+peering, 85 active+clean; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s wr, 9 op/s 2026-02-24T09:09:30.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:30 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/522845135' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-24T09:09:30.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:30 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] up:active 2026-02-24T09:09:30.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:30 trial004 ceph-mon[41596]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 9 up:standby 2026-02-24T09:09:30.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:30 trial004 ceph-mon[41596]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:09:30.465 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:09:30 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: 2026-02-24T09:09:30.332+0000 7f843576e640 -1 client.14880 error registering admin socket command: (17) File exists 2026-02-24T09:09:30.501 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:30.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:30 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/522845135' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-24T09:09:30.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:30 trial090 ceph-mon[47278]: pgmap v139: 97 pgs: 12 creating+peering, 85 active+clean; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s wr, 9 op/s 2026-02-24T09:09:30.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:30 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/522845135' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-24T09:09:30.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:30 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] up:active 2026-02-24T09:09:30.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:30 trial090 ceph-mon[47278]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 9 up:standby 2026-02-24T09:09:30.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:30 trial090 ceph-mon[47278]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:09:30.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:30 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/522845135' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-24T09:09:30.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:30 trial014 ceph-mon[46941]: pgmap v139: 97 pgs: 12 creating+peering, 85 active+clean; 580 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s wr, 9 op/s 2026-02-24T09:09:30.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:30 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/522845135' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-24T09:09:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:30 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] up:active 2026-02-24T09:09:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:30 trial014 ceph-mon[46941]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 9 up:standby 2026-02-24T09:09:30.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:30 trial014 ceph-mon[46941]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:09:30.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.606+0000 7f84ac97a640 1 -- 10.20.193.4:0/500008562 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84a4113200 msgr2=0x7f84a4173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:30.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.606+0000 7f84ac97a640 1 --2- 10.20.193.4:0/500008562 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84a4113200 0x7f84a4173bd0 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=15853538712725195665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f849800aa30 tx=0x7f8498030280 comp rx=0 tx=0).stop 2026-02-24T09:09:30.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 -- 10.20.193.4:0/500008562 shutdown_connections 2026-02-24T09:09:30.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 --2- 10.20.193.4:0/500008562 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84a4113200 0x7f84a4173bd0 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=15853538712725195665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 --2- 10.20.193.4:0/500008562 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84a410da00 0x7f84a4112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 --2- 10.20.193.4:0/500008562 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84a410d010 0x7f84a410d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 -- 10.20.193.4:0/500008562 >> 10.20.193.4:0/500008562 conn(0x7f84a405f830 msgr2=0x7f84a410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:30.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 -- 10.20.193.4:0/500008562 shutdown_connections 2026-02-24T09:09:30.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 -- 10.20.193.4:0/500008562 wait complete. 2026-02-24T09:09:30.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 Processor -- start 2026-02-24T09:09:30.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 -- start start 2026-02-24T09:09:30.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84a410d010 0x7f84a411b9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:30.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84a410da00 0x7f84a411bf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:30.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84a4113200 0x7f84a41212d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:30.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f84a41218f0 con 0x7f84a410d010 2026-02-24T09:09:30.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f84a4121a60 con 0x7f84a4113200 2026-02-24T09:09:30.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84ac97a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84a4121c20 con 0x7f84a410da00 2026-02-24T09:09:30.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84aa6ef640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84a410d010 0x7f84a411b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:30.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84aa6ef640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84a410d010 0x7f84a411b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42874/0 (socket says 10.20.193.4:42874) 2026-02-24T09:09:30.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84aa6ef640 1 -- 10.20.193.4:0/550196948 learned_addr learned my addr 10.20.193.4:0/550196948 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84a9eee640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84a410da00 0x7f84a411bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84aa6ef640 1 -- 10.20.193.4:0/550196948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84a410da00 msgr2=0x7f84a411bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84aa6ef640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84a410da00 0x7f84a411bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84aa6ef640 1 -- 10.20.193.4:0/550196948 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84a4113200 msgr2=0x7f84a41212d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84aaef0640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84a4113200 0x7f84a41212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84aa6ef640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84a4113200 0x7f84a41212d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.607+0000 7f84aa6ef640 1 -- 10.20.193.4:0/550196948 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849800a650 con 0x7f84a410d010 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.608+0000 7f84aaef0640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84a4113200 0x7f84a41212d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.608+0000 7f84aa6ef640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84a410d010 0x7f84a411b9c0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f849c0072a0 tx=0x7f849c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.608+0000 7f848f7fe640 1 -- 10.20.193.4:0/550196948 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f849c004500 con 0x7f84a410d010 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.608+0000 7f848f7fe640 1 -- 10.20.193.4:0/550196948 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f849c00bd20 con 0x7f84a410d010 2026-02-24T09:09:30.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.608+0000 7f848f7fe640 1 -- 10.20.193.4:0/550196948 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f849c002ea0 con 0x7f84a410d010 2026-02-24T09:09:30.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.608+0000 7f84ac97a640 1 -- 10.20.193.4:0/550196948 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a4121f00 con 0x7f84a410d010 2026-02-24T09:09:30.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.608+0000 7f84ac97a640 1 -- 10.20.193.4:0/550196948 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a4162600 con 0x7f84a410d010 2026-02-24T09:09:30.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.608+0000 7f84ac97a640 1 -- 10.20.193.4:0/550196948 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a4122120 con 0x7f84a410d010 2026-02-24T09:09:30.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.610+0000 7f848f7fe640 1 -- 10.20.193.4:0/550196948 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f849c00b840 con 0x7f84a410d010 2026-02-24T09:09:30.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.610+0000 7f848f7fe640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84800b5760 0x7f84800d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:30.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.610+0000 7f84a9eee640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84800b5760 0x7f84800d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:30.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.610+0000 7f848f7fe640 1 -- 10.20.193.4:0/550196948 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f849c0e6950 con 0x7f84a410d010 2026-02-24T09:09:30.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.610+0000 7f84a9eee640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84800b5760 0x7f84800d5c10 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a4122360 tx=0x7f8490005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:30.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.610+0000 7f848f7fe640 1 -- 10.20.193.4:0/550196948 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f849c0a9400 con 0x7f84a410d010 2026-02-24T09:09:30.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.735+0000 7f84ac97a640 1 -- 10.20.193.4:0/550196948 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f84a411cbc0 con 0x7f84800b5760 2026-02-24T09:09:30.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.749+0000 7f848f7fe640 1 -- 10.20.193.4:0/550196948 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f84a411cbc0 con 0x7f84800b5760 2026-02-24T09:09:30.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 -- 10.20.193.4:0/550196948 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84800b5760 msgr2=0x7f84800d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:30.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84800b5760 0x7f84800d5c10 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a4122360 tx=0x7f8490005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:30.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 -- 10.20.193.4:0/550196948 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84a410d010 msgr2=0x7f84a411b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:30.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84a410d010 0x7f84a411b9c0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f849c0072a0 tx=0x7f849c00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 -- 10.20.193.4:0/550196948 shutdown_connections 2026-02-24T09:09:30.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84800b5760 0x7f84800d5c10 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84a4113200 0x7f84a41212d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84a410da00 0x7f84a411bf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 --2- 10.20.193.4:0/550196948 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84a410d010 0x7f84a411b9c0 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:30.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 -- 10.20.193.4:0/550196948 >> 10.20.193.4:0/550196948 conn(0x7f84a405f830 msgr2=0x7f84a410ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:30.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 -- 10.20.193.4:0/550196948 shutdown_connections 2026-02-24T09:09:30.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:30.750+0000 7f84ac97a640 1 -- 10.20.193.4:0/550196948 wait complete. 2026-02-24T09:09:30.790 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-24T09:09:30.907 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:31.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 -- 10.20.193.4:0/651952536 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc9d410f280 msgr2=0x7fc9d410f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 --2- 10.20.193.4:0/651952536 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc9d410f280 0x7fc9d410f650 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=2576457440893244641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9c0009950 tx=0x7fc9c002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 -- 10.20.193.4:0/651952536 shutdown_connections 2026-02-24T09:09:31.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 --2- 10.20.193.4:0/651952536 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc9d4115470 0x7fc9d4175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 --2- 10.20.193.4:0/651952536 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9d410fc70 0x7fc9d4114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 --2- 10.20.193.4:0/651952536 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc9d410f280 0x7fc9d410f650 unknown :-1 s=CLOSED pgs=250 gs=1 cs=0 l=1 c_cookie=2576457440893244641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 -- 10.20.193.4:0/651952536 >> 10.20.193.4:0/651952536 conn(0x7fc9d405f830 msgr2=0x7fc9d410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:31.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 -- 10.20.193.4:0/651952536 shutdown_connections 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 -- 10.20.193.4:0/651952536 wait complete. 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 Processor -- start 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 -- start start 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9d410f280 0x7fc9d411dc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc9d410fc70 0x7fc9d411e180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc9d4115470 0x7fc9d4123550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4123b70 con 0x7fc9d4115470 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4123ce0 con 0x7fc9d410fc70 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9da4ae640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4123ea0 con 0x7fc9d410f280 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d8a24640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc9d4115470 0x7fc9d4123550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d8a24640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc9d4115470 0x7fc9d4123550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42898/0 (socket says 10.20.193.4:42898) 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d8a24640 1 -- 10.20.193.4:0/2715586873 learned_addr learned my addr 10.20.193.4:0/2715586873 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d37fe640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc9d410fc70 0x7fc9d411e180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d3fff640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9d410f280 0x7fc9d411dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d8a24640 1 -- 10.20.193.4:0/2715586873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9d410f280 msgr2=0x7fc9d411dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d8a24640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9d410f280 0x7fc9d411dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d8a24640 1 -- 10.20.193.4:0/2715586873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc9d410fc70 msgr2=0x7fc9d411e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d8a24640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc9d410fc70 0x7fc9d411e180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d8a24640 1 -- 10.20.193.4:0/2715586873 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c0009570 con 0x7fc9d4115470 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.009+0000 7fc9d3fff640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9d410f280 0x7fc9d411dc40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.010+0000 7fc9d8a24640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc9d4115470 0x7fc9d4123550 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9c800f8d0 tx=0x7fc9c800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.010+0000 7fc9d17fa640 1 -- 10.20.193.4:0/2715586873 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9c800dce0 con 0x7fc9d4115470 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.010+0000 7fc9da4ae640 1 -- 10.20.193.4:0/2715586873 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d4124180 con 0x7fc9d4115470 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.010+0000 7fc9d17fa640 1 -- 10.20.193.4:0/2715586873 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc9c800de40 con 0x7fc9d4115470 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.010+0000 7fc9d17fa640 1 -- 10.20.193.4:0/2715586873 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9c8011740 con 0x7fc9d4115470 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.010+0000 7fc9da4ae640 1 -- 10.20.193.4:0/2715586873 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d4164880 con 0x7fc9d4115470 2026-02-24T09:09:31.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.010+0000 7fc9da4ae640 1 -- 10.20.193.4:0/2715586873 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d4110560 con 0x7fc9d4115470 2026-02-24T09:09:31.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.011+0000 7fc9d17fa640 1 -- 10.20.193.4:0/2715586873 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7fc9c8020060 con 0x7fc9d4115470 2026-02-24T09:09:31.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.012+0000 7fc9d17fa640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc9a80b56e0 0x7fc9a80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.012+0000 7fc9d3fff640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc9a80b56e0 0x7fc9a80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.012+0000 7fc9d17fa640 1 -- 10.20.193.4:0/2715586873 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fc9c8015070 con 0x7fc9d4115470 2026-02-24T09:09:31.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.012+0000 7fc9d3fff640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc9a80b56e0 0x7fc9a80d5b90 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9c00098a0 tx=0x7fc9c0031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:31.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.012+0000 7fc9d17fa640 1 -- 10.20.193.4:0/2715586873 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc9c80aa6d0 con 0x7fc9d4115470 2026-02-24T09:09:31.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.137+0000 7fc9da4ae640 1 -- 10.20.193.4:0/2715586873 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fc9d411eda0 con 0x7fc9a80b56e0 2026-02-24T09:09:31.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.141+0000 7fc9d17fa640 1 -- 10.20.193.4:0/2715586873 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc9d411eda0 con 0x7fc9a80b56e0 2026-02-24T09:09:31.143 INFO:teuthology.orchestra.run.trial004.stdout:/volumes/qa/sv_0/40689f86-7e98-4b5e-87ca-414f84577c7a 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 -- 10.20.193.4:0/2715586873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc9a80b56e0 msgr2=0x7fc9a80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc9a80b56e0 0x7fc9a80d5b90 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9c00098a0 tx=0x7fc9c0031040 comp rx=0 tx=0).stop 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 -- 10.20.193.4:0/2715586873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc9d4115470 msgr2=0x7fc9d4123550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc9d4115470 0x7fc9d4123550 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9c800f8d0 tx=0x7fc9c800fda0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 -- 10.20.193.4:0/2715586873 shutdown_connections 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc9a80b56e0 0x7fc9a80d5b90 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc9d4115470 0x7fc9d4123550 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc9d410fc70 0x7fc9d411e180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 --2- 10.20.193.4:0/2715586873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9d410f280 0x7fc9d411dc40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 -- 10.20.193.4:0/2715586873 >> 10.20.193.4:0/2715586873 conn(0x7fc9d405f830 msgr2=0x7fc9d410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 -- 10.20.193.4:0/2715586873 shutdown_connections 2026-02-24T09:09:31.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.142+0000 7fc9da4ae640 1 -- 10.20.193.4:0/2715586873 wait complete. 2026-02-24T09:09:31.180 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-24T09:09:31.295 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:31.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.394+0000 7fbb6df5f640 1 -- 10.20.193.4:0/909761872 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbb6810c840 msgr2=0x7fbb68155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.394+0000 7fbb6df5f640 1 --2- 10.20.193.4:0/909761872 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbb6810c840 0x7fbb68155720 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=4836777105210122260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb58009950 tx=0x7fbb5802f190 comp rx=0 tx=0).stop 2026-02-24T09:09:31.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.394+0000 7fbb6df5f640 1 -- 10.20.193.4:0/909761872 shutdown_connections 2026-02-24T09:09:31.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.394+0000 7fbb6df5f640 1 --2- 10.20.193.4:0/909761872 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbb68155c60 0x7fbb68176040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.394+0000 7fbb6df5f640 1 --2- 10.20.193.4:0/909761872 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbb6810c840 0x7fbb68155720 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=4836777105210122260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.394+0000 7fbb6df5f640 1 --2- 10.20.193.4:0/909761872 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb6810bf30 0x7fbb6810c300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.394+0000 7fbb6df5f640 1 -- 10.20.193.4:0/909761872 >> 10.20.193.4:0/909761872 conn(0x7fbb680e9bf0 msgr2=0x7fbb6810a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:31.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.394+0000 7fbb6df5f640 1 -- 10.20.193.4:0/909761872 shutdown_connections 2026-02-24T09:09:31.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.394+0000 7fbb6df5f640 1 -- 10.20.193.4:0/909761872 wait complete. 2026-02-24T09:09:31.398 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:31 trial004 ceph-mon[41596]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:31.398 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:31 trial004 ceph-mon[41596]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:31.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb6df5f640 1 Processor -- start 2026-02-24T09:09:31.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb6df5f640 1 -- start start 2026-02-24T09:09:31.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb6df5f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbb6810bf30 0x7fbb68161320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb6df5f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbb6810c840 0x7fbb68161860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb6df5f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb68155c60 0x7fbb68166c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb6df5f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbb68167250 con 0x7fbb6810bf30 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb6df5f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbb681673c0 con 0x7fbb6810c840 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb6df5f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb68167580 con 0x7fbb68155c60 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb677fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbb6810bf30 0x7fbb68161320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb677fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbb6810bf30 0x7fbb68161320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42912/0 (socket says 10.20.193.4:42912) 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb677fe640 1 -- 10.20.193.4:0/3543480721 learned_addr learned my addr 10.20.193.4:0/3543480721 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb66ffd640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbb6810c840 0x7fbb68161860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb67fff640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb68155c60 0x7fbb68166c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb677fe640 1 -- 10.20.193.4:0/3543480721 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb68155c60 msgr2=0x7fbb68166c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb677fe640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb68155c60 0x7fbb68166c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb677fe640 1 -- 10.20.193.4:0/3543480721 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbb6810c840 msgr2=0x7fbb68161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb677fe640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbb6810c840 0x7fbb68161860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb677fe640 1 -- 10.20.193.4:0/3543480721 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb58009570 con 0x7fbb6810bf30 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb66ffd640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbb6810c840 0x7fbb68161860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb677fe640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbb6810bf30 0x7fbb68161320 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb54005db0 tx=0x7fbb5400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb64ff9640 1 -- 10.20.193.4:0/3543480721 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbb54004500 con 0x7fbb6810bf30 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb64ff9640 1 -- 10.20.193.4:0/3543480721 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbb54004d30 con 0x7fbb6810bf30 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb6df5f640 1 -- 10.20.193.4:0/3543480721 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb68167860 con 0x7fbb6810bf30 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb64ff9640 1 -- 10.20.193.4:0/3543480721 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbb540053c0 con 0x7fbb6810bf30 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.395+0000 7fbb6df5f640 1 -- 10.20.193.4:0/3543480721 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb68152890 con 0x7fbb6810bf30 2026-02-24T09:09:31.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.396+0000 7fbb6df5f640 1 -- 10.20.193.4:0/3543480721 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb680603c0 con 0x7fbb6810bf30 2026-02-24T09:09:31.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.397+0000 7fbb64ff9640 1 -- 10.20.193.4:0/3543480721 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7fbb54009940 con 0x7fbb6810bf30 2026-02-24T09:09:31.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.398+0000 7fbb64ff9640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbb3c0b5760 0x7fbb3c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.398+0000 7fbb64ff9640 1 -- 10.20.193.4:0/3543480721 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fbb540e6ef0 con 0x7fbb6810bf30 2026-02-24T09:09:31.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.398+0000 7fbb66ffd640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbb3c0b5760 0x7fbb3c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.398+0000 7fbb66ffd640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbb3c0b5760 0x7fbb3c0d5c10 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb580023d0 tx=0x7fbb58031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:31.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.399+0000 7fbb64ff9640 1 -- 10.20.193.4:0/3543480721 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbb540a99e0 con 0x7fbb6810bf30 2026-02-24T09:09:31.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.521+0000 7fbb6df5f640 1 -- 10.20.193.4:0/3543480721 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fbb68162480 con 0x7fbb3c0b5760 2026-02-24T09:09:31.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.536+0000 7fbb64ff9640 1 -- 10.20.193.4:0/3543480721 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbb68162480 con 0x7fbb3c0b5760 2026-02-24T09:09:31.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 -- 10.20.193.4:0/3543480721 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbb3c0b5760 msgr2=0x7fbb3c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbb3c0b5760 0x7fbb3c0d5c10 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb580023d0 tx=0x7fbb58031040 comp rx=0 tx=0).stop 2026-02-24T09:09:31.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 -- 10.20.193.4:0/3543480721 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbb6810bf30 msgr2=0x7fbb68161320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbb6810bf30 0x7fbb68161320 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb54005db0 tx=0x7fbb5400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 -- 10.20.193.4:0/3543480721 shutdown_connections 2026-02-24T09:09:31.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbb3c0b5760 0x7fbb3c0d5c10 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb68155c60 0x7fbb68166c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbb6810c840 0x7fbb68161860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 --2- 10.20.193.4:0/3543480721 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbb6810bf30 0x7fbb68161320 unknown :-1 s=CLOSED pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 -- 10.20.193.4:0/3543480721 >> 10.20.193.4:0/3543480721 conn(0x7fbb680e9bf0 msgr2=0x7fbb68109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:31.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 -- 10.20.193.4:0/3543480721 shutdown_connections 2026-02-24T09:09:31.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.537+0000 7fbb6df5f640 1 -- 10.20.193.4:0/3543480721 wait complete. 2026-02-24T09:09:31.576 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-24T09:09:31.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:31 trial090 ceph-mon[47278]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:31.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:31 trial090 ceph-mon[47278]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:31.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:31 trial014 ceph-mon[46941]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:31.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:31 trial014 ceph-mon[46941]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:31.694 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:31.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 -- 10.20.193.4:0/1132703980 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66b4115470 msgr2=0x7f66b4175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 --2- 10.20.193.4:0/1132703980 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66b4115470 0x7f66b4175e40 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=2552224201812435684 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66b000aa30 tx=0x7f66b0030280 comp rx=0 tx=0).stop 2026-02-24T09:09:31.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 -- 10.20.193.4:0/1132703980 shutdown_connections 2026-02-24T09:09:31.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 --2- 10.20.193.4:0/1132703980 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66b4115470 0x7f66b4175e40 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=2552224201812435684 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 --2- 10.20.193.4:0/1132703980 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66b410fc70 0x7f66b4114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 --2- 10.20.193.4:0/1132703980 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66b410f280 0x7f66b410f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 -- 10.20.193.4:0/1132703980 >> 10.20.193.4:0/1132703980 conn(0x7f66b405f830 msgr2=0x7f66b410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:31.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 -- 10.20.193.4:0/1132703980 shutdown_connections 2026-02-24T09:09:31.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 -- 10.20.193.4:0/1132703980 wait complete. 2026-02-24T09:09:31.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 Processor -- start 2026-02-24T09:09:31.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 -- start start 2026-02-24T09:09:31.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66b410f280 0x7f66b411dc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66b410fc70 0x7f66b411e150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66b4115470 0x7f66b4123520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f66b4123b40 con 0x7f66b4115470 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f66b4123cb0 con 0x7f66b410fc70 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66bb3a8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66b4123e70 con 0x7f66b410f280 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b991e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66b4115470 0x7f66b4123520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b991e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66b4115470 0x7f66b4123520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42918/0 (socket says 10.20.193.4:42918) 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b991e640 1 -- 10.20.193.4:0/2059541129 learned_addr learned my addr 10.20.193.4:0/2059541129 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b911d640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66b410f280 0x7f66b411dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b891c640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66b410fc70 0x7f66b411e150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b991e640 1 -- 10.20.193.4:0/2059541129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66b410f280 msgr2=0x7f66b411dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b991e640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66b410f280 0x7f66b411dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b991e640 1 -- 10.20.193.4:0/2059541129 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66b410fc70 msgr2=0x7f66b411e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b991e640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66b410fc70 0x7f66b411e150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b991e640 1 -- 10.20.193.4:0/2059541129 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b000a650 con 0x7f66b4115470 2026-02-24T09:09:31.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b891c640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66b410fc70 0x7f66b411e150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:31.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.796+0000 7f66b991e640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66b4115470 0x7f66b4123520 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66b0005900 tx=0x7f66b00039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:31.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.797+0000 7f66a27fc640 1 -- 10.20.193.4:0/2059541129 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66b003e070 con 0x7f66b4115470 2026-02-24T09:09:31.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.797+0000 7f66a27fc640 1 -- 10.20.193.4:0/2059541129 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66b00055a0 con 0x7f66b4115470 2026-02-24T09:09:31.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.797+0000 7f66bb3a8640 1 -- 10.20.193.4:0/2059541129 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b41240f0 con 0x7f66b4115470 2026-02-24T09:09:31.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.797+0000 7f66a27fc640 1 -- 10.20.193.4:0/2059541129 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66b0042960 con 0x7f66b4115470 2026-02-24T09:09:31.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.797+0000 7f66bb3a8640 1 -- 10.20.193.4:0/2059541129 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b4164850 con 0x7f66b4115470 2026-02-24T09:09:31.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.797+0000 7f66bb3a8640 1 -- 10.20.193.4:0/2059541129 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b41243c0 con 0x7f66b4115470 2026-02-24T09:09:31.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.799+0000 7f66a27fc640 1 -- 10.20.193.4:0/2059541129 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f66b0039b80 con 0x7f66b4115470 2026-02-24T09:09:31.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.799+0000 7f66a27fc640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66900b5760 0x7f66900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:31.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.799+0000 7f66b911d640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66900b5760 0x7f66900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:31.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.799+0000 7f66a27fc640 1 -- 10.20.193.4:0/2059541129 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f66b010c690 con 0x7f66b4115470 2026-02-24T09:09:31.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.800+0000 7f66b911d640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66900b5760 0x7f66900d5c10 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a4004740 tx=0x7f66a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:31.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.800+0000 7f66a27fc640 1 -- 10.20.193.4:0/2059541129 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f66b00cf140 con 0x7f66b4115470 2026-02-24T09:09:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.928+0000 7f66bb3a8640 1 -- 10.20.193.4:0/2059541129 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f66b411ed70 con 0x7f66900b5760 2026-02-24T09:09:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.930+0000 7f66a27fc640 1 -- 10.20.193.4:0/2059541129 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f66b411ed70 con 0x7f66900b5760 2026-02-24T09:09:31.933 INFO:teuthology.orchestra.run.trial004.stdout:/volumes/qa/sv_1/b9a35c6a-b2c2-4a63-877b-bc71ed48210e 2026-02-24T09:09:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 -- 10.20.193.4:0/2059541129 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66900b5760 msgr2=0x7f66900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66900b5760 0x7f66900d5c10 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a4004740 tx=0x7f66a4005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:31.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 -- 10.20.193.4:0/2059541129 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66b4115470 msgr2=0x7f66b4123520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:31.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66b4115470 0x7f66b4123520 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66b0005900 tx=0x7f66b00039b0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 -- 10.20.193.4:0/2059541129 shutdown_connections 2026-02-24T09:09:31.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66900b5760 0x7f66900d5c10 unknown :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66b4115470 0x7f66b4123520 unknown :-1 s=CLOSED pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66b410fc70 0x7f66b411e150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 --2- 10.20.193.4:0/2059541129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66b410f280 0x7f66b411dc10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:31.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 -- 10.20.193.4:0/2059541129 >> 10.20.193.4:0/2059541129 conn(0x7f66b405f830 msgr2=0x7f66b410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:31.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 -- 10.20.193.4:0/2059541129 shutdown_connections 2026-02-24T09:09:31.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:31.932+0000 7f66bb3a8640 1 -- 10.20.193.4:0/2059541129 wait complete. 2026-02-24T09:09:31.970 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:32.088 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.188+0000 7f245722c640 1 -- 10.20.193.4:0/1521689609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f245010f280 msgr2=0x7f245010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.188+0000 7f245722c640 1 --2- 10.20.193.4:0/1521689609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f245010f280 0x7f245010f650 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=15374535474601014282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2440009950 tx=0x7f244002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.188+0000 7f245722c640 1 -- 10.20.193.4:0/1521689609 shutdown_connections 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.188+0000 7f245722c640 1 --2- 10.20.193.4:0/1521689609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2450115470 0x7f2450175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.188+0000 7f245722c640 1 --2- 10.20.193.4:0/1521689609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f245010fc70 0x7f2450114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.188+0000 7f245722c640 1 --2- 10.20.193.4:0/1521689609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f245010f280 0x7f245010f650 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=15374535474601014282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.188+0000 7f245722c640 1 -- 10.20.193.4:0/1521689609 >> 10.20.193.4:0/1521689609 conn(0x7f245005f830 msgr2=0x7f245010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.188+0000 7f245722c640 1 -- 10.20.193.4:0/1521689609 shutdown_connections 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.188+0000 7f245722c640 1 -- 10.20.193.4:0/1521689609 wait complete. 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f245722c640 1 Processor -- start 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f245722c640 1 -- start start 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f245722c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f245010f280 0x7f245011db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f245722c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f245010fc70 0x7f245011e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f245722c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2450115470 0x7f2450123470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f245722c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2450123a90 con 0x7f245010fc70 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f245722c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2450123c00 con 0x7f245010f280 2026-02-24T09:09:32.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f245722c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2450123dc0 con 0x7f2450115470 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2447fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f245010fc70 0x7f245011e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2447fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f245010fc70 0x7f245011e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42936/0 (socket says 10.20.193.4:42936) 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2447fff640 1 -- 10.20.193.4:0/3673924957 learned_addr learned my addr 10.20.193.4:0/3673924957 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2454fa1640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f245010f280 0x7f245011db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f24557a2640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2450115470 0x7f2450123470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2447fff640 1 -- 10.20.193.4:0/3673924957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2450115470 msgr2=0x7f2450123470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2447fff640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2450115470 0x7f2450123470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2447fff640 1 -- 10.20.193.4:0/3673924957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f245010f280 msgr2=0x7f245011db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2447fff640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f245010f280 0x7f245011db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2447fff640 1 -- 10.20.193.4:0/3673924957 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2440009570 con 0x7f245010fc70 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f24557a2640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2450115470 0x7f2450123470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2447fff640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f245010fc70 0x7f245011e0a0 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2438009480 tx=0x7f243800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2445ffb640 1 -- 10.20.193.4:0/3673924957 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f243800cd40 con 0x7f245010fc70 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2445ffb640 1 -- 10.20.193.4:0/3673924957 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2438004d30 con 0x7f245010fc70 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f245722c640 1 -- 10.20.193.4:0/3673924957 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24501240a0 con 0x7f245010fc70 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f2445ffb640 1 -- 10.20.193.4:0/3673924957 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24380106b0 con 0x7f245010fc70 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.189+0000 7f245722c640 1 -- 10.20.193.4:0/3673924957 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24501647a0 con 0x7f245010fc70 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.190+0000 7f245722c640 1 -- 10.20.193.4:0/3673924957 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2450110560 con 0x7f245010fc70 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.191+0000 7f2445ffb640 1 -- 10.20.193.4:0/3673924957 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 16) ==== 157121+0+0 (secure 0 0 0) 0x7f243801f060 con 0x7f245010fc70 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.192+0000 7f2445ffb640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f242c0b56e0 0x7f242c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.192+0000 7f2445ffb640 1 -- 10.20.193.4:0/3673924957 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f2438014070 con 0x7f245010fc70 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.192+0000 7f2454fa1640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f242c0b56e0 0x7f242c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.192+0000 7f2454fa1640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f242c0b56e0 0x7f242c0d5b90 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24400023d0 tx=0x7f2440031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:32.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.193+0000 7f2445ffb640 1 -- 10.20.193.4:0/3673924957 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f24380a98e0 con 0x7f245010fc70 2026-02-24T09:09:32.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.290+0000 7f2445ffb640 1 -- 10.20.193.4:0/3673924957 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f24380050b0 con 0x7f245010fc70 2026-02-24T09:09:32.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.330+0000 7f245722c640 1 -- 10.20.193.4:0/3673924957 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f245010f650 con 0x7f245010fc70 2026-02-24T09:09:32.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.330+0000 7f2445ffb640 1 -- 10.20.193.4:0/3673924957 <== mon.0 v2:10.20.193.4:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+11882 (secure 0 0 0) 0x7f24380970f0 con 0x7f245010fc70 2026-02-24T09:09:32.334 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:32.334 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":18,"btime":"2026-02-24T09:09:29:940018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:29.940013+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24637,24625,24620]},"id":1}]} 2026-02-24T09:09:32.335 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 18 2026-02-24T09:09:32.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.332+0000 7f245722c640 1 -- 10.20.193.4:0/3673924957 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f242c0b56e0 msgr2=0x7f242c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.332+0000 7f245722c640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f242c0b56e0 0x7f242c0d5b90 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24400023d0 tx=0x7f2440031040 comp rx=0 tx=0).stop 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.332+0000 7f245722c640 1 -- 10.20.193.4:0/3673924957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f245010fc70 msgr2=0x7f245011e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.332+0000 7f245722c640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f245010fc70 0x7f245011e0a0 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2438009480 tx=0x7f243800ee60 comp rx=0 tx=0).stop 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.332+0000 7f245722c640 1 -- 10.20.193.4:0/3673924957 shutdown_connections 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.332+0000 7f245722c640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f242c0b56e0 0x7f242c0d5b90 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.332+0000 7f245722c640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2450115470 0x7f2450123470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.332+0000 7f245722c640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f245010fc70 0x7f245011e0a0 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.332+0000 7f245722c640 1 --2- 10.20.193.4:0/3673924957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f245010f280 0x7f245011db60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.332+0000 7f245722c640 1 -- 10.20.193.4:0/3673924957 >> 10.20.193.4:0/3673924957 conn(0x7f245005f830 msgr2=0x7f245010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.333+0000 7f245722c640 1 -- 10.20.193.4:0/3673924957 shutdown_connections 2026-02-24T09:09:32.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.333+0000 7f245722c640 1 -- 10.20.193.4:0/3673924957 wait complete. 2026-02-24T09:09:32.374 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:09:32.492 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:32.541 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:32 trial004 ceph-mon[41596]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:32.541 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:32 trial004 ceph-mon[41596]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:32.541 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:32 trial004 ceph-mon[41596]: pgmap v140: 97 pgs: 97 active+clean; 580 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 828 B/s rd, 4.5 KiB/s wr, 12 op/s 2026-02-24T09:09:32.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:32 trial090 ceph-mon[47278]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:32.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:32 trial090 ceph-mon[47278]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:32.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:32 trial090 ceph-mon[47278]: pgmap v140: 97 pgs: 97 active+clean; 580 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 828 B/s rd, 4.5 KiB/s wr, 12 op/s 2026-02-24T09:09:32.592 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:32 trial014 ceph-mon[46941]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:32.592 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:32 trial014 ceph-mon[46941]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:32.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:32 trial014 ceph-mon[46941]: pgmap v140: 97 pgs: 97 active+clean; 580 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 828 B/s rd, 4.5 KiB/s wr, 12 op/s 2026-02-24T09:09:32.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.591+0000 7fea8a160640 1 -- 10.20.193.4:0/2649985526 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fea8410fc70 msgr2=0x7fea84114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.591+0000 7fea8a160640 1 --2- 10.20.193.4:0/2649985526 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fea8410fc70 0x7fea84114cc0 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=4305787994314196329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea74009950 tx=0x7fea7402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.591+0000 7fea8a160640 1 -- 10.20.193.4:0/2649985526 shutdown_connections 2026-02-24T09:09:32.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.591+0000 7fea8a160640 1 --2- 10.20.193.4:0/2649985526 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fea84115470 0x7fea84175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.591+0000 7fea8a160640 1 --2- 10.20.193.4:0/2649985526 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fea8410fc70 0x7fea84114cc0 unknown :-1 s=CLOSED pgs=258 gs=1 cs=0 l=1 c_cookie=4305787994314196329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.591+0000 7fea8a160640 1 --2- 10.20.193.4:0/2649985526 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fea8410f280 0x7fea8410f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.591+0000 7fea8a160640 1 -- 10.20.193.4:0/2649985526 >> 10.20.193.4:0/2649985526 conn(0x7fea8405f830 msgr2=0x7fea8410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:32.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea8a160640 1 -- 10.20.193.4:0/2649985526 shutdown_connections 2026-02-24T09:09:32.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea8a160640 1 -- 10.20.193.4:0/2649985526 wait complete. 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea8a160640 1 Processor -- start 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea8a160640 1 -- start start 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea8a160640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fea8410f280 0x7fea840f5540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea8a160640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fea8410fc70 0x7fea84175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea8a160640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fea84115470 0x7fea840f5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea8a160640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fea840fae50 con 0x7fea84115470 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea8a160640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fea840fafc0 con 0x7fea8410fc70 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea8a160640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fea840fb180 con 0x7fea8410f280 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea83fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fea84115470 0x7fea840f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea83fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fea84115470 0x7fea840f5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42964/0 (socket says 10.20.193.4:42964) 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea83fff640 1 -- 10.20.193.4:0/2449338297 learned_addr learned my addr 10.20.193.4:0/2449338297 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea82ffd640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fea8410fc70 0x7fea84175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea837fe640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fea8410f280 0x7fea840f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea83fff640 1 -- 10.20.193.4:0/2449338297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fea8410f280 msgr2=0x7fea840f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea83fff640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fea8410f280 0x7fea840f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea83fff640 1 -- 10.20.193.4:0/2449338297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fea8410fc70 msgr2=0x7fea84175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea83fff640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fea8410fc70 0x7fea84175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea83fff640 1 -- 10.20.193.4:0/2449338297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea74009570 con 0x7fea84115470 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea83fff640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fea84115470 0x7fea840f5c40 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea7800f8d0 tx=0x7fea7800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.592+0000 7fea80ff9640 1 -- 10.20.193.4:0/2449338297 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea7800dce0 con 0x7fea84115470 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.593+0000 7fea8a160640 1 -- 10.20.193.4:0/2449338297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea840fb460 con 0x7fea84115470 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.593+0000 7fea80ff9640 1 -- 10.20.193.4:0/2449338297 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fea7800de40 con 0x7fea84115470 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.593+0000 7fea80ff9640 1 -- 10.20.193.4:0/2449338297 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea78011740 con 0x7fea84115470 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.593+0000 7fea8a160640 1 -- 10.20.193.4:0/2449338297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea840fb980 con 0x7fea84115470 2026-02-24T09:09:32.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.593+0000 7fea8a160640 1 -- 10.20.193.4:0/2449338297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea84110560 con 0x7fea84115470 2026-02-24T09:09:32.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.594+0000 7fea80ff9640 1 -- 10.20.193.4:0/2449338297 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fea78020060 con 0x7fea84115470 2026-02-24T09:09:32.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.595+0000 7fea80ff9640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fea580b5760 0x7fea580d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.595+0000 7fea837fe640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fea580b5760 0x7fea580d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.595+0000 7fea80ff9640 1 -- 10.20.193.4:0/2449338297 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fea78015070 con 0x7fea84115470 2026-02-24T09:09:32.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.595+0000 7fea837fe640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fea580b5760 0x7fea580d5c10 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea70004740 tx=0x7fea70005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:32.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.596+0000 7fea80ff9640 1 -- 10.20.193.4:0/2449338297 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fea780aa850 con 0x7fea84115470 2026-02-24T09:09:32.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.702+0000 7fea8a160640 1 -- 10.20.193.4:0/2449338297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea8410f650 con 0x7fea84115470 2026-02-24T09:09:32.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.703+0000 7fea80ff9640 1 -- 10.20.193.4:0/2449338297 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22231 (secure 0 0 0) 0x7fea78020340 con 0x7fea84115470 2026-02-24T09:09:32.706 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:32.707 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":75,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:26.263940+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:32.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 -- 10.20.193.4:0/2449338297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fea580b5760 msgr2=0x7fea580d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fea580b5760 0x7fea580d5c10 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea70004740 tx=0x7fea70005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 -- 10.20.193.4:0/2449338297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fea84115470 msgr2=0x7fea840f5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fea84115470 0x7fea840f5c40 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea7800f8d0 tx=0x7fea7800fda0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 -- 10.20.193.4:0/2449338297 shutdown_connections 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fea580b5760 0x7fea580d5c10 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fea84115470 0x7fea840f5c40 unknown :-1 s=CLOSED pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fea8410fc70 0x7fea84175d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 --2- 10.20.193.4:0/2449338297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fea8410f280 0x7fea840f5540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 -- 10.20.193.4:0/2449338297 >> 10.20.193.4:0/2449338297 conn(0x7fea8405f830 msgr2=0x7fea84111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 -- 10.20.193.4:0/2449338297 shutdown_connections 2026-02-24T09:09:32.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.704+0000 7fea8a160640 1 -- 10.20.193.4:0/2449338297 wait complete. 2026-02-24T09:09:32.743 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T09:09:32.743 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:09:32.857 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:32.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 -- 10.20.193.4:0/2974936921 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe25010bf60 msgr2=0x7fe25010c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 --2- 10.20.193.4:0/2974936921 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe25010bf60 0x7fe25010c330 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=1028027888908169015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe244009980 tx=0x7fe24402f180 comp rx=0 tx=0).stop 2026-02-24T09:09:32.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 -- 10.20.193.4:0/2974936921 shutdown_connections 2026-02-24T09:09:32.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 --2- 10.20.193.4:0/2974936921 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe250111540 0x7fe2501119e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 --2- 10.20.193.4:0/2974936921 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe25010c950 0x7fe250110f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 --2- 10.20.193.4:0/2974936921 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe25010bf60 0x7fe25010c330 unknown :-1 s=CLOSED pgs=260 gs=1 cs=0 l=1 c_cookie=1028027888908169015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 -- 10.20.193.4:0/2974936921 >> 10.20.193.4:0/2974936921 conn(0x7fe2500e9bf0 msgr2=0x7fe25010a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 -- 10.20.193.4:0/2974936921 shutdown_connections 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 -- 10.20.193.4:0/2974936921 wait complete. 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 Processor -- start 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.961+0000 7fe255a3f640 1 -- start start 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe255a3f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe25010bf60 0x7fe2501228b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe255a3f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe25010c950 0x7fe250122df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe255a3f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe250111540 0x7fe2501281c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe255a3f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe2501287e0 con 0x7fe25010bf60 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe255a3f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe250128950 con 0x7fe250111540 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe255a3f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe250128b10 con 0x7fe25010c950 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe25010bf60 0x7fe2501228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe25010bf60 0x7fe2501228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42982/0 (socket says 10.20.193.4:42982) 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24effd640 1 -- 10.20.193.4:0/3607839714 learned_addr learned my addr 10.20.193.4:0/3607839714 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24e7fc640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe25010c950 0x7fe250122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24f7fe640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe250111540 0x7fe2501281c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24effd640 1 -- 10.20.193.4:0/3607839714 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe25010c950 msgr2=0x7fe250122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24effd640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe25010c950 0x7fe250122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24effd640 1 -- 10.20.193.4:0/3607839714 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe250111540 msgr2=0x7fe2501281c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24effd640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe250111540 0x7fe2501281c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24effd640 1 -- 10.20.193.4:0/3607839714 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe244009570 con 0x7fe25010bf60 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe24effd640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe25010bf60 0x7fe2501228b0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2440028d0 tx=0x7fe244002900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe254a3d640 1 -- 10.20.193.4:0/3607839714 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe24403d070 con 0x7fe25010bf60 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe254a3d640 1 -- 10.20.193.4:0/3607839714 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe244002aa0 con 0x7fe25010bf60 2026-02-24T09:09:32.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe255a3f640 1 -- 10.20.193.4:0/3607839714 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe250128df0 con 0x7fe25010bf60 2026-02-24T09:09:32.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe254a3d640 1 -- 10.20.193.4:0/3607839714 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe244041a90 con 0x7fe25010bf60 2026-02-24T09:09:32.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe255a3f640 1 -- 10.20.193.4:0/3607839714 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2501694f0 con 0x7fe25010bf60 2026-02-24T09:09:32.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.962+0000 7fe255a3f640 1 -- 10.20.193.4:0/3607839714 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe250060420 con 0x7fe25010bf60 2026-02-24T09:09:32.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.964+0000 7fe254a3d640 1 -- 10.20.193.4:0/3607839714 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fe244038740 con 0x7fe25010bf60 2026-02-24T09:09:32.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.964+0000 7fe254a3d640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe2240b5770 0x7fe2240d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:32.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.964+0000 7fe254a3d640 1 -- 10.20.193.4:0/3607839714 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fe24410bbf0 con 0x7fe25010bf60 2026-02-24T09:09:32.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.964+0000 7fe24e7fc640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe2240b5770 0x7fe2240d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:32.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.965+0000 7fe24e7fc640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe2240b5770 0x7fe2240d5c20 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe250129250 tx=0x7fe238004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:32.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:32.965+0000 7fe254a3d640 1 -- 10.20.193.4:0/3607839714 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe2440ce690 con 0x7fe25010bf60 2026-02-24T09:09:33.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.067+0000 7fe255a3f640 1 -- 10.20.193.4:0/3607839714 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe250123a10 con 0x7fe2240b5770 2026-02-24T09:09:33.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.070+0000 7fe254a3d640 1 -- 10.20.193.4:0/3607839714 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258870 (secure 0 0 0) 0x7fe250123a10 con 0x7fe2240b5770 2026-02-24T09:09:33.077 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:33.080 INFO:teuthology.orchestra.run.trial004.stderr:dumped all 2026-02-24T09:09:33.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 -- 10.20.193.4:0/3607839714 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe2240b5770 msgr2=0x7fe2240d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe2240b5770 0x7fe2240d5c20 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe250129250 tx=0x7fe238004420 comp rx=0 tx=0).stop 2026-02-24T09:09:33.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 -- 10.20.193.4:0/3607839714 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe25010bf60 msgr2=0x7fe2501228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe25010bf60 0x7fe2501228b0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2440028d0 tx=0x7fe244002900 comp rx=0 tx=0).stop 2026-02-24T09:09:33.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 -- 10.20.193.4:0/3607839714 shutdown_connections 2026-02-24T09:09:33.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe2240b5770 0x7fe2240d5c20 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe250111540 0x7fe2501281c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe25010c950 0x7fe250122df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 --2- 10.20.193.4:0/3607839714 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe25010bf60 0x7fe2501228b0 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 -- 10.20.193.4:0/3607839714 >> 10.20.193.4:0/3607839714 conn(0x7fe2500e9bf0 msgr2=0x7fe250109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:33.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 -- 10.20.193.4:0/3607839714 shutdown_connections 2026-02-24T09:09:33.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.072+0000 7fe255a3f640 1 -- 10.20.193.4:0/3607839714 wait complete. 2026-02-24T09:09:33.113 INFO:teuthology.orchestra.run.trial004.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2026-02-24T09:09:31.664527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593734,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":112,"num_read_kb":97,"num_write":278,"num_write_kb":3749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":251,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333356,"kb_used_data":9788,"kb_used_omap":356,"kb_used_meta":322971,"kb_avail":8807705044,"statfs":{"total":9019431321600,"available":9019089965056,"internally_reserved":0,"allocated":10022912,"data_stored":6514105,"data_compressed":113181,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":364684,"internal_metadata":330723188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3366,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":89,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.414828"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332664+0000","last_change":"2026-02-24T09:09:25.267627+0000","last_active":"2026-02-24T09:09:26.332664+0000","last_peered":"2026-02-24T09:09:26.332664+0000","last_clean":"2026-02-24T09:09:26.332664+0000","last_became_active":"2026-02-24T09:09:25.267439+0000","last_became_peered":"2026-02-24T09:09:25.267439+0000","last_unstale":"2026-02-24T09:09:26.332664+0000","last_undegraded":"2026-02-24T09:09:26.332664+0000","last_fullsized":"2026-02-24T09:09:26.332664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:24.034680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267727+0000","last_change":"2026-02-24T09:09:25.267299+0000","last_active":"2026-02-24T09:09:26.267727+0000","last_peered":"2026-02-24T09:09:26.267727+0000","last_clean":"2026-02-24T09:09:26.267727+0000","last_became_active":"2026-02-24T09:09:25.266956+0000","last_became_peered":"2026-02-24T09:09:25.266956+0000","last_unstale":"2026-02-24T09:09:26.267727+0000","last_undegraded":"2026-02-24T09:09:26.267727+0000","last_fullsized":"2026-02-24T09:09:26.267727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:05.466777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267738+0000","last_change":"2026-02-24T09:09:25.268761+0000","last_active":"2026-02-24T09:09:26.267738+0000","last_peered":"2026-02-24T09:09:26.267738+0000","last_clean":"2026-02-24T09:09:26.267738+0000","last_became_active":"2026-02-24T09:09:25.268476+0000","last_became_peered":"2026-02-24T09:09:25.268476+0000","last_unstale":"2026-02-24T09:09:26.267738+0000","last_undegraded":"2026-02-24T09:09:26.267738+0000","last_fullsized":"2026-02-24T09:09:26.267738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:26:00.680116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335046+0000","last_change":"2026-02-24T09:09:25.271303+0000","last_active":"2026-02-24T09:09:26.335046+0000","last_peered":"2026-02-24T09:09:26.335046+0000","last_clean":"2026-02-24T09:09:26.335046+0000","last_became_active":"2026-02-24T09:09:25.271175+0000","last_became_peered":"2026-02-24T09:09:25.271175+0000","last_unstale":"2026-02-24T09:09:26.335046+0000","last_undegraded":"2026-02-24T09:09:26.335046+0000","last_fullsized":"2026-02-24T09:09:26.335046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:55:25.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267634+0000","last_change":"2026-02-24T09:09:25.267923+0000","last_active":"2026-02-24T09:09:26.267634+0000","last_peered":"2026-02-24T09:09:26.267634+0000","last_clean":"2026-02-24T09:09:26.267634+0000","last_became_active":"2026-02-24T09:09:25.267775+0000","last_became_peered":"2026-02-24T09:09:25.267775+0000","last_unstale":"2026-02-24T09:09:26.267634+0000","last_undegraded":"2026-02-24T09:09:26.267634+0000","last_fullsized":"2026-02-24T09:09:26.267634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:54:25.575849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270023+0000","last_change":"2026-02-24T09:09:25.269603+0000","last_active":"2026-02-24T09:09:26.270023+0000","last_peered":"2026-02-24T09:09:26.270023+0000","last_clean":"2026-02-24T09:09:26.270023+0000","last_became_active":"2026-02-24T09:09:25.269057+0000","last_became_peered":"2026-02-24T09:09:25.269057+0000","last_unstale":"2026-02-24T09:09:26.270023+0000","last_undegraded":"2026-02-24T09:09:26.270023+0000","last_fullsized":"2026-02-24T09:09:26.270023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:39:21.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733238+0000","last_change":"2026-02-24T09:09:25.270852+0000","last_active":"2026-02-24T09:09:26.733238+0000","last_peered":"2026-02-24T09:09:26.733238+0000","last_clean":"2026-02-24T09:09:26.733238+0000","last_became_active":"2026-02-24T09:09:25.270607+0000","last_became_peered":"2026-02-24T09:09:25.270607+0000","last_unstale":"2026-02-24T09:09:26.733238+0000","last_undegraded":"2026-02-24T09:09:26.733238+0000","last_fullsized":"2026-02-24T09:09:26.733238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:45:43.574810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268619+0000","last_change":"2026-02-24T09:09:25.268833+0000","last_active":"2026-02-24T09:09:26.268619+0000","last_peered":"2026-02-24T09:09:26.268619+0000","last_clean":"2026-02-24T09:09:26.268619+0000","last_became_active":"2026-02-24T09:09:25.268462+0000","last_became_peered":"2026-02-24T09:09:25.268462+0000","last_unstale":"2026-02-24T09:09:26.268619+0000","last_undegraded":"2026-02-24T09:09:26.268619+0000","last_fullsized":"2026-02-24T09:09:26.268619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:47.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334895+0000","last_change":"2026-02-24T09:09:25.271419+0000","last_active":"2026-02-24T09:09:26.334895+0000","last_peered":"2026-02-24T09:09:26.334895+0000","last_clean":"2026-02-24T09:09:26.334895+0000","last_became_active":"2026-02-24T09:09:25.270954+0000","last_became_peered":"2026-02-24T09:09:25.270954+0000","last_unstale":"2026-02-24T09:09:26.334895+0000","last_undegraded":"2026-02-24T09:09:26.334895+0000","last_fullsized":"2026-02-24T09:09:26.334895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:07:15.889565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270286+0000","last_change":"2026-02-24T09:09:25.269709+0000","last_active":"2026-02-24T09:09:26.270286+0000","last_peered":"2026-02-24T09:09:26.270286+0000","last_clean":"2026-02-24T09:09:26.270286+0000","last_became_active":"2026-02-24T09:09:25.269136+0000","last_became_peered":"2026-02-24T09:09:25.269136+0000","last_unstale":"2026-02-24T09:09:26.270286+0000","last_undegraded":"2026-02-24T09:09:26.270286+0000","last_fullsized":"2026-02-24T09:09:26.270286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:42:02.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733508+0000","last_change":"2026-02-24T09:09:25.272025+0000","last_active":"2026-02-24T09:09:26.733508+0000","last_peered":"2026-02-24T09:09:26.733508+0000","last_clean":"2026-02-24T09:09:26.733508+0000","last_became_active":"2026-02-24T09:09:25.271851+0000","last_became_peered":"2026-02-24T09:09:25.271851+0000","last_unstale":"2026-02-24T09:09:26.733508+0000","last_undegraded":"2026-02-24T09:09:26.733508+0000","last_fullsized":"2026-02-24T09:09:26.733508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:49:57.365130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335160+0000","last_change":"2026-02-24T09:09:25.271156+0000","last_active":"2026-02-24T09:09:26.335160+0000","last_peered":"2026-02-24T09:09:26.335160+0000","last_clean":"2026-02-24T09:09:26.335160+0000","last_became_active":"2026-02-24T09:09:25.270992+0000","last_became_peered":"2026-02-24T09:09:25.270992+0000","last_unstale":"2026-02-24T09:09:26.335160+0000","last_undegraded":"2026-02-24T09:09:26.335160+0000","last_fullsized":"2026-02-24T09:09:26.335160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:56.324038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332309+0000","last_change":"2026-02-24T09:09:25.266871+0000","last_active":"2026-02-24T09:09:26.332309+0000","last_peered":"2026-02-24T09:09:26.332309+0000","last_clean":"2026-02-24T09:09:26.332309+0000","last_became_active":"2026-02-24T09:09:25.266438+0000","last_became_peered":"2026-02-24T09:09:25.266438+0000","last_unstale":"2026-02-24T09:09:26.332309+0000","last_undegraded":"2026-02-24T09:09:26.332309+0000","last_fullsized":"2026-02-24T09:09:26.332309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:24:17.014313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267591+0000","last_change":"2026-02-24T09:09:25.266851+0000","last_active":"2026-02-24T09:09:26.267591+0000","last_peered":"2026-02-24T09:09:26.267591+0000","last_clean":"2026-02-24T09:09:26.267591+0000","last_became_active":"2026-02-24T09:09:25.266530+0000","last_became_peered":"2026-02-24T09:09:25.266530+0000","last_unstale":"2026-02-24T09:09:26.267591+0000","last_undegraded":"2026-02-24T09:09:26.267591+0000","last_fullsized":"2026-02-24T09:09:26.267591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:53.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267465+0000","last_change":"2026-02-24T09:09:25.269561+0000","last_active":"2026-02-24T09:09:26.267465+0000","last_peered":"2026-02-24T09:09:26.267465+0000","last_clean":"2026-02-24T09:09:26.267465+0000","last_became_active":"2026-02-24T09:09:25.268979+0000","last_became_peered":"2026-02-24T09:09:25.268979+0000","last_unstale":"2026-02-24T09:09:26.267465+0000","last_undegraded":"2026-02-24T09:09:26.267465+0000","last_fullsized":"2026-02-24T09:09:26.267465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:16:56.110766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334540+0000","last_change":"2026-02-24T09:09:25.271426+0000","last_active":"2026-02-24T09:09:26.334540+0000","last_peered":"2026-02-24T09:09:26.334540+0000","last_clean":"2026-02-24T09:09:26.334540+0000","last_became_active":"2026-02-24T09:09:25.270917+0000","last_became_peered":"2026-02-24T09:09:25.270917+0000","last_unstale":"2026-02-24T09:09:26.334540+0000","last_undegraded":"2026-02-24T09:09:26.334540+0000","last_fullsized":"2026-02-24T09:09:26.334540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:58:52.125871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332673+0000","last_change":"2026-02-24T09:09:25.267238+0000","last_active":"2026-02-24T09:09:26.332673+0000","last_peered":"2026-02-24T09:09:26.332673+0000","last_clean":"2026-02-24T09:09:26.332673+0000","last_became_active":"2026-02-24T09:09:25.267060+0000","last_became_peered":"2026-02-24T09:09:25.267060+0000","last_unstale":"2026-02-24T09:09:26.332673+0000","last_undegraded":"2026-02-24T09:09:26.332673+0000","last_fullsized":"2026-02-24T09:09:26.332673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:00:58.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267495+0000","last_change":"2026-02-24T09:09:25.266005+0000","last_active":"2026-02-24T09:09:26.267495+0000","last_peered":"2026-02-24T09:09:26.267495+0000","last_clean":"2026-02-24T09:09:26.267495+0000","last_became_active":"2026-02-24T09:09:25.265847+0000","last_became_peered":"2026-02-24T09:09:25.265847+0000","last_unstale":"2026-02-24T09:09:26.267495+0000","last_undegraded":"2026-02-24T09:09:26.267495+0000","last_fullsized":"2026-02-24T09:09:26.267495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:29:02.137351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332638+0000","last_change":"2026-02-24T09:09:25.268822+0000","last_active":"2026-02-24T09:09:26.332638+0000","last_peered":"2026-02-24T09:09:26.332638+0000","last_clean":"2026-02-24T09:09:26.332638+0000","last_became_active":"2026-02-24T09:09:25.268683+0000","last_became_peered":"2026-02-24T09:09:25.268683+0000","last_unstale":"2026-02-24T09:09:26.332638+0000","last_undegraded":"2026-02-24T09:09:26.332638+0000","last_fullsized":"2026-02-24T09:09:26.332638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:23:58.256403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332429+0000","last_change":"2026-02-24T09:09:25.266214+0000","last_active":"2026-02-24T09:09:26.332429+0000","last_peered":"2026-02-24T09:09:26.332429+0000","last_clean":"2026-02-24T09:09:26.332429+0000","last_became_active":"2026-02-24T09:09:25.266019+0000","last_became_peered":"2026-02-24T09:09:25.266019+0000","last_unstale":"2026-02-24T09:09:26.332429+0000","last_undegraded":"2026-02-24T09:09:26.332429+0000","last_fullsized":"2026-02-24T09:09:26.332429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:17.141581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332384+0000","last_change":"2026-02-24T09:09:25.267493+0000","last_active":"2026-02-24T09:09:26.332384+0000","last_peered":"2026-02-24T09:09:26.332384+0000","last_clean":"2026-02-24T09:09:26.332384+0000","last_became_active":"2026-02-24T09:09:25.267314+0000","last_became_peered":"2026-02-24T09:09:25.267314+0000","last_unstale":"2026-02-24T09:09:26.332384+0000","last_undegraded":"2026-02-24T09:09:26.332384+0000","last_fullsized":"2026-02-24T09:09:26.332384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:59:11.536214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334717+0000","last_change":"2026-02-24T09:09:25.272131+0000","last_active":"2026-02-24T09:09:26.334717+0000","last_peered":"2026-02-24T09:09:26.334717+0000","last_clean":"2026-02-24T09:09:26.334717+0000","last_became_active":"2026-02-24T09:09:25.271680+0000","last_became_peered":"2026-02-24T09:09:25.271680+0000","last_unstale":"2026-02-24T09:09:26.334717+0000","last_undegraded":"2026-02-24T09:09:26.334717+0000","last_fullsized":"2026-02-24T09:09:26.334717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:07:33.257865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268617+0000","last_change":"2026-02-24T09:09:25.267808+0000","last_active":"2026-02-24T09:09:26.268617+0000","last_peered":"2026-02-24T09:09:26.268617+0000","last_clean":"2026-02-24T09:09:26.268617+0000","last_became_active":"2026-02-24T09:09:25.266759+0000","last_became_peered":"2026-02-24T09:09:25.266759+0000","last_unstale":"2026-02-24T09:09:26.268617+0000","last_undegraded":"2026-02-24T09:09:26.268617+0000","last_fullsized":"2026-02-24T09:09:26.268617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:55.312047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268133+0000","last_change":"2026-02-24T09:09:25.268500+0000","last_active":"2026-02-24T09:09:26.268133+0000","last_peered":"2026-02-24T09:09:26.268133+0000","last_clean":"2026-02-24T09:09:26.268133+0000","last_became_active":"2026-02-24T09:09:25.267904+0000","last_became_peered":"2026-02-24T09:09:25.267904+0000","last_unstale":"2026-02-24T09:09:26.268133+0000","last_undegraded":"2026-02-24T09:09:26.268133+0000","last_fullsized":"2026-02-24T09:09:26.268133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:38:47.330593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269021+0000","last_change":"2026-02-24T09:09:25.269694+0000","last_active":"2026-02-24T09:09:26.269021+0000","last_peered":"2026-02-24T09:09:26.269021+0000","last_clean":"2026-02-24T09:09:26.269021+0000","last_became_active":"2026-02-24T09:09:25.269068+0000","last_became_peered":"2026-02-24T09:09:25.269068+0000","last_unstale":"2026-02-24T09:09:26.269021+0000","last_undegraded":"2026-02-24T09:09:26.269021+0000","last_fullsized":"2026-02-24T09:09:26.269021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:04:44.772275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332668+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.332668+0000","last_peered":"2026-02-24T09:09:26.332668+0000","last_clean":"2026-02-24T09:09:26.332668+0000","last_became_active":"2026-02-24T09:09:25.269534+0000","last_became_peered":"2026-02-24T09:09:25.269534+0000","last_unstale":"2026-02-24T09:09:26.332668+0000","last_undegraded":"2026-02-24T09:09:26.332668+0000","last_fullsized":"2026-02-24T09:09:26.332668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:45:51.428970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332478+0000","last_change":"2026-02-24T09:09:25.266779+0000","last_active":"2026-02-24T09:09:26.332478+0000","last_peered":"2026-02-24T09:09:26.332478+0000","last_clean":"2026-02-24T09:09:26.332478+0000","last_became_active":"2026-02-24T09:09:25.266603+0000","last_became_peered":"2026-02-24T09:09:25.266603+0000","last_unstale":"2026-02-24T09:09:26.332478+0000","last_undegraded":"2026-02-24T09:09:26.332478+0000","last_fullsized":"2026-02-24T09:09:26.332478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:01:38.198458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332295+0000","last_change":"2026-02-24T09:09:25.266933+0000","last_active":"2026-02-24T09:09:26.332295+0000","last_peered":"2026-02-24T09:09:26.332295+0000","last_clean":"2026-02-24T09:09:26.332295+0000","last_became_active":"2026-02-24T09:09:25.266381+0000","last_became_peered":"2026-02-24T09:09:25.266381+0000","last_unstale":"2026-02-24T09:09:26.332295+0000","last_undegraded":"2026-02-24T09:09:26.332295+0000","last_fullsized":"2026-02-24T09:09:26.332295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:45:44.657482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267754+0000","last_change":"2026-02-24T09:09:25.269576+0000","last_active":"2026-02-24T09:09:26.267754+0000","last_peered":"2026-02-24T09:09:26.267754+0000","last_clean":"2026-02-24T09:09:26.267754+0000","last_became_active":"2026-02-24T09:09:25.269159+0000","last_became_peered":"2026-02-24T09:09:25.269159+0000","last_unstale":"2026-02-24T09:09:26.267754+0000","last_undegraded":"2026-02-24T09:09:26.267754+0000","last_fullsized":"2026-02-24T09:09:26.267754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:23:37.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332345+0000","last_change":"2026-02-24T09:09:25.269282+0000","last_active":"2026-02-24T09:09:26.332345+0000","last_peered":"2026-02-24T09:09:26.332345+0000","last_clean":"2026-02-24T09:09:26.332345+0000","last_became_active":"2026-02-24T09:09:25.269088+0000","last_became_peered":"2026-02-24T09:09:25.269088+0000","last_unstale":"2026-02-24T09:09:26.332345+0000","last_undegraded":"2026-02-24T09:09:26.332345+0000","last_fullsized":"2026-02-24T09:09:26.332345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:49.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332404+0000","last_change":"2026-02-24T09:09:25.270968+0000","last_active":"2026-02-24T09:09:26.332404+0000","last_peered":"2026-02-24T09:09:26.332404+0000","last_clean":"2026-02-24T09:09:26.332404+0000","last_became_active":"2026-02-24T09:09:25.270816+0000","last_became_peered":"2026-02-24T09:09:25.270816+0000","last_unstale":"2026-02-24T09:09:26.332404+0000","last_undegraded":"2026-02-24T09:09:26.332404+0000","last_fullsized":"2026-02-24T09:09:26.332404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:10:08.592263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332360+0000","last_change":"2026-02-24T09:09:25.267715+0000","last_active":"2026-02-24T09:09:26.332360+0000","last_peered":"2026-02-24T09:09:26.332360+0000","last_clean":"2026-02-24T09:09:26.332360+0000","last_became_active":"2026-02-24T09:09:25.267031+0000","last_became_peered":"2026-02-24T09:09:25.267031+0000","last_unstale":"2026-02-24T09:09:26.332360+0000","last_undegraded":"2026-02-24T09:09:26.332360+0000","last_fullsized":"2026-02-24T09:09:26.332360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:14:50.568512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267758+0000","last_change":"2026-02-24T09:09:25.268347+0000","last_active":"2026-02-24T09:09:26.267758+0000","last_peered":"2026-02-24T09:09:26.267758+0000","last_clean":"2026-02-24T09:09:26.267758+0000","last_became_active":"2026-02-24T09:09:25.268235+0000","last_became_peered":"2026-02-24T09:09:25.268235+0000","last_unstale":"2026-02-24T09:09:26.267758+0000","last_undegraded":"2026-02-24T09:09:26.267758+0000","last_fullsized":"2026-02-24T09:09:26.267758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:17.309082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267916+0000","last_change":"2026-02-24T09:09:24.256941+0000","last_active":"2026-02-24T09:09:26.267916+0000","last_peered":"2026-02-24T09:09:26.267916+0000","last_clean":"2026-02-24T09:09:26.267916+0000","last_became_active":"2026-02-24T09:09:24.256577+0000","last_became_peered":"2026-02-24T09:09:24.256577+0000","last_unstale":"2026-02-24T09:09:26.267916+0000","last_undegraded":"2026-02-24T09:09:26.267916+0000","last_fullsized":"2026-02-24T09:09:26.267916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:13:19.756549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268000+0000","last_change":"2026-02-24T09:09:25.270452+0000","last_active":"2026-02-24T09:09:26.268000+0000","last_peered":"2026-02-24T09:09:26.268000+0000","last_clean":"2026-02-24T09:09:26.268000+0000","last_became_active":"2026-02-24T09:09:25.270184+0000","last_became_peered":"2026-02-24T09:09:25.270184+0000","last_unstale":"2026-02-24T09:09:26.268000+0000","last_undegraded":"2026-02-24T09:09:26.268000+0000","last_fullsized":"2026-02-24T09:09:26.268000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:07:41.652941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270021+0000","last_change":"2026-02-24T09:09:24.261249+0000","last_active":"2026-02-24T09:09:26.270021+0000","last_peered":"2026-02-24T09:09:26.270021+0000","last_clean":"2026-02-24T09:09:26.270021+0000","last_became_active":"2026-02-24T09:09:24.261064+0000","last_became_peered":"2026-02-24T09:09:24.261064+0000","last_unstale":"2026-02-24T09:09:26.270021+0000","last_undegraded":"2026-02-24T09:09:26.270021+0000","last_fullsized":"2026-02-24T09:09:26.270021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:59:42.964350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941445+0000","last_change":"2026-02-24T09:09:24.254918+0000","last_active":"2026-02-24T09:09:28.941445+0000","last_peered":"2026-02-24T09:09:28.941445+0000","last_clean":"2026-02-24T09:09:28.941445+0000","last_became_active":"2026-02-24T09:09:24.254590+0000","last_became_peered":"2026-02-24T09:09:24.254590+0000","last_unstale":"2026-02-24T09:09:28.941445+0000","last_undegraded":"2026-02-24T09:09:28.941445+0000","last_fullsized":"2026-02-24T09:09:28.941445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:03:19.504844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268666+0000","last_change":"2026-02-24T09:09:25.267204+0000","last_active":"2026-02-24T09:09:26.268666+0000","last_peered":"2026-02-24T09:09:26.268666+0000","last_clean":"2026-02-24T09:09:26.268666+0000","last_became_active":"2026-02-24T09:09:25.266489+0000","last_became_peered":"2026-02-24T09:09:25.266489+0000","last_unstale":"2026-02-24T09:09:26.268666+0000","last_undegraded":"2026-02-24T09:09:26.268666+0000","last_fullsized":"2026-02-24T09:09:26.268666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:26:34.500054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268230+0000","last_change":"2026-02-24T09:09:24.258042+0000","last_active":"2026-02-24T09:09:26.268230+0000","last_peered":"2026-02-24T09:09:26.268230+0000","last_clean":"2026-02-24T09:09:26.268230+0000","last_became_active":"2026-02-24T09:09:24.257801+0000","last_became_peered":"2026-02-24T09:09:24.257801+0000","last_unstale":"2026-02-24T09:09:26.268230+0000","last_undegraded":"2026-02-24T09:09:26.268230+0000","last_fullsized":"2026-02-24T09:09:26.268230+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:27.596990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267334+0000","last_change":"2026-02-24T09:09:25.267636+0000","last_active":"2026-02-24T09:09:26.267334+0000","last_peered":"2026-02-24T09:09:26.267334+0000","last_clean":"2026-02-24T09:09:26.267334+0000","last_became_active":"2026-02-24T09:09:25.267505+0000","last_became_peered":"2026-02-24T09:09:25.267505+0000","last_unstale":"2026-02-24T09:09:26.267334+0000","last_undegraded":"2026-02-24T09:09:26.267334+0000","last_fullsized":"2026-02-24T09:09:26.267334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:20.660345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270215+0000","last_change":"2026-02-24T09:09:24.260793+0000","last_active":"2026-02-24T09:09:26.270215+0000","last_peered":"2026-02-24T09:09:26.270215+0000","last_clean":"2026-02-24T09:09:26.270215+0000","last_became_active":"2026-02-24T09:09:24.260555+0000","last_became_peered":"2026-02-24T09:09:24.260555+0000","last_unstale":"2026-02-24T09:09:26.270215+0000","last_undegraded":"2026-02-24T09:09:26.270215+0000","last_fullsized":"2026-02-24T09:09:26.270215+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:30:45.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334847+0000","last_change":"2026-02-24T09:09:25.271121+0000","last_active":"2026-02-24T09:09:26.334847+0000","last_peered":"2026-02-24T09:09:26.334847+0000","last_clean":"2026-02-24T09:09:26.334847+0000","last_became_active":"2026-02-24T09:09:25.270770+0000","last_became_peered":"2026-02-24T09:09:25.270770+0000","last_unstale":"2026-02-24T09:09:26.334847+0000","last_undegraded":"2026-02-24T09:09:26.334847+0000","last_fullsized":"2026-02-24T09:09:26.334847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:52:58.451719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940998+0000","last_change":"2026-02-24T09:09:24.259030+0000","last_active":"2026-02-24T09:09:27.940998+0000","last_peered":"2026-02-24T09:09:27.940998+0000","last_clean":"2026-02-24T09:09:27.940998+0000","last_became_active":"2026-02-24T09:09:24.258747+0000","last_became_peered":"2026-02-24T09:09:24.258747+0000","last_unstale":"2026-02-24T09:09:27.940998+0000","last_undegraded":"2026-02-24T09:09:27.940998+0000","last_fullsized":"2026-02-24T09:09:27.940998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:49:46.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267794+0000","last_change":"2026-02-24T09:09:25.269875+0000","last_active":"2026-02-24T09:09:26.267794+0000","last_peered":"2026-02-24T09:09:26.267794+0000","last_clean":"2026-02-24T09:09:26.267794+0000","last_became_active":"2026-02-24T09:09:25.269400+0000","last_became_peered":"2026-02-24T09:09:25.269400+0000","last_unstale":"2026-02-24T09:09:26.267794+0000","last_undegraded":"2026-02-24T09:09:26.267794+0000","last_fullsized":"2026-02-24T09:09:26.267794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:08:29.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268101+0000","last_change":"2026-02-24T09:09:24.256845+0000","last_active":"2026-02-24T09:09:26.268101+0000","last_peered":"2026-02-24T09:09:26.268101+0000","last_clean":"2026-02-24T09:09:26.268101+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:26.268101+0000","last_undegraded":"2026-02-24T09:09:26.268101+0000","last_fullsized":"2026-02-24T09:09:26.268101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:08:15.802226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334785+0000","last_change":"2026-02-24T09:09:25.269608+0000","last_active":"2026-02-24T09:09:26.334785+0000","last_peered":"2026-02-24T09:09:26.334785+0000","last_clean":"2026-02-24T09:09:26.334785+0000","last_became_active":"2026-02-24T09:09:25.268736+0000","last_became_peered":"2026-02-24T09:09:25.268736+0000","last_unstale":"2026-02-24T09:09:26.334785+0000","last_undegraded":"2026-02-24T09:09:26.334785+0000","last_fullsized":"2026-02-24T09:09:26.334785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:39:41.466580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'6","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270140+0000","last_change":"2026-02-24T09:09:24.260591+0000","last_active":"2026-02-24T09:09:26.270140+0000","last_peered":"2026-02-24T09:09:26.270140+0000","last_clean":"2026-02-24T09:09:26.270140+0000","last_became_active":"2026-02-24T09:09:24.260382+0000","last_became_peered":"2026-02-24T09:09:24.260382+0000","last_unstale":"2026-02-24T09:09:26.270140+0000","last_undegraded":"2026-02-24T09:09:26.270140+0000","last_fullsized":"2026-02-24T09:09:26.270140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:05:00.313499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1622,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267717+0000","last_change":"2026-02-24T09:09:25.266872+0000","last_active":"2026-02-24T09:09:26.267717+0000","last_peered":"2026-02-24T09:09:26.267717+0000","last_clean":"2026-02-24T09:09:26.267717+0000","last_became_active":"2026-02-24T09:09:25.266720+0000","last_became_peered":"2026-02-24T09:09:25.266720+0000","last_unstale":"2026-02-24T09:09:26.267717+0000","last_undegraded":"2026-02-24T09:09:26.267717+0000","last_fullsized":"2026-02-24T09:09:26.267717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:43.574647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938532+0000","last_change":"2026-02-24T09:09:24.256821+0000","last_active":"2026-02-24T09:09:27.938532+0000","last_peered":"2026-02-24T09:09:27.938532+0000","last_clean":"2026-02-24T09:09:27.938532+0000","last_became_active":"2026-02-24T09:09:24.256284+0000","last_became_peered":"2026-02-24T09:09:24.256284+0000","last_unstale":"2026-02-24T09:09:27.938532+0000","last_undegraded":"2026-02-24T09:09:27.938532+0000","last_fullsized":"2026-02-24T09:09:27.938532+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:37:32.352734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332187+0000","last_change":"2026-02-24T09:09:25.268120+0000","last_active":"2026-02-24T09:09:26.332187+0000","last_peered":"2026-02-24T09:09:26.332187+0000","last_clean":"2026-02-24T09:09:26.332187+0000","last_became_active":"2026-02-24T09:09:25.267865+0000","last_became_peered":"2026-02-24T09:09:25.267865+0000","last_unstale":"2026-02-24T09:09:26.332187+0000","last_undegraded":"2026-02-24T09:09:26.332187+0000","last_fullsized":"2026-02-24T09:09:26.332187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:51:18.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267953+0000","last_change":"2026-02-24T09:09:24.257176+0000","last_active":"2026-02-24T09:09:26.267953+0000","last_peered":"2026-02-24T09:09:26.267953+0000","last_clean":"2026-02-24T09:09:26.267953+0000","last_became_active":"2026-02-24T09:09:24.256855+0000","last_became_peered":"2026-02-24T09:09:24.256855+0000","last_unstale":"2026-02-24T09:09:26.267953+0000","last_undegraded":"2026-02-24T09:09:26.267953+0000","last_fullsized":"2026-02-24T09:09:26.267953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:48:25.179774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733497+0000","last_change":"2026-02-24T09:09:25.271913+0000","last_active":"2026-02-24T09:09:26.733497+0000","last_peered":"2026-02-24T09:09:26.733497+0000","last_clean":"2026-02-24T09:09:26.733497+0000","last_became_active":"2026-02-24T09:09:25.271736+0000","last_became_peered":"2026-02-24T09:09:25.271736+0000","last_unstale":"2026-02-24T09:09:26.733497+0000","last_undegraded":"2026-02-24T09:09:26.733497+0000","last_fullsized":"2026-02-24T09:09:26.733497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:49.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943686+0000","last_change":"2026-02-24T09:09:24.259308+0000","last_active":"2026-02-24T09:09:28.943686+0000","last_peered":"2026-02-24T09:09:28.943686+0000","last_clean":"2026-02-24T09:09:28.943686+0000","last_became_active":"2026-02-24T09:09:24.259131+0000","last_became_peered":"2026-02-24T09:09:24.259131+0000","last_unstale":"2026-02-24T09:09:28.943686+0000","last_undegraded":"2026-02-24T09:09:28.943686+0000","last_fullsized":"2026-02-24T09:09:28.943686+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:52:00.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733165+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.733165+0000","last_peered":"2026-02-24T09:09:26.733165+0000","last_clean":"2026-02-24T09:09:26.733165+0000","last_became_active":"2026-02-24T09:09:25.269559+0000","last_became_peered":"2026-02-24T09:09:25.269559+0000","last_unstale":"2026-02-24T09:09:26.733165+0000","last_undegraded":"2026-02-24T09:09:26.733165+0000","last_fullsized":"2026-02-24T09:09:26.733165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:06:28.902948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942522+0000","last_change":"2026-02-24T09:09:24.257075+0000","last_active":"2026-02-24T09:09:28.942522+0000","last_peered":"2026-02-24T09:09:28.942522+0000","last_clean":"2026-02-24T09:09:28.942522+0000","last_became_active":"2026-02-24T09:09:24.256738+0000","last_became_peered":"2026-02-24T09:09:24.256738+0000","last_unstale":"2026-02-24T09:09:28.942522+0000","last_undegraded":"2026-02-24T09:09:28.942522+0000","last_fullsized":"2026-02-24T09:09:28.942522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:14.802040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268002+0000","last_change":"2026-02-24T09:09:25.271423+0000","last_active":"2026-02-24T09:09:26.268002+0000","last_peered":"2026-02-24T09:09:26.268002+0000","last_clean":"2026-02-24T09:09:26.268002+0000","last_became_active":"2026-02-24T09:09:25.271142+0000","last_became_peered":"2026-02-24T09:09:25.271142+0000","last_unstale":"2026-02-24T09:09:26.268002+0000","last_undegraded":"2026-02-24T09:09:26.268002+0000","last_fullsized":"2026-02-24T09:09:26.268002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:16.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.940354+0000","last_change":"2026-02-24T09:09:24.258426+0000","last_active":"2026-02-24T09:09:29.940354+0000","last_peered":"2026-02-24T09:09:29.940354+0000","last_clean":"2026-02-24T09:09:29.940354+0000","last_became_active":"2026-02-24T09:09:24.257941+0000","last_became_peered":"2026-02-24T09:09:24.257941+0000","last_unstale":"2026-02-24T09:09:29.940354+0000","last_undegraded":"2026-02-24T09:09:29.940354+0000","last_fullsized":"2026-02-24T09:09:29.940354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:30:29.724001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332552+0000","last_change":"2026-02-24T09:09:25.266758+0000","last_active":"2026-02-24T09:09:26.332552+0000","last_peered":"2026-02-24T09:09:26.332552+0000","last_clean":"2026-02-24T09:09:26.332552+0000","last_became_active":"2026-02-24T09:09:25.266569+0000","last_became_peered":"2026-02-24T09:09:25.266569+0000","last_unstale":"2026-02-24T09:09:26.332552+0000","last_undegraded":"2026-02-24T09:09:26.332552+0000","last_fullsized":"2026-02-24T09:09:26.332552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:13:56.985056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332354+0000","last_change":"2026-02-24T09:09:24.256974+0000","last_active":"2026-02-24T09:09:26.332354+0000","last_peered":"2026-02-24T09:09:26.332354+0000","last_clean":"2026-02-24T09:09:26.332354+0000","last_became_active":"2026-02-24T09:09:24.256617+0000","last_became_peered":"2026-02-24T09:09:24.256617+0000","last_unstale":"2026-02-24T09:09:26.332354+0000","last_undegraded":"2026-02-24T09:09:26.332354+0000","last_fullsized":"2026-02-24T09:09:26.332354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:28.318156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733475+0000","last_change":"2026-02-24T09:09:25.270445+0000","last_active":"2026-02-24T09:09:26.733475+0000","last_peered":"2026-02-24T09:09:26.733475+0000","last_clean":"2026-02-24T09:09:26.733475+0000","last_became_active":"2026-02-24T09:09:25.270275+0000","last_became_peered":"2026-02-24T09:09:25.270275+0000","last_unstale":"2026-02-24T09:09:26.733475+0000","last_undegraded":"2026-02-24T09:09:26.733475+0000","last_fullsized":"2026-02-24T09:09:26.733475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:53:49.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268206+0000","last_change":"2026-02-24T09:09:24.259031+0000","last_active":"2026-02-24T09:09:26.268206+0000","last_peered":"2026-02-24T09:09:26.268206+0000","last_clean":"2026-02-24T09:09:26.268206+0000","last_became_active":"2026-02-24T09:09:24.258899+0000","last_became_peered":"2026-02-24T09:09:24.258899+0000","last_unstale":"2026-02-24T09:09:26.268206+0000","last_undegraded":"2026-02-24T09:09:26.268206+0000","last_fullsized":"2026-02-24T09:09:26.268206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:16.802986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733389+0000","last_change":"2026-02-24T09:09:25.272707+0000","last_active":"2026-02-24T09:09:26.733389+0000","last_peered":"2026-02-24T09:09:26.733389+0000","last_clean":"2026-02-24T09:09:26.733389+0000","last_became_active":"2026-02-24T09:09:25.272563+0000","last_became_peered":"2026-02-24T09:09:25.272563+0000","last_unstale":"2026-02-24T09:09:26.733389+0000","last_undegraded":"2026-02-24T09:09:26.733389+0000","last_fullsized":"2026-02-24T09:09:26.733389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:41:22.895217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332549+0000","last_change":"2026-02-24T09:09:24.256493+0000","last_active":"2026-02-24T09:09:26.332549+0000","last_peered":"2026-02-24T09:09:26.332549+0000","last_clean":"2026-02-24T09:09:26.332549+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:26.332549+0000","last_undegraded":"2026-02-24T09:09:26.332549+0000","last_fullsized":"2026-02-24T09:09:26.332549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:43:12.259841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733528+0000","last_change":"2026-02-24T09:09:25.271977+0000","last_active":"2026-02-24T09:09:26.733528+0000","last_peered":"2026-02-24T09:09:26.733528+0000","last_clean":"2026-02-24T09:09:26.733528+0000","last_became_active":"2026-02-24T09:09:25.271650+0000","last_became_peered":"2026-02-24T09:09:25.271650+0000","last_unstale":"2026-02-24T09:09:26.733528+0000","last_undegraded":"2026-02-24T09:09:26.733528+0000","last_fullsized":"2026-02-24T09:09:26.733528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:10.062115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733207+0000","last_change":"2026-02-24T09:09:05.953512+0000","last_active":"2026-02-24T09:09:26.733207+0000","last_peered":"2026-02-24T09:09:26.733207+0000","last_clean":"2026-02-24T09:09:26.733207+0000","last_became_active":"2026-02-24T09:09:05.953360+0000","last_became_peered":"2026-02-24T09:09:05.953360+0000","last_unstale":"2026-02-24T09:09:26.733207+0000","last_undegraded":"2026-02-24T09:09:26.733207+0000","last_fullsized":"2026-02-24T09:09:26.733207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_clean_scrub_stamp":"2026-02-24T09:08:00.445410+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:48.550493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941025+0000","last_change":"2026-02-24T09:09:24.259164+0000","last_active":"2026-02-24T09:09:27.941025+0000","last_peered":"2026-02-24T09:09:27.941025+0000","last_clean":"2026-02-24T09:09:27.941025+0000","last_became_active":"2026-02-24T09:09:24.259011+0000","last_became_peered":"2026-02-24T09:09:24.259011+0000","last_unstale":"2026-02-24T09:09:27.941025+0000","last_undegraded":"2026-02-24T09:09:27.941025+0000","last_fullsized":"2026-02-24T09:09:27.941025+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:41.649484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268864+0000","last_change":"2026-02-24T09:09:25.269884+0000","last_active":"2026-02-24T09:09:26.268864+0000","last_peered":"2026-02-24T09:09:26.268864+0000","last_clean":"2026-02-24T09:09:26.268864+0000","last_became_active":"2026-02-24T09:09:25.269543+0000","last_became_peered":"2026-02-24T09:09:25.269543+0000","last_unstale":"2026-02-24T09:09:26.268864+0000","last_undegraded":"2026-02-24T09:09:26.268864+0000","last_fullsized":"2026-02-24T09:09:26.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:21:25.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940807+0000","last_change":"2026-02-24T09:09:24.259369+0000","last_active":"2026-02-24T09:09:27.940807+0000","last_peered":"2026-02-24T09:09:27.940807+0000","last_clean":"2026-02-24T09:09:27.940807+0000","last_became_active":"2026-02-24T09:09:24.259086+0000","last_became_peered":"2026-02-24T09:09:24.259086+0000","last_unstale":"2026-02-24T09:09:27.940807+0000","last_undegraded":"2026-02-24T09:09:27.940807+0000","last_fullsized":"2026-02-24T09:09:27.940807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:08.881900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332119+0000","last_change":"2026-02-24T09:09:25.266898+0000","last_active":"2026-02-24T09:09:26.332119+0000","last_peered":"2026-02-24T09:09:26.332119+0000","last_clean":"2026-02-24T09:09:26.332119+0000","last_became_active":"2026-02-24T09:09:25.266407+0000","last_became_peered":"2026-02-24T09:09:25.266407+0000","last_unstale":"2026-02-24T09:09:26.332119+0000","last_undegraded":"2026-02-24T09:09:26.332119+0000","last_fullsized":"2026-02-24T09:09:26.332119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:51.887929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941603+0000","last_change":"2026-02-24T09:09:24.254126+0000","last_active":"2026-02-24T09:09:28.941603+0000","last_peered":"2026-02-24T09:09:28.941603+0000","last_clean":"2026-02-24T09:09:28.941603+0000","last_became_active":"2026-02-24T09:09:24.253911+0000","last_became_peered":"2026-02-24T09:09:24.253911+0000","last_unstale":"2026-02-24T09:09:28.941603+0000","last_undegraded":"2026-02-24T09:09:28.941603+0000","last_fullsized":"2026-02-24T09:09:28.941603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:09:56.146842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268161+0000","last_change":"2026-02-24T09:09:25.270387+0000","last_active":"2026-02-24T09:09:26.268161+0000","last_peered":"2026-02-24T09:09:26.268161+0000","last_clean":"2026-02-24T09:09:26.268161+0000","last_became_active":"2026-02-24T09:09:25.269478+0000","last_became_peered":"2026-02-24T09:09:25.269478+0000","last_unstale":"2026-02-24T09:09:26.268161+0000","last_undegraded":"2026-02-24T09:09:26.268161+0000","last_fullsized":"2026-02-24T09:09:26.268161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:32:15.217221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733294+0000","last_change":"2026-02-24T09:09:24.259169+0000","last_active":"2026-02-24T09:09:26.733294+0000","last_peered":"2026-02-24T09:09:26.733294+0000","last_clean":"2026-02-24T09:09:26.733294+0000","last_became_active":"2026-02-24T09:09:24.258755+0000","last_became_peered":"2026-02-24T09:09:24.258755+0000","last_unstale":"2026-02-24T09:09:26.733294+0000","last_undegraded":"2026-02-24T09:09:26.733294+0000","last_fullsized":"2026-02-24T09:09:26.733294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:33.438504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270152+0000","last_change":"2026-02-24T09:09:25.270732+0000","last_active":"2026-02-24T09:09:26.270152+0000","last_peered":"2026-02-24T09:09:26.270152+0000","last_clean":"2026-02-24T09:09:26.270152+0000","last_became_active":"2026-02-24T09:09:25.270200+0000","last_became_peered":"2026-02-24T09:09:25.270200+0000","last_unstale":"2026-02-24T09:09:26.270152+0000","last_undegraded":"2026-02-24T09:09:26.270152+0000","last_fullsized":"2026-02-24T09:09:26.270152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:59:28.115196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267351+0000","last_change":"2026-02-24T09:09:24.257488+0000","last_active":"2026-02-24T09:09:26.267351+0000","last_peered":"2026-02-24T09:09:26.267351+0000","last_clean":"2026-02-24T09:09:26.267351+0000","last_became_active":"2026-02-24T09:09:24.257202+0000","last_became_peered":"2026-02-24T09:09:24.257202+0000","last_unstale":"2026-02-24T09:09:26.267351+0000","last_undegraded":"2026-02-24T09:09:26.267351+0000","last_fullsized":"2026-02-24T09:09:26.267351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:41:24.345307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270233+0000","last_change":"2026-02-24T09:09:25.272254+0000","last_active":"2026-02-24T09:09:26.270233+0000","last_peered":"2026-02-24T09:09:26.270233+0000","last_clean":"2026-02-24T09:09:26.270233+0000","last_became_active":"2026-02-24T09:09:25.271674+0000","last_became_peered":"2026-02-24T09:09:25.271674+0000","last_unstale":"2026-02-24T09:09:26.270233+0000","last_undegraded":"2026-02-24T09:09:26.270233+0000","last_fullsized":"2026-02-24T09:09:26.270233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:03:26.493850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938246+0000","last_change":"2026-02-24T09:09:24.257331+0000","last_active":"2026-02-24T09:09:27.938246+0000","last_peered":"2026-02-24T09:09:27.938246+0000","last_clean":"2026-02-24T09:09:27.938246+0000","last_became_active":"2026-02-24T09:09:24.256876+0000","last_became_peered":"2026-02-24T09:09:24.256876+0000","last_unstale":"2026-02-24T09:09:27.938246+0000","last_undegraded":"2026-02-24T09:09:27.938246+0000","last_fullsized":"2026-02-24T09:09:27.938246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:29:58.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332332+0000","last_change":"2026-02-24T09:09:25.266642+0000","last_active":"2026-02-24T09:09:26.332332+0000","last_peered":"2026-02-24T09:09:26.332332+0000","last_clean":"2026-02-24T09:09:26.332332+0000","last_became_active":"2026-02-24T09:09:25.266307+0000","last_became_peered":"2026-02-24T09:09:25.266307+0000","last_unstale":"2026-02-24T09:09:26.332332+0000","last_undegraded":"2026-02-24T09:09:26.332332+0000","last_fullsized":"2026-02-24T09:09:26.332332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:51.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267446+0000","last_change":"2026-02-24T09:09:24.258807+0000","last_active":"2026-02-24T09:09:26.267446+0000","last_peered":"2026-02-24T09:09:26.267446+0000","last_clean":"2026-02-24T09:09:26.267446+0000","last_became_active":"2026-02-24T09:09:24.258649+0000","last_became_peered":"2026-02-24T09:09:24.258649+0000","last_unstale":"2026-02-24T09:09:26.267446+0000","last_undegraded":"2026-02-24T09:09:26.267446+0000","last_fullsized":"2026-02-24T09:09:26.267446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:10:48.348275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269009+0000","last_change":"2026-02-24T09:09:25.268491+0000","last_active":"2026-02-24T09:09:26.269009+0000","last_peered":"2026-02-24T09:09:26.269009+0000","last_clean":"2026-02-24T09:09:26.269009+0000","last_became_active":"2026-02-24T09:09:25.267341+0000","last_became_peered":"2026-02-24T09:09:25.267341+0000","last_unstale":"2026-02-24T09:09:26.269009+0000","last_undegraded":"2026-02-24T09:09:26.269009+0000","last_fullsized":"2026-02-24T09:09:26.269009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:18:29.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940964+0000","last_change":"2026-02-24T09:09:24.258484+0000","last_active":"2026-02-24T09:09:27.940964+0000","last_peered":"2026-02-24T09:09:27.940964+0000","last_clean":"2026-02-24T09:09:27.940964+0000","last_became_active":"2026-02-24T09:09:24.258249+0000","last_became_peered":"2026-02-24T09:09:24.258249+0000","last_unstale":"2026-02-24T09:09:27.940964+0000","last_undegraded":"2026-02-24T09:09:27.940964+0000","last_fullsized":"2026-02-24T09:09:27.940964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:32:56.722522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267783+0000","last_change":"2026-02-24T09:09:25.269738+0000","last_active":"2026-02-24T09:09:26.267783+0000","last_peered":"2026-02-24T09:09:26.267783+0000","last_clean":"2026-02-24T09:09:26.267783+0000","last_became_active":"2026-02-24T09:09:25.269413+0000","last_became_peered":"2026-02-24T09:09:25.269413+0000","last_unstale":"2026-02-24T09:09:26.267783+0000","last_undegraded":"2026-02-24T09:09:26.267783+0000","last_fullsized":"2026-02-24T09:09:26.267783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:00.412570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941334+0000","last_change":"2026-02-24T09:09:24.258901+0000","last_active":"2026-02-24T09:09:27.941334+0000","last_peered":"2026-02-24T09:09:27.941334+0000","last_clean":"2026-02-24T09:09:27.941334+0000","last_became_active":"2026-02-24T09:09:24.258325+0000","last_became_peered":"2026-02-24T09:09:24.258325+0000","last_unstale":"2026-02-24T09:09:27.941334+0000","last_undegraded":"2026-02-24T09:09:27.941334+0000","last_fullsized":"2026-02-24T09:09:27.941334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:36.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267522+0000","last_change":"2026-02-24T09:09:25.267368+0000","last_active":"2026-02-24T09:09:26.267522+0000","last_peered":"2026-02-24T09:09:26.267522+0000","last_clean":"2026-02-24T09:09:26.267522+0000","last_became_active":"2026-02-24T09:09:25.267168+0000","last_became_peered":"2026-02-24T09:09:25.267168+0000","last_unstale":"2026-02-24T09:09:26.267522+0000","last_undegraded":"2026-02-24T09:09:26.267522+0000","last_fullsized":"2026-02-24T09:09:26.267522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:57.616866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.939140+0000","last_change":"2026-02-24T09:09:24.257345+0000","last_active":"2026-02-24T09:09:27.939140+0000","last_peered":"2026-02-24T09:09:27.939140+0000","last_clean":"2026-02-24T09:09:27.939140+0000","last_became_active":"2026-02-24T09:09:24.256817+0000","last_became_peered":"2026-02-24T09:09:24.256817+0000","last_unstale":"2026-02-24T09:09:27.939140+0000","last_undegraded":"2026-02-24T09:09:27.939140+0000","last_fullsized":"2026-02-24T09:09:27.939140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:37:48.042471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332527+0000","last_change":"2026-02-24T09:09:25.267778+0000","last_active":"2026-02-24T09:09:26.332527+0000","last_peered":"2026-02-24T09:09:26.332527+0000","last_clean":"2026-02-24T09:09:26.332527+0000","last_became_active":"2026-02-24T09:09:25.267379+0000","last_became_peered":"2026-02-24T09:09:25.267379+0000","last_unstale":"2026-02-24T09:09:26.332527+0000","last_undegraded":"2026-02-24T09:09:26.332527+0000","last_fullsized":"2026-02-24T09:09:26.332527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:25:47.194857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332298+0000","last_change":"2026-02-24T09:09:24.259141+0000","last_active":"2026-02-24T09:09:26.332298+0000","last_peered":"2026-02-24T09:09:26.332298+0000","last_clean":"2026-02-24T09:09:26.332298+0000","last_became_active":"2026-02-24T09:09:24.258981+0000","last_became_peered":"2026-02-24T09:09:24.258981+0000","last_unstale":"2026-02-24T09:09:26.332298+0000","last_undegraded":"2026-02-24T09:09:26.332298+0000","last_fullsized":"2026-02-24T09:09:26.332298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:48.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268774+0000","last_change":"2026-02-24T09:09:25.268540+0000","last_active":"2026-02-24T09:09:26.268774+0000","last_peered":"2026-02-24T09:09:26.268774+0000","last_clean":"2026-02-24T09:09:26.268774+0000","last_became_active":"2026-02-24T09:09:25.267915+0000","last_became_peered":"2026-02-24T09:09:25.267915+0000","last_unstale":"2026-02-24T09:09:26.268774+0000","last_undegraded":"2026-02-24T09:09:26.268774+0000","last_fullsized":"2026-02-24T09:09:26.268774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:55.564971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938005+0000","last_change":"2026-02-24T09:09:24.257964+0000","last_active":"2026-02-24T09:09:27.938005+0000","last_peered":"2026-02-24T09:09:27.938005+0000","last_clean":"2026-02-24T09:09:27.938005+0000","last_became_active":"2026-02-24T09:09:24.257717+0000","last_became_peered":"2026-02-24T09:09:24.257717+0000","last_unstale":"2026-02-24T09:09:27.938005+0000","last_undegraded":"2026-02-24T09:09:27.938005+0000","last_fullsized":"2026-02-24T09:09:27.938005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:23:24.989893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733433+0000","last_change":"2026-02-24T09:09:25.271214+0000","last_active":"2026-02-24T09:09:26.733433+0000","last_peered":"2026-02-24T09:09:26.733433+0000","last_clean":"2026-02-24T09:09:26.733433+0000","last_became_active":"2026-02-24T09:09:25.271038+0000","last_became_peered":"2026-02-24T09:09:25.271038+0000","last_unstale":"2026-02-24T09:09:26.733433+0000","last_undegraded":"2026-02-24T09:09:26.733433+0000","last_fullsized":"2026-02-24T09:09:26.733433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:58:44.899837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268097+0000","last_change":"2026-02-24T09:09:25.269834+0000","last_active":"2026-02-24T09:09:26.268097+0000","last_peered":"2026-02-24T09:09:26.268097+0000","last_clean":"2026-02-24T09:09:26.268097+0000","last_became_active":"2026-02-24T09:09:25.269526+0000","last_became_peered":"2026-02-24T09:09:25.269526+0000","last_unstale":"2026-02-24T09:09:26.268097+0000","last_undegraded":"2026-02-24T09:09:26.268097+0000","last_fullsized":"2026-02-24T09:09:26.268097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:36:54.610640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267687+0000","last_change":"2026-02-24T09:09:24.258597+0000","last_active":"2026-02-24T09:09:26.267687+0000","last_peered":"2026-02-24T09:09:26.267687+0000","last_clean":"2026-02-24T09:09:26.267687+0000","last_became_active":"2026-02-24T09:09:24.258302+0000","last_became_peered":"2026-02-24T09:09:24.258302+0000","last_unstale":"2026-02-24T09:09:26.267687+0000","last_undegraded":"2026-02-24T09:09:26.267687+0000","last_fullsized":"2026-02-24T09:09:26.267687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:20:15.556479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334746+0000","last_change":"2026-02-24T09:09:25.269804+0000","last_active":"2026-02-24T09:09:26.334746+0000","last_peered":"2026-02-24T09:09:26.334746+0000","last_clean":"2026-02-24T09:09:26.334746+0000","last_became_active":"2026-02-24T09:09:25.268973+0000","last_became_peered":"2026-02-24T09:09:25.268973+0000","last_unstale":"2026-02-24T09:09:26.334746+0000","last_undegraded":"2026-02-24T09:09:26.334746+0000","last_fullsized":"2026-02-24T09:09:26.334746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:33:39.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942003+0000","last_change":"2026-02-24T09:09:24.257428+0000","last_active":"2026-02-24T09:09:28.942003+0000","last_peered":"2026-02-24T09:09:28.942003+0000","last_clean":"2026-02-24T09:09:28.942003+0000","last_became_active":"2026-02-24T09:09:24.256679+0000","last_became_peered":"2026-02-24T09:09:24.256679+0000","last_unstale":"2026-02-24T09:09:28.942003+0000","last_undegraded":"2026-02-24T09:09:28.942003+0000","last_fullsized":"2026-02-24T09:09:28.942003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:39:28.664820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267792+0000","last_change":"2026-02-24T09:09:25.268127+0000","last_active":"2026-02-24T09:09:26.267792+0000","last_peered":"2026-02-24T09:09:26.267792+0000","last_clean":"2026-02-24T09:09:26.267792+0000","last_became_active":"2026-02-24T09:09:25.267860+0000","last_became_peered":"2026-02-24T09:09:25.267860+0000","last_unstale":"2026-02-24T09:09:26.267792+0000","last_undegraded":"2026-02-24T09:09:26.267792+0000","last_fullsized":"2026-02-24T09:09:26.267792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:37:52.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269053+0000","last_change":"2026-02-24T09:09:24.257552+0000","last_active":"2026-02-24T09:09:26.269053+0000","last_peered":"2026-02-24T09:09:26.269053+0000","last_clean":"2026-02-24T09:09:26.269053+0000","last_became_active":"2026-02-24T09:09:24.257163+0000","last_became_peered":"2026-02-24T09:09:24.257163+0000","last_unstale":"2026-02-24T09:09:26.269053+0000","last_undegraded":"2026-02-24T09:09:26.269053+0000","last_fullsized":"2026-02-24T09:09:26.269053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:30:54.285800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268961+0000","last_change":"2026-02-24T09:09:25.268695+0000","last_active":"2026-02-24T09:09:26.268961+0000","last_peered":"2026-02-24T09:09:26.268961+0000","last_clean":"2026-02-24T09:09:26.268961+0000","last_became_active":"2026-02-24T09:09:25.268128+0000","last_became_peered":"2026-02-24T09:09:25.268128+0000","last_unstale":"2026-02-24T09:09:26.268961+0000","last_undegraded":"2026-02-24T09:09:26.268961+0000","last_fullsized":"2026-02-24T09:09:26.268961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:23.987958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267474+0000","last_change":"2026-02-24T09:09:24.257602+0000","last_active":"2026-02-24T09:09:26.267474+0000","last_peered":"2026-02-24T09:09:26.267474+0000","last_clean":"2026-02-24T09:09:26.267474+0000","last_became_active":"2026-02-24T09:09:24.257440+0000","last_became_peered":"2026-02-24T09:09:24.257440+0000","last_unstale":"2026-02-24T09:09:26.267474+0000","last_undegraded":"2026-02-24T09:09:26.267474+0000","last_fullsized":"2026-02-24T09:09:26.267474+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:13:51.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3366,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":89,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":100343,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":259322,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710727,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":395125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":27582038},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939654,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27828,"kb_used_data":864,"kb_used_omap":17,"kb_used_meta":26926,"kb_avail":733975372,"statfs":{"total":751619276800,"available":751590780928,"internally_reserved":0,"allocated":884736,"data_stored":986717,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":17477,"internal_metadata":27573179},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070473,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":395327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21694,"internal_metadata":27568962},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299402,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31140,"internal_metadata":27559516},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528332,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":985493,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":25152,"internal_metadata":27565504},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":394623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888078,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27816,"kb_used_data":852,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975384,"statfs":{"total":751619276800,"available":751590793216,"internally_reserved":0,"allocated":872448,"data_stored":985083,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":30940,"internal_metadata":27559716},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":394555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29424,"internal_metadata":27561232},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247827,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":394934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45238,"internal_metadata":27545418},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476755,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":396189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34031,"internal_metadata":27556625},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607573,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":396155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":47,"kb_used_meta":26896,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":394623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48274,"internal_metadata":27542382},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5468,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11410,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12131,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6225,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13842,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3986,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29546,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8195,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5352,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:09:33.121 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:09:33.270 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:33.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.372+0000 7fba7558f640 1 -- 10.20.193.4:0/4204406644 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba7010fc70 msgr2=0x7fba70114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.372+0000 7fba7558f640 1 --2- 10.20.193.4:0/4204406644 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba7010fc70 0x7fba70114cc0 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=6323411829141235534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba58009950 tx=0x7fba5802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.372+0000 7fba7558f640 1 -- 10.20.193.4:0/4204406644 shutdown_connections 2026-02-24T09:09:33.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.372+0000 7fba7558f640 1 --2- 10.20.193.4:0/4204406644 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba70115470 0x7fba70175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.372+0000 7fba7558f640 1 --2- 10.20.193.4:0/4204406644 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba7010fc70 0x7fba70114cc0 unknown :-1 s=CLOSED pgs=262 gs=1 cs=0 l=1 c_cookie=6323411829141235534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.372+0000 7fba7558f640 1 --2- 10.20.193.4:0/4204406644 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba7010f280 0x7fba7010f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.372+0000 7fba7558f640 1 -- 10.20.193.4:0/4204406644 >> 10.20.193.4:0/4204406644 conn(0x7fba7005f830 msgr2=0x7fba7010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:33.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.372+0000 7fba7558f640 1 -- 10.20.193.4:0/4204406644 shutdown_connections 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.372+0000 7fba7558f640 1 -- 10.20.193.4:0/4204406644 wait complete. 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba7558f640 1 Processor -- start 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba7558f640 1 -- start start 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba7558f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba7010f280 0x7fba700f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba7558f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba7010fc70 0x7fba70175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba7558f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba70115470 0x7fba700f5cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba7558f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fba700faec0 con 0x7fba7010f280 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba7558f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fba700fb030 con 0x7fba7010fc70 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba7558f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba700fb1f0 con 0x7fba70115470 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba7010f280 0x7fba700f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba7010f280 0x7fba700f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58862/0 (socket says 10.20.193.4:58862) 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6effd640 1 -- 10.20.193.4:0/1742241681 learned_addr learned my addr 10.20.193.4:0/1742241681 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6e7fc640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba7010fc70 0x7fba70175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6f7fe640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba70115470 0x7fba700f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6effd640 1 -- 10.20.193.4:0/1742241681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba70115470 msgr2=0x7fba700f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6effd640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba70115470 0x7fba700f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6effd640 1 -- 10.20.193.4:0/1742241681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba7010fc70 msgr2=0x7fba70175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6effd640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba7010fc70 0x7fba70175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6effd640 1 -- 10.20.193.4:0/1742241681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba58009570 con 0x7fba7010f280 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6e7fc640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba7010fc70 0x7fba70175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba6effd640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba7010f280 0x7fba700f55b0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba6400d950 tx=0x7fba6400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba4ffff640 1 -- 10.20.193.4:0/1742241681 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba64004540 con 0x7fba7010f280 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba7558f640 1 -- 10.20.193.4:0/1742241681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba700fb4d0 con 0x7fba7010f280 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba4ffff640 1 -- 10.20.193.4:0/1742241681 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba64009d00 con 0x7fba7010f280 2026-02-24T09:09:33.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba4ffff640 1 -- 10.20.193.4:0/1742241681 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba640106e0 con 0x7fba7010f280 2026-02-24T09:09:33.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.373+0000 7fba7558f640 1 -- 10.20.193.4:0/1742241681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba700fb9f0 con 0x7fba7010f280 2026-02-24T09:09:33.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.374+0000 7fba7558f640 1 -- 10.20.193.4:0/1742241681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba70110560 con 0x7fba7010f280 2026-02-24T09:09:33.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.375+0000 7fba4ffff640 1 -- 10.20.193.4:0/1742241681 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fba640027c0 con 0x7fba7010f280 2026-02-24T09:09:33.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.376+0000 7fba4ffff640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba400b5760 0x7fba400d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:33.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.376+0000 7fba4ffff640 1 -- 10.20.193.4:0/1742241681 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fba640e73d0 con 0x7fba7010f280 2026-02-24T09:09:33.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.376+0000 7fba6e7fc640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba400b5760 0x7fba400d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:33.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.376+0000 7fba6e7fc640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba400b5760 0x7fba400d5c10 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba580023d0 tx=0x7fba58031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:33.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.377+0000 7fba4ffff640 1 -- 10.20.193.4:0/1742241681 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fba640a9d20 con 0x7fba7010f280 2026-02-24T09:09:33.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:33 trial004 ceph-mon[41596]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:33.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:33 trial004 ceph-mon[41596]: mgrmap e17: x(active, since 2m), standbys: z, y 2026-02-24T09:09:33.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:33 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3673924957' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:33.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:33 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2449338297' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:33.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.478+0000 7fba7558f640 1 -- 10.20.193.4:0/1742241681 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba700f6770 con 0x7fba400b5760 2026-02-24T09:09:33.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.481+0000 7fba4ffff640 1 -- 10.20.193.4:0/1742241681 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258870 (secure 0 0 0) 0x7fba700f6770 con 0x7fba400b5760 2026-02-24T09:09:33.486 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:33.487 INFO:teuthology.orchestra.run.trial004.stderr:dumped all 2026-02-24T09:09:33.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 -- 10.20.193.4:0/1742241681 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba400b5760 msgr2=0x7fba400d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba400b5760 0x7fba400d5c10 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba580023d0 tx=0x7fba58031040 comp rx=0 tx=0).stop 2026-02-24T09:09:33.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 -- 10.20.193.4:0/1742241681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba7010f280 msgr2=0x7fba700f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba7010f280 0x7fba700f55b0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba6400d950 tx=0x7fba6400de20 comp rx=0 tx=0).stop 2026-02-24T09:09:33.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 -- 10.20.193.4:0/1742241681 shutdown_connections 2026-02-24T09:09:33.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba400b5760 0x7fba400d5c10 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba70115470 0x7fba700f5cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba7010fc70 0x7fba70175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 --2- 10.20.193.4:0/1742241681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba7010f280 0x7fba700f55b0 unknown :-1 s=CLOSED pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 -- 10.20.193.4:0/1742241681 >> 10.20.193.4:0/1742241681 conn(0x7fba7005f830 msgr2=0x7fba70111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:33.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 -- 10.20.193.4:0/1742241681 shutdown_connections 2026-02-24T09:09:33.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.482+0000 7fba7558f640 1 -- 10.20.193.4:0/1742241681 wait complete. 2026-02-24T09:09:33.522 INFO:teuthology.orchestra.run.trial004.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2026-02-24T09:09:31.664527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593734,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":112,"num_read_kb":97,"num_write":278,"num_write_kb":3749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":251,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333356,"kb_used_data":9788,"kb_used_omap":356,"kb_used_meta":322971,"kb_avail":8807705044,"statfs":{"total":9019431321600,"available":9019089965056,"internally_reserved":0,"allocated":10022912,"data_stored":6514105,"data_compressed":113181,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":364684,"internal_metadata":330723188},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3366,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":89,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.414828"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332664+0000","last_change":"2026-02-24T09:09:25.267627+0000","last_active":"2026-02-24T09:09:26.332664+0000","last_peered":"2026-02-24T09:09:26.332664+0000","last_clean":"2026-02-24T09:09:26.332664+0000","last_became_active":"2026-02-24T09:09:25.267439+0000","last_became_peered":"2026-02-24T09:09:25.267439+0000","last_unstale":"2026-02-24T09:09:26.332664+0000","last_undegraded":"2026-02-24T09:09:26.332664+0000","last_fullsized":"2026-02-24T09:09:26.332664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:24.034680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267727+0000","last_change":"2026-02-24T09:09:25.267299+0000","last_active":"2026-02-24T09:09:26.267727+0000","last_peered":"2026-02-24T09:09:26.267727+0000","last_clean":"2026-02-24T09:09:26.267727+0000","last_became_active":"2026-02-24T09:09:25.266956+0000","last_became_peered":"2026-02-24T09:09:25.266956+0000","last_unstale":"2026-02-24T09:09:26.267727+0000","last_undegraded":"2026-02-24T09:09:26.267727+0000","last_fullsized":"2026-02-24T09:09:26.267727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:05.466777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267738+0000","last_change":"2026-02-24T09:09:25.268761+0000","last_active":"2026-02-24T09:09:26.267738+0000","last_peered":"2026-02-24T09:09:26.267738+0000","last_clean":"2026-02-24T09:09:26.267738+0000","last_became_active":"2026-02-24T09:09:25.268476+0000","last_became_peered":"2026-02-24T09:09:25.268476+0000","last_unstale":"2026-02-24T09:09:26.267738+0000","last_undegraded":"2026-02-24T09:09:26.267738+0000","last_fullsized":"2026-02-24T09:09:26.267738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:26:00.680116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335046+0000","last_change":"2026-02-24T09:09:25.271303+0000","last_active":"2026-02-24T09:09:26.335046+0000","last_peered":"2026-02-24T09:09:26.335046+0000","last_clean":"2026-02-24T09:09:26.335046+0000","last_became_active":"2026-02-24T09:09:25.271175+0000","last_became_peered":"2026-02-24T09:09:25.271175+0000","last_unstale":"2026-02-24T09:09:26.335046+0000","last_undegraded":"2026-02-24T09:09:26.335046+0000","last_fullsized":"2026-02-24T09:09:26.335046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:55:25.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267634+0000","last_change":"2026-02-24T09:09:25.267923+0000","last_active":"2026-02-24T09:09:26.267634+0000","last_peered":"2026-02-24T09:09:26.267634+0000","last_clean":"2026-02-24T09:09:26.267634+0000","last_became_active":"2026-02-24T09:09:25.267775+0000","last_became_peered":"2026-02-24T09:09:25.267775+0000","last_unstale":"2026-02-24T09:09:26.267634+0000","last_undegraded":"2026-02-24T09:09:26.267634+0000","last_fullsized":"2026-02-24T09:09:26.267634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:54:25.575849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270023+0000","last_change":"2026-02-24T09:09:25.269603+0000","last_active":"2026-02-24T09:09:26.270023+0000","last_peered":"2026-02-24T09:09:26.270023+0000","last_clean":"2026-02-24T09:09:26.270023+0000","last_became_active":"2026-02-24T09:09:25.269057+0000","last_became_peered":"2026-02-24T09:09:25.269057+0000","last_unstale":"2026-02-24T09:09:26.270023+0000","last_undegraded":"2026-02-24T09:09:26.270023+0000","last_fullsized":"2026-02-24T09:09:26.270023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:39:21.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733238+0000","last_change":"2026-02-24T09:09:25.270852+0000","last_active":"2026-02-24T09:09:26.733238+0000","last_peered":"2026-02-24T09:09:26.733238+0000","last_clean":"2026-02-24T09:09:26.733238+0000","last_became_active":"2026-02-24T09:09:25.270607+0000","last_became_peered":"2026-02-24T09:09:25.270607+0000","last_unstale":"2026-02-24T09:09:26.733238+0000","last_undegraded":"2026-02-24T09:09:26.733238+0000","last_fullsized":"2026-02-24T09:09:26.733238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:45:43.574810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268619+0000","last_change":"2026-02-24T09:09:25.268833+0000","last_active":"2026-02-24T09:09:26.268619+0000","last_peered":"2026-02-24T09:09:26.268619+0000","last_clean":"2026-02-24T09:09:26.268619+0000","last_became_active":"2026-02-24T09:09:25.268462+0000","last_became_peered":"2026-02-24T09:09:25.268462+0000","last_unstale":"2026-02-24T09:09:26.268619+0000","last_undegraded":"2026-02-24T09:09:26.268619+0000","last_fullsized":"2026-02-24T09:09:26.268619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:47.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334895+0000","last_change":"2026-02-24T09:09:25.271419+0000","last_active":"2026-02-24T09:09:26.334895+0000","last_peered":"2026-02-24T09:09:26.334895+0000","last_clean":"2026-02-24T09:09:26.334895+0000","last_became_active":"2026-02-24T09:09:25.270954+0000","last_became_peered":"2026-02-24T09:09:25.270954+0000","last_unstale":"2026-02-24T09:09:26.334895+0000","last_undegraded":"2026-02-24T09:09:26.334895+0000","last_fullsized":"2026-02-24T09:09:26.334895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:07:15.889565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270286+0000","last_change":"2026-02-24T09:09:25.269709+0000","last_active":"2026-02-24T09:09:26.270286+0000","last_peered":"2026-02-24T09:09:26.270286+0000","last_clean":"2026-02-24T09:09:26.270286+0000","last_became_active":"2026-02-24T09:09:25.269136+0000","last_became_peered":"2026-02-24T09:09:25.269136+0000","last_unstale":"2026-02-24T09:09:26.270286+0000","last_undegraded":"2026-02-24T09:09:26.270286+0000","last_fullsized":"2026-02-24T09:09:26.270286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:42:02.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733508+0000","last_change":"2026-02-24T09:09:25.272025+0000","last_active":"2026-02-24T09:09:26.733508+0000","last_peered":"2026-02-24T09:09:26.733508+0000","last_clean":"2026-02-24T09:09:26.733508+0000","last_became_active":"2026-02-24T09:09:25.271851+0000","last_became_peered":"2026-02-24T09:09:25.271851+0000","last_unstale":"2026-02-24T09:09:26.733508+0000","last_undegraded":"2026-02-24T09:09:26.733508+0000","last_fullsized":"2026-02-24T09:09:26.733508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:49:57.365130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335160+0000","last_change":"2026-02-24T09:09:25.271156+0000","last_active":"2026-02-24T09:09:26.335160+0000","last_peered":"2026-02-24T09:09:26.335160+0000","last_clean":"2026-02-24T09:09:26.335160+0000","last_became_active":"2026-02-24T09:09:25.270992+0000","last_became_peered":"2026-02-24T09:09:25.270992+0000","last_unstale":"2026-02-24T09:09:26.335160+0000","last_undegraded":"2026-02-24T09:09:26.335160+0000","last_fullsized":"2026-02-24T09:09:26.335160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:56.324038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332309+0000","last_change":"2026-02-24T09:09:25.266871+0000","last_active":"2026-02-24T09:09:26.332309+0000","last_peered":"2026-02-24T09:09:26.332309+0000","last_clean":"2026-02-24T09:09:26.332309+0000","last_became_active":"2026-02-24T09:09:25.266438+0000","last_became_peered":"2026-02-24T09:09:25.266438+0000","last_unstale":"2026-02-24T09:09:26.332309+0000","last_undegraded":"2026-02-24T09:09:26.332309+0000","last_fullsized":"2026-02-24T09:09:26.332309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:24:17.014313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267591+0000","last_change":"2026-02-24T09:09:25.266851+0000","last_active":"2026-02-24T09:09:26.267591+0000","last_peered":"2026-02-24T09:09:26.267591+0000","last_clean":"2026-02-24T09:09:26.267591+0000","last_became_active":"2026-02-24T09:09:25.266530+0000","last_became_peered":"2026-02-24T09:09:25.266530+0000","last_unstale":"2026-02-24T09:09:26.267591+0000","last_undegraded":"2026-02-24T09:09:26.267591+0000","last_fullsized":"2026-02-24T09:09:26.267591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:53.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267465+0000","last_change":"2026-02-24T09:09:25.269561+0000","last_active":"2026-02-24T09:09:26.267465+0000","last_peered":"2026-02-24T09:09:26.267465+0000","last_clean":"2026-02-24T09:09:26.267465+0000","last_became_active":"2026-02-24T09:09:25.268979+0000","last_became_peered":"2026-02-24T09:09:25.268979+0000","last_unstale":"2026-02-24T09:09:26.267465+0000","last_undegraded":"2026-02-24T09:09:26.267465+0000","last_fullsized":"2026-02-24T09:09:26.267465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:16:56.110766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334540+0000","last_change":"2026-02-24T09:09:25.271426+0000","last_active":"2026-02-24T09:09:26.334540+0000","last_peered":"2026-02-24T09:09:26.334540+0000","last_clean":"2026-02-24T09:09:26.334540+0000","last_became_active":"2026-02-24T09:09:25.270917+0000","last_became_peered":"2026-02-24T09:09:25.270917+0000","last_unstale":"2026-02-24T09:09:26.334540+0000","last_undegraded":"2026-02-24T09:09:26.334540+0000","last_fullsized":"2026-02-24T09:09:26.334540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:58:52.125871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332673+0000","last_change":"2026-02-24T09:09:25.267238+0000","last_active":"2026-02-24T09:09:26.332673+0000","last_peered":"2026-02-24T09:09:26.332673+0000","last_clean":"2026-02-24T09:09:26.332673+0000","last_became_active":"2026-02-24T09:09:25.267060+0000","last_became_peered":"2026-02-24T09:09:25.267060+0000","last_unstale":"2026-02-24T09:09:26.332673+0000","last_undegraded":"2026-02-24T09:09:26.332673+0000","last_fullsized":"2026-02-24T09:09:26.332673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:00:58.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267495+0000","last_change":"2026-02-24T09:09:25.266005+0000","last_active":"2026-02-24T09:09:26.267495+0000","last_peered":"2026-02-24T09:09:26.267495+0000","last_clean":"2026-02-24T09:09:26.267495+0000","last_became_active":"2026-02-24T09:09:25.265847+0000","last_became_peered":"2026-02-24T09:09:25.265847+0000","last_unstale":"2026-02-24T09:09:26.267495+0000","last_undegraded":"2026-02-24T09:09:26.267495+0000","last_fullsized":"2026-02-24T09:09:26.267495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:29:02.137351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332638+0000","last_change":"2026-02-24T09:09:25.268822+0000","last_active":"2026-02-24T09:09:26.332638+0000","last_peered":"2026-02-24T09:09:26.332638+0000","last_clean":"2026-02-24T09:09:26.332638+0000","last_became_active":"2026-02-24T09:09:25.268683+0000","last_became_peered":"2026-02-24T09:09:25.268683+0000","last_unstale":"2026-02-24T09:09:26.332638+0000","last_undegraded":"2026-02-24T09:09:26.332638+0000","last_fullsized":"2026-02-24T09:09:26.332638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:23:58.256403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332429+0000","last_change":"2026-02-24T09:09:25.266214+0000","last_active":"2026-02-24T09:09:26.332429+0000","last_peered":"2026-02-24T09:09:26.332429+0000","last_clean":"2026-02-24T09:09:26.332429+0000","last_became_active":"2026-02-24T09:09:25.266019+0000","last_became_peered":"2026-02-24T09:09:25.266019+0000","last_unstale":"2026-02-24T09:09:26.332429+0000","last_undegraded":"2026-02-24T09:09:26.332429+0000","last_fullsized":"2026-02-24T09:09:26.332429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:17.141581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332384+0000","last_change":"2026-02-24T09:09:25.267493+0000","last_active":"2026-02-24T09:09:26.332384+0000","last_peered":"2026-02-24T09:09:26.332384+0000","last_clean":"2026-02-24T09:09:26.332384+0000","last_became_active":"2026-02-24T09:09:25.267314+0000","last_became_peered":"2026-02-24T09:09:25.267314+0000","last_unstale":"2026-02-24T09:09:26.332384+0000","last_undegraded":"2026-02-24T09:09:26.332384+0000","last_fullsized":"2026-02-24T09:09:26.332384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:59:11.536214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334717+0000","last_change":"2026-02-24T09:09:25.272131+0000","last_active":"2026-02-24T09:09:26.334717+0000","last_peered":"2026-02-24T09:09:26.334717+0000","last_clean":"2026-02-24T09:09:26.334717+0000","last_became_active":"2026-02-24T09:09:25.271680+0000","last_became_peered":"2026-02-24T09:09:25.271680+0000","last_unstale":"2026-02-24T09:09:26.334717+0000","last_undegraded":"2026-02-24T09:09:26.334717+0000","last_fullsized":"2026-02-24T09:09:26.334717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:07:33.257865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268617+0000","last_change":"2026-02-24T09:09:25.267808+0000","last_active":"2026-02-24T09:09:26.268617+0000","last_peered":"2026-02-24T09:09:26.268617+0000","last_clean":"2026-02-24T09:09:26.268617+0000","last_became_active":"2026-02-24T09:09:25.266759+0000","last_became_peered":"2026-02-24T09:09:25.266759+0000","last_unstale":"2026-02-24T09:09:26.268617+0000","last_undegraded":"2026-02-24T09:09:26.268617+0000","last_fullsized":"2026-02-24T09:09:26.268617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:55.312047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268133+0000","last_change":"2026-02-24T09:09:25.268500+0000","last_active":"2026-02-24T09:09:26.268133+0000","last_peered":"2026-02-24T09:09:26.268133+0000","last_clean":"2026-02-24T09:09:26.268133+0000","last_became_active":"2026-02-24T09:09:25.267904+0000","last_became_peered":"2026-02-24T09:09:25.267904+0000","last_unstale":"2026-02-24T09:09:26.268133+0000","last_undegraded":"2026-02-24T09:09:26.268133+0000","last_fullsized":"2026-02-24T09:09:26.268133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:38:47.330593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269021+0000","last_change":"2026-02-24T09:09:25.269694+0000","last_active":"2026-02-24T09:09:26.269021+0000","last_peered":"2026-02-24T09:09:26.269021+0000","last_clean":"2026-02-24T09:09:26.269021+0000","last_became_active":"2026-02-24T09:09:25.269068+0000","last_became_peered":"2026-02-24T09:09:25.269068+0000","last_unstale":"2026-02-24T09:09:26.269021+0000","last_undegraded":"2026-02-24T09:09:26.269021+0000","last_fullsized":"2026-02-24T09:09:26.269021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:04:44.772275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332668+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.332668+0000","last_peered":"2026-02-24T09:09:26.332668+0000","last_clean":"2026-02-24T09:09:26.332668+0000","last_became_active":"2026-02-24T09:09:25.269534+0000","last_became_peered":"2026-02-24T09:09:25.269534+0000","last_unstale":"2026-02-24T09:09:26.332668+0000","last_undegraded":"2026-02-24T09:09:26.332668+0000","last_fullsized":"2026-02-24T09:09:26.332668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:45:51.428970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332478+0000","last_change":"2026-02-24T09:09:25.266779+0000","last_active":"2026-02-24T09:09:26.332478+0000","last_peered":"2026-02-24T09:09:26.332478+0000","last_clean":"2026-02-24T09:09:26.332478+0000","last_became_active":"2026-02-24T09:09:25.266603+0000","last_became_peered":"2026-02-24T09:09:25.266603+0000","last_unstale":"2026-02-24T09:09:26.332478+0000","last_undegraded":"2026-02-24T09:09:26.332478+0000","last_fullsized":"2026-02-24T09:09:26.332478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:01:38.198458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332295+0000","last_change":"2026-02-24T09:09:25.266933+0000","last_active":"2026-02-24T09:09:26.332295+0000","last_peered":"2026-02-24T09:09:26.332295+0000","last_clean":"2026-02-24T09:09:26.332295+0000","last_became_active":"2026-02-24T09:09:25.266381+0000","last_became_peered":"2026-02-24T09:09:25.266381+0000","last_unstale":"2026-02-24T09:09:26.332295+0000","last_undegraded":"2026-02-24T09:09:26.332295+0000","last_fullsized":"2026-02-24T09:09:26.332295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:45:44.657482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267754+0000","last_change":"2026-02-24T09:09:25.269576+0000","last_active":"2026-02-24T09:09:26.267754+0000","last_peered":"2026-02-24T09:09:26.267754+0000","last_clean":"2026-02-24T09:09:26.267754+0000","last_became_active":"2026-02-24T09:09:25.269159+0000","last_became_peered":"2026-02-24T09:09:25.269159+0000","last_unstale":"2026-02-24T09:09:26.267754+0000","last_undegraded":"2026-02-24T09:09:26.267754+0000","last_fullsized":"2026-02-24T09:09:26.267754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:23:37.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332345+0000","last_change":"2026-02-24T09:09:25.269282+0000","last_active":"2026-02-24T09:09:26.332345+0000","last_peered":"2026-02-24T09:09:26.332345+0000","last_clean":"2026-02-24T09:09:26.332345+0000","last_became_active":"2026-02-24T09:09:25.269088+0000","last_became_peered":"2026-02-24T09:09:25.269088+0000","last_unstale":"2026-02-24T09:09:26.332345+0000","last_undegraded":"2026-02-24T09:09:26.332345+0000","last_fullsized":"2026-02-24T09:09:26.332345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:49.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332404+0000","last_change":"2026-02-24T09:09:25.270968+0000","last_active":"2026-02-24T09:09:26.332404+0000","last_peered":"2026-02-24T09:09:26.332404+0000","last_clean":"2026-02-24T09:09:26.332404+0000","last_became_active":"2026-02-24T09:09:25.270816+0000","last_became_peered":"2026-02-24T09:09:25.270816+0000","last_unstale":"2026-02-24T09:09:26.332404+0000","last_undegraded":"2026-02-24T09:09:26.332404+0000","last_fullsized":"2026-02-24T09:09:26.332404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:10:08.592263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332360+0000","last_change":"2026-02-24T09:09:25.267715+0000","last_active":"2026-02-24T09:09:26.332360+0000","last_peered":"2026-02-24T09:09:26.332360+0000","last_clean":"2026-02-24T09:09:26.332360+0000","last_became_active":"2026-02-24T09:09:25.267031+0000","last_became_peered":"2026-02-24T09:09:25.267031+0000","last_unstale":"2026-02-24T09:09:26.332360+0000","last_undegraded":"2026-02-24T09:09:26.332360+0000","last_fullsized":"2026-02-24T09:09:26.332360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:14:50.568512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267758+0000","last_change":"2026-02-24T09:09:25.268347+0000","last_active":"2026-02-24T09:09:26.267758+0000","last_peered":"2026-02-24T09:09:26.267758+0000","last_clean":"2026-02-24T09:09:26.267758+0000","last_became_active":"2026-02-24T09:09:25.268235+0000","last_became_peered":"2026-02-24T09:09:25.268235+0000","last_unstale":"2026-02-24T09:09:26.267758+0000","last_undegraded":"2026-02-24T09:09:26.267758+0000","last_fullsized":"2026-02-24T09:09:26.267758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:17.309082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267916+0000","last_change":"2026-02-24T09:09:24.256941+0000","last_active":"2026-02-24T09:09:26.267916+0000","last_peered":"2026-02-24T09:09:26.267916+0000","last_clean":"2026-02-24T09:09:26.267916+0000","last_became_active":"2026-02-24T09:09:24.256577+0000","last_became_peered":"2026-02-24T09:09:24.256577+0000","last_unstale":"2026-02-24T09:09:26.267916+0000","last_undegraded":"2026-02-24T09:09:26.267916+0000","last_fullsized":"2026-02-24T09:09:26.267916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:13:19.756549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268000+0000","last_change":"2026-02-24T09:09:25.270452+0000","last_active":"2026-02-24T09:09:26.268000+0000","last_peered":"2026-02-24T09:09:26.268000+0000","last_clean":"2026-02-24T09:09:26.268000+0000","last_became_active":"2026-02-24T09:09:25.270184+0000","last_became_peered":"2026-02-24T09:09:25.270184+0000","last_unstale":"2026-02-24T09:09:26.268000+0000","last_undegraded":"2026-02-24T09:09:26.268000+0000","last_fullsized":"2026-02-24T09:09:26.268000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:07:41.652941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270021+0000","last_change":"2026-02-24T09:09:24.261249+0000","last_active":"2026-02-24T09:09:26.270021+0000","last_peered":"2026-02-24T09:09:26.270021+0000","last_clean":"2026-02-24T09:09:26.270021+0000","last_became_active":"2026-02-24T09:09:24.261064+0000","last_became_peered":"2026-02-24T09:09:24.261064+0000","last_unstale":"2026-02-24T09:09:26.270021+0000","last_undegraded":"2026-02-24T09:09:26.270021+0000","last_fullsized":"2026-02-24T09:09:26.270021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:59:42.964350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941445+0000","last_change":"2026-02-24T09:09:24.254918+0000","last_active":"2026-02-24T09:09:28.941445+0000","last_peered":"2026-02-24T09:09:28.941445+0000","last_clean":"2026-02-24T09:09:28.941445+0000","last_became_active":"2026-02-24T09:09:24.254590+0000","last_became_peered":"2026-02-24T09:09:24.254590+0000","last_unstale":"2026-02-24T09:09:28.941445+0000","last_undegraded":"2026-02-24T09:09:28.941445+0000","last_fullsized":"2026-02-24T09:09:28.941445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:03:19.504844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268666+0000","last_change":"2026-02-24T09:09:25.267204+0000","last_active":"2026-02-24T09:09:26.268666+0000","last_peered":"2026-02-24T09:09:26.268666+0000","last_clean":"2026-02-24T09:09:26.268666+0000","last_became_active":"2026-02-24T09:09:25.266489+0000","last_became_peered":"2026-02-24T09:09:25.266489+0000","last_unstale":"2026-02-24T09:09:26.268666+0000","last_undegraded":"2026-02-24T09:09:26.268666+0000","last_fullsized":"2026-02-24T09:09:26.268666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:26:34.500054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268230+0000","last_change":"2026-02-24T09:09:24.258042+0000","last_active":"2026-02-24T09:09:26.268230+0000","last_peered":"2026-02-24T09:09:26.268230+0000","last_clean":"2026-02-24T09:09:26.268230+0000","last_became_active":"2026-02-24T09:09:24.257801+0000","last_became_peered":"2026-02-24T09:09:24.257801+0000","last_unstale":"2026-02-24T09:09:26.268230+0000","last_undegraded":"2026-02-24T09:09:26.268230+0000","last_fullsized":"2026-02-24T09:09:26.268230+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:27.596990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267334+0000","last_change":"2026-02-24T09:09:25.267636+0000","last_active":"2026-02-24T09:09:26.267334+0000","last_peered":"2026-02-24T09:09:26.267334+0000","last_clean":"2026-02-24T09:09:26.267334+0000","last_became_active":"2026-02-24T09:09:25.267505+0000","last_became_peered":"2026-02-24T09:09:25.267505+0000","last_unstale":"2026-02-24T09:09:26.267334+0000","last_undegraded":"2026-02-24T09:09:26.267334+0000","last_fullsized":"2026-02-24T09:09:26.267334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:20.660345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270215+0000","last_change":"2026-02-24T09:09:24.260793+0000","last_active":"2026-02-24T09:09:26.270215+0000","last_peered":"2026-02-24T09:09:26.270215+0000","last_clean":"2026-02-24T09:09:26.270215+0000","last_became_active":"2026-02-24T09:09:24.260555+0000","last_became_peered":"2026-02-24T09:09:24.260555+0000","last_unstale":"2026-02-24T09:09:26.270215+0000","last_undegraded":"2026-02-24T09:09:26.270215+0000","last_fullsized":"2026-02-24T09:09:26.270215+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:30:45.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334847+0000","last_change":"2026-02-24T09:09:25.271121+0000","last_active":"2026-02-24T09:09:26.334847+0000","last_peered":"2026-02-24T09:09:26.334847+0000","last_clean":"2026-02-24T09:09:26.334847+0000","last_became_active":"2026-02-24T09:09:25.270770+0000","last_became_peered":"2026-02-24T09:09:25.270770+0000","last_unstale":"2026-02-24T09:09:26.334847+0000","last_undegraded":"2026-02-24T09:09:26.334847+0000","last_fullsized":"2026-02-24T09:09:26.334847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:52:58.451719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940998+0000","last_change":"2026-02-24T09:09:24.259030+0000","last_active":"2026-02-24T09:09:27.940998+0000","last_peered":"2026-02-24T09:09:27.940998+0000","last_clean":"2026-02-24T09:09:27.940998+0000","last_became_active":"2026-02-24T09:09:24.258747+0000","last_became_peered":"2026-02-24T09:09:24.258747+0000","last_unstale":"2026-02-24T09:09:27.940998+0000","last_undegraded":"2026-02-24T09:09:27.940998+0000","last_fullsized":"2026-02-24T09:09:27.940998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:49:46.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267794+0000","last_change":"2026-02-24T09:09:25.269875+0000","last_active":"2026-02-24T09:09:26.267794+0000","last_peered":"2026-02-24T09:09:26.267794+0000","last_clean":"2026-02-24T09:09:26.267794+0000","last_became_active":"2026-02-24T09:09:25.269400+0000","last_became_peered":"2026-02-24T09:09:25.269400+0000","last_unstale":"2026-02-24T09:09:26.267794+0000","last_undegraded":"2026-02-24T09:09:26.267794+0000","last_fullsized":"2026-02-24T09:09:26.267794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:08:29.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268101+0000","last_change":"2026-02-24T09:09:24.256845+0000","last_active":"2026-02-24T09:09:26.268101+0000","last_peered":"2026-02-24T09:09:26.268101+0000","last_clean":"2026-02-24T09:09:26.268101+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:26.268101+0000","last_undegraded":"2026-02-24T09:09:26.268101+0000","last_fullsized":"2026-02-24T09:09:26.268101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:08:15.802226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334785+0000","last_change":"2026-02-24T09:09:25.269608+0000","last_active":"2026-02-24T09:09:26.334785+0000","last_peered":"2026-02-24T09:09:26.334785+0000","last_clean":"2026-02-24T09:09:26.334785+0000","last_became_active":"2026-02-24T09:09:25.268736+0000","last_became_peered":"2026-02-24T09:09:25.268736+0000","last_unstale":"2026-02-24T09:09:26.334785+0000","last_undegraded":"2026-02-24T09:09:26.334785+0000","last_fullsized":"2026-02-24T09:09:26.334785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:39:41.466580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'6","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270140+0000","last_change":"2026-02-24T09:09:24.260591+0000","last_active":"2026-02-24T09:09:26.270140+0000","last_peered":"2026-02-24T09:09:26.270140+0000","last_clean":"2026-02-24T09:09:26.270140+0000","last_became_active":"2026-02-24T09:09:24.260382+0000","last_became_peered":"2026-02-24T09:09:24.260382+0000","last_unstale":"2026-02-24T09:09:26.270140+0000","last_undegraded":"2026-02-24T09:09:26.270140+0000","last_fullsized":"2026-02-24T09:09:26.270140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:05:00.313499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1622,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267717+0000","last_change":"2026-02-24T09:09:25.266872+0000","last_active":"2026-02-24T09:09:26.267717+0000","last_peered":"2026-02-24T09:09:26.267717+0000","last_clean":"2026-02-24T09:09:26.267717+0000","last_became_active":"2026-02-24T09:09:25.266720+0000","last_became_peered":"2026-02-24T09:09:25.266720+0000","last_unstale":"2026-02-24T09:09:26.267717+0000","last_undegraded":"2026-02-24T09:09:26.267717+0000","last_fullsized":"2026-02-24T09:09:26.267717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:43.574647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938532+0000","last_change":"2026-02-24T09:09:24.256821+0000","last_active":"2026-02-24T09:09:27.938532+0000","last_peered":"2026-02-24T09:09:27.938532+0000","last_clean":"2026-02-24T09:09:27.938532+0000","last_became_active":"2026-02-24T09:09:24.256284+0000","last_became_peered":"2026-02-24T09:09:24.256284+0000","last_unstale":"2026-02-24T09:09:27.938532+0000","last_undegraded":"2026-02-24T09:09:27.938532+0000","last_fullsized":"2026-02-24T09:09:27.938532+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:37:32.352734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332187+0000","last_change":"2026-02-24T09:09:25.268120+0000","last_active":"2026-02-24T09:09:26.332187+0000","last_peered":"2026-02-24T09:09:26.332187+0000","last_clean":"2026-02-24T09:09:26.332187+0000","last_became_active":"2026-02-24T09:09:25.267865+0000","last_became_peered":"2026-02-24T09:09:25.267865+0000","last_unstale":"2026-02-24T09:09:26.332187+0000","last_undegraded":"2026-02-24T09:09:26.332187+0000","last_fullsized":"2026-02-24T09:09:26.332187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:51:18.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267953+0000","last_change":"2026-02-24T09:09:24.257176+0000","last_active":"2026-02-24T09:09:26.267953+0000","last_peered":"2026-02-24T09:09:26.267953+0000","last_clean":"2026-02-24T09:09:26.267953+0000","last_became_active":"2026-02-24T09:09:24.256855+0000","last_became_peered":"2026-02-24T09:09:24.256855+0000","last_unstale":"2026-02-24T09:09:26.267953+0000","last_undegraded":"2026-02-24T09:09:26.267953+0000","last_fullsized":"2026-02-24T09:09:26.267953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:48:25.179774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733497+0000","last_change":"2026-02-24T09:09:25.271913+0000","last_active":"2026-02-24T09:09:26.733497+0000","last_peered":"2026-02-24T09:09:26.733497+0000","last_clean":"2026-02-24T09:09:26.733497+0000","last_became_active":"2026-02-24T09:09:25.271736+0000","last_became_peered":"2026-02-24T09:09:25.271736+0000","last_unstale":"2026-02-24T09:09:26.733497+0000","last_undegraded":"2026-02-24T09:09:26.733497+0000","last_fullsized":"2026-02-24T09:09:26.733497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:49.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943686+0000","last_change":"2026-02-24T09:09:24.259308+0000","last_active":"2026-02-24T09:09:28.943686+0000","last_peered":"2026-02-24T09:09:28.943686+0000","last_clean":"2026-02-24T09:09:28.943686+0000","last_became_active":"2026-02-24T09:09:24.259131+0000","last_became_peered":"2026-02-24T09:09:24.259131+0000","last_unstale":"2026-02-24T09:09:28.943686+0000","last_undegraded":"2026-02-24T09:09:28.943686+0000","last_fullsized":"2026-02-24T09:09:28.943686+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:52:00.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733165+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.733165+0000","last_peered":"2026-02-24T09:09:26.733165+0000","last_clean":"2026-02-24T09:09:26.733165+0000","last_became_active":"2026-02-24T09:09:25.269559+0000","last_became_peered":"2026-02-24T09:09:25.269559+0000","last_unstale":"2026-02-24T09:09:26.733165+0000","last_undegraded":"2026-02-24T09:09:26.733165+0000","last_fullsized":"2026-02-24T09:09:26.733165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:06:28.902948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942522+0000","last_change":"2026-02-24T09:09:24.257075+0000","last_active":"2026-02-24T09:09:28.942522+0000","last_peered":"2026-02-24T09:09:28.942522+0000","last_clean":"2026-02-24T09:09:28.942522+0000","last_became_active":"2026-02-24T09:09:24.256738+0000","last_became_peered":"2026-02-24T09:09:24.256738+0000","last_unstale":"2026-02-24T09:09:28.942522+0000","last_undegraded":"2026-02-24T09:09:28.942522+0000","last_fullsized":"2026-02-24T09:09:28.942522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:14.802040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268002+0000","last_change":"2026-02-24T09:09:25.271423+0000","last_active":"2026-02-24T09:09:26.268002+0000","last_peered":"2026-02-24T09:09:26.268002+0000","last_clean":"2026-02-24T09:09:26.268002+0000","last_became_active":"2026-02-24T09:09:25.271142+0000","last_became_peered":"2026-02-24T09:09:25.271142+0000","last_unstale":"2026-02-24T09:09:26.268002+0000","last_undegraded":"2026-02-24T09:09:26.268002+0000","last_fullsized":"2026-02-24T09:09:26.268002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:16.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.940354+0000","last_change":"2026-02-24T09:09:24.258426+0000","last_active":"2026-02-24T09:09:29.940354+0000","last_peered":"2026-02-24T09:09:29.940354+0000","last_clean":"2026-02-24T09:09:29.940354+0000","last_became_active":"2026-02-24T09:09:24.257941+0000","last_became_peered":"2026-02-24T09:09:24.257941+0000","last_unstale":"2026-02-24T09:09:29.940354+0000","last_undegraded":"2026-02-24T09:09:29.940354+0000","last_fullsized":"2026-02-24T09:09:29.940354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:30:29.724001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332552+0000","last_change":"2026-02-24T09:09:25.266758+0000","last_active":"2026-02-24T09:09:26.332552+0000","last_peered":"2026-02-24T09:09:26.332552+0000","last_clean":"2026-02-24T09:09:26.332552+0000","last_became_active":"2026-02-24T09:09:25.266569+0000","last_became_peered":"2026-02-24T09:09:25.266569+0000","last_unstale":"2026-02-24T09:09:26.332552+0000","last_undegraded":"2026-02-24T09:09:26.332552+0000","last_fullsized":"2026-02-24T09:09:26.332552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:13:56.985056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332354+0000","last_change":"2026-02-24T09:09:24.256974+0000","last_active":"2026-02-24T09:09:26.332354+0000","last_peered":"2026-02-24T09:09:26.332354+0000","last_clean":"2026-02-24T09:09:26.332354+0000","last_became_active":"2026-02-24T09:09:24.256617+0000","last_became_peered":"2026-02-24T09:09:24.256617+0000","last_unstale":"2026-02-24T09:09:26.332354+0000","last_undegraded":"2026-02-24T09:09:26.332354+0000","last_fullsized":"2026-02-24T09:09:26.332354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:28.318156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733475+0000","last_change":"2026-02-24T09:09:25.270445+0000","last_active":"2026-02-24T09:09:26.733475+0000","last_peered":"2026-02-24T09:09:26.733475+0000","last_clean":"2026-02-24T09:09:26.733475+0000","last_became_active":"2026-02-24T09:09:25.270275+0000","last_became_peered":"2026-02-24T09:09:25.270275+0000","last_unstale":"2026-02-24T09:09:26.733475+0000","last_undegraded":"2026-02-24T09:09:26.733475+0000","last_fullsized":"2026-02-24T09:09:26.733475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:53:49.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268206+0000","last_change":"2026-02-24T09:09:24.259031+0000","last_active":"2026-02-24T09:09:26.268206+0000","last_peered":"2026-02-24T09:09:26.268206+0000","last_clean":"2026-02-24T09:09:26.268206+0000","last_became_active":"2026-02-24T09:09:24.258899+0000","last_became_peered":"2026-02-24T09:09:24.258899+0000","last_unstale":"2026-02-24T09:09:26.268206+0000","last_undegraded":"2026-02-24T09:09:26.268206+0000","last_fullsized":"2026-02-24T09:09:26.268206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:16.802986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733389+0000","last_change":"2026-02-24T09:09:25.272707+0000","last_active":"2026-02-24T09:09:26.733389+0000","last_peered":"2026-02-24T09:09:26.733389+0000","last_clean":"2026-02-24T09:09:26.733389+0000","last_became_active":"2026-02-24T09:09:25.272563+0000","last_became_peered":"2026-02-24T09:09:25.272563+0000","last_unstale":"2026-02-24T09:09:26.733389+0000","last_undegraded":"2026-02-24T09:09:26.733389+0000","last_fullsized":"2026-02-24T09:09:26.733389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:41:22.895217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332549+0000","last_change":"2026-02-24T09:09:24.256493+0000","last_active":"2026-02-24T09:09:26.332549+0000","last_peered":"2026-02-24T09:09:26.332549+0000","last_clean":"2026-02-24T09:09:26.332549+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:26.332549+0000","last_undegraded":"2026-02-24T09:09:26.332549+0000","last_fullsized":"2026-02-24T09:09:26.332549+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:43:12.259841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733528+0000","last_change":"2026-02-24T09:09:25.271977+0000","last_active":"2026-02-24T09:09:26.733528+0000","last_peered":"2026-02-24T09:09:26.733528+0000","last_clean":"2026-02-24T09:09:26.733528+0000","last_became_active":"2026-02-24T09:09:25.271650+0000","last_became_peered":"2026-02-24T09:09:25.271650+0000","last_unstale":"2026-02-24T09:09:26.733528+0000","last_undegraded":"2026-02-24T09:09:26.733528+0000","last_fullsized":"2026-02-24T09:09:26.733528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:10.062115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733207+0000","last_change":"2026-02-24T09:09:05.953512+0000","last_active":"2026-02-24T09:09:26.733207+0000","last_peered":"2026-02-24T09:09:26.733207+0000","last_clean":"2026-02-24T09:09:26.733207+0000","last_became_active":"2026-02-24T09:09:05.953360+0000","last_became_peered":"2026-02-24T09:09:05.953360+0000","last_unstale":"2026-02-24T09:09:26.733207+0000","last_undegraded":"2026-02-24T09:09:26.733207+0000","last_fullsized":"2026-02-24T09:09:26.733207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_clean_scrub_stamp":"2026-02-24T09:08:00.445410+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:48.550493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941025+0000","last_change":"2026-02-24T09:09:24.259164+0000","last_active":"2026-02-24T09:09:27.941025+0000","last_peered":"2026-02-24T09:09:27.941025+0000","last_clean":"2026-02-24T09:09:27.941025+0000","last_became_active":"2026-02-24T09:09:24.259011+0000","last_became_peered":"2026-02-24T09:09:24.259011+0000","last_unstale":"2026-02-24T09:09:27.941025+0000","last_undegraded":"2026-02-24T09:09:27.941025+0000","last_fullsized":"2026-02-24T09:09:27.941025+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:41.649484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268864+0000","last_change":"2026-02-24T09:09:25.269884+0000","last_active":"2026-02-24T09:09:26.268864+0000","last_peered":"2026-02-24T09:09:26.268864+0000","last_clean":"2026-02-24T09:09:26.268864+0000","last_became_active":"2026-02-24T09:09:25.269543+0000","last_became_peered":"2026-02-24T09:09:25.269543+0000","last_unstale":"2026-02-24T09:09:26.268864+0000","last_undegraded":"2026-02-24T09:09:26.268864+0000","last_fullsized":"2026-02-24T09:09:26.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:21:25.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940807+0000","last_change":"2026-02-24T09:09:24.259369+0000","last_active":"2026-02-24T09:09:27.940807+0000","last_peered":"2026-02-24T09:09:27.940807+0000","last_clean":"2026-02-24T09:09:27.940807+0000","last_became_active":"2026-02-24T09:09:24.259086+0000","last_became_peered":"2026-02-24T09:09:24.259086+0000","last_unstale":"2026-02-24T09:09:27.940807+0000","last_undegraded":"2026-02-24T09:09:27.940807+0000","last_fullsized":"2026-02-24T09:09:27.940807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:08.881900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332119+0000","last_change":"2026-02-24T09:09:25.266898+0000","last_active":"2026-02-24T09:09:26.332119+0000","last_peered":"2026-02-24T09:09:26.332119+0000","last_clean":"2026-02-24T09:09:26.332119+0000","last_became_active":"2026-02-24T09:09:25.266407+0000","last_became_peered":"2026-02-24T09:09:25.266407+0000","last_unstale":"2026-02-24T09:09:26.332119+0000","last_undegraded":"2026-02-24T09:09:26.332119+0000","last_fullsized":"2026-02-24T09:09:26.332119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:51.887929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941603+0000","last_change":"2026-02-24T09:09:24.254126+0000","last_active":"2026-02-24T09:09:28.941603+0000","last_peered":"2026-02-24T09:09:28.941603+0000","last_clean":"2026-02-24T09:09:28.941603+0000","last_became_active":"2026-02-24T09:09:24.253911+0000","last_became_peered":"2026-02-24T09:09:24.253911+0000","last_unstale":"2026-02-24T09:09:28.941603+0000","last_undegraded":"2026-02-24T09:09:28.941603+0000","last_fullsized":"2026-02-24T09:09:28.941603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:09:56.146842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268161+0000","last_change":"2026-02-24T09:09:25.270387+0000","last_active":"2026-02-24T09:09:26.268161+0000","last_peered":"2026-02-24T09:09:26.268161+0000","last_clean":"2026-02-24T09:09:26.268161+0000","last_became_active":"2026-02-24T09:09:25.269478+0000","last_became_peered":"2026-02-24T09:09:25.269478+0000","last_unstale":"2026-02-24T09:09:26.268161+0000","last_undegraded":"2026-02-24T09:09:26.268161+0000","last_fullsized":"2026-02-24T09:09:26.268161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:32:15.217221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733294+0000","last_change":"2026-02-24T09:09:24.259169+0000","last_active":"2026-02-24T09:09:26.733294+0000","last_peered":"2026-02-24T09:09:26.733294+0000","last_clean":"2026-02-24T09:09:26.733294+0000","last_became_active":"2026-02-24T09:09:24.258755+0000","last_became_peered":"2026-02-24T09:09:24.258755+0000","last_unstale":"2026-02-24T09:09:26.733294+0000","last_undegraded":"2026-02-24T09:09:26.733294+0000","last_fullsized":"2026-02-24T09:09:26.733294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:33.438504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270152+0000","last_change":"2026-02-24T09:09:25.270732+0000","last_active":"2026-02-24T09:09:26.270152+0000","last_peered":"2026-02-24T09:09:26.270152+0000","last_clean":"2026-02-24T09:09:26.270152+0000","last_became_active":"2026-02-24T09:09:25.270200+0000","last_became_peered":"2026-02-24T09:09:25.270200+0000","last_unstale":"2026-02-24T09:09:26.270152+0000","last_undegraded":"2026-02-24T09:09:26.270152+0000","last_fullsized":"2026-02-24T09:09:26.270152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:59:28.115196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267351+0000","last_change":"2026-02-24T09:09:24.257488+0000","last_active":"2026-02-24T09:09:26.267351+0000","last_peered":"2026-02-24T09:09:26.267351+0000","last_clean":"2026-02-24T09:09:26.267351+0000","last_became_active":"2026-02-24T09:09:24.257202+0000","last_became_peered":"2026-02-24T09:09:24.257202+0000","last_unstale":"2026-02-24T09:09:26.267351+0000","last_undegraded":"2026-02-24T09:09:26.267351+0000","last_fullsized":"2026-02-24T09:09:26.267351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:41:24.345307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270233+0000","last_change":"2026-02-24T09:09:25.272254+0000","last_active":"2026-02-24T09:09:26.270233+0000","last_peered":"2026-02-24T09:09:26.270233+0000","last_clean":"2026-02-24T09:09:26.270233+0000","last_became_active":"2026-02-24T09:09:25.271674+0000","last_became_peered":"2026-02-24T09:09:25.271674+0000","last_unstale":"2026-02-24T09:09:26.270233+0000","last_undegraded":"2026-02-24T09:09:26.270233+0000","last_fullsized":"2026-02-24T09:09:26.270233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:03:26.493850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938246+0000","last_change":"2026-02-24T09:09:24.257331+0000","last_active":"2026-02-24T09:09:27.938246+0000","last_peered":"2026-02-24T09:09:27.938246+0000","last_clean":"2026-02-24T09:09:27.938246+0000","last_became_active":"2026-02-24T09:09:24.256876+0000","last_became_peered":"2026-02-24T09:09:24.256876+0000","last_unstale":"2026-02-24T09:09:27.938246+0000","last_undegraded":"2026-02-24T09:09:27.938246+0000","last_fullsized":"2026-02-24T09:09:27.938246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:29:58.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332332+0000","last_change":"2026-02-24T09:09:25.266642+0000","last_active":"2026-02-24T09:09:26.332332+0000","last_peered":"2026-02-24T09:09:26.332332+0000","last_clean":"2026-02-24T09:09:26.332332+0000","last_became_active":"2026-02-24T09:09:25.266307+0000","last_became_peered":"2026-02-24T09:09:25.266307+0000","last_unstale":"2026-02-24T09:09:26.332332+0000","last_undegraded":"2026-02-24T09:09:26.332332+0000","last_fullsized":"2026-02-24T09:09:26.332332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:51.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267446+0000","last_change":"2026-02-24T09:09:24.258807+0000","last_active":"2026-02-24T09:09:26.267446+0000","last_peered":"2026-02-24T09:09:26.267446+0000","last_clean":"2026-02-24T09:09:26.267446+0000","last_became_active":"2026-02-24T09:09:24.258649+0000","last_became_peered":"2026-02-24T09:09:24.258649+0000","last_unstale":"2026-02-24T09:09:26.267446+0000","last_undegraded":"2026-02-24T09:09:26.267446+0000","last_fullsized":"2026-02-24T09:09:26.267446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:10:48.348275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269009+0000","last_change":"2026-02-24T09:09:25.268491+0000","last_active":"2026-02-24T09:09:26.269009+0000","last_peered":"2026-02-24T09:09:26.269009+0000","last_clean":"2026-02-24T09:09:26.269009+0000","last_became_active":"2026-02-24T09:09:25.267341+0000","last_became_peered":"2026-02-24T09:09:25.267341+0000","last_unstale":"2026-02-24T09:09:26.269009+0000","last_undegraded":"2026-02-24T09:09:26.269009+0000","last_fullsized":"2026-02-24T09:09:26.269009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:18:29.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940964+0000","last_change":"2026-02-24T09:09:24.258484+0000","last_active":"2026-02-24T09:09:27.940964+0000","last_peered":"2026-02-24T09:09:27.940964+0000","last_clean":"2026-02-24T09:09:27.940964+0000","last_became_active":"2026-02-24T09:09:24.258249+0000","last_became_peered":"2026-02-24T09:09:24.258249+0000","last_unstale":"2026-02-24T09:09:27.940964+0000","last_undegraded":"2026-02-24T09:09:27.940964+0000","last_fullsized":"2026-02-24T09:09:27.940964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:32:56.722522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267783+0000","last_change":"2026-02-24T09:09:25.269738+0000","last_active":"2026-02-24T09:09:26.267783+0000","last_peered":"2026-02-24T09:09:26.267783+0000","last_clean":"2026-02-24T09:09:26.267783+0000","last_became_active":"2026-02-24T09:09:25.269413+0000","last_became_peered":"2026-02-24T09:09:25.269413+0000","last_unstale":"2026-02-24T09:09:26.267783+0000","last_undegraded":"2026-02-24T09:09:26.267783+0000","last_fullsized":"2026-02-24T09:09:26.267783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:00.412570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941334+0000","last_change":"2026-02-24T09:09:24.258901+0000","last_active":"2026-02-24T09:09:27.941334+0000","last_peered":"2026-02-24T09:09:27.941334+0000","last_clean":"2026-02-24T09:09:27.941334+0000","last_became_active":"2026-02-24T09:09:24.258325+0000","last_became_peered":"2026-02-24T09:09:24.258325+0000","last_unstale":"2026-02-24T09:09:27.941334+0000","last_undegraded":"2026-02-24T09:09:27.941334+0000","last_fullsized":"2026-02-24T09:09:27.941334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:36.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267522+0000","last_change":"2026-02-24T09:09:25.267368+0000","last_active":"2026-02-24T09:09:26.267522+0000","last_peered":"2026-02-24T09:09:26.267522+0000","last_clean":"2026-02-24T09:09:26.267522+0000","last_became_active":"2026-02-24T09:09:25.267168+0000","last_became_peered":"2026-02-24T09:09:25.267168+0000","last_unstale":"2026-02-24T09:09:26.267522+0000","last_undegraded":"2026-02-24T09:09:26.267522+0000","last_fullsized":"2026-02-24T09:09:26.267522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:57.616866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.939140+0000","last_change":"2026-02-24T09:09:24.257345+0000","last_active":"2026-02-24T09:09:27.939140+0000","last_peered":"2026-02-24T09:09:27.939140+0000","last_clean":"2026-02-24T09:09:27.939140+0000","last_became_active":"2026-02-24T09:09:24.256817+0000","last_became_peered":"2026-02-24T09:09:24.256817+0000","last_unstale":"2026-02-24T09:09:27.939140+0000","last_undegraded":"2026-02-24T09:09:27.939140+0000","last_fullsized":"2026-02-24T09:09:27.939140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:37:48.042471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332527+0000","last_change":"2026-02-24T09:09:25.267778+0000","last_active":"2026-02-24T09:09:26.332527+0000","last_peered":"2026-02-24T09:09:26.332527+0000","last_clean":"2026-02-24T09:09:26.332527+0000","last_became_active":"2026-02-24T09:09:25.267379+0000","last_became_peered":"2026-02-24T09:09:25.267379+0000","last_unstale":"2026-02-24T09:09:26.332527+0000","last_undegraded":"2026-02-24T09:09:26.332527+0000","last_fullsized":"2026-02-24T09:09:26.332527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:25:47.194857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332298+0000","last_change":"2026-02-24T09:09:24.259141+0000","last_active":"2026-02-24T09:09:26.332298+0000","last_peered":"2026-02-24T09:09:26.332298+0000","last_clean":"2026-02-24T09:09:26.332298+0000","last_became_active":"2026-02-24T09:09:24.258981+0000","last_became_peered":"2026-02-24T09:09:24.258981+0000","last_unstale":"2026-02-24T09:09:26.332298+0000","last_undegraded":"2026-02-24T09:09:26.332298+0000","last_fullsized":"2026-02-24T09:09:26.332298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:48.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268774+0000","last_change":"2026-02-24T09:09:25.268540+0000","last_active":"2026-02-24T09:09:26.268774+0000","last_peered":"2026-02-24T09:09:26.268774+0000","last_clean":"2026-02-24T09:09:26.268774+0000","last_became_active":"2026-02-24T09:09:25.267915+0000","last_became_peered":"2026-02-24T09:09:25.267915+0000","last_unstale":"2026-02-24T09:09:26.268774+0000","last_undegraded":"2026-02-24T09:09:26.268774+0000","last_fullsized":"2026-02-24T09:09:26.268774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:55.564971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938005+0000","last_change":"2026-02-24T09:09:24.257964+0000","last_active":"2026-02-24T09:09:27.938005+0000","last_peered":"2026-02-24T09:09:27.938005+0000","last_clean":"2026-02-24T09:09:27.938005+0000","last_became_active":"2026-02-24T09:09:24.257717+0000","last_became_peered":"2026-02-24T09:09:24.257717+0000","last_unstale":"2026-02-24T09:09:27.938005+0000","last_undegraded":"2026-02-24T09:09:27.938005+0000","last_fullsized":"2026-02-24T09:09:27.938005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:23:24.989893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733433+0000","last_change":"2026-02-24T09:09:25.271214+0000","last_active":"2026-02-24T09:09:26.733433+0000","last_peered":"2026-02-24T09:09:26.733433+0000","last_clean":"2026-02-24T09:09:26.733433+0000","last_became_active":"2026-02-24T09:09:25.271038+0000","last_became_peered":"2026-02-24T09:09:25.271038+0000","last_unstale":"2026-02-24T09:09:26.733433+0000","last_undegraded":"2026-02-24T09:09:26.733433+0000","last_fullsized":"2026-02-24T09:09:26.733433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:58:44.899837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268097+0000","last_change":"2026-02-24T09:09:25.269834+0000","last_active":"2026-02-24T09:09:26.268097+0000","last_peered":"2026-02-24T09:09:26.268097+0000","last_clean":"2026-02-24T09:09:26.268097+0000","last_became_active":"2026-02-24T09:09:25.269526+0000","last_became_peered":"2026-02-24T09:09:25.269526+0000","last_unstale":"2026-02-24T09:09:26.268097+0000","last_undegraded":"2026-02-24T09:09:26.268097+0000","last_fullsized":"2026-02-24T09:09:26.268097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:36:54.610640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267687+0000","last_change":"2026-02-24T09:09:24.258597+0000","last_active":"2026-02-24T09:09:26.267687+0000","last_peered":"2026-02-24T09:09:26.267687+0000","last_clean":"2026-02-24T09:09:26.267687+0000","last_became_active":"2026-02-24T09:09:24.258302+0000","last_became_peered":"2026-02-24T09:09:24.258302+0000","last_unstale":"2026-02-24T09:09:26.267687+0000","last_undegraded":"2026-02-24T09:09:26.267687+0000","last_fullsized":"2026-02-24T09:09:26.267687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:20:15.556479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334746+0000","last_change":"2026-02-24T09:09:25.269804+0000","last_active":"2026-02-24T09:09:26.334746+0000","last_peered":"2026-02-24T09:09:26.334746+0000","last_clean":"2026-02-24T09:09:26.334746+0000","last_became_active":"2026-02-24T09:09:25.268973+0000","last_became_peered":"2026-02-24T09:09:25.268973+0000","last_unstale":"2026-02-24T09:09:26.334746+0000","last_undegraded":"2026-02-24T09:09:26.334746+0000","last_fullsized":"2026-02-24T09:09:26.334746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:33:39.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942003+0000","last_change":"2026-02-24T09:09:24.257428+0000","last_active":"2026-02-24T09:09:28.942003+0000","last_peered":"2026-02-24T09:09:28.942003+0000","last_clean":"2026-02-24T09:09:28.942003+0000","last_became_active":"2026-02-24T09:09:24.256679+0000","last_became_peered":"2026-02-24T09:09:24.256679+0000","last_unstale":"2026-02-24T09:09:28.942003+0000","last_undegraded":"2026-02-24T09:09:28.942003+0000","last_fullsized":"2026-02-24T09:09:28.942003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:39:28.664820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267792+0000","last_change":"2026-02-24T09:09:25.268127+0000","last_active":"2026-02-24T09:09:26.267792+0000","last_peered":"2026-02-24T09:09:26.267792+0000","last_clean":"2026-02-24T09:09:26.267792+0000","last_became_active":"2026-02-24T09:09:25.267860+0000","last_became_peered":"2026-02-24T09:09:25.267860+0000","last_unstale":"2026-02-24T09:09:26.267792+0000","last_undegraded":"2026-02-24T09:09:26.267792+0000","last_fullsized":"2026-02-24T09:09:26.267792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:37:52.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269053+0000","last_change":"2026-02-24T09:09:24.257552+0000","last_active":"2026-02-24T09:09:26.269053+0000","last_peered":"2026-02-24T09:09:26.269053+0000","last_clean":"2026-02-24T09:09:26.269053+0000","last_became_active":"2026-02-24T09:09:24.257163+0000","last_became_peered":"2026-02-24T09:09:24.257163+0000","last_unstale":"2026-02-24T09:09:26.269053+0000","last_undegraded":"2026-02-24T09:09:26.269053+0000","last_fullsized":"2026-02-24T09:09:26.269053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:30:54.285800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268961+0000","last_change":"2026-02-24T09:09:25.268695+0000","last_active":"2026-02-24T09:09:26.268961+0000","last_peered":"2026-02-24T09:09:26.268961+0000","last_clean":"2026-02-24T09:09:26.268961+0000","last_became_active":"2026-02-24T09:09:25.268128+0000","last_became_peered":"2026-02-24T09:09:25.268128+0000","last_unstale":"2026-02-24T09:09:26.268961+0000","last_undegraded":"2026-02-24T09:09:26.268961+0000","last_fullsized":"2026-02-24T09:09:26.268961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:23.987958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267474+0000","last_change":"2026-02-24T09:09:24.257602+0000","last_active":"2026-02-24T09:09:26.267474+0000","last_peered":"2026-02-24T09:09:26.267474+0000","last_clean":"2026-02-24T09:09:26.267474+0000","last_became_active":"2026-02-24T09:09:24.257440+0000","last_became_peered":"2026-02-24T09:09:24.257440+0000","last_unstale":"2026-02-24T09:09:26.267474+0000","last_undegraded":"2026-02-24T09:09:26.267474+0000","last_fullsized":"2026-02-24T09:09:26.267474+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:13:51.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3366,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":89,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":100343,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":259322,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710727,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":395125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":27582038},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939654,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27828,"kb_used_data":864,"kb_used_omap":17,"kb_used_meta":26926,"kb_avail":733975372,"statfs":{"total":751619276800,"available":751590780928,"internally_reserved":0,"allocated":884736,"data_stored":986717,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":17477,"internal_metadata":27573179},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070473,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":395327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21694,"internal_metadata":27568962},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299402,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31140,"internal_metadata":27559516},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528332,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":985493,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":25152,"internal_metadata":27565504},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":394623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888078,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27816,"kb_used_data":852,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975384,"statfs":{"total":751619276800,"available":751590793216,"internally_reserved":0,"allocated":872448,"data_stored":985083,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":30940,"internal_metadata":27559716},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":394555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29424,"internal_metadata":27561232},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247827,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":394934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45238,"internal_metadata":27545418},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476755,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":396189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34031,"internal_metadata":27556625},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607573,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":396155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":47,"kb_used_meta":26896,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":394623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48274,"internal_metadata":27542382},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5468,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11410,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12131,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6225,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13842,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3986,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29546,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8195,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5352,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:09:33.525 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T09:09:33.526 INFO:tasks.cephadm:Setting up client nodes... 2026-02-24T09:09:33.526 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-24T09:09:33.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:33 trial090 ceph-mon[47278]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:33.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:33 trial090 ceph-mon[47278]: mgrmap e17: x(active, since 2m), standbys: z, y 2026-02-24T09:09:33.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:33 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3673924957' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:33.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:33 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2449338297' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:33.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:33 trial014 ceph-mon[46941]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:33.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:33 trial014 ceph-mon[46941]: mgrmap e17: x(active, since 2m), standbys: z, y 2026-02-24T09:09:33.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:33 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3673924957' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:33.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:33 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2449338297' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:33.678 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:33.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.777+0000 7fc4855a2640 1 -- 10.20.193.4:0/3563718448 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc480060920 msgr2=0x7fc48010ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.777+0000 7fc4855a2640 1 --2- 10.20.193.4:0/3563718448 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc480060920 0x7fc48010ba20 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=12027622079298338675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc474009950 tx=0x7fc47402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.777+0000 7fc4855a2640 1 -- 10.20.193.4:0/3563718448 shutdown_connections 2026-02-24T09:09:33.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.777+0000 7fc4855a2640 1 --2- 10.20.193.4:0/3563718448 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc48010cac0 0x7fc48010cf60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.777+0000 7fc4855a2640 1 --2- 10.20.193.4:0/3563718448 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc48010bf60 0x7fc48010c3d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.777+0000 7fc4855a2640 1 --2- 10.20.193.4:0/3563718448 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc480060920 0x7fc48010ba20 unknown :-1 s=CLOSED pgs=264 gs=1 cs=0 l=1 c_cookie=12027622079298338675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.777+0000 7fc4855a2640 1 -- 10.20.193.4:0/3563718448 >> 10.20.193.4:0/3563718448 conn(0x7fc4800e9660 msgr2=0x7fc480109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.777+0000 7fc4855a2640 1 -- 10.20.193.4:0/3563718448 shutdown_connections 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.777+0000 7fc4855a2640 1 -- 10.20.193.4:0/3563718448 wait complete. 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.777+0000 7fc4855a2640 1 Processor -- start 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc4855a2640 1 -- start start 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc4855a2640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc480060920 0x7fc4800f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc4855a2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc48010bf60 0x7fc4800f52e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc4855a2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc48010cac0 0x7fc4800f5ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:33.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc4855a2640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fc4800f6620 con 0x7fc48010cac0 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc4855a2640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fc4800f6790 con 0x7fc480060920 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc4855a2640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc4800f6950 con 0x7fc48010bf60 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc48010cac0 0x7fc4800f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc48010cac0 0x7fc4800f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58882/0 (socket says 10.20.193.4:58882) 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47f7fe640 1 -- 10.20.193.4:0/3917410711 learned_addr learned my addr 10.20.193.4:0/3917410711 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47effd640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc480060920 0x7fc4800f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47f7fe640 1 -- 10.20.193.4:0/3917410711 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc48010bf60 msgr2=0x7fc4800f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47f7fe640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc48010bf60 0x7fc4800f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47f7fe640 1 -- 10.20.193.4:0/3917410711 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc480060920 msgr2=0x7fc4800f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47f7fe640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc480060920 0x7fc4800f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47f7fe640 1 -- 10.20.193.4:0/3917410711 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc474009570 con 0x7fc48010cac0 2026-02-24T09:09:33.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47effd640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc480060920 0x7fc4800f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:33.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc47f7fe640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc48010cac0 0x7fc4800f5ee0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc470006e90 tx=0x7fc47000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:33.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc45ffff640 1 -- 10.20.193.4:0/3917410711 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc470005500 con 0x7fc48010cac0 2026-02-24T09:09:33.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc45ffff640 1 -- 10.20.193.4:0/3917410711 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc470005e10 con 0x7fc48010cac0 2026-02-24T09:09:33.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc4855a2640 1 -- 10.20.193.4:0/3917410711 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4800f6c30 con 0x7fc48010cac0 2026-02-24T09:09:33.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc45ffff640 1 -- 10.20.193.4:0/3917410711 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc470003a90 con 0x7fc48010cac0 2026-02-24T09:09:33.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.778+0000 7fc4855a2640 1 -- 10.20.193.4:0/3917410711 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4800f71b0 con 0x7fc48010cac0 2026-02-24T09:09:33.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.779+0000 7fc4855a2640 1 -- 10.20.193.4:0/3917410711 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc480111d90 con 0x7fc48010cac0 2026-02-24T09:09:33.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.781+0000 7fc45ffff640 1 -- 10.20.193.4:0/3917410711 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fc47000c840 con 0x7fc48010cac0 2026-02-24T09:09:33.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.782+0000 7fc45ffff640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc4540b57f0 0x7fc4540d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:33.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.782+0000 7fc45ffff640 1 -- 10.20.193.4:0/3917410711 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fc4700e7cc0 con 0x7fc48010cac0 2026-02-24T09:09:33.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.782+0000 7fc47effd640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc4540b57f0 0x7fc4540d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:33.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.782+0000 7fc45ffff640 1 -- 10.20.193.4:0/3917410711 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc4700e81b0 con 0x7fc48010cac0 2026-02-24T09:09:33.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.782+0000 7fc47effd640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc4540b57f0 0x7fc4540d5ca0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4740023d0 tx=0x7fc474031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:33.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.929+0000 7fc4855a2640 1 -- 10.20.193.4:0/3917410711 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc480062010 con 0x7fc48010cac0 2026-02-24T09:09:33.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.930+0000 7fc45ffff640 1 -- 10.20.193.4:0/3917410711 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7fc4700aa650 con 0x7fc48010cac0 2026-02-24T09:09:33.934 INFO:teuthology.orchestra.run.trial004.stdout:[client.0] 2026-02-24T09:09:33.934 INFO:teuthology.orchestra.run.trial004.stdout: key = AQDNap1pjnV+NxAA+8c1DbWorGX1b/QMDIsaYQ== 2026-02-24T09:09:33.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 -- 10.20.193.4:0/3917410711 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc4540b57f0 msgr2=0x7fc4540d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc4540b57f0 0x7fc4540d5ca0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4740023d0 tx=0x7fc474031040 comp rx=0 tx=0).stop 2026-02-24T09:09:33.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 -- 10.20.193.4:0/3917410711 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc48010cac0 msgr2=0x7fc4800f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:33.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc48010cac0 0x7fc4800f5ee0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc470006e90 tx=0x7fc47000edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 -- 10.20.193.4:0/3917410711 shutdown_connections 2026-02-24T09:09:33.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc4540b57f0 0x7fc4540d5ca0 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc48010cac0 0x7fc4800f5ee0 unknown :-1 s=CLOSED pgs=265 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc48010bf60 0x7fc4800f52e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 --2- 10.20.193.4:0/3917410711 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc480060920 0x7fc4800f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:33.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 -- 10.20.193.4:0/3917410711 >> 10.20.193.4:0/3917410711 conn(0x7fc4800e9660 msgr2=0x7fc4800eadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:33.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 -- 10.20.193.4:0/3917410711 shutdown_connections 2026-02-24T09:09:33.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:33.931+0000 7fc4855a2640 1 -- 10.20.193.4:0/3917410711 wait complete. 2026-02-24T09:09:33.990 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:09:33.990 DEBUG:teuthology.orchestra.run.trial004:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-24T09:09:33.990 DEBUG:teuthology.orchestra.run.trial004:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T09:09:34.025 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-24T09:09:34.180 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:34.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.275+0000 7fde41819640 1 -- 10.20.193.4:0/3984260420 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde3c10f280 msgr2=0x7fde3c10f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:34.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.275+0000 7fde41819640 1 --2- 10.20.193.4:0/3984260420 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde3c10f280 0x7fde3c10f650 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=79013690699718166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde30009950 tx=0x7fde3002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.275+0000 7fde41819640 1 -- 10.20.193.4:0/3984260420 shutdown_connections 2026-02-24T09:09:34.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.275+0000 7fde41819640 1 --2- 10.20.193.4:0/3984260420 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde3c115470 0x7fde3c175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.275+0000 7fde41819640 1 --2- 10.20.193.4:0/3984260420 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde3c10fc70 0x7fde3c114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.275+0000 7fde41819640 1 --2- 10.20.193.4:0/3984260420 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde3c10f280 0x7fde3c10f650 unknown :-1 s=CLOSED pgs=266 gs=1 cs=0 l=1 c_cookie=79013690699718166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.275+0000 7fde41819640 1 -- 10.20.193.4:0/3984260420 >> 10.20.193.4:0/3984260420 conn(0x7fde3c05f830 msgr2=0x7fde3c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:34.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.275+0000 7fde41819640 1 -- 10.20.193.4:0/3984260420 shutdown_connections 2026-02-24T09:09:34.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.275+0000 7fde41819640 1 -- 10.20.193.4:0/3984260420 wait complete. 2026-02-24T09:09:34.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde41819640 1 Processor -- start 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde41819640 1 -- start start 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde41819640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde3c10f280 0x7fde3c11dbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde41819640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde3c10fc70 0x7fde3c11e0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde41819640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde3c115470 0x7fde3c1234c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde41819640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c123ae0 con 0x7fde3c10f280 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde41819640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c123c50 con 0x7fde3c115470 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde41819640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fde3c123e10 con 0x7fde3c10fc70 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde3c10f280 0x7fde3c11dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde3c10f280 0x7fde3c11dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58910/0 (socket says 10.20.193.4:58910) 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3affd640 1 -- 10.20.193.4:0/2782611691 learned_addr learned my addr 10.20.193.4:0/2782611691 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3a7fc640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde3c10fc70 0x7fde3c11e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3b7fe640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde3c115470 0x7fde3c1234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3affd640 1 -- 10.20.193.4:0/2782611691 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde3c10fc70 msgr2=0x7fde3c11e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3affd640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde3c10fc70 0x7fde3c11e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3affd640 1 -- 10.20.193.4:0/2782611691 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde3c115470 msgr2=0x7fde3c1234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3affd640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde3c115470 0x7fde3c1234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3affd640 1 -- 10.20.193.4:0/2782611691 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde30009570 con 0x7fde3c10f280 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3a7fc640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde3c10fc70 0x7fde3c11e0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde3affd640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde3c10f280 0x7fde3c11dbb0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde300023d0 tx=0x7fde300043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde40817640 1 -- 10.20.193.4:0/2782611691 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde3003d070 con 0x7fde3c10f280 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde41819640 1 -- 10.20.193.4:0/2782611691 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3c124090 con 0x7fde3c10f280 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde40817640 1 -- 10.20.193.4:0/2782611691 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fde30038920 con 0x7fde3c10f280 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde40817640 1 -- 10.20.193.4:0/2782611691 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde300419d0 con 0x7fde3c10f280 2026-02-24T09:09:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.276+0000 7fde41819640 1 -- 10.20.193.4:0/2782611691 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3c1647f0 con 0x7fde3c10f280 2026-02-24T09:09:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.277+0000 7fde41819640 1 -- 10.20.193.4:0/2782611691 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde3c110560 con 0x7fde3c10f280 2026-02-24T09:09:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.278+0000 7fde40817640 1 -- 10.20.193.4:0/2782611691 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fde30038a90 con 0x7fde3c10f280 2026-02-24T09:09:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.279+0000 7fde40817640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde100b5770 0x7fde100d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.279+0000 7fde40817640 1 -- 10.20.193.4:0/2782611691 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fde3010b8a0 con 0x7fde3c10f280 2026-02-24T09:09:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.279+0000 7fde3a7fc640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde100b5770 0x7fde100d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.279+0000 7fde3a7fc640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde100b5770 0x7fde100d5c20 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde24005970 tx=0x7fde24005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.280+0000 7fde40817640 1 -- 10.20.193.4:0/2782611691 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fde300ce3d0 con 0x7fde3c10f280 2026-02-24T09:09:34.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.386+0000 7fde41819640 1 -- 10.20.193.4:0/2782611691 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fde3c124220 con 0x7fde3c10f280 2026-02-24T09:09:34.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.386+0000 7fde40817640 1 -- 10.20.193.4:0/2782611691 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v47) ==== 86+0+133 (secure 0 0 0) 0x7fde300d14f0 con 0x7fde3c10f280 2026-02-24T09:09:34.390 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:34.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 -- 10.20.193.4:0/2782611691 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde100b5770 msgr2=0x7fde100d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:34.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde100b5770 0x7fde100d5c20 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde24005970 tx=0x7fde24005900 comp rx=0 tx=0).stop 2026-02-24T09:09:34.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 -- 10.20.193.4:0/2782611691 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde3c10f280 msgr2=0x7fde3c11dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:34.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde3c10f280 0x7fde3c11dbb0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde300023d0 tx=0x7fde300043d0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 -- 10.20.193.4:0/2782611691 shutdown_connections 2026-02-24T09:09:34.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fde100b5770 0x7fde100d5c20 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fde3c115470 0x7fde3c1234c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde3c10fc70 0x7fde3c11e0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 --2- 10.20.193.4:0/2782611691 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fde3c10f280 0x7fde3c11dbb0 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 -- 10.20.193.4:0/2782611691 >> 10.20.193.4:0/2782611691 conn(0x7fde3c05f830 msgr2=0x7fde3c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:34.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 -- 10.20.193.4:0/2782611691 shutdown_connections 2026-02-24T09:09:34.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.387+0000 7fde41819640 1 -- 10.20.193.4:0/2782611691 wait complete. 2026-02-24T09:09:34.428 INFO:teuthology.orchestra.run.trial004.stdout:[{"version":47,"timestamp":"2026-02-24T09:09:20.698419+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-24T09:09:34.428 INFO:tasks.ceph_manager:config epoch is 47 2026-02-24T09:09:34.429 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T09:09:34.429 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-24T09:09:34.429 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-24T09:09:34.545 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:34.567 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:34 trial004 ceph-mon[41596]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:34.567 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:34 trial004 ceph-mon[41596]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:34.567 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:34 trial004 ceph-mon[41596]: pgmap v141: 97 pgs: 97 active+clean; 626 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-24T09:09:34.568 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:34 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3917410711' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T09:09:34.568 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:34 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3917410711' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T09:09:34.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:34 trial090 ceph-mon[47278]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:34.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:34 trial090 ceph-mon[47278]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:34.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:34 trial090 ceph-mon[47278]: pgmap v141: 97 pgs: 97 active+clean; 626 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-24T09:09:34.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:34 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3917410711' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T09:09:34.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:34 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3917410711' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T09:09:34.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:34 trial014 ceph-mon[46941]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:34.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:34 trial014 ceph-mon[46941]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:34.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:34 trial014 ceph-mon[46941]: pgmap v141: 97 pgs: 97 active+clean; 626 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 18 op/s 2026-02-24T09:09:34.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:34 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3917410711' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T09:09:34.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:34 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3917410711' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T09:09:34.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 -- 10.20.193.4:0/3309269967 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9d1410d010 msgr2=0x7f9d1410d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:34.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 --2- 10.20.193.4:0/3309269967 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9d1410d010 0x7f9d1410d3e0 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=15631420990644923610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d08009950 tx=0x7f9d0802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 -- 10.20.193.4:0/3309269967 shutdown_connections 2026-02-24T09:09:34.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 --2- 10.20.193.4:0/3309269967 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d14113200 0x7f9d14173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 --2- 10.20.193.4:0/3309269967 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9d1410da00 0x7f9d14112a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 --2- 10.20.193.4:0/3309269967 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9d1410d010 0x7f9d1410d3e0 unknown :-1 s=CLOSED pgs=268 gs=1 cs=0 l=1 c_cookie=15631420990644923610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 -- 10.20.193.4:0/3309269967 >> 10.20.193.4:0/3309269967 conn(0x7f9d1405f830 msgr2=0x7f9d1410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:34.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 -- 10.20.193.4:0/3309269967 shutdown_connections 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 -- 10.20.193.4:0/3309269967 wait complete. 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 Processor -- start 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 -- start start 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9d1410d010 0x7f9d14060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d1410da00 0x7f9d140614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9d14113200 0x7f9d14061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14163d00 con 0x7f9d1410d010 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14163e70 con 0x7f9d14113200 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.647+0000 7f9d19800640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14164030 con 0x7f9d1410da00 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d12ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9d1410d010 0x7f9d14060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d12ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9d1410d010 0x7f9d14060f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58936/0 (socket says 10.20.193.4:58936) 2026-02-24T09:09:34.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d12ffd640 1 -- 10.20.193.4:0/191832047 learned_addr learned my addr 10.20.193.4:0/191832047 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d127fc640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d1410da00 0x7f9d140614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d137fe640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9d14113200 0x7f9d14061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d12ffd640 1 -- 10.20.193.4:0/191832047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d1410da00 msgr2=0x7f9d140614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d12ffd640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d1410da00 0x7f9d140614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d12ffd640 1 -- 10.20.193.4:0/191832047 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9d14113200 msgr2=0x7f9d14061a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d12ffd640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9d14113200 0x7f9d14061a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d12ffd640 1 -- 10.20.193.4:0/191832047 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d08009570 con 0x7f9d1410d010 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d12ffd640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9d1410d010 0x7f9d14060f90 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d08038820 tx=0x7f9d08004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9cf3fff640 1 -- 10.20.193.4:0/191832047 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d0803d070 con 0x7f9d1410d010 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9cf3fff640 1 -- 10.20.193.4:0/191832047 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9d08002ad0 con 0x7f9d1410d010 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d19800640 1 -- 10.20.193.4:0/191832047 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d141642b0 con 0x7f9d1410d010 2026-02-24T09:09:34.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9cf3fff640 1 -- 10.20.193.4:0/191832047 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d08041940 con 0x7f9d1410d010 2026-02-24T09:09:34.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d19800640 1 -- 10.20.193.4:0/191832047 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d14164720 con 0x7f9d1410d010 2026-02-24T09:09:34.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.648+0000 7f9d19800640 1 -- 10.20.193.4:0/191832047 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d1410e2f0 con 0x7f9d1410d010 2026-02-24T09:09:34.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.650+0000 7f9cf3fff640 1 -- 10.20.193.4:0/191832047 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f9d08041ad0 con 0x7f9d1410d010 2026-02-24T09:09:34.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.650+0000 7f9cf3fff640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ce80b5770 0x7f9ce80d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:34.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.651+0000 7f9d127fc640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ce80b5770 0x7f9ce80d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:34.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.651+0000 7f9cf3fff640 1 -- 10.20.193.4:0/191832047 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9d0810b790 con 0x7f9d1410d010 2026-02-24T09:09:34.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.651+0000 7f9d127fc640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ce80b5770 0x7f9ce80d5c20 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d1410b620 tx=0x7f9cfc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:34.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.652+0000 7f9cf3fff640 1 -- 10.20.193.4:0/191832047 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f9d080ce230 con 0x7f9d1410d010 2026-02-24T09:09:34.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.787+0000 7f9d19800640 1 -- 10.20.193.4:0/191832047 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9d14062290 con 0x7f9d1410d010 2026-02-24T09:09:34.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.790+0000 7f9cf3fff640 1 -- 10.20.193.4:0/191832047 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+297620 (secure 0 0 0) 0x7f9d080d13e0 con 0x7f9d1410d010 2026-02-24T09:09:34.797 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:34.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 -- 10.20.193.4:0/191832047 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ce80b5770 msgr2=0x7f9ce80d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:34.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ce80b5770 0x7f9ce80d5c20 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d1410b620 tx=0x7f9cfc005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:34.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 -- 10.20.193.4:0/191832047 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9d1410d010 msgr2=0x7f9d14060f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:34.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9d1410d010 0x7f9d14060f90 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d08038820 tx=0x7f9d08004300 comp rx=0 tx=0).stop 2026-02-24T09:09:34.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 -- 10.20.193.4:0/191832047 shutdown_connections 2026-02-24T09:09:34.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ce80b5770 0x7f9ce80d5c20 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9d14113200 0x7f9d14061a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d1410da00 0x7f9d140614d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 --2- 10.20.193.4:0/191832047 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9d1410d010 0x7f9d14060f90 unknown :-1 s=CLOSED pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:34.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 -- 10.20.193.4:0/191832047 >> 10.20.193.4:0/191832047 conn(0x7f9d1405f830 msgr2=0x7f9d1410ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:34.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 -- 10.20.193.4:0/191832047 shutdown_connections 2026-02-24T09:09:34.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:34.791+0000 7f9d19800640 1 -- 10.20.193.4:0/191832047 wait complete. 2026-02-24T09:09:34.832 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6800","nonce":2848002115},{"type":"v1","addr":"10.20.193.4:6801","nonce":2848002115}]},"active_addr":"10.20.193.4:6801/2848002115","active_change":"2026-02-24T09:07:01.644764+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":24145,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24203,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.4:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.4:0","nonce":3295951478}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.4:0","nonce":2371257539}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.4:0","nonce":741636303}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.4:0","nonce":143268591}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.4:0","nonce":3169414253}]}]} 2026-02-24T09:09:34.843 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-24T09:09:34.843 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-24T09:09:34.844 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:09:34.986 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 -- 10.20.193.4:0/2243458411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f342c1537b0 msgr2=0x7f342c173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 --2- 10.20.193.4:0/2243458411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f342c1537b0 0x7f342c173bd0 secure :-1 s=READY pgs=270 gs=1 cs=0 l=1 c_cookie=5835022287446508535 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f342800aa30 tx=0x7f3428030280 comp rx=0 tx=0).stop 2026-02-24T09:09:35.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 -- 10.20.193.4:0/2243458411 shutdown_connections 2026-02-24T09:09:35.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 --2- 10.20.193.4:0/2243458411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f342c1537b0 0x7f342c173bd0 unknown :-1 s=CLOSED pgs=270 gs=1 cs=0 l=1 c_cookie=5835022287446508535 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 --2- 10.20.193.4:0/2243458411 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f342c10ebf0 0x7f342c153270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 --2- 10.20.193.4:0/2243458411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f342c10e200 0x7f342c10e5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 -- 10.20.193.4:0/2243458411 >> 10.20.193.4:0/2243458411 conn(0x7f342c0e9bf0 msgr2=0x7f342c10a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 -- 10.20.193.4:0/2243458411 shutdown_connections 2026-02-24T09:09:35.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 -- 10.20.193.4:0/2243458411 wait complete. 2026-02-24T09:09:35.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 Processor -- start 2026-02-24T09:09:35.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 -- start start 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f342c10e200 0x7f342c15fe90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f342c10ebf0 0x7f342c1603d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f342c1537b0 0x7f342c1657a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f342c165dc0 con 0x7f342c10ebf0 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f342c165f30 con 0x7f342c10e200 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f3433364640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f342c1660f0 con 0x7f342c1537b0 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.084+0000 7f34308d8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f342c10ebf0 0x7f342c1603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34308d8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f342c10ebf0 0x7f342c1603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58956/0 (socket says 10.20.193.4:58956) 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34308d8640 1 -- 10.20.193.4:0/2594152324 learned_addr learned my addr 10.20.193.4:0/2594152324 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34310d9640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f342c10e200 0x7f342c15fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34318da640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f342c1537b0 0x7f342c1657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34308d8640 1 -- 10.20.193.4:0/2594152324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f342c1537b0 msgr2=0x7f342c1657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34308d8640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f342c1537b0 0x7f342c1657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34308d8640 1 -- 10.20.193.4:0/2594152324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f342c10e200 msgr2=0x7f342c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34308d8640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f342c10e200 0x7f342c15fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34308d8640 1 -- 10.20.193.4:0/2594152324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342800a650 con 0x7f342c10ebf0 2026-02-24T09:09:35.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34318da640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f342c1537b0 0x7f342c1657a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:35.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f34308d8640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f342c10ebf0 0x7f342c1603d0 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f342000d950 tx=0x7f342000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f341a7fc640 1 -- 10.20.193.4:0/2594152324 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3420004540 con 0x7f342c10ebf0 2026-02-24T09:09:35.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f3433364640 1 -- 10.20.193.4:0/2594152324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f342c1663d0 con 0x7f342c10ebf0 2026-02-24T09:09:35.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f341a7fc640 1 -- 10.20.193.4:0/2594152324 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3420009d00 con 0x7f342c10ebf0 2026-02-24T09:09:35.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f341a7fc640 1 -- 10.20.193.4:0/2594152324 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34200106e0 con 0x7f342c10ebf0 2026-02-24T09:09:35.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f3433364640 1 -- 10.20.193.4:0/2594152324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f342c14f3d0 con 0x7f342c10ebf0 2026-02-24T09:09:35.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.085+0000 7f3433364640 1 -- 10.20.193.4:0/2594152324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342c060380 con 0x7f342c10ebf0 2026-02-24T09:09:35.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.087+0000 7f341a7fc640 1 -- 10.20.193.4:0/2594152324 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f34200027c0 con 0x7f342c10ebf0 2026-02-24T09:09:35.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.087+0000 7f341a7fc640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34080b5770 0x7f34080d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.087+0000 7f34310d9640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34080b5770 0x7f34080d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.087+0000 7f341a7fc640 1 -- 10.20.193.4:0/2594152324 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f34200e72e0 con 0x7f342c10ebf0 2026-02-24T09:09:35.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.088+0000 7f34310d9640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34080b5770 0x7f34080d5c20 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f341c005970 tx=0x7f341c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.088+0000 7f341a7fc640 1 -- 10.20.193.4:0/2594152324 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f34200a9c70 con 0x7f342c10ebf0 2026-02-24T09:09:35.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.192+0000 7f3433364640 1 -- 10.20.193.4:0/2594152324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f342c10e5d0 con 0x7f342c10ebf0 2026-02-24T09:09:35.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.192+0000 7f341a7fc640 1 -- 10.20.193.4:0/2594152324 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22231 (secure 0 0 0) 0x7f34200ace20 con 0x7f342c10ebf0 2026-02-24T09:09:35.197 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:35.197 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":75,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:26.263940+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:35.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 -- 10.20.193.4:0/2594152324 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34080b5770 msgr2=0x7f34080d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34080b5770 0x7f34080d5c20 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f341c005970 tx=0x7f341c005900 comp rx=0 tx=0).stop 2026-02-24T09:09:35.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 -- 10.20.193.4:0/2594152324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f342c10ebf0 msgr2=0x7f342c1603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f342c10ebf0 0x7f342c1603d0 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f342000d950 tx=0x7f342000de20 comp rx=0 tx=0).stop 2026-02-24T09:09:35.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 -- 10.20.193.4:0/2594152324 shutdown_connections 2026-02-24T09:09:35.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34080b5770 0x7f34080d5c20 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f342c1537b0 0x7f342c1657a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f342c10ebf0 0x7f342c1603d0 unknown :-1 s=CLOSED pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 --2- 10.20.193.4:0/2594152324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f342c10e200 0x7f342c15fe90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 -- 10.20.193.4:0/2594152324 >> 10.20.193.4:0/2594152324 conn(0x7f342c0e9bf0 msgr2=0x7f342c109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 -- 10.20.193.4:0/2594152324 shutdown_connections 2026-02-24T09:09:35.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.193+0000 7f3433364640 1 -- 10.20.193.4:0/2594152324 wait complete. 2026-02-24T09:09:35.233 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-24T09:09:35.234 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:09:35.351 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.373 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:35 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2782611691' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-24T09:09:35.373 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:35 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/191832047' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-24T09:09:35.373 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:35 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2594152324' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:35.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.454+0000 7f53b5d77640 1 -- 10.20.193.4:0/142155055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f53b010f280 msgr2=0x7f53b010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.454+0000 7f53b5d77640 1 --2- 10.20.193.4:0/142155055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f53b010f280 0x7f53b010f650 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=11466233050772916923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f539c009950 tx=0x7f539c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.454+0000 7f53b5d77640 1 -- 10.20.193.4:0/142155055 shutdown_connections 2026-02-24T09:09:35.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.454+0000 7f53b5d77640 1 --2- 10.20.193.4:0/142155055 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b0115470 0x7f53b0175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.454+0000 7f53b5d77640 1 --2- 10.20.193.4:0/142155055 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f53b010fc70 0x7f53b0114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.454+0000 7f53b5d77640 1 --2- 10.20.193.4:0/142155055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f53b010f280 0x7f53b010f650 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=11466233050772916923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.454+0000 7f53b5d77640 1 -- 10.20.193.4:0/142155055 >> 10.20.193.4:0/142155055 conn(0x7f53b005f830 msgr2=0x7f53b010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.454+0000 7f53b5d77640 1 -- 10.20.193.4:0/142155055 shutdown_connections 2026-02-24T09:09:35.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.454+0000 7f53b5d77640 1 -- 10.20.193.4:0/142155055 wait complete. 2026-02-24T09:09:35.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53b5d77640 1 Processor -- start 2026-02-24T09:09:35.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53b5d77640 1 -- start start 2026-02-24T09:09:35.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53b5d77640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f53b010f280 0x7f53b011db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53b5d77640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f53b010fc70 0x7f53b011e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53b5d77640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b0115470 0x7f53b0123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53b5d77640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0123a60 con 0x7f53b010fc70 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53b5d77640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0123bd0 con 0x7f53b010f280 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53b5d77640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0123d90 con 0x7f53b0115470 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53aeffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f53b010fc70 0x7f53b011e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53aeffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f53b010fc70 0x7f53b011e070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58972/0 (socket says 10.20.193.4:58972) 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53aeffd640 1 -- 10.20.193.4:0/2451609945 learned_addr learned my addr 10.20.193.4:0/2451609945 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53af7fe640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f53b010f280 0x7f53b011db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53affff640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b0115470 0x7f53b0123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53aeffd640 1 -- 10.20.193.4:0/2451609945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b0115470 msgr2=0x7f53b0123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53aeffd640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b0115470 0x7f53b0123440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53aeffd640 1 -- 10.20.193.4:0/2451609945 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f53b010f280 msgr2=0x7f53b011db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53aeffd640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f53b010f280 0x7f53b011db30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53aeffd640 1 -- 10.20.193.4:0/2451609945 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539c009570 con 0x7f53b010fc70 2026-02-24T09:09:35.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53aeffd640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f53b010fc70 0x7f53b011e070 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53a000d950 tx=0x7f53a000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53acff9640 1 -- 10.20.193.4:0/2451609945 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53a0004540 con 0x7f53b010fc70 2026-02-24T09:09:35.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53acff9640 1 -- 10.20.193.4:0/2451609945 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f53a0009d00 con 0x7f53b010fc70 2026-02-24T09:09:35.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53b5d77640 1 -- 10.20.193.4:0/2451609945 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b0124070 con 0x7f53b010fc70 2026-02-24T09:09:35.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53acff9640 1 -- 10.20.193.4:0/2451609945 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53a00106e0 con 0x7f53b010fc70 2026-02-24T09:09:35.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.455+0000 7f53b5d77640 1 -- 10.20.193.4:0/2451609945 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b0164770 con 0x7f53b010fc70 2026-02-24T09:09:35.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.456+0000 7f53b5d77640 1 -- 10.20.193.4:0/2451609945 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b0110560 con 0x7f53b010fc70 2026-02-24T09:09:35.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.457+0000 7f53acff9640 1 -- 10.20.193.4:0/2451609945 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f53a00097c0 con 0x7f53b010fc70 2026-02-24T09:09:35.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.458+0000 7f53acff9640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f53840b57f0 0x7f53840d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.458+0000 7f53af7fe640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f53840b57f0 0x7f53840d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.458+0000 7f53acff9640 1 -- 10.20.193.4:0/2451609945 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f53a00e7170 con 0x7f53b010fc70 2026-02-24T09:09:35.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.458+0000 7f53af7fe640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f53840b57f0 0x7f53840d5ca0 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f539c005b30 tx=0x7f539c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.458+0000 7f53acff9640 1 -- 10.20.193.4:0/2451609945 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f53a00a9ac0 con 0x7f53b010fc70 2026-02-24T09:09:35.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.564+0000 7f53b5d77640 1 -- 10.20.193.4:0/2451609945 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53b0179170 con 0x7f53b010fc70 2026-02-24T09:09:35.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.564+0000 7f53acff9640 1 -- 10.20.193.4:0/2451609945 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22231 (secure 0 0 0) 0x7f53a00acc70 con 0x7f53b010fc70 2026-02-24T09:09:35.569 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:35.569 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":75,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:26.263940+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:35.570 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.565+0000 7f53b5d77640 1 -- 10.20.193.4:0/2451609945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f53840b57f0 msgr2=0x7f53840d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.565+0000 7f53b5d77640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f53840b57f0 0x7f53840d5ca0 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f539c005b30 tx=0x7f539c03a040 comp rx=0 tx=0).stop 2026-02-24T09:09:35.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.565+0000 7f53b5d77640 1 -- 10.20.193.4:0/2451609945 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f53b010fc70 msgr2=0x7f53b011e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.565+0000 7f53b5d77640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f53b010fc70 0x7f53b011e070 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53a000d950 tx=0x7f53a000de20 comp rx=0 tx=0).stop 2026-02-24T09:09:35.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.566+0000 7f53b5d77640 1 -- 10.20.193.4:0/2451609945 shutdown_connections 2026-02-24T09:09:35.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.566+0000 7f53b5d77640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f53840b57f0 0x7f53840d5ca0 unknown :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.566+0000 7f53b5d77640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b0115470 0x7f53b0123440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.566+0000 7f53b5d77640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f53b010fc70 0x7f53b011e070 unknown :-1 s=CLOSED pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.566+0000 7f53b5d77640 1 --2- 10.20.193.4:0/2451609945 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f53b010f280 0x7f53b011db30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.566+0000 7f53b5d77640 1 -- 10.20.193.4:0/2451609945 >> 10.20.193.4:0/2451609945 conn(0x7f53b005f830 msgr2=0x7f53b010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.572 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.566+0000 7f53b5d77640 1 -- 10.20.193.4:0/2451609945 shutdown_connections 2026-02-24T09:09:35.572 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.566+0000 7f53b5d77640 1 -- 10.20.193.4:0/2451609945 wait complete. 2026-02-24T09:09:35.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:35 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2782611691' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-24T09:09:35.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:35 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/191832047' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-24T09:09:35.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:35 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2594152324' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:35.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:35 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2782611691' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-24T09:09:35.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:35 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/191832047' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-24T09:09:35.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:35 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2594152324' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:35.605 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-24T09:09:35.605 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-24T09:09:35.605 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-24T09:09:35.605 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-24T09:09:35.605 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-24T09:09:35.606 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-24T09:09:35.606 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-24T09:09:35.606 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-24T09:09:35.606 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-24T09:09:35.606 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-24T09:09:35.606 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-24T09:09:35.606 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-24T09:09:35.741 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.746 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.746 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.747 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.750 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.755 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.756 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.756 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.758 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.760 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.763 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.763 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:35.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 -- 10.20.193.4:0/1385780467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9b0410f280 msgr2=0x7f9b0410f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 --2- 10.20.193.4:0/1385780467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9b0410f280 0x7f9b0410f650 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=2921209937299965438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9af4009950 tx=0x7f9af402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 -- 10.20.193.4:0/1385780467 shutdown_connections 2026-02-24T09:09:35.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 --2- 10.20.193.4:0/1385780467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9b04115470 0x7f9b04175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 --2- 10.20.193.4:0/1385780467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9b0410fc70 0x7f9b04114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 --2- 10.20.193.4:0/1385780467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9b0410f280 0x7f9b0410f650 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=2921209937299965438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 -- 10.20.193.4:0/1385780467 >> 10.20.193.4:0/1385780467 conn(0x7f9b0405f830 msgr2=0x7f9b0410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 -- 10.20.193.4:0/1385780467 shutdown_connections 2026-02-24T09:09:35.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 -- 10.20.193.4:0/1385780467 wait complete. 2026-02-24T09:09:35.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 Processor -- start 2026-02-24T09:09:35.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.864+0000 7f9b0b15f640 1 -- start start 2026-02-24T09:09:35.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b0b15f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9b0410f280 0x7f9b0411db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b0b15f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9b0410fc70 0x7f9b0411e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b0b15f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9b04115470 0x7f9b04123470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b0b15f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9b04123a90 con 0x7f9b0410fc70 2026-02-24T09:09:35.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b0b15f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9b04123c00 con 0x7f9b0410f280 2026-02-24T09:09:35.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b0b15f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b04123dc0 con 0x7f9b04115470 2026-02-24T09:09:35.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9afbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9b0410fc70 0x7f9b0411e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9afbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9b0410fc70 0x7f9b0411e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58988/0 (socket says 10.20.193.4:58988) 2026-02-24T09:09:35.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9afbfff640 1 -- 10.20.193.4:0/3609155732 learned_addr learned my addr 10.20.193.4:0/3609155732 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b08ed4640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9b0410f280 0x7f9b0411db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b096d5640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9b04115470 0x7f9b04123470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9afbfff640 1 -- 10.20.193.4:0/3609155732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9b04115470 msgr2=0x7f9b04123470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9afbfff640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9b04115470 0x7f9b04123470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9afbfff640 1 -- 10.20.193.4:0/3609155732 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9b0410f280 msgr2=0x7f9b0411db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9afbfff640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9b0410f280 0x7f9b0411db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9afbfff640 1 -- 10.20.193.4:0/3609155732 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af4009570 con 0x7f9b0410fc70 2026-02-24T09:09:35.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b08ed4640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9b0410f280 0x7f9b0411db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:35.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9afbfff640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9b0410fc70 0x7f9b0411e0a0 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aec00d950 tx=0x7f9aec00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9af9ffb640 1 -- 10.20.193.4:0/3609155732 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aec004540 con 0x7f9b0410fc70 2026-02-24T09:09:35.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b041240a0 con 0x7f9b0410fc70 2026-02-24T09:09:35.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9af9ffb640 1 -- 10.20.193.4:0/3609155732 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9aec009d00 con 0x7f9b0410fc70 2026-02-24T09:09:35.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9af9ffb640 1 -- 10.20.193.4:0/3609155732 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aec0106e0 con 0x7f9b0410fc70 2026-02-24T09:09:35.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.865+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b041647a0 con 0x7f9b0410fc70 2026-02-24T09:09:35.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.866+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b04052010 con 0x7f9b0410fc70 2026-02-24T09:09:35.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.867+0000 7f9af9ffb640 1 -- 10.20.193.4:0/3609155732 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f9aec0027c0 con 0x7f9b0410fc70 2026-02-24T09:09:35.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f9af9ffb640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ae00b57f0 0x7f9ae00d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f9b08ed4640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ae00b57f0 0x7f9ae00d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f9af9ffb640 1 -- 10.20.193.4:0/3609155732 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9aec0e74d0 con 0x7f9b0410fc70 2026-02-24T09:09:35.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f9af9ffb640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] conn(0x7f9ae00dcf60 0x7f9ae00fd370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f9af9ffb640 1 -- 10.20.193.4:0/3609155732 --> [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ae00fda20 con 0x7f9ae00dcf60 2026-02-24T09:09:35.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f9af9ffb640 1 -- 10.20.193.4:0/3609155732 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f9aec0e78f0 con 0x7f9b0410fc70 2026-02-24T09:09:35.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f4c80d41640 1 -- 10.20.193.4:0/4147798309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7c115470 msgr2=0x7f4c7c175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f4c80d41640 1 --2- 10.20.193.4:0/4147798309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7c115470 0x7f4c7c175e40 secure :-1 s=READY pgs=71 gs=3 cs=0 l=1 c_cookie=6816598599083189533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c6c00aa30 tx=0x7f4c6c030280 comp rx=0 tx=0).stop 2026-02-24T09:09:35.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f4c80d41640 1 -- 10.20.193.4:0/4147798309 shutdown_connections 2026-02-24T09:09:35.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f4c80d41640 1 --2- 10.20.193.4:0/4147798309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7c115470 0x7f4c7c175e40 unknown :-1 s=CLOSED pgs=71 gs=3 cs=0 l=1 c_cookie=6816598599083189533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f4c80d41640 1 --2- 10.20.193.4:0/4147798309 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7c10fc70 0x7f4c7c114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f4c80d41640 1 --2- 10.20.193.4:0/4147798309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7c10f280 0x7f4c7c10f650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f4c80d41640 1 -- 10.20.193.4:0/4147798309 >> 10.20.193.4:0/4147798309 conn(0x7f4c7c05f830 msgr2=0x7f4c7c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f9b08ed4640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ae00b57f0 0x7f9ae00d5ca0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9af40023d0 tx=0x7f9af4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.868+0000 7f9b096d5640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] conn(0x7f9ae00dcf60 0x7f9ae00fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7f9b096d5640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] conn(0x7f9ae00dcf60 0x7f9ae00fd370 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7f4c80d41640 1 -- 10.20.193.4:0/4147798309 shutdown_connections 2026-02-24T09:09:35.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7f4c80d41640 1 -- 10.20.193.4:0/4147798309 wait complete. 2026-02-24T09:09:35.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7fdf79e13640 1 -- 10.20.193.4:0/95649048 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf741135a0 msgr2=0x7fdf74173f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7fdf79e13640 1 --2- 10.20.193.4:0/95649048 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf741135a0 0x7fdf74173f70 secure :-1 s=READY pgs=60 gs=2 cs=0 l=1 c_cookie=8262029100822543274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf6800aa30 tx=0x7fdf68030290 comp rx=0 tx=0).stop 2026-02-24T09:09:35.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7f4c80d41640 1 Processor -- start 2026-02-24T09:09:35.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7f4c80d41640 1 -- start start 2026-02-24T09:09:35.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7f9af9ffb640 1 -- 10.20.193.4:0/3609155732 <== osd.3 v2:10.20.193.4:6810/1170432191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f9ae00fda20 con 0x7f9ae00dcf60 2026-02-24T09:09:35.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7f4c80d41640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7c10f280 0x7f4c7c066f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7fdf79e13640 1 -- 10.20.193.4:0/95649048 shutdown_connections 2026-02-24T09:09:35.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7fdf79e13640 1 --2- 10.20.193.4:0/95649048 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf741135a0 0x7fdf74173f70 unknown :-1 s=CLOSED pgs=60 gs=2 cs=0 l=1 c_cookie=8262029100822543274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7fdf79e13640 1 --2- 10.20.193.4:0/95649048 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf7410dda0 0x7fdf74112df0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7fdf79e13640 1 --2- 10.20.193.4:0/95649048 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf7410d3b0 0x7fdf7410d780 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7fdf79e13640 1 -- 10.20.193.4:0/95649048 >> 10.20.193.4:0/95649048 conn(0x7fdf740eac60 msgr2=0x7fdf7410b070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7fdf79e13640 1 -- 10.20.193.4:0/95649048 shutdown_connections 2026-02-24T09:09:35.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7fdf79e13640 1 -- 10.20.193.4:0/95649048 wait complete. 2026-02-24T09:09:35.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.869+0000 7f4c80d41640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7c10fc70 0x7f4c7c0631d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c80d41640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7c115470 0x7f4c7c063830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7a575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7c10f280 0x7f4c7c066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7a575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7c10f280 0x7f4c7c066f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:56914/0 (socket says 10.20.193.4:56914) 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7ad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7c115470 0x7f4c7c063830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7ad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7c115470 0x7f4c7c063830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59018/0 (socket says 10.20.193.4:59018) 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c79d74640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7c10fc70 0x7f4c7c0631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7a575640 1 -- 10.20.193.4:0/773739314 learned_addr learned my addr 10.20.193.4:0/773739314 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c063fc0 con 0x7f4c7c115470 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c168210 con 0x7f4c7c10fc70 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1683d0 con 0x7f4c7c10f280 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7ad76640 1 -- 10.20.193.4:0/773739314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7c10f280 msgr2=0x7f4c7c066f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7ad76640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7c10f280 0x7f4c7c066f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7ad76640 1 -- 10.20.193.4:0/773739314 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7c10fc70 msgr2=0x7f4c7c0631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7ad76640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7c10fc70 0x7f4c7c0631d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7ad76640 1 -- 10.20.193.4:0/773739314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c640094b0 con 0x7f4c7c115470 2026-02-24T09:09:35.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7a575640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7c10f280 0x7f4c7c066f60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:09:35.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c7ad76640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7c115470 0x7f4c7c063830 secure :-1 s=READY pgs=276 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c6c030790 tx=0x7f4c6c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c637fe640 1 -- 10.20.193.4:0/773739314 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c6c03e070 con 0x7f4c7c115470 2026-02-24T09:09:35.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.870+0000 7f4c637fe640 1 -- 10.20.193.4:0/773739314 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4c6c0055a0 con 0x7f4c7c115470 2026-02-24T09:09:35.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6c00a650 con 0x7f4c7c115470 2026-02-24T09:09:35.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7f4c637fe640 1 -- 10.20.193.4:0/773739314 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c6c042a70 con 0x7f4c7c115470 2026-02-24T09:09:35.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf79e13640 1 Processor -- start 2026-02-24T09:09:35.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf79e13640 1 -- start start 2026-02-24T09:09:35.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf79e13640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf7410d3b0 0x7fdf7411ab50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf79e13640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf7410dda0 0x7fdf7411b090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c168930 con 0x7f4c7c115470 2026-02-24T09:09:35.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf79e13640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf741135a0 0x7fdf74120460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf79e13640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fdf74120a80 con 0x7fdf7410dda0 2026-02-24T09:09:35.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf79e13640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fdf74120bf0 con 0x7fdf7410d3b0 2026-02-24T09:09:35.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf79e13640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf74120db0 con 0x7fdf741135a0 2026-02-24T09:09:35.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf73fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf741135a0 0x7fdf74120460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf73fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf741135a0 0x7fdf74120460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:56916/0 (socket says 10.20.193.4:56916) 2026-02-24T09:09:35.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf73fff640 1 -- 10.20.193.4:0/329023891 learned_addr learned my addr 10.20.193.4:0/329023891 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf737fe640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf7410d3b0 0x7fdf7411ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c7c052010 con 0x7f4c7c115470 2026-02-24T09:09:35.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf73fff640 1 -- 10.20.193.4:0/329023891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf7410d3b0 msgr2=0x7fdf7411ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf73fff640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf7410d3b0 0x7fdf7411ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf73fff640 1 -- 10.20.193.4:0/329023891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf7410dda0 msgr2=0x7fdf7411b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf73fff640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf7410dda0 0x7fdf7411b090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.871+0000 7fdf73fff640 1 -- 10.20.193.4:0/329023891 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6800a650 con 0x7fdf741135a0 2026-02-24T09:09:35.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.873+0000 7f4c637fe640 1 -- 10.20.193.4:0/773739314 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f4c6c0050c0 con 0x7f4c7c115470 2026-02-24T09:09:35.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.873+0000 7f4c637fe640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c540b5870 0x7f4c540d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.873+0000 7f4c637fe640 1 -- 10.20.193.4:0/773739314 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f4c6c10ccc0 con 0x7f4c7c115470 2026-02-24T09:09:35.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.873+0000 7f4c637fe640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] conn(0x7f4c540dcfe0 0x7f4c540fd3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.873+0000 7f4c637fe640 1 -- 10.20.193.4:0/773739314 --> [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c540fdaa0 con 0x7f4c540dcfe0 2026-02-24T09:09:35.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.873+0000 7f4c637fe640 1 -- 10.20.193.4:0/773739314 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f4c6c10cff0 con 0x7f4c7c115470 2026-02-24T09:09:35.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.873+0000 7f4c7a575640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c540b5870 0x7f4c540d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.873+0000 7f341a378640 1 -- 10.20.193.4:0/738258293 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3414153350 msgr2=0x7f3414173770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.873+0000 7f341a378640 1 --2- 10.20.193.4:0/738258293 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3414153350 0x7f3414173770 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=13376249866321913326 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f340800aa30 tx=0x7f3408030280 comp rx=0 tx=0).stop 2026-02-24T09:09:35.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f4c79d74640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] conn(0x7f4c540dcfe0 0x7f4c540fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f4c7a575640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c540b5870 0x7f4c540d5d20 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c7000b2c0 tx=0x7f4c7000b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f341a378640 1 -- 10.20.193.4:0/738258293 shutdown_connections 2026-02-24T09:09:35.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f341a378640 1 --2- 10.20.193.4:0/738258293 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3414153350 0x7f3414173770 unknown :-1 s=CLOSED pgs=277 gs=1 cs=0 l=1 c_cookie=13376249866321913326 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f341a378640 1 --2- 10.20.193.4:0/738258293 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f341410e790 0x7f3414152d80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f341a378640 1 --2- 10.20.193.4:0/738258293 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f341410dda0 0x7f341410e170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f341a378640 1 -- 10.20.193.4:0/738258293 >> 10.20.193.4:0/738258293 conn(0x7f34140e97e0 msgr2=0x7f3414109bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f341a378640 1 -- 10.20.193.4:0/738258293 shutdown_connections 2026-02-24T09:09:35.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f341a378640 1 -- 10.20.193.4:0/738258293 wait complete. 2026-02-24T09:09:35.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f4c79d74640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] conn(0x7f4c540dcfe0 0x7f4c540fd3f0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.874+0000 7f341a378640 1 Processor -- start 2026-02-24T09:09:35.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f341a378640 1 -- start start 2026-02-24T09:09:35.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f341a378640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f341410dda0 0x7f341415fab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f341a378640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f341410e790 0x7f341415fff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f341a378640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3414153350 0x7f34141653c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f341a378640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f34141659e0 con 0x7f341410dda0 2026-02-24T09:09:35.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f3413fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f341410dda0 0x7f341415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f341a378640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3414165b50 con 0x7f341410e790 2026-02-24T09:09:35.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f341a378640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3414165d10 con 0x7f3414153350 2026-02-24T09:09:35.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f4c637fe640 1 -- 10.20.193.4:0/773739314 <== osd.4 v2:10.20.193.14:6808/1479310505 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f4c540fdaa0 con 0x7f4c540dcfe0 2026-02-24T09:09:35.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f3413fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f341410dda0 0x7f341415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59064/0 (socket says 10.20.193.4:59064) 2026-02-24T09:09:35.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f3413fff640 1 -- 10.20.193.4:0/1998365429 learned_addr learned my addr 10.20.193.4:0/1998365429 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7fdf73fff640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf741135a0 0x7fdf74120460 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf68006ad0 tx=0x7fdf68003780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f34137fe640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f341410e790 0x7f341415fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f34188ee640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3414153350 0x7f34141653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7fdf70ff9640 1 -- 10.20.193.4:0/329023891 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf6803e070 con 0x7fdf741135a0 2026-02-24T09:09:35.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7fdf70ff9640 1 -- 10.20.193.4:0/329023891 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdf68003b40 con 0x7fdf741135a0 2026-02-24T09:09:35.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf74121030 con 0x7fdf741135a0 2026-02-24T09:09:35.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7fdf70ff9640 1 -- 10.20.193.4:0/329023891 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf68042a00 con 0x7fdf741135a0 2026-02-24T09:09:35.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf74161790 con 0x7fdf741135a0 2026-02-24T09:09:35.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f3413fff640 1 -- 10.20.193.4:0/1998365429 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3414153350 msgr2=0x7f34141653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f3413fff640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3414153350 0x7f34141653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f3413fff640 1 -- 10.20.193.4:0/1998365429 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f341410e790 msgr2=0x7f341415fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f3413fff640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f341410e790 0x7f341415fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f3413fff640 1 -- 10.20.193.4:0/1998365429 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340800a650 con 0x7f341410dda0 2026-02-24T09:09:35.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f3413fff640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f341410dda0 0x7f341415fab0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f340000d950 tx=0x7f340000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f34117fa640 1 -- 10.20.193.4:0/1998365429 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3400004540 con 0x7f341410dda0 2026-02-24T09:09:35.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f34117fa640 1 -- 10.20.193.4:0/1998365429 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3400009d00 con 0x7f341410dda0 2026-02-24T09:09:35.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.875+0000 7f34117fa640 1 -- 10.20.193.4:0/1998365429 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34000106e0 con 0x7f341410dda0 2026-02-24T09:09:35.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3414165ff0 con 0x7f341410dda0 2026-02-24T09:09:35.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341410bc20 con 0x7f341410dda0 2026-02-24T09:09:35.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf74121300 con 0x7fdf741135a0 2026-02-24T09:09:35.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7fb85ae74640 1 -- 10.20.193.4:0/1533313753 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb85410ebe0 msgr2=0x7fb8541531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7fb85ae74640 1 --2- 10.20.193.4:0/1533313753 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb85410ebe0 0x7fb8541531d0 secure :-1 s=READY pgs=73 gs=1 cs=0 l=1 c_cookie=5690409697127650799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb83c009950 tx=0x7fb83c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7fb85ae74640 1 -- 10.20.193.4:0/1533313753 shutdown_connections 2026-02-24T09:09:35.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7fb85ae74640 1 --2- 10.20.193.4:0/1533313753 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb8541537a0 0x7fb854173bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7fb85ae74640 1 --2- 10.20.193.4:0/1533313753 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb85410ebe0 0x7fb8541531d0 unknown :-1 s=CLOSED pgs=73 gs=1 cs=0 l=1 c_cookie=5690409697127650799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7fb85ae74640 1 --2- 10.20.193.4:0/1533313753 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb85410e1f0 0x7fb85410e5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7fb85ae74640 1 -- 10.20.193.4:0/1533313753 >> 10.20.193.4:0/1533313753 conn(0x7fb8540e9bf0 msgr2=0x7fb85410a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7fb85ae74640 1 -- 10.20.193.4:0/1533313753 shutdown_connections 2026-02-24T09:09:35.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7fb85ae74640 1 -- 10.20.193.4:0/1533313753 wait complete. 2026-02-24T09:09:35.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.876+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3414052010 con 0x7f341410dda0 2026-02-24T09:09:35.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7fb85ae74640 1 Processor -- start 2026-02-24T09:09:35.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7fdf70ff9640 1 -- 10.20.193.4:0/329023891 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fdf680050c0 con 0x7fdf741135a0 2026-02-24T09:09:35.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7fb85ae74640 1 -- start start 2026-02-24T09:09:35.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7ffac4736640 1 -- 10.20.193.4:0/4047447551 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffabc114a10 msgr2=0x7ffabc119560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7ffac4736640 1 --2- 10.20.193.4:0/4047447551 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffabc114a10 0x7ffabc119560 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=6833733258236183216 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffab0009950 tx=0x7ffab002f1b0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7ffac4736640 1 -- 10.20.193.4:0/4047447551 shutdown_connections 2026-02-24T09:09:35.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7ffac4736640 1 --2- 10.20.193.4:0/4047447551 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffabc119d10 0x7ffabc17a6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7ffac4736640 1 --2- 10.20.193.4:0/4047447551 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffabc114a10 0x7ffabc119560 unknown :-1 s=CLOSED pgs=279 gs=1 cs=0 l=1 c_cookie=6833733258236183216 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7ffac4736640 1 --2- 10.20.193.4:0/4047447551 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffabc114020 0x7ffabc1143f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7ffac4736640 1 -- 10.20.193.4:0/4047447551 >> 10.20.193.4:0/4047447551 conn(0x7ffabc064c40 msgr2=0x7ffabc065040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7ffac4736640 1 -- 10.20.193.4:0/4047447551 shutdown_connections 2026-02-24T09:09:35.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7ffac4736640 1 -- 10.20.193.4:0/4047447551 wait complete. 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7fb85ae74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb85410e1f0 0x7fb85415fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7fb85ae74640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb85410ebe0 0x7fb8541602b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7fb85ae74640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb8541537a0 0x7fb854165680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb85ae74640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb854165ca0 con 0x7fb85410e1f0 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb85ae74640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb854165e10 con 0x7fb85410ebe0 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb85ae74640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb854165fd0 con 0x7fb8541537a0 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb858be9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb85410e1f0 0x7fb85415fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb84bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb85410ebe0 0x7fb8541602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb858be9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb85410e1f0 0x7fb85415fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59088/0 (socket says 10.20.193.4:59088) 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb84bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb85410ebe0 0x7fb8541602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:52796/0 (socket says 10.20.193.4:52796) 2026-02-24T09:09:35.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb858be9640 1 -- 10.20.193.4:0/2206669940 learned_addr learned my addr 10.20.193.4:0/2206669940 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fdf70ff9640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf480b57f0 0x7fdf480d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb8593ea640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb8541537a0 0x7fb854165680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fdf737fe640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf480b57f0 0x7fdf480d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac4736640 1 Processor -- start 2026-02-24T09:09:35.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fdf70ff9640 1 -- 10.20.193.4:0/329023891 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fdf6810c700 con 0x7fdf741135a0 2026-02-24T09:09:35.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb84bfff640 1 -- 10.20.193.4:0/2206669940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb8541537a0 msgr2=0x7fb854165680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac4736640 1 -- start start 2026-02-24T09:09:35.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fdf70ff9640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] conn(0x7fdf480dcf50 0x7fdf480fd360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fdf70ff9640 1 -- 10.20.193.4:0/329023891 --> [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf480fda10 con 0x7fdf480dcf50 2026-02-24T09:09:35.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fdf70ff9640 1 -- 10.20.193.4:0/329023891 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fdf6810ed20 con 0x7fdf741135a0 2026-02-24T09:09:35.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb84bfff640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb8541537a0 0x7fb854165680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb84bfff640 1 -- 10.20.193.4:0/2206669940 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb85410e1f0 msgr2=0x7fb85415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb84bfff640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb85410e1f0 0x7fb85415fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb84bfff640 1 -- 10.20.193.4:0/2206669940 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8440094b0 con 0x7fb85410ebe0 2026-02-24T09:09:35.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fdf72ffd640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] conn(0x7fdf480dcf50 0x7fdf480fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fdf737fe640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf480b57f0 0x7fdf480d5ca0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf60004780 tx=0x7fdf60008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac4736640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffabc114020 0x7ffabc0fbce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac4736640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffabc114a10 0x7ffabc17a5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb84bfff640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb85410ebe0 0x7fb8541602b0 secure :-1 s=READY pgs=61 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb83c005970 tx=0x7fb83c0028d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb8593ea640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb8541537a0 0x7fb854165680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:35.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac4736640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffabc119d10 0x7ffabc0fc3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac4736640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1015f0 con 0x7ffabc114020 2026-02-24T09:09:35.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac4736640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc101760 con 0x7ffabc114a10 2026-02-24T09:09:35.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac4736640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc101920 con 0x7ffabc119d10 2026-02-24T09:09:35.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac24ab640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffabc114020 0x7ffabc0fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac24ab640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffabc114020 0x7ffabc0fbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59090/0 (socket says 10.20.193.4:59090) 2026-02-24T09:09:35.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac24ab640 1 -- 10.20.193.4:0/3380219186 learned_addr learned my addr 10.20.193.4:0/3380219186 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac1caa640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffabc114a10 0x7ffabc17a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.877+0000 7f34117fa640 1 -- 10.20.193.4:0/1998365429 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f34000097c0 con 0x7f341410dda0 2026-02-24T09:09:35.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7f34117fa640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33e80b9d00 0x7f33e80da1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7f34117fa640 1 -- 10.20.193.4:0/1998365429 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f34000e6e20 con 0x7f341410dda0 2026-02-24T09:09:35.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7f34117fa640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] conn(0x7f33e80e1470 0x7f33e8101880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7f34117fa640 1 -- 10.20.193.4:0/1998365429 --> [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33e8101f30 con 0x7f33e80e1470 2026-02-24T09:09:35.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7f34117fa640 1 -- 10.20.193.4:0/1998365429 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f34000e94b0 con 0x7f341410dda0 2026-02-24T09:09:35.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7f34137fe640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33e80b9d00 0x7f33e80da1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7ffac2cac640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffabc119d10 0x7ffabc0fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7fdf72ffd640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] conn(0x7fdf480dcf50 0x7fdf480fd360 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7f34137fe640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33e80b9d00 0x7f33e80da1b0 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3404005970 tx=0x7f3404005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7f34188ee640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] conn(0x7f33e80e1470 0x7f33e8101880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffac24ab640 1 -- 10.20.193.4:0/3380219186 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffabc119d10 msgr2=0x7ffabc0fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffac24ab640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffabc119d10 0x7ffabc0fc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffac24ab640 1 -- 10.20.193.4:0/3380219186 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffabc114a10 msgr2=0x7ffabc17a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffac24ab640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffabc114a10 0x7ffabc17a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffac24ab640 1 -- 10.20.193.4:0/3380219186 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab0009570 con 0x7ffabc114020 2026-02-24T09:09:35.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffac2cac640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffabc119d10 0x7ffabc0fc3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:35.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffac24ab640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffabc114020 0x7ffabc0fbce0 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffaac00b520 tx=0x7ffaac00b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.878+0000 7fb849ffb640 1 -- 10.20.193.4:0/2206669940 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb83c03d070 con 0x7fb85410ebe0 2026-02-24T09:09:35.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7fb849ffb640 1 -- 10.20.193.4:0/2206669940 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb83c002ac0 con 0x7fb85410ebe0 2026-02-24T09:09:35.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb83c009570 con 0x7fb85410ebe0 2026-02-24T09:09:35.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffaa37fe640 1 -- 10.20.193.4:0/3380219186 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffaac0044a0 con 0x7ffabc114020 2026-02-24T09:09:35.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85414f0f0 con 0x7fb85410ebe0 2026-02-24T09:09:35.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7fb849ffb640 1 -- 10.20.193.4:0/2206669940 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb83c041a00 con 0x7fb85410ebe0 2026-02-24T09:09:35.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7f34188ee640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] conn(0x7f33e80e1470 0x7f33e8101880 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffaa37fe640 1 -- 10.20.193.4:0/3380219186 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffaac002c20 con 0x7ffabc114020 2026-02-24T09:09:35.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffaa37fe640 1 -- 10.20.193.4:0/3380219186 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffaac00fdb0 con 0x7ffabc114020 2026-02-24T09:09:35.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffabc101c00 con 0x7ffabc114020 2026-02-24T09:09:35.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.879+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffabc102120 con 0x7ffabc114020 2026-02-24T09:09:35.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.880+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffabc052010 con 0x7ffabc114020 2026-02-24T09:09:35.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.880+0000 7f34117fa640 1 -- 10.20.193.4:0/1998365429 <== osd.1 v2:10.20.193.14:6800/1845604691 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f33e8101f30 con 0x7f33e80e1470 2026-02-24T09:09:35.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.880+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb854052010 con 0x7fb85410ebe0 2026-02-24T09:09:35.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.880+0000 7fb849ffb640 1 -- 10.20.193.4:0/2206669940 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fb83c038920 con 0x7fb85410ebe0 2026-02-24T09:09:35.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.880+0000 7fdf70ff9640 1 -- 10.20.193.4:0/329023891 <== osd.8 v2:10.20.193.90:6816/1972287488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fdf480fda10 con 0x7fdf480dcf50 2026-02-24T09:09:35.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.880+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 --> [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b0404cd10 con 0x7f9ae00dcf60 2026-02-24T09:09:35.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7f9af9ffb640 1 -- 10.20.193.4:0/3609155732 <== osd.3 v2:10.20.193.4:6810/1170432191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9b0404cd10 con 0x7f9ae00dcf60 2026-02-24T09:09:35.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] conn(0x7f9ae00dcf60 msgr2=0x7f9ae00fd370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7f9b0b15f640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] conn(0x7f9ae00dcf60 0x7f9ae00fd370 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ae00b57f0 msgr2=0x7f9ae00d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7f9b0b15f640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9ae00b57f0 0x7f9ae00d5ca0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9af40023d0 tx=0x7f9af4031040 comp rx=0 tx=0).stop 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9b0410fc70 msgr2=0x7f9b0411e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7f9b0b15f640 1 --2- 10.20.193.4:0/3609155732 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9b0410fc70 0x7f9b0411e0a0 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aec00d950 tx=0x7f9aec00de20 comp rx=0 tx=0).stop 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7f9b096d5640 1 -- 10.20.193.4:0/3609155732 reap_dead start 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 shutdown_connections 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 >> 10.20.193.4:0/3609155732 conn(0x7f9b0405f830 msgr2=0x7f9b0410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 shutdown_connections 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f9b0b15f640 1 -- 10.20.193.4:0/3609155732 wait complete. 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 -- 10.20.193.4:0/243092677 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f47cc10c450 msgr2=0x7f47cc1114a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 --2- 10.20.193.4:0/243092677 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f47cc10c450 0x7f47cc1114a0 secure :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=234211856217183398 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47b4009950 tx=0x7f47b402f1b0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 -- 10.20.193.4:0/243092677 shutdown_connections 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 --2- 10.20.193.4:0/243092677 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f47cc111c50 0x7f47cc172620 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 --2- 10.20.193.4:0/243092677 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f47cc10c450 0x7f47cc1114a0 unknown :-1 s=CLOSED pgs=74 gs=1 cs=0 l=1 c_cookie=234211856217183398 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 --2- 10.20.193.4:0/243092677 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47cc10ba60 0x7f47cc10be30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 -- 10.20.193.4:0/243092677 >> 10.20.193.4:0/243092677 conn(0x7f47cc0e9370 msgr2=0x7f47cc109780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 -- 10.20.193.4:0/243092677 shutdown_connections 2026-02-24T09:09:35.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 -- 10.20.193.4:0/243092677 wait complete. 2026-02-24T09:09:35.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7fb849ffb640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8300b5940 0x7fb8300d5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7fb858be9640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8300b5940 0x7fb8300d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7fb849ffb640 1 -- 10.20.193.4:0/2206669940 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb83c10b2d0 con 0x7fb85410ebe0 2026-02-24T09:09:35.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7fb849ffb640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] conn(0x7fb8300dd0b0 0x7fb8300fd4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7fb849ffb640 1 -- 10.20.193.4:0/2206669940 --> [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8300fdb70 con 0x7fb8300dd0b0 2026-02-24T09:09:35.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7fb849ffb640 1 -- 10.20.193.4:0/2206669940 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fb83c10d870 con 0x7fb85410ebe0 2026-02-24T09:09:35.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7fb858be9640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8300b5940 0x7fb8300d5df0 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb844005c70 tx=0x7fb844005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.881+0000 7ffaa37fe640 1 -- 10.20.193.4:0/3380219186 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7ffaac020060 con 0x7ffabc114020 2026-02-24T09:09:35.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 Processor -- start 2026-02-24T09:09:35.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7f47d2ad0640 1 -- start start 2026-02-24T09:09:35.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7ffaa37fe640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa980b57e0 0x7ffa980d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7ffac1caa640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa980b57e0 0x7ffa980d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7ffaa37fe640 1 -- 10.20.193.4:0/3380219186 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7ffaac0ad3e0 con 0x7ffabc114020 2026-02-24T09:09:35.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7ffaa37fe640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] conn(0x7ffa980ddb30 0x7ffa980fdfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7ffaa37fe640 1 -- 10.20.193.4:0/3380219186 --> [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa980fe710 con 0x7ffa980ddb30 2026-02-24T09:09:35.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.882+0000 7ffaa37fe640 1 -- 10.20.193.4:0/3380219186 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7ffaac006dd0 con 0x7ffabc114020 2026-02-24T09:09:35.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7ffac1caa640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa980b57e0 0x7ffa980d5c90 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffab0005b30 tx=0x7ffab003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7ffac2cac640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] conn(0x7ffa980ddb30 0x7ffa980fdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d2ad0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f47cc10ba60 0x7f47cc0f1dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7ffac2cac640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] conn(0x7ffa980ddb30 0x7ffa980fdfc0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d2ad0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47cc10c450 0x7f47cc172520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d2ad0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f47cc111c50 0x7f47cc0f24c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d2ad0640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc0f76d0 con 0x7f47cc10c450 2026-02-24T09:09:35.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d2ad0640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc0f7840 con 0x7f47cc10ba60 2026-02-24T09:09:35.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d2ad0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc0f7a00 con 0x7f47cc111c50 2026-02-24T09:09:35.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d0845640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f47cc10ba60 0x7f47cc0f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d0845640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f47cc10ba60 0x7f47cc0f1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:52816/0 (socket says 10.20.193.4:52816) 2026-02-24T09:09:35.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d0845640 1 -- 10.20.193.4:0/3757691659 learned_addr learned my addr 10.20.193.4:0/3757691659 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47c3fff640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47cc10c450 0x7f47cc172520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d0845640 1 -- 10.20.193.4:0/3757691659 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f47cc111c50 msgr2=0x7f47cc0f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d0845640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f47cc111c50 0x7f47cc0f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d0845640 1 -- 10.20.193.4:0/3757691659 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47cc10c450 msgr2=0x7f47cc172520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d0845640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f47cc10c450 0x7f47cc172520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d0845640 1 -- 10.20.193.4:0/3757691659 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b4009570 con 0x7f47cc10ba60 2026-02-24T09:09:35.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.883+0000 7f47d0845640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f47cc10ba60 0x7f47cc0f1dc0 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47bc00c9b0 tx=0x7f47bc00ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.884+0000 7ffaa37fe640 1 -- 10.20.193.4:0/3380219186 <== osd.0 v2:10.20.193.4:6802/2373413233 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7ffa980fe710 con 0x7ffa980ddb30 2026-02-24T09:09:35.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.884+0000 7f47c1ffb640 1 -- 10.20.193.4:0/3757691659 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47bc0044a0 con 0x7f47cc10ba60 2026-02-24T09:09:35.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.884+0000 7f47c1ffb640 1 -- 10.20.193.4:0/3757691659 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f47bc007da0 con 0x7f47cc10ba60 2026-02-24T09:09:35.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.884+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47cc0f7ce0 con 0x7f47cc10ba60 2026-02-24T09:09:35.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.884+0000 7f47c1ffb640 1 -- 10.20.193.4:0/3757691659 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47bc00f6d0 con 0x7f47cc10ba60 2026-02-24T09:09:35.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.884+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47cc0f81b0 con 0x7f47cc10ba60 2026-02-24T09:09:35.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7fb8593ea640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] conn(0x7fb8300dd0b0 0x7fb8300fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 --> [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4c7c052010 con 0x7f4c540dcfe0 2026-02-24T09:09:35.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7fb8593ea640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] conn(0x7fb8300dd0b0 0x7fb8300fd4c0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f4c637fe640 1 -- 10.20.193.4:0/773739314 <== osd.4 v2:10.20.193.14:6808/1479310505 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4c7c052010 con 0x7f4c540dcfe0 2026-02-24T09:09:35.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47cc052010 con 0x7f47cc10ba60 2026-02-24T09:09:35.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f47c1ffb640 1 -- 10.20.193.4:0/3757691659 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f47bc002880 con 0x7f47cc10ba60 2026-02-24T09:09:35.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 >> [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] conn(0x7f4c540dcfe0 msgr2=0x7f4c540fd3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f4c80d41640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] conn(0x7f4c540dcfe0 0x7f4c540fd3f0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c540b5870 msgr2=0x7f4c540d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f4c80d41640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c540b5870 0x7f4c540d5d20 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c7000b2c0 tx=0x7f4c7000b4a0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7c115470 msgr2=0x7f4c7c063830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f4c80d41640 1 --2- 10.20.193.4:0/773739314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7c115470 0x7f4c7c063830 secure :-1 s=READY pgs=276 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c6c030790 tx=0x7f4c6c005870 comp rx=0 tx=0).stop 2026-02-24T09:09:35.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7fb849ffb640 1 -- 10.20.193.4:0/2206669940 <== osd.7 v2:10.20.193.14:6816/144746180 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fb8300fdb70 con 0x7fb8300dd0b0 2026-02-24T09:09:35.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.885+0000 7f4c7ad76640 1 -- 10.20.193.4:0/773739314 reap_dead start 2026-02-24T09:09:35.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 shutdown_connections 2026-02-24T09:09:35.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 >> 10.20.193.4:0/773739314 conn(0x7f4c7c05f830 msgr2=0x7f4c7c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 shutdown_connections 2026-02-24T09:09:35.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f4c80d41640 1 -- 10.20.193.4:0/773739314 wait complete. 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f47c1ffb640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f47a80b5670 0x7f47a80d5b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f47c1ffb640 1 -- 10.20.193.4:0/3757691659 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f47bc0e5fa0 con 0x7f47cc10ba60 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f47c1ffb640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] conn(0x7f47a80dcc70 0x7f47a80fd080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f47c1ffb640 1 -- 10.20.193.4:0/3757691659 --> [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47a80fd730 con 0x7f47a80dcc70 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f47c1ffb640 1 -- 10.20.193.4:0/3757691659 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f47bc0e85a0 con 0x7f47cc10ba60 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f47c3fff640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f47a80b5670 0x7f47a80d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.886+0000 7f47d1046640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] conn(0x7f47a80dcc70 0x7f47a80fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.887+0000 7f47c3fff640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f47a80b5670 0x7f47a80d5b20 secure :-1 s=READY pgs=192 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47cc0f8760 tx=0x7f47b403a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.887+0000 7f47d1046640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] conn(0x7f47a80dcc70 0x7f47a80fd080 crc :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.887+0000 7f47c1ffb640 1 -- 10.20.193.4:0/3757691659 <== osd.5 v2:10.20.193.90:6808/3682673793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f47a80fd730 con 0x7f47a80dcc70 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.891+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 --> [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf74052010 con 0x7fdf480dcf50 2026-02-24T09:09:35.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.891+0000 7fa395f51640 1 -- 10.20.193.4:0/2513872692 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa39010f280 msgr2=0x7fa39010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.891+0000 7fa395f51640 1 --2- 10.20.193.4:0/2513872692 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa39010f280 0x7fa39010f650 secure :-1 s=READY pgs=281 gs=3 cs=0 l=1 c_cookie=2820452194622149141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa37c0098e0 tx=0x7fa37c02f130 comp rx=0 tx=0).stop 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fa395f51640 1 -- 10.20.193.4:0/2513872692 shutdown_connections 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fa395f51640 1 --2- 10.20.193.4:0/2513872692 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa390115470 0x7fa390175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fa395f51640 1 --2- 10.20.193.4:0/2513872692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa39010fc70 0x7fa390114cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fa395f51640 1 --2- 10.20.193.4:0/2513872692 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa39010f280 0x7fa39010f650 unknown :-1 s=CLOSED pgs=281 gs=3 cs=0 l=1 c_cookie=2820452194622149141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fa395f51640 1 -- 10.20.193.4:0/2513872692 >> 10.20.193.4:0/2513872692 conn(0x7fa39005f830 msgr2=0x7fa39010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fa395f51640 1 -- 10.20.193.4:0/2513872692 shutdown_connections 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fa395f51640 1 -- 10.20.193.4:0/2513872692 wait complete. 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fa395f51640 1 Processor -- start 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fdf70ff9640 1 -- 10.20.193.4:0/329023891 <== osd.8 v2:10.20.193.90:6816/1972287488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdf74052010 con 0x7fdf480dcf50 2026-02-24T09:09:35.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fa395f51640 1 -- start start 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 >> [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] conn(0x7fdf480dcf50 msgr2=0x7fdf480fd360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fdf79e13640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] conn(0x7fdf480dcf50 0x7fdf480fd360 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf480b57f0 msgr2=0x7fdf480d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fdf79e13640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf480b57f0 0x7fdf480d5ca0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf60004780 tx=0x7fdf60008040 comp rx=0 tx=0).stop 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf741135a0 msgr2=0x7fdf74120460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fdf79e13640 1 --2- 10.20.193.4:0/329023891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf741135a0 0x7fdf74120460 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf68006ad0 tx=0x7fdf68003780 comp rx=0 tx=0).stop 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.892+0000 7fdf73fff640 1 -- 10.20.193.4:0/329023891 reap_dead start 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa395f51640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa39010f280 0x7fa39011dbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 shutdown_connections 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 >> 10.20.193.4:0/329023891 conn(0x7fdf740eac60 msgr2=0x7fdf7410c110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 shutdown_connections 2026-02-24T09:09:35.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fdf79e13640 1 -- 10.20.193.4:0/329023891 wait complete. 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 --> [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f341404cd90 con 0x7f33e80e1470 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f88a3eb2640 1 -- 10.20.193.4:0/2255851588 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f889c10f280 msgr2=0x7f889c10f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f88a3eb2640 1 --2- 10.20.193.4:0/2255851588 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f889c10f280 0x7f889c10f650 secure :-1 s=READY pgs=282 gs=2 cs=0 l=1 c_cookie=5853749859355599904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f888c009950 tx=0x7f888c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f88a3eb2640 1 -- 10.20.193.4:0/2255851588 shutdown_connections 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f88a3eb2640 1 --2- 10.20.193.4:0/2255851588 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f889c115470 0x7f889c175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f88a3eb2640 1 --2- 10.20.193.4:0/2255851588 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889c10fc70 0x7f889c114cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f88a3eb2640 1 --2- 10.20.193.4:0/2255851588 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f889c10f280 0x7f889c10f650 unknown :-1 s=CLOSED pgs=282 gs=2 cs=0 l=1 c_cookie=5853749859355599904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f88a3eb2640 1 -- 10.20.193.4:0/2255851588 >> 10.20.193.4:0/2255851588 conn(0x7f889c05f830 msgr2=0x7f889c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f88a3eb2640 1 -- 10.20.193.4:0/2255851588 shutdown_connections 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f88a3eb2640 1 -- 10.20.193.4:0/2255851588 wait complete. 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa395f51640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa39010fc70 0x7fa39011e120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa395f51640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa390115470 0x7fa3901234f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa395f51640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fa390123b10 con 0x7fa39010fc70 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa395f51640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fa390123c80 con 0x7fa39010f280 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38f7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa39010f280 0x7fa39011dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa395f51640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa390123e40 con 0x7fa390115470 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38f7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa39010f280 0x7fa39011dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:52850/0 (socket says 10.20.193.4:52850) 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38ffff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa390115470 0x7fa3901234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38f7fe640 1 -- 10.20.193.4:0/2328510048 learned_addr learned my addr 10.20.193.4:0/2328510048 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38effd640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa39010fc70 0x7fa39011e120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38ffff640 1 -- 10.20.193.4:0/2328510048 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa39010f280 msgr2=0x7fa39011dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38ffff640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa39010f280 0x7fa39011dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38ffff640 1 -- 10.20.193.4:0/2328510048 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa39010fc70 msgr2=0x7fa39011e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f89be741640 1 -- 10.20.193.4:0/2388928709 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89b810f280 msgr2=0x7f89b810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f89be741640 1 --2- 10.20.193.4:0/2388928709 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89b810f280 0x7f89b810f650 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=4866271683893592830 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89a4009890 tx=0x7f89a402f0e0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f89be741640 1 -- 10.20.193.4:0/2388928709 shutdown_connections 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f89be741640 1 --2- 10.20.193.4:0/2388928709 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89b8115470 0x7f89b8175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f89be741640 1 --2- 10.20.193.4:0/2388928709 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89b810fc70 0x7f89b8114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f89be741640 1 --2- 10.20.193.4:0/2388928709 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89b810f280 0x7f89b810f650 unknown :-1 s=CLOSED pgs=75 gs=1 cs=0 l=1 c_cookie=4866271683893592830 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f89be741640 1 -- 10.20.193.4:0/2388928709 >> 10.20.193.4:0/2388928709 conn(0x7f89b805f830 msgr2=0x7f89b810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f89be741640 1 -- 10.20.193.4:0/2388928709 shutdown_connections 2026-02-24T09:09:35.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38ffff640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa39010fc70 0x7fa39011e120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38ffff640 1 -- 10.20.193.4:0/2328510048 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa380009570 con 0x7fa390115470 2026-02-24T09:09:35.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38effd640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa39010fc70 0x7fa39011e120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:09:35.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7f89be741640 1 -- 10.20.193.4:0/2388928709 wait complete. 2026-02-24T09:09:35.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7fa38ffff640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa390115470 0x7fa3901234f0 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa38400f940 tx=0x7fa38400fe10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7fa38cff9640 1 -- 10.20.193.4:0/2328510048 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa38400dce0 con 0x7fa390115470 2026-02-24T09:09:35.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7fa38cff9640 1 -- 10.20.193.4:0/2328510048 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa38400de40 con 0x7fa390115470 2026-02-24T09:09:35.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7fa38cff9640 1 -- 10.20.193.4:0/2328510048 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3840116b0 con 0x7fa390115470 2026-02-24T09:09:35.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37c0094b0 con 0x7fa390115470 2026-02-24T09:09:35.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89be741640 1 Processor -- start 2026-02-24T09:09:35.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa390164680 con 0x7fa390115470 2026-02-24T09:09:35.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89be741640 1 -- start start 2026-02-24T09:09:35.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f88a3eb2640 1 Processor -- start 2026-02-24T09:09:35.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89be741640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89b810f280 0x7f89b811dbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89be741640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89b810fc70 0x7f89b811e120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89b7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89b810f280 0x7f89b811dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89b7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89b810f280 0x7f89b811dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59140/0 (socket says 10.20.193.4:59140) 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89b7fff640 1 -- 10.20.193.4:0/711413750 learned_addr learned my addr 10.20.193.4:0/711413750 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89be741640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89b8115470 0x7f89b81234f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89b77fe640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89b810fc70 0x7f89b811e120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89be741640 1 -- 10.20.193.4:0/711413750 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f89b8123b10 con 0x7f89b810f280 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89be741640 1 -- 10.20.193.4:0/711413750 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f89b8123c80 con 0x7f89b810fc70 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89be741640 1 -- 10.20.193.4:0/711413750 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89b8123e40 con 0x7f89b8115470 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89bccb7640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89b8115470 0x7f89b81234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f88a3eb2640 1 -- start start 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f88a3eb2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889c10f280 0x7f889c11dbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89b7fff640 1 -- 10.20.193.4:0/711413750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89b8115470 msgr2=0x7f89b81234f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89b7fff640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89b8115470 0x7f89b81234f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89b7fff640 1 -- 10.20.193.4:0/711413750 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89b810fc70 msgr2=0x7f89b811e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89b7fff640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89b810fc70 0x7f89b811e120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89b7fff640 1 -- 10.20.193.4:0/711413750 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40094b0 con 0x7f89b810f280 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa390052010 con 0x7fa390115470 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f89b7fff640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89b810f280 0x7f89b811dbe0 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89a4032040 tx=0x7f89a40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f88a3eb2640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f889c10fc70 0x7f889c11e0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f88a3eb2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f889c115470 0x7f889c1234c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f88a3eb2640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f889c123ae0 con 0x7f889c115470 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f88a3eb2640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f889c123c50 con 0x7f889c10fc70 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f88a1c27640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889c10f280 0x7f889c11dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f88a3eb2640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f889c123e10 con 0x7f889c10f280 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f88a1c27640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889c10f280 0x7f889c11dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:57022/0 (socket says 10.20.193.4:57022) 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f88a1c27640 1 -- 10.20.193.4:0/4106056125 learned_addr learned my addr 10.20.193.4:0/4106056125 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f88a2428640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f889c115470 0x7f889c1234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f34117fa640 1 -- 10.20.193.4:0/1998365429 <== osd.1 v2:10.20.193.14:6800/1845604691 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f341404cd90 con 0x7f33e80e1470 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 >> [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] conn(0x7f33e80e1470 msgr2=0x7f33e8101880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f341a378640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] conn(0x7f33e80e1470 0x7f33e8101880 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33e80b9d00 msgr2=0x7f33e80da1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7f341a378640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33e80b9d00 0x7f33e80da1b0 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3404005970 tx=0x7f3404005900 comp rx=0 tx=0).stop 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f341410dda0 msgr2=0x7f341415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f341a378640 1 --2- 10.20.193.4:0/1998365429 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f341410dda0 0x7f341415fab0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f340000d950 tx=0x7f340000de20 comp rx=0 tx=0).stop 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f34188ee640 1 -- 10.20.193.4:0/1998365429 reap_dead start 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 shutdown_connections 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 >> 10.20.193.4:0/1998365429 conn(0x7f34140e97e0 msgr2=0x7f3414109bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 shutdown_connections 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f341a378640 1 -- 10.20.193.4:0/1998365429 wait complete. 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.893+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 --> [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffabc17dda0 con 0x7ffa980ddb30 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.894+0000 7ffaa37fe640 1 -- 10.20.193.4:0/3380219186 <== osd.0 v2:10.20.193.4:6802/2373413233 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffabc17dda0 con 0x7ffa980ddb30 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f88a2428640 1 -- 10.20.193.4:0/4106056125 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889c10f280 msgr2=0x7f889c11dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f88a2428640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889c10f280 0x7f889c11dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f88a2428640 1 -- 10.20.193.4:0/4106056125 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f889c10fc70 msgr2=0x7f889c11e0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f88a2428640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f889c10fc70 0x7f889c11e0f0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f88a2428640 1 -- 10.20.193.4:0/4106056125 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c009570 con 0x7f889c115470 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f88a2428640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f889c115470 0x7f889c1234c0 secure :-1 s=READY pgs=284 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889800e720 tx=0x7f889800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f89b57fa640 1 -- 10.20.193.4:0/711413750 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89a403d070 con 0x7f89b810f280 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f89be741640 1 -- 10.20.193.4:0/711413750 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b81240c0 con 0x7f89b810f280 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f89be741640 1 -- 10.20.193.4:0/711413750 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b8164820 con 0x7f89b810f280 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f89b57fa640 1 -- 10.20.193.4:0/711413750 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f89a4002a00 con 0x7f89b810f280 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7f89b57fa640 1 -- 10.20.193.4:0/711413750 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89a4041a00 con 0x7f89b810f280 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7fa38cff9640 1 -- 10.20.193.4:0/2328510048 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fa384020060 con 0x7fa390115470 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] conn(0x7ffa980ddb30 msgr2=0x7ffa980fdfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7ffac4736640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] conn(0x7ffa980ddb30 0x7ffa980fdfc0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa980b57e0 msgr2=0x7ffa980d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.895+0000 7ffac4736640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa980b57e0 0x7ffa980d5c90 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffab0005b30 tx=0x7ffab003a040 comp rx=0 tx=0).stop 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffabc114020 msgr2=0x7ffabc0fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7ffac4736640 1 --2- 10.20.193.4:0/3380219186 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffabc114020 0x7ffabc0fbce0 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffaac00b520 tx=0x7ffaac00b9f0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7f888affd640 1 -- 10.20.193.4:0/4106056125 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8898005500 con 0x7f889c115470 2026-02-24T09:09:35.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7f888affd640 1 -- 10.20.193.4:0/4106056125 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8898005660 con 0x7f889c115470 2026-02-24T09:09:35.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7f888affd640 1 -- 10.20.193.4:0/4106056125 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8898011460 con 0x7f889c115470 2026-02-24T09:09:35.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c1240f0 con 0x7f889c115470 2026-02-24T09:09:35.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c1647f0 con 0x7f889c115470 2026-02-24T09:09:35.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7fa38cff9640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa3640b57f0 0x7fa3640d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7ffac2cac640 1 -- 10.20.193.4:0/3380219186 reap_dead start 2026-02-24T09:09:35.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7f898affd640 1 -- 10.20.193.4:0/711413750 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8980000fd0 con 0x7f89b810f280 2026-02-24T09:09:35.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 shutdown_connections 2026-02-24T09:09:35.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 >> 10.20.193.4:0/3380219186 conn(0x7ffabc064c40 msgr2=0x7ffabc1187a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7fa38cff9640 1 -- 10.20.193.4:0/2328510048 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fa384015070 con 0x7fa390115470 2026-02-24T09:09:35.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7fa38f7fe640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa3640b57f0 0x7fa3640d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.897+0000 7fa38f7fe640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa3640b57f0 0x7fa3640d5ca0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa37c032040 tx=0x7fa37c005b60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.897+0000 7fa38cff9640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] conn(0x7fa3640dcf60 0x7fa3640fd370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.897+0000 7f89b57fa640 1 -- 10.20.193.4:0/711413750 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f89a40386b0 con 0x7f89b810f280 2026-02-24T09:09:35.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.897+0000 7fa38cff9640 1 -- 10.20.193.4:0/2328510048 --> [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3640fda20 con 0x7fa3640dcf60 2026-02-24T09:09:35.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.897+0000 7fa38cff9640 1 -- 10.20.193.4:0/2328510048 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa3840ec2a0 con 0x7fa390115470 2026-02-24T09:09:35.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.897+0000 7fa38effd640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] conn(0x7fa3640dcf60 0x7fa3640fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.898+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 shutdown_connections 2026-02-24T09:09:35.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.898+0000 7ffac4736640 1 -- 10.20.193.4:0/3380219186 wait complete. 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.898+0000 7fa38effd640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] conn(0x7fa3640dcf60 0x7fa3640fd370 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.898+0000 7f89b57fa640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f898c0b57f0 0x7f898c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.898+0000 7f89b77fe640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f898c0b57f0 0x7f898c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f89b57fa640 1 -- 10.20.193.4:0/711413750 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f89a410b2a0 con 0x7f89b810f280 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f89b77fe640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f898c0b57f0 0x7f898c0d5ca0 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89b8124580 tx=0x7f89a80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f89b57fa640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] conn(0x7f898c0dcf60 0x7f898c0fd370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7fa38cff9640 1 -- 10.20.193.4:0/2328510048 <== osd.2 v2:10.20.193.90:6800/3627753021 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7fa3640fda20 con 0x7fa3640dcf60 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f89b57fa640 1 -- 10.20.193.4:0/711413750 --> [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f898c0fda20 con 0x7f898c0dcf60 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f89b57fa640 1 -- 10.20.193.4:0/711413750 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f89a40cd640 con 0x7f89b810f280 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f89bccb7640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] conn(0x7f898c0dcf60 0x7f898c0fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.896+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f889c052010 con 0x7f889c115470 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.898+0000 7f888affd640 1 -- 10.20.193.4:0/4106056125 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f889800c7e0 con 0x7f889c115470 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f888affd640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88780b5870 0x7f88780d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f888affd640 1 -- 10.20.193.4:0/4106056125 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f88980e7fc0 con 0x7f889c115470 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f888affd640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] conn(0x7f88780dcfe0 0x7f88780fd3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f888affd640 1 -- 10.20.193.4:0/4106056125 --> [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88780fdaa0 con 0x7f88780dcfe0 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.899+0000 7f888affd640 1 -- 10.20.193.4:0/4106056125 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f88980e82f0 con 0x7f889c115470 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.900+0000 7f89bccb7640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] conn(0x7f898c0dcf60 0x7f898c0fd370 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.900+0000 7f88a1426640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] conn(0x7f88780dcfe0 0x7f88780fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.900+0000 7f88a1426640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] conn(0x7f88780dcfe0 0x7f88780fd3f0 crc :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.900+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 --> [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb8541774e0 con 0x7fb8300dd0b0 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.900+0000 7fb849ffb640 1 -- 10.20.193.4:0/2206669940 <== osd.7 v2:10.20.193.14:6816/144746180 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb8541774e0 con 0x7fb8300dd0b0 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7f888affd640 1 -- 10.20.193.4:0/4106056125 <== osd.11 v2:10.20.193.90:6824/3154606116 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f88780fdaa0 con 0x7f88780dcfe0 2026-02-24T09:09:35.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7f88a1c27640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88780b5870 0x7f88780d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 >> [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] conn(0x7fb8300dd0b0 msgr2=0x7fb8300fd4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb85ae74640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] conn(0x7fb8300dd0b0 0x7fb8300fd4c0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7f88a1c27640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88780b5870 0x7f88780d5d20 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f888c0023d0 tx=0x7f888c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8300b5940 msgr2=0x7fb8300d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb85ae74640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8300b5940 0x7fb8300d5df0 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb844005c70 tx=0x7fb844005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb85410ebe0 msgr2=0x7fb8541602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb85ae74640 1 --2- 10.20.193.4:0/2206669940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb85410ebe0 0x7fb8541602b0 secure :-1 s=READY pgs=61 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb83c005970 tx=0x7fb83c0028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb8593ea640 1 -- 10.20.193.4:0/2206669940 reap_dead start 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 shutdown_connections 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 >> 10.20.193.4:0/2206669940 conn(0x7fb8540e9bf0 msgr2=0x7fb854109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 shutdown_connections 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7fb85ae74640 1 -- 10.20.193.4:0/2206669940 wait complete. 2026-02-24T09:09:35.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.902+0000 7f89b57fa640 1 -- 10.20.193.4:0/711413750 <== osd.10 v2:10.20.193.14:6824/3870052801 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f898c0fda20 con 0x7f898c0dcf60 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.901+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 --> [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47cc10cd40 con 0x7f47a80dcc70 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.902+0000 7f47c1ffb640 1 -- 10.20.193.4:0/3757691659 <== osd.5 v2:10.20.193.90:6808/3682673793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f47cc10cd40 con 0x7f47a80dcc70 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.902+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 >> [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] conn(0x7f47a80dcc70 msgr2=0x7f47a80fd080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.902+0000 7f47d2ad0640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] conn(0x7f47a80dcc70 0x7f47a80fd080 crc :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.902+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f47a80b5670 msgr2=0x7f47a80d5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.902+0000 7f47d2ad0640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f47a80b5670 0x7f47a80d5b20 secure :-1 s=READY pgs=192 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47cc0f8760 tx=0x7f47b403a040 comp rx=0 tx=0).stop 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.902+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f47cc10ba60 msgr2=0x7f47cc0f1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.902+0000 7f47d2ad0640 1 --2- 10.20.193.4:0/3757691659 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f47cc10ba60 0x7f47cc0f1dc0 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47bc00c9b0 tx=0x7f47bc00ce80 comp rx=0 tx=0).stop 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.902+0000 7f47d1046640 1 -- 10.20.193.4:0/3757691659 reap_dead start 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.903+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 shutdown_connections 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.903+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 >> 10.20.193.4:0/3757691659 conn(0x7f47cc0e9370 msgr2=0x7f47cc10e260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.904+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 shutdown_connections 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.904+0000 7f47d2ad0640 1 -- 10.20.193.4:0/3757691659 wait complete. 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.908+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 --> [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa39004cd90 con 0x7fa3640dcf60 2026-02-24T09:09:35.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.908+0000 7fa38cff9640 1 -- 10.20.193.4:0/2328510048 <== osd.2 v2:10.20.193.90:6800/3627753021 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa39004cd90 con 0x7fa3640dcf60 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 >> [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] conn(0x7fa3640dcf60 msgr2=0x7fa3640fd370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa395f51640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] conn(0x7fa3640dcf60 0x7fa3640fd370 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa3640b57f0 msgr2=0x7fa3640d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa395f51640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa3640b57f0 0x7fa3640d5ca0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa37c032040 tx=0x7fa37c005b60 comp rx=0 tx=0).stop 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa390115470 msgr2=0x7fa3901234f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa395f51640 1 --2- 10.20.193.4:0/2328510048 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa390115470 0x7fa3901234f0 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa38400f940 tx=0x7fa38400fe10 comp rx=0 tx=0).stop 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa38ffff640 1 -- 10.20.193.4:0/2328510048 reap_dead start 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 shutdown_connections 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 >> 10.20.193.4:0/2328510048 conn(0x7fa39005f830 msgr2=0x7fa39010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 shutdown_connections 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.909+0000 7fa395f51640 1 -- 10.20.193.4:0/2328510048 wait complete. 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.912+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 --> [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f889c04cd10 con 0x7f88780dcfe0 2026-02-24T09:09:35.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.913+0000 7f888affd640 1 -- 10.20.193.4:0/4106056125 <== osd.11 v2:10.20.193.90:6824/3154606116 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f889c04cd10 con 0x7f88780dcfe0 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.913+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 >> [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] conn(0x7f88780dcfe0 msgr2=0x7f88780fd3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.913+0000 7f88a3eb2640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] conn(0x7f88780dcfe0 0x7f88780fd3f0 crc :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.913+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88780b5870 msgr2=0x7f88780d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.913+0000 7f88a3eb2640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88780b5870 0x7f88780d5d20 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f888c0023d0 tx=0x7f888c031040 comp rx=0 tx=0).stop 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.913+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f889c115470 msgr2=0x7f889c1234c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.913+0000 7f88a3eb2640 1 --2- 10.20.193.4:0/4106056125 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f889c115470 0x7f889c1234c0 secure :-1 s=READY pgs=284 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889800e720 tx=0x7f889800ebf0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.913+0000 7f88a2428640 1 -- 10.20.193.4:0/4106056125 reap_dead start 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.914+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 shutdown_connections 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.914+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 >> 10.20.193.4:0/4106056125 conn(0x7f889c05f830 msgr2=0x7f889c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.914+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 shutdown_connections 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.914+0000 7f88a3eb2640 1 -- 10.20.193.4:0/4106056125 wait complete. 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f898affd640 1 -- 10.20.193.4:0/711413750 --> [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8980002d10 con 0x7f898c0dcf60 2026-02-24T09:09:35.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f89b57fa640 1 -- 10.20.193.4:0/711413750 <== osd.10 v2:10.20.193.14:6824/3870052801 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8980002d10 con 0x7f898c0dcf60 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f817e1fe640 1 -- 10.20.193.4:0/1333470278 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8178115470 msgr2=0x7f8178175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f817e1fe640 1 --2- 10.20.193.4:0/1333470278 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8178115470 0x7f8178175e40 secure :-1 s=READY pgs=285 gs=2 cs=0 l=1 c_cookie=6473619527878177855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f816c00a970 tx=0x7f816c0301b0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f817e1fe640 1 -- 10.20.193.4:0/1333470278 shutdown_connections 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f817e1fe640 1 --2- 10.20.193.4:0/1333470278 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8178115470 0x7f8178175e40 unknown :-1 s=CLOSED pgs=285 gs=2 cs=0 l=1 c_cookie=6473619527878177855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f817e1fe640 1 --2- 10.20.193.4:0/1333470278 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f817810fc70 0x7f8178114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f817e1fe640 1 --2- 10.20.193.4:0/1333470278 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f817810f280 0x7f817810f650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f817e1fe640 1 -- 10.20.193.4:0/1333470278 >> 10.20.193.4:0/1333470278 conn(0x7f817805f830 msgr2=0x7f817810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f817e1fe640 1 -- 10.20.193.4:0/1333470278 shutdown_connections 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.915+0000 7f817e1fe640 1 -- 10.20.193.4:0/1333470278 wait complete. 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f817e1fe640 1 Processor -- start 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f817e1fe640 1 -- start start 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f817e1fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f817810f280 0x7f8178115d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f817e1fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f817810fc70 0x7f8178116250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f817e1fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8178115470 0x7f817815ad80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f817e1fe640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f817815b2c0 con 0x7f817810fc70 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f8176ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f817810fc70 0x7f8178116250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f817e1fe640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f817815b430 con 0x7f817810f280 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f817e1fe640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f817815b5f0 con 0x7f8178115470 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f8176ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f817810fc70 0x7f8178116250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59168/0 (socket says 10.20.193.4:59168) 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f8176ffd640 1 -- 10.20.193.4:0/1672620393 learned_addr learned my addr 10.20.193.4:0/1672620393 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f898affd640 1 -- 10.20.193.4:0/711413750 >> [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] conn(0x7f898c0dcf60 msgr2=0x7f898c0fd370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f898affd640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] conn(0x7f898c0dcf60 0x7f898c0fd370 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.916+0000 7f81777fe640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f817810f280 0x7f8178115d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f8176ffd640 1 -- 10.20.193.4:0/1672620393 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8178115470 msgr2=0x7f817815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f8176ffd640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8178115470 0x7f817815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f8176ffd640 1 -- 10.20.193.4:0/1672620393 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f817810f280 msgr2=0x7f8178115d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f8176ffd640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f817810f280 0x7f8178115d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f8176ffd640 1 -- 10.20.193.4:0/1672620393 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81680094b0 con 0x7f817810fc70 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f8176ffd640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f817810fc70 0x7f8178116250 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8168009fd0 tx=0x7f8168002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f898affd640 1 -- 10.20.193.4:0/711413750 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f898c0b57f0 msgr2=0x7f898c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f898affd640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f898c0b57f0 0x7f898c0d5ca0 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89b8124580 tx=0x7f89a80073d0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f898affd640 1 -- 10.20.193.4:0/711413750 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89b810f280 msgr2=0x7f89b811dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f898affd640 1 --2- 10.20.193.4:0/711413750 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89b810f280 0x7f89b811dbe0 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89a4032040 tx=0x7f89a40028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f89bccb7640 1 -- 10.20.193.4:0/711413750 reap_dead start 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f8174ff9640 1 -- 10.20.193.4:0/1672620393 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f816800ed60 con 0x7f817810fc70 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f898affd640 1 -- 10.20.193.4:0/711413750 shutdown_connections 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f898affd640 1 -- 10.20.193.4:0/711413750 >> 10.20.193.4:0/711413750 conn(0x7f89b805f830 msgr2=0x7f89b810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816c00a590 con 0x7f817810fc70 2026-02-24T09:09:35.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f8174ff9640 1 -- 10.20.193.4:0/1672620393 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8168002e20 con 0x7f817810fc70 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f898affd640 1 -- 10.20.193.4:0/711413750 shutdown_connections 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.917+0000 7f898affd640 1 -- 10.20.193.4:0/711413750 wait complete. 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.918+0000 7f8174ff9640 1 -- 10.20.193.4:0/1672620393 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f81680189f0 con 0x7f817810fc70 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.918+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817815bc60 con 0x7f817810fc70 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.918+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8178052010 con 0x7f817810fc70 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.918+0000 7f8174ff9640 1 -- 10.20.193.4:0/1672620393 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f8168016020 con 0x7f817810fc70 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.919+0000 7f8174ff9640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f814c0b57f0 0x7f814c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.919+0000 7f81777fe640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f814c0b57f0 0x7f814c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.919+0000 7f8174ff9640 1 -- 10.20.193.4:0/1672620393 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f81680e6d20 con 0x7f817810fc70 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.920+0000 7f8174ff9640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] conn(0x7f814c0dcdf0 0x7f814c0fd200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.920+0000 7f8174ff9640 1 -- 10.20.193.4:0/1672620393 --> [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f814c0fd8b0 con 0x7f814c0dcdf0 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.920+0000 7f8174ff9640 1 -- 10.20.193.4:0/1672620393 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f81680e92c0 con 0x7f817810fc70 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.920+0000 7f81777fe640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f814c0b57f0 0x7f814c0d5ca0 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8164004740 tx=0x7f8164009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.920+0000 7f8177fff640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] conn(0x7f814c0dcdf0 0x7f814c0fd200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.920+0000 7f8177fff640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] conn(0x7f814c0dcdf0 0x7f814c0fd200 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.921+0000 7f8174ff9640 1 -- 10.20.193.4:0/1672620393 <== osd.6 v2:10.20.193.4:6818/3822012168 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f814c0fd8b0 con 0x7f814c0dcdf0 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.929+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 --> [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f817810e1a0 con 0x7f814c0dcdf0 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.930+0000 7f8174ff9640 1 -- 10.20.193.4:0/1672620393 <== osd.6 v2:10.20.193.4:6818/3822012168 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f817810e1a0 con 0x7f814c0dcdf0 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.930+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] conn(0x7f814c0dcdf0 msgr2=0x7f814c0fd200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.930+0000 7f817e1fe640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] conn(0x7f814c0dcdf0 0x7f814c0fd200 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.930+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f814c0b57f0 msgr2=0x7f814c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.930+0000 7f817e1fe640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f814c0b57f0 0x7f814c0d5ca0 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8164004740 tx=0x7f8164009310 comp rx=0 tx=0).stop 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.930+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f817810fc70 msgr2=0x7f8178116250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.930+0000 7f817e1fe640 1 --2- 10.20.193.4:0/1672620393 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f817810fc70 0x7f8178116250 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8168009fd0 tx=0x7f8168002bc0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.930+0000 7f8177fff640 1 -- 10.20.193.4:0/1672620393 reap_dead start 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.932+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 shutdown_connections 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.932+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 >> 10.20.193.4:0/1672620393 conn(0x7f817805f830 msgr2=0x7f817810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.932+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 shutdown_connections 2026-02-24T09:09:35.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.932+0000 7f817e1fe640 1 -- 10.20.193.4:0/1672620393 wait complete. 2026-02-24T09:09:35.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.949+0000 7f4649c07640 1 -- 10.20.193.4:0/1188440630 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f464410da00 msgr2=0x7f4644112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.949+0000 7f4649c07640 1 --2- 10.20.193.4:0/1188440630 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f464410da00 0x7f4644112a50 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=7295270168647390978 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4634009950 tx=0x7f463402f190 comp rx=0 tx=0).stop 2026-02-24T09:09:35.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.949+0000 7f4649c07640 1 -- 10.20.193.4:0/1188440630 shutdown_connections 2026-02-24T09:09:35.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.949+0000 7f4649c07640 1 --2- 10.20.193.4:0/1188440630 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4644113200 0x7f4644173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.949+0000 7f4649c07640 1 --2- 10.20.193.4:0/1188440630 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f464410da00 0x7f4644112a50 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=7295270168647390978 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.949+0000 7f4649c07640 1 --2- 10.20.193.4:0/1188440630 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f464410d010 0x7f464410d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.949+0000 7f4649c07640 1 -- 10.20.193.4:0/1188440630 >> 10.20.193.4:0/1188440630 conn(0x7f464405f830 msgr2=0x7f464410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.949+0000 7f4649c07640 1 -- 10.20.193.4:0/1188440630 shutdown_connections 2026-02-24T09:09:35.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.949+0000 7f4649c07640 1 -- 10.20.193.4:0/1188440630 wait complete. 2026-02-24T09:09:35.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4649c07640 1 Processor -- start 2026-02-24T09:09:35.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4649c07640 1 -- start start 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4649c07640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f464410d010 0x7f46440f33b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4649c07640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f464410da00 0x7f4644173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4649c07640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4644113200 0x7f46440f3ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4649c07640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f46440f8cc0 con 0x7f464410da00 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4649c07640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f46440f8e30 con 0x7f4644113200 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4649c07640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f46440f8ff0 con 0x7f464410d010 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4643fff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4644113200 0x7f46440f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f46437fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f464410d010 0x7f46440f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4643fff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4644113200 0x7f46440f3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:52920/0 (socket says 10.20.193.4:52920) 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4643fff640 1 -- 10.20.193.4:0/3879941258 learned_addr learned my addr 10.20.193.4:0/3879941258 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4642ffd640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f464410da00 0x7f4644173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.950+0000 7f4643fff640 1 -- 10.20.193.4:0/3879941258 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f464410d010 msgr2=0x7f46440f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4643fff640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f464410d010 0x7f46440f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4643fff640 1 -- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f464410da00 msgr2=0x7f4644173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4643fff640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f464410da00 0x7f4644173ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4643fff640 1 -- 10.20.193.4:0/3879941258 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463800a590 con 0x7f4644113200 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f46437fe640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f464410d010 0x7f46440f33b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4642ffd640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f464410da00 0x7f4644173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:35.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4643fff640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4644113200 0x7f46440f3ab0 secure :-1 s=READY pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4638005790 tx=0x7f4638003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4640ff9640 1 -- 10.20.193.4:0/3879941258 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f463800fd60 con 0x7f4644113200 2026-02-24T09:09:35.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4640ff9640 1 -- 10.20.193.4:0/3879941258 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4638003e80 con 0x7f4644113200 2026-02-24T09:09:35.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4640ff9640 1 -- 10.20.193.4:0/3879941258 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4638019a80 con 0x7f4644113200 2026-02-24T09:09:35.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4634009570 con 0x7f4644113200 2026-02-24T09:09:35.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46440f9660 con 0x7f4644113200 2026-02-24T09:09:35.955 INFO:teuthology.orchestra.run.trial004.stdout:98784247828 2026-02-24T09:09:35.955 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T09:09:35.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.951+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4644052010 con 0x7f4644113200 2026-02-24T09:09:35.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.952+0000 7f4640ff9640 1 -- 10.20.193.4:0/3879941258 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f4638017020 con 0x7f4644113200 2026-02-24T09:09:35.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.953+0000 7f4640ff9640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46180b57e0 0x7f46180d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.953+0000 7f4640ff9640 1 -- 10.20.193.4:0/3879941258 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f46380e7f30 con 0x7f4644113200 2026-02-24T09:09:35.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.953+0000 7f46437fe640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46180b57e0 0x7f46180d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.953+0000 7f4640ff9640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] conn(0x7f46180dcf50 0x7f46180fd360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:35.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.953+0000 7f4640ff9640 1 -- 10.20.193.4:0/3879941258 --> [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46180fda10 con 0x7f46180dcf50 2026-02-24T09:09:35.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.953+0000 7f4640ff9640 1 -- 10.20.193.4:0/3879941258 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f46380e82e0 con 0x7f4644113200 2026-02-24T09:09:35.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.953+0000 7f4642ffd640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] conn(0x7f46180dcf50 0x7f46180fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:35.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.953+0000 7f46437fe640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46180b57e0 0x7f46180d5c90 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4630005970 tx=0x7f4630005f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.953+0000 7f4642ffd640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] conn(0x7f46180dcf50 0x7f46180fd360 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:35.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.954+0000 7f4640ff9640 1 -- 10.20.193.4:0/3879941258 <== osd.9 v2:10.20.193.4:6826/2740686484 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33658 (crc 0 0 0) 0x7f46180fda10 con 0x7f46180dcf50 2026-02-24T09:09:35.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.962+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 --> [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4644177170 con 0x7f46180dcf50 2026-02-24T09:09:35.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4640ff9640 1 -- 10.20.193.4:0/3879941258 <== osd.9 v2:10.20.193.4:6826/2740686484 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4644177170 con 0x7f46180dcf50 2026-02-24T09:09:35.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] conn(0x7f46180dcf50 msgr2=0x7f46180fd360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4649c07640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] conn(0x7f46180dcf50 0x7f46180fd360 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:35.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46180b57e0 msgr2=0x7f46180d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4649c07640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f46180b57e0 0x7f46180d5c90 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4630005970 tx=0x7f4630005f70 comp rx=0 tx=0).stop 2026-02-24T09:09:35.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4644113200 msgr2=0x7f46440f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:35.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4649c07640 1 --2- 10.20.193.4:0/3879941258 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4644113200 0x7f46440f3ab0 secure :-1 s=READY pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4638005790 tx=0x7f4638003c20 comp rx=0 tx=0).stop 2026-02-24T09:09:35.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4643fff640 1 -- 10.20.193.4:0/3879941258 reap_dead start 2026-02-24T09:09:35.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 shutdown_connections 2026-02-24T09:09:35.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 >> 10.20.193.4:0/3879941258 conn(0x7f464405f830 msgr2=0x7f4644110860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:35.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 shutdown_connections 2026-02-24T09:09:35.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:35.963+0000 7f4649c07640 1 -- 10.20.193.4:0/3879941258 wait complete. 2026-02-24T09:09:35.970 INFO:teuthology.orchestra.run.trial004.stdout:68719476757 2026-02-24T09:09:35.971 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T09:09:35.972 INFO:teuthology.orchestra.run.trial004.stdout:128849018898 2026-02-24T09:09:35.973 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-24T09:09:35.990 INFO:teuthology.orchestra.run.trial004.stdout:176093659152 2026-02-24T09:09:35.990 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-24T09:09:35.998 INFO:teuthology.orchestra.run.trial004.stdout:223338299403 2026-02-24T09:09:35.998 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-24T09:09:36.005 INFO:teuthology.orchestra.run.trial004.stdout:270582939656 2026-02-24T09:09:36.006 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-24T09:09:36.015 INFO:teuthology.orchestra.run.trial004.stdout:300647710729 2026-02-24T09:09:36.015 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-24T09:09:36.020 INFO:teuthology.orchestra.run.trial004.stdout:253403070475 2026-02-24T09:09:36.020 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-24T09:09:36.024 INFO:teuthology.orchestra.run.trial004.stdout:51539607575 2026-02-24T09:09:36.024 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T09:09:36.035 INFO:teuthology.orchestra.run.trial004.stdout:193273528334 2026-02-24T09:09:36.035 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-24T09:09:36.058 INFO:teuthology.orchestra.run.trial004.stdout:34359738393 2026-02-24T09:09:36.058 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T09:09:36.064 INFO:teuthology.orchestra.run.trial004.stdout:146028888080 2026-02-24T09:09:36.064 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-24T09:09:36.094 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.116 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.117 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.122 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.152 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.153 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.170 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.171 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.173 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.193 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 -- 10.20.193.4:0/3366612134 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44a4063860 msgr2=0x7f44a4063c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 --2- 10.20.193.4:0/3366612134 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44a4063860 0x7f44a4063c70 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=13722719375240926579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4498009890 tx=0x7f449802f0e0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 -- 10.20.193.4:0/3366612134 shutdown_connections 2026-02-24T09:09:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 --2- 10.20.193.4:0/3366612134 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44a4159a90 0x7f44a4179f20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 --2- 10.20.193.4:0/3366612134 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44a4063860 0x7f44a4063c70 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=13722719375240926579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 --2- 10.20.193.4:0/3366612134 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44a4067220 0x7f44a4063240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 -- 10.20.193.4:0/3366612134 >> 10.20.193.4:0/3366612134 conn(0x7f44a405f830 msgr2=0x7f44a410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 -- 10.20.193.4:0/3366612134 shutdown_connections 2026-02-24T09:09:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 -- 10.20.193.4:0/3366612134 wait complete. 2026-02-24T09:09:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 Processor -- start 2026-02-24T09:09:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.226+0000 7f44ac421640 1 -- start start 2026-02-24T09:09:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44ac421640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44a4063860 0x7f44a4163d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44ac421640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44a4067220 0x7f44a41642d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44ac421640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44a4159a90 0x7f44a41696a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44ac421640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4169cc0 con 0x7f44a4159a90 2026-02-24T09:09:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44ac421640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4169e30 con 0x7f44a4063860 2026-02-24T09:09:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44ac421640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4169ff0 con 0x7f44a4067220 2026-02-24T09:09:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44a9995640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44a4067220 0x7f44a41642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44a9995640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44a4067220 0x7f44a41642d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:57092/0 (socket says 10.20.193.4:57092) 2026-02-24T09:09:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44a9995640 1 -- 10.20.193.4:0/4187512397 learned_addr learned my addr 10.20.193.4:0/4187512397 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 -- 10.20.193.4:0/1994653052 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7410da00 msgr2=0x7f4c74112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44aa997640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44a4159a90 0x7f44a41696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 --2- 10.20.193.4:0/1994653052 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7410da00 0x7f4c74112a50 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=16975886316195204425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c5c009950 tx=0x7f4c5c02f1b0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 -- 10.20.193.4:0/1994653052 shutdown_connections 2026-02-24T09:09:36.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 --2- 10.20.193.4:0/1994653052 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c74113200 0x7f4c74173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 --2- 10.20.193.4:0/1994653052 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7410da00 0x7f4c74112a50 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=16975886316195204425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 --2- 10.20.193.4:0/1994653052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c7410d010 0x7f4c7410d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 -- 10.20.193.4:0/1994653052 >> 10.20.193.4:0/1994653052 conn(0x7f4c7405f830 msgr2=0x7f4c7410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44a9995640 1 -- 10.20.193.4:0/4187512397 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44a4063860 msgr2=0x7f44a4163d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:09:36.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44aa196640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44a4063860 0x7f44a4163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44a9995640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44a4063860 0x7f44a4163d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44a9995640 1 -- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44a4159a90 msgr2=0x7f44a41696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44a9995640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44a4159a90 0x7f44a41696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44a9995640 1 -- 10.20.193.4:0/4187512397 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a000a650 con 0x7f44a4067220 2026-02-24T09:09:36.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44aa997640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44a4159a90 0x7f44a41696a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:09:36.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 -- 10.20.193.4:0/1994653052 shutdown_connections 2026-02-24T09:09:36.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 -- 10.20.193.4:0/1994653052 wait complete. 2026-02-24T09:09:36.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 Processor -- start 2026-02-24T09:09:36.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 -- start start 2026-02-24T09:09:36.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f44a9995640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44a4067220 0x7f44a41642d0 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4498002390 tx=0x7f44980028d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7410d010 0x7f4c7405d660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7410da00 0x7f4c74173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c74113200 0x7f4c7405dd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f448b7fe640 1 -- 10.20.193.4:0/4187512397 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f449803d070 con 0x7f44a4067220 2026-02-24T09:09:36.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740ff2d0 con 0x7f4c7410d010 2026-02-24T09:09:36.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740ff440 con 0x7f4c7410da00 2026-02-24T09:09:36.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c78a5f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740ff600 con 0x7f4c74113200 2026-02-24T09:09:36.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f4c72575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7410d010 0x7f4c7405d660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f448b7fe640 1 -- 10.20.193.4:0/4187512397 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f449802fcb0 con 0x7f44a4067220 2026-02-24T09:09:36.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.227+0000 7f448b7fe640 1 -- 10.20.193.4:0/4187512397 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44980419d0 con 0x7f44a4067220 2026-02-24T09:09:36.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f44ac421640 1 -- 10.20.193.4:0/4187512397 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44980094b0 con 0x7f44a4067220 2026-02-24T09:09:36.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f4c72575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7410d010 0x7f4c7405d660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59220/0 (socket says 10.20.193.4:59220) 2026-02-24T09:09:36.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f4c72575640 1 -- 10.20.193.4:0/3628574204 learned_addr learned my addr 10.20.193.4:0/3628574204 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f4c71d74640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7410da00 0x7f4c74173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f4c72575640 1 -- 10.20.193.4:0/3628574204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c74113200 msgr2=0x7f4c7405dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f4c72575640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c74113200 0x7f4c7405dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f4c72575640 1 -- 10.20.193.4:0/3628574204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7410da00 msgr2=0x7f4c74173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f4c72575640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7410da00 0x7f4c74173ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f4c72575640 1 -- 10.20.193.4:0/3628574204 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c009570 con 0x7f4c7410d010 2026-02-24T09:09:36.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f4c71d74640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7410da00 0x7f4c74173ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:36.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f4c72575640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7410d010 0x7f4c7405d660 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c680072a0 tx=0x7f4c6800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.228+0000 7f44ac421640 1 -- 10.20.193.4:0/4187512397 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a416a500 con 0x7f44a4067220 2026-02-24T09:09:36.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.229+0000 7f4c5b7fe640 1 -- 10.20.193.4:0/3628574204 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c68004500 con 0x7f4c7410d010 2026-02-24T09:09:36.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.229+0000 7f4c5b7fe640 1 -- 10.20.193.4:0/3628574204 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4c68004d30 con 0x7f4c7410d010 2026-02-24T09:09:36.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.229+0000 7f4c78a5f640 1 -- 10.20.193.4:0/3628574204 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c740ff8e0 con 0x7f4c7410d010 2026-02-24T09:09:36.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.229+0000 7f4c5b7fe640 1 -- 10.20.193.4:0/3628574204 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c68005310 con 0x7f4c7410d010 2026-02-24T09:09:36.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.229+0000 7f4c78a5f640 1 -- 10.20.193.4:0/3628574204 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c740ffdb0 con 0x7f4c7410d010 2026-02-24T09:09:36.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.229+0000 7f44ac421640 1 -- 10.20.193.4:0/4187512397 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a4064750 con 0x7f44a4067220 2026-02-24T09:09:36.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.229+0000 7f4c78a5f640 1 -- 10.20.193.4:0/3628574204 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7410e2f0 con 0x7f4c7410d010 2026-02-24T09:09:36.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.229+0000 7f448b7fe640 1 -- 10.20.193.4:0/4187512397 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f4498041b60 con 0x7f44a4067220 2026-02-24T09:09:36.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.230+0000 7f448b7fe640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44800b57f0 0x7f44800d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.230+0000 7f448b7fe640 1 -- 10.20.193.4:0/4187512397 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f449810b050 con 0x7f44a4067220 2026-02-24T09:09:36.244 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.231+0000 7f44aa196640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44800b57f0 0x7f44800d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.231+0000 7f44aa196640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44800b57f0 0x7f44800d5ca0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4494005970 tx=0x7f4494005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.231+0000 7f4c5b7fe640 1 -- 10.20.193.4:0/3628574204 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f4c680054a0 con 0x7f4c7410d010 2026-02-24T09:09:36.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.232+0000 7f4c5b7fe640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c4c0b58b0 0x7f4c4c0d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.232+0000 7f4c71d74640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c4c0b58b0 0x7f4c4c0d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.232+0000 7f4c5b7fe640 1 -- 10.20.193.4:0/3628574204 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f4c680e6d10 con 0x7f4c7410d010 2026-02-24T09:09:36.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.232+0000 7f4c71d74640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c4c0b58b0 0x7f4c4c0d5d60 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c74102550 tx=0x7f4c5c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.232+0000 7f448b7fe640 1 -- 10.20.193.4:0/4187512397 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f44980cdaf0 con 0x7f44a4067220 2026-02-24T09:09:36.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 -- 10.20.193.4:0/3902198055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7494115470 msgr2=0x7f7494175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 --2- 10.20.193.4:0/3902198055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7494115470 0x7f7494175e40 secure :-1 s=READY pgs=290 gs=3 cs=0 l=1 c_cookie=16903940908486927416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f748800a9c0 tx=0x7f7488030200 comp rx=0 tx=0).stop 2026-02-24T09:09:36.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 -- 10.20.193.4:0/3902198055 shutdown_connections 2026-02-24T09:09:36.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 --2- 10.20.193.4:0/3902198055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7494115470 0x7f7494175e40 unknown :-1 s=CLOSED pgs=290 gs=3 cs=0 l=1 c_cookie=16903940908486927416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 --2- 10.20.193.4:0/3902198055 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f749410fc70 0x7f7494114cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f4c5b7fe640 1 -- 10.20.193.4:0/3628574204 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f4c680a96a0 con 0x7f4c7410d010 2026-02-24T09:09:36.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 --2- 10.20.193.4:0/3902198055 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f749410f280 0x7f749410f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 -- 10.20.193.4:0/3902198055 >> 10.20.193.4:0/3902198055 conn(0x7f749405f830 msgr2=0x7f749410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 -- 10.20.193.4:0/3902198055 shutdown_connections 2026-02-24T09:09:36.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 -- 10.20.193.4:0/3902198055 wait complete. 2026-02-24T09:09:36.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 Processor -- start 2026-02-24T09:09:36.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.234+0000 7f749a59c640 1 -- start start 2026-02-24T09:09:36.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f749a59c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f749410f280 0x7f7494115d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f749a59c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f749410fc70 0x7f7494116250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f749a59c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7494115470 0x7f749415ad80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f749a59c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7494116a60 con 0x7f7494115470 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f749a59c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7494116bd0 con 0x7f749410f280 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f749a59c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f749415b340 con 0x7f749410fc70 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f74937fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f749410fc70 0x7f7494116250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f74937fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f749410fc70 0x7f7494116250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:57130/0 (socket says 10.20.193.4:57130) 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f7498b12640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7494115470 0x7f749415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f74937fe640 1 -- 10.20.193.4:0/752244249 learned_addr learned my addr 10.20.193.4:0/752244249 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f7493fff640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f749410f280 0x7f7494115d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f7493fff640 1 -- 10.20.193.4:0/752244249 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f749410fc70 msgr2=0x7f7494116250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f7493fff640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f749410fc70 0x7f7494116250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.235+0000 7f7493fff640 1 -- 10.20.193.4:0/752244249 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7494115470 msgr2=0x7f749415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.249 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:36.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.236+0000 7f52783f8640 1 -- 10.20.193.4:0/1131488073 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52701135a0 msgr2=0x7f5270173f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.236+0000 7f52783f8640 1 --2- 10.20.193.4:0/1131488073 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52701135a0 0x7f5270173f70 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=10921380851634347290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f526c00aa30 tx=0x7f526c030290 comp rx=0 tx=0).stop 2026-02-24T09:09:36.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.236+0000 7f52783f8640 1 -- 10.20.193.4:0/1131488073 shutdown_connections 2026-02-24T09:09:36.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.236+0000 7f52783f8640 1 --2- 10.20.193.4:0/1131488073 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52701135a0 0x7f5270173f70 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=10921380851634347290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.236+0000 7f52783f8640 1 --2- 10.20.193.4:0/1131488073 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f527010bcd0 0x7f5270112df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.236+0000 7f52783f8640 1 --2- 10.20.193.4:0/1131488073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f527010b2e0 0x7f527010b6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.236+0000 7f52783f8640 1 -- 10.20.193.4:0/1131488073 >> 10.20.193.4:0/1131488073 conn(0x7f52700e8e50 msgr2=0x7f5270109260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.236+0000 7f52783f8640 1 -- 10.20.193.4:0/1131488073 shutdown_connections 2026-02-24T09:09:36.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.236+0000 7f52783f8640 1 -- 10.20.193.4:0/1131488073 wait complete. 2026-02-24T09:09:36.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f52783f8640 1 Processor -- start 2026-02-24T09:09:36.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f52783f8640 1 -- start start 2026-02-24T09:09:36.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f7493fff640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7494115470 0x7f749415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f7493fff640 1 -- 10.20.193.4:0/752244249 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7484009570 con 0x7f749410f280 2026-02-24T09:09:36.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f7498b12640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7494115470 0x7f749415ad80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:36.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f7493fff640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f749410f280 0x7f7494115d10 secure :-1 s=READY pgs=65 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f748000d720 tx=0x7f748000dbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f74917fa640 1 -- 10.20.193.4:0/752244249 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7480004500 con 0x7f749410f280 2026-02-24T09:09:36.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f74917fa640 1 -- 10.20.193.4:0/752244249 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7480004d30 con 0x7f749410f280 2026-02-24T09:09:36.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f749a59c640 1 -- 10.20.193.4:0/752244249 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748800a590 con 0x7f749410f280 2026-02-24T09:09:36.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f749a59c640 1 -- 10.20.193.4:0/752244249 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f749415b9b0 con 0x7f749410f280 2026-02-24T09:09:36.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f52783f8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f527010b2e0 0x7f52700ec7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f52783f8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f527010bcd0 0x7f5270173e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f52783f8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f52701135a0 0x7f52700ecea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f52783f8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f52700f20b0 con 0x7f527010b2e0 2026-02-24T09:09:36.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f52783f8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f52700f2220 con 0x7f52701135a0 2026-02-24T09:09:36.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f52783f8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f52700f23e0 con 0x7f527010bcd0 2026-02-24T09:09:36.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f527616d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f527010b2e0 0x7f52700ec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f527616d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f527010b2e0 0x7f52700ec7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59260/0 (socket says 10.20.193.4:59260) 2026-02-24T09:09:36.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f527616d640 1 -- 10.20.193.4:0/2054259775 learned_addr learned my addr 10.20.193.4:0/2054259775 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f527696e640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f52701135a0 0x7f52700ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f527616d640 1 -- 10.20.193.4:0/2054259775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f527010bcd0 msgr2=0x7f5270173e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f527616d640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f527010bcd0 0x7f5270173e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f527616d640 1 -- 10.20.193.4:0/2054259775 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f52701135a0 msgr2=0x7f52700ecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f527616d640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f52701135a0 0x7f52700ecea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.237+0000 7f527616d640 1 -- 10.20.193.4:0/2054259775 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c00a650 con 0x7f527010b2e0 2026-02-24T09:09:36.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.238+0000 7f527616d640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f527010b2e0 0x7f52700ec7a0 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f526000ca60 tx=0x7f526000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.238+0000 7f52577fe640 1 -- 10.20.193.4:0/2054259775 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5260004500 con 0x7f527010b2e0 2026-02-24T09:09:36.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.238+0000 7f52577fe640 1 -- 10.20.193.4:0/2054259775 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5260007e10 con 0x7f527010b2e0 2026-02-24T09:09:36.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.238+0000 7f52577fe640 1 -- 10.20.193.4:0/2054259775 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f526000f760 con 0x7f527010b2e0 2026-02-24T09:09:36.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.238+0000 7f74917fa640 1 -- 10.20.193.4:0/752244249 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74800052a0 con 0x7f749410f280 2026-02-24T09:09:36.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.238+0000 7f749a59c640 1 -- 10.20.193.4:0/752244249 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7494110560 con 0x7f749410f280 2026-02-24T09:09:36.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.239+0000 7f52783f8640 1 -- 10.20.193.4:0/2054259775 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52700f26c0 con 0x7f527010b2e0 2026-02-24T09:09:36.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.239+0000 7f52783f8640 1 -- 10.20.193.4:0/2054259775 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52700f2b10 con 0x7f527010b2e0 2026-02-24T09:09:36.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.239+0000 7f52783f8640 1 -- 10.20.193.4:0/2054259775 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f527010c400 con 0x7f527010b2e0 2026-02-24T09:09:36.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.239+0000 7f74917fa640 1 -- 10.20.193.4:0/752244249 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f7480009820 con 0x7f749410f280 2026-02-24T09:09:36.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.240+0000 7f74917fa640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b5670 0x7f745c0d5b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.241+0000 7f52577fe640 1 -- 10.20.193.4:0/2054259775 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f5260002910 con 0x7f527010b2e0 2026-02-24T09:09:36.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.241+0000 7f74917fa640 1 -- 10.20.193.4:0/752244249 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f74800e6a30 con 0x7f749410f280 2026-02-24T09:09:36.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.241+0000 7f74917fa640 1 -- 10.20.193.4:0/752244249 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f74800a8bd0 con 0x7f749410f280 2026-02-24T09:09:36.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.242+0000 7f52577fe640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f524c0b57f0 0x7f524c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.242+0000 7f52577fe640 1 -- 10.20.193.4:0/2054259775 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f52600e6ab0 con 0x7f527010b2e0 2026-02-24T09:09:36.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.242+0000 7f527596c640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f524c0b57f0 0x7f524c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.242+0000 7f74937fe640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b5670 0x7f745c0d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.242+0000 7f527596c640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f524c0b57f0 0x7f524c0d5ca0 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5264009480 tx=0x7f5264009410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.243+0000 7f74937fe640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b5670 0x7f745c0d5b20 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7494112120 tx=0x7f7484009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.243+0000 7f52577fe640 1 -- 10.20.193.4:0/2054259775 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f52600a9400 con 0x7f527010b2e0 2026-02-24T09:09:36.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.270+0000 7f77725d5640 1 -- 10.20.193.4:0/2958279472 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f776c10d010 msgr2=0x7f776c10d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.270+0000 7f77725d5640 1 --2- 10.20.193.4:0/2958279472 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f776c10d010 0x7f776c10d3e0 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=4503324193542657822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7758009950 tx=0x7f775802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.270+0000 7f77725d5640 1 -- 10.20.193.4:0/2958279472 shutdown_connections 2026-02-24T09:09:36.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.270+0000 7f77725d5640 1 --2- 10.20.193.4:0/2958279472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f776c113200 0x7f776c173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.270+0000 7f77725d5640 1 --2- 10.20.193.4:0/2958279472 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f776c10da00 0x7f776c112a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.271+0000 7f77725d5640 1 --2- 10.20.193.4:0/2958279472 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f776c10d010 0x7f776c10d3e0 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=4503324193542657822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.271+0000 7f77725d5640 1 -- 10.20.193.4:0/2958279472 >> 10.20.193.4:0/2958279472 conn(0x7f776c05f830 msgr2=0x7f776c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.271+0000 7f77725d5640 1 -- 10.20.193.4:0/2958279472 shutdown_connections 2026-02-24T09:09:36.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.271+0000 7f77725d5640 1 -- 10.20.193.4:0/2958279472 wait complete. 2026-02-24T09:09:36.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.271+0000 7f77725d5640 1 Processor -- start 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.271+0000 7f77725d5640 1 -- start start 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.271+0000 7f77725d5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f776c10d010 0x7f776c11b970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f77725d5640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f776c10da00 0x7f776c11beb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f77725d5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f776c113200 0x7f776c121280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f77725d5640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f776c1218a0 con 0x7f776c113200 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f77725d5640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f776c121a10 con 0x7f776c10da00 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f77725d5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f776c121bd0 con 0x7f776c10d010 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f7770b4b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f776c113200 0x7f776c121280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f776bfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f776c10d010 0x7f776c11b970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f7770b4b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f776c113200 0x7f776c121280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59286/0 (socket says 10.20.193.4:59286) 2026-02-24T09:09:36.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f7770b4b640 1 -- 10.20.193.4:0/535653177 learned_addr learned my addr 10.20.193.4:0/535653177 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f776b7fe640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f776c10da00 0x7f776c11beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f7770b4b640 1 -- 10.20.193.4:0/535653177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f776c10d010 msgr2=0x7f776c11b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f7770b4b640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f776c10d010 0x7f776c11b970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f7770b4b640 1 -- 10.20.193.4:0/535653177 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f776c10da00 msgr2=0x7f776c11beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f7770b4b640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f776c10da00 0x7f776c11beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f7770b4b640 1 -- 10.20.193.4:0/535653177 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7758009570 con 0x7f776c113200 2026-02-24T09:09:36.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.272+0000 7f7770b4b640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f776c113200 0x7f776c121280 secure :-1 s=READY pgs=294 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7760006e90 tx=0x7f776000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.273+0000 7f77697fa640 1 -- 10.20.193.4:0/535653177 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f776000cb80 con 0x7f776c113200 2026-02-24T09:09:36.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.273+0000 7f77697fa640 1 -- 10.20.193.4:0/535653177 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7760005e10 con 0x7f776c113200 2026-02-24T09:09:36.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.273+0000 7f77697fa640 1 -- 10.20.193.4:0/535653177 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7760003b20 con 0x7f776c113200 2026-02-24T09:09:36.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.273+0000 7f77725d5640 1 -- 10.20.193.4:0/535653177 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776c121eb0 con 0x7f776c113200 2026-02-24T09:09:36.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.273+0000 7f77725d5640 1 -- 10.20.193.4:0/535653177 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776c061010 con 0x7f776c113200 2026-02-24T09:09:36.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.274+0000 7f77725d5640 1 -- 10.20.193.4:0/535653177 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f776c1220d0 con 0x7f776c113200 2026-02-24T09:09:36.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.275+0000 7fc74da9f640 1 -- 10.20.193.4:0/1914737092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc74810fc70 msgr2=0x7fc748114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.275+0000 7fc74da9f640 1 --2- 10.20.193.4:0/1914737092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc74810fc70 0x7fc748114cc0 secure :-1 s=READY pgs=78 gs=2 cs=0 l=1 c_cookie=7353694950010264194 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc738009950 tx=0x7fc73802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.275+0000 7fc74da9f640 1 -- 10.20.193.4:0/1914737092 shutdown_connections 2026-02-24T09:09:36.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.275+0000 7fc74da9f640 1 --2- 10.20.193.4:0/1914737092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc748115470 0x7fc748175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.275+0000 7fc74da9f640 1 --2- 10.20.193.4:0/1914737092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc74810fc70 0x7fc748114cc0 unknown :-1 s=CLOSED pgs=78 gs=2 cs=0 l=1 c_cookie=7353694950010264194 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.275+0000 7fc74da9f640 1 --2- 10.20.193.4:0/1914737092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc74810f280 0x7fc74810f650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.275+0000 7fc74da9f640 1 -- 10.20.193.4:0/1914737092 >> 10.20.193.4:0/1914737092 conn(0x7fc74805f830 msgr2=0x7fc74810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.275+0000 7fc74da9f640 1 -- 10.20.193.4:0/1914737092 shutdown_connections 2026-02-24T09:09:36.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.275+0000 7fc74da9f640 1 -- 10.20.193.4:0/1914737092 wait complete. 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc74da9f640 1 Processor -- start 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc74da9f640 1 -- start start 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc74da9f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc74810f280 0x7fc748066fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc74da9f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc74810fc70 0x7fc748175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc74da9f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc748115470 0x7fc748063280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc74da9f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fc748063a10 con 0x7fc748115470 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc74da9f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fc748063b80 con 0x7fc74810fc70 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc74da9f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc748063d40 con 0x7fc74810f280 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc747fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc748115470 0x7fc748063280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc747fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc748115470 0x7fc748063280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59302/0 (socket says 10.20.193.4:59302) 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc747fff640 1 -- 10.20.193.4:0/16712664 learned_addr learned my addr 10.20.193.4:0/16712664 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc7477fe640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc74810f280 0x7fc748066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc746ffd640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc74810fc70 0x7fc748175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc747fff640 1 -- 10.20.193.4:0/16712664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc74810f280 msgr2=0x7fc748066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc747fff640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc74810f280 0x7fc748066fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc747fff640 1 -- 10.20.193.4:0/16712664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc74810fc70 msgr2=0x7fc748175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc747fff640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc74810fc70 0x7fc748175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc747fff640 1 -- 10.20.193.4:0/16712664 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7340094b0 con 0x7fc748115470 2026-02-24T09:09:36.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.276+0000 7fc747fff640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc748115470 0x7fc748063280 secure :-1 s=READY pgs=295 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc73c006e90 tx=0x7fc73c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.278+0000 7fc744ff9640 1 -- 10.20.193.4:0/16712664 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc73c00cb80 con 0x7fc748115470 2026-02-24T09:09:36.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.279+0000 7fc744ff9640 1 -- 10.20.193.4:0/16712664 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc73c005e10 con 0x7fc748115470 2026-02-24T09:09:36.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.279+0000 7fc744ff9640 1 -- 10.20.193.4:0/16712664 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc73c003b20 con 0x7fc748115470 2026-02-24T09:09:36.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.279+0000 7fc74da9f640 1 -- 10.20.193.4:0/16712664 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc738009570 con 0x7fc748115470 2026-02-24T09:09:36.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.279+0000 7fc74da9f640 1 -- 10.20.193.4:0/16712664 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7480ffc70 con 0x7fc748115470 2026-02-24T09:09:36.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.279+0000 7fc722ffd640 1 -- 10.20.193.4:0/16712664 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc704005300 con 0x7fc748115470 2026-02-24T09:09:36.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.280+0000 7f77697fa640 1 -- 10.20.193.4:0/535653177 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f7760005090 con 0x7f776c113200 2026-02-24T09:09:36.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.280+0000 7f77697fa640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77400b5870 0x7f77400d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.281+0000 7f776bfff640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77400b5870 0x7f77400d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.281+0000 7f77697fa640 1 -- 10.20.193.4:0/535653177 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f77600e7c70 con 0x7f776c113200 2026-02-24T09:09:36.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.281+0000 7f77697fa640 1 -- 10.20.193.4:0/535653177 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f7760120930 con 0x7f776c113200 2026-02-24T09:09:36.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.281+0000 7f776bfff640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77400b5870 0x7f77400d5d20 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77580098a0 tx=0x7f775803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.282+0000 7fc744ff9640 1 -- 10.20.193.4:0/16712664 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fc73c005090 con 0x7fc748115470 2026-02-24T09:09:36.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.282+0000 7fc744ff9640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc71c0b57f0 0x7fc71c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.282+0000 7fc7477fe640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc71c0b57f0 0x7fc71c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.282+0000 7fc744ff9640 1 -- 10.20.193.4:0/16712664 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fc73c0e7d40 con 0x7fc748115470 2026-02-24T09:09:36.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.283+0000 7fc7477fe640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc71c0b57f0 0x7fc71c0d5ca0 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc734004740 tx=0x7fc734005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.283+0000 7fc744ff9640 1 -- 10.20.193.4:0/16712664 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc73c0aa6d0 con 0x7fc748115470 2026-02-24T09:09:36.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.285+0000 7f20f3fff640 1 -- 10.20.193.4:0/392281659 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f20f40386f0 con 0x7f210410b120 2026-02-24T09:09:36.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 -- 10.20.193.4:0/392281659 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f210410b120 msgr2=0x7f210410b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 --2- 10.20.193.4:0/392281659 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f210410b120 0x7f210410b4f0 secure :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=4809398935468210798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20f4009950 tx=0x7f20f402f1b0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 -- 10.20.193.4:0/392281659 shutdown_connections 2026-02-24T09:09:36.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 --2- 10.20.193.4:0/392281659 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21041112f0 0x7f2104111cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 --2- 10.20.193.4:0/392281659 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f210410bb10 0x7f2104110b60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 --2- 10.20.193.4:0/392281659 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f210410b120 0x7f210410b4f0 unknown :-1 s=CLOSED pgs=66 gs=2 cs=0 l=1 c_cookie=4809398935468210798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 -- 10.20.193.4:0/392281659 >> 10.20.193.4:0/392281659 conn(0x7f21040e8e50 msgr2=0x7f2104109260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 -- 10.20.193.4:0/392281659 shutdown_connections 2026-02-24T09:09:36.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 -- 10.20.193.4:0/392281659 wait complete. 2026-02-24T09:09:36.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 Processor -- start 2026-02-24T09:09:36.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 -- start start 2026-02-24T09:09:36.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f210410b120 0x7f21040f0830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f210410bb10 0x7f21040f0d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21041112f0 0x7f21040f6140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.286+0000 7f210b434640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f21040f6760 con 0x7f210410b120 2026-02-24T09:09:36.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f210b434640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f21040f68d0 con 0x7f21041112f0 2026-02-24T09:09:36.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f210b434640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f21040f6a90 con 0x7f210410bb10 2026-02-24T09:09:36.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21091a9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f210410b120 0x7f21040f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21091a9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f210410b120 0x7f21040f0830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59322/0 (socket says 10.20.193.4:59322) 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21091a9640 1 -- 10.20.193.4:0/1158458471 learned_addr learned my addr 10.20.193.4:0/1158458471 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21089a8640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f210410bb10 0x7f21040f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21099aa640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21041112f0 0x7f21040f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21091a9640 1 -- 10.20.193.4:0/1158458471 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f210410bb10 msgr2=0x7f21040f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21091a9640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f210410bb10 0x7f21040f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21091a9640 1 -- 10.20.193.4:0/1158458471 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21041112f0 msgr2=0x7f21040f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21091a9640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21041112f0 0x7f21040f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21091a9640 1 -- 10.20.193.4:0/1158458471 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f4009570 con 0x7f210410b120 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f21091a9640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f210410b120 0x7f21040f0830 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20f402f6c0 tx=0x7f20f40043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f20f27fc640 1 -- 10.20.193.4:0/1158458471 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f20f403d070 con 0x7f210410b120 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f20f27fc640 1 -- 10.20.193.4:0/1158458471 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f20f4002b80 con 0x7f210410b120 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f20f27fc640 1 -- 10.20.193.4:0/1158458471 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f20f40419e0 con 0x7f210410b120 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f210b434640 1 -- 10.20.193.4:0/1158458471 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21040f6d10 con 0x7f210410b120 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.287+0000 7f210b434640 1 -- 10.20.193.4:0/1158458471 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21040f72b0 con 0x7f210410b120 2026-02-24T09:09:36.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.288+0000 7f210b434640 1 -- 10.20.193.4:0/1158458471 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210410c400 con 0x7f210410b120 2026-02-24T09:09:36.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.289+0000 7f257e64d640 1 -- 10.20.193.4:0/387639544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f257810da00 msgr2=0x7f2578112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.289+0000 7f257e64d640 1 --2- 10.20.193.4:0/387639544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f257810da00 0x7f2578112a50 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=17038719518700771732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2568009890 tx=0x7f256802f100 comp rx=0 tx=0).stop 2026-02-24T09:09:36.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.289+0000 7f257e64d640 1 -- 10.20.193.4:0/387639544 shutdown_connections 2026-02-24T09:09:36.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.289+0000 7f257e64d640 1 --2- 10.20.193.4:0/387639544 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2578113200 0x7f2578173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.289+0000 7f257e64d640 1 --2- 10.20.193.4:0/387639544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f257810da00 0x7f2578112a50 unknown :-1 s=CLOSED pgs=79 gs=2 cs=0 l=1 c_cookie=17038719518700771732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.289+0000 7f257e64d640 1 --2- 10.20.193.4:0/387639544 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f257810d010 0x7f257810d3e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.289+0000 7f257e64d640 1 -- 10.20.193.4:0/387639544 >> 10.20.193.4:0/387639544 conn(0x7f257805f830 msgr2=0x7f257810ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.289+0000 7f257e64d640 1 -- 10.20.193.4:0/387639544 shutdown_connections 2026-02-24T09:09:36.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.289+0000 7f257e64d640 1 -- 10.20.193.4:0/387639544 wait complete. 2026-02-24T09:09:36.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.290+0000 7f20f27fc640 1 -- 10.20.193.4:0/1158458471 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f20f4041b70 con 0x7f210410b120 2026-02-24T09:09:36.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.290+0000 7f257e64d640 1 Processor -- start 2026-02-24T09:09:36.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.290+0000 7f257e64d640 1 -- start start 2026-02-24T09:09:36.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.290+0000 7f257e64d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f257810d010 0x7f25780f3350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.290+0000 7f257e64d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f257810da00 0x7f2578173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.290+0000 7f257e64d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2578113200 0x7f25780f3a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.290+0000 7f20f27fc640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20e00b5870 0x7f20e00d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.290+0000 7f257e64d640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f25780f8c60 con 0x7f257810da00 2026-02-24T09:09:36.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.290+0000 7f257e64d640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f25780f8dd0 con 0x7f257810d010 2026-02-24T09:09:36.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.290+0000 7f25777fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f257810da00 0x7f2578173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f20f27fc640 1 -- 10.20.193.4:0/1158458471 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f20f410b7d0 con 0x7f210410b120 2026-02-24T09:09:36.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f257e64d640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25780f8f90 con 0x7f2578113200 2026-02-24T09:09:36.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f25777fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f257810da00 0x7f2578173ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59354/0 (socket says 10.20.193.4:59354) 2026-02-24T09:09:36.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f25777fe640 1 -- 10.20.193.4:0/1539287452 learned_addr learned my addr 10.20.193.4:0/1539287452 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f257cbc3640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2578113200 0x7f25780f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f21089a8640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20e00b5870 0x7f20e00d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f2577fff640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f257810d010 0x7f25780f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f25777fe640 1 -- 10.20.193.4:0/1539287452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2578113200 msgr2=0x7f25780f3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f25777fe640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2578113200 0x7f25780f3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f25777fe640 1 -- 10.20.193.4:0/1539287452 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f257810d010 msgr2=0x7f25780f3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f25777fe640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f257810d010 0x7f25780f3350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f25777fe640 1 -- 10.20.193.4:0/1539287452 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25680094b0 con 0x7f257810da00 2026-02-24T09:09:36.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f25777fe640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f257810da00 0x7f2578173ad0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2568002390 tx=0x7f2568005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f2577fff640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f257810d010 0x7f25780f3350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:36.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f21089a8640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20e00b5870 0x7f20e00d5d20 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21040f71d0 tx=0x7f20f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.291+0000 7f20f27fc640 1 -- 10.20.193.4:0/1158458471 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f20f40ce2c0 con 0x7f210410b120 2026-02-24T09:09:36.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.293+0000 7f4db8110640 1 -- 10.20.193.4:0/2481397616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db0115470 msgr2=0x7f4db0175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.293+0000 7f4db8110640 1 --2- 10.20.193.4:0/2481397616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db0115470 0x7f4db0175e40 secure :-1 s=READY pgs=80 gs=3 cs=0 l=1 c_cookie=4752174651956158125 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac00a970 tx=0x7f4dac0301b0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.293+0000 7f4db8110640 1 -- 10.20.193.4:0/2481397616 shutdown_connections 2026-02-24T09:09:36.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.293+0000 7f4db8110640 1 --2- 10.20.193.4:0/2481397616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db0115470 0x7f4db0175e40 unknown :-1 s=CLOSED pgs=80 gs=3 cs=0 l=1 c_cookie=4752174651956158125 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.293+0000 7f4db8110640 1 --2- 10.20.193.4:0/2481397616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db010fc70 0x7f4db0114cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.293+0000 7f4db8110640 1 --2- 10.20.193.4:0/2481397616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db010f280 0x7f4db010f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.293+0000 7f4db8110640 1 -- 10.20.193.4:0/2481397616 >> 10.20.193.4:0/2481397616 conn(0x7f4db005f830 msgr2=0x7f4db010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.293+0000 7f4db8110640 1 -- 10.20.193.4:0/2481397616 shutdown_connections 2026-02-24T09:09:36.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.293+0000 7f4db8110640 1 -- 10.20.193.4:0/2481397616 wait complete. 2026-02-24T09:09:36.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f4db8110640 1 Processor -- start 2026-02-24T09:09:36.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f4db8110640 1 -- start start 2026-02-24T09:09:36.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f25757fa640 1 -- 10.20.193.4:0/1539287452 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25680042e0 con 0x7f257810da00 2026-02-24T09:09:36.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f257e64d640 1 -- 10.20.193.4:0/1539287452 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25780f9210 con 0x7f257810da00 2026-02-24T09:09:36.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f25757fa640 1 -- 10.20.193.4:0/1539287452 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2568004440 con 0x7f257810da00 2026-02-24T09:09:36.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f257e64d640 1 -- 10.20.193.4:0/1539287452 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25780f96d0 con 0x7f257810da00 2026-02-24T09:09:36.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f4db8110640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db010f280 0x7f4db011db90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f4db8110640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db010fc70 0x7f4db011e0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f4db8110640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db0115470 0x7f4db01234a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f4db8110640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4db0123ac0 con 0x7f4db010f280 2026-02-24T09:09:36.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f4db8110640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4db0123c30 con 0x7f4db010fc70 2026-02-24T09:09:36.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f4db8110640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4db0123df0 con 0x7f4db0115470 2026-02-24T09:09:36.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db6686640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db0115470 0x7f4db01234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db6686640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db0115470 0x7f4db01234a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:57218/0 (socket says 10.20.193.4:57218) 2026-02-24T09:09:36.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db5684640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db010fc70 0x7f4db011e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db6686640 1 -- 10.20.193.4:0/1332420607 learned_addr learned my addr 10.20.193.4:0/1332420607 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db5e85640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db010f280 0x7f4db011db90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.295+0000 7f25757fa640 1 -- 10.20.193.4:0/1539287452 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f256803fc50 con 0x7f257810da00 2026-02-24T09:09:36.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db6686640 1 -- 10.20.193.4:0/1332420607 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db010fc70 msgr2=0x7f4db011e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db6686640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db010fc70 0x7f4db011e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db6686640 1 -- 10.20.193.4:0/1332420607 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db010f280 msgr2=0x7f4db011db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db6686640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db010f280 0x7f4db011db90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db6686640 1 -- 10.20.193.4:0/1332420607 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac00a590 con 0x7f4db0115470 2026-02-24T09:09:36.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f4db6686640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db0115470 0x7f4db01234a0 secure :-1 s=READY pgs=81 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac005820 tx=0x7f4dac030d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.296+0000 7f257e64d640 1 -- 10.20.193.4:0/1539287452 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f257810e2f0 con 0x7f257810da00 2026-02-24T09:09:36.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.297+0000 7f4d9effd640 1 -- 10.20.193.4:0/1332420607 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dac03e070 con 0x7f4db0115470 2026-02-24T09:09:36.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.297+0000 7f4d9effd640 1 -- 10.20.193.4:0/1332420607 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4dac003b10 con 0x7f4db0115470 2026-02-24T09:09:36.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.297+0000 7f4d9effd640 1 -- 10.20.193.4:0/1332420607 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dac042960 con 0x7f4db0115470 2026-02-24T09:09:36.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.297+0000 7f4db8110640 1 -- 10.20.193.4:0/1332420607 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db0124070 con 0x7f4db0115470 2026-02-24T09:09:36.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.297+0000 7f4db8110640 1 -- 10.20.193.4:0/1332420607 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db0164630 con 0x7f4db0115470 2026-02-24T09:09:36.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.297+0000 7f25757fa640 1 -- 10.20.193.4:0/1539287452 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f256804f070 con 0x7f257810da00 2026-02-24T09:09:36.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.297+0000 7f4db8110640 1 -- 10.20.193.4:0/1332420607 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db0110560 con 0x7f4db0115470 2026-02-24T09:09:36.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.298+0000 7f25757fa640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f254c0b57f0 0x7f254c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.298+0000 7f25757fa640 1 -- 10.20.193.4:0/1539287452 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f256810fcc0 con 0x7f257810da00 2026-02-24T09:09:36.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.298+0000 7f2577fff640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f254c0b57f0 0x7f254c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.299+0000 7f2577fff640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f254c0b57f0 0x7f254c0d5ca0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2564004720 tx=0x7f2564005f20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.299+0000 7f4d9effd640 1 -- 10.20.193.4:0/1332420607 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f4dac042af0 con 0x7f4db0115470 2026-02-24T09:09:36.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.300+0000 7f4d9effd640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b5940 0x7f4d8c0d5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.300+0000 7f4d9effd640 1 -- 10.20.193.4:0/1332420607 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f4dac10c3b0 con 0x7f4db0115470 2026-02-24T09:09:36.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.300+0000 7f25757fa640 1 -- 10.20.193.4:0/1539287452 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f25680d2560 con 0x7f257810da00 2026-02-24T09:09:36.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.300+0000 7f4d9effd640 1 -- 10.20.193.4:0/1332420607 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f4dac0ceec0 con 0x7f4db0115470 2026-02-24T09:09:36.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.307+0000 7f4db5e85640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b5940 0x7f4d8c0d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.307+0000 7f4db5e85640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b5940 0x7f4d8c0d5df0 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da0004740 tx=0x7f4da0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 -- 10.20.193.4:0/599600967 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faae810d010 msgr2=0x7faae810d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 --2- 10.20.193.4:0/599600967 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faae810d010 0x7faae810d3e0 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=16373171001552257814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faadc009950 tx=0x7faadc02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 -- 10.20.193.4:0/599600967 shutdown_connections 2026-02-24T09:09:36.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 --2- 10.20.193.4:0/599600967 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faae8113200 0x7faae8173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 --2- 10.20.193.4:0/599600967 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faae810da00 0x7faae8112a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 --2- 10.20.193.4:0/599600967 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faae810d010 0x7faae810d3e0 unknown :-1 s=CLOSED pgs=298 gs=1 cs=0 l=1 c_cookie=16373171001552257814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 -- 10.20.193.4:0/599600967 >> 10.20.193.4:0/599600967 conn(0x7faae805f830 msgr2=0x7faae810ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 -- 10.20.193.4:0/599600967 shutdown_connections 2026-02-24T09:09:36.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 -- 10.20.193.4:0/599600967 wait complete. 2026-02-24T09:09:36.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 Processor -- start 2026-02-24T09:09:36.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 -- start start 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faae810d010 0x7faae8060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.311+0000 7faaece71640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faae810da00 0x7faae80614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faaece71640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faae8113200 0x7faae8061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faaece71640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7faae8163d20 con 0x7faae810da00 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faaece71640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7faae8163e90 con 0x7faae8113200 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faaece71640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7faae8164050 con 0x7faae810d010 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae5d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faae810da00 0x7faae80614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae5d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faae810da00 0x7faae80614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59386/0 (socket says 10.20.193.4:59386) 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae5d74640 1 -- 10.20.193.4:0/697624141 learned_addr learned my addr 10.20.193.4:0/697624141 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae6d76640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faae8113200 0x7faae8061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae5d74640 1 -- 10.20.193.4:0/697624141 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faae810d010 msgr2=0x7faae8060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae6575640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faae810d010 0x7faae8060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae5d74640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faae810d010 0x7faae8060f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae5d74640 1 -- 10.20.193.4:0/697624141 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faae8113200 msgr2=0x7faae8061a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae5d74640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faae8113200 0x7faae8061a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae5d74640 1 -- 10.20.193.4:0/697624141 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faadc009570 con 0x7faae810da00 2026-02-24T09:09:36.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae6d76640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faae8113200 0x7faae8061a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:36.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae6575640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faae810d010 0x7faae8060f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:36.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faae5d74640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faae810da00 0x7faae80614d0 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad000d950 tx=0x7faad000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faacf7fe640 1 -- 10.20.193.4:0/697624141 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faad0004540 con 0x7faae810da00 2026-02-24T09:09:36.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faacf7fe640 1 -- 10.20.193.4:0/697624141 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faad0009d00 con 0x7faae810da00 2026-02-24T09:09:36.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faaece71640 1 -- 10.20.193.4:0/697624141 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae8164330 con 0x7faae810da00 2026-02-24T09:09:36.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faacf7fe640 1 -- 10.20.193.4:0/697624141 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faad00106e0 con 0x7faae810da00 2026-02-24T09:09:36.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.312+0000 7faaece71640 1 -- 10.20.193.4:0/697624141 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae81647f0 con 0x7faae810da00 2026-02-24T09:09:36.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.313+0000 7faacd7fa640 1 -- 10.20.193.4:0/697624141 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faab0005300 con 0x7faae810da00 2026-02-24T09:09:36.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.314+0000 7faacf7fe640 1 -- 10.20.193.4:0/697624141 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7faad00097c0 con 0x7faae810da00 2026-02-24T09:09:36.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.315+0000 7faacf7fe640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faac00b57f0 0x7faac00d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.315+0000 7faacf7fe640 1 -- 10.20.193.4:0/697624141 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7faad00e71f0 con 0x7faae810da00 2026-02-24T09:09:36.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.315+0000 7faae6575640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faac00b57f0 0x7faac00d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.316+0000 7faae6575640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faac00b57f0 0x7faac00d5ca0 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faadc0098a0 tx=0x7faadc031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.318+0000 7faacf7fe640 1 -- 10.20.193.4:0/697624141 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7faad00a9b80 con 0x7faae810da00 2026-02-24T09:09:36.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.360+0000 7f4c78a5f640 1 -- 10.20.193.4:0/3628574204 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4c74100090 con 0x7f4c7410d010 2026-02-24T09:09:36.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.361+0000 7f4c5b7fe640 1 -- 10.20.193.4:0/3628574204 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4c680ac850 con 0x7f4c7410d010 2026-02-24T09:09:36.365 INFO:teuthology.orchestra.run.trial004.stdout:128849018897 2026-02-24T09:09:36.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.362+0000 7faad8d96640 1 -- 10.20.193.4:0/274398218 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faad410f280 msgr2=0x7faad410f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.362+0000 7faad8d96640 1 --2- 10.20.193.4:0/274398218 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faad410f280 0x7faad410f650 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=11286606988143581002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faac8009950 tx=0x7faac802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.362+0000 7faad8d96640 1 -- 10.20.193.4:0/274398218 shutdown_connections 2026-02-24T09:09:36.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.362+0000 7faad8d96640 1 --2- 10.20.193.4:0/274398218 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faad4115470 0x7faad4175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.362+0000 7faad8d96640 1 --2- 10.20.193.4:0/274398218 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faad410fc70 0x7faad4114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.362+0000 7faad8d96640 1 --2- 10.20.193.4:0/274398218 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faad410f280 0x7faad410f650 unknown :-1 s=CLOSED pgs=82 gs=1 cs=0 l=1 c_cookie=11286606988143581002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.362+0000 7faad8d96640 1 -- 10.20.193.4:0/274398218 >> 10.20.193.4:0/274398218 conn(0x7faad405f830 msgr2=0x7faad410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.362+0000 7faad8d96640 1 -- 10.20.193.4:0/274398218 shutdown_connections 2026-02-24T09:09:36.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.362+0000 7faad8d96640 1 -- 10.20.193.4:0/274398218 wait complete. 2026-02-24T09:09:36.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad8d96640 1 Processor -- start 2026-02-24T09:09:36.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad8d96640 1 -- start start 2026-02-24T09:09:36.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad8d96640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faad410f280 0x7faad411dc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad8d96640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faad410fc70 0x7faad411e1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad8d96640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faad4115470 0x7faad4123580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad8d96640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7faad4123ba0 con 0x7faad410fc70 2026-02-24T09:09:36.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad8d96640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7faad4123d10 con 0x7faad4115470 2026-02-24T09:09:36.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad8d96640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7faad4123ed0 con 0x7faad410f280 2026-02-24T09:09:36.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad1d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faad410fc70 0x7faad411e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad1d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faad410fc70 0x7faad411e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59422/0 (socket says 10.20.193.4:59422) 2026-02-24T09:09:36.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad1d74640 1 -- 10.20.193.4:0/1050436680 learned_addr learned my addr 10.20.193.4:0/1050436680 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad2575640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faad410f280 0x7faad411dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad2d76640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faad4115470 0x7faad4123580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad1d74640 1 -- 10.20.193.4:0/1050436680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faad410f280 msgr2=0x7faad411dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad1d74640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faad410f280 0x7faad411dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad1d74640 1 -- 10.20.193.4:0/1050436680 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faad4115470 msgr2=0x7faad4123580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad1d74640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faad4115470 0x7faad4123580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7faad1d74640 1 -- 10.20.193.4:0/1050436680 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac400a590 con 0x7faad410fc70 2026-02-24T09:09:36.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7fe53e476640 1 -- 10.20.193.4:0/1754823086 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe53810fc70 msgr2=0x7fe538114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.363+0000 7fe53e476640 1 --2- 10.20.193.4:0/1754823086 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe53810fc70 0x7fe538114cc0 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=10376923191279019623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe528009950 tx=0x7fe52802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7faad1d74640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faad410fc70 0x7faad411e1b0 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faabc009480 tx=0x7faabc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 -- 10.20.193.4:0/3628574204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c4c0b58b0 msgr2=0x7f4c4c0d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c4c0b58b0 0x7f4c4c0d5d60 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c74102550 tx=0x7f4c5c031040 comp rx=0 tx=0).stop 2026-02-24T09:09:36.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 -- 10.20.193.4:0/3628574204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7410d010 msgr2=0x7f4c7405d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7410d010 0x7f4c7405d660 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c680072a0 tx=0x7f4c6800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7fe53e476640 1 -- 10.20.193.4:0/1754823086 shutdown_connections 2026-02-24T09:09:36.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7fe53e476640 1 --2- 10.20.193.4:0/1754823086 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe538115470 0x7fe538175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7fe53e476640 1 --2- 10.20.193.4:0/1754823086 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe53810fc70 0x7fe538114cc0 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=10376923191279019623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7fe53e476640 1 --2- 10.20.193.4:0/1754823086 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe53810f280 0x7fe53810f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7fe53e476640 1 -- 10.20.193.4:0/1754823086 >> 10.20.193.4:0/1754823086 conn(0x7fe53805f830 msgr2=0x7fe53810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7fe53e476640 1 -- 10.20.193.4:0/1754823086 shutdown_connections 2026-02-24T09:09:36.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7faabb7fe640 1 -- 10.20.193.4:0/1050436680 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faabc00cd40 con 0x7faad410fc70 2026-02-24T09:09:36.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7faad8d96640 1 -- 10.20.193.4:0/1050436680 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac8009570 con 0x7faad410fc70 2026-02-24T09:09:36.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7faabb7fe640 1 -- 10.20.193.4:0/1050436680 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faabc004d30 con 0x7faad410fc70 2026-02-24T09:09:36.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7faabb7fe640 1 -- 10.20.193.4:0/1050436680 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faabc010740 con 0x7faad410fc70 2026-02-24T09:09:36.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7faad8d96640 1 -- 10.20.193.4:0/1050436680 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad4164710 con 0x7faad410fc70 2026-02-24T09:09:36.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7faad8d96640 1 -- 10.20.193.4:0/1050436680 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad4110560 con 0x7faad410fc70 2026-02-24T09:09:36.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 -- 10.20.193.4:0/3628574204 shutdown_connections 2026-02-24T09:09:36.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4c4c0b58b0 0x7f4c4c0d5d60 unknown :-1 s=CLOSED pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c74113200 0x7f4c7405dd30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c7410da00 0x7f4c74173ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 --2- 10.20.193.4:0/3628574204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c7410d010 0x7f4c7405d660 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 -- 10.20.193.4:0/3628574204 >> 10.20.193.4:0/3628574204 conn(0x7f4c7405f830 msgr2=0x7f4c7410b500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 -- 10.20.193.4:0/3628574204 shutdown_connections 2026-02-24T09:09:36.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7f4c78a5f640 1 -- 10.20.193.4:0/3628574204 wait complete. 2026-02-24T09:09:36.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7fe53e476640 1 -- 10.20.193.4:0/1754823086 wait complete. 2026-02-24T09:09:36.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7fe53e476640 1 Processor -- start 2026-02-24T09:09:36.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.364+0000 7fe53e476640 1 -- start start 2026-02-24T09:09:36.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe53e476640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe53810f280 0x7fe53810ae20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe53e476640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe53810fc70 0x7fe538175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe53e476640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe538115470 0x7fe53810b520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe53e476640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe5380f10d0 con 0x7fe53810fc70 2026-02-24T09:09:36.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe53e476640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe5380f1240 con 0x7fe538115470 2026-02-24T09:09:36.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe53e476640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe5380f1400 con 0x7fe53810f280 2026-02-24T09:09:36.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe537fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe53810f280 0x7fe53810ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe537fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe53810f280 0x7fe53810ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:57276/0 (socket says 10.20.193.4:57276) 2026-02-24T09:09:36.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe537fff640 1 -- 10.20.193.4:0/2312873686 learned_addr learned my addr 10.20.193.4:0/2312873686 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:36.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7f44ac421640 1 -- 10.20.193.4:0/4187512397 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f44a4164ef0 con 0x7f44a4067220 2026-02-24T09:09:36.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe53c9ec640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe538115470 0x7fe53810b520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe537fff640 1 -- 10.20.193.4:0/2312873686 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe538115470 msgr2=0x7fe53810b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe537fff640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe538115470 0x7fe53810b520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe537fff640 1 -- 10.20.193.4:0/2312873686 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe53810fc70 msgr2=0x7fe538175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe537fff640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe53810fc70 0x7fe538175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe537fff640 1 -- 10.20.193.4:0/2312873686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe528009570 con 0x7fe53810f280 2026-02-24T09:09:36.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7f448b7fe640 1 -- 10.20.193.4:0/4187512397 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4498005b60 con 0x7f44a4067220 2026-02-24T09:09:36.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe537fff640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe53810f280 0x7fe53810ae20 secure :-1 s=READY pgs=83 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe524005db0 tx=0x7fe52400ddf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe5357fa640 1 -- 10.20.193.4:0/2312873686 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe524004500 con 0x7fe53810f280 2026-02-24T09:09:36.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe5357fa640 1 -- 10.20.193.4:0/2312873686 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe524004d30 con 0x7fe53810f280 2026-02-24T09:09:36.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe53e476640 1 -- 10.20.193.4:0/2312873686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5380f16e0 con 0x7fe53810f280 2026-02-24T09:09:36.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe5357fa640 1 -- 10.20.193.4:0/2312873686 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5240053c0 con 0x7fe53810f280 2026-02-24T09:09:36.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.365+0000 7fe53e476640 1 -- 10.20.193.4:0/2312873686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5380f1bb0 con 0x7fe53810f280 2026-02-24T09:09:36.387 INFO:teuthology.orchestra.run.trial004.stdout:98784247827 2026-02-24T09:09:36.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.366+0000 7fe53e476640 1 -- 10.20.193.4:0/2312873686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe538110560 con 0x7fe53810f280 2026-02-24T09:09:36.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.366+0000 7faabb7fe640 1 -- 10.20.193.4:0/1050436680 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7faabc01f060 con 0x7faad410fc70 2026-02-24T09:09:36.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.367+0000 7faabb7fe640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faaac0b57f0 0x7faaac0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.367+0000 7faabb7fe640 1 -- 10.20.193.4:0/1050436680 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7faabc014070 con 0x7faad410fc70 2026-02-24T09:09:36.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.367+0000 7faad2575640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faaac0b57f0 0x7faaac0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.367+0000 7fe5357fa640 1 -- 10.20.193.4:0/2312873686 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fe524009940 con 0x7fe53810f280 2026-02-24T09:09:36.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.367+0000 7faabb7fe640 1 -- 10.20.193.4:0/1050436680 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7faabc0acab0 con 0x7faad410fc70 2026-02-24T09:09:36.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.367+0000 7faad2575640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faaac0b57f0 0x7faaac0d5ca0 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faac80023d0 tx=0x7faac8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.368+0000 7fe5357fa640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe50c0b57e0 0x7fe50c0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:36.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.368+0000 7fe5357fa640 1 -- 10.20.193.4:0/2312873686 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fe5240e6da0 con 0x7fe53810f280 2026-02-24T09:09:36.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.368+0000 7fe5377fe640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe50c0b57e0 0x7fe50c0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:36.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.368+0000 7fe5377fe640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe50c0b57e0 0x7fe50c0d5c90 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe52802f6e0 tx=0x7fe528005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:36.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 -- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44800b57f0 msgr2=0x7f44800d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44800b57f0 0x7f44800d5ca0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4494005970 tx=0x7f4494005900 comp rx=0 tx=0).stop 2026-02-24T09:09:36.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 -- 10.20.193.4:0/4187512397 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44a4067220 msgr2=0x7f44a41642d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44a4067220 0x7f44a41642d0 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4498002390 tx=0x7f44980028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 -- 10.20.193.4:0/4187512397 shutdown_connections 2026-02-24T09:09:36.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f44800b57f0 0x7f44800d5ca0 unknown :-1 s=CLOSED pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f44a4159a90 0x7f44a41696a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f44a4067220 0x7f44a41642d0 unknown :-1 s=CLOSED pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 --2- 10.20.193.4:0/4187512397 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f44a4063860 0x7f44a4163d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 -- 10.20.193.4:0/4187512397 >> 10.20.193.4:0/4187512397 conn(0x7f44a405f830 msgr2=0x7f44a410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 -- 10.20.193.4:0/4187512397 shutdown_connections 2026-02-24T09:09:36.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.369+0000 7f44ac421640 1 -- 10.20.193.4:0/4187512397 wait complete. 2026-02-24T09:09:36.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.370+0000 7fe5357fa640 1 -- 10.20.193.4:0/2312873686 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe5240a96f0 con 0x7fe53810f280 2026-02-24T09:09:36.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.372+0000 7f749a59c640 1 -- 10.20.193.4:0/752244249 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f749405eb60 con 0x7f749410f280 2026-02-24T09:09:36.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.373+0000 7f74917fa640 1 -- 10.20.193.4:0/752244249 <== mon.2 v2:10.20.193.14:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7480094e60 con 0x7f749410f280 2026-02-24T09:09:36.395 INFO:teuthology.orchestra.run.trial004.stdout:68719476756 2026-02-24T09:09:36.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.376+0000 7f749a59c640 1 -- 10.20.193.4:0/752244249 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b5670 msgr2=0x7f745c0d5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.376+0000 7f749a59c640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b5670 0x7f745c0d5b20 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7494112120 tx=0x7f7484009310 comp rx=0 tx=0).stop 2026-02-24T09:09:36.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.376+0000 7f749a59c640 1 -- 10.20.193.4:0/752244249 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f749410f280 msgr2=0x7f7494115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.376+0000 7f749a59c640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f749410f280 0x7f7494115d10 secure :-1 s=READY pgs=65 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f748000d720 tx=0x7f748000dbf0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.376+0000 7f749a59c640 1 -- 10.20.193.4:0/752244249 shutdown_connections 2026-02-24T09:09:36.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.376+0000 7f749a59c640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b5670 0x7f745c0d5b20 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.376+0000 7f749a59c640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7494115470 0x7f749415ad80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.376+0000 7f749a59c640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f749410fc70 0x7f7494116250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.376+0000 7f749a59c640 1 --2- 10.20.193.4:0/752244249 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f749410f280 0x7f7494115d10 unknown :-1 s=CLOSED pgs=65 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.376+0000 7f749a59c640 1 -- 10.20.193.4:0/752244249 >> 10.20.193.4:0/752244249 conn(0x7f749405f830 msgr2=0x7f749410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.377+0000 7f749a59c640 1 -- 10.20.193.4:0/752244249 shutdown_connections 2026-02-24T09:09:36.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.377+0000 7f749a59c640 1 -- 10.20.193.4:0/752244249 wait complete. 2026-02-24T09:09:36.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.379+0000 7f52783f8640 1 -- 10.20.193.4:0/2054259775 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f527010b6b0 con 0x7f527010b2e0 2026-02-24T09:09:36.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.379+0000 7f52577fe640 1 -- 10.20.193.4:0/2054259775 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f52600026a0 con 0x7f527010b2e0 2026-02-24T09:09:36.398 INFO:teuthology.orchestra.run.trial004.stdout:176093659151 2026-02-24T09:09:36.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.384+0000 7f52783f8640 1 -- 10.20.193.4:0/2054259775 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f524c0b57f0 msgr2=0x7f524c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.384+0000 7f52783f8640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f524c0b57f0 0x7f524c0d5ca0 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5264009480 tx=0x7f5264009410 comp rx=0 tx=0).stop 2026-02-24T09:09:36.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.384+0000 7f52783f8640 1 -- 10.20.193.4:0/2054259775 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f527010b2e0 msgr2=0x7f52700ec7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.384+0000 7f52783f8640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f527010b2e0 0x7f52700ec7a0 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f526000ca60 tx=0x7f526000cf30 comp rx=0 tx=0).stop 2026-02-24T09:09:36.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.385+0000 7f52783f8640 1 -- 10.20.193.4:0/2054259775 shutdown_connections 2026-02-24T09:09:36.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.385+0000 7f52783f8640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f524c0b57f0 0x7f524c0d5ca0 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.385+0000 7f52783f8640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f52701135a0 0x7f52700ecea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.385+0000 7f52783f8640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f527010bcd0 0x7f5270173e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.385+0000 7f52783f8640 1 --2- 10.20.193.4:0/2054259775 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f527010b2e0 0x7f52700ec7a0 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.385+0000 7f52783f8640 1 -- 10.20.193.4:0/2054259775 >> 10.20.193.4:0/2054259775 conn(0x7f52700e8e50 msgr2=0x7f527010cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.385+0000 7f52783f8640 1 -- 10.20.193.4:0/2054259775 shutdown_connections 2026-02-24T09:09:36.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.385+0000 7f52783f8640 1 -- 10.20.193.4:0/2054259775 wait complete. 2026-02-24T09:09:36.400 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:36 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2451609945' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:36.400 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:36 trial004 ceph-mon[41596]: pgmap v142: 97 pgs: 97 active+clean; 627 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 9.6 KiB/s wr, 18 op/s 2026-02-24T09:09:36.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.415+0000 7f77725d5640 1 -- 10.20.193.4:0/535653177 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f776c11cad0 con 0x7f776c113200 2026-02-24T09:09:36.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.416+0000 7f77697fa640 1 -- 10.20.193.4:0/535653177 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f77600aa670 con 0x7f776c113200 2026-02-24T09:09:36.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.416+0000 7fc722ffd640 1 -- 10.20.193.4:0/16712664 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fc704005880 con 0x7fc748115470 2026-02-24T09:09:36.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.416+0000 7fc744ff9640 1 -- 10.20.193.4:0/16712664 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc73c0ad880 con 0x7fc748115470 2026-02-24T09:09:36.420 INFO:teuthology.orchestra.run.trial004.stdout:300647710727 2026-02-24T09:09:36.421 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018898 got 128849018897 for osd.4 2026-02-24T09:09:36.421 INFO:teuthology.orchestra.run.trial004.stdout:270582939655 2026-02-24T09:09:36.423 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247828 got 98784247827 for osd.3 2026-02-24T09:09:36.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 -- 10.20.193.4:0/16712664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc71c0b57f0 msgr2=0x7fc71c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc71c0b57f0 0x7fc71c0d5ca0 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc734004740 tx=0x7fc734005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:36.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 -- 10.20.193.4:0/16712664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc748115470 msgr2=0x7fc748063280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc748115470 0x7fc748063280 secure :-1 s=READY pgs=295 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc73c006e90 tx=0x7fc73c00eeb0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 -- 10.20.193.4:0/16712664 shutdown_connections 2026-02-24T09:09:36.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc71c0b57f0 0x7fc71c0d5ca0 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc748115470 0x7fc748063280 unknown :-1 s=CLOSED pgs=295 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc74810fc70 0x7fc748175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 --2- 10.20.193.4:0/16712664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc74810f280 0x7fc748066fb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 -- 10.20.193.4:0/16712664 >> 10.20.193.4:0/16712664 conn(0x7fc74805f830 msgr2=0x7fc7481133c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 -- 10.20.193.4:0/16712664 shutdown_connections 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.419+0000 7fc722ffd640 1 -- 10.20.193.4:0/16712664 wait complete. 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 -- 10.20.193.4:0/535653177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77400b5870 msgr2=0x7f77400d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77400b5870 0x7f77400d5d20 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77580098a0 tx=0x7f775803a040 comp rx=0 tx=0).stop 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 -- 10.20.193.4:0/535653177 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f776c113200 msgr2=0x7f776c121280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f776c113200 0x7f776c121280 secure :-1 s=READY pgs=294 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7760006e90 tx=0x7f776000eeb0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 -- 10.20.193.4:0/535653177 shutdown_connections 2026-02-24T09:09:36.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77400b5870 0x7f77400d5d20 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f776c113200 0x7f776c121280 unknown :-1 s=CLOSED pgs=294 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f776c10da00 0x7f776c11beb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 --2- 10.20.193.4:0/535653177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f776c10d010 0x7f776c11b970 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 -- 10.20.193.4:0/535653177 >> 10.20.193.4:0/535653177 conn(0x7f776c05f830 msgr2=0x7f776c10ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 -- 10.20.193.4:0/535653177 shutdown_connections 2026-02-24T09:09:36.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f77725d5640 1 -- 10.20.193.4:0/535653177 wait complete. 2026-02-24T09:09:36.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f210b434640 1 -- 10.20.193.4:0/1158458471 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f21040f1990 con 0x7f210410b120 2026-02-24T09:09:36.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.421+0000 7f20f27fc640 1 -- 10.20.193.4:0/1158458471 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f20f40d13e0 con 0x7f210410b120 2026-02-24T09:09:36.425 INFO:teuthology.orchestra.run.trial004.stdout:223338299402 2026-02-24T09:09:36.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 -- 10.20.193.4:0/1158458471 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20e00b5870 msgr2=0x7f20e00d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20e00b5870 0x7f20e00d5d20 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21040f71d0 tx=0x7f20f8005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:36.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 -- 10.20.193.4:0/1158458471 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f210410b120 msgr2=0x7f21040f0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f210410b120 0x7f21040f0830 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20f402f6c0 tx=0x7f20f40043d0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 -- 10.20.193.4:0/1158458471 shutdown_connections 2026-02-24T09:09:36.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f20e00b5870 0x7f20e00d5d20 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21041112f0 0x7f21040f6140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f210410bb10 0x7f21040f0d70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 --2- 10.20.193.4:0/1158458471 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f210410b120 0x7f21040f0830 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 -- 10.20.193.4:0/1158458471 >> 10.20.193.4:0/1158458471 conn(0x7f21040e8e50 msgr2=0x7f210410c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 -- 10.20.193.4:0/1158458471 shutdown_connections 2026-02-24T09:09:36.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.425+0000 7f210b434640 1 -- 10.20.193.4:0/1158458471 wait complete. 2026-02-24T09:09:36.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.431+0000 7f257e64d640 1 -- 10.20.193.4:0/1539287452 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f25780f44b0 con 0x7f257810da00 2026-02-24T09:09:36.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.432+0000 7f25757fa640 1 -- 10.20.193.4:0/1539287452 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2568005b60 con 0x7f257810da00 2026-02-24T09:09:36.435 INFO:teuthology.orchestra.run.trial004.stdout:253403070474 2026-02-24T09:09:36.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.434+0000 7f4db8110640 1 -- 10.20.193.4:0/1332420607 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4db0179160 con 0x7f4db0115470 2026-02-24T09:09:36.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.434+0000 7f4d9effd640 1 -- 10.20.193.4:0/1332420607 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4dac006c40 con 0x7f4db0115470 2026-02-24T09:09:36.438 INFO:teuthology.orchestra.run.trial004.stdout:51539607574 2026-02-24T09:09:36.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 -- 10.20.193.4:0/1539287452 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f254c0b57f0 msgr2=0x7f254c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f254c0b57f0 0x7f254c0d5ca0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2564004720 tx=0x7f2564005f20 comp rx=0 tx=0).stop 2026-02-24T09:09:36.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 -- 10.20.193.4:0/1539287452 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f257810da00 msgr2=0x7f2578173ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f257810da00 0x7f2578173ad0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2568002390 tx=0x7f2568005e20 comp rx=0 tx=0).stop 2026-02-24T09:09:36.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 -- 10.20.193.4:0/1539287452 shutdown_connections 2026-02-24T09:09:36.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f254c0b57f0 0x7f254c0d5ca0 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2578113200 0x7f25780f3a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f257810da00 0x7f2578173ad0 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 --2- 10.20.193.4:0/1539287452 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f257810d010 0x7f25780f3350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 -- 10.20.193.4:0/1539287452 >> 10.20.193.4:0/1539287452 conn(0x7f257805f830 msgr2=0x7f257810f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 -- 10.20.193.4:0/1539287452 shutdown_connections 2026-02-24T09:09:36.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.435+0000 7f257e64d640 1 -- 10.20.193.4:0/1539287452 wait complete. 2026-02-24T09:09:36.440 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.2 2026-02-24T09:09:36.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 -- 10.20.193.4:0/1332420607 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b5940 msgr2=0x7f4d8c0d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b5940 0x7f4d8c0d5df0 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da0004740 tx=0x7f4da0005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 -- 10.20.193.4:0/1332420607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db0115470 msgr2=0x7f4db01234a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db0115470 0x7f4db01234a0 secure :-1 s=READY pgs=81 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac005820 tx=0x7f4dac030d70 comp rx=0 tx=0).stop 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 -- 10.20.193.4:0/1332420607 shutdown_connections 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b5940 0x7f4d8c0d5df0 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db0115470 0x7f4db01234a0 unknown :-1 s=CLOSED pgs=81 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db010fc70 0x7f4db011e0d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 --2- 10.20.193.4:0/1332420607 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db010f280 0x7f4db011db90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 -- 10.20.193.4:0/1332420607 >> 10.20.193.4:0/1332420607 conn(0x7f4db005f830 msgr2=0x7f4db010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 -- 10.20.193.4:0/1332420607 shutdown_connections 2026-02-24T09:09:36.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.438+0000 7f4db8110640 1 -- 10.20.193.4:0/1332420607 wait complete. 2026-02-24T09:09:36.444 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659152 got 176093659151 for osd.6 2026-02-24T09:09:36.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.454+0000 7faacd7fa640 1 -- 10.20.193.4:0/697624141 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7faab0005880 con 0x7faae810da00 2026-02-24T09:09:36.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.455+0000 7faacf7fe640 1 -- 10.20.193.4:0/697624141 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faad00acd30 con 0x7faae810da00 2026-02-24T09:09:36.458 INFO:teuthology.orchestra.run.trial004.stdout:193273528333 2026-02-24T09:09:36.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 -- 10.20.193.4:0/697624141 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faac00b57f0 msgr2=0x7faac00d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faac00b57f0 0x7faac00d5ca0 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faadc0098a0 tx=0x7faadc031040 comp rx=0 tx=0).stop 2026-02-24T09:09:36.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 -- 10.20.193.4:0/697624141 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faae810da00 msgr2=0x7faae80614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faae810da00 0x7faae80614d0 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faad000d950 tx=0x7faad000de20 comp rx=0 tx=0).stop 2026-02-24T09:09:36.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 -- 10.20.193.4:0/697624141 shutdown_connections 2026-02-24T09:09:36.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faac00b57f0 0x7faac00d5ca0 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faae8113200 0x7faae8061a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faae810da00 0x7faae80614d0 unknown :-1 s=CLOSED pgs=299 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 --2- 10.20.193.4:0/697624141 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faae810d010 0x7faae8060f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 -- 10.20.193.4:0/697624141 >> 10.20.193.4:0/697624141 conn(0x7faae805f830 msgr2=0x7faae810ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 -- 10.20.193.4:0/697624141 shutdown_connections 2026-02-24T09:09:36.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.458+0000 7faacd7fa640 1 -- 10.20.193.4:0/697624141 wait complete. 2026-02-24T09:09:36.472 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939656 got 270582939655 for osd.10 2026-02-24T09:09:36.475 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710729 got 300647710727 for osd.11 2026-02-24T09:09:36.486 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299403 got 223338299402 for osd.8 2026-02-24T09:09:36.487 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070475 got 253403070474 for osd.9 2026-02-24T09:09:36.491 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607575 got 51539607574 for osd.1 2026-02-24T09:09:36.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.496+0000 7faad8d96640 1 -- 10.20.193.4:0/1050436680 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faad411edd0 con 0x7faad410fc70 2026-02-24T09:09:36.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.496+0000 7faabb7fe640 1 -- 10.20.193.4:0/1050436680 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faabc0acc90 con 0x7faad410fc70 2026-02-24T09:09:36.501 INFO:teuthology.orchestra.run.trial004.stdout:34359738392 2026-02-24T09:09:36.503 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528334 got 193273528333 for osd.7 2026-02-24T09:09:36.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 -- 10.20.193.4:0/1050436680 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faaac0b57f0 msgr2=0x7faaac0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faaac0b57f0 0x7faaac0d5ca0 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faac80023d0 tx=0x7faac8031040 comp rx=0 tx=0).stop 2026-02-24T09:09:36.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 -- 10.20.193.4:0/1050436680 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faad410fc70 msgr2=0x7faad411e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faad410fc70 0x7faad411e1b0 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faabc009480 tx=0x7faabc00ee60 comp rx=0 tx=0).stop 2026-02-24T09:09:36.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 -- 10.20.193.4:0/1050436680 shutdown_connections 2026-02-24T09:09:36.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faaac0b57f0 0x7faaac0d5ca0 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faad4115470 0x7faad4123580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faad410fc70 0x7faad411e1b0 unknown :-1 s=CLOSED pgs=301 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 --2- 10.20.193.4:0/1050436680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faad410f280 0x7faad411dc70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 -- 10.20.193.4:0/1050436680 >> 10.20.193.4:0/1050436680 conn(0x7faad405f830 msgr2=0x7faad410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 -- 10.20.193.4:0/1050436680 shutdown_connections 2026-02-24T09:09:36.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7faad8d96640 1 -- 10.20.193.4:0/1050436680 wait complete. 2026-02-24T09:09:36.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.499+0000 7fe53e476640 1 -- 10.20.193.4:0/2312873686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe5380f1dd0 con 0x7fe53810f280 2026-02-24T09:09:36.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.500+0000 7fe5357fa640 1 -- 10.20.193.4:0/2312873686 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe524005550 con 0x7fe53810f280 2026-02-24T09:09:36.508 INFO:teuthology.orchestra.run.trial004.stdout:146028888079 2026-02-24T09:09:36.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 -- 10.20.193.4:0/2312873686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe50c0b57e0 msgr2=0x7fe50c0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe50c0b57e0 0x7fe50c0d5c90 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe52802f6e0 tx=0x7fe528005e70 comp rx=0 tx=0).stop 2026-02-24T09:09:36.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 -- 10.20.193.4:0/2312873686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe53810f280 msgr2=0x7fe53810ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:36.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe53810f280 0x7fe53810ae20 secure :-1 s=READY pgs=83 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe524005db0 tx=0x7fe52400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 -- 10.20.193.4:0/2312873686 shutdown_connections 2026-02-24T09:09:36.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe50c0b57e0 0x7fe50c0d5c90 unknown :-1 s=CLOSED pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe538115470 0x7fe53810b520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe53810fc70 0x7fe538175d40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 --2- 10.20.193.4:0/2312873686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe53810f280 0x7fe53810ae20 unknown :-1 s=CLOSED pgs=83 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:36.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 -- 10.20.193.4:0/2312873686 >> 10.20.193.4:0/2312873686 conn(0x7fe53805f830 msgr2=0x7fe538111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:36.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 -- 10.20.193.4:0/2312873686 shutdown_connections 2026-02-24T09:09:36.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:36.502+0000 7fe53e476640 1 -- 10.20.193.4:0/2312873686 wait complete. 2026-02-24T09:09:36.541 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738393 got 34359738392 for osd.0 2026-02-24T09:09:36.544 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888080 got 146028888079 for osd.5 2026-02-24T09:09:36.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:36 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2451609945' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:36.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:36 trial090 ceph-mon[47278]: pgmap v142: 97 pgs: 97 active+clean; 627 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 9.6 KiB/s wr, 18 op/s 2026-02-24T09:09:36.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:36 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2451609945' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:36.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:36 trial014 ceph-mon[46941]: pgmap v142: 97 pgs: 97 active+clean; 627 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 9.6 KiB/s wr, 18 op/s 2026-02-24T09:09:37.422 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-24T09:09:37.424 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T09:09:37.441 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T09:09:37.446 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-24T09:09:37.473 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-24T09:09:37.477 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-24T09:09:37.487 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-24T09:09:37.488 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-24T09:09:37.491 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T09:09:37.504 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-24T09:09:37.542 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T09:09:37.543 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.544 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.545 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-24T09:09:37.567 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3628574204' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:09:37.567 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4187512397' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:09:37.567 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/752244249' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:09:37.567 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2054259775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:09:37.567 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/535653177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:09:37.567 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/16712664' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:09:37.568 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1158458471' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:09:37.568 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1539287452' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:09:37.568 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1332420607' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:09:37.568 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/697624141' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:09:37.568 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1050436680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:09:37.568 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:37 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2312873686' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3628574204' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4187512397' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/752244249' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2054259775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/535653177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/16712664' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1158458471' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1539287452' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1332420607' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/697624141' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:09:37.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1050436680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:09:37.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:37 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2312873686' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:09:37.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3628574204' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:09:37.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4187512397' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:09:37.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/752244249' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:09:37.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2054259775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:09:37.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/535653177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:09:37.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/16712664' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:09:37.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1158458471' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:09:37.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1539287452' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:09:37.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1332420607' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:09:37.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/697624141' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:09:37.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1050436680' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:09:37.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:37 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2312873686' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:09:37.595 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.599 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.645 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.647 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.648 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.649 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.651 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.651 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.670+0000 7fe422cd8640 1 -- 10.20.193.4:0/2487468762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe41c115470 msgr2=0x7fe41c175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.670+0000 7fe422cd8640 1 --2- 10.20.193.4:0/2487468762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe41c115470 0x7fe41c175e40 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=4329704608075698613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe41800aa30 tx=0x7fe418030270 comp rx=0 tx=0).stop 2026-02-24T09:09:37.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.670+0000 7fe422cd8640 1 -- 10.20.193.4:0/2487468762 shutdown_connections 2026-02-24T09:09:37.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.670+0000 7fe422cd8640 1 --2- 10.20.193.4:0/2487468762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe41c115470 0x7fe41c175e40 unknown :-1 s=CLOSED pgs=67 gs=1 cs=0 l=1 c_cookie=4329704608075698613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.670+0000 7fe422cd8640 1 --2- 10.20.193.4:0/2487468762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe41c10fc70 0x7fe41c114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.670+0000 7fe422cd8640 1 --2- 10.20.193.4:0/2487468762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe41c10f280 0x7fe41c10f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.670+0000 7fe422cd8640 1 -- 10.20.193.4:0/2487468762 >> 10.20.193.4:0/2487468762 conn(0x7fe41c05f830 msgr2=0x7fe41c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.670+0000 7fe422cd8640 1 -- 10.20.193.4:0/2487468762 shutdown_connections 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.670+0000 7fe422cd8640 1 -- 10.20.193.4:0/2487468762 wait complete. 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe422cd8640 1 Processor -- start 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe422cd8640 1 -- start start 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe422cd8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe41c10f280 0x7fe41c0fe4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe422cd8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe41c10fc70 0x7fe41c175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe422cd8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe41c115470 0x7fe41c0febf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe422cd8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c1037c0 con 0x7fe41c10fc70 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe422cd8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c103930 con 0x7fe41c115470 2026-02-24T09:09:37.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe422cd8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c103af0 con 0x7fe41c10f280 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe413fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe41c10fc70 0x7fe41c175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe413fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe41c10fc70 0x7fe41c175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59454/0 (socket says 10.20.193.4:59454) 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe413fff640 1 -- 10.20.193.4:0/106154156 learned_addr learned my addr 10.20.193.4:0/106154156 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe420a4d640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe41c10f280 0x7fe41c0fe4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.671+0000 7fe42124e640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe41c115470 0x7fe41c0febf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe413fff640 1 -- 10.20.193.4:0/106154156 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe41c10f280 msgr2=0x7fe41c0fe4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe413fff640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe41c10f280 0x7fe41c0fe4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe413fff640 1 -- 10.20.193.4:0/106154156 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe41c115470 msgr2=0x7fe41c0febf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe413fff640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe41c115470 0x7fe41c0febf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe413fff640 1 -- 10.20.193.4:0/106154156 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c0094b0 con 0x7fe41c10fc70 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe413fff640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe41c10fc70 0x7fe41c175d40 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe404009480 tx=0x7fe40400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe411ffb640 1 -- 10.20.193.4:0/106154156 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe40400ccc0 con 0x7fe41c10fc70 2026-02-24T09:09:37.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe411ffb640 1 -- 10.20.193.4:0/106154156 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe40400ce20 con 0x7fe41c10fc70 2026-02-24T09:09:37.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe422cd8640 1 -- 10.20.193.4:0/106154156 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41800a650 con 0x7fe41c10fc70 2026-02-24T09:09:37.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe411ffb640 1 -- 10.20.193.4:0/106154156 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4040106b0 con 0x7fe41c10fc70 2026-02-24T09:09:37.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7fe422cd8640 1 -- 10.20.193.4:0/106154156 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe41c104110 con 0x7fe41c10fc70 2026-02-24T09:09:37.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7f2e907a0640 1 -- 10.20.193.4:0/2923693280 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e8810f650 msgr2=0x7f2e8810fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7f2e907a0640 1 --2- 10.20.193.4:0/2923693280 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e8810f650 0x7f2e8810fa20 secure :-1 s=READY pgs=84 gs=3 cs=0 l=1 c_cookie=17984818581681610600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e78009980 tx=0x7f2e7802f180 comp rx=0 tx=0).stop 2026-02-24T09:09:37.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7f2e907a0640 1 -- 10.20.193.4:0/2923693280 shutdown_connections 2026-02-24T09:09:37.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7f2e907a0640 1 --2- 10.20.193.4:0/2923693280 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e88112290 0x7f2e88175e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7f2e907a0640 1 --2- 10.20.193.4:0/2923693280 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e88110040 0x7f2e88111ab0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7f2e907a0640 1 --2- 10.20.193.4:0/2923693280 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e8810f650 0x7f2e8810fa20 unknown :-1 s=CLOSED pgs=84 gs=3 cs=0 l=1 c_cookie=17984818581681610600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7f2e907a0640 1 -- 10.20.193.4:0/2923693280 >> 10.20.193.4:0/2923693280 conn(0x7f2e880648b0 msgr2=0x7f2e88064cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.672+0000 7f2e907a0640 1 -- 10.20.193.4:0/2923693280 shutdown_connections 2026-02-24T09:09:37.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.673+0000 7f2e907a0640 1 -- 10.20.193.4:0/2923693280 wait complete. 2026-02-24T09:09:37.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.673+0000 7f2e907a0640 1 Processor -- start 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.673+0000 7f2e907a0640 1 -- start start 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.673+0000 7f2e907a0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e8810f650 0x7f2e8805e520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.673+0000 7f2e907a0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e88110040 0x7f2e88175d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.673+0000 7f2e907a0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e88112290 0x7f2e8805b7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.673+0000 7f2e907a0640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8805bf30 con 0x7f2e88110040 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.673+0000 7f2e907a0640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8805c0a0 con 0x7f2e88112290 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.673+0000 7f2e907a0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8805c260 con 0x7f2e8810f650 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8e515640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e8810f650 0x7f2e8805e520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8e515640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e8810f650 0x7f2e8805e520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:57314/0 (socket says 10.20.193.4:57314) 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8e515640 1 -- 10.20.193.4:0/1169554480 learned_addr learned my addr 10.20.193.4:0/1169554480 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8ed16640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e88112290 0x7f2e8805b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8dd14640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e88110040 0x7f2e88175d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.684 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8e515640 1 -- 10.20.193.4:0/1169554480 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e88112290 msgr2=0x7f2e8805b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.684 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.673+0000 7fe3eb7fe640 1 -- 10.20.193.4:0/106154156 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3dc005300 con 0x7fe41c10fc70 2026-02-24T09:09:37.684 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7fe411ffb640 1 -- 10.20.193.4:0/106154156 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fe40401f060 con 0x7fe41c10fc70 2026-02-24T09:09:37.685 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8e515640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e88112290 0x7f2e8805b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.685 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8e515640 1 -- 10.20.193.4:0/1169554480 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e88110040 msgr2=0x7f2e88175d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.685 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8e515640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e88110040 0x7f2e88175d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.685 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8e515640 1 -- 10.20.193.4:0/1169554480 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e78009570 con 0x7f2e8810f650 2026-02-24T09:09:37.685 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e8e515640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e8810f650 0x7f2e8805e520 secure :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e780028d0 tx=0x7f2e78002900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.686 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e6f7fe640 1 -- 10.20.193.4:0/1169554480 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e7803d070 con 0x7f2e8810f650 2026-02-24T09:09:37.686 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e6f7fe640 1 -- 10.20.193.4:0/1169554480 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2e780043d0 con 0x7f2e8810f650 2026-02-24T09:09:37.686 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e6f7fe640 1 -- 10.20.193.4:0/1169554480 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e78041820 con 0x7f2e8810f650 2026-02-24T09:09:37.686 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.674+0000 7f2e907a0640 1 -- 10.20.193.4:0/1169554480 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8805c480 con 0x7f2e8810f650 2026-02-24T09:09:37.686 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.675+0000 7f2e907a0640 1 -- 10.20.193.4:0/1169554480 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8817afb0 con 0x7f2e8810f650 2026-02-24T09:09:37.687 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.675+0000 7fe411ffb640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3f80b57e0 0x7fe3f80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.687 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.675+0000 7fe420a4d640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3f80b57e0 0x7fe3f80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.687 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.675+0000 7fe411ffb640 1 -- 10.20.193.4:0/106154156 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fe404014070 con 0x7fe41c10fc70 2026-02-24T09:09:37.687 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.675+0000 7fe420a4d640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3f80b57e0 0x7fe3f80d5c90 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe40c004740 tx=0x7fe40c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.675+0000 7f2e907a0640 1 -- 10.20.193.4:0/1169554480 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8805c610 con 0x7f2e8810f650 2026-02-24T09:09:37.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.676+0000 7f2e6f7fe640 1 -- 10.20.193.4:0/1169554480 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f2e78041980 con 0x7f2e8810f650 2026-02-24T09:09:37.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.676+0000 7fe411ffb640 1 -- 10.20.193.4:0/106154156 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe4040a97b0 con 0x7fe41c10fc70 2026-02-24T09:09:37.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.676+0000 7f2e6f7fe640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e640b5670 0x7f2e640d5b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.677+0000 7f2e6f7fe640 1 -- 10.20.193.4:0/1169554480 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f2e7810afc0 con 0x7f2e8810f650 2026-02-24T09:09:37.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.677+0000 7f2e8dd14640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e640b5670 0x7f2e640d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.677+0000 7f2e8dd14640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e640b5670 0x7f2e640d5b20 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e8805e2a0 tx=0x7f2e7c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.678+0000 7f2e6f7fe640 1 -- 10.20.193.4:0/1169554480 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f2e8805c610 con 0x7f2e8810f650 2026-02-24T09:09:37.690 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.690 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:37.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.716+0000 7f70398bf640 1 -- 10.20.193.4:0/1477635494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7034115470 msgr2=0x7f7034175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.716+0000 7f70398bf640 1 --2- 10.20.193.4:0/1477635494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7034115470 0x7f7034175e40 secure :-1 s=READY pgs=303 gs=3 cs=0 l=1 c_cookie=12956245245304202160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f702400aa30 tx=0x7f7024030290 comp rx=0 tx=0).stop 2026-02-24T09:09:37.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.716+0000 7f70398bf640 1 -- 10.20.193.4:0/1477635494 shutdown_connections 2026-02-24T09:09:37.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.716+0000 7f70398bf640 1 --2- 10.20.193.4:0/1477635494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7034115470 0x7f7034175e40 unknown :-1 s=CLOSED pgs=303 gs=3 cs=0 l=1 c_cookie=12956245245304202160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.716+0000 7f70398bf640 1 --2- 10.20.193.4:0/1477635494 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f703410fc70 0x7f7034114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.716+0000 7f70398bf640 1 --2- 10.20.193.4:0/1477635494 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f703410f280 0x7f703410f650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.716+0000 7f70398bf640 1 -- 10.20.193.4:0/1477635494 >> 10.20.193.4:0/1477635494 conn(0x7f703405f830 msgr2=0x7f703410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.716+0000 7f70398bf640 1 -- 10.20.193.4:0/1477635494 shutdown_connections 2026-02-24T09:09:37.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.716+0000 7f70398bf640 1 -- 10.20.193.4:0/1477635494 wait complete. 2026-02-24T09:09:37.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.717+0000 7f70398bf640 1 Processor -- start 2026-02-24T09:09:37.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.717+0000 7f70398bf640 1 -- start start 2026-02-24T09:09:37.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.717+0000 7f70398bf640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f703410f280 0x7f70340f5510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70398bf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f703410fc70 0x7f7034175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70398bf640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7034115470 0x7f70340f5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70398bf640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f70340fae20 con 0x7f703410fc70 2026-02-24T09:09:37.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70398bf640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f70340faf90 con 0x7f703410f280 2026-02-24T09:09:37.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70398bf640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f70340fb150 con 0x7f7034115470 2026-02-24T09:09:37.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f7032ffd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f703410f280 0x7f70340f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70327fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f703410fc70 0x7f7034175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70327fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f703410fc70 0x7f7034175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59482/0 (socket says 10.20.193.4:59482) 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70327fc640 1 -- 10.20.193.4:0/41825351 learned_addr learned my addr 10.20.193.4:0/41825351 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70337fe640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7034115470 0x7f70340f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70327fc640 1 -- 10.20.193.4:0/41825351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7034115470 msgr2=0x7f70340f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70327fc640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7034115470 0x7f70340f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70327fc640 1 -- 10.20.193.4:0/41825351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f703410f280 msgr2=0x7f70340f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70327fc640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f703410f280 0x7f70340f5510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70327fc640 1 -- 10.20.193.4:0/41825351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702400a650 con 0x7f703410fc70 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70327fc640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f703410fc70 0x7f7034175d40 secure :-1 s=READY pgs=304 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f701c00b500 tx=0x7f701c00b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70388bd640 1 -- 10.20.193.4:0/41825351 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f701c004560 con 0x7f703410fc70 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70398bf640 1 -- 10.20.193.4:0/41825351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70340fb430 con 0x7f703410fc70 2026-02-24T09:09:37.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70388bd640 1 -- 10.20.193.4:0/41825351 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f701c002b80 con 0x7f703410fc70 2026-02-24T09:09:37.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70388bd640 1 -- 10.20.193.4:0/41825351 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f701c00fd60 con 0x7f703410fc70 2026-02-24T09:09:37.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.718+0000 7f70398bf640 1 -- 10.20.193.4:0/41825351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70340fb9d0 con 0x7f703410fc70 2026-02-24T09:09:37.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.719+0000 7f70398bf640 1 -- 10.20.193.4:0/41825351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70340fbc50 con 0x7f703410fc70 2026-02-24T09:09:37.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.720+0000 7f70388bd640 1 -- 10.20.193.4:0/41825351 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f701c002cf0 con 0x7f703410fc70 2026-02-24T09:09:37.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.721+0000 7f70388bd640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70080b57e0 0x7f70080d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.721+0000 7f70388bd640 1 -- 10.20.193.4:0/41825351 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f701c0e66c0 con 0x7f703410fc70 2026-02-24T09:09:37.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.721+0000 7f7032ffd640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70080b57e0 0x7f70080d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.721+0000 7f7032ffd640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70080b57e0 0x7f70080d5c90 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7028005970 tx=0x7f7028005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.721+0000 7f70388bd640 1 -- 10.20.193.4:0/41825351 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f701c0a9120 con 0x7f703410fc70 2026-02-24T09:09:37.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.722+0000 7fbadded8640 1 -- 10.20.193.4:0/3637595464 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbad8113630 msgr2=0x7fbad8174000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.722+0000 7fbadded8640 1 --2- 10.20.193.4:0/3637595464 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbad8113630 0x7fbad8174000 secure :-1 s=READY pgs=305 gs=2 cs=0 l=1 c_cookie=2932993431201332618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbacc00aa30 tx=0x7fbacc030270 comp rx=0 tx=0).stop 2026-02-24T09:09:37.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.722+0000 7fbadded8640 1 -- 10.20.193.4:0/3637595464 shutdown_connections 2026-02-24T09:09:37.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.722+0000 7fbadded8640 1 --2- 10.20.193.4:0/3637595464 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbad8113630 0x7fbad8174000 unknown :-1 s=CLOSED pgs=305 gs=2 cs=0 l=1 c_cookie=2932993431201332618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.722+0000 7fbadded8640 1 --2- 10.20.193.4:0/3637595464 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbad810c1d0 0x7fbad8112e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.722+0000 7fbadded8640 1 --2- 10.20.193.4:0/3637595464 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbad810b7e0 0x7fbad810bbb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.722+0000 7fbadded8640 1 -- 10.20.193.4:0/3637595464 >> 10.20.193.4:0/3637595464 conn(0x7fbad80e9370 msgr2=0x7fbad8109780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.722+0000 7fbadded8640 1 -- 10.20.193.4:0/3637595464 shutdown_connections 2026-02-24T09:09:37.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.722+0000 7fbadded8640 1 -- 10.20.193.4:0/3637595464 wait complete. 2026-02-24T09:09:37.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbadded8640 1 Processor -- start 2026-02-24T09:09:37.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbadded8640 1 -- start start 2026-02-24T09:09:37.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbadded8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbad810b7e0 0x7fbad81143e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbadded8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbad810c1d0 0x7fbad8114920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbadded8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbad8113630 0x7fbad8116950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbadded8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbad8116f70 con 0x7fbad810c1d0 2026-02-24T09:09:37.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbadded8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbad81170e0 con 0x7fbad8113630 2026-02-24T09:09:37.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbadded8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbad81172a0 con 0x7fbad810b7e0 2026-02-24T09:09:37.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbad7fff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbad8113630 0x7fbad8116950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbad7fff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbad8113630 0x7fbad8116950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:53190/0 (socket says 10.20.193.4:53190) 2026-02-24T09:09:37.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbad7fff640 1 -- 10.20.193.4:0/3272008157 learned_addr learned my addr 10.20.193.4:0/3272008157 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbad6ffd640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbad810c1d0 0x7fbad8114920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.723+0000 7fbad7fff640 1 -- 10.20.193.4:0/3272008157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbad810b7e0 msgr2=0x7fbad81143e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T09:09:37.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbad7fff640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbad810b7e0 0x7fbad81143e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbad7fff640 1 -- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbad810c1d0 msgr2=0x7fbad8114920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbad7fff640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbad810c1d0 0x7fbad8114920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbad7fff640 1 -- 10.20.193.4:0/3272008157 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc00a650 con 0x7fbad8113630 2026-02-24T09:09:37.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbad6ffd640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbad810c1d0 0x7fbad8114920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:37.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbad7fff640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbad8113630 0x7fbad8116950 secure :-1 s=READY pgs=68 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbacc006a50 tx=0x7fbacc0039b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbad4ff9640 1 -- 10.20.193.4:0/3272008157 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbacc03e070 con 0x7fbad8113630 2026-02-24T09:09:37.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbadded8640 1 -- 10.20.193.4:0/3272008157 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad8117520 con 0x7fbad8113630 2026-02-24T09:09:37.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbadded8640 1 -- 10.20.193.4:0/3272008157 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad815aec0 con 0x7fbad8113630 2026-02-24T09:09:37.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbad4ff9640 1 -- 10.20.193.4:0/3272008157 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbacc0055a0 con 0x7fbad8113630 2026-02-24T09:09:37.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.724+0000 7fbad4ff9640 1 -- 10.20.193.4:0/3272008157 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbacc042940 con 0x7fbad8113630 2026-02-24T09:09:37.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.725+0000 7fbadded8640 1 -- 10.20.193.4:0/3272008157 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad805fab0 con 0x7fbad8113630 2026-02-24T09:09:37.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.726+0000 7fbad4ff9640 1 -- 10.20.193.4:0/3272008157 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fbacc042ad0 con 0x7fbad8113630 2026-02-24T09:09:37.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.727+0000 7fbad4ff9640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbaac0b5870 0x7fbaac0d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.727+0000 7fbad4ff9640 1 -- 10.20.193.4:0/3272008157 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fbacc10c620 con 0x7fbad8113630 2026-02-24T09:09:37.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.727+0000 7fbad77fe640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbaac0b5870 0x7fbaac0d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.727+0000 7fbad77fe640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbaac0b5870 0x7fbaac0d5d20 secure :-1 s=READY pgs=213 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbac4004740 tx=0x7fbac400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.728+0000 7fbad4ff9640 1 -- 10.20.193.4:0/3272008157 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbacc0cf080 con 0x7fbad8113630 2026-02-24T09:09:37.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.772+0000 7f72743ed640 1 -- 10.20.193.4:0/22620657 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f726c10c450 msgr2=0x7f726c1114a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.772+0000 7f72743ed640 1 --2- 10.20.193.4:0/22620657 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f726c10c450 0x7f726c1114a0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=8526704603892682527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f726000aaa0 tx=0x7f7260030590 comp rx=0 tx=0).stop 2026-02-24T09:09:37.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.772+0000 7f72743ed640 1 -- 10.20.193.4:0/22620657 shutdown_connections 2026-02-24T09:09:37.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.772+0000 7f72743ed640 1 --2- 10.20.193.4:0/22620657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f726c111c50 0x7f726c172620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.772+0000 7f72743ed640 1 --2- 10.20.193.4:0/22620657 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f726c10c450 0x7f726c1114a0 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=8526704603892682527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.772+0000 7f72743ed640 1 --2- 10.20.193.4:0/22620657 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f726c10ba60 0x7f726c10be30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.772+0000 7f72743ed640 1 -- 10.20.193.4:0/22620657 >> 10.20.193.4:0/22620657 conn(0x7f726c0e9370 msgr2=0x7f726c109780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.772+0000 7f72743ed640 1 -- 10.20.193.4:0/22620657 shutdown_connections 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.772+0000 7f72743ed640 1 -- 10.20.193.4:0/22620657 wait complete. 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f72743ed640 1 Processor -- start 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f72743ed640 1 -- start start 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f72743ed640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f726c10ba60 0x7f726c0e9860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f72743ed640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f726c10c450 0x7f726c172520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f72743ed640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f726c111c50 0x7f726c0e9da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f72743ed640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f726c0ea2e0 con 0x7f726c10c450 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f72743ed640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f726c0ea450 con 0x7f726c10ba60 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f72743ed640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f726c0ea610 con 0x7f726c111c50 2026-02-24T09:09:37.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f7271961640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f726c10c450 0x7f726c172520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f7271961640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f726c10c450 0x7f726c172520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59532/0 (socket says 10.20.193.4:59532) 2026-02-24T09:09:37.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f7271961640 1 -- 10.20.193.4:0/43594863 learned_addr learned my addr 10.20.193.4:0/43594863 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f7272162640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f726c10ba60 0x7f726c0e9860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f7272963640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f726c111c50 0x7f726c0e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f401c954640 1 -- 10.20.193.4:0/2647313123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f401410c8a0 msgr2=0x7f40141118f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f401c954640 1 --2- 10.20.193.4:0/2647313123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f401410c8a0 0x7f40141118f0 secure :-1 s=READY pgs=306 gs=2 cs=0 l=1 c_cookie=14058944548930848102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40000099a0 tx=0x7f400002f1f0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f401c954640 1 -- 10.20.193.4:0/2647313123 shutdown_connections 2026-02-24T09:09:37.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f401c954640 1 --2- 10.20.193.4:0/2647313123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f40141120a0 0x7f4014172a70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f401c954640 1 --2- 10.20.193.4:0/2647313123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f401410c8a0 0x7f40141118f0 unknown :-1 s=CLOSED pgs=306 gs=2 cs=0 l=1 c_cookie=14058944548930848102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f401c954640 1 --2- 10.20.193.4:0/2647313123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f401410beb0 0x7f401410c280 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f401c954640 1 -- 10.20.193.4:0/2647313123 >> 10.20.193.4:0/2647313123 conn(0x7f40140e97e0 msgr2=0x7f4014109bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f401c954640 1 -- 10.20.193.4:0/2647313123 shutdown_connections 2026-02-24T09:09:37.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f401c954640 1 -- 10.20.193.4:0/2647313123 wait complete. 2026-02-24T09:09:37.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f7272162640 1 -- 10.20.193.4:0/43594863 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f726c111c50 msgr2=0x7f726c0e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f7272162640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f726c111c50 0x7f726c0e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f7272162640 1 -- 10.20.193.4:0/43594863 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f726c10c450 msgr2=0x7f726c172520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f7272162640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f726c10c450 0x7f726c172520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.773+0000 7f7272162640 1 -- 10.20.193.4:0/43594863 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726800a590 con 0x7f726c10ba60 2026-02-24T09:09:37.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f7272162640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f726c10ba60 0x7f726c0e9860 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f725c00e9c0 tx=0x7f725c00ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f72537fe640 1 -- 10.20.193.4:0/43594863 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f725c00ccb0 con 0x7f726c10ba60 2026-02-24T09:09:37.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401c954640 1 Processor -- start 2026-02-24T09:09:37.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f72537fe640 1 -- 10.20.193.4:0/43594863 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f725c00ce10 con 0x7f726c10ba60 2026-02-24T09:09:37.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401c954640 1 -- start start 2026-02-24T09:09:37.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f72743ed640 1 -- 10.20.193.4:0/43594863 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726000a6c0 con 0x7f726c10ba60 2026-02-24T09:09:37.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f72537fe640 1 -- 10.20.193.4:0/43594863 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f725c0106b0 con 0x7f726c10ba60 2026-02-24T09:09:37.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f72743ed640 1 -- 10.20.193.4:0/43594863 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c0fc610 con 0x7f726c10ba60 2026-02-24T09:09:37.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401c954640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f401410beb0 0x7f401411ed50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401c954640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f401410c8a0 0x7f401411f290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401c954640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40141120a0 0x7f4014124660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401c954640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4014124c80 con 0x7f40141120a0 2026-02-24T09:09:37.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401c954640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4014124df0 con 0x7f401410c8a0 2026-02-24T09:09:37.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401c954640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4014124fb0 con 0x7f401410beb0 2026-02-24T09:09:37.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401aeca640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40141120a0 0x7f4014124660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401aeca640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40141120a0 0x7f4014124660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59544/0 (socket says 10.20.193.4:59544) 2026-02-24T09:09:37.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401aeca640 1 -- 10.20.193.4:0/808144221 learned_addr learned my addr 10.20.193.4:0/808144221 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401a6c9640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f401410beb0 0x7f401411ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f4019ec8640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f401410c8a0 0x7f401411f290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401aeca640 1 -- 10.20.193.4:0/808144221 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f401410beb0 msgr2=0x7f401411ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401aeca640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f401410beb0 0x7f401411ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401aeca640 1 -- 10.20.193.4:0/808144221 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f401410c8a0 msgr2=0x7f401411f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401aeca640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f401410c8a0 0x7f401411f290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401aeca640 1 -- 10.20.193.4:0/808144221 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4000009570 con 0x7f40141120a0 2026-02-24T09:09:37.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.774+0000 7f401aeca640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40141120a0 0x7f4014124660 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4008006e90 tx=0x7f400800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.775+0000 7f3fff7fe640 1 -- 10.20.193.4:0/808144221 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4008005500 con 0x7f40141120a0 2026-02-24T09:09:37.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.775+0000 7f3fff7fe640 1 -- 10.20.193.4:0/808144221 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4008005e10 con 0x7f40141120a0 2026-02-24T09:09:37.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.775+0000 7f3fff7fe640 1 -- 10.20.193.4:0/808144221 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4008003a90 con 0x7f40141120a0 2026-02-24T09:09:37.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.775+0000 7f401c954640 1 -- 10.20.193.4:0/808144221 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4014125290 con 0x7f40141120a0 2026-02-24T09:09:37.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.775+0000 7f401c954640 1 -- 10.20.193.4:0/808144221 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4014165990 con 0x7f40141120a0 2026-02-24T09:09:37.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.775+0000 7f72743ed640 1 -- 10.20.193.4:0/43594863 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c10cd40 con 0x7f726c10ba60 2026-02-24T09:09:37.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.775+0000 7f401c954640 1 -- 10.20.193.4:0/808144221 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40141254b0 con 0x7f40141120a0 2026-02-24T09:09:37.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.776+0000 7f72537fe640 1 -- 10.20.193.4:0/43594863 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f725c01f060 con 0x7f726c10ba60 2026-02-24T09:09:37.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.776+0000 7f72537fe640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72480b57e0 0x7f72480d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.776+0000 7f72537fe640 1 -- 10.20.193.4:0/43594863 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f725c014070 con 0x7f726c10ba60 2026-02-24T09:09:37.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.777+0000 7f7271961640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72480b57e0 0x7f72480d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.777+0000 7f3fff7fe640 1 -- 10.20.193.4:0/808144221 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f400800c840 con 0x7f40141120a0 2026-02-24T09:09:37.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.777+0000 7f7271961640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72480b57e0 0x7f72480d5c90 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f726c10e4d0 tx=0x7f7260005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.777+0000 7f3fff7fe640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ff00b57f0 0x7f3ff00d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.778+0000 7f401a6c9640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ff00b57f0 0x7f3ff00d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.778+0000 7f3fff7fe640 1 -- 10.20.193.4:0/808144221 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f40080e7ba0 con 0x7f40141120a0 2026-02-24T09:09:37.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.778+0000 7f401a6c9640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ff00b57f0 0x7f3ff00d5ca0 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f400c004740 tx=0x7f400c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.778+0000 7f72537fe640 1 -- 10.20.193.4:0/43594863 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f725c0a9560 con 0x7f726c10ba60 2026-02-24T09:09:37.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.778+0000 7f3fff7fe640 1 -- 10.20.193.4:0/808144221 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f40080aa530 con 0x7f40141120a0 2026-02-24T09:09:37.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 -- 10.20.193.4:0/1189520421 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f570810da00 msgr2=0x7f5708112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 --2- 10.20.193.4:0/1189520421 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f570810da00 0x7f5708112a50 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=6899065412529037945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56fc009950 tx=0x7f56fc02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 -- 10.20.193.4:0/1189520421 shutdown_connections 2026-02-24T09:09:37.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 --2- 10.20.193.4:0/1189520421 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5708113200 0x7f5708173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 --2- 10.20.193.4:0/1189520421 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f570810da00 0x7f5708112a50 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=6899065412529037945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 --2- 10.20.193.4:0/1189520421 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f570810d010 0x7f570810d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 -- 10.20.193.4:0/1189520421 >> 10.20.193.4:0/1189520421 conn(0x7f570805f830 msgr2=0x7f570810ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f41a5c71640 1 -- 10.20.193.4:0/2087475642 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41a010d010 msgr2=0x7f41a010d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f41a5c71640 1 --2- 10.20.193.4:0/2087475642 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41a010d010 0x7f41a010d3e0 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=15237749962936210687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f418c009950 tx=0x7f418c0336a0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 -- 10.20.193.4:0/1189520421 shutdown_connections 2026-02-24T09:09:37.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 -- 10.20.193.4:0/1189520421 wait complete. 2026-02-24T09:09:37.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 Processor -- start 2026-02-24T09:09:37.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f57100d5640 1 -- start start 2026-02-24T09:09:37.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f41a5c71640 1 -- 10.20.193.4:0/2087475642 shutdown_connections 2026-02-24T09:09:37.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f41a5c71640 1 --2- 10.20.193.4:0/2087475642 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41a0113200 0x7f41a0173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f41a5c71640 1 --2- 10.20.193.4:0/2087475642 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41a010da00 0x7f41a0112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f41a5c71640 1 --2- 10.20.193.4:0/2087475642 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41a010d010 0x7f41a010d3e0 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=15237749962936210687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.779+0000 7f41a5c71640 1 -- 10.20.193.4:0/2087475642 >> 10.20.193.4:0/2087475642 conn(0x7f41a005f830 msgr2=0x7f41a010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f41a5c71640 1 -- 10.20.193.4:0/2087475642 shutdown_connections 2026-02-24T09:09:37.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f41a5c71640 1 -- 10.20.193.4:0/2087475642 wait complete. 2026-02-24T09:09:37.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f57100d5640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f570810d010 0x7f57080f2b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f57100d5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f570810da00 0x7f5708173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f57100d5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5708113200 0x7f57080f3220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f570e64b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5708113200 0x7f57080f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f570e64b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5708113200 0x7f57080f3220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59552/0 (socket says 10.20.193.4:59552) 2026-02-24T09:09:37.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f570de4a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f570810d010 0x7f57080f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f570e64b640 1 -- 10.20.193.4:0/3030579070 learned_addr learned my addr 10.20.193.4:0/3030579070 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f57080f8430 con 0x7f5708113200 2026-02-24T09:09:37.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f57080f85a0 con 0x7f570810d010 2026-02-24T09:09:37.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57080f8760 con 0x7f570810da00 2026-02-24T09:09:37.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f41a5c71640 1 Processor -- start 2026-02-24T09:09:37.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f570e64b640 1 -- 10.20.193.4:0/3030579070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f570810da00 msgr2=0x7f5708173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f570e64b640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f570810da00 0x7f5708173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f570e64b640 1 -- 10.20.193.4:0/3030579070 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f570810d010 msgr2=0x7f57080f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f41a5c71640 1 -- start start 2026-02-24T09:09:37.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f570e64b640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f570810d010 0x7f57080f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f570e64b640 1 -- 10.20.193.4:0/3030579070 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56fc009570 con 0x7f5708113200 2026-02-24T09:09:37.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f570e64b640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5708113200 0x7f57080f3220 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5704006e90 tx=0x7f570400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f41a5c71640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41a010d010 0x7f41a011b760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f41a5c71640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41a010da00 0x7f41a011bca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f41a5c71640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41a0113200 0x7f41a0121070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f41a5c71640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f41a0121600 con 0x7f41a010da00 2026-02-24T09:09:37.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f41a5c71640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f41a0121770 con 0x7f41a010d010 2026-02-24T09:09:37.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f41a5c71640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41a0121930 con 0x7f41a0113200 2026-02-24T09:09:37.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f56f6ffd640 1 -- 10.20.193.4:0/3030579070 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5704005500 con 0x7f5708113200 2026-02-24T09:09:37.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f56f6ffd640 1 -- 10.20.193.4:0/3030579070 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5704005e10 con 0x7f5708113200 2026-02-24T09:09:37.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f419f7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41a010d010 0x7f41a011b760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f56f6ffd640 1 -- 10.20.193.4:0/3030579070 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5704003a70 con 0x7f5708113200 2026-02-24T09:09:37.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f419effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41a010da00 0x7f41a011bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f419f7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41a010d010 0x7f41a011b760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:53294/0 (socket says 10.20.193.4:53294) 2026-02-24T09:09:37.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f419f7fe640 1 -- 10.20.193.4:0/3251423177 learned_addr learned my addr 10.20.193.4:0/3251423177 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57080f8a40 con 0x7f5708113200 2026-02-24T09:09:37.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57080f8e00 con 0x7f5708113200 2026-02-24T09:09:37.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.780+0000 7f419ffff640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41a0113200 0x7f41a0121070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.781+0000 7f419ffff640 1 -- 10.20.193.4:0/3251423177 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41a010d010 msgr2=0x7f41a011b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.781+0000 7f419ffff640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41a010d010 0x7f41a011b760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.781+0000 7f419ffff640 1 -- 10.20.193.4:0/3251423177 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41a010da00 msgr2=0x7f41a011bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.781+0000 7f419ffff640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41a010da00 0x7f41a011bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.781+0000 7f419ffff640 1 -- 10.20.193.4:0/3251423177 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c009570 con 0x7f41a0113200 2026-02-24T09:09:37.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.781+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f570810e2f0 con 0x7f5708113200 2026-02-24T09:09:37.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.781+0000 7f419ffff640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41a0113200 0x7f41a0121070 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4194007fd0 tx=0x7f419400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.781+0000 7f419cff9640 1 -- 10.20.193.4:0/3251423177 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4194005560 con 0x7f41a0113200 2026-02-24T09:09:37.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.781+0000 7f419cff9640 1 -- 10.20.193.4:0/3251423177 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4194003c60 con 0x7f41a0113200 2026-02-24T09:09:37.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.781+0000 7f419cff9640 1 -- 10.20.193.4:0/3251423177 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4194011d10 con 0x7f41a0113200 2026-02-24T09:09:37.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.782+0000 7f41a5c71640 1 -- 10.20.193.4:0/3251423177 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a0121c10 con 0x7f41a0113200 2026-02-24T09:09:37.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.782+0000 7f41a5c71640 1 -- 10.20.193.4:0/3251423177 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a0162200 con 0x7f41a0113200 2026-02-24T09:09:37.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.783+0000 7f41a5c71640 1 -- 10.20.193.4:0/3251423177 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a010e2f0 con 0x7f41a0113200 2026-02-24T09:09:37.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.783+0000 7f56f6ffd640 1 -- 10.20.193.4:0/3030579070 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f570400c8d0 con 0x7f5708113200 2026-02-24T09:09:37.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.783+0000 7f419cff9640 1 -- 10.20.193.4:0/3251423177 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f4194003780 con 0x7f41a0113200 2026-02-24T09:09:37.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.784+0000 7f419cff9640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41740b57f0 0x7f41740d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.784+0000 7f56f6ffd640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56e40b5860 0x7f56e40d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.784+0000 7f56f6ffd640 1 -- 10.20.193.4:0/3030579070 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f57040e79a0 con 0x7f5708113200 2026-02-24T09:09:37.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.784+0000 7f419cff9640 1 -- 10.20.193.4:0/3251423177 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f41940e6fd0 con 0x7f41a0113200 2026-02-24T09:09:37.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.784+0000 7f570de4a640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56e40b5860 0x7f56e40d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.784+0000 7f419f7fe640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41740b57f0 0x7f41740d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.784+0000 7f570de4a640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56e40b5860 0x7f56e40d5d10 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f8004740 tx=0x7f56f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.784+0000 7f419f7fe640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41740b57f0 0x7f41740d5ca0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f418c002fd0 tx=0x7f418c00b050 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.785+0000 7f419cff9640 1 -- 10.20.193.4:0/3251423177 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f41940a9a30 con 0x7f41a0113200 2026-02-24T09:09:37.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.786+0000 7f56f6ffd640 1 -- 10.20.193.4:0/3030579070 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f57040aa2f0 con 0x7f5708113200 2026-02-24T09:09:37.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7efc5cbf9640 1 -- 10.20.193.4:0/492210083 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc581112f0 msgr2=0x7efc58111cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7efc5cbf9640 1 --2- 10.20.193.4:0/492210083 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc581112f0 0x7efc58111cd0 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=16034703760079270342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc4800aa30 tx=0x7efc48030270 comp rx=0 tx=0).stop 2026-02-24T09:09:37.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7efc5cbf9640 1 -- 10.20.193.4:0/492210083 shutdown_connections 2026-02-24T09:09:37.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7efc5cbf9640 1 --2- 10.20.193.4:0/492210083 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc581112f0 0x7efc58111cd0 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=16034703760079270342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7efc5cbf9640 1 --2- 10.20.193.4:0/492210083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc5810bcd0 0x7efc58110b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7efc5cbf9640 1 --2- 10.20.193.4:0/492210083 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc5810b2e0 0x7efc5810b6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7efc5cbf9640 1 -- 10.20.193.4:0/492210083 >> 10.20.193.4:0/492210083 conn(0x7efc580e8e50 msgr2=0x7efc58109260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7efc5cbf9640 1 -- 10.20.193.4:0/492210083 shutdown_connections 2026-02-24T09:09:37.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7efc5cbf9640 1 -- 10.20.193.4:0/492210083 wait complete. 2026-02-24T09:09:37.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7f32c598e640 1 -- 10.20.193.4:0/1330041089 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f32c010de30 msgr2=0x7f32c0112e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.787+0000 7f32c598e640 1 --2- 10.20.193.4:0/1330041089 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f32c010de30 0x7f32c0112e80 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=12115501178006206423 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32a8009950 tx=0x7f32a802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7f32c598e640 1 -- 10.20.193.4:0/1330041089 shutdown_connections 2026-02-24T09:09:37.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7f32c598e640 1 --2- 10.20.193.4:0/1330041089 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f32c0113630 0x7f32c0174000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7f32c598e640 1 --2- 10.20.193.4:0/1330041089 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f32c010de30 0x7f32c0112e80 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=12115501178006206423 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7f32c598e640 1 --2- 10.20.193.4:0/1330041089 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32c010d440 0x7f32c010d810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7f32c598e640 1 -- 10.20.193.4:0/1330041089 >> 10.20.193.4:0/1330041089 conn(0x7f32c00ead50 msgr2=0x7f32c010b160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7f32c598e640 1 -- 10.20.193.4:0/1330041089 shutdown_connections 2026-02-24T09:09:37.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7f32c598e640 1 -- 10.20.193.4:0/1330041089 wait complete. 2026-02-24T09:09:37.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc5cbf9640 1 Processor -- start 2026-02-24T09:09:37.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc5cbf9640 1 -- start start 2026-02-24T09:09:37.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc5cbf9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc5810b2e0 0x7efc58122b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc5cbf9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc5810bcd0 0x7efc58123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc5cbf9640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc581112f0 0x7efc58128460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc5cbf9640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7efc58128a80 con 0x7efc5810b2e0 2026-02-24T09:09:37.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc5cbf9640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7efc58128bf0 con 0x7efc581112f0 2026-02-24T09:09:37.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc5cbf9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7efc58128db0 con 0x7efc5810bcd0 2026-02-24T09:09:37.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc5810b2e0 0x7efc58122b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc5810b2e0 0x7efc58122b50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59586/0 (socket says 10.20.193.4:59586) 2026-02-24T09:09:37.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56575640 1 -- 10.20.193.4:0/2107087771 learned_addr learned my addr 10.20.193.4:0/2107087771 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7f32c598e640 1 Processor -- start 2026-02-24T09:09:37.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc55d74640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc5810bcd0 0x7efc58123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56d76640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc581112f0 0x7efc58128460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56575640 1 -- 10.20.193.4:0/2107087771 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc5810bcd0 msgr2=0x7efc58123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7f32c598e640 1 -- start start 2026-02-24T09:09:37.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56575640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc5810bcd0 0x7efc58123090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56575640 1 -- 10.20.193.4:0/2107087771 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc581112f0 msgr2=0x7efc58128460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56575640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc581112f0 0x7efc58128460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56575640 1 -- 10.20.193.4:0/2107087771 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4800a650 con 0x7efc5810b2e0 2026-02-24T09:09:37.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56d76640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc581112f0 0x7efc58128460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:37.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc56575640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc5810b2e0 0x7efc58122b50 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc4c00d950 tx=0x7efc4c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc3f7fe640 1 -- 10.20.193.4:0/2107087771 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc4c004540 con 0x7efc5810b2e0 2026-02-24T09:09:37.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc3f7fe640 1 -- 10.20.193.4:0/2107087771 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efc4c009d00 con 0x7efc5810b2e0 2026-02-24T09:09:37.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7efc5cbf9640 1 -- 10.20.193.4:0/2107087771 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc58129090 con 0x7efc5810b2e0 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.788+0000 7f32c598e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32c010d440 0x7f32c00f3790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32c598e640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f32c010de30 0x7f32c0173f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32c598e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f32c0113630 0x7f32c00f3e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32c598e640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f32c00f90a0 con 0x7f32c0113630 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32beffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32c010d440 0x7f32c00f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32bf7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f32c0113630 0x7f32c00f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32bf7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f32c0113630 0x7f32c00f3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59598/0 (socket says 10.20.193.4:59598) 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32bf7fe640 1 -- 10.20.193.4:0/743628715 learned_addr learned my addr 10.20.193.4:0/743628715 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32be7fc640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f32c010de30 0x7f32c0173f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f32c00f9210 con 0x7f32c010de30 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f32c00f93d0 con 0x7f32c010d440 2026-02-24T09:09:37.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7efc3f7fe640 1 -- 10.20.193.4:0/2107087771 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc4c0106e0 con 0x7efc5810b2e0 2026-02-24T09:09:37.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32beffd640 1 -- 10.20.193.4:0/743628715 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f32c010de30 msgr2=0x7f32c0173f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32beffd640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f32c010de30 0x7f32c0173f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32beffd640 1 -- 10.20.193.4:0/743628715 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f32c0113630 msgr2=0x7f32c00f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32beffd640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f32c0113630 0x7f32c00f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32beffd640 1 -- 10.20.193.4:0/743628715 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a8009570 con 0x7f32c010d440 2026-02-24T09:09:37.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7efc5cbf9640 1 -- 10.20.193.4:0/2107087771 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc58169790 con 0x7efc5810b2e0 2026-02-24T09:09:37.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32bf7fe640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f32c0113630 0x7f32c00f3e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:09:37.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.789+0000 7f32be7fc640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f32c010de30 0x7f32c0173f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:37.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.790+0000 7f32beffd640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32c010d440 0x7f32c00f3790 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32b400d720 tx=0x7f32b400dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.790+0000 7efc5cbf9640 1 -- 10.20.193.4:0/2107087771 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5810c400 con 0x7efc5810b2e0 2026-02-24T09:09:37.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.790+0000 7f32c498c640 1 -- 10.20.193.4:0/743628715 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32b4004500 con 0x7f32c010d440 2026-02-24T09:09:37.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.790+0000 7f32c498c640 1 -- 10.20.193.4:0/743628715 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f32b4004d30 con 0x7f32c010d440 2026-02-24T09:09:37.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.790+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c00f96b0 con 0x7f32c010d440 2026-02-24T09:09:37.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.790+0000 7f32c498c640 1 -- 10.20.193.4:0/743628715 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32b40052a0 con 0x7f32c010d440 2026-02-24T09:09:37.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.790+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c00f9bd0 con 0x7f32c010d440 2026-02-24T09:09:37.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.790+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c00f9eb0 con 0x7f32c010d440 2026-02-24T09:09:37.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.790+0000 7efc3f7fe640 1 -- 10.20.193.4:0/2107087771 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7efc4c0097c0 con 0x7efc5810b2e0 2026-02-24T09:09:37.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/4029955002 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5e5410ebe0 msgr2=0x7f5e541531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e58cad640 1 -- 10.20.193.4:0/4029955002 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e48004290 con 0x7f5e5410ebe0 2026-02-24T09:09:37.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 --2- 10.20.193.4:0/4029955002 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5e5410ebe0 0x7f5e541531d0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=3218057801793602611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e48009890 tx=0x7f5e4802f120 comp rx=0 tx=0).stop 2026-02-24T09:09:37.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/4029955002 shutdown_connections 2026-02-24T09:09:37.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 --2- 10.20.193.4:0/4029955002 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5e541537a0 0x7f5e54173bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 --2- 10.20.193.4:0/4029955002 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5e5410ebe0 0x7f5e541531d0 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=3218057801793602611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 --2- 10.20.193.4:0/4029955002 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5e5410e1f0 0x7f5e5410e5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/4029955002 >> 10.20.193.4:0/4029955002 conn(0x7f5e540e9bf0 msgr2=0x7f5e5410a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/4029955002 shutdown_connections 2026-02-24T09:09:37.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7efc3f7fe640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc300b5770 0x7efc300d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7efc3f7fe640 1 -- 10.20.193.4:0/2107087771 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7efc4c0e61c0 con 0x7efc5810b2e0 2026-02-24T09:09:37.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/4029955002 wait complete. 2026-02-24T09:09:37.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 Processor -- start 2026-02-24T09:09:37.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7efc55d74640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc300b5770 0x7efc300d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.791+0000 7f5e5bf3a640 1 -- start start 2026-02-24T09:09:37.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5bf3a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5e5410e1f0 0x7f5e5405a5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5bf3a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5e5410ebe0 0x7f5e5405aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5bf3a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5e541537a0 0x7f5e5405b020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7efc55d74640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc300b5770 0x7efc300d5c20 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc581294f0 tx=0x7efc40005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f32c498c640 1 -- 10.20.193.4:0/743628715 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f32b4005430 con 0x7f32c010d440 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e59caf640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5e5410e1f0 0x7f5e5405a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e59caf640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5e5410e1f0 0x7f5e5405a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:53356/0 (socket says 10.20.193.4:53356) 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e59caf640 1 -- 10.20.193.4:0/1493090597 learned_addr learned my addr 10.20.193.4:0/1493090597 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5414f0f0 con 0x7f5e541537a0 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5414f260 con 0x7f5e5410e1f0 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5414f420 con 0x7f5e5410ebe0 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e594ae640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5e5410ebe0 0x7f5e5405aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5a4b0640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5e541537a0 0x7f5e5405b020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5a4b0640 1 -- 10.20.193.4:0/1493090597 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5e5410ebe0 msgr2=0x7f5e5405aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5a4b0640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5e5410ebe0 0x7f5e5405aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5a4b0640 1 -- 10.20.193.4:0/1493090597 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5e5410e1f0 msgr2=0x7f5e5405a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5a4b0640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5e5410e1f0 0x7f5e5405a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5a4b0640 1 -- 10.20.193.4:0/1493090597 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e480094b0 con 0x7f5e541537a0 2026-02-24T09:09:37.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.792+0000 7f5e5a4b0640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5e541537a0 0x7f5e5405b020 secure :-1 s=READY pgs=315 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e50006c10 tx=0x7f5e5000fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7f32c498c640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f32940b57e0 0x7f32940d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7f32be7fc640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f32940b57e0 0x7f32940d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7f32c498c640 1 -- 10.20.193.4:0/743628715 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f32b40e6f70 con 0x7f32c010d440 2026-02-24T09:09:37.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7f32c498c640 1 -- 10.20.193.4:0/743628715 <== mon.1 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f32b40e73f0 con 0x7f32c010d440 2026-02-24T09:09:37.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7f32be7fc640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f32940b57e0 0x7f32940d5c90 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32a80098a0 tx=0x7f32a8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7f5e42ffd640 1 -- 10.20.193.4:0/1493090597 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e5000dda0 con 0x7f5e541537a0 2026-02-24T09:09:37.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7f5e42ffd640 1 -- 10.20.193.4:0/1493090597 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e50005e10 con 0x7f5e541537a0 2026-02-24T09:09:37.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7f5e42ffd640 1 -- 10.20.193.4:0/1493090597 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e50004aa0 con 0x7f5e541537a0 2026-02-24T09:09:37.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5414f700 con 0x7f5e541537a0 2026-02-24T09:09:37.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5414fc00 con 0x7f5e541537a0 2026-02-24T09:09:37.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.794+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e54060420 con 0x7f5e541537a0 2026-02-24T09:09:37.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.795+0000 7f5e42ffd640 1 -- 10.20.193.4:0/1493090597 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f5e50004c30 con 0x7f5e541537a0 2026-02-24T09:09:37.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.793+0000 7efc3f7fe640 1 -- 10.20.193.4:0/2107087771 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7efc4c0a8b50 con 0x7efc5810b2e0 2026-02-24T09:09:37.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.796+0000 7f5e42ffd640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e300b58c0 0x7f5e300d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.796+0000 7f5e59caf640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e300b58c0 0x7f5e300d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.797+0000 7f5e42ffd640 1 -- 10.20.193.4:0/1493090597 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f5e50015070 con 0x7f5e541537a0 2026-02-24T09:09:37.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.797+0000 7f5e59caf640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e300b58c0 0x7f5e300d5d70 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e44006fd0 tx=0x7f5e44009290 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.797+0000 7f5e42ffd640 1 -- 10.20.193.4:0/1493090597 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f5e500aa9e0 con 0x7f5e541537a0 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 -- 10.20.193.4:0/3747423175 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd69810bf30 msgr2=0x7fd69810c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 --2- 10.20.193.4:0/3747423175 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd69810bf30 0x7fd69810c300 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=5476549655459782080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c009980 tx=0x7fd68c02f180 comp rx=0 tx=0).stop 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 -- 10.20.193.4:0/3747423175 shutdown_connections 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 --2- 10.20.193.4:0/3747423175 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd698111510 0x7fd6981119b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 --2- 10.20.193.4:0/3747423175 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd69810c920 0x7fd698110ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 --2- 10.20.193.4:0/3747423175 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd69810bf30 0x7fd69810c300 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=5476549655459782080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 -- 10.20.193.4:0/3747423175 >> 10.20.193.4:0/3747423175 conn(0x7fd6980e9bc0 msgr2=0x7fd698109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 -- 10.20.193.4:0/3747423175 shutdown_connections 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 -- 10.20.193.4:0/3747423175 wait complete. 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 Processor -- start 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 -- start start 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd69810bf30 0x7fd698109f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd69810c920 0x7fd6981031d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.798+0000 7fd697577640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd698111510 0x7fd698103790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd697577640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd698103f20 con 0x7fd69810bf30 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd697577640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd698104090 con 0x7fd698111510 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd697577640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd698108c90 con 0x7fd69810c920 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd69810bf30 0x7fd698109f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd69810bf30 0x7fd698109f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59626/0 (socket says 10.20.193.4:59626) 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696575640 1 -- 10.20.193.4:0/28727873 learned_addr learned my addr 10.20.193.4:0/28727873 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696d76640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd698111510 0x7fd698103790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd695d74640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd69810c920 0x7fd6981031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696575640 1 -- 10.20.193.4:0/28727873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd69810c920 msgr2=0x7fd6981031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696575640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd69810c920 0x7fd6981031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696575640 1 -- 10.20.193.4:0/28727873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd698111510 msgr2=0x7fd698103790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696575640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd698111510 0x7fd698103790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696575640 1 -- 10.20.193.4:0/28727873 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c009570 con 0x7fd69810bf30 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd695d74640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd69810c920 0x7fd6981031d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696d76640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd698111510 0x7fd698103790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd696575640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd69810bf30 0x7fd698109f70 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c0028d0 tx=0x7fd68c002900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd67f7fe640 1 -- 10.20.193.4:0/28727873 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd68c03d070 con 0x7fd69810bf30 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd67f7fe640 1 -- 10.20.193.4:0/28727873 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd68c0043d0 con 0x7fd69810bf30 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd697577640 1 -- 10.20.193.4:0/28727873 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd698108f70 con 0x7fd69810bf30 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd67f7fe640 1 -- 10.20.193.4:0/28727873 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd68c041960 con 0x7fd69810bf30 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.799+0000 7fd697577640 1 -- 10.20.193.4:0/28727873 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd698109490 con 0x7fd69810bf30 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.800+0000 7fd697577640 1 -- 10.20.193.4:0/28727873 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd698060420 con 0x7fd69810bf30 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.802+0000 7fd67f7fe640 1 -- 10.20.193.4:0/28727873 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fd68c041af0 con 0x7fd69810bf30 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.802+0000 7fd67f7fe640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd6700b57f0 0x7fd6700d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.802+0000 7fd695d74640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd6700b57f0 0x7fd6700d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.802+0000 7fd67f7fe640 1 -- 10.20.193.4:0/28727873 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fd68c10afe0 con 0x7fd69810bf30 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.803+0000 7fd695d74640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd6700b57f0 0x7fd6700d5ca0 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd69810b1f0 tx=0x7fd680005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:37.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.805+0000 7fd67f7fe640 1 -- 10.20.193.4:0/28727873 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fd68c0cda40 con 0x7fd69810bf30 2026-02-24T09:09:37.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.806+0000 7fe3eb7fe640 1 -- 10.20.193.4:0/106154156 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe3dc005880 con 0x7fe41c10fc70 2026-02-24T09:09:37.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.806+0000 7fe411ffb640 1 -- 10.20.193.4:0/106154156 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe4040ac960 con 0x7fe41c10fc70 2026-02-24T09:09:37.829 INFO:teuthology.orchestra.run.trial004.stdout:98784247827 2026-02-24T09:09:37.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.808+0000 7f2e907a0640 1 -- 10.20.193.4:0/1169554480 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2e8805c610 con 0x7f2e8810f650 2026-02-24T09:09:37.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.808+0000 7f2e6f7fe640 1 -- 10.20.193.4:0/1169554480 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2e8805c610 con 0x7f2e8810f650 2026-02-24T09:09:37.829 INFO:teuthology.orchestra.run.trial004.stdout:128849018897 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 -- 10.20.193.4:0/106154156 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3f80b57e0 msgr2=0x7fe3f80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3f80b57e0 0x7fe3f80d5c90 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe40c004740 tx=0x7fe40c005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 -- 10.20.193.4:0/106154156 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe41c10fc70 msgr2=0x7fe41c175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe41c10fc70 0x7fe41c175d40 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe404009480 tx=0x7fe40400ee60 comp rx=0 tx=0).stop 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 -- 10.20.193.4:0/106154156 shutdown_connections 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3f80b57e0 0x7fe3f80d5c90 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe41c115470 0x7fe41c0febf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe41c10fc70 0x7fe41c175d40 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 --2- 10.20.193.4:0/106154156 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe41c10f280 0x7fe41c0fe4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 -- 10.20.193.4:0/106154156 >> 10.20.193.4:0/106154156 conn(0x7fe41c05f830 msgr2=0x7fe41c10d730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 -- 10.20.193.4:0/106154156 shutdown_connections 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.809+0000 7fe3eb7fe640 1 -- 10.20.193.4:0/106154156 wait complete. 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 -- 10.20.193.4:0/1169554480 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e640b5670 msgr2=0x7f2e640d5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e640b5670 0x7f2e640d5b20 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e8805e2a0 tx=0x7f2e7c005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:37.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 -- 10.20.193.4:0/1169554480 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e8810f650 msgr2=0x7f2e8805e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e8810f650 0x7f2e8805e520 secure :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e780028d0 tx=0x7f2e78002900 comp rx=0 tx=0).stop 2026-02-24T09:09:37.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 -- 10.20.193.4:0/1169554480 shutdown_connections 2026-02-24T09:09:37.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2e640b5670 0x7f2e640d5b20 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e88112290 0x7f2e8805b7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e88110040 0x7f2e88175d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 --2- 10.20.193.4:0/1169554480 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e8810f650 0x7f2e8805e520 unknown :-1 s=CLOSED pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 -- 10.20.193.4:0/1169554480 >> 10.20.193.4:0/1169554480 conn(0x7f2e880648b0 msgr2=0x7f2e88112ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 -- 10.20.193.4:0/1169554480 shutdown_connections 2026-02-24T09:09:37.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.813+0000 7f2e907a0640 1 -- 10.20.193.4:0/1169554480 wait complete. 2026-02-24T09:09:37.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.849+0000 7f70398bf640 1 -- 10.20.193.4:0/41825351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f70340f6670 con 0x7f703410fc70 2026-02-24T09:09:37.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.850+0000 7f70388bd640 1 -- 10.20.193.4:0/41825351 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f701c0ac2d0 con 0x7f703410fc70 2026-02-24T09:09:37.853 INFO:teuthology.orchestra.run.trial004.stdout:176093659151 2026-02-24T09:09:37.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 -- 10.20.193.4:0/41825351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70080b57e0 msgr2=0x7f70080d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70080b57e0 0x7f70080d5c90 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7028005970 tx=0x7f7028005900 comp rx=0 tx=0).stop 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 -- 10.20.193.4:0/41825351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f703410fc70 msgr2=0x7f7034175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f703410fc70 0x7f7034175d40 secure :-1 s=READY pgs=304 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f701c00b500 tx=0x7f701c00b9d0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 -- 10.20.193.4:0/41825351 shutdown_connections 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70080b57e0 0x7f70080d5c90 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7034115470 0x7f70340f5c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f703410fc70 0x7f7034175d40 unknown :-1 s=CLOSED pgs=304 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 --2- 10.20.193.4:0/41825351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f703410f280 0x7f70340f5510 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 -- 10.20.193.4:0/41825351 >> 10.20.193.4:0/41825351 conn(0x7f703405f830 msgr2=0x7f703410d730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 -- 10.20.193.4:0/41825351 shutdown_connections 2026-02-24T09:09:37.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.853+0000 7f70398bf640 1 -- 10.20.193.4:0/41825351 wait complete. 2026-02-24T09:09:37.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.858+0000 7fbadded8640 1 -- 10.20.193.4:0/3272008157 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbad810bbb0 con 0x7fbad8113630 2026-02-24T09:09:37.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.859+0000 7fbad4ff9640 1 -- 10.20.193.4:0/3272008157 <== mon.2 v2:10.20.193.14:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbacc0d2230 con 0x7fbad8113630 2026-02-24T09:09:37.862 INFO:teuthology.orchestra.run.trial004.stdout:68719476756 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 -- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbaac0b5870 msgr2=0x7fbaac0d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbaac0b5870 0x7fbaac0d5d20 secure :-1 s=READY pgs=213 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbac4004740 tx=0x7fbac400b410 comp rx=0 tx=0).stop 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 -- 10.20.193.4:0/3272008157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbad8113630 msgr2=0x7fbad8116950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbad8113630 0x7fbad8116950 secure :-1 s=READY pgs=68 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbacc006a50 tx=0x7fbacc0039b0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 -- 10.20.193.4:0/3272008157 shutdown_connections 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbaac0b5870 0x7fbaac0d5d20 unknown :-1 s=CLOSED pgs=213 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbad8113630 0x7fbad8116950 unknown :-1 s=CLOSED pgs=68 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbad810c1d0 0x7fbad8114920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 --2- 10.20.193.4:0/3272008157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbad810b7e0 0x7fbad81143e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 -- 10.20.193.4:0/3272008157 >> 10.20.193.4:0/3272008157 conn(0x7fbad80e9370 msgr2=0x7fbad8109750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 -- 10.20.193.4:0/3272008157 shutdown_connections 2026-02-24T09:09:37.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.862+0000 7fbadded8640 1 -- 10.20.193.4:0/3272008157 wait complete. 2026-02-24T09:09:37.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018898 got 128849018897 for osd.4 2026-02-24T09:09:37.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247828 got 98784247827 for osd.3 2026-02-24T09:09:37.909 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659152 got 176093659151 for osd.6 2026-02-24T09:09:37.911 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.2 2026-02-24T09:09:37.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.911+0000 7f72743ed640 1 -- 10.20.193.4:0/43594863 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f726c0eab60 con 0x7f726c10ba60 2026-02-24T09:09:37.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.912+0000 7f72537fe640 1 -- 10.20.193.4:0/43594863 <== mon.2 v2:10.20.193.14:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f725c0ac710 con 0x7f726c10ba60 2026-02-24T09:09:37.915 INFO:teuthology.orchestra.run.trial004.stdout:270582939655 2026-02-24T09:09:37.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 -- 10.20.193.4:0/43594863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72480b57e0 msgr2=0x7f72480d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72480b57e0 0x7f72480d5c90 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f726c10e4d0 tx=0x7f7260005ab0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 -- 10.20.193.4:0/43594863 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f726c10ba60 msgr2=0x7f726c0e9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f726c10ba60 0x7f726c0e9860 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f725c00e9c0 tx=0x7f725c00ee90 comp rx=0 tx=0).stop 2026-02-24T09:09:37.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 -- 10.20.193.4:0/43594863 shutdown_connections 2026-02-24T09:09:37.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72480b57e0 0x7f72480d5c90 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f726c111c50 0x7f726c0e9da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f726c10c450 0x7f726c172520 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 --2- 10.20.193.4:0/43594863 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f726c10ba60 0x7f726c0e9860 unknown :-1 s=CLOSED pgs=69 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 -- 10.20.193.4:0/43594863 >> 10.20.193.4:0/43594863 conn(0x7f726c0e9370 msgr2=0x7f726c109f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 -- 10.20.193.4:0/43594863 shutdown_connections 2026-02-24T09:09:37.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.914+0000 7f72743ed640 1 -- 10.20.193.4:0/43594863 wait complete. 2026-02-24T09:09:37.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.915+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f57080f9290 con 0x7f5708113200 2026-02-24T09:09:37.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.915+0000 7f56f6ffd640 1 -- 10.20.193.4:0/3030579070 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f57040ad4a0 con 0x7f5708113200 2026-02-24T09:09:37.920 INFO:teuthology.orchestra.run.trial004.stdout:51539607574 2026-02-24T09:09:37.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.917+0000 7f41a5c71640 1 -- 10.20.193.4:0/3251423177 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f41a0174d10 con 0x7f41a0113200 2026-02-24T09:09:37.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.917+0000 7f419cff9640 1 -- 10.20.193.4:0/3251423177 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f41940acbe0 con 0x7f41a0113200 2026-02-24T09:09:37.921 INFO:teuthology.orchestra.run.trial004.stdout:300647710727 2026-02-24T09:09:37.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.917+0000 7f401c954640 1 -- 10.20.193.4:0/808144221 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f401410d190 con 0x7f40141120a0 2026-02-24T09:09:37.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.917+0000 7f3fff7fe640 1 -- 10.20.193.4:0/808144221 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f40080ad6e0 con 0x7f40141120a0 2026-02-24T09:09:37.922 INFO:teuthology.orchestra.run.trial004.stdout:223338299402 2026-02-24T09:09:37.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56e40b5860 msgr2=0x7f56e40d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56e40b5860 0x7f56e40d5d10 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f8004740 tx=0x7f56f8005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:37.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5708113200 msgr2=0x7f57080f3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5708113200 0x7f57080f3220 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5704006e90 tx=0x7f570400edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 shutdown_connections 2026-02-24T09:09:37.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56e40b5860 0x7f56e40d5d10 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5708113200 0x7f57080f3220 unknown :-1 s=CLOSED pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f570810da00 0x7f5708173ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 --2- 10.20.193.4:0/3030579070 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f570810d010 0x7f57080f2b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 >> 10.20.193.4:0/3030579070 conn(0x7f570805f830 msgr2=0x7f570810b840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 shutdown_connections 2026-02-24T09:09:37.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.918+0000 7f57100d5640 1 -- 10.20.193.4:0/3030579070 wait complete. 2026-02-24T09:09:37.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 -- 10.20.193.4:0/3251423177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41740b57f0 msgr2=0x7f41740d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41740b57f0 0x7f41740d5ca0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f418c002fd0 tx=0x7f418c00b050 comp rx=0 tx=0).stop 2026-02-24T09:09:37.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 -- 10.20.193.4:0/3251423177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41a0113200 msgr2=0x7f41a0121070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41a0113200 0x7f41a0121070 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4194007fd0 tx=0x7f419400c9c0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 -- 10.20.193.4:0/3251423177 shutdown_connections 2026-02-24T09:09:37.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41740b57f0 0x7f41740d5ca0 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41a0113200 0x7f41a0121070 unknown :-1 s=CLOSED pgs=87 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41a010da00 0x7f41a011bca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 --2- 10.20.193.4:0/3251423177 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41a010d010 0x7f41a011b760 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 -- 10.20.193.4:0/3251423177 >> 10.20.193.4:0/3251423177 conn(0x7f41a005f830 msgr2=0x7f41a010ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 -- 10.20.193.4:0/3251423177 shutdown_connections 2026-02-24T09:09:37.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f41a5c71640 1 -- 10.20.193.4:0/3251423177 wait complete. 2026-02-24T09:09:37.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 -- 10.20.193.4:0/808144221 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ff00b57f0 msgr2=0x7f3ff00d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ff00b57f0 0x7f3ff00d5ca0 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f400c004740 tx=0x7f400c00b410 comp rx=0 tx=0).stop 2026-02-24T09:09:37.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 -- 10.20.193.4:0/808144221 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40141120a0 msgr2=0x7f4014124660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40141120a0 0x7f4014124660 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4008006e90 tx=0x7f400800edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 -- 10.20.193.4:0/808144221 shutdown_connections 2026-02-24T09:09:37.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ff00b57f0 0x7f3ff00d5ca0 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40141120a0 0x7f4014124660 unknown :-1 s=CLOSED pgs=307 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f401410c8a0 0x7f401411f290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 --2- 10.20.193.4:0/808144221 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f401410beb0 0x7f401411ed50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 -- 10.20.193.4:0/808144221 >> 10.20.193.4:0/808144221 conn(0x7f40140e97e0 msgr2=0x7f4014109bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 -- 10.20.193.4:0/808144221 shutdown_connections 2026-02-24T09:09:37.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.920+0000 7f401c954640 1 -- 10.20.193.4:0/808144221 wait complete. 2026-02-24T09:09:37.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.927+0000 7efc5cbf9640 1 -- 10.20.193.4:0/2107087771 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7efc58110b60 con 0x7efc5810b2e0 2026-02-24T09:09:37.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.927+0000 7efc3f7fe640 1 -- 10.20.193.4:0/2107087771 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efc4c0a8b50 con 0x7efc5810b2e0 2026-02-24T09:09:37.931 INFO:teuthology.orchestra.run.trial004.stdout:146028888079 2026-02-24T09:09:37.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.928+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f5e5405b8a0 con 0x7f5e541537a0 2026-02-24T09:09:37.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.928+0000 7f5e42ffd640 1 -- 10.20.193.4:0/1493090597 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5e500adb90 con 0x7f5e541537a0 2026-02-24T09:09:37.932 INFO:teuthology.orchestra.run.trial004.stdout:253403070474 2026-02-24T09:09:37.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 -- 10.20.193.4:0/2107087771 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc300b5770 msgr2=0x7efc300d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc300b5770 0x7efc300d5c20 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc581294f0 tx=0x7efc40005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:37.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 -- 10.20.193.4:0/2107087771 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc5810b2e0 msgr2=0x7efc58122b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc5810b2e0 0x7efc58122b50 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc4c00d950 tx=0x7efc4c00de20 comp rx=0 tx=0).stop 2026-02-24T09:09:37.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 -- 10.20.193.4:0/2107087771 shutdown_connections 2026-02-24T09:09:37.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc300b5770 0x7efc300d5c20 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc581112f0 0x7efc58128460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc5810bcd0 0x7efc58123090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 --2- 10.20.193.4:0/2107087771 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc5810b2e0 0x7efc58122b50 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 -- 10.20.193.4:0/2107087771 >> 10.20.193.4:0/2107087771 conn(0x7efc580e8e50 msgr2=0x7efc58109230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 -- 10.20.193.4:0/2107087771 shutdown_connections 2026-02-24T09:09:37.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7efc5cbf9640 1 -- 10.20.193.4:0/2107087771 wait complete. 2026-02-24T09:09:37.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e300b58c0 msgr2=0x7f5e300d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e300b58c0 0x7f5e300d5d70 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e44006fd0 tx=0x7f5e44009290 comp rx=0 tx=0).stop 2026-02-24T09:09:37.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5e541537a0 msgr2=0x7f5e5405b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5e541537a0 0x7f5e5405b020 secure :-1 s=READY pgs=315 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e50006c10 tx=0x7f5e5000fde0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 shutdown_connections 2026-02-24T09:09:37.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e300b58c0 0x7f5e300d5d70 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5e541537a0 0x7f5e5405b020 unknown :-1 s=CLOSED pgs=315 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5e5410ebe0 0x7f5e5405aae0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 --2- 10.20.193.4:0/1493090597 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5e5410e1f0 0x7f5e5405a5a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 >> 10.20.193.4:0/1493090597 conn(0x7f5e540e9bf0 msgr2=0x7f5e54109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 shutdown_connections 2026-02-24T09:09:37.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.931+0000 7f5e5bf3a640 1 -- 10.20.193.4:0/1493090597 wait complete. 2026-02-24T09:09:37.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.933+0000 7fd697577640 1 -- 10.20.193.4:0/28727873 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd6981044d0 con 0x7fd69810bf30 2026-02-24T09:09:37.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.933+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f32c00f9840 con 0x7f32c010d440 2026-02-24T09:09:37.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.934+0000 7f32c498c640 1 -- 10.20.193.4:0/743628715 <== mon.1 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f32c00f9840 con 0x7f32c010d440 2026-02-24T09:09:37.939 INFO:teuthology.orchestra.run.trial004.stdout:193273528333 2026-02-24T09:09:37.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.934+0000 7fd67f7fe640 1 -- 10.20.193.4:0/28727873 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd68c0cda40 con 0x7fd69810bf30 2026-02-24T09:09:37.939 INFO:teuthology.orchestra.run.trial004.stdout:34359738392 2026-02-24T09:09:37.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f32940b57e0 msgr2=0x7f32940d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f32940b57e0 0x7f32940d5c90 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32a80098a0 tx=0x7f32a8031040 comp rx=0 tx=0).stop 2026-02-24T09:09:37.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32c010d440 msgr2=0x7f32c00f3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32c010d440 0x7f32c00f3790 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32b400d720 tx=0x7f32b400dbf0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 shutdown_connections 2026-02-24T09:09:37.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f32940b57e0 0x7f32940d5c90 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f32c0113630 0x7f32c00f3e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f32c010de30 0x7f32c0173f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 --2- 10.20.193.4:0/743628715 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32c010d440 0x7f32c00f3790 unknown :-1 s=CLOSED pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 >> 10.20.193.4:0/743628715 conn(0x7f32c00ead50 msgr2=0x7f32c010fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 -- 10.20.193.4:0/28727873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd6700b57f0 msgr2=0x7fd6700d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd6700b57f0 0x7fd6700d5ca0 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd69810b1f0 tx=0x7fd680005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:37.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 shutdown_connections 2026-02-24T09:09:37.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 -- 10.20.193.4:0/28727873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd69810bf30 msgr2=0x7fd698109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:37.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd69810bf30 0x7fd698109f70 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c0028d0 tx=0x7fd68c002900 comp rx=0 tx=0).stop 2026-02-24T09:09:37.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7f32c598e640 1 -- 10.20.193.4:0/743628715 wait complete. 2026-02-24T09:09:37.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 -- 10.20.193.4:0/28727873 shutdown_connections 2026-02-24T09:09:37.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd6700b57f0 0x7fd6700d5ca0 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd698111510 0x7fd698103790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd69810c920 0x7fd6981031d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 --2- 10.20.193.4:0/28727873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd69810bf30 0x7fd698109f70 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:37.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 -- 10.20.193.4:0/28727873 >> 10.20.193.4:0/28727873 conn(0x7fd6980e9bc0 msgr2=0x7fd69810fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:37.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 -- 10.20.193.4:0/28727873 shutdown_connections 2026-02-24T09:09:37.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:37.938+0000 7fd697577640 1 -- 10.20.193.4:0/28727873 wait complete. 2026-02-24T09:09:37.968 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939656 got 270582939655 for osd.10 2026-02-24T09:09:37.977 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607575 got 51539607574 for osd.1 2026-02-24T09:09:37.985 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888080 got 146028888079 for osd.5 2026-02-24T09:09:37.990 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299403 got 223338299402 for osd.8 2026-02-24T09:09:37.995 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070475 got 253403070474 for osd.9 2026-02-24T09:09:37.996 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710729 got 300647710727 for osd.11 2026-02-24T09:09:38.019 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528334 got 193273528333 for osd.7 2026-02-24T09:09:38.019 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738393 got 34359738392 for osd.0 2026-02-24T09:09:38.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: pgmap v143: 97 pgs: 97 active+clean; 632 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 8.9 KiB/s wr, 16 op/s 2026-02-24T09:09:38.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/106154156' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:09:38.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1169554480' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:09:38.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/41825351' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:09:38.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3272008157' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:09:38.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/43594863' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:09:38.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3030579070' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:09:38.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3251423177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:09:38.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/808144221' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:09:38.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2107087771' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:09:38.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1493090597' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:09:38.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/28727873' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:09:38.584 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:38 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/743628715' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:09:38.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: pgmap v143: 97 pgs: 97 active+clean; 632 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 8.9 KiB/s wr, 16 op/s 2026-02-24T09:09:38.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/106154156' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:09:38.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1169554480' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:09:38.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/41825351' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:09:38.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3272008157' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:09:38.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/43594863' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:09:38.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3030579070' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:09:38.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3251423177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:09:38.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/808144221' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:09:38.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2107087771' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:09:38.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1493090597' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:09:38.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/28727873' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:09:38.594 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:38 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/743628715' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:09:38.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: pgmap v143: 97 pgs: 97 active+clean; 632 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 8.9 KiB/s wr, 16 op/s 2026-02-24T09:09:38.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/106154156' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:09:38.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1169554480' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:09:38.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/41825351' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:09:38.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3272008157' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:09:38.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/43594863' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:09:38.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3030579070' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:09:38.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3251423177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:09:38.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/808144221' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:09:38.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2107087771' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:09:38.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1493090597' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:09:38.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/28727873' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:09:38.716 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:38 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/743628715' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:09:38.873 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-24T09:09:38.874 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T09:09:38.909 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-24T09:09:38.912 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T09:09:38.969 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-24T09:09:38.977 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T09:09:38.986 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-24T09:09:38.991 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-24T09:09:38.991 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:38.993 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:38.996 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-24T09:09:38.997 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-24T09:09:39.019 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-24T09:09:39.020 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T09:09:39.040 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.041 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.102 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.111+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/3886997926 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4b78066a30 msgr2=0x7f4b78062a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.111+0000 7f4b7e2ae640 1 --2- 10.20.193.4:0/3886997926 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4b78066a30 0x7f4b78062a50 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=5133319079739217307 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b6c00aa30 tx=0x7f4b6c030280 comp rx=0 tx=0).stop 2026-02-24T09:09:39.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.111+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/3886997926 shutdown_connections 2026-02-24T09:09:39.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.111+0000 7f4b7e2ae640 1 --2- 10.20.193.4:0/3886997926 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b78159ed0 0x7f4b7817a360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.111+0000 7f4b7e2ae640 1 --2- 10.20.193.4:0/3886997926 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4b78063070 0x7f4b78063480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.111+0000 7f4b7e2ae640 1 --2- 10.20.193.4:0/3886997926 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4b78066a30 0x7f4b78062a50 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=5133319079739217307 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.111+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/3886997926 >> 10.20.193.4:0/3886997926 conn(0x7f4b780ecf70 msgr2=0x7f4b7810d380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.111+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/3886997926 shutdown_connections 2026-02-24T09:09:39.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.111+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/3886997926 wait complete. 2026-02-24T09:09:39.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b7e2ae640 1 Processor -- start 2026-02-24T09:09:39.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b7e2ae640 1 -- start start 2026-02-24T09:09:39.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b7e2ae640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4b78063070 0x7f4b7817a150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b7e2ae640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b78066a30 0x7f4b781753b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b7e2ae640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4b78159ed0 0x7f4b78175970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b77fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4b78063070 0x7f4b7817a150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b7e2ae640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4b78176100 con 0x7f4b78063070 2026-02-24T09:09:39.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b77fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4b78063070 0x7f4b7817a150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59634/0 (socket says 10.20.193.4:59634) 2026-02-24T09:09:39.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b77fff640 1 -- 10.20.193.4:0/337092164 learned_addr learned my addr 10.20.193.4:0/337092164 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4b78176270 con 0x7f4b78159ed0 2026-02-24T09:09:39.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4b781503e0 con 0x7f4b78066a30 2026-02-24T09:09:39.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b777fe640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b78066a30 0x7f4b781753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b7c824640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4b78159ed0 0x7f4b78175970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b77fff640 1 -- 10.20.193.4:0/337092164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b78066a30 msgr2=0x7f4b781753b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b77fff640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b78066a30 0x7f4b781753b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b77fff640 1 -- 10.20.193.4:0/337092164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4b78159ed0 msgr2=0x7f4b78175970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b77fff640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4b78159ed0 0x7f4b78175970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.112+0000 7f4b77fff640 1 -- 10.20.193.4:0/337092164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c00a650 con 0x7f4b78063070 2026-02-24T09:09:39.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.113+0000 7f4b77fff640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4b78063070 0x7f4b7817a150 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b6c006ad0 tx=0x7f4b6c0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 -- 10.20.193.4:0/1300199891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4068113200 msgr2=0x7f4068173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 --2- 10.20.193.4:0/1300199891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4068113200 0x7f4068173bd0 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=2528927255749181521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f405c00aa30 tx=0x7f405c030280 comp rx=0 tx=0).stop 2026-02-24T09:09:39.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 -- 10.20.193.4:0/1300199891 shutdown_connections 2026-02-24T09:09:39.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 --2- 10.20.193.4:0/1300199891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4068113200 0x7f4068173bd0 unknown :-1 s=CLOSED pgs=320 gs=1 cs=0 l=1 c_cookie=2528927255749181521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 --2- 10.20.193.4:0/1300199891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f406810da00 0x7f4068112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 --2- 10.20.193.4:0/1300199891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f406810d010 0x7f406810d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 -- 10.20.193.4:0/1300199891 >> 10.20.193.4:0/1300199891 conn(0x7f406805f830 msgr2=0x7f406810ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 -- 10.20.193.4:0/1300199891 shutdown_connections 2026-02-24T09:09:39.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.113+0000 7f4b757fa640 1 -- 10.20.193.4:0/337092164 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4b6c03e070 con 0x7f4b78063070 2026-02-24T09:09:39.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.113+0000 7f4b757fa640 1 -- 10.20.193.4:0/337092164 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4b6c0055a0 con 0x7f4b78063070 2026-02-24T09:09:39.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.113+0000 7f4b757fa640 1 -- 10.20.193.4:0/337092164 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4b6c042a70 con 0x7f4b78063070 2026-02-24T09:09:39.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.113+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b78150660 con 0x7f4b78063070 2026-02-24T09:09:39.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.113+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b78150a80 con 0x7f4b78063070 2026-02-24T09:09:39.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b78063f60 con 0x7f4b78063070 2026-02-24T09:09:39.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 -- 10.20.193.4:0/1300199891 wait complete. 2026-02-24T09:09:39.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 Processor -- start 2026-02-24T09:09:39.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 -- start start 2026-02-24T09:09:39.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f406810d010 0x7f40680f5550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f406810da00 0x7f4068173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4068113200 0x7f40680f5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f40680fae60 con 0x7f406810d010 2026-02-24T09:09:39.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f40680fafd0 con 0x7f406810da00 2026-02-24T09:09:39.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.114+0000 7f406da9c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f40680fb190 con 0x7f4068113200 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f40677fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f406810d010 0x7f40680f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f40677fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f406810d010 0x7f40680f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59636/0 (socket says 10.20.193.4:59636) 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f40677fe640 1 -- 10.20.193.4:0/2149521313 learned_addr learned my addr 10.20.193.4:0/2149521313 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f4067fff640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4068113200 0x7f40680f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f4066ffd640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f406810da00 0x7f4068173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f40677fe640 1 -- 10.20.193.4:0/2149521313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4068113200 msgr2=0x7f40680f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f40677fe640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4068113200 0x7f40680f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f40677fe640 1 -- 10.20.193.4:0/2149521313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f406810da00 msgr2=0x7f4068173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f40677fe640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f406810da00 0x7f4068173ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f40677fe640 1 -- 10.20.193.4:0/2149521313 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c00a650 con 0x7f406810d010 2026-02-24T09:09:39.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.115+0000 7f40677fe640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f406810d010 0x7f40680f5550 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40540072a0 tx=0x7f405400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.116+0000 7f4b757fa640 1 -- 10.20.193.4:0/337092164 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f4b6c0050c0 con 0x7f4b78063070 2026-02-24T09:09:39.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.117+0000 7f4b757fa640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4b580b57f0 0x7f4b580d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.117+0000 7f4b757fa640 1 -- 10.20.193.4:0/337092164 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f4b6c10d1e0 con 0x7f4b78063070 2026-02-24T09:09:39.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.117+0000 7f4064ff9640 1 -- 10.20.193.4:0/2149521313 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4054007ea0 con 0x7f406810d010 2026-02-24T09:09:39.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.117+0000 7f4064ff9640 1 -- 10.20.193.4:0/2149521313 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4054004500 con 0x7f406810d010 2026-02-24T09:09:39.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.117+0000 7f4064ff9640 1 -- 10.20.193.4:0/2149521313 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40540106e0 con 0x7f406810d010 2026-02-24T09:09:39.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.117+0000 7f406da9c640 1 -- 10.20.193.4:0/2149521313 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40680fb470 con 0x7f406810d010 2026-02-24T09:09:39.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.117+0000 7f406da9c640 1 -- 10.20.193.4:0/2149521313 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40680fb8f0 con 0x7f406810d010 2026-02-24T09:09:39.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.117+0000 7f4b777fe640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4b580b57f0 0x7f4b580d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.117+0000 7f4b757fa640 1 -- 10.20.193.4:0/337092164 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f4b6c0cfc40 con 0x7f4b78063070 2026-02-24T09:09:39.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.117+0000 7f4b777fe640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4b580b57f0 0x7f4b580d5ca0 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b64005970 tx=0x7f4b64005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.118+0000 7f406da9c640 1 -- 10.20.193.4:0/2149521313 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f406810e2f0 con 0x7f406810d010 2026-02-24T09:09:39.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.119+0000 7f4064ff9640 1 -- 10.20.193.4:0/2149521313 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f4054002730 con 0x7f406810d010 2026-02-24T09:09:39.128 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.120+0000 7f4064ff9640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f403c0b57e0 0x7f403c0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.120+0000 7f4064ff9640 1 -- 10.20.193.4:0/2149521313 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f40540e6aa0 con 0x7f406810d010 2026-02-24T09:09:39.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.120+0000 7f4066ffd640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f403c0b57e0 0x7f403c0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.121+0000 7f4066ffd640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f403c0b57e0 0x7f403c0d5c90 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40680fbef0 tx=0x7f405800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.121+0000 7f4064ff9640 1 -- 10.20.193.4:0/2149521313 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f40540a94e0 con 0x7f406810d010 2026-02-24T09:09:39.129 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.131 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.167+0000 7f77634bf640 1 -- 10.20.193.4:0/4263254359 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f775c155c60 msgr2=0x7f775c176040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.167+0000 7f77634bf640 1 --2- 10.20.193.4:0/4263254359 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f775c155c60 0x7f775c176040 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=16792321125697185309 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f775800aa30 tx=0x7f7758030280 comp rx=0 tx=0).stop 2026-02-24T09:09:39.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.167+0000 7f77634bf640 1 -- 10.20.193.4:0/4263254359 shutdown_connections 2026-02-24T09:09:39.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.167+0000 7f77634bf640 1 --2- 10.20.193.4:0/4263254359 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f775c155c60 0x7f775c176040 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=16792321125697185309 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.167+0000 7f77634bf640 1 --2- 10.20.193.4:0/4263254359 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f775c10c840 0x7f775c155720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.167+0000 7f77634bf640 1 --2- 10.20.193.4:0/4263254359 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f775c10bf30 0x7f775c10c300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.167+0000 7f77634bf640 1 -- 10.20.193.4:0/4263254359 >> 10.20.193.4:0/4263254359 conn(0x7f775c0e9bf0 msgr2=0x7f775c10a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.167+0000 7f77634bf640 1 -- 10.20.193.4:0/4263254359 shutdown_connections 2026-02-24T09:09:39.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.167+0000 7f77634bf640 1 -- 10.20.193.4:0/4263254359 wait complete. 2026-02-24T09:09:39.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f9018ea9640 1 -- 10.20.193.4:0/1111794086 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9014113200 msgr2=0x7f9014173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f9018ea9640 1 --2- 10.20.193.4:0/1111794086 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9014113200 0x7f9014173bd0 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=12119019623421116024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9004009890 tx=0x7f900402f0e0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f9018ea9640 1 -- 10.20.193.4:0/1111794086 shutdown_connections 2026-02-24T09:09:39.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f77634bf640 1 Processor -- start 2026-02-24T09:09:39.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f77634bf640 1 -- start start 2026-02-24T09:09:39.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f77634bf640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f775c10bf30 0x7f775c172540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f77634bf640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f775c10c840 0x7f775c172a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f77634bf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f775c155c60 0x7f775c172fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f77634bf640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f775c152830 con 0x7f775c155c60 2026-02-24T09:09:39.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f77634bf640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f775c1529a0 con 0x7f775c10c840 2026-02-24T09:09:39.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f77634bf640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f775c152b60 con 0x7f775c10bf30 2026-02-24T09:09:39.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f7761a35640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f775c155c60 0x7f775c172fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f7761234640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f775c10bf30 0x7f775c172540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f7761a35640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f775c155c60 0x7f775c172fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59674/0 (socket says 10.20.193.4:59674) 2026-02-24T09:09:39.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f7760a33640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f775c10c840 0x7f775c172a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f7761a35640 1 -- 10.20.193.4:0/2716049043 learned_addr learned my addr 10.20.193.4:0/2716049043 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f7761a35640 1 -- 10.20.193.4:0/2716049043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f775c10bf30 msgr2=0x7f775c172540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f7761a35640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f775c10bf30 0x7f775c172540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f7761a35640 1 -- 10.20.193.4:0/2716049043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f775c10c840 msgr2=0x7f775c172a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f7761a35640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f775c10c840 0x7f775c172a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f7761a35640 1 -- 10.20.193.4:0/2716049043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775800a650 con 0x7f775c155c60 2026-02-24T09:09:39.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f7761234640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f775c10bf30 0x7f775c172540 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:39.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f9018ea9640 1 --2- 10.20.193.4:0/1111794086 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9014113200 0x7f9014173bd0 unknown :-1 s=CLOSED pgs=323 gs=1 cs=0 l=1 c_cookie=12119019623421116024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f9018ea9640 1 --2- 10.20.193.4:0/1111794086 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f901410da00 0x7f9014112a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f9018ea9640 1 --2- 10.20.193.4:0/1111794086 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f901410d010 0x7f901410d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f9018ea9640 1 -- 10.20.193.4:0/1111794086 >> 10.20.193.4:0/1111794086 conn(0x7f901405f830 msgr2=0x7f901410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f9018ea9640 1 -- 10.20.193.4:0/1111794086 shutdown_connections 2026-02-24T09:09:39.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.168+0000 7f9018ea9640 1 -- 10.20.193.4:0/1111794086 wait complete. 2026-02-24T09:09:39.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9018ea9640 1 Processor -- start 2026-02-24T09:09:39.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9018ea9640 1 -- start start 2026-02-24T09:09:39.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f7761a35640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f775c155c60 0x7f775c172fc0 secure :-1 s=READY pgs=324 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f775800a310 tx=0x7f77580039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f774a7fc640 1 -- 10.20.193.4:0/2716049043 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f775803e070 con 0x7f775c155c60 2026-02-24T09:09:39.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f77634bf640 1 -- 10.20.193.4:0/2716049043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c152de0 con 0x7f775c155c60 2026-02-24T09:09:39.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9018ea9640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f901410d010 0x7f9014060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f77634bf640 1 -- 10.20.193.4:0/2716049043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c153250 con 0x7f775c155c60 2026-02-24T09:09:39.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9018ea9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f901410da00 0x7f90140614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9018ea9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9014113200 0x7f9014061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f774a7fc640 1 -- 10.20.193.4:0/2716049043 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7758003b60 con 0x7f775c155c60 2026-02-24T09:09:39.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f774a7fc640 1 -- 10.20.193.4:0/2716049043 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77580428c0 con 0x7f775c155c60 2026-02-24T09:09:39.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9018ea9640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9014163ce0 con 0x7f901410da00 2026-02-24T09:09:39.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9011d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f901410da00 0x7f90140614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9012575640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f901410d010 0x7f9014060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9012575640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f901410d010 0x7f9014060f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:53472/0 (socket says 10.20.193.4:53472) 2026-02-24T09:09:39.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9011d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f901410da00 0x7f90140614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59682/0 (socket says 10.20.193.4:59682) 2026-02-24T09:09:39.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9012575640 1 -- 10.20.193.4:0/2170052114 learned_addr learned my addr 10.20.193.4:0/2170052114 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9014163e50 con 0x7f901410d010 2026-02-24T09:09:39.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9014164010 con 0x7f9014113200 2026-02-24T09:09:39.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.169+0000 7f9012d76640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9014113200 0x7f9014061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.170+0000 7f9011d74640 1 -- 10.20.193.4:0/2170052114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9014113200 msgr2=0x7f9014061a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.170+0000 7f9011d74640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9014113200 0x7f9014061a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.170+0000 7f9011d74640 1 -- 10.20.193.4:0/2170052114 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f901410d010 msgr2=0x7f9014060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.170+0000 7f9011d74640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f901410d010 0x7f9014060f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.170+0000 7f9011d74640 1 -- 10.20.193.4:0/2170052114 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90040094b0 con 0x7f901410da00 2026-02-24T09:09:39.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.170+0000 7f9011d74640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f901410da00 0x7f90140614d0 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ffc004740 tx=0x7f8ffc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.170+0000 7f77634bf640 1 -- 10.20.193.4:0/2716049043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775c0603c0 con 0x7f775c155c60 2026-02-24T09:09:39.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.170+0000 7f8ffb7fe640 1 -- 10.20.193.4:0/2170052114 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ffc00cd40 con 0x7f901410da00 2026-02-24T09:09:39.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.170+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90141642f0 con 0x7f901410da00 2026-02-24T09:09:39.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.170+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9014164810 con 0x7f901410da00 2026-02-24T09:09:39.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.171+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901410e2f0 con 0x7f901410da00 2026-02-24T09:09:39.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.172+0000 7f774a7fc640 1 -- 10.20.193.4:0/2716049043 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f7758039b80 con 0x7f775c155c60 2026-02-24T09:09:39.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.172+0000 7f774a7fc640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77380b5770 0x7f77380d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.172+0000 7f7761234640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77380b5770 0x7f77380d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.172+0000 7f774a7fc640 1 -- 10.20.193.4:0/2716049043 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f775810c7d0 con 0x7f775c155c60 2026-02-24T09:09:39.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.173+0000 7f7761234640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77380b5770 0x7f77380d5c20 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f774c004740 tx=0x7f774c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.174+0000 7f8ffb7fe640 1 -- 10.20.193.4:0/2170052114 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8ffc0045a0 con 0x7f901410da00 2026-02-24T09:09:39.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.174+0000 7f8ffb7fe640 1 -- 10.20.193.4:0/2170052114 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ffc021dc0 con 0x7f901410da00 2026-02-24T09:09:39.184 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.174+0000 7f774a7fc640 1 -- 10.20.193.4:0/2716049043 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f77580cf230 con 0x7f775c155c60 2026-02-24T09:09:39.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.176+0000 7f8ffb7fe640 1 -- 10.20.193.4:0/2170052114 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f8ffc01f060 con 0x7f901410da00 2026-02-24T09:09:39.185 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.185 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.176+0000 7f8ffb7fe640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8fec0b57f0 0x7f8fec0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.176+0000 7f8ffb7fe640 1 -- 10.20.193.4:0/2170052114 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f8ffc014070 con 0x7f901410da00 2026-02-24T09:09:39.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.176+0000 7f9012575640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8fec0b57f0 0x7f8fec0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.177+0000 7f8ffb7fe640 1 -- 10.20.193.4:0/2170052114 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8ffc0a9770 con 0x7f901410da00 2026-02-24T09:09:39.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.177+0000 7f9012575640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8fec0b57f0 0x7f8fec0d5ca0 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90080082e0 tx=0x7f9008005050 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.187 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.246+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4b781766b0 con 0x7f4b78063070 2026-02-24T09:09:39.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.246+0000 7fd7324db640 1 -- 10.20.193.4:0/2290359781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd72c113200 msgr2=0x7fd72c173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.246+0000 7fd7324db640 1 --2- 10.20.193.4:0/2290359781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd72c113200 0x7fd72c173bd0 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=13853896330839825710 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd72000aa30 tx=0x7fd720030270 comp rx=0 tx=0).stop 2026-02-24T09:09:39.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.247+0000 7f4b757fa640 1 -- 10.20.193.4:0/337092164 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4b6c0d2df0 con 0x7f4b78063070 2026-02-24T09:09:39.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.246+0000 7fd7324db640 1 -- 10.20.193.4:0/2290359781 shutdown_connections 2026-02-24T09:09:39.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.247+0000 7fd7324db640 1 --2- 10.20.193.4:0/2290359781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd72c113200 0x7fd72c173bd0 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=13853896330839825710 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.247+0000 7fd7324db640 1 --2- 10.20.193.4:0/2290359781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd72c10da00 0x7fd72c112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.247+0000 7fd7324db640 1 --2- 10.20.193.4:0/2290359781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd72c10d010 0x7fd72c10d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.247+0000 7fd7324db640 1 -- 10.20.193.4:0/2290359781 >> 10.20.193.4:0/2290359781 conn(0x7fd72c05f830 msgr2=0x7fd72c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.247+0000 7fd7324db640 1 -- 10.20.193.4:0/2290359781 shutdown_connections 2026-02-24T09:09:39.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.247+0000 7fd7324db640 1 -- 10.20.193.4:0/2290359781 wait complete. 2026-02-24T09:09:39.252 INFO:teuthology.orchestra.run.trial004.stdout:128849018898 2026-02-24T09:09:39.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.247+0000 7fd7324db640 1 Processor -- start 2026-02-24T09:09:39.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.247+0000 7fd7324db640 1 -- start start 2026-02-24T09:09:39.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd7324db640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd72c10d010 0x7fd72c11b900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd7324db640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd72c10da00 0x7fd72c11be40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd7324db640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd72c113200 0x7fd72c121210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd7324db640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c121830 con 0x7fd72c113200 2026-02-24T09:09:39.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd7324db640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1219a0 con 0x7fd72c10d010 2026-02-24T09:09:39.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd7324db640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c121b60 con 0x7fd72c10da00 2026-02-24T09:09:39.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd730a51640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd72c113200 0x7fd72c121210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd730a51640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd72c113200 0x7fd72c121210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59718/0 (socket says 10.20.193.4:59718) 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd730a51640 1 -- 10.20.193.4:0/2143692865 learned_addr learned my addr 10.20.193.4:0/2143692865 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd72bfff640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd72c10d010 0x7fd72c11b900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd72b7fe640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd72c10da00 0x7fd72c11be40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd730a51640 1 -- 10.20.193.4:0/2143692865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd72c10da00 msgr2=0x7fd72c11be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd730a51640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd72c10da00 0x7fd72c11be40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd730a51640 1 -- 10.20.193.4:0/2143692865 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd72c10d010 msgr2=0x7fd72c11b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd730a51640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd72c10d010 0x7fd72c11b900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd730a51640 1 -- 10.20.193.4:0/2143692865 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72000a650 con 0x7fd72c113200 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.248+0000 7fd730a51640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd72c113200 0x7fd72c121210 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd720032fe0 tx=0x7fd720030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.249+0000 7fd7297fa640 1 -- 10.20.193.4:0/2143692865 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd72003e070 con 0x7fd72c113200 2026-02-24T09:09:39.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.249+0000 7fd7297fa640 1 -- 10.20.193.4:0/2143692865 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd720003b50 con 0x7fd72c113200 2026-02-24T09:09:39.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.249+0000 7fd7297fa640 1 -- 10.20.193.4:0/2143692865 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7200429d0 con 0x7fd72c113200 2026-02-24T09:09:39.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.249+0000 7fd7324db640 1 -- 10.20.193.4:0/2143692865 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72c121de0 con 0x7fd72c113200 2026-02-24T09:09:39.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.249+0000 7fd7324db640 1 -- 10.20.193.4:0/2143692865 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72c060e70 con 0x7fd72c113200 2026-02-24T09:09:39.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.250+0000 7fd7324db640 1 -- 10.20.193.4:0/2143692865 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72c10e2f0 con 0x7fd72c113200 2026-02-24T09:09:39.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.250+0000 7f1f700d5640 1 -- 10.20.193.4:0/1781951622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f6810ba60 msgr2=0x7f1f6810be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.250+0000 7f1f700d5640 1 --2- 10.20.193.4:0/1781951622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f6810ba60 0x7f1f6810be30 secure :-1 s=READY pgs=89 gs=2 cs=0 l=1 c_cookie=4295981225187422872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f58009950 tx=0x7f1f5802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.250+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4b580b57f0 msgr2=0x7f4b580d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.250+0000 7f4b7e2ae640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4b580b57f0 0x7f4b580d5ca0 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b64005970 tx=0x7f4b64005900 comp rx=0 tx=0).stop 2026-02-24T09:09:39.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.250+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4b78063070 msgr2=0x7f4b7817a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.250+0000 7f4b7e2ae640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4b78063070 0x7f4b7817a150 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b6c006ad0 tx=0x7f4b6c0037a0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.251+0000 7fd7297fa640 1 -- 10.20.193.4:0/2143692865 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fd720042b60 con 0x7fd72c113200 2026-02-24T09:09:39.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.251+0000 7f1f700d5640 1 -- 10.20.193.4:0/1781951622 shutdown_connections 2026-02-24T09:09:39.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.251+0000 7f1f700d5640 1 --2- 10.20.193.4:0/1781951622 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f68111c50 0x7f1f68172620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.251+0000 7f1f700d5640 1 --2- 10.20.193.4:0/1781951622 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f6810c450 0x7f1f681114a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.251+0000 7f1f700d5640 1 --2- 10.20.193.4:0/1781951622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f6810ba60 0x7f1f6810be30 unknown :-1 s=CLOSED pgs=89 gs=2 cs=0 l=1 c_cookie=4295981225187422872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.251+0000 7f1f700d5640 1 -- 10.20.193.4:0/1781951622 >> 10.20.193.4:0/1781951622 conn(0x7f1f680e9370 msgr2=0x7f1f68109780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.251+0000 7f1f700d5640 1 -- 10.20.193.4:0/1781951622 shutdown_connections 2026-02-24T09:09:39.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.251+0000 7f1f700d5640 1 -- 10.20.193.4:0/1781951622 wait complete. 2026-02-24T09:09:39.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7fd7297fa640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd7000b58c0 0x7fd7000d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7fd7297fa640 1 -- 10.20.193.4:0/2143692865 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fd72010c7b0 con 0x7fd72c113200 2026-02-24T09:09:39.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7fd72bfff640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd7000b58c0 0x7fd7000d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f1f700d5640 1 Processor -- start 2026-02-24T09:09:39.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 shutdown_connections 2026-02-24T09:09:39.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f4b7e2ae640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4b580b57f0 0x7f4b580d5ca0 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f4b7e2ae640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4b78159ed0 0x7f4b78175970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f4b7e2ae640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b78066a30 0x7f4b781753b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f4b7e2ae640 1 --2- 10.20.193.4:0/337092164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4b78063070 0x7f4b7817a150 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 >> 10.20.193.4:0/337092164 conn(0x7f4b780ecf70 msgr2=0x7f4b7810d350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 shutdown_connections 2026-02-24T09:09:39.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f4b7e2ae640 1 -- 10.20.193.4:0/337092164 wait complete. 2026-02-24T09:09:39.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f1f700d5640 1 -- start start 2026-02-24T09:09:39.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7fd72bfff640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd7000b58c0 0x7fd7000d5d70 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd718004740 tx=0x7fd718005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f1f700d5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f6810ba60 0x7f1f680f1ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f1f700d5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f6810c450 0x7f1f680f2000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f1f700d5640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f68111c50 0x7f1f680f73d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f1f700d5640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f1f680f79f0 con 0x7f1f6810c450 2026-02-24T09:09:39.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f1f700d5640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f1f680f7b60 con 0x7f1f68111c50 2026-02-24T09:09:39.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.252+0000 7f1f700d5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1f680f7d20 con 0x7f1f6810ba60 2026-02-24T09:09:39.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6d649640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f6810c450 0x7f1f680f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6de4a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f6810ba60 0x7f1f680f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6d649640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f6810c450 0x7f1f680f2000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59726/0 (socket says 10.20.193.4:59726) 2026-02-24T09:09:39.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6d649640 1 -- 10.20.193.4:0/4173935402 learned_addr learned my addr 10.20.193.4:0/4173935402 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6e64b640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f68111c50 0x7f1f680f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f406da9c640 1 -- 10.20.193.4:0/2149521313 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f40680fbb10 con 0x7f406810d010 2026-02-24T09:09:39.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6d649640 1 -- 10.20.193.4:0/4173935402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f6810ba60 msgr2=0x7f1f680f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6d649640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f6810ba60 0x7f1f680f1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6d649640 1 -- 10.20.193.4:0/4173935402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f68111c50 msgr2=0x7f1f680f73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6d649640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f68111c50 0x7f1f680f73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6d649640 1 -- 10.20.193.4:0/4173935402 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f58009570 con 0x7f1f6810c450 2026-02-24T09:09:39.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f6d649640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f6810c450 0x7f1f680f2000 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f5c00b500 tx=0x7f1f5c00b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7fd7297fa640 1 -- 10.20.193.4:0/2143692865 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fd7200cf300 con 0x7fd72c113200 2026-02-24T09:09:39.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f4064ff9640 1 -- 10.20.193.4:0/2149521313 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f40540ac690 con 0x7f406810d010 2026-02-24T09:09:39.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f56ffd640 1 -- 10.20.193.4:0/4173935402 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f5c0044a0 con 0x7f1f6810c450 2026-02-24T09:09:39.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.253+0000 7f1f700d5640 1 -- 10.20.193.4:0/4173935402 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f680f8000 con 0x7f1f6810c450 2026-02-24T09:09:39.267 INFO:teuthology.orchestra.run.trial004.stdout:98784247829 2026-02-24T09:09:39.267 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.254+0000 7f1f700d5640 1 -- 10.20.193.4:0/4173935402 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f68112790 con 0x7f1f6810c450 2026-02-24T09:09:39.267 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.254+0000 7f1f56ffd640 1 -- 10.20.193.4:0/4173935402 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1f5c002b80 con 0x7f1f6810c450 2026-02-24T09:09:39.267 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.254+0000 7f1f56ffd640 1 -- 10.20.193.4:0/4173935402 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f5c00fd90 con 0x7f1f6810c450 2026-02-24T09:09:39.267 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.254+0000 7f1f700d5640 1 -- 10.20.193.4:0/4173935402 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6810cd40 con 0x7f1f6810c450 2026-02-24T09:09:39.268 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.256+0000 7f406da9c640 1 -- 10.20.193.4:0/2149521313 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f403c0b57e0 msgr2=0x7f403c0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.268 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.256+0000 7f406da9c640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f403c0b57e0 0x7f403c0d5c90 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40680fbef0 tx=0x7f405800b410 comp rx=0 tx=0).stop 2026-02-24T09:09:39.268 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.256+0000 7f406da9c640 1 -- 10.20.193.4:0/2149521313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f406810d010 msgr2=0x7f40680f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.268 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.256+0000 7f406da9c640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f406810d010 0x7f40680f5550 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40540072a0 tx=0x7f405400dd70 comp rx=0 tx=0).stop 2026-02-24T09:09:39.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.256+0000 7f1f56ffd640 1 -- 10.20.193.4:0/4173935402 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f1f5c0026a0 con 0x7f1f6810c450 2026-02-24T09:09:39.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.257+0000 7f1f56ffd640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f440b5870 0x7f1f440d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.257+0000 7f1f6de4a640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f440b5870 0x7f1f440d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.257+0000 7f1f56ffd640 1 -- 10.20.193.4:0/4173935402 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f1f5c0e6680 con 0x7f1f6810c450 2026-02-24T09:09:39.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.258+0000 7f406da9c640 1 -- 10.20.193.4:0/2149521313 shutdown_connections 2026-02-24T09:09:39.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.258+0000 7f406da9c640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f403c0b57e0 0x7f403c0d5c90 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.258+0000 7f406da9c640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4068113200 0x7f40680f5c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.258+0000 7f406da9c640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f406810da00 0x7f4068173ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.258+0000 7f406da9c640 1 --2- 10.20.193.4:0/2149521313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f406810d010 0x7f40680f5550 unknown :-1 s=CLOSED pgs=321 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.258+0000 7f406da9c640 1 -- 10.20.193.4:0/2149521313 >> 10.20.193.4:0/2149521313 conn(0x7f406805f830 msgr2=0x7f406810bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.258+0000 7f1f6de4a640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f440b5870 0x7f1f440d5d20 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f580098a0 tx=0x7f1f58031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.258+0000 7f1f56ffd640 1 -- 10.20.193.4:0/4173935402 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f1f5c0a90e0 con 0x7f1f6810c450 2026-02-24T09:09:39.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.258+0000 7f406da9c640 1 -- 10.20.193.4:0/2149521313 shutdown_connections 2026-02-24T09:09:39.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.258+0000 7f406da9c640 1 -- 10.20.193.4:0/2149521313 wait complete. 2026-02-24T09:09:39.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fdfaf567640 1 -- 10.20.193.4:0/2035630348 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfa80618e0 msgr2=0x7fdfa81551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fdfaf567640 1 --2- 10.20.193.4:0/2035630348 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfa80618e0 0x7fdfa81551f0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=6398802686576524221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf98009950 tx=0x7fdf9802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fdfaf567640 1 -- 10.20.193.4:0/2035630348 shutdown_connections 2026-02-24T09:09:39.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fdfaf567640 1 --2- 10.20.193.4:0/2035630348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfa8155730 0x7fdfa8175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fdfaf567640 1 --2- 10.20.193.4:0/2035630348 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfa80618e0 0x7fdfa81551f0 unknown :-1 s=CLOSED pgs=329 gs=1 cs=0 l=1 c_cookie=6398802686576524221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fdfaf567640 1 --2- 10.20.193.4:0/2035630348 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfa8060fd0 0x7fdfa80613a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fdfaf567640 1 -- 10.20.193.4:0/2035630348 >> 10.20.193.4:0/2035630348 conn(0x7fdfa805f830 msgr2=0x7fdfa810ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fdfaf567640 1 -- 10.20.193.4:0/2035630348 shutdown_connections 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fdfaf567640 1 -- 10.20.193.4:0/2035630348 wait complete. 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfaf567640 1 Processor -- start 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfaf567640 1 -- start start 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfaf567640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfa8060fd0 0x7fdfa8161ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfaf567640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfa80618e0 0x7fdfa81623e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfaf567640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfa8155730 0x7fdfa81677b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfaf567640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa8167dd0 con 0x7fdfa8155730 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfaf567640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa8167f40 con 0x7fdfa8060fd0 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfaf567640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa8168100 con 0x7fdfa80618e0 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfadadd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfa8155730 0x7fdfa81677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfadadd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfa8155730 0x7fdfa81677b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59760/0 (socket says 10.20.193.4:59760) 2026-02-24T09:09:39.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfadadd640 1 -- 10.20.193.4:0/3562394203 learned_addr learned my addr 10.20.193.4:0/3562394203 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfacadb640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfa80618e0 0x7fdfa81623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfad2dc640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfa8060fd0 0x7fdfa8161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfadadd640 1 -- 10.20.193.4:0/3562394203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfa80618e0 msgr2=0x7fdfa81623e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfadadd640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfa80618e0 0x7fdfa81623e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfadadd640 1 -- 10.20.193.4:0/3562394203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfa8060fd0 msgr2=0x7fdfa8161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfadadd640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfa8060fd0 0x7fdfa8161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.260+0000 7fdfadadd640 1 -- 10.20.193.4:0/3562394203 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf98009570 con 0x7fdfa8155730 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.261+0000 7fdfadadd640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfa8155730 0x7fdfa81677b0 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfa400f940 tx=0x7fdfa400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.261+0000 7fdf967fc640 1 -- 10.20.193.4:0/3562394203 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfa400dda0 con 0x7fdfa8155730 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.261+0000 7fdf967fc640 1 -- 10.20.193.4:0/3562394203 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfa4005e10 con 0x7fdfa8155730 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.261+0000 7fdf967fc640 1 -- 10.20.193.4:0/3562394203 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfa40116b0 con 0x7fdfa8155730 2026-02-24T09:09:39.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.261+0000 7fdfaf567640 1 -- 10.20.193.4:0/3562394203 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa81683e0 con 0x7fdfa8155730 2026-02-24T09:09:39.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.261+0000 7fdfaf567640 1 -- 10.20.193.4:0/3562394203 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa8151350 con 0x7fdfa8155730 2026-02-24T09:09:39.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fdfaf567640 1 -- 10.20.193.4:0/3562394203 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa8168600 con 0x7fdfa8155730 2026-02-24T09:09:39.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fb4f8994640 1 -- 10.20.193.4:0/2215981543 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4f0067d30 msgr2=0x7fb4f006cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fb4f8994640 1 --2- 10.20.193.4:0/2215981543 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4f0067d30 0x7fb4f006cd80 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=3276285045327289816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4dc009950 tx=0x7fb4dc02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fb4f8994640 1 -- 10.20.193.4:0/2215981543 shutdown_connections 2026-02-24T09:09:39.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fb4f8994640 1 --2- 10.20.193.4:0/2215981543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4f006d510 0x7fb4f006def0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fb4f8994640 1 --2- 10.20.193.4:0/2215981543 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4f0067d30 0x7fb4f006cd80 unknown :-1 s=CLOSED pgs=330 gs=1 cs=0 l=1 c_cookie=3276285045327289816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fb4f8994640 1 --2- 10.20.193.4:0/2215981543 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4f0067340 0x7fb4f0067710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.259+0000 7fb4f8994640 1 -- 10.20.193.4:0/2215981543 >> 10.20.193.4:0/2215981543 conn(0x7fb4f0064c40 msgr2=0x7fb4f0065040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f8994640 1 -- 10.20.193.4:0/2215981543 shutdown_connections 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f8994640 1 -- 10.20.193.4:0/2215981543 wait complete. 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f8994640 1 Processor -- start 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f8994640 1 -- start start 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f8994640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4f0067340 0x7fb4f005e460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f8994640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4f0067d30 0x7fb4f005e9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f8994640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4f006d510 0x7fb4f0126540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f8994640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f0126b40 con 0x7fb4f0067340 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f6709640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4f0067340 0x7fb4f005e460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f8994640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f0126cb0 con 0x7fb4f0067d30 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f8994640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f0126e70 con 0x7fb4f006d510 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f6709640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4f0067340 0x7fb4f005e460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59766/0 (socket says 10.20.193.4:59766) 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.262+0000 7fb4f6709640 1 -- 10.20.193.4:0/1046951157 learned_addr learned my addr 10.20.193.4:0/1046951157 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f6f0a640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4f006d510 0x7fb4f0126540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f5f08640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4f0067d30 0x7fb4f005e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f6709640 1 -- 10.20.193.4:0/1046951157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4f006d510 msgr2=0x7fb4f0126540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f6709640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4f006d510 0x7fb4f0126540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f6709640 1 -- 10.20.193.4:0/1046951157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4f0067d30 msgr2=0x7fb4f005e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f6709640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4f0067d30 0x7fb4f005e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f6709640 1 -- 10.20.193.4:0/1046951157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4dc009570 con 0x7fb4f0067340 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f6f0a640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4f006d510 0x7fb4f0126540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:39.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f6709640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4f0067340 0x7fb4f005e460 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4e80072a0 tx=0x7fb4e800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4db7fe640 1 -- 10.20.193.4:0/1046951157 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4e8004500 con 0x7fb4f0067340 2026-02-24T09:09:39.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4db7fe640 1 -- 10.20.193.4:0/1046951157 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb4e800bd20 con 0x7fb4f0067340 2026-02-24T09:09:39.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4db7fe640 1 -- 10.20.193.4:0/1046951157 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4e8002ea0 con 0x7fb4f0067340 2026-02-24T09:09:39.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f8994640 1 -- 10.20.193.4:0/1046951157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f0127150 con 0x7fb4f0067340 2026-02-24T09:09:39.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fb4f8994640 1 -- 10.20.193.4:0/1046951157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f016aad0 con 0x7fb4f0067340 2026-02-24T09:09:39.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.263+0000 7fdf967fc640 1 -- 10.20.193.4:0/3562394203 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fdfa4020060 con 0x7fdfa8155730 2026-02-24T09:09:39.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.264+0000 7fb4d97fa640 1 -- 10.20.193.4:0/1046951157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4bc005300 con 0x7fb4f0067340 2026-02-24T09:09:39.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.264+0000 7fdf967fc640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf840b5870 0x7fdf840d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.264+0000 7fdfad2dc640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf840b5870 0x7fdf840d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.264+0000 7fdf967fc640 1 -- 10.20.193.4:0/3562394203 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fdfa4015070 con 0x7fdfa8155730 2026-02-24T09:09:39.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.265+0000 7fdfad2dc640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf840b5870 0x7fdf840d5d20 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf9c004740 tx=0x7fdf9c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.266+0000 7fb4db7fe640 1 -- 10.20.193.4:0/1046951157 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fb4e800b840 con 0x7fb4f0067340 2026-02-24T09:09:39.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.266+0000 7fb4db7fe640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4cc0b57f0 0x7fb4cc0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.266+0000 7fb4db7fe640 1 -- 10.20.193.4:0/1046951157 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb4e80e6c10 con 0x7fb4f0067340 2026-02-24T09:09:39.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.267+0000 7fb4f5f08640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4cc0b57f0 0x7fb4cc0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.267+0000 7fb4f5f08640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4cc0b57f0 0x7fb4cc0d5ca0 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4dc009350 tx=0x7fb4dc031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.268+0000 7fdf967fc640 1 -- 10.20.193.4:0/3562394203 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fdfa40aa5f0 con 0x7fdfa8155730 2026-02-24T09:09:39.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.271+0000 7fb4db7fe640 1 -- 10.20.193.4:0/1046951157 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fb4e80a95a0 con 0x7fb4f0067340 2026-02-24T09:09:39.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.302+0000 7f1fa2019640 1 -- 10.20.193.4:0/707867423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9c10d010 msgr2=0x7f1f9c10d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.302+0000 7f1fa2019640 1 --2- 10.20.193.4:0/707867423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9c10d010 0x7f1f9c10d3e0 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=12811417632207470087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f88009950 tx=0x7f1f8802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.302+0000 7f1fa2019640 1 -- 10.20.193.4:0/707867423 shutdown_connections 2026-02-24T09:09:39.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.302+0000 7f1fa2019640 1 --2- 10.20.193.4:0/707867423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f9c113200 0x7f1f9c173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.302+0000 7f1fa2019640 1 --2- 10.20.193.4:0/707867423 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9c10da00 0x7f1f9c112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.302+0000 7f1fa2019640 1 --2- 10.20.193.4:0/707867423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9c10d010 0x7f1f9c10d3e0 unknown :-1 s=CLOSED pgs=70 gs=1 cs=0 l=1 c_cookie=12811417632207470087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.302+0000 7f1fa2019640 1 -- 10.20.193.4:0/707867423 >> 10.20.193.4:0/707867423 conn(0x7f1f9c05f830 msgr2=0x7f1f9c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.302+0000 7f1fa2019640 1 -- 10.20.193.4:0/707867423 shutdown_connections 2026-02-24T09:09:39.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.302+0000 7f1fa2019640 1 -- 10.20.193.4:0/707867423 wait complete. 2026-02-24T09:09:39.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.302+0000 7f1fa2019640 1 Processor -- start 2026-02-24T09:09:39.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1fa2019640 1 -- start start 2026-02-24T09:09:39.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1fa2019640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f9c10d010 0x7f1f9c11b9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1fa2019640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9c10da00 0x7f1f9c11bf20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1fa2019640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9c113200 0x7f1f9c1212a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1fa2019640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c1218c0 con 0x7f1f9c10da00 2026-02-24T09:09:39.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1fa2019640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c121a30 con 0x7f1f9c113200 2026-02-24T09:09:39.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1fa2019640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c121bf0 con 0x7f1f9c10d010 2026-02-24T09:09:39.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9c10da00 0x7f1f9c11bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9c10da00 0x7f1f9c11bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59794/0 (socket says 10.20.193.4:59794) 2026-02-24T09:09:39.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9affd640 1 -- 10.20.193.4:0/3588938351 learned_addr learned my addr 10.20.193.4:0/3588938351 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9b7fe640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f9c10d010 0x7f1f9c11b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9bfff640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9c113200 0x7f1f9c1212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f77634bf640 1 -- 10.20.193.4:0/2716049043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f775c173840 con 0x7f775c155c60 2026-02-24T09:09:39.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9affd640 1 -- 10.20.193.4:0/3588938351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f9c10d010 msgr2=0x7f1f9c11b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9affd640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f9c10d010 0x7f1f9c11b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9affd640 1 -- 10.20.193.4:0/3588938351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9c113200 msgr2=0x7f1f9c1212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9affd640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9c113200 0x7f1f9c1212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9affd640 1 -- 10.20.193.4:0/3588938351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f88009570 con 0x7f1f9c10da00 2026-02-24T09:09:39.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.303+0000 7f1f9affd640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9c10da00 0x7f1f9c11bf20 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f8c009480 tx=0x7f1f8c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7f774a7fc640 1 -- 10.20.193.4:0/2716049043 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f77580d23e0 con 0x7f775c155c60 2026-02-24T09:09:39.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7f1f98ff9640 1 -- 10.20.193.4:0/3588938351 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f8c011910 con 0x7f1f9c10da00 2026-02-24T09:09:39.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7f1f98ff9640 1 -- 10.20.193.4:0/3588938351 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1f8c004850 con 0x7f1f9c10da00 2026-02-24T09:09:39.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7f1f98ff9640 1 -- 10.20.193.4:0/3588938351 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f8c012740 con 0x7f1f9c10da00 2026-02-24T09:09:39.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7f1fa2019640 1 -- 10.20.193.4:0/3588938351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c121ed0 con 0x7f1f9c10da00 2026-02-24T09:09:39.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7f1fa2019640 1 -- 10.20.193.4:0/3588938351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c060e70 con 0x7f1f9c10da00 2026-02-24T09:09:39.313 INFO:teuthology.orchestra.run.trial004.stdout:176093659152 2026-02-24T09:09:39.314 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018898 got 128849018898 for osd.4 2026-02-24T09:09:39.315 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7fe0119a3640 1 -- 10.20.193.4:0/3348635280 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe00c10da00 msgr2=0x7fe00c112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7fe0119a3640 1 --2- 10.20.193.4:0/3348635280 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe00c10da00 0x7fe00c112a50 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=13017392017851428184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdff4009950 tx=0x7fdff402f1b0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7fe0119a3640 1 -- 10.20.193.4:0/3348635280 shutdown_connections 2026-02-24T09:09:39.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7fe0119a3640 1 --2- 10.20.193.4:0/3348635280 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe00c113200 0x7fe00c173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7fe0119a3640 1 --2- 10.20.193.4:0/3348635280 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe00c10da00 0x7fe00c112a50 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=13017392017851428184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7fe0119a3640 1 --2- 10.20.193.4:0/3348635280 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe00c10d010 0x7fe00c10d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7fe0119a3640 1 -- 10.20.193.4:0/3348635280 >> 10.20.193.4:0/3348635280 conn(0x7fe00c05f830 msgr2=0x7fe00c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7fe0119a3640 1 -- 10.20.193.4:0/3348635280 shutdown_connections 2026-02-24T09:09:39.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.304+0000 7fe0119a3640 1 -- 10.20.193.4:0/3348635280 wait complete. 2026-02-24T09:09:39.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7f1fa2019640 1 -- 10.20.193.4:0/3588938351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c10e2f0 con 0x7f1f9c10da00 2026-02-24T09:09:39.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe0119a3640 1 Processor -- start 2026-02-24T09:09:39.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe0119a3640 1 -- start start 2026-02-24T09:09:39.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe0119a3640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe00c10d010 0x7fe00c060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe0119a3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe00c10da00 0x7fe00c173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe0119a3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe00c113200 0x7fe00c0614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f901410d3e0 con 0x7f901410da00 2026-02-24T09:09:39.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe00affd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe00c10d010 0x7fe00c060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe0119a3640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c061a10 con 0x7fe00c113200 2026-02-24T09:09:39.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe0119a3640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c061b80 con 0x7fe00c10d010 2026-02-24T09:09:39.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe0119a3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c061d40 con 0x7fe00c10da00 2026-02-24T09:09:39.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe00affd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe00c10d010 0x7fe00c060f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:53590/0 (socket says 10.20.193.4:53590) 2026-02-24T09:09:39.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7fe00affd640 1 -- 10.20.193.4:0/1316864319 learned_addr learned my addr 10.20.193.4:0/1316864319 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe00b7fe640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe00c113200 0x7fe00c0614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe00a7fc640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe00c10da00 0x7fe00c173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.305+0000 7f8ffb7fe640 1 -- 10.20.193.4:0/2170052114 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ffc0ac890 con 0x7f901410da00 2026-02-24T09:09:39.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe00affd640 1 -- 10.20.193.4:0/1316864319 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe00c10da00 msgr2=0x7fe00c173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe00affd640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe00c10da00 0x7fe00c173ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe00affd640 1 -- 10.20.193.4:0/1316864319 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe00c113200 msgr2=0x7fe00c0614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe00affd640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe00c113200 0x7fe00c0614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe00affd640 1 -- 10.20.193.4:0/1316864319 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff4009570 con 0x7fe00c10d010 2026-02-24T09:09:39.323 INFO:teuthology.orchestra.run.trial004.stdout:68719476757 2026-02-24T09:09:39.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe00affd640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe00c10d010 0x7fe00c060f90 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe00000d950 tx=0x7fe00000de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7f1f98ff9640 1 -- 10.20.193.4:0/3588938351 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f1f8c0049c0 con 0x7f1f9c10da00 2026-02-24T09:09:39.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe0109a1640 1 -- 10.20.193.4:0/1316864319 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe000004540 con 0x7fe00c10d010 2026-02-24T09:09:39.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe0109a1640 1 -- 10.20.193.4:0/1316864319 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe000009d00 con 0x7fe00c10d010 2026-02-24T09:09:39.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe0109a1640 1 -- 10.20.193.4:0/1316864319 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0000106e0 con 0x7fe00c10d010 2026-02-24T09:09:39.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe0119a3640 1 -- 10.20.193.4:0/1316864319 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c0fb6f0 con 0x7fe00c10d010 2026-02-24T09:09:39.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.306+0000 7fe0119a3640 1 -- 10.20.193.4:0/1316864319 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00c0fbc10 con 0x7fe00c10d010 2026-02-24T09:09:39.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.307+0000 7f1f98ff9640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f700b58c0 0x7f1f700d5d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.307+0000 7f1f98ff9640 1 -- 10.20.193.4:0/3588938351 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f1f8c0ea970 con 0x7f1f9c10da00 2026-02-24T09:09:39.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.307+0000 7f1f9b7fe640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f700b58c0 0x7f1f700d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.307+0000 7f77634bf640 1 -- 10.20.193.4:0/2716049043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77380b5770 msgr2=0x7f77380d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.307+0000 7f77634bf640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77380b5770 0x7f77380d5c20 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f774c004740 tx=0x7f774c005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:39.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.307+0000 7f77634bf640 1 -- 10.20.193.4:0/2716049043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f775c155c60 msgr2=0x7f775c172fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.307+0000 7f77634bf640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f775c155c60 0x7f775c172fc0 secure :-1 s=READY pgs=324 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f775800a310 tx=0x7f77580039b0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.307+0000 7fe0119a3640 1 -- 10.20.193.4:0/1316864319 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe00c10e2f0 con 0x7fe00c10d010 2026-02-24T09:09:39.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.307+0000 7f1f9b7fe640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f700b58c0 0x7f1f700d5d70 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f880098a0 tx=0x7f1f8803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.308+0000 7f77634bf640 1 -- 10.20.193.4:0/2716049043 shutdown_connections 2026-02-24T09:09:39.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.308+0000 7f77634bf640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77380b5770 0x7f77380d5c20 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.308+0000 7f77634bf640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f775c155c60 0x7f775c172fc0 unknown :-1 s=CLOSED pgs=324 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.308+0000 7f77634bf640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f775c10c840 0x7f775c172a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.308+0000 7f77634bf640 1 --2- 10.20.193.4:0/2716049043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f775c10bf30 0x7f775c172540 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.308+0000 7f77634bf640 1 -- 10.20.193.4:0/2716049043 >> 10.20.193.4:0/2716049043 conn(0x7f775c0e9bf0 msgr2=0x7f775c109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.308+0000 7f77634bf640 1 -- 10.20.193.4:0/2716049043 shutdown_connections 2026-02-24T09:09:39.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.308+0000 7f77634bf640 1 -- 10.20.193.4:0/2716049043 wait complete. 2026-02-24T09:09:39.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.308+0000 7fe0109a1640 1 -- 10.20.193.4:0/1316864319 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fe0000097c0 con 0x7fe00c10d010 2026-02-24T09:09:39.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.309+0000 7fe0109a1640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfe00b57e0 0x7fdfe00d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.309+0000 7fe0109a1640 1 -- 10.20.193.4:0/1316864319 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fe0000e6d70 con 0x7fe00c10d010 2026-02-24T09:09:39.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.309+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8fec0b57f0 msgr2=0x7f8fec0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.309+0000 7f9018ea9640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8fec0b57f0 0x7f8fec0d5ca0 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90080082e0 tx=0x7f9008005050 comp rx=0 tx=0).stop 2026-02-24T09:09:39.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.309+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f901410da00 msgr2=0x7f90140614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.309+0000 7f9018ea9640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f901410da00 0x7f90140614d0 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ffc004740 tx=0x7f8ffc00ee60 comp rx=0 tx=0).stop 2026-02-24T09:09:39.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7fe00a7fc640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfe00b57e0 0x7fdfe00d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7fe00a7fc640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfe00b57e0 0x7fdfe00d5c90 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdff40023d0 tx=0x7fdff4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 -- 10.20.193.4:0/3146238698 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5c114a10 msgr2=0x7f3a5c119560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 --2- 10.20.193.4:0/3146238698 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5c114a10 0x7f3a5c119560 secure :-1 s=READY pgs=335 gs=1 cs=0 l=1 c_cookie=3741175355006075058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a44009950 tx=0x7f3a4402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 shutdown_connections 2026-02-24T09:09:39.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f9018ea9640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8fec0b57f0 0x7f8fec0d5ca0 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f9018ea9640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9014113200 0x7f9014061a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f9018ea9640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f901410da00 0x7f90140614d0 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f9018ea9640 1 --2- 10.20.193.4:0/2170052114 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f901410d010 0x7f9014060f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 >> 10.20.193.4:0/2170052114 conn(0x7f901405f830 msgr2=0x7f901410ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 -- 10.20.193.4:0/3146238698 shutdown_connections 2026-02-24T09:09:39.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 --2- 10.20.193.4:0/3146238698 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5c119d10 0x7f3a5c17a6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 --2- 10.20.193.4:0/3146238698 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5c114a10 0x7f3a5c119560 unknown :-1 s=CLOSED pgs=335 gs=1 cs=0 l=1 c_cookie=3741175355006075058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 --2- 10.20.193.4:0/3146238698 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5c114020 0x7f3a5c1143f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 -- 10.20.193.4:0/3146238698 >> 10.20.193.4:0/3146238698 conn(0x7f3a5c064c40 msgr2=0x7f3a5c065040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 -- 10.20.193.4:0/3146238698 shutdown_connections 2026-02-24T09:09:39.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 -- 10.20.193.4:0/3146238698 wait complete. 2026-02-24T09:09:39.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 shutdown_connections 2026-02-24T09:09:39.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 Processor -- start 2026-02-24T09:09:39.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.310+0000 7f3a62e32640 1 -- start start 2026-02-24T09:09:39.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a62e32640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5c114020 0x7f3a5c0fbc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a62e32640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5c114a10 0x7f3a5c17a5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a62e32640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5c119d10 0x7f3a5c0fc390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a62e32640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c1015a0 con 0x7f3a5c114a10 2026-02-24T09:09:39.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a62e32640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c101710 con 0x7f3a5c119d10 2026-02-24T09:09:39.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a62e32640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c1018d0 con 0x7f3a5c114020 2026-02-24T09:09:39.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a53fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5c114a10 0x7f3a5c17a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a613a8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5c119d10 0x7f3a5c0fc390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a53fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5c114a10 0x7f3a5c17a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59844/0 (socket says 10.20.193.4:59844) 2026-02-24T09:09:39.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a53fff640 1 -- 10.20.193.4:0/2324330126 learned_addr learned my addr 10.20.193.4:0/2324330126 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f9018ea9640 1 -- 10.20.193.4:0/2170052114 wait complete. 2026-02-24T09:09:39.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a60ba7640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5c114020 0x7f3a5c0fbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a53fff640 1 -- 10.20.193.4:0/2324330126 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5c114020 msgr2=0x7f3a5c0fbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a53fff640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5c114020 0x7f3a5c0fbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a53fff640 1 -- 10.20.193.4:0/2324330126 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5c119d10 msgr2=0x7f3a5c0fc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a53fff640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5c119d10 0x7f3a5c0fc390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a53fff640 1 -- 10.20.193.4:0/2324330126 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a44009570 con 0x7f3a5c114a10 2026-02-24T09:09:39.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a53fff640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5c114a10 0x7f3a5c17a5e0 secure :-1 s=READY pgs=337 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a44038820 tx=0x7f3a440028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a51ffb640 1 -- 10.20.193.4:0/2324330126 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a4403d070 con 0x7f3a5c114a10 2026-02-24T09:09:39.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a51ffb640 1 -- 10.20.193.4:0/2324330126 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a44038920 con 0x7f3a5c114a10 2026-02-24T09:09:39.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a51ffb640 1 -- 10.20.193.4:0/2324330126 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a44041940 con 0x7f3a5c114a10 2026-02-24T09:09:39.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a62e32640 1 -- 10.20.193.4:0/2324330126 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c101b50 con 0x7f3a5c114a10 2026-02-24T09:09:39.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7fe0109a1640 1 -- 10.20.193.4:0/1316864319 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe0000a9700 con 0x7fe00c10d010 2026-02-24T09:09:39.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f3a62e32640 1 -- 10.20.193.4:0/2324330126 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c101f70 con 0x7f3a5c114a10 2026-02-24T09:09:39.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f9bac504640 1 -- 10.20.193.4:0/3702757638 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ba4159f00 msgr2=0x7f9ba417a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.311+0000 7f9bac504640 1 --2- 10.20.193.4:0/3702757638 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ba4159f00 0x7f9ba417a320 secure :-1 s=READY pgs=336 gs=3 cs=0 l=1 c_cookie=15549069560250931241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ba000aa30 tx=0x7f9ba0030280 comp rx=0 tx=0).stop 2026-02-24T09:09:39.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.312+0000 7f9bac504640 1 -- 10.20.193.4:0/3702757638 shutdown_connections 2026-02-24T09:09:39.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.312+0000 7f9bac504640 1 --2- 10.20.193.4:0/3702757638 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ba4159f00 0x7f9ba417a320 unknown :-1 s=CLOSED pgs=336 gs=3 cs=0 l=1 c_cookie=15549069560250931241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.312+0000 7f9bac504640 1 --2- 10.20.193.4:0/3702757638 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ba40676d0 0x7f9ba4067b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.312+0000 7f9bac504640 1 --2- 10.20.193.4:0/3702757638 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ba4069150 0x7f9ba4067190 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.312+0000 7f9bac504640 1 -- 10.20.193.4:0/3702757638 >> 10.20.193.4:0/3702757638 conn(0x7f9ba4064cc0 msgr2=0x7f9ba40650c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.312+0000 7f9bac504640 1 -- 10.20.193.4:0/3702757638 shutdown_connections 2026-02-24T09:09:39.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.312+0000 7f9bac504640 1 -- 10.20.193.4:0/3702757638 wait complete. 2026-02-24T09:09:39.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.312+0000 7f1f98ff9640 1 -- 10.20.193.4:0/3588938351 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f1f8c0ad300 con 0x7f1f9c10da00 2026-02-24T09:09:39.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f3a51ffb640 1 -- 10.20.193.4:0/2324330126 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f3a44038a90 con 0x7f3a5c114a10 2026-02-24T09:09:39.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f3a62e32640 1 -- 10.20.193.4:0/2324330126 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c114e00 con 0x7f3a5c114a10 2026-02-24T09:09:39.339 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247828 got 98784247829 for osd.3 2026-02-24T09:09:39.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f3a51ffb640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a380b57f0 0x7f3a380d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f3a51ffb640 1 -- 10.20.193.4:0/2324330126 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f3a4410ae30 con 0x7f3a5c114a10 2026-02-24T09:09:39.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f3a60ba7640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a380b57f0 0x7f3a380d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.340 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9bac504640 1 Processor -- start 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9bac504640 1 -- start start 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9bac504640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ba40676d0 0x7f9ba40f8c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9bac504640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ba4069150 0x7f9ba40f9140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9bac504640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ba4159f00 0x7f9ba40fe510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9bac504640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40feb30 con 0x7f9ba40676d0 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9bac504640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40feca0 con 0x7f9ba4069150 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9bac504640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40fee60 con 0x7f9ba4159f00 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9baa279640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ba40676d0 0x7f9ba40f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9baa279640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ba40676d0 0x7f9ba40f8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59850/0 (socket says 10.20.193.4:59850) 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9baa279640 1 -- 10.20.193.4:0/2252042314 learned_addr learned my addr 10.20.193.4:0/2252042314 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9baaa7a640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ba4159f00 0x7f9ba40fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9baa279640 1 -- 10.20.193.4:0/2252042314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ba4159f00 msgr2=0x7f9ba40fe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9baa279640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ba4159f00 0x7f9ba40fe510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9ba9a78640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ba4069150 0x7f9ba40f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9baa279640 1 -- 10.20.193.4:0/2252042314 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ba4069150 msgr2=0x7f9ba40f9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9baa279640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ba4069150 0x7f9ba40f9140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9baa279640 1 -- 10.20.193.4:0/2252042314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba000a650 con 0x7f9ba40676d0 2026-02-24T09:09:39.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9ba9a78640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ba4069150 0x7f9ba40f9140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:39.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.313+0000 7f9baa279640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ba40676d0 0x7f9ba40f8c00 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b94009480 tx=0x7f9b9400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.314+0000 7f3a60ba7640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a380b57f0 0x7f3a380d5ca0 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a4c004740 tx=0x7f3a4c005f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.342 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:39 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/337092164' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:09:39.342 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:39 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2149521313' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:09:39.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.316+0000 7f3a51ffb640 1 -- 10.20.193.4:0/2324330126 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3a440cd8d0 con 0x7f3a5c114a10 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.315+0000 7f9b8b7fe640 1 -- 10.20.193.4:0/2252042314 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b9400cd40 con 0x7f9ba40676d0 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.315+0000 7f9b8b7fe640 1 -- 10.20.193.4:0/2252042314 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9b94004d30 con 0x7f9ba40676d0 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.315+0000 7f9b8b7fe640 1 -- 10.20.193.4:0/2252042314 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b94010740 con 0x7f9ba40676d0 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.315+0000 7f9bac504640 1 -- 10.20.193.4:0/2252042314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba40ff140 con 0x7f9ba40676d0 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.316+0000 7f9bac504640 1 -- 10.20.193.4:0/2252042314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba413f840 con 0x7f9ba40676d0 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.316+0000 7f9bac504640 1 -- 10.20.193.4:0/2252042314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba40686a0 con 0x7f9ba40676d0 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.317+0000 7f9b8b7fe640 1 -- 10.20.193.4:0/2252042314 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f9b9401f060 con 0x7f9ba40676d0 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.318+0000 7f9b8b7fe640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b800b57f0 0x7f9b800d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.318+0000 7f9b8b7fe640 1 -- 10.20.193.4:0/2252042314 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9b94014070 con 0x7f9ba40676d0 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.318+0000 7f9ba9a78640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b800b57f0 0x7f9b800d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.318+0000 7f9ba9a78640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b800b57f0 0x7f9b800d5ca0 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ba40ff5a0 tx=0x7f9b98005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.320+0000 7f9b8b7fe640 1 -- 10.20.193.4:0/2252042314 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f9b940eb070 con 0x7f9ba40676d0 2026-02-24T09:09:39.361 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659152 got 176093659152 for osd.6 2026-02-24T09:09:39.361 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.362 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476757 got 68719476757 for osd.2 2026-02-24T09:09:39.362 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.388+0000 7fd7324db640 1 -- 10.20.193.4:0/2143692865 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fd72c10d3e0 con 0x7fd72c113200 2026-02-24T09:09:39.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.388+0000 7fd7297fa640 1 -- 10.20.193.4:0/2143692865 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd7200d24b0 con 0x7fd72c113200 2026-02-24T09:09:39.392 INFO:teuthology.orchestra.run.trial004.stdout:270582939657 2026-02-24T09:09:39.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.390+0000 7fd7324db640 1 -- 10.20.193.4:0/2143692865 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd7000b58c0 msgr2=0x7fd7000d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.390+0000 7fd7324db640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd7000b58c0 0x7fd7000d5d70 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd718004740 tx=0x7fd718005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:39.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.390+0000 7fd7324db640 1 -- 10.20.193.4:0/2143692865 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd72c113200 msgr2=0x7fd72c121210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.390+0000 7fd7324db640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd72c113200 0x7fd72c121210 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd720032fe0 tx=0x7fd720030d70 comp rx=0 tx=0).stop 2026-02-24T09:09:39.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.390+0000 7fd7324db640 1 -- 10.20.193.4:0/2143692865 shutdown_connections 2026-02-24T09:09:39.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.390+0000 7fd7324db640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd7000b58c0 0x7fd7000d5d70 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.390+0000 7fd7324db640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd72c113200 0x7fd72c121210 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.390+0000 7fd7324db640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd72c10da00 0x7fd72c11be40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.390+0000 7fd7324db640 1 --2- 10.20.193.4:0/2143692865 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd72c10d010 0x7fd72c11b900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.390+0000 7fd7324db640 1 -- 10.20.193.4:0/2143692865 >> 10.20.193.4:0/2143692865 conn(0x7fd72c05f830 msgr2=0x7fd72c10ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.391+0000 7fd7324db640 1 -- 10.20.193.4:0/2143692865 shutdown_connections 2026-02-24T09:09:39.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.391+0000 7fd7324db640 1 -- 10.20.193.4:0/2143692865 wait complete. 2026-02-24T09:09:39.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.396+0000 7f1f700d5640 1 -- 10.20.193.4:0/4173935402 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1f680600e0 con 0x7f1f6810c450 2026-02-24T09:09:39.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.396+0000 7f1f56ffd640 1 -- 10.20.193.4:0/4173935402 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f5c0202e0 con 0x7f1f6810c450 2026-02-24T09:09:39.400 INFO:teuthology.orchestra.run.trial004.stdout:51539607575 2026-02-24T09:09:39.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.398+0000 7f1f700d5640 1 -- 10.20.193.4:0/4173935402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f440b5870 msgr2=0x7f1f440d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.398+0000 7f1f700d5640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f440b5870 0x7f1f440d5d20 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f580098a0 tx=0x7f1f58031040 comp rx=0 tx=0).stop 2026-02-24T09:09:39.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.399+0000 7f1f700d5640 1 -- 10.20.193.4:0/4173935402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f6810c450 msgr2=0x7f1f680f2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.399+0000 7f1f700d5640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f6810c450 0x7f1f680f2000 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f5c00b500 tx=0x7f1f5c00b9d0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.399+0000 7f1f700d5640 1 -- 10.20.193.4:0/4173935402 shutdown_connections 2026-02-24T09:09:39.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.399+0000 7f1f700d5640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f440b5870 0x7f1f440d5d20 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.399+0000 7f1f700d5640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f68111c50 0x7f1f680f73d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.399+0000 7f1f700d5640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f6810c450 0x7f1f680f2000 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.399+0000 7f1f700d5640 1 --2- 10.20.193.4:0/4173935402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f6810ba60 0x7f1f680f1ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.399+0000 7f1f700d5640 1 -- 10.20.193.4:0/4173935402 >> 10.20.193.4:0/4173935402 conn(0x7f1f680e9370 msgr2=0x7f1f6810a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.399+0000 7f1f700d5640 1 -- 10.20.193.4:0/4173935402 shutdown_connections 2026-02-24T09:09:39.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.399+0000 7f1f700d5640 1 -- 10.20.193.4:0/4173935402 wait complete. 2026-02-24T09:09:39.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.403+0000 7fdfaf567640 1 -- 10.20.193.4:0/3562394203 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdfa8163000 con 0x7fdfa8155730 2026-02-24T09:09:39.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.403+0000 7fdf967fc640 1 -- 10.20.193.4:0/3562394203 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdfa40ad7a0 con 0x7fdfa8155730 2026-02-24T09:09:39.406 INFO:teuthology.orchestra.run.trial004.stdout:146028888081 2026-02-24T09:09:39.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.404+0000 7fb4d97fa640 1 -- 10.20.193.4:0/1046951157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fb4bc005880 con 0x7fb4f0067340 2026-02-24T09:09:39.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.404+0000 7fb4db7fe640 1 -- 10.20.193.4:0/1046951157 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb4e80ac750 con 0x7fb4f0067340 2026-02-24T09:09:39.408 INFO:teuthology.orchestra.run.trial004.stdout:223338299404 2026-02-24T09:09:39.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.405+0000 7fdfaf567640 1 -- 10.20.193.4:0/3562394203 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf840b5870 msgr2=0x7fdf840d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.405+0000 7fdfaf567640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf840b5870 0x7fdf840d5d20 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf9c004740 tx=0x7fdf9c00b410 comp rx=0 tx=0).stop 2026-02-24T09:09:39.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.405+0000 7fdfaf567640 1 -- 10.20.193.4:0/3562394203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfa8155730 msgr2=0x7fdfa81677b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.405+0000 7fdfaf567640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfa8155730 0x7fdfa81677b0 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfa400f940 tx=0x7fdfa400fe10 comp rx=0 tx=0).stop 2026-02-24T09:09:39.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.405+0000 7fdfaf567640 1 -- 10.20.193.4:0/3562394203 shutdown_connections 2026-02-24T09:09:39.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.405+0000 7fdfaf567640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdf840b5870 0x7fdf840d5d20 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.405+0000 7fdfaf567640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdfa8155730 0x7fdfa81677b0 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.405+0000 7fdfaf567640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdfa80618e0 0x7fdfa81623e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.405+0000 7fdfaf567640 1 --2- 10.20.193.4:0/3562394203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdfa8060fd0 0x7fdfa8161ea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.405+0000 7fdfaf567640 1 -- 10.20.193.4:0/3562394203 >> 10.20.193.4:0/3562394203 conn(0x7fdfa805f830 msgr2=0x7fdfa810ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.406+0000 7fdfaf567640 1 -- 10.20.193.4:0/3562394203 shutdown_connections 2026-02-24T09:09:39.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.406+0000 7fdfaf567640 1 -- 10.20.193.4:0/3562394203 wait complete. 2026-02-24T09:09:39.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 -- 10.20.193.4:0/1046951157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4cc0b57f0 msgr2=0x7fb4cc0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4cc0b57f0 0x7fb4cc0d5ca0 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4dc009350 tx=0x7fb4dc031040 comp rx=0 tx=0).stop 2026-02-24T09:09:39.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 -- 10.20.193.4:0/1046951157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4f0067340 msgr2=0x7fb4f005e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4f0067340 0x7fb4f005e460 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4e80072a0 tx=0x7fb4e800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 -- 10.20.193.4:0/1046951157 shutdown_connections 2026-02-24T09:09:39.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4cc0b57f0 0x7fb4cc0d5ca0 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4f006d510 0x7fb4f0126540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4f0067d30 0x7fb4f005e9a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 --2- 10.20.193.4:0/1046951157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4f0067340 0x7fb4f005e460 unknown :-1 s=CLOSED pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 -- 10.20.193.4:0/1046951157 >> 10.20.193.4:0/1046951157 conn(0x7fb4f0064c40 msgr2=0x7fb4f006b420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.409+0000 7fb4d97fa640 1 -- 10.20.193.4:0/1046951157 shutdown_connections 2026-02-24T09:09:39.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.410+0000 7fb4d97fa640 1 -- 10.20.193.4:0/1046951157 wait complete. 2026-02-24T09:09:39.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.432+0000 7fe0119a3640 1 -- 10.20.193.4:0/1316864319 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe00c0622c0 con 0x7fe00c10d010 2026-02-24T09:09:39.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.432+0000 7fe0109a1640 1 -- 10.20.193.4:0/1316864319 <== mon.2 v2:10.20.193.14:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe0000ac8b0 con 0x7fe00c10d010 2026-02-24T09:09:39.437 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939656 got 270582939657 for osd.10 2026-02-24T09:09:39.437 INFO:teuthology.orchestra.run.trial004.stdout:193273528334 2026-02-24T09:09:39.438 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 -- 10.20.193.4:0/1316864319 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfe00b57e0 msgr2=0x7fdfe00d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfe00b57e0 0x7fdfe00d5c90 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdff40023d0 tx=0x7fdff4031040 comp rx=0 tx=0).stop 2026-02-24T09:09:39.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 -- 10.20.193.4:0/1316864319 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe00c10d010 msgr2=0x7fe00c060f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe00c10d010 0x7fe00c060f90 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe00000d950 tx=0x7fe00000de20 comp rx=0 tx=0).stop 2026-02-24T09:09:39.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 -- 10.20.193.4:0/1316864319 shutdown_connections 2026-02-24T09:09:39.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdfe00b57e0 0x7fdfe00d5c90 unknown :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe00c113200 0x7fe00c0614d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe00c10da00 0x7fe00c173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 --2- 10.20.193.4:0/1316864319 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe00c10d010 0x7fe00c060f90 unknown :-1 s=CLOSED pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 -- 10.20.193.4:0/1316864319 >> 10.20.193.4:0/1316864319 conn(0x7fe00c05f830 msgr2=0x7fe00c10b500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 -- 10.20.193.4:0/1316864319 shutdown_connections 2026-02-24T09:09:39.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.435+0000 7fe0119a3640 1 -- 10.20.193.4:0/1316864319 wait complete. 2026-02-24T09:09:39.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.440+0000 7f1fa2019640 1 -- 10.20.193.4:0/3588938351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f1f9c176f40 con 0x7f1f9c10da00 2026-02-24T09:09:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.440+0000 7f3a62e32640 1 -- 10.20.193.4:0/2324330126 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f3a5c0fcdf0 con 0x7f3a5c114a10 2026-02-24T09:09:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.440+0000 7f1f98ff9640 1 -- 10.20.193.4:0/3588938351 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f1f8c0b04b0 con 0x7f1f9c10da00 2026-02-24T09:09:39.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.440+0000 7f3a51ffb640 1 -- 10.20.193.4:0/2324330126 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3a440d0a80 con 0x7f3a5c114a10 2026-02-24T09:09:39.445 INFO:teuthology.orchestra.run.trial004.stdout:300647710729 2026-02-24T09:09:39.445 INFO:teuthology.orchestra.run.trial004.stdout:253403070475 2026-02-24T09:09:39.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.441+0000 7f9bac504640 1 -- 10.20.193.4:0/2252042314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9ba40f9d60 con 0x7f9ba40676d0 2026-02-24T09:09:39.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.441+0000 7f9b8b7fe640 1 -- 10.20.193.4:0/2252042314 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b940a9880 con 0x7f9ba40676d0 2026-02-24T09:09:39.446 INFO:teuthology.orchestra.run.trial004.stdout:34359738394 2026-02-24T09:09:39.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 -- 10.20.193.4:0/3588938351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f700b58c0 msgr2=0x7f1f700d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f700b58c0 0x7f1f700d5d70 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f880098a0 tx=0x7f1f8803a040 comp rx=0 tx=0).stop 2026-02-24T09:09:39.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 -- 10.20.193.4:0/3588938351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9c10da00 msgr2=0x7f1f9c11bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9c10da00 0x7f1f9c11bf20 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f8c009480 tx=0x7f1f8c00c7f0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 -- 10.20.193.4:0/2324330126 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a380b57f0 msgr2=0x7f3a380d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a380b57f0 0x7f3a380d5ca0 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a4c004740 tx=0x7f3a4c005f70 comp rx=0 tx=0).stop 2026-02-24T09:09:39.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 -- 10.20.193.4:0/2324330126 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5c114a10 msgr2=0x7f3a5c17a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5c114a10 0x7f3a5c17a5e0 secure :-1 s=READY pgs=337 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a44038820 tx=0x7f3a440028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 -- 10.20.193.4:0/2324330126 shutdown_connections 2026-02-24T09:09:39.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a380b57f0 0x7f3a380d5ca0 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a5c119d10 0x7f3a5c0fc390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a5c114a10 0x7f3a5c17a5e0 unknown :-1 s=CLOSED pgs=337 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 --2- 10.20.193.4:0/2324330126 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a5c114020 0x7f3a5c0fbc90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 -- 10.20.193.4:0/2324330126 >> 10.20.193.4:0/2324330126 conn(0x7f3a5c064c40 msgr2=0x7f3a5c1187a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 -- 10.20.193.4:0/3588938351 shutdown_connections 2026-02-24T09:09:39.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f700b58c0 0x7f1f700d5d70 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9c113200 0x7f1f9c1212a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9c10da00 0x7f1f9c11bf20 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 --2- 10.20.193.4:0/3588938351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f9c10d010 0x7f1f9c11b9e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 -- 10.20.193.4:0/3588938351 >> 10.20.193.4:0/3588938351 conn(0x7f1f9c05f830 msgr2=0x7f1f9c10ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 -- 10.20.193.4:0/3588938351 shutdown_connections 2026-02-24T09:09:39.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f1fa2019640 1 -- 10.20.193.4:0/3588938351 wait complete. 2026-02-24T09:09:39.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 -- 10.20.193.4:0/2324330126 shutdown_connections 2026-02-24T09:09:39.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.443+0000 7f3a62e32640 1 -- 10.20.193.4:0/2324330126 wait complete. 2026-02-24T09:09:39.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 -- 10.20.193.4:0/2252042314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b800b57f0 msgr2=0x7f9b800d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b800b57f0 0x7f9b800d5ca0 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ba40ff5a0 tx=0x7f9b98005f00 comp rx=0 tx=0).stop 2026-02-24T09:09:39.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 -- 10.20.193.4:0/2252042314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ba40676d0 msgr2=0x7f9ba40f8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ba40676d0 0x7f9ba40f8c00 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b94009480 tx=0x7f9b9400ee60 comp rx=0 tx=0).stop 2026-02-24T09:09:39.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 -- 10.20.193.4:0/2252042314 shutdown_connections 2026-02-24T09:09:39.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b800b57f0 0x7f9b800d5ca0 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ba4159f00 0x7f9ba40fe510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ba4069150 0x7f9ba40f9140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 --2- 10.20.193.4:0/2252042314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ba40676d0 0x7f9ba40f8c00 unknown :-1 s=CLOSED pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 -- 10.20.193.4:0/2252042314 >> 10.20.193.4:0/2252042314 conn(0x7f9ba4064cc0 msgr2=0x7f9ba4070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 -- 10.20.193.4:0/2252042314 shutdown_connections 2026-02-24T09:09:39.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.445+0000 7f9bac504640 1 -- 10.20.193.4:0/2252042314 wait complete. 2026-02-24T09:09:39.453 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607575 got 51539607575 for osd.1 2026-02-24T09:09:39.453 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.460 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888080 got 146028888081 for osd.5 2026-02-24T09:09:39.460 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.475 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299403 got 223338299404 for osd.8 2026-02-24T09:09:39.475 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.487 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528334 got 193273528334 for osd.7 2026-02-24T09:09:39.487 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.497 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070475 got 253403070475 for osd.9 2026-02-24T09:09:39.497 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.504 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738393 got 34359738394 for osd.0 2026-02-24T09:09:39.504 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.511 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710729 got 300647710729 for osd.11 2026-02-24T09:09:39.511 DEBUG:teuthology.parallel:result is None 2026-02-24T09:09:39.512 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T09:09:39.512 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:09:39.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:39 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/337092164' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:09:39.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:39 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2149521313' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:09:39.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:39 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/337092164' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-24T09:09:39.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:39 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2149521313' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T09:09:39.672 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:39.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.772+0000 7f77c9cfc640 1 -- 10.20.193.4:0/1777660442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f77c410f280 msgr2=0x7f77c410f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.772+0000 7f77c9cfc640 1 --2- 10.20.193.4:0/1777660442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f77c410f280 0x7f77c410f650 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=1222523150184981334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77b0009950 tx=0x7f77b002f190 comp rx=0 tx=0).stop 2026-02-24T09:09:39.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.772+0000 7f77c9cfc640 1 -- 10.20.193.4:0/1777660442 shutdown_connections 2026-02-24T09:09:39.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.772+0000 7f77c9cfc640 1 --2- 10.20.193.4:0/1777660442 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f77c4115470 0x7f77c4175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.772+0000 7f77c9cfc640 1 --2- 10.20.193.4:0/1777660442 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77c410fc70 0x7f77c4114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.772+0000 7f77c9cfc640 1 --2- 10.20.193.4:0/1777660442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f77c410f280 0x7f77c410f650 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=1222523150184981334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.772+0000 7f77c9cfc640 1 -- 10.20.193.4:0/1777660442 >> 10.20.193.4:0/1777660442 conn(0x7f77c405f830 msgr2=0x7f77c410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.772+0000 7f77c9cfc640 1 -- 10.20.193.4:0/1777660442 shutdown_connections 2026-02-24T09:09:39.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.772+0000 7f77c9cfc640 1 -- 10.20.193.4:0/1777660442 wait complete. 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c9cfc640 1 Processor -- start 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c9cfc640 1 -- start start 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c9cfc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77c410f280 0x7f77c411dbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c9cfc640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f77c410fc70 0x7f77c411e120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c9cfc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f77c4115470 0x7f77c41234f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c9cfc640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4123b10 con 0x7f77c4115470 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c9cfc640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4123c80 con 0x7f77c410fc70 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c9cfc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4123e40 con 0x7f77c410f280 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f77c4115470 0x7f77c41234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f77c4115470 0x7f77c41234f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59864/0 (socket says 10.20.193.4:59864) 2026-02-24T09:09:39.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c3fff640 1 -- 10.20.193.4:0/971308285 learned_addr learned my addr 10.20.193.4:0/971308285 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c37fe640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77c410f280 0x7f77c411dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c2ffd640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f77c410fc70 0x7f77c411e120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c3fff640 1 -- 10.20.193.4:0/971308285 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77c410f280 msgr2=0x7f77c411dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c3fff640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77c410f280 0x7f77c411dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c3fff640 1 -- 10.20.193.4:0/971308285 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f77c410fc70 msgr2=0x7f77c411e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c3fff640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f77c410fc70 0x7f77c411e120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c3fff640 1 -- 10.20.193.4:0/971308285 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b0009570 con 0x7f77c4115470 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c37fe640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77c410f280 0x7f77c411dbe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c2ffd640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f77c410fc70 0x7f77c411e120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c3fff640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f77c4115470 0x7f77c41234f0 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77b8006e90 tx=0x7f77b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c0ff9640 1 -- 10.20.193.4:0/971308285 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77b8005500 con 0x7f77c4115470 2026-02-24T09:09:39.780 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c0ff9640 1 -- 10.20.193.4:0/971308285 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f77b8005e10 con 0x7f77c4115470 2026-02-24T09:09:39.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c9cfc640 1 -- 10.20.193.4:0/971308285 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c4124120 con 0x7f77c4115470 2026-02-24T09:09:39.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c0ff9640 1 -- 10.20.193.4:0/971308285 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77b8003a90 con 0x7f77c4115470 2026-02-24T09:09:39.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.773+0000 7f77c9cfc640 1 -- 10.20.193.4:0/971308285 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c4164820 con 0x7f77c4115470 2026-02-24T09:09:39.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.774+0000 7f77c9cfc640 1 -- 10.20.193.4:0/971308285 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c4110560 con 0x7f77c4115470 2026-02-24T09:09:39.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.776+0000 7f77c0ff9640 1 -- 10.20.193.4:0/971308285 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f77b800c840 con 0x7f77c4115470 2026-02-24T09:09:39.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.777+0000 7f77c0ff9640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77980b5770 0x7f77980d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:39.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.777+0000 7f77c0ff9640 1 -- 10.20.193.4:0/971308285 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f77b80e7d90 con 0x7f77c4115470 2026-02-24T09:09:39.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.777+0000 7f77c37fe640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77980b5770 0x7f77980d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:39.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.777+0000 7f77c0ff9640 1 -- 10.20.193.4:0/971308285 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f77b80e8280 con 0x7f77c4115470 2026-02-24T09:09:39.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.777+0000 7f77c37fe640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77980b5770 0x7f77980d5c20 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77b00023d0 tx=0x7f77b0031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:39.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.880+0000 7f77c9cfc640 1 -- 10.20.193.4:0/971308285 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77c411ed40 con 0x7f77980b5770 2026-02-24T09:09:39.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.882+0000 7f77c0ff9640 1 -- 10.20.193.4:0/971308285 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258953 (secure 0 0 0) 0x7f77c411ed40 con 0x7f77980b5770 2026-02-24T09:09:39.889 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:39.891 INFO:teuthology.orchestra.run.trial004.stderr:dumped all 2026-02-24T09:09:39.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 -- 10.20.193.4:0/971308285 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77980b5770 msgr2=0x7f77980d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77980b5770 0x7f77980d5c20 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77b00023d0 tx=0x7f77b0031040 comp rx=0 tx=0).stop 2026-02-24T09:09:39.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 -- 10.20.193.4:0/971308285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f77c4115470 msgr2=0x7f77c41234f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:39.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f77c4115470 0x7f77c41234f0 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77b8006e90 tx=0x7f77b800edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 -- 10.20.193.4:0/971308285 shutdown_connections 2026-02-24T09:09:39.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77980b5770 0x7f77980d5c20 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f77c4115470 0x7f77c41234f0 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f77c410fc70 0x7f77c411e120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 --2- 10.20.193.4:0/971308285 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77c410f280 0x7f77c411dbe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:39.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 -- 10.20.193.4:0/971308285 >> 10.20.193.4:0/971308285 conn(0x7f77c405f830 msgr2=0x7f77c410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:39.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 -- 10.20.193.4:0/971308285 shutdown_connections 2026-02-24T09:09:39.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:39.884+0000 7f77c9cfc640 1 -- 10.20.193.4:0/971308285 wait complete. 2026-02-24T09:09:39.925 INFO:teuthology.orchestra.run.trial004.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2026-02-24T09:09:39.666318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646896,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":175,"num_read_kb":184,"num_write":341,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333624,"kb_used_data":10056,"kb_used_omap":377,"kb_used_meta":322950,"kb_avail":8807704776,"statfs":{"total":9019431321600,"available":9019089690624,"internally_reserved":0,"allocated":10297344,"data_stored":6675084,"data_compressed":113181,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":386257,"internal_metadata":330701615},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54724,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":69,"num_read_kb":93,"num_write":121,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002587"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332664+0000","last_change":"2026-02-24T09:09:25.267627+0000","last_active":"2026-02-24T09:09:26.332664+0000","last_peered":"2026-02-24T09:09:26.332664+0000","last_clean":"2026-02-24T09:09:26.332664+0000","last_became_active":"2026-02-24T09:09:25.267439+0000","last_became_peered":"2026-02-24T09:09:25.267439+0000","last_unstale":"2026-02-24T09:09:26.332664+0000","last_undegraded":"2026-02-24T09:09:26.332664+0000","last_fullsized":"2026-02-24T09:09:26.332664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:24.034680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267727+0000","last_change":"2026-02-24T09:09:25.267299+0000","last_active":"2026-02-24T09:09:26.267727+0000","last_peered":"2026-02-24T09:09:26.267727+0000","last_clean":"2026-02-24T09:09:26.267727+0000","last_became_active":"2026-02-24T09:09:25.266956+0000","last_became_peered":"2026-02-24T09:09:25.266956+0000","last_unstale":"2026-02-24T09:09:26.267727+0000","last_undegraded":"2026-02-24T09:09:26.267727+0000","last_fullsized":"2026-02-24T09:09:26.267727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:05.466777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267738+0000","last_change":"2026-02-24T09:09:25.268761+0000","last_active":"2026-02-24T09:09:26.267738+0000","last_peered":"2026-02-24T09:09:26.267738+0000","last_clean":"2026-02-24T09:09:26.267738+0000","last_became_active":"2026-02-24T09:09:25.268476+0000","last_became_peered":"2026-02-24T09:09:25.268476+0000","last_unstale":"2026-02-24T09:09:26.267738+0000","last_undegraded":"2026-02-24T09:09:26.267738+0000","last_fullsized":"2026-02-24T09:09:26.267738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:26:00.680116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335046+0000","last_change":"2026-02-24T09:09:25.271303+0000","last_active":"2026-02-24T09:09:26.335046+0000","last_peered":"2026-02-24T09:09:26.335046+0000","last_clean":"2026-02-24T09:09:26.335046+0000","last_became_active":"2026-02-24T09:09:25.271175+0000","last_became_peered":"2026-02-24T09:09:25.271175+0000","last_unstale":"2026-02-24T09:09:26.335046+0000","last_undegraded":"2026-02-24T09:09:26.335046+0000","last_fullsized":"2026-02-24T09:09:26.335046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:55:25.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267634+0000","last_change":"2026-02-24T09:09:25.267923+0000","last_active":"2026-02-24T09:09:26.267634+0000","last_peered":"2026-02-24T09:09:26.267634+0000","last_clean":"2026-02-24T09:09:26.267634+0000","last_became_active":"2026-02-24T09:09:25.267775+0000","last_became_peered":"2026-02-24T09:09:25.267775+0000","last_unstale":"2026-02-24T09:09:26.267634+0000","last_undegraded":"2026-02-24T09:09:26.267634+0000","last_fullsized":"2026-02-24T09:09:26.267634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:54:25.575849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270023+0000","last_change":"2026-02-24T09:09:25.269603+0000","last_active":"2026-02-24T09:09:26.270023+0000","last_peered":"2026-02-24T09:09:26.270023+0000","last_clean":"2026-02-24T09:09:26.270023+0000","last_became_active":"2026-02-24T09:09:25.269057+0000","last_became_peered":"2026-02-24T09:09:25.269057+0000","last_unstale":"2026-02-24T09:09:26.270023+0000","last_undegraded":"2026-02-24T09:09:26.270023+0000","last_fullsized":"2026-02-24T09:09:26.270023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:39:21.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733238+0000","last_change":"2026-02-24T09:09:25.270852+0000","last_active":"2026-02-24T09:09:26.733238+0000","last_peered":"2026-02-24T09:09:26.733238+0000","last_clean":"2026-02-24T09:09:26.733238+0000","last_became_active":"2026-02-24T09:09:25.270607+0000","last_became_peered":"2026-02-24T09:09:25.270607+0000","last_unstale":"2026-02-24T09:09:26.733238+0000","last_undegraded":"2026-02-24T09:09:26.733238+0000","last_fullsized":"2026-02-24T09:09:26.733238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:45:43.574810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268619+0000","last_change":"2026-02-24T09:09:25.268833+0000","last_active":"2026-02-24T09:09:26.268619+0000","last_peered":"2026-02-24T09:09:26.268619+0000","last_clean":"2026-02-24T09:09:26.268619+0000","last_became_active":"2026-02-24T09:09:25.268462+0000","last_became_peered":"2026-02-24T09:09:25.268462+0000","last_unstale":"2026-02-24T09:09:26.268619+0000","last_undegraded":"2026-02-24T09:09:26.268619+0000","last_fullsized":"2026-02-24T09:09:26.268619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:47.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334895+0000","last_change":"2026-02-24T09:09:25.271419+0000","last_active":"2026-02-24T09:09:26.334895+0000","last_peered":"2026-02-24T09:09:26.334895+0000","last_clean":"2026-02-24T09:09:26.334895+0000","last_became_active":"2026-02-24T09:09:25.270954+0000","last_became_peered":"2026-02-24T09:09:25.270954+0000","last_unstale":"2026-02-24T09:09:26.334895+0000","last_undegraded":"2026-02-24T09:09:26.334895+0000","last_fullsized":"2026-02-24T09:09:26.334895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:07:15.889565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270286+0000","last_change":"2026-02-24T09:09:25.269709+0000","last_active":"2026-02-24T09:09:26.270286+0000","last_peered":"2026-02-24T09:09:26.270286+0000","last_clean":"2026-02-24T09:09:26.270286+0000","last_became_active":"2026-02-24T09:09:25.269136+0000","last_became_peered":"2026-02-24T09:09:25.269136+0000","last_unstale":"2026-02-24T09:09:26.270286+0000","last_undegraded":"2026-02-24T09:09:26.270286+0000","last_fullsized":"2026-02-24T09:09:26.270286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:42:02.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733508+0000","last_change":"2026-02-24T09:09:25.272025+0000","last_active":"2026-02-24T09:09:26.733508+0000","last_peered":"2026-02-24T09:09:26.733508+0000","last_clean":"2026-02-24T09:09:26.733508+0000","last_became_active":"2026-02-24T09:09:25.271851+0000","last_became_peered":"2026-02-24T09:09:25.271851+0000","last_unstale":"2026-02-24T09:09:26.733508+0000","last_undegraded":"2026-02-24T09:09:26.733508+0000","last_fullsized":"2026-02-24T09:09:26.733508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:49:57.365130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335160+0000","last_change":"2026-02-24T09:09:25.271156+0000","last_active":"2026-02-24T09:09:26.335160+0000","last_peered":"2026-02-24T09:09:26.335160+0000","last_clean":"2026-02-24T09:09:26.335160+0000","last_became_active":"2026-02-24T09:09:25.270992+0000","last_became_peered":"2026-02-24T09:09:25.270992+0000","last_unstale":"2026-02-24T09:09:26.335160+0000","last_undegraded":"2026-02-24T09:09:26.335160+0000","last_fullsized":"2026-02-24T09:09:26.335160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:56.324038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332309+0000","last_change":"2026-02-24T09:09:25.266871+0000","last_active":"2026-02-24T09:09:26.332309+0000","last_peered":"2026-02-24T09:09:26.332309+0000","last_clean":"2026-02-24T09:09:26.332309+0000","last_became_active":"2026-02-24T09:09:25.266438+0000","last_became_peered":"2026-02-24T09:09:25.266438+0000","last_unstale":"2026-02-24T09:09:26.332309+0000","last_undegraded":"2026-02-24T09:09:26.332309+0000","last_fullsized":"2026-02-24T09:09:26.332309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:24:17.014313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267591+0000","last_change":"2026-02-24T09:09:25.266851+0000","last_active":"2026-02-24T09:09:26.267591+0000","last_peered":"2026-02-24T09:09:26.267591+0000","last_clean":"2026-02-24T09:09:26.267591+0000","last_became_active":"2026-02-24T09:09:25.266530+0000","last_became_peered":"2026-02-24T09:09:25.266530+0000","last_unstale":"2026-02-24T09:09:26.267591+0000","last_undegraded":"2026-02-24T09:09:26.267591+0000","last_fullsized":"2026-02-24T09:09:26.267591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:53.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267465+0000","last_change":"2026-02-24T09:09:25.269561+0000","last_active":"2026-02-24T09:09:26.267465+0000","last_peered":"2026-02-24T09:09:26.267465+0000","last_clean":"2026-02-24T09:09:26.267465+0000","last_became_active":"2026-02-24T09:09:25.268979+0000","last_became_peered":"2026-02-24T09:09:25.268979+0000","last_unstale":"2026-02-24T09:09:26.267465+0000","last_undegraded":"2026-02-24T09:09:26.267465+0000","last_fullsized":"2026-02-24T09:09:26.267465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:16:56.110766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334540+0000","last_change":"2026-02-24T09:09:25.271426+0000","last_active":"2026-02-24T09:09:26.334540+0000","last_peered":"2026-02-24T09:09:26.334540+0000","last_clean":"2026-02-24T09:09:26.334540+0000","last_became_active":"2026-02-24T09:09:25.270917+0000","last_became_peered":"2026-02-24T09:09:25.270917+0000","last_unstale":"2026-02-24T09:09:26.334540+0000","last_undegraded":"2026-02-24T09:09:26.334540+0000","last_fullsized":"2026-02-24T09:09:26.334540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:58:52.125871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332673+0000","last_change":"2026-02-24T09:09:25.267238+0000","last_active":"2026-02-24T09:09:26.332673+0000","last_peered":"2026-02-24T09:09:26.332673+0000","last_clean":"2026-02-24T09:09:26.332673+0000","last_became_active":"2026-02-24T09:09:25.267060+0000","last_became_peered":"2026-02-24T09:09:25.267060+0000","last_unstale":"2026-02-24T09:09:26.332673+0000","last_undegraded":"2026-02-24T09:09:26.332673+0000","last_fullsized":"2026-02-24T09:09:26.332673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:00:58.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267495+0000","last_change":"2026-02-24T09:09:25.266005+0000","last_active":"2026-02-24T09:09:26.267495+0000","last_peered":"2026-02-24T09:09:26.267495+0000","last_clean":"2026-02-24T09:09:26.267495+0000","last_became_active":"2026-02-24T09:09:25.265847+0000","last_became_peered":"2026-02-24T09:09:25.265847+0000","last_unstale":"2026-02-24T09:09:26.267495+0000","last_undegraded":"2026-02-24T09:09:26.267495+0000","last_fullsized":"2026-02-24T09:09:26.267495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:29:02.137351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332638+0000","last_change":"2026-02-24T09:09:25.268822+0000","last_active":"2026-02-24T09:09:26.332638+0000","last_peered":"2026-02-24T09:09:26.332638+0000","last_clean":"2026-02-24T09:09:26.332638+0000","last_became_active":"2026-02-24T09:09:25.268683+0000","last_became_peered":"2026-02-24T09:09:25.268683+0000","last_unstale":"2026-02-24T09:09:26.332638+0000","last_undegraded":"2026-02-24T09:09:26.332638+0000","last_fullsized":"2026-02-24T09:09:26.332638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:23:58.256403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332429+0000","last_change":"2026-02-24T09:09:25.266214+0000","last_active":"2026-02-24T09:09:26.332429+0000","last_peered":"2026-02-24T09:09:26.332429+0000","last_clean":"2026-02-24T09:09:26.332429+0000","last_became_active":"2026-02-24T09:09:25.266019+0000","last_became_peered":"2026-02-24T09:09:25.266019+0000","last_unstale":"2026-02-24T09:09:26.332429+0000","last_undegraded":"2026-02-24T09:09:26.332429+0000","last_fullsized":"2026-02-24T09:09:26.332429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:17.141581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332384+0000","last_change":"2026-02-24T09:09:25.267493+0000","last_active":"2026-02-24T09:09:26.332384+0000","last_peered":"2026-02-24T09:09:26.332384+0000","last_clean":"2026-02-24T09:09:26.332384+0000","last_became_active":"2026-02-24T09:09:25.267314+0000","last_became_peered":"2026-02-24T09:09:25.267314+0000","last_unstale":"2026-02-24T09:09:26.332384+0000","last_undegraded":"2026-02-24T09:09:26.332384+0000","last_fullsized":"2026-02-24T09:09:26.332384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:59:11.536214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334717+0000","last_change":"2026-02-24T09:09:25.272131+0000","last_active":"2026-02-24T09:09:26.334717+0000","last_peered":"2026-02-24T09:09:26.334717+0000","last_clean":"2026-02-24T09:09:26.334717+0000","last_became_active":"2026-02-24T09:09:25.271680+0000","last_became_peered":"2026-02-24T09:09:25.271680+0000","last_unstale":"2026-02-24T09:09:26.334717+0000","last_undegraded":"2026-02-24T09:09:26.334717+0000","last_fullsized":"2026-02-24T09:09:26.334717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:07:33.257865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268617+0000","last_change":"2026-02-24T09:09:25.267808+0000","last_active":"2026-02-24T09:09:26.268617+0000","last_peered":"2026-02-24T09:09:26.268617+0000","last_clean":"2026-02-24T09:09:26.268617+0000","last_became_active":"2026-02-24T09:09:25.266759+0000","last_became_peered":"2026-02-24T09:09:25.266759+0000","last_unstale":"2026-02-24T09:09:26.268617+0000","last_undegraded":"2026-02-24T09:09:26.268617+0000","last_fullsized":"2026-02-24T09:09:26.268617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:55.312047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268133+0000","last_change":"2026-02-24T09:09:25.268500+0000","last_active":"2026-02-24T09:09:26.268133+0000","last_peered":"2026-02-24T09:09:26.268133+0000","last_clean":"2026-02-24T09:09:26.268133+0000","last_became_active":"2026-02-24T09:09:25.267904+0000","last_became_peered":"2026-02-24T09:09:25.267904+0000","last_unstale":"2026-02-24T09:09:26.268133+0000","last_undegraded":"2026-02-24T09:09:26.268133+0000","last_fullsized":"2026-02-24T09:09:26.268133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:38:47.330593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269021+0000","last_change":"2026-02-24T09:09:25.269694+0000","last_active":"2026-02-24T09:09:26.269021+0000","last_peered":"2026-02-24T09:09:26.269021+0000","last_clean":"2026-02-24T09:09:26.269021+0000","last_became_active":"2026-02-24T09:09:25.269068+0000","last_became_peered":"2026-02-24T09:09:25.269068+0000","last_unstale":"2026-02-24T09:09:26.269021+0000","last_undegraded":"2026-02-24T09:09:26.269021+0000","last_fullsized":"2026-02-24T09:09:26.269021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:04:44.772275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332668+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.332668+0000","last_peered":"2026-02-24T09:09:26.332668+0000","last_clean":"2026-02-24T09:09:26.332668+0000","last_became_active":"2026-02-24T09:09:25.269534+0000","last_became_peered":"2026-02-24T09:09:25.269534+0000","last_unstale":"2026-02-24T09:09:26.332668+0000","last_undegraded":"2026-02-24T09:09:26.332668+0000","last_fullsized":"2026-02-24T09:09:26.332668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:45:51.428970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332478+0000","last_change":"2026-02-24T09:09:25.266779+0000","last_active":"2026-02-24T09:09:26.332478+0000","last_peered":"2026-02-24T09:09:26.332478+0000","last_clean":"2026-02-24T09:09:26.332478+0000","last_became_active":"2026-02-24T09:09:25.266603+0000","last_became_peered":"2026-02-24T09:09:25.266603+0000","last_unstale":"2026-02-24T09:09:26.332478+0000","last_undegraded":"2026-02-24T09:09:26.332478+0000","last_fullsized":"2026-02-24T09:09:26.332478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:01:38.198458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332295+0000","last_change":"2026-02-24T09:09:25.266933+0000","last_active":"2026-02-24T09:09:26.332295+0000","last_peered":"2026-02-24T09:09:26.332295+0000","last_clean":"2026-02-24T09:09:26.332295+0000","last_became_active":"2026-02-24T09:09:25.266381+0000","last_became_peered":"2026-02-24T09:09:25.266381+0000","last_unstale":"2026-02-24T09:09:26.332295+0000","last_undegraded":"2026-02-24T09:09:26.332295+0000","last_fullsized":"2026-02-24T09:09:26.332295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:45:44.657482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267754+0000","last_change":"2026-02-24T09:09:25.269576+0000","last_active":"2026-02-24T09:09:26.267754+0000","last_peered":"2026-02-24T09:09:26.267754+0000","last_clean":"2026-02-24T09:09:26.267754+0000","last_became_active":"2026-02-24T09:09:25.269159+0000","last_became_peered":"2026-02-24T09:09:25.269159+0000","last_unstale":"2026-02-24T09:09:26.267754+0000","last_undegraded":"2026-02-24T09:09:26.267754+0000","last_fullsized":"2026-02-24T09:09:26.267754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:23:37.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332345+0000","last_change":"2026-02-24T09:09:25.269282+0000","last_active":"2026-02-24T09:09:26.332345+0000","last_peered":"2026-02-24T09:09:26.332345+0000","last_clean":"2026-02-24T09:09:26.332345+0000","last_became_active":"2026-02-24T09:09:25.269088+0000","last_became_peered":"2026-02-24T09:09:25.269088+0000","last_unstale":"2026-02-24T09:09:26.332345+0000","last_undegraded":"2026-02-24T09:09:26.332345+0000","last_fullsized":"2026-02-24T09:09:26.332345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:49.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332404+0000","last_change":"2026-02-24T09:09:25.270968+0000","last_active":"2026-02-24T09:09:26.332404+0000","last_peered":"2026-02-24T09:09:26.332404+0000","last_clean":"2026-02-24T09:09:26.332404+0000","last_became_active":"2026-02-24T09:09:25.270816+0000","last_became_peered":"2026-02-24T09:09:25.270816+0000","last_unstale":"2026-02-24T09:09:26.332404+0000","last_undegraded":"2026-02-24T09:09:26.332404+0000","last_fullsized":"2026-02-24T09:09:26.332404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:10:08.592263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332360+0000","last_change":"2026-02-24T09:09:25.267715+0000","last_active":"2026-02-24T09:09:26.332360+0000","last_peered":"2026-02-24T09:09:26.332360+0000","last_clean":"2026-02-24T09:09:26.332360+0000","last_became_active":"2026-02-24T09:09:25.267031+0000","last_became_peered":"2026-02-24T09:09:25.267031+0000","last_unstale":"2026-02-24T09:09:26.332360+0000","last_undegraded":"2026-02-24T09:09:26.332360+0000","last_fullsized":"2026-02-24T09:09:26.332360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:14:50.568512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267758+0000","last_change":"2026-02-24T09:09:25.268347+0000","last_active":"2026-02-24T09:09:26.267758+0000","last_peered":"2026-02-24T09:09:26.267758+0000","last_clean":"2026-02-24T09:09:26.267758+0000","last_became_active":"2026-02-24T09:09:25.268235+0000","last_became_peered":"2026-02-24T09:09:25.268235+0000","last_unstale":"2026-02-24T09:09:26.267758+0000","last_undegraded":"2026-02-24T09:09:26.267758+0000","last_fullsized":"2026-02-24T09:09:26.267758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:17.309082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:35.949131+0000","last_change":"2026-02-24T09:09:24.256941+0000","last_active":"2026-02-24T09:09:35.949131+0000","last_peered":"2026-02-24T09:09:35.949131+0000","last_clean":"2026-02-24T09:09:35.949131+0000","last_became_active":"2026-02-24T09:09:24.256577+0000","last_became_peered":"2026-02-24T09:09:24.256577+0000","last_unstale":"2026-02-24T09:09:35.949131+0000","last_undegraded":"2026-02-24T09:09:35.949131+0000","last_fullsized":"2026-02-24T09:09:35.949131+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:13:19.756549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268000+0000","last_change":"2026-02-24T09:09:25.270452+0000","last_active":"2026-02-24T09:09:26.268000+0000","last_peered":"2026-02-24T09:09:26.268000+0000","last_clean":"2026-02-24T09:09:26.268000+0000","last_became_active":"2026-02-24T09:09:25.270184+0000","last_became_peered":"2026-02-24T09:09:25.270184+0000","last_unstale":"2026-02-24T09:09:26.268000+0000","last_undegraded":"2026-02-24T09:09:26.268000+0000","last_fullsized":"2026-02-24T09:09:26.268000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:07:41.652941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943662+0000","last_change":"2026-02-24T09:09:24.261249+0000","last_active":"2026-02-24T09:09:28.943662+0000","last_peered":"2026-02-24T09:09:28.943662+0000","last_clean":"2026-02-24T09:09:28.943662+0000","last_became_active":"2026-02-24T09:09:24.261064+0000","last_became_peered":"2026-02-24T09:09:24.261064+0000","last_unstale":"2026-02-24T09:09:28.943662+0000","last_undegraded":"2026-02-24T09:09:28.943662+0000","last_fullsized":"2026-02-24T09:09:28.943662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:59:42.964350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941445+0000","last_change":"2026-02-24T09:09:24.254918+0000","last_active":"2026-02-24T09:09:28.941445+0000","last_peered":"2026-02-24T09:09:28.941445+0000","last_clean":"2026-02-24T09:09:28.941445+0000","last_became_active":"2026-02-24T09:09:24.254590+0000","last_became_peered":"2026-02-24T09:09:24.254590+0000","last_unstale":"2026-02-24T09:09:28.941445+0000","last_undegraded":"2026-02-24T09:09:28.941445+0000","last_fullsized":"2026-02-24T09:09:28.941445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:03:19.504844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268666+0000","last_change":"2026-02-24T09:09:25.267204+0000","last_active":"2026-02-24T09:09:26.268666+0000","last_peered":"2026-02-24T09:09:26.268666+0000","last_clean":"2026-02-24T09:09:26.268666+0000","last_became_active":"2026-02-24T09:09:25.266489+0000","last_became_peered":"2026-02-24T09:09:25.266489+0000","last_unstale":"2026-02-24T09:09:26.268666+0000","last_undegraded":"2026-02-24T09:09:26.268666+0000","last_fullsized":"2026-02-24T09:09:26.268666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:26:34.500054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210732+0000","last_change":"2026-02-24T09:09:24.258042+0000","last_active":"2026-02-24T09:09:27.210732+0000","last_peered":"2026-02-24T09:09:27.210732+0000","last_clean":"2026-02-24T09:09:27.210732+0000","last_became_active":"2026-02-24T09:09:24.257801+0000","last_became_peered":"2026-02-24T09:09:24.257801+0000","last_unstale":"2026-02-24T09:09:27.210732+0000","last_undegraded":"2026-02-24T09:09:27.210732+0000","last_fullsized":"2026-02-24T09:09:27.210732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:27.596990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267334+0000","last_change":"2026-02-24T09:09:25.267636+0000","last_active":"2026-02-24T09:09:26.267334+0000","last_peered":"2026-02-24T09:09:26.267334+0000","last_clean":"2026-02-24T09:09:26.267334+0000","last_became_active":"2026-02-24T09:09:25.267505+0000","last_became_peered":"2026-02-24T09:09:25.267505+0000","last_unstale":"2026-02-24T09:09:26.267334+0000","last_undegraded":"2026-02-24T09:09:26.267334+0000","last_fullsized":"2026-02-24T09:09:26.267334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:20.660345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:34.950667+0000","last_change":"2026-02-24T09:09:24.260793+0000","last_active":"2026-02-24T09:09:34.950667+0000","last_peered":"2026-02-24T09:09:34.950667+0000","last_clean":"2026-02-24T09:09:34.950667+0000","last_became_active":"2026-02-24T09:09:24.260555+0000","last_became_peered":"2026-02-24T09:09:24.260555+0000","last_unstale":"2026-02-24T09:09:34.950667+0000","last_undegraded":"2026-02-24T09:09:34.950667+0000","last_fullsized":"2026-02-24T09:09:34.950667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:30:45.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334847+0000","last_change":"2026-02-24T09:09:25.271121+0000","last_active":"2026-02-24T09:09:26.334847+0000","last_peered":"2026-02-24T09:09:26.334847+0000","last_clean":"2026-02-24T09:09:26.334847+0000","last_became_active":"2026-02-24T09:09:25.270770+0000","last_became_peered":"2026-02-24T09:09:25.270770+0000","last_unstale":"2026-02-24T09:09:26.334847+0000","last_undegraded":"2026-02-24T09:09:26.334847+0000","last_fullsized":"2026-02-24T09:09:26.334847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:52:58.451719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940998+0000","last_change":"2026-02-24T09:09:24.259030+0000","last_active":"2026-02-24T09:09:27.940998+0000","last_peered":"2026-02-24T09:09:27.940998+0000","last_clean":"2026-02-24T09:09:27.940998+0000","last_became_active":"2026-02-24T09:09:24.258747+0000","last_became_peered":"2026-02-24T09:09:24.258747+0000","last_unstale":"2026-02-24T09:09:27.940998+0000","last_undegraded":"2026-02-24T09:09:27.940998+0000","last_fullsized":"2026-02-24T09:09:27.940998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:49:46.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267794+0000","last_change":"2026-02-24T09:09:25.269875+0000","last_active":"2026-02-24T09:09:26.267794+0000","last_peered":"2026-02-24T09:09:26.267794+0000","last_clean":"2026-02-24T09:09:26.267794+0000","last_became_active":"2026-02-24T09:09:25.269400+0000","last_became_peered":"2026-02-24T09:09:25.269400+0000","last_unstale":"2026-02-24T09:09:26.267794+0000","last_undegraded":"2026-02-24T09:09:26.267794+0000","last_fullsized":"2026-02-24T09:09:26.267794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:08:29.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938278+0000","last_change":"2026-02-24T09:09:24.256845+0000","last_active":"2026-02-24T09:09:27.938278+0000","last_peered":"2026-02-24T09:09:27.938278+0000","last_clean":"2026-02-24T09:09:27.938278+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:27.938278+0000","last_undegraded":"2026-02-24T09:09:27.938278+0000","last_fullsized":"2026-02-24T09:09:27.938278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:08:15.802226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334785+0000","last_change":"2026-02-24T09:09:25.269608+0000","last_active":"2026-02-24T09:09:26.334785+0000","last_peered":"2026-02-24T09:09:26.334785+0000","last_clean":"2026-02-24T09:09:26.334785+0000","last_became_active":"2026-02-24T09:09:25.268736+0000","last_became_peered":"2026-02-24T09:09:25.268736+0000","last_unstale":"2026-02-24T09:09:26.334785+0000","last_undegraded":"2026-02-24T09:09:26.334785+0000","last_fullsized":"2026-02-24T09:09:26.334785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:39:41.466580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'22","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:35.954121+0000","last_change":"2026-02-24T09:09:24.260591+0000","last_active":"2026-02-24T09:09:35.954121+0000","last_peered":"2026-02-24T09:09:35.954121+0000","last_clean":"2026-02-24T09:09:35.954121+0000","last_became_active":"2026-02-24T09:09:24.260382+0000","last_became_peered":"2026-02-24T09:09:24.260382+0000","last_unstale":"2026-02-24T09:09:35.954121+0000","last_undegraded":"2026-02-24T09:09:35.954121+0000","last_fullsized":"2026-02-24T09:09:35.954121+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:05:00.313499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52244,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":61,"num_write":23,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267717+0000","last_change":"2026-02-24T09:09:25.266872+0000","last_active":"2026-02-24T09:09:26.267717+0000","last_peered":"2026-02-24T09:09:26.267717+0000","last_clean":"2026-02-24T09:09:26.267717+0000","last_became_active":"2026-02-24T09:09:25.266720+0000","last_became_peered":"2026-02-24T09:09:25.266720+0000","last_unstale":"2026-02-24T09:09:26.267717+0000","last_undegraded":"2026-02-24T09:09:26.267717+0000","last_fullsized":"2026-02-24T09:09:26.267717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:43.574647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941766+0000","last_change":"2026-02-24T09:09:24.256821+0000","last_active":"2026-02-24T09:09:28.941766+0000","last_peered":"2026-02-24T09:09:28.941766+0000","last_clean":"2026-02-24T09:09:28.941766+0000","last_became_active":"2026-02-24T09:09:24.256284+0000","last_became_peered":"2026-02-24T09:09:24.256284+0000","last_unstale":"2026-02-24T09:09:28.941766+0000","last_undegraded":"2026-02-24T09:09:28.941766+0000","last_fullsized":"2026-02-24T09:09:28.941766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:37:32.352734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332187+0000","last_change":"2026-02-24T09:09:25.268120+0000","last_active":"2026-02-24T09:09:26.332187+0000","last_peered":"2026-02-24T09:09:26.332187+0000","last_clean":"2026-02-24T09:09:26.332187+0000","last_became_active":"2026-02-24T09:09:25.267865+0000","last_became_peered":"2026-02-24T09:09:25.267865+0000","last_unstale":"2026-02-24T09:09:26.332187+0000","last_undegraded":"2026-02-24T09:09:26.332187+0000","last_fullsized":"2026-02-24T09:09:26.332187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:51:18.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938196+0000","last_change":"2026-02-24T09:09:24.257176+0000","last_active":"2026-02-24T09:09:27.938196+0000","last_peered":"2026-02-24T09:09:27.938196+0000","last_clean":"2026-02-24T09:09:27.938196+0000","last_became_active":"2026-02-24T09:09:24.256855+0000","last_became_peered":"2026-02-24T09:09:24.256855+0000","last_unstale":"2026-02-24T09:09:27.938196+0000","last_undegraded":"2026-02-24T09:09:27.938196+0000","last_fullsized":"2026-02-24T09:09:27.938196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:48:25.179774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733497+0000","last_change":"2026-02-24T09:09:25.271913+0000","last_active":"2026-02-24T09:09:26.733497+0000","last_peered":"2026-02-24T09:09:26.733497+0000","last_clean":"2026-02-24T09:09:26.733497+0000","last_became_active":"2026-02-24T09:09:25.271736+0000","last_became_peered":"2026-02-24T09:09:25.271736+0000","last_unstale":"2026-02-24T09:09:26.733497+0000","last_undegraded":"2026-02-24T09:09:26.733497+0000","last_fullsized":"2026-02-24T09:09:26.733497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:49.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:37.954400+0000","last_change":"2026-02-24T09:09:24.259308+0000","last_active":"2026-02-24T09:09:37.954400+0000","last_peered":"2026-02-24T09:09:37.954400+0000","last_clean":"2026-02-24T09:09:37.954400+0000","last_became_active":"2026-02-24T09:09:24.259131+0000","last_became_peered":"2026-02-24T09:09:24.259131+0000","last_unstale":"2026-02-24T09:09:37.954400+0000","last_undegraded":"2026-02-24T09:09:37.954400+0000","last_fullsized":"2026-02-24T09:09:37.954400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:52:00.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733165+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.733165+0000","last_peered":"2026-02-24T09:09:26.733165+0000","last_clean":"2026-02-24T09:09:26.733165+0000","last_became_active":"2026-02-24T09:09:25.269559+0000","last_became_peered":"2026-02-24T09:09:25.269559+0000","last_unstale":"2026-02-24T09:09:26.733165+0000","last_undegraded":"2026-02-24T09:09:26.733165+0000","last_fullsized":"2026-02-24T09:09:26.733165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:06:28.902948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942522+0000","last_change":"2026-02-24T09:09:24.257075+0000","last_active":"2026-02-24T09:09:28.942522+0000","last_peered":"2026-02-24T09:09:28.942522+0000","last_clean":"2026-02-24T09:09:28.942522+0000","last_became_active":"2026-02-24T09:09:24.256738+0000","last_became_peered":"2026-02-24T09:09:24.256738+0000","last_unstale":"2026-02-24T09:09:28.942522+0000","last_undegraded":"2026-02-24T09:09:28.942522+0000","last_fullsized":"2026-02-24T09:09:28.942522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:14.802040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268002+0000","last_change":"2026-02-24T09:09:25.271423+0000","last_active":"2026-02-24T09:09:26.268002+0000","last_peered":"2026-02-24T09:09:26.268002+0000","last_clean":"2026-02-24T09:09:26.268002+0000","last_became_active":"2026-02-24T09:09:25.271142+0000","last_became_peered":"2026-02-24T09:09:25.271142+0000","last_unstale":"2026-02-24T09:09:26.268002+0000","last_undegraded":"2026-02-24T09:09:26.268002+0000","last_fullsized":"2026-02-24T09:09:26.268002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:16.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.940354+0000","last_change":"2026-02-24T09:09:24.258426+0000","last_active":"2026-02-24T09:09:29.940354+0000","last_peered":"2026-02-24T09:09:29.940354+0000","last_clean":"2026-02-24T09:09:29.940354+0000","last_became_active":"2026-02-24T09:09:24.257941+0000","last_became_peered":"2026-02-24T09:09:24.257941+0000","last_unstale":"2026-02-24T09:09:29.940354+0000","last_undegraded":"2026-02-24T09:09:29.940354+0000","last_fullsized":"2026-02-24T09:09:29.940354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:30:29.724001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332552+0000","last_change":"2026-02-24T09:09:25.266758+0000","last_active":"2026-02-24T09:09:26.332552+0000","last_peered":"2026-02-24T09:09:26.332552+0000","last_clean":"2026-02-24T09:09:26.332552+0000","last_became_active":"2026-02-24T09:09:25.266569+0000","last_became_peered":"2026-02-24T09:09:25.266569+0000","last_unstale":"2026-02-24T09:09:26.332552+0000","last_undegraded":"2026-02-24T09:09:26.332552+0000","last_fullsized":"2026-02-24T09:09:26.332552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:13:56.985056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332354+0000","last_change":"2026-02-24T09:09:24.256974+0000","last_active":"2026-02-24T09:09:26.332354+0000","last_peered":"2026-02-24T09:09:26.332354+0000","last_clean":"2026-02-24T09:09:26.332354+0000","last_became_active":"2026-02-24T09:09:24.256617+0000","last_became_peered":"2026-02-24T09:09:24.256617+0000","last_unstale":"2026-02-24T09:09:26.332354+0000","last_undegraded":"2026-02-24T09:09:26.332354+0000","last_fullsized":"2026-02-24T09:09:26.332354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:28.318156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733475+0000","last_change":"2026-02-24T09:09:25.270445+0000","last_active":"2026-02-24T09:09:26.733475+0000","last_peered":"2026-02-24T09:09:26.733475+0000","last_clean":"2026-02-24T09:09:26.733475+0000","last_became_active":"2026-02-24T09:09:25.270275+0000","last_became_peered":"2026-02-24T09:09:25.270275+0000","last_unstale":"2026-02-24T09:09:26.733475+0000","last_undegraded":"2026-02-24T09:09:26.733475+0000","last_fullsized":"2026-02-24T09:09:26.733475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:53:49.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210815+0000","last_change":"2026-02-24T09:09:24.259031+0000","last_active":"2026-02-24T09:09:27.210815+0000","last_peered":"2026-02-24T09:09:27.210815+0000","last_clean":"2026-02-24T09:09:27.210815+0000","last_became_active":"2026-02-24T09:09:24.258899+0000","last_became_peered":"2026-02-24T09:09:24.258899+0000","last_unstale":"2026-02-24T09:09:27.210815+0000","last_undegraded":"2026-02-24T09:09:27.210815+0000","last_fullsized":"2026-02-24T09:09:27.210815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:16.802986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109422+0000","last_change":"2026-02-24T09:09:25.272707+0000","last_active":"2026-02-24T09:09:28.109422+0000","last_peered":"2026-02-24T09:09:28.109422+0000","last_clean":"2026-02-24T09:09:28.109422+0000","last_became_active":"2026-02-24T09:09:25.272563+0000","last_became_peered":"2026-02-24T09:09:25.272563+0000","last_unstale":"2026-02-24T09:09:28.109422+0000","last_undegraded":"2026-02-24T09:09:28.109422+0000","last_fullsized":"2026-02-24T09:09:28.109422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:41:22.895217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942219+0000","last_change":"2026-02-24T09:09:24.256493+0000","last_active":"2026-02-24T09:09:28.942219+0000","last_peered":"2026-02-24T09:09:28.942219+0000","last_clean":"2026-02-24T09:09:28.942219+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:28.942219+0000","last_undegraded":"2026-02-24T09:09:28.942219+0000","last_fullsized":"2026-02-24T09:09:28.942219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:43:12.259841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733528+0000","last_change":"2026-02-24T09:09:25.271977+0000","last_active":"2026-02-24T09:09:26.733528+0000","last_peered":"2026-02-24T09:09:26.733528+0000","last_clean":"2026-02-24T09:09:26.733528+0000","last_became_active":"2026-02-24T09:09:25.271650+0000","last_became_peered":"2026-02-24T09:09:25.271650+0000","last_unstale":"2026-02-24T09:09:26.733528+0000","last_undegraded":"2026-02-24T09:09:26.733528+0000","last_fullsized":"2026-02-24T09:09:26.733528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:10.062115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733207+0000","last_change":"2026-02-24T09:09:05.953512+0000","last_active":"2026-02-24T09:09:26.733207+0000","last_peered":"2026-02-24T09:09:26.733207+0000","last_clean":"2026-02-24T09:09:26.733207+0000","last_became_active":"2026-02-24T09:09:05.953360+0000","last_became_peered":"2026-02-24T09:09:05.953360+0000","last_unstale":"2026-02-24T09:09:26.733207+0000","last_undegraded":"2026-02-24T09:09:26.733207+0000","last_fullsized":"2026-02-24T09:09:26.733207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_clean_scrub_stamp":"2026-02-24T09:08:00.445410+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:48.550493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.945604+0000","last_change":"2026-02-24T09:09:24.259164+0000","last_active":"2026-02-24T09:09:29.945604+0000","last_peered":"2026-02-24T09:09:29.945604+0000","last_clean":"2026-02-24T09:09:29.945604+0000","last_became_active":"2026-02-24T09:09:24.259011+0000","last_became_peered":"2026-02-24T09:09:24.259011+0000","last_unstale":"2026-02-24T09:09:29.945604+0000","last_undegraded":"2026-02-24T09:09:29.945604+0000","last_fullsized":"2026-02-24T09:09:29.945604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:41.649484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268864+0000","last_change":"2026-02-24T09:09:25.269884+0000","last_active":"2026-02-24T09:09:26.268864+0000","last_peered":"2026-02-24T09:09:26.268864+0000","last_clean":"2026-02-24T09:09:26.268864+0000","last_became_active":"2026-02-24T09:09:25.269543+0000","last_became_peered":"2026-02-24T09:09:25.269543+0000","last_unstale":"2026-02-24T09:09:26.268864+0000","last_undegraded":"2026-02-24T09:09:26.268864+0000","last_fullsized":"2026-02-24T09:09:26.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:21:25.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943350+0000","last_change":"2026-02-24T09:09:24.259369+0000","last_active":"2026-02-24T09:09:28.943350+0000","last_peered":"2026-02-24T09:09:28.943350+0000","last_clean":"2026-02-24T09:09:28.943350+0000","last_became_active":"2026-02-24T09:09:24.259086+0000","last_became_peered":"2026-02-24T09:09:24.259086+0000","last_unstale":"2026-02-24T09:09:28.943350+0000","last_undegraded":"2026-02-24T09:09:28.943350+0000","last_fullsized":"2026-02-24T09:09:28.943350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:08.881900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332119+0000","last_change":"2026-02-24T09:09:25.266898+0000","last_active":"2026-02-24T09:09:26.332119+0000","last_peered":"2026-02-24T09:09:26.332119+0000","last_clean":"2026-02-24T09:09:26.332119+0000","last_became_active":"2026-02-24T09:09:25.266407+0000","last_became_peered":"2026-02-24T09:09:25.266407+0000","last_unstale":"2026-02-24T09:09:26.332119+0000","last_undegraded":"2026-02-24T09:09:26.332119+0000","last_fullsized":"2026-02-24T09:09:26.332119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:51.887929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:33.948252+0000","last_change":"2026-02-24T09:09:24.254126+0000","last_active":"2026-02-24T09:09:33.948252+0000","last_peered":"2026-02-24T09:09:33.948252+0000","last_clean":"2026-02-24T09:09:33.948252+0000","last_became_active":"2026-02-24T09:09:24.253911+0000","last_became_peered":"2026-02-24T09:09:24.253911+0000","last_unstale":"2026-02-24T09:09:33.948252+0000","last_undegraded":"2026-02-24T09:09:33.948252+0000","last_fullsized":"2026-02-24T09:09:33.948252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:09:56.146842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268161+0000","last_change":"2026-02-24T09:09:25.270387+0000","last_active":"2026-02-24T09:09:26.268161+0000","last_peered":"2026-02-24T09:09:26.268161+0000","last_clean":"2026-02-24T09:09:26.268161+0000","last_became_active":"2026-02-24T09:09:25.269478+0000","last_became_peered":"2026-02-24T09:09:25.269478+0000","last_unstale":"2026-02-24T09:09:26.268161+0000","last_undegraded":"2026-02-24T09:09:26.268161+0000","last_fullsized":"2026-02-24T09:09:26.268161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:32:15.217221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109411+0000","last_change":"2026-02-24T09:09:24.259169+0000","last_active":"2026-02-24T09:09:28.109411+0000","last_peered":"2026-02-24T09:09:28.109411+0000","last_clean":"2026-02-24T09:09:28.109411+0000","last_became_active":"2026-02-24T09:09:24.258755+0000","last_became_peered":"2026-02-24T09:09:24.258755+0000","last_unstale":"2026-02-24T09:09:28.109411+0000","last_undegraded":"2026-02-24T09:09:28.109411+0000","last_fullsized":"2026-02-24T09:09:28.109411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:33.438504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270152+0000","last_change":"2026-02-24T09:09:25.270732+0000","last_active":"2026-02-24T09:09:26.270152+0000","last_peered":"2026-02-24T09:09:26.270152+0000","last_clean":"2026-02-24T09:09:26.270152+0000","last_became_active":"2026-02-24T09:09:25.270200+0000","last_became_peered":"2026-02-24T09:09:25.270200+0000","last_unstale":"2026-02-24T09:09:26.270152+0000","last_undegraded":"2026-02-24T09:09:26.270152+0000","last_fullsized":"2026-02-24T09:09:26.270152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:59:28.115196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267351+0000","last_change":"2026-02-24T09:09:24.257488+0000","last_active":"2026-02-24T09:09:26.267351+0000","last_peered":"2026-02-24T09:09:26.267351+0000","last_clean":"2026-02-24T09:09:26.267351+0000","last_became_active":"2026-02-24T09:09:24.257202+0000","last_became_peered":"2026-02-24T09:09:24.257202+0000","last_unstale":"2026-02-24T09:09:26.267351+0000","last_undegraded":"2026-02-24T09:09:26.267351+0000","last_fullsized":"2026-02-24T09:09:26.267351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:41:24.345307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.674896+0000","last_change":"2026-02-24T09:09:25.272254+0000","last_active":"2026-02-24T09:09:26.674896+0000","last_peered":"2026-02-24T09:09:26.674896+0000","last_clean":"2026-02-24T09:09:26.674896+0000","last_became_active":"2026-02-24T09:09:25.271674+0000","last_became_peered":"2026-02-24T09:09:25.271674+0000","last_unstale":"2026-02-24T09:09:26.674896+0000","last_undegraded":"2026-02-24T09:09:26.674896+0000","last_fullsized":"2026-02-24T09:09:26.674896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:03:26.493850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938246+0000","last_change":"2026-02-24T09:09:24.257331+0000","last_active":"2026-02-24T09:09:27.938246+0000","last_peered":"2026-02-24T09:09:27.938246+0000","last_clean":"2026-02-24T09:09:27.938246+0000","last_became_active":"2026-02-24T09:09:24.256876+0000","last_became_peered":"2026-02-24T09:09:24.256876+0000","last_unstale":"2026-02-24T09:09:27.938246+0000","last_undegraded":"2026-02-24T09:09:27.938246+0000","last_fullsized":"2026-02-24T09:09:27.938246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:29:58.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332332+0000","last_change":"2026-02-24T09:09:25.266642+0000","last_active":"2026-02-24T09:09:26.332332+0000","last_peered":"2026-02-24T09:09:26.332332+0000","last_clean":"2026-02-24T09:09:26.332332+0000","last_became_active":"2026-02-24T09:09:25.266307+0000","last_became_peered":"2026-02-24T09:09:25.266307+0000","last_unstale":"2026-02-24T09:09:26.332332+0000","last_undegraded":"2026-02-24T09:09:26.332332+0000","last_fullsized":"2026-02-24T09:09:26.332332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:51.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:37.268830+0000","last_change":"2026-02-24T09:09:24.258807+0000","last_active":"2026-02-24T09:09:37.268830+0000","last_peered":"2026-02-24T09:09:37.268830+0000","last_clean":"2026-02-24T09:09:37.268830+0000","last_became_active":"2026-02-24T09:09:24.258649+0000","last_became_peered":"2026-02-24T09:09:24.258649+0000","last_unstale":"2026-02-24T09:09:37.268830+0000","last_undegraded":"2026-02-24T09:09:37.268830+0000","last_fullsized":"2026-02-24T09:09:37.268830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:10:48.348275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269009+0000","last_change":"2026-02-24T09:09:25.268491+0000","last_active":"2026-02-24T09:09:26.269009+0000","last_peered":"2026-02-24T09:09:26.269009+0000","last_clean":"2026-02-24T09:09:26.269009+0000","last_became_active":"2026-02-24T09:09:25.267341+0000","last_became_peered":"2026-02-24T09:09:25.267341+0000","last_unstale":"2026-02-24T09:09:26.269009+0000","last_undegraded":"2026-02-24T09:09:26.269009+0000","last_fullsized":"2026-02-24T09:09:26.269009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:18:29.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940964+0000","last_change":"2026-02-24T09:09:24.258484+0000","last_active":"2026-02-24T09:09:27.940964+0000","last_peered":"2026-02-24T09:09:27.940964+0000","last_clean":"2026-02-24T09:09:27.940964+0000","last_became_active":"2026-02-24T09:09:24.258249+0000","last_became_peered":"2026-02-24T09:09:24.258249+0000","last_unstale":"2026-02-24T09:09:27.940964+0000","last_undegraded":"2026-02-24T09:09:27.940964+0000","last_fullsized":"2026-02-24T09:09:27.940964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:32:56.722522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267783+0000","last_change":"2026-02-24T09:09:25.269738+0000","last_active":"2026-02-24T09:09:26.267783+0000","last_peered":"2026-02-24T09:09:26.267783+0000","last_clean":"2026-02-24T09:09:26.267783+0000","last_became_active":"2026-02-24T09:09:25.269413+0000","last_became_peered":"2026-02-24T09:09:25.269413+0000","last_unstale":"2026-02-24T09:09:26.267783+0000","last_undegraded":"2026-02-24T09:09:26.267783+0000","last_fullsized":"2026-02-24T09:09:26.267783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:00.412570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941334+0000","last_change":"2026-02-24T09:09:24.258901+0000","last_active":"2026-02-24T09:09:27.941334+0000","last_peered":"2026-02-24T09:09:27.941334+0000","last_clean":"2026-02-24T09:09:27.941334+0000","last_became_active":"2026-02-24T09:09:24.258325+0000","last_became_peered":"2026-02-24T09:09:24.258325+0000","last_unstale":"2026-02-24T09:09:27.941334+0000","last_undegraded":"2026-02-24T09:09:27.941334+0000","last_fullsized":"2026-02-24T09:09:27.941334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:36.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267522+0000","last_change":"2026-02-24T09:09:25.267368+0000","last_active":"2026-02-24T09:09:26.267522+0000","last_peered":"2026-02-24T09:09:26.267522+0000","last_clean":"2026-02-24T09:09:26.267522+0000","last_became_active":"2026-02-24T09:09:25.267168+0000","last_became_peered":"2026-02-24T09:09:25.267168+0000","last_unstale":"2026-02-24T09:09:26.267522+0000","last_undegraded":"2026-02-24T09:09:26.267522+0000","last_fullsized":"2026-02-24T09:09:26.267522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:57.616866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.939140+0000","last_change":"2026-02-24T09:09:24.257345+0000","last_active":"2026-02-24T09:09:27.939140+0000","last_peered":"2026-02-24T09:09:27.939140+0000","last_clean":"2026-02-24T09:09:27.939140+0000","last_became_active":"2026-02-24T09:09:24.256817+0000","last_became_peered":"2026-02-24T09:09:24.256817+0000","last_unstale":"2026-02-24T09:09:27.939140+0000","last_undegraded":"2026-02-24T09:09:27.939140+0000","last_fullsized":"2026-02-24T09:09:27.939140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:37:48.042471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332527+0000","last_change":"2026-02-24T09:09:25.267778+0000","last_active":"2026-02-24T09:09:26.332527+0000","last_peered":"2026-02-24T09:09:26.332527+0000","last_clean":"2026-02-24T09:09:26.332527+0000","last_became_active":"2026-02-24T09:09:25.267379+0000","last_became_peered":"2026-02-24T09:09:25.267379+0000","last_unstale":"2026-02-24T09:09:26.332527+0000","last_undegraded":"2026-02-24T09:09:26.332527+0000","last_fullsized":"2026-02-24T09:09:26.332527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:25:47.194857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.121396+0000","last_change":"2026-02-24T09:09:24.259141+0000","last_active":"2026-02-24T09:09:28.121396+0000","last_peered":"2026-02-24T09:09:28.121396+0000","last_clean":"2026-02-24T09:09:28.121396+0000","last_became_active":"2026-02-24T09:09:24.258981+0000","last_became_peered":"2026-02-24T09:09:24.258981+0000","last_unstale":"2026-02-24T09:09:28.121396+0000","last_undegraded":"2026-02-24T09:09:28.121396+0000","last_fullsized":"2026-02-24T09:09:28.121396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:48.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268774+0000","last_change":"2026-02-24T09:09:25.268540+0000","last_active":"2026-02-24T09:09:26.268774+0000","last_peered":"2026-02-24T09:09:26.268774+0000","last_clean":"2026-02-24T09:09:26.268774+0000","last_became_active":"2026-02-24T09:09:25.267915+0000","last_became_peered":"2026-02-24T09:09:25.267915+0000","last_unstale":"2026-02-24T09:09:26.268774+0000","last_undegraded":"2026-02-24T09:09:26.268774+0000","last_fullsized":"2026-02-24T09:09:26.268774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:55.564971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938005+0000","last_change":"2026-02-24T09:09:24.257964+0000","last_active":"2026-02-24T09:09:27.938005+0000","last_peered":"2026-02-24T09:09:27.938005+0000","last_clean":"2026-02-24T09:09:27.938005+0000","last_became_active":"2026-02-24T09:09:24.257717+0000","last_became_peered":"2026-02-24T09:09:24.257717+0000","last_unstale":"2026-02-24T09:09:27.938005+0000","last_undegraded":"2026-02-24T09:09:27.938005+0000","last_fullsized":"2026-02-24T09:09:27.938005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:23:24.989893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733433+0000","last_change":"2026-02-24T09:09:25.271214+0000","last_active":"2026-02-24T09:09:26.733433+0000","last_peered":"2026-02-24T09:09:26.733433+0000","last_clean":"2026-02-24T09:09:26.733433+0000","last_became_active":"2026-02-24T09:09:25.271038+0000","last_became_peered":"2026-02-24T09:09:25.271038+0000","last_unstale":"2026-02-24T09:09:26.733433+0000","last_undegraded":"2026-02-24T09:09:26.733433+0000","last_fullsized":"2026-02-24T09:09:26.733433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:58:44.899837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268097+0000","last_change":"2026-02-24T09:09:25.269834+0000","last_active":"2026-02-24T09:09:26.268097+0000","last_peered":"2026-02-24T09:09:26.268097+0000","last_clean":"2026-02-24T09:09:26.268097+0000","last_became_active":"2026-02-24T09:09:25.269526+0000","last_became_peered":"2026-02-24T09:09:25.269526+0000","last_unstale":"2026-02-24T09:09:26.268097+0000","last_undegraded":"2026-02-24T09:09:26.268097+0000","last_fullsized":"2026-02-24T09:09:26.268097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:36:54.610640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267687+0000","last_change":"2026-02-24T09:09:24.258597+0000","last_active":"2026-02-24T09:09:26.267687+0000","last_peered":"2026-02-24T09:09:26.267687+0000","last_clean":"2026-02-24T09:09:26.267687+0000","last_became_active":"2026-02-24T09:09:24.258302+0000","last_became_peered":"2026-02-24T09:09:24.258302+0000","last_unstale":"2026-02-24T09:09:26.267687+0000","last_undegraded":"2026-02-24T09:09:26.267687+0000","last_fullsized":"2026-02-24T09:09:26.267687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:20:15.556479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334746+0000","last_change":"2026-02-24T09:09:25.269804+0000","last_active":"2026-02-24T09:09:26.334746+0000","last_peered":"2026-02-24T09:09:26.334746+0000","last_clean":"2026-02-24T09:09:26.334746+0000","last_became_active":"2026-02-24T09:09:25.268973+0000","last_became_peered":"2026-02-24T09:09:25.268973+0000","last_unstale":"2026-02-24T09:09:26.334746+0000","last_undegraded":"2026-02-24T09:09:26.334746+0000","last_fullsized":"2026-02-24T09:09:26.334746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:33:39.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942003+0000","last_change":"2026-02-24T09:09:24.257428+0000","last_active":"2026-02-24T09:09:28.942003+0000","last_peered":"2026-02-24T09:09:28.942003+0000","last_clean":"2026-02-24T09:09:28.942003+0000","last_became_active":"2026-02-24T09:09:24.256679+0000","last_became_peered":"2026-02-24T09:09:24.256679+0000","last_unstale":"2026-02-24T09:09:28.942003+0000","last_undegraded":"2026-02-24T09:09:28.942003+0000","last_fullsized":"2026-02-24T09:09:28.942003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:39:28.664820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267792+0000","last_change":"2026-02-24T09:09:25.268127+0000","last_active":"2026-02-24T09:09:26.267792+0000","last_peered":"2026-02-24T09:09:26.267792+0000","last_clean":"2026-02-24T09:09:26.267792+0000","last_became_active":"2026-02-24T09:09:25.267860+0000","last_became_peered":"2026-02-24T09:09:25.267860+0000","last_unstale":"2026-02-24T09:09:26.267792+0000","last_undegraded":"2026-02-24T09:09:26.267792+0000","last_fullsized":"2026-02-24T09:09:26.267792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:37:52.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269053+0000","last_change":"2026-02-24T09:09:24.257552+0000","last_active":"2026-02-24T09:09:26.269053+0000","last_peered":"2026-02-24T09:09:26.269053+0000","last_clean":"2026-02-24T09:09:26.269053+0000","last_became_active":"2026-02-24T09:09:24.257163+0000","last_became_peered":"2026-02-24T09:09:24.257163+0000","last_unstale":"2026-02-24T09:09:26.269053+0000","last_undegraded":"2026-02-24T09:09:26.269053+0000","last_fullsized":"2026-02-24T09:09:26.269053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:30:54.285800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268961+0000","last_change":"2026-02-24T09:09:25.268695+0000","last_active":"2026-02-24T09:09:26.268961+0000","last_peered":"2026-02-24T09:09:26.268961+0000","last_clean":"2026-02-24T09:09:26.268961+0000","last_became_active":"2026-02-24T09:09:25.268128+0000","last_became_peered":"2026-02-24T09:09:25.268128+0000","last_unstale":"2026-02-24T09:09:26.268961+0000","last_undegraded":"2026-02-24T09:09:26.268961+0000","last_fullsized":"2026-02-24T09:09:26.268961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:23.987958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942226+0000","last_change":"2026-02-24T09:09:24.257602+0000","last_active":"2026-02-24T09:09:28.942226+0000","last_peered":"2026-02-24T09:09:28.942226+0000","last_clean":"2026-02-24T09:09:28.942226+0000","last_became_active":"2026-02-24T09:09:24.257440+0000","last_became_peered":"2026-02-24T09:09:24.257440+0000","last_unstale":"2026-02-24T09:09:28.942226+0000","last_undegraded":"2026-02-24T09:09:28.942226+0000","last_fullsized":"2026-02-24T09:09:28.942226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:13:51.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56294,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":69,"num_read_kb":93,"num_write":150,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":168882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119304,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":259322,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710729,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":395125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":27582038},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939657,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27900,"kb_used_data":936,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975300,"statfs":{"total":751619276800,"available":751590707200,"internally_reserved":0,"allocated":958464,"data_stored":1039260,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23856,"internal_metadata":27566800},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24845,"internal_metadata":27565811},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299404,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32653,"internal_metadata":27558003},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":987230,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28867,"internal_metadata":27561789},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":394740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888081,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":986504,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":32062,"internal_metadata":27558594},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018899,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31416,"internal_metadata":27559240},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247829,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":395051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46746,"internal_metadata":27543910},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27840,"kb_used_data":876,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975360,"statfs":{"total":751619276800,"available":751590768640,"internally_reserved":0,"allocated":897024,"data_stored":448137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34581,"internal_metadata":27556075},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607575,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27816,"kb_used_data":852,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975384,"statfs":{"total":751619276800,"available":751590793216,"internally_reserved":0,"allocated":872448,"data_stored":446777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738394,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49917,"internal_metadata":27540739},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11012,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":52244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":53604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12011,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13639,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6329,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13842,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3422,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31059,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9492,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13536,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:09:39.932 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:09:40.082 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:40.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.177+0000 7f7fe03c4640 1 -- 10.20.193.4:0/3351027809 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7fd81124f0 msgr2=0x7f7fd8172ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.177+0000 7f7fe03c4640 1 --2- 10.20.193.4:0/3351027809 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7fd81124f0 0x7f7fd8172ec0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=17173788754445938250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7fd400aa30 tx=0x7f7fd4030280 comp rx=0 tx=0).stop 2026-02-24T09:09:40.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.177+0000 7f7fe03c4640 1 -- 10.20.193.4:0/3351027809 shutdown_connections 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.177+0000 7f7fe03c4640 1 --2- 10.20.193.4:0/3351027809 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7fd81124f0 0x7f7fd8172ec0 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=17173788754445938250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.177+0000 7f7fe03c4640 1 --2- 10.20.193.4:0/3351027809 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7fd810ccf0 0x7f7fd8111d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.177+0000 7f7fe03c4640 1 --2- 10.20.193.4:0/3351027809 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fd810c300 0x7f7fd810c6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.177+0000 7f7fe03c4640 1 -- 10.20.193.4:0/3351027809 >> 10.20.193.4:0/3351027809 conn(0x7f7fd80e9bf0 msgr2=0x7f7fd810a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.177+0000 7f7fe03c4640 1 -- 10.20.193.4:0/3351027809 shutdown_connections 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.177+0000 7f7fe03c4640 1 -- 10.20.193.4:0/3351027809 wait complete. 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fe03c4640 1 Processor -- start 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fe03c4640 1 -- start start 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fe03c4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fd810c300 0x7f7fd80f5940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fe03c4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7fd810ccf0 0x7f7fd8172dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fe03c4640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7fd81124f0 0x7f7fd80f6040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fe03c4640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80fb250 con 0x7f7fd810ccf0 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fe03c4640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80fb3c0 con 0x7f7fd81124f0 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fe03c4640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80fb580 con 0x7f7fd810c300 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fdd938640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7fd810ccf0 0x7f7fd8172dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fdd938640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7fd810ccf0 0x7f7fd8172dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59888/0 (socket says 10.20.193.4:59888) 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fdd938640 1 -- 10.20.193.4:0/1557970953 learned_addr learned my addr 10.20.193.4:0/1557970953 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fde139640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fd810c300 0x7f7fd80f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fde93a640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7fd81124f0 0x7f7fd80f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fdd938640 1 -- 10.20.193.4:0/1557970953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fd810c300 msgr2=0x7f7fd80f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fdd938640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fd810c300 0x7f7fd80f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fdd938640 1 -- 10.20.193.4:0/1557970953 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7fd81124f0 msgr2=0x7f7fd80f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fdd938640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7fd81124f0 0x7f7fd80f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fdd938640 1 -- 10.20.193.4:0/1557970953 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd400a650 con 0x7f7fd810ccf0 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fde139640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fd810c300 0x7f7fd80f5940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fdd938640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7fd810ccf0 0x7f7fd8172dc0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7fcc00d950 tx=0x7f7fcc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fbf7fe640 1 -- 10.20.193.4:0/1557970953 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7fcc004540 con 0x7f7fd810ccf0 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fbf7fe640 1 -- 10.20.193.4:0/1557970953 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7fcc009d00 con 0x7f7fd810ccf0 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fe03c4640 1 -- 10.20.193.4:0/1557970953 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd80fb860 con 0x7f7fd810ccf0 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fbf7fe640 1 -- 10.20.193.4:0/1557970953 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7fcc0106e0 con 0x7f7fd810ccf0 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.178+0000 7f7fe03c4640 1 -- 10.20.193.4:0/1557970953 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd80fbd30 con 0x7f7fd810ccf0 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.179+0000 7f7fe03c4640 1 -- 10.20.193.4:0/1557970953 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd810d5e0 con 0x7f7fd810ccf0 2026-02-24T09:09:40.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.180+0000 7f7fbf7fe640 1 -- 10.20.193.4:0/1557970953 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f7fcc0097c0 con 0x7f7fd810ccf0 2026-02-24T09:09:40.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.180+0000 7f7fbf7fe640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7fb40b5760 0x7f7fb40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.180+0000 7f7fbf7fe640 1 -- 10.20.193.4:0/1557970953 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f7fcc0e73b0 con 0x7f7fd810ccf0 2026-02-24T09:09:40.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.180+0000 7f7fde139640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7fb40b5760 0x7f7fb40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.181+0000 7f7fde139640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7fb40b5760 0x7f7fb40d5c10 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7fc8005970 tx=0x7f7fc8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:40.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.181+0000 7f7fbf7fe640 1 -- 10.20.193.4:0/1557970953 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f7fcc0a9d00 con 0x7f7fd810ccf0 2026-02-24T09:09:40.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.286+0000 7f7fe03c4640 1 -- 10.20.193.4:0/1557970953 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fd8062010 con 0x7f7fb40b5760 2026-02-24T09:09:40.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.288+0000 7f7fbf7fe640 1 -- 10.20.193.4:0/1557970953 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258953 (secure 0 0 0) 0x7f7fd8062010 con 0x7f7fb40b5760 2026-02-24T09:09:40.294 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:40.296 INFO:teuthology.orchestra.run.trial004.stderr:dumped all 2026-02-24T09:09:40.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 -- 10.20.193.4:0/1557970953 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7fb40b5760 msgr2=0x7f7fb40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7fb40b5760 0x7f7fb40d5c10 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7fc8005970 tx=0x7f7fc8005900 comp rx=0 tx=0).stop 2026-02-24T09:09:40.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 -- 10.20.193.4:0/1557970953 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7fd810ccf0 msgr2=0x7f7fd8172dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7fd810ccf0 0x7f7fd8172dc0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7fcc00d950 tx=0x7f7fcc00de20 comp rx=0 tx=0).stop 2026-02-24T09:09:40.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 -- 10.20.193.4:0/1557970953 shutdown_connections 2026-02-24T09:09:40.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7fb40b5760 0x7f7fb40d5c10 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7fd81124f0 0x7f7fd80f6040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7fd810ccf0 0x7f7fd8172dc0 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 --2- 10.20.193.4:0/1557970953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fd810c300 0x7f7fd80f5940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 -- 10.20.193.4:0/1557970953 >> 10.20.193.4:0/1557970953 conn(0x7f7fd80e9bf0 msgr2=0x7f7fd81103a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:40.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 -- 10.20.193.4:0/1557970953 shutdown_connections 2026-02-24T09:09:40.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.290+0000 7f7fe03c4640 1 -- 10.20.193.4:0/1557970953 wait complete. 2026-02-24T09:09:40.329 INFO:teuthology.orchestra.run.trial004.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2026-02-24T09:09:39.666318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646896,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":175,"num_read_kb":184,"num_write":341,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333624,"kb_used_data":10056,"kb_used_omap":377,"kb_used_meta":322950,"kb_avail":8807704776,"statfs":{"total":9019431321600,"available":9019089690624,"internally_reserved":0,"allocated":10297344,"data_stored":6675084,"data_compressed":113181,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":386257,"internal_metadata":330701615},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54724,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":69,"num_read_kb":93,"num_write":121,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002587"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332664+0000","last_change":"2026-02-24T09:09:25.267627+0000","last_active":"2026-02-24T09:09:26.332664+0000","last_peered":"2026-02-24T09:09:26.332664+0000","last_clean":"2026-02-24T09:09:26.332664+0000","last_became_active":"2026-02-24T09:09:25.267439+0000","last_became_peered":"2026-02-24T09:09:25.267439+0000","last_unstale":"2026-02-24T09:09:26.332664+0000","last_undegraded":"2026-02-24T09:09:26.332664+0000","last_fullsized":"2026-02-24T09:09:26.332664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:24.034680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267727+0000","last_change":"2026-02-24T09:09:25.267299+0000","last_active":"2026-02-24T09:09:26.267727+0000","last_peered":"2026-02-24T09:09:26.267727+0000","last_clean":"2026-02-24T09:09:26.267727+0000","last_became_active":"2026-02-24T09:09:25.266956+0000","last_became_peered":"2026-02-24T09:09:25.266956+0000","last_unstale":"2026-02-24T09:09:26.267727+0000","last_undegraded":"2026-02-24T09:09:26.267727+0000","last_fullsized":"2026-02-24T09:09:26.267727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:05.466777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267738+0000","last_change":"2026-02-24T09:09:25.268761+0000","last_active":"2026-02-24T09:09:26.267738+0000","last_peered":"2026-02-24T09:09:26.267738+0000","last_clean":"2026-02-24T09:09:26.267738+0000","last_became_active":"2026-02-24T09:09:25.268476+0000","last_became_peered":"2026-02-24T09:09:25.268476+0000","last_unstale":"2026-02-24T09:09:26.267738+0000","last_undegraded":"2026-02-24T09:09:26.267738+0000","last_fullsized":"2026-02-24T09:09:26.267738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:26:00.680116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335046+0000","last_change":"2026-02-24T09:09:25.271303+0000","last_active":"2026-02-24T09:09:26.335046+0000","last_peered":"2026-02-24T09:09:26.335046+0000","last_clean":"2026-02-24T09:09:26.335046+0000","last_became_active":"2026-02-24T09:09:25.271175+0000","last_became_peered":"2026-02-24T09:09:25.271175+0000","last_unstale":"2026-02-24T09:09:26.335046+0000","last_undegraded":"2026-02-24T09:09:26.335046+0000","last_fullsized":"2026-02-24T09:09:26.335046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:55:25.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267634+0000","last_change":"2026-02-24T09:09:25.267923+0000","last_active":"2026-02-24T09:09:26.267634+0000","last_peered":"2026-02-24T09:09:26.267634+0000","last_clean":"2026-02-24T09:09:26.267634+0000","last_became_active":"2026-02-24T09:09:25.267775+0000","last_became_peered":"2026-02-24T09:09:25.267775+0000","last_unstale":"2026-02-24T09:09:26.267634+0000","last_undegraded":"2026-02-24T09:09:26.267634+0000","last_fullsized":"2026-02-24T09:09:26.267634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:54:25.575849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270023+0000","last_change":"2026-02-24T09:09:25.269603+0000","last_active":"2026-02-24T09:09:26.270023+0000","last_peered":"2026-02-24T09:09:26.270023+0000","last_clean":"2026-02-24T09:09:26.270023+0000","last_became_active":"2026-02-24T09:09:25.269057+0000","last_became_peered":"2026-02-24T09:09:25.269057+0000","last_unstale":"2026-02-24T09:09:26.270023+0000","last_undegraded":"2026-02-24T09:09:26.270023+0000","last_fullsized":"2026-02-24T09:09:26.270023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:39:21.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733238+0000","last_change":"2026-02-24T09:09:25.270852+0000","last_active":"2026-02-24T09:09:26.733238+0000","last_peered":"2026-02-24T09:09:26.733238+0000","last_clean":"2026-02-24T09:09:26.733238+0000","last_became_active":"2026-02-24T09:09:25.270607+0000","last_became_peered":"2026-02-24T09:09:25.270607+0000","last_unstale":"2026-02-24T09:09:26.733238+0000","last_undegraded":"2026-02-24T09:09:26.733238+0000","last_fullsized":"2026-02-24T09:09:26.733238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:45:43.574810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268619+0000","last_change":"2026-02-24T09:09:25.268833+0000","last_active":"2026-02-24T09:09:26.268619+0000","last_peered":"2026-02-24T09:09:26.268619+0000","last_clean":"2026-02-24T09:09:26.268619+0000","last_became_active":"2026-02-24T09:09:25.268462+0000","last_became_peered":"2026-02-24T09:09:25.268462+0000","last_unstale":"2026-02-24T09:09:26.268619+0000","last_undegraded":"2026-02-24T09:09:26.268619+0000","last_fullsized":"2026-02-24T09:09:26.268619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:47.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334895+0000","last_change":"2026-02-24T09:09:25.271419+0000","last_active":"2026-02-24T09:09:26.334895+0000","last_peered":"2026-02-24T09:09:26.334895+0000","last_clean":"2026-02-24T09:09:26.334895+0000","last_became_active":"2026-02-24T09:09:25.270954+0000","last_became_peered":"2026-02-24T09:09:25.270954+0000","last_unstale":"2026-02-24T09:09:26.334895+0000","last_undegraded":"2026-02-24T09:09:26.334895+0000","last_fullsized":"2026-02-24T09:09:26.334895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:07:15.889565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270286+0000","last_change":"2026-02-24T09:09:25.269709+0000","last_active":"2026-02-24T09:09:26.270286+0000","last_peered":"2026-02-24T09:09:26.270286+0000","last_clean":"2026-02-24T09:09:26.270286+0000","last_became_active":"2026-02-24T09:09:25.269136+0000","last_became_peered":"2026-02-24T09:09:25.269136+0000","last_unstale":"2026-02-24T09:09:26.270286+0000","last_undegraded":"2026-02-24T09:09:26.270286+0000","last_fullsized":"2026-02-24T09:09:26.270286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:42:02.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733508+0000","last_change":"2026-02-24T09:09:25.272025+0000","last_active":"2026-02-24T09:09:26.733508+0000","last_peered":"2026-02-24T09:09:26.733508+0000","last_clean":"2026-02-24T09:09:26.733508+0000","last_became_active":"2026-02-24T09:09:25.271851+0000","last_became_peered":"2026-02-24T09:09:25.271851+0000","last_unstale":"2026-02-24T09:09:26.733508+0000","last_undegraded":"2026-02-24T09:09:26.733508+0000","last_fullsized":"2026-02-24T09:09:26.733508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:49:57.365130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335160+0000","last_change":"2026-02-24T09:09:25.271156+0000","last_active":"2026-02-24T09:09:26.335160+0000","last_peered":"2026-02-24T09:09:26.335160+0000","last_clean":"2026-02-24T09:09:26.335160+0000","last_became_active":"2026-02-24T09:09:25.270992+0000","last_became_peered":"2026-02-24T09:09:25.270992+0000","last_unstale":"2026-02-24T09:09:26.335160+0000","last_undegraded":"2026-02-24T09:09:26.335160+0000","last_fullsized":"2026-02-24T09:09:26.335160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:56.324038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332309+0000","last_change":"2026-02-24T09:09:25.266871+0000","last_active":"2026-02-24T09:09:26.332309+0000","last_peered":"2026-02-24T09:09:26.332309+0000","last_clean":"2026-02-24T09:09:26.332309+0000","last_became_active":"2026-02-24T09:09:25.266438+0000","last_became_peered":"2026-02-24T09:09:25.266438+0000","last_unstale":"2026-02-24T09:09:26.332309+0000","last_undegraded":"2026-02-24T09:09:26.332309+0000","last_fullsized":"2026-02-24T09:09:26.332309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:24:17.014313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267591+0000","last_change":"2026-02-24T09:09:25.266851+0000","last_active":"2026-02-24T09:09:26.267591+0000","last_peered":"2026-02-24T09:09:26.267591+0000","last_clean":"2026-02-24T09:09:26.267591+0000","last_became_active":"2026-02-24T09:09:25.266530+0000","last_became_peered":"2026-02-24T09:09:25.266530+0000","last_unstale":"2026-02-24T09:09:26.267591+0000","last_undegraded":"2026-02-24T09:09:26.267591+0000","last_fullsized":"2026-02-24T09:09:26.267591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:53.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267465+0000","last_change":"2026-02-24T09:09:25.269561+0000","last_active":"2026-02-24T09:09:26.267465+0000","last_peered":"2026-02-24T09:09:26.267465+0000","last_clean":"2026-02-24T09:09:26.267465+0000","last_became_active":"2026-02-24T09:09:25.268979+0000","last_became_peered":"2026-02-24T09:09:25.268979+0000","last_unstale":"2026-02-24T09:09:26.267465+0000","last_undegraded":"2026-02-24T09:09:26.267465+0000","last_fullsized":"2026-02-24T09:09:26.267465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:16:56.110766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334540+0000","last_change":"2026-02-24T09:09:25.271426+0000","last_active":"2026-02-24T09:09:26.334540+0000","last_peered":"2026-02-24T09:09:26.334540+0000","last_clean":"2026-02-24T09:09:26.334540+0000","last_became_active":"2026-02-24T09:09:25.270917+0000","last_became_peered":"2026-02-24T09:09:25.270917+0000","last_unstale":"2026-02-24T09:09:26.334540+0000","last_undegraded":"2026-02-24T09:09:26.334540+0000","last_fullsized":"2026-02-24T09:09:26.334540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:58:52.125871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332673+0000","last_change":"2026-02-24T09:09:25.267238+0000","last_active":"2026-02-24T09:09:26.332673+0000","last_peered":"2026-02-24T09:09:26.332673+0000","last_clean":"2026-02-24T09:09:26.332673+0000","last_became_active":"2026-02-24T09:09:25.267060+0000","last_became_peered":"2026-02-24T09:09:25.267060+0000","last_unstale":"2026-02-24T09:09:26.332673+0000","last_undegraded":"2026-02-24T09:09:26.332673+0000","last_fullsized":"2026-02-24T09:09:26.332673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:00:58.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267495+0000","last_change":"2026-02-24T09:09:25.266005+0000","last_active":"2026-02-24T09:09:26.267495+0000","last_peered":"2026-02-24T09:09:26.267495+0000","last_clean":"2026-02-24T09:09:26.267495+0000","last_became_active":"2026-02-24T09:09:25.265847+0000","last_became_peered":"2026-02-24T09:09:25.265847+0000","last_unstale":"2026-02-24T09:09:26.267495+0000","last_undegraded":"2026-02-24T09:09:26.267495+0000","last_fullsized":"2026-02-24T09:09:26.267495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:29:02.137351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332638+0000","last_change":"2026-02-24T09:09:25.268822+0000","last_active":"2026-02-24T09:09:26.332638+0000","last_peered":"2026-02-24T09:09:26.332638+0000","last_clean":"2026-02-24T09:09:26.332638+0000","last_became_active":"2026-02-24T09:09:25.268683+0000","last_became_peered":"2026-02-24T09:09:25.268683+0000","last_unstale":"2026-02-24T09:09:26.332638+0000","last_undegraded":"2026-02-24T09:09:26.332638+0000","last_fullsized":"2026-02-24T09:09:26.332638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:23:58.256403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332429+0000","last_change":"2026-02-24T09:09:25.266214+0000","last_active":"2026-02-24T09:09:26.332429+0000","last_peered":"2026-02-24T09:09:26.332429+0000","last_clean":"2026-02-24T09:09:26.332429+0000","last_became_active":"2026-02-24T09:09:25.266019+0000","last_became_peered":"2026-02-24T09:09:25.266019+0000","last_unstale":"2026-02-24T09:09:26.332429+0000","last_undegraded":"2026-02-24T09:09:26.332429+0000","last_fullsized":"2026-02-24T09:09:26.332429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:17.141581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332384+0000","last_change":"2026-02-24T09:09:25.267493+0000","last_active":"2026-02-24T09:09:26.332384+0000","last_peered":"2026-02-24T09:09:26.332384+0000","last_clean":"2026-02-24T09:09:26.332384+0000","last_became_active":"2026-02-24T09:09:25.267314+0000","last_became_peered":"2026-02-24T09:09:25.267314+0000","last_unstale":"2026-02-24T09:09:26.332384+0000","last_undegraded":"2026-02-24T09:09:26.332384+0000","last_fullsized":"2026-02-24T09:09:26.332384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:59:11.536214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334717+0000","last_change":"2026-02-24T09:09:25.272131+0000","last_active":"2026-02-24T09:09:26.334717+0000","last_peered":"2026-02-24T09:09:26.334717+0000","last_clean":"2026-02-24T09:09:26.334717+0000","last_became_active":"2026-02-24T09:09:25.271680+0000","last_became_peered":"2026-02-24T09:09:25.271680+0000","last_unstale":"2026-02-24T09:09:26.334717+0000","last_undegraded":"2026-02-24T09:09:26.334717+0000","last_fullsized":"2026-02-24T09:09:26.334717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:07:33.257865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268617+0000","last_change":"2026-02-24T09:09:25.267808+0000","last_active":"2026-02-24T09:09:26.268617+0000","last_peered":"2026-02-24T09:09:26.268617+0000","last_clean":"2026-02-24T09:09:26.268617+0000","last_became_active":"2026-02-24T09:09:25.266759+0000","last_became_peered":"2026-02-24T09:09:25.266759+0000","last_unstale":"2026-02-24T09:09:26.268617+0000","last_undegraded":"2026-02-24T09:09:26.268617+0000","last_fullsized":"2026-02-24T09:09:26.268617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:55.312047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268133+0000","last_change":"2026-02-24T09:09:25.268500+0000","last_active":"2026-02-24T09:09:26.268133+0000","last_peered":"2026-02-24T09:09:26.268133+0000","last_clean":"2026-02-24T09:09:26.268133+0000","last_became_active":"2026-02-24T09:09:25.267904+0000","last_became_peered":"2026-02-24T09:09:25.267904+0000","last_unstale":"2026-02-24T09:09:26.268133+0000","last_undegraded":"2026-02-24T09:09:26.268133+0000","last_fullsized":"2026-02-24T09:09:26.268133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:38:47.330593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269021+0000","last_change":"2026-02-24T09:09:25.269694+0000","last_active":"2026-02-24T09:09:26.269021+0000","last_peered":"2026-02-24T09:09:26.269021+0000","last_clean":"2026-02-24T09:09:26.269021+0000","last_became_active":"2026-02-24T09:09:25.269068+0000","last_became_peered":"2026-02-24T09:09:25.269068+0000","last_unstale":"2026-02-24T09:09:26.269021+0000","last_undegraded":"2026-02-24T09:09:26.269021+0000","last_fullsized":"2026-02-24T09:09:26.269021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:04:44.772275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332668+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.332668+0000","last_peered":"2026-02-24T09:09:26.332668+0000","last_clean":"2026-02-24T09:09:26.332668+0000","last_became_active":"2026-02-24T09:09:25.269534+0000","last_became_peered":"2026-02-24T09:09:25.269534+0000","last_unstale":"2026-02-24T09:09:26.332668+0000","last_undegraded":"2026-02-24T09:09:26.332668+0000","last_fullsized":"2026-02-24T09:09:26.332668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:45:51.428970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332478+0000","last_change":"2026-02-24T09:09:25.266779+0000","last_active":"2026-02-24T09:09:26.332478+0000","last_peered":"2026-02-24T09:09:26.332478+0000","last_clean":"2026-02-24T09:09:26.332478+0000","last_became_active":"2026-02-24T09:09:25.266603+0000","last_became_peered":"2026-02-24T09:09:25.266603+0000","last_unstale":"2026-02-24T09:09:26.332478+0000","last_undegraded":"2026-02-24T09:09:26.332478+0000","last_fullsized":"2026-02-24T09:09:26.332478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:01:38.198458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332295+0000","last_change":"2026-02-24T09:09:25.266933+0000","last_active":"2026-02-24T09:09:26.332295+0000","last_peered":"2026-02-24T09:09:26.332295+0000","last_clean":"2026-02-24T09:09:26.332295+0000","last_became_active":"2026-02-24T09:09:25.266381+0000","last_became_peered":"2026-02-24T09:09:25.266381+0000","last_unstale":"2026-02-24T09:09:26.332295+0000","last_undegraded":"2026-02-24T09:09:26.332295+0000","last_fullsized":"2026-02-24T09:09:26.332295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:45:44.657482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267754+0000","last_change":"2026-02-24T09:09:25.269576+0000","last_active":"2026-02-24T09:09:26.267754+0000","last_peered":"2026-02-24T09:09:26.267754+0000","last_clean":"2026-02-24T09:09:26.267754+0000","last_became_active":"2026-02-24T09:09:25.269159+0000","last_became_peered":"2026-02-24T09:09:25.269159+0000","last_unstale":"2026-02-24T09:09:26.267754+0000","last_undegraded":"2026-02-24T09:09:26.267754+0000","last_fullsized":"2026-02-24T09:09:26.267754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:23:37.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332345+0000","last_change":"2026-02-24T09:09:25.269282+0000","last_active":"2026-02-24T09:09:26.332345+0000","last_peered":"2026-02-24T09:09:26.332345+0000","last_clean":"2026-02-24T09:09:26.332345+0000","last_became_active":"2026-02-24T09:09:25.269088+0000","last_became_peered":"2026-02-24T09:09:25.269088+0000","last_unstale":"2026-02-24T09:09:26.332345+0000","last_undegraded":"2026-02-24T09:09:26.332345+0000","last_fullsized":"2026-02-24T09:09:26.332345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:49.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332404+0000","last_change":"2026-02-24T09:09:25.270968+0000","last_active":"2026-02-24T09:09:26.332404+0000","last_peered":"2026-02-24T09:09:26.332404+0000","last_clean":"2026-02-24T09:09:26.332404+0000","last_became_active":"2026-02-24T09:09:25.270816+0000","last_became_peered":"2026-02-24T09:09:25.270816+0000","last_unstale":"2026-02-24T09:09:26.332404+0000","last_undegraded":"2026-02-24T09:09:26.332404+0000","last_fullsized":"2026-02-24T09:09:26.332404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:10:08.592263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332360+0000","last_change":"2026-02-24T09:09:25.267715+0000","last_active":"2026-02-24T09:09:26.332360+0000","last_peered":"2026-02-24T09:09:26.332360+0000","last_clean":"2026-02-24T09:09:26.332360+0000","last_became_active":"2026-02-24T09:09:25.267031+0000","last_became_peered":"2026-02-24T09:09:25.267031+0000","last_unstale":"2026-02-24T09:09:26.332360+0000","last_undegraded":"2026-02-24T09:09:26.332360+0000","last_fullsized":"2026-02-24T09:09:26.332360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:14:50.568512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267758+0000","last_change":"2026-02-24T09:09:25.268347+0000","last_active":"2026-02-24T09:09:26.267758+0000","last_peered":"2026-02-24T09:09:26.267758+0000","last_clean":"2026-02-24T09:09:26.267758+0000","last_became_active":"2026-02-24T09:09:25.268235+0000","last_became_peered":"2026-02-24T09:09:25.268235+0000","last_unstale":"2026-02-24T09:09:26.267758+0000","last_undegraded":"2026-02-24T09:09:26.267758+0000","last_fullsized":"2026-02-24T09:09:26.267758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:17.309082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:35.949131+0000","last_change":"2026-02-24T09:09:24.256941+0000","last_active":"2026-02-24T09:09:35.949131+0000","last_peered":"2026-02-24T09:09:35.949131+0000","last_clean":"2026-02-24T09:09:35.949131+0000","last_became_active":"2026-02-24T09:09:24.256577+0000","last_became_peered":"2026-02-24T09:09:24.256577+0000","last_unstale":"2026-02-24T09:09:35.949131+0000","last_undegraded":"2026-02-24T09:09:35.949131+0000","last_fullsized":"2026-02-24T09:09:35.949131+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:13:19.756549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268000+0000","last_change":"2026-02-24T09:09:25.270452+0000","last_active":"2026-02-24T09:09:26.268000+0000","last_peered":"2026-02-24T09:09:26.268000+0000","last_clean":"2026-02-24T09:09:26.268000+0000","last_became_active":"2026-02-24T09:09:25.270184+0000","last_became_peered":"2026-02-24T09:09:25.270184+0000","last_unstale":"2026-02-24T09:09:26.268000+0000","last_undegraded":"2026-02-24T09:09:26.268000+0000","last_fullsized":"2026-02-24T09:09:26.268000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:07:41.652941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943662+0000","last_change":"2026-02-24T09:09:24.261249+0000","last_active":"2026-02-24T09:09:28.943662+0000","last_peered":"2026-02-24T09:09:28.943662+0000","last_clean":"2026-02-24T09:09:28.943662+0000","last_became_active":"2026-02-24T09:09:24.261064+0000","last_became_peered":"2026-02-24T09:09:24.261064+0000","last_unstale":"2026-02-24T09:09:28.943662+0000","last_undegraded":"2026-02-24T09:09:28.943662+0000","last_fullsized":"2026-02-24T09:09:28.943662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:59:42.964350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941445+0000","last_change":"2026-02-24T09:09:24.254918+0000","last_active":"2026-02-24T09:09:28.941445+0000","last_peered":"2026-02-24T09:09:28.941445+0000","last_clean":"2026-02-24T09:09:28.941445+0000","last_became_active":"2026-02-24T09:09:24.254590+0000","last_became_peered":"2026-02-24T09:09:24.254590+0000","last_unstale":"2026-02-24T09:09:28.941445+0000","last_undegraded":"2026-02-24T09:09:28.941445+0000","last_fullsized":"2026-02-24T09:09:28.941445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:03:19.504844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268666+0000","last_change":"2026-02-24T09:09:25.267204+0000","last_active":"2026-02-24T09:09:26.268666+0000","last_peered":"2026-02-24T09:09:26.268666+0000","last_clean":"2026-02-24T09:09:26.268666+0000","last_became_active":"2026-02-24T09:09:25.266489+0000","last_became_peered":"2026-02-24T09:09:25.266489+0000","last_unstale":"2026-02-24T09:09:26.268666+0000","last_undegraded":"2026-02-24T09:09:26.268666+0000","last_fullsized":"2026-02-24T09:09:26.268666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:26:34.500054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210732+0000","last_change":"2026-02-24T09:09:24.258042+0000","last_active":"2026-02-24T09:09:27.210732+0000","last_peered":"2026-02-24T09:09:27.210732+0000","last_clean":"2026-02-24T09:09:27.210732+0000","last_became_active":"2026-02-24T09:09:24.257801+0000","last_became_peered":"2026-02-24T09:09:24.257801+0000","last_unstale":"2026-02-24T09:09:27.210732+0000","last_undegraded":"2026-02-24T09:09:27.210732+0000","last_fullsized":"2026-02-24T09:09:27.210732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:27.596990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267334+0000","last_change":"2026-02-24T09:09:25.267636+0000","last_active":"2026-02-24T09:09:26.267334+0000","last_peered":"2026-02-24T09:09:26.267334+0000","last_clean":"2026-02-24T09:09:26.267334+0000","last_became_active":"2026-02-24T09:09:25.267505+0000","last_became_peered":"2026-02-24T09:09:25.267505+0000","last_unstale":"2026-02-24T09:09:26.267334+0000","last_undegraded":"2026-02-24T09:09:26.267334+0000","last_fullsized":"2026-02-24T09:09:26.267334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:20.660345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:34.950667+0000","last_change":"2026-02-24T09:09:24.260793+0000","last_active":"2026-02-24T09:09:34.950667+0000","last_peered":"2026-02-24T09:09:34.950667+0000","last_clean":"2026-02-24T09:09:34.950667+0000","last_became_active":"2026-02-24T09:09:24.260555+0000","last_became_peered":"2026-02-24T09:09:24.260555+0000","last_unstale":"2026-02-24T09:09:34.950667+0000","last_undegraded":"2026-02-24T09:09:34.950667+0000","last_fullsized":"2026-02-24T09:09:34.950667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:30:45.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334847+0000","last_change":"2026-02-24T09:09:25.271121+0000","last_active":"2026-02-24T09:09:26.334847+0000","last_peered":"2026-02-24T09:09:26.334847+0000","last_clean":"2026-02-24T09:09:26.334847+0000","last_became_active":"2026-02-24T09:09:25.270770+0000","last_became_peered":"2026-02-24T09:09:25.270770+0000","last_unstale":"2026-02-24T09:09:26.334847+0000","last_undegraded":"2026-02-24T09:09:26.334847+0000","last_fullsized":"2026-02-24T09:09:26.334847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:52:58.451719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940998+0000","last_change":"2026-02-24T09:09:24.259030+0000","last_active":"2026-02-24T09:09:27.940998+0000","last_peered":"2026-02-24T09:09:27.940998+0000","last_clean":"2026-02-24T09:09:27.940998+0000","last_became_active":"2026-02-24T09:09:24.258747+0000","last_became_peered":"2026-02-24T09:09:24.258747+0000","last_unstale":"2026-02-24T09:09:27.940998+0000","last_undegraded":"2026-02-24T09:09:27.940998+0000","last_fullsized":"2026-02-24T09:09:27.940998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:49:46.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267794+0000","last_change":"2026-02-24T09:09:25.269875+0000","last_active":"2026-02-24T09:09:26.267794+0000","last_peered":"2026-02-24T09:09:26.267794+0000","last_clean":"2026-02-24T09:09:26.267794+0000","last_became_active":"2026-02-24T09:09:25.269400+0000","last_became_peered":"2026-02-24T09:09:25.269400+0000","last_unstale":"2026-02-24T09:09:26.267794+0000","last_undegraded":"2026-02-24T09:09:26.267794+0000","last_fullsized":"2026-02-24T09:09:26.267794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:08:29.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938278+0000","last_change":"2026-02-24T09:09:24.256845+0000","last_active":"2026-02-24T09:09:27.938278+0000","last_peered":"2026-02-24T09:09:27.938278+0000","last_clean":"2026-02-24T09:09:27.938278+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:27.938278+0000","last_undegraded":"2026-02-24T09:09:27.938278+0000","last_fullsized":"2026-02-24T09:09:27.938278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:08:15.802226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334785+0000","last_change":"2026-02-24T09:09:25.269608+0000","last_active":"2026-02-24T09:09:26.334785+0000","last_peered":"2026-02-24T09:09:26.334785+0000","last_clean":"2026-02-24T09:09:26.334785+0000","last_became_active":"2026-02-24T09:09:25.268736+0000","last_became_peered":"2026-02-24T09:09:25.268736+0000","last_unstale":"2026-02-24T09:09:26.334785+0000","last_undegraded":"2026-02-24T09:09:26.334785+0000","last_fullsized":"2026-02-24T09:09:26.334785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:39:41.466580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'22","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:35.954121+0000","last_change":"2026-02-24T09:09:24.260591+0000","last_active":"2026-02-24T09:09:35.954121+0000","last_peered":"2026-02-24T09:09:35.954121+0000","last_clean":"2026-02-24T09:09:35.954121+0000","last_became_active":"2026-02-24T09:09:24.260382+0000","last_became_peered":"2026-02-24T09:09:24.260382+0000","last_unstale":"2026-02-24T09:09:35.954121+0000","last_undegraded":"2026-02-24T09:09:35.954121+0000","last_fullsized":"2026-02-24T09:09:35.954121+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:05:00.313499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52244,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":61,"num_write":23,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267717+0000","last_change":"2026-02-24T09:09:25.266872+0000","last_active":"2026-02-24T09:09:26.267717+0000","last_peered":"2026-02-24T09:09:26.267717+0000","last_clean":"2026-02-24T09:09:26.267717+0000","last_became_active":"2026-02-24T09:09:25.266720+0000","last_became_peered":"2026-02-24T09:09:25.266720+0000","last_unstale":"2026-02-24T09:09:26.267717+0000","last_undegraded":"2026-02-24T09:09:26.267717+0000","last_fullsized":"2026-02-24T09:09:26.267717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:43.574647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941766+0000","last_change":"2026-02-24T09:09:24.256821+0000","last_active":"2026-02-24T09:09:28.941766+0000","last_peered":"2026-02-24T09:09:28.941766+0000","last_clean":"2026-02-24T09:09:28.941766+0000","last_became_active":"2026-02-24T09:09:24.256284+0000","last_became_peered":"2026-02-24T09:09:24.256284+0000","last_unstale":"2026-02-24T09:09:28.941766+0000","last_undegraded":"2026-02-24T09:09:28.941766+0000","last_fullsized":"2026-02-24T09:09:28.941766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:37:32.352734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332187+0000","last_change":"2026-02-24T09:09:25.268120+0000","last_active":"2026-02-24T09:09:26.332187+0000","last_peered":"2026-02-24T09:09:26.332187+0000","last_clean":"2026-02-24T09:09:26.332187+0000","last_became_active":"2026-02-24T09:09:25.267865+0000","last_became_peered":"2026-02-24T09:09:25.267865+0000","last_unstale":"2026-02-24T09:09:26.332187+0000","last_undegraded":"2026-02-24T09:09:26.332187+0000","last_fullsized":"2026-02-24T09:09:26.332187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:51:18.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938196+0000","last_change":"2026-02-24T09:09:24.257176+0000","last_active":"2026-02-24T09:09:27.938196+0000","last_peered":"2026-02-24T09:09:27.938196+0000","last_clean":"2026-02-24T09:09:27.938196+0000","last_became_active":"2026-02-24T09:09:24.256855+0000","last_became_peered":"2026-02-24T09:09:24.256855+0000","last_unstale":"2026-02-24T09:09:27.938196+0000","last_undegraded":"2026-02-24T09:09:27.938196+0000","last_fullsized":"2026-02-24T09:09:27.938196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:48:25.179774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733497+0000","last_change":"2026-02-24T09:09:25.271913+0000","last_active":"2026-02-24T09:09:26.733497+0000","last_peered":"2026-02-24T09:09:26.733497+0000","last_clean":"2026-02-24T09:09:26.733497+0000","last_became_active":"2026-02-24T09:09:25.271736+0000","last_became_peered":"2026-02-24T09:09:25.271736+0000","last_unstale":"2026-02-24T09:09:26.733497+0000","last_undegraded":"2026-02-24T09:09:26.733497+0000","last_fullsized":"2026-02-24T09:09:26.733497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:49.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:37.954400+0000","last_change":"2026-02-24T09:09:24.259308+0000","last_active":"2026-02-24T09:09:37.954400+0000","last_peered":"2026-02-24T09:09:37.954400+0000","last_clean":"2026-02-24T09:09:37.954400+0000","last_became_active":"2026-02-24T09:09:24.259131+0000","last_became_peered":"2026-02-24T09:09:24.259131+0000","last_unstale":"2026-02-24T09:09:37.954400+0000","last_undegraded":"2026-02-24T09:09:37.954400+0000","last_fullsized":"2026-02-24T09:09:37.954400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:52:00.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733165+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.733165+0000","last_peered":"2026-02-24T09:09:26.733165+0000","last_clean":"2026-02-24T09:09:26.733165+0000","last_became_active":"2026-02-24T09:09:25.269559+0000","last_became_peered":"2026-02-24T09:09:25.269559+0000","last_unstale":"2026-02-24T09:09:26.733165+0000","last_undegraded":"2026-02-24T09:09:26.733165+0000","last_fullsized":"2026-02-24T09:09:26.733165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:06:28.902948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942522+0000","last_change":"2026-02-24T09:09:24.257075+0000","last_active":"2026-02-24T09:09:28.942522+0000","last_peered":"2026-02-24T09:09:28.942522+0000","last_clean":"2026-02-24T09:09:28.942522+0000","last_became_active":"2026-02-24T09:09:24.256738+0000","last_became_peered":"2026-02-24T09:09:24.256738+0000","last_unstale":"2026-02-24T09:09:28.942522+0000","last_undegraded":"2026-02-24T09:09:28.942522+0000","last_fullsized":"2026-02-24T09:09:28.942522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:14.802040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268002+0000","last_change":"2026-02-24T09:09:25.271423+0000","last_active":"2026-02-24T09:09:26.268002+0000","last_peered":"2026-02-24T09:09:26.268002+0000","last_clean":"2026-02-24T09:09:26.268002+0000","last_became_active":"2026-02-24T09:09:25.271142+0000","last_became_peered":"2026-02-24T09:09:25.271142+0000","last_unstale":"2026-02-24T09:09:26.268002+0000","last_undegraded":"2026-02-24T09:09:26.268002+0000","last_fullsized":"2026-02-24T09:09:26.268002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:16.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.940354+0000","last_change":"2026-02-24T09:09:24.258426+0000","last_active":"2026-02-24T09:09:29.940354+0000","last_peered":"2026-02-24T09:09:29.940354+0000","last_clean":"2026-02-24T09:09:29.940354+0000","last_became_active":"2026-02-24T09:09:24.257941+0000","last_became_peered":"2026-02-24T09:09:24.257941+0000","last_unstale":"2026-02-24T09:09:29.940354+0000","last_undegraded":"2026-02-24T09:09:29.940354+0000","last_fullsized":"2026-02-24T09:09:29.940354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:30:29.724001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332552+0000","last_change":"2026-02-24T09:09:25.266758+0000","last_active":"2026-02-24T09:09:26.332552+0000","last_peered":"2026-02-24T09:09:26.332552+0000","last_clean":"2026-02-24T09:09:26.332552+0000","last_became_active":"2026-02-24T09:09:25.266569+0000","last_became_peered":"2026-02-24T09:09:25.266569+0000","last_unstale":"2026-02-24T09:09:26.332552+0000","last_undegraded":"2026-02-24T09:09:26.332552+0000","last_fullsized":"2026-02-24T09:09:26.332552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:13:56.985056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332354+0000","last_change":"2026-02-24T09:09:24.256974+0000","last_active":"2026-02-24T09:09:26.332354+0000","last_peered":"2026-02-24T09:09:26.332354+0000","last_clean":"2026-02-24T09:09:26.332354+0000","last_became_active":"2026-02-24T09:09:24.256617+0000","last_became_peered":"2026-02-24T09:09:24.256617+0000","last_unstale":"2026-02-24T09:09:26.332354+0000","last_undegraded":"2026-02-24T09:09:26.332354+0000","last_fullsized":"2026-02-24T09:09:26.332354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:28.318156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733475+0000","last_change":"2026-02-24T09:09:25.270445+0000","last_active":"2026-02-24T09:09:26.733475+0000","last_peered":"2026-02-24T09:09:26.733475+0000","last_clean":"2026-02-24T09:09:26.733475+0000","last_became_active":"2026-02-24T09:09:25.270275+0000","last_became_peered":"2026-02-24T09:09:25.270275+0000","last_unstale":"2026-02-24T09:09:26.733475+0000","last_undegraded":"2026-02-24T09:09:26.733475+0000","last_fullsized":"2026-02-24T09:09:26.733475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:53:49.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210815+0000","last_change":"2026-02-24T09:09:24.259031+0000","last_active":"2026-02-24T09:09:27.210815+0000","last_peered":"2026-02-24T09:09:27.210815+0000","last_clean":"2026-02-24T09:09:27.210815+0000","last_became_active":"2026-02-24T09:09:24.258899+0000","last_became_peered":"2026-02-24T09:09:24.258899+0000","last_unstale":"2026-02-24T09:09:27.210815+0000","last_undegraded":"2026-02-24T09:09:27.210815+0000","last_fullsized":"2026-02-24T09:09:27.210815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:16.802986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109422+0000","last_change":"2026-02-24T09:09:25.272707+0000","last_active":"2026-02-24T09:09:28.109422+0000","last_peered":"2026-02-24T09:09:28.109422+0000","last_clean":"2026-02-24T09:09:28.109422+0000","last_became_active":"2026-02-24T09:09:25.272563+0000","last_became_peered":"2026-02-24T09:09:25.272563+0000","last_unstale":"2026-02-24T09:09:28.109422+0000","last_undegraded":"2026-02-24T09:09:28.109422+0000","last_fullsized":"2026-02-24T09:09:28.109422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:41:22.895217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942219+0000","last_change":"2026-02-24T09:09:24.256493+0000","last_active":"2026-02-24T09:09:28.942219+0000","last_peered":"2026-02-24T09:09:28.942219+0000","last_clean":"2026-02-24T09:09:28.942219+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:28.942219+0000","last_undegraded":"2026-02-24T09:09:28.942219+0000","last_fullsized":"2026-02-24T09:09:28.942219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:43:12.259841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733528+0000","last_change":"2026-02-24T09:09:25.271977+0000","last_active":"2026-02-24T09:09:26.733528+0000","last_peered":"2026-02-24T09:09:26.733528+0000","last_clean":"2026-02-24T09:09:26.733528+0000","last_became_active":"2026-02-24T09:09:25.271650+0000","last_became_peered":"2026-02-24T09:09:25.271650+0000","last_unstale":"2026-02-24T09:09:26.733528+0000","last_undegraded":"2026-02-24T09:09:26.733528+0000","last_fullsized":"2026-02-24T09:09:26.733528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:10.062115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733207+0000","last_change":"2026-02-24T09:09:05.953512+0000","last_active":"2026-02-24T09:09:26.733207+0000","last_peered":"2026-02-24T09:09:26.733207+0000","last_clean":"2026-02-24T09:09:26.733207+0000","last_became_active":"2026-02-24T09:09:05.953360+0000","last_became_peered":"2026-02-24T09:09:05.953360+0000","last_unstale":"2026-02-24T09:09:26.733207+0000","last_undegraded":"2026-02-24T09:09:26.733207+0000","last_fullsized":"2026-02-24T09:09:26.733207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_clean_scrub_stamp":"2026-02-24T09:08:00.445410+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:48.550493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.945604+0000","last_change":"2026-02-24T09:09:24.259164+0000","last_active":"2026-02-24T09:09:29.945604+0000","last_peered":"2026-02-24T09:09:29.945604+0000","last_clean":"2026-02-24T09:09:29.945604+0000","last_became_active":"2026-02-24T09:09:24.259011+0000","last_became_peered":"2026-02-24T09:09:24.259011+0000","last_unstale":"2026-02-24T09:09:29.945604+0000","last_undegraded":"2026-02-24T09:09:29.945604+0000","last_fullsized":"2026-02-24T09:09:29.945604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:41.649484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268864+0000","last_change":"2026-02-24T09:09:25.269884+0000","last_active":"2026-02-24T09:09:26.268864+0000","last_peered":"2026-02-24T09:09:26.268864+0000","last_clean":"2026-02-24T09:09:26.268864+0000","last_became_active":"2026-02-24T09:09:25.269543+0000","last_became_peered":"2026-02-24T09:09:25.269543+0000","last_unstale":"2026-02-24T09:09:26.268864+0000","last_undegraded":"2026-02-24T09:09:26.268864+0000","last_fullsized":"2026-02-24T09:09:26.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:21:25.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943350+0000","last_change":"2026-02-24T09:09:24.259369+0000","last_active":"2026-02-24T09:09:28.943350+0000","last_peered":"2026-02-24T09:09:28.943350+0000","last_clean":"2026-02-24T09:09:28.943350+0000","last_became_active":"2026-02-24T09:09:24.259086+0000","last_became_peered":"2026-02-24T09:09:24.259086+0000","last_unstale":"2026-02-24T09:09:28.943350+0000","last_undegraded":"2026-02-24T09:09:28.943350+0000","last_fullsized":"2026-02-24T09:09:28.943350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:08.881900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332119+0000","last_change":"2026-02-24T09:09:25.266898+0000","last_active":"2026-02-24T09:09:26.332119+0000","last_peered":"2026-02-24T09:09:26.332119+0000","last_clean":"2026-02-24T09:09:26.332119+0000","last_became_active":"2026-02-24T09:09:25.266407+0000","last_became_peered":"2026-02-24T09:09:25.266407+0000","last_unstale":"2026-02-24T09:09:26.332119+0000","last_undegraded":"2026-02-24T09:09:26.332119+0000","last_fullsized":"2026-02-24T09:09:26.332119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:51.887929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:33.948252+0000","last_change":"2026-02-24T09:09:24.254126+0000","last_active":"2026-02-24T09:09:33.948252+0000","last_peered":"2026-02-24T09:09:33.948252+0000","last_clean":"2026-02-24T09:09:33.948252+0000","last_became_active":"2026-02-24T09:09:24.253911+0000","last_became_peered":"2026-02-24T09:09:24.253911+0000","last_unstale":"2026-02-24T09:09:33.948252+0000","last_undegraded":"2026-02-24T09:09:33.948252+0000","last_fullsized":"2026-02-24T09:09:33.948252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:09:56.146842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268161+0000","last_change":"2026-02-24T09:09:25.270387+0000","last_active":"2026-02-24T09:09:26.268161+0000","last_peered":"2026-02-24T09:09:26.268161+0000","last_clean":"2026-02-24T09:09:26.268161+0000","last_became_active":"2026-02-24T09:09:25.269478+0000","last_became_peered":"2026-02-24T09:09:25.269478+0000","last_unstale":"2026-02-24T09:09:26.268161+0000","last_undegraded":"2026-02-24T09:09:26.268161+0000","last_fullsized":"2026-02-24T09:09:26.268161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:32:15.217221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109411+0000","last_change":"2026-02-24T09:09:24.259169+0000","last_active":"2026-02-24T09:09:28.109411+0000","last_peered":"2026-02-24T09:09:28.109411+0000","last_clean":"2026-02-24T09:09:28.109411+0000","last_became_active":"2026-02-24T09:09:24.258755+0000","last_became_peered":"2026-02-24T09:09:24.258755+0000","last_unstale":"2026-02-24T09:09:28.109411+0000","last_undegraded":"2026-02-24T09:09:28.109411+0000","last_fullsized":"2026-02-24T09:09:28.109411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:33.438504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270152+0000","last_change":"2026-02-24T09:09:25.270732+0000","last_active":"2026-02-24T09:09:26.270152+0000","last_peered":"2026-02-24T09:09:26.270152+0000","last_clean":"2026-02-24T09:09:26.270152+0000","last_became_active":"2026-02-24T09:09:25.270200+0000","last_became_peered":"2026-02-24T09:09:25.270200+0000","last_unstale":"2026-02-24T09:09:26.270152+0000","last_undegraded":"2026-02-24T09:09:26.270152+0000","last_fullsized":"2026-02-24T09:09:26.270152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:59:28.115196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267351+0000","last_change":"2026-02-24T09:09:24.257488+0000","last_active":"2026-02-24T09:09:26.267351+0000","last_peered":"2026-02-24T09:09:26.267351+0000","last_clean":"2026-02-24T09:09:26.267351+0000","last_became_active":"2026-02-24T09:09:24.257202+0000","last_became_peered":"2026-02-24T09:09:24.257202+0000","last_unstale":"2026-02-24T09:09:26.267351+0000","last_undegraded":"2026-02-24T09:09:26.267351+0000","last_fullsized":"2026-02-24T09:09:26.267351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:41:24.345307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.674896+0000","last_change":"2026-02-24T09:09:25.272254+0000","last_active":"2026-02-24T09:09:26.674896+0000","last_peered":"2026-02-24T09:09:26.674896+0000","last_clean":"2026-02-24T09:09:26.674896+0000","last_became_active":"2026-02-24T09:09:25.271674+0000","last_became_peered":"2026-02-24T09:09:25.271674+0000","last_unstale":"2026-02-24T09:09:26.674896+0000","last_undegraded":"2026-02-24T09:09:26.674896+0000","last_fullsized":"2026-02-24T09:09:26.674896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:03:26.493850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938246+0000","last_change":"2026-02-24T09:09:24.257331+0000","last_active":"2026-02-24T09:09:27.938246+0000","last_peered":"2026-02-24T09:09:27.938246+0000","last_clean":"2026-02-24T09:09:27.938246+0000","last_became_active":"2026-02-24T09:09:24.256876+0000","last_became_peered":"2026-02-24T09:09:24.256876+0000","last_unstale":"2026-02-24T09:09:27.938246+0000","last_undegraded":"2026-02-24T09:09:27.938246+0000","last_fullsized":"2026-02-24T09:09:27.938246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:29:58.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332332+0000","last_change":"2026-02-24T09:09:25.266642+0000","last_active":"2026-02-24T09:09:26.332332+0000","last_peered":"2026-02-24T09:09:26.332332+0000","last_clean":"2026-02-24T09:09:26.332332+0000","last_became_active":"2026-02-24T09:09:25.266307+0000","last_became_peered":"2026-02-24T09:09:25.266307+0000","last_unstale":"2026-02-24T09:09:26.332332+0000","last_undegraded":"2026-02-24T09:09:26.332332+0000","last_fullsized":"2026-02-24T09:09:26.332332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:51.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:37.268830+0000","last_change":"2026-02-24T09:09:24.258807+0000","last_active":"2026-02-24T09:09:37.268830+0000","last_peered":"2026-02-24T09:09:37.268830+0000","last_clean":"2026-02-24T09:09:37.268830+0000","last_became_active":"2026-02-24T09:09:24.258649+0000","last_became_peered":"2026-02-24T09:09:24.258649+0000","last_unstale":"2026-02-24T09:09:37.268830+0000","last_undegraded":"2026-02-24T09:09:37.268830+0000","last_fullsized":"2026-02-24T09:09:37.268830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:10:48.348275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269009+0000","last_change":"2026-02-24T09:09:25.268491+0000","last_active":"2026-02-24T09:09:26.269009+0000","last_peered":"2026-02-24T09:09:26.269009+0000","last_clean":"2026-02-24T09:09:26.269009+0000","last_became_active":"2026-02-24T09:09:25.267341+0000","last_became_peered":"2026-02-24T09:09:25.267341+0000","last_unstale":"2026-02-24T09:09:26.269009+0000","last_undegraded":"2026-02-24T09:09:26.269009+0000","last_fullsized":"2026-02-24T09:09:26.269009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:18:29.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940964+0000","last_change":"2026-02-24T09:09:24.258484+0000","last_active":"2026-02-24T09:09:27.940964+0000","last_peered":"2026-02-24T09:09:27.940964+0000","last_clean":"2026-02-24T09:09:27.940964+0000","last_became_active":"2026-02-24T09:09:24.258249+0000","last_became_peered":"2026-02-24T09:09:24.258249+0000","last_unstale":"2026-02-24T09:09:27.940964+0000","last_undegraded":"2026-02-24T09:09:27.940964+0000","last_fullsized":"2026-02-24T09:09:27.940964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:32:56.722522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267783+0000","last_change":"2026-02-24T09:09:25.269738+0000","last_active":"2026-02-24T09:09:26.267783+0000","last_peered":"2026-02-24T09:09:26.267783+0000","last_clean":"2026-02-24T09:09:26.267783+0000","last_became_active":"2026-02-24T09:09:25.269413+0000","last_became_peered":"2026-02-24T09:09:25.269413+0000","last_unstale":"2026-02-24T09:09:26.267783+0000","last_undegraded":"2026-02-24T09:09:26.267783+0000","last_fullsized":"2026-02-24T09:09:26.267783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:00.412570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941334+0000","last_change":"2026-02-24T09:09:24.258901+0000","last_active":"2026-02-24T09:09:27.941334+0000","last_peered":"2026-02-24T09:09:27.941334+0000","last_clean":"2026-02-24T09:09:27.941334+0000","last_became_active":"2026-02-24T09:09:24.258325+0000","last_became_peered":"2026-02-24T09:09:24.258325+0000","last_unstale":"2026-02-24T09:09:27.941334+0000","last_undegraded":"2026-02-24T09:09:27.941334+0000","last_fullsized":"2026-02-24T09:09:27.941334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:36.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267522+0000","last_change":"2026-02-24T09:09:25.267368+0000","last_active":"2026-02-24T09:09:26.267522+0000","last_peered":"2026-02-24T09:09:26.267522+0000","last_clean":"2026-02-24T09:09:26.267522+0000","last_became_active":"2026-02-24T09:09:25.267168+0000","last_became_peered":"2026-02-24T09:09:25.267168+0000","last_unstale":"2026-02-24T09:09:26.267522+0000","last_undegraded":"2026-02-24T09:09:26.267522+0000","last_fullsized":"2026-02-24T09:09:26.267522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:57.616866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.939140+0000","last_change":"2026-02-24T09:09:24.257345+0000","last_active":"2026-02-24T09:09:27.939140+0000","last_peered":"2026-02-24T09:09:27.939140+0000","last_clean":"2026-02-24T09:09:27.939140+0000","last_became_active":"2026-02-24T09:09:24.256817+0000","last_became_peered":"2026-02-24T09:09:24.256817+0000","last_unstale":"2026-02-24T09:09:27.939140+0000","last_undegraded":"2026-02-24T09:09:27.939140+0000","last_fullsized":"2026-02-24T09:09:27.939140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:37:48.042471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332527+0000","last_change":"2026-02-24T09:09:25.267778+0000","last_active":"2026-02-24T09:09:26.332527+0000","last_peered":"2026-02-24T09:09:26.332527+0000","last_clean":"2026-02-24T09:09:26.332527+0000","last_became_active":"2026-02-24T09:09:25.267379+0000","last_became_peered":"2026-02-24T09:09:25.267379+0000","last_unstale":"2026-02-24T09:09:26.332527+0000","last_undegraded":"2026-02-24T09:09:26.332527+0000","last_fullsized":"2026-02-24T09:09:26.332527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:25:47.194857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.121396+0000","last_change":"2026-02-24T09:09:24.259141+0000","last_active":"2026-02-24T09:09:28.121396+0000","last_peered":"2026-02-24T09:09:28.121396+0000","last_clean":"2026-02-24T09:09:28.121396+0000","last_became_active":"2026-02-24T09:09:24.258981+0000","last_became_peered":"2026-02-24T09:09:24.258981+0000","last_unstale":"2026-02-24T09:09:28.121396+0000","last_undegraded":"2026-02-24T09:09:28.121396+0000","last_fullsized":"2026-02-24T09:09:28.121396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:48.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268774+0000","last_change":"2026-02-24T09:09:25.268540+0000","last_active":"2026-02-24T09:09:26.268774+0000","last_peered":"2026-02-24T09:09:26.268774+0000","last_clean":"2026-02-24T09:09:26.268774+0000","last_became_active":"2026-02-24T09:09:25.267915+0000","last_became_peered":"2026-02-24T09:09:25.267915+0000","last_unstale":"2026-02-24T09:09:26.268774+0000","last_undegraded":"2026-02-24T09:09:26.268774+0000","last_fullsized":"2026-02-24T09:09:26.268774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:55.564971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938005+0000","last_change":"2026-02-24T09:09:24.257964+0000","last_active":"2026-02-24T09:09:27.938005+0000","last_peered":"2026-02-24T09:09:27.938005+0000","last_clean":"2026-02-24T09:09:27.938005+0000","last_became_active":"2026-02-24T09:09:24.257717+0000","last_became_peered":"2026-02-24T09:09:24.257717+0000","last_unstale":"2026-02-24T09:09:27.938005+0000","last_undegraded":"2026-02-24T09:09:27.938005+0000","last_fullsized":"2026-02-24T09:09:27.938005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:23:24.989893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733433+0000","last_change":"2026-02-24T09:09:25.271214+0000","last_active":"2026-02-24T09:09:26.733433+0000","last_peered":"2026-02-24T09:09:26.733433+0000","last_clean":"2026-02-24T09:09:26.733433+0000","last_became_active":"2026-02-24T09:09:25.271038+0000","last_became_peered":"2026-02-24T09:09:25.271038+0000","last_unstale":"2026-02-24T09:09:26.733433+0000","last_undegraded":"2026-02-24T09:09:26.733433+0000","last_fullsized":"2026-02-24T09:09:26.733433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:58:44.899837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268097+0000","last_change":"2026-02-24T09:09:25.269834+0000","last_active":"2026-02-24T09:09:26.268097+0000","last_peered":"2026-02-24T09:09:26.268097+0000","last_clean":"2026-02-24T09:09:26.268097+0000","last_became_active":"2026-02-24T09:09:25.269526+0000","last_became_peered":"2026-02-24T09:09:25.269526+0000","last_unstale":"2026-02-24T09:09:26.268097+0000","last_undegraded":"2026-02-24T09:09:26.268097+0000","last_fullsized":"2026-02-24T09:09:26.268097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:36:54.610640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267687+0000","last_change":"2026-02-24T09:09:24.258597+0000","last_active":"2026-02-24T09:09:26.267687+0000","last_peered":"2026-02-24T09:09:26.267687+0000","last_clean":"2026-02-24T09:09:26.267687+0000","last_became_active":"2026-02-24T09:09:24.258302+0000","last_became_peered":"2026-02-24T09:09:24.258302+0000","last_unstale":"2026-02-24T09:09:26.267687+0000","last_undegraded":"2026-02-24T09:09:26.267687+0000","last_fullsized":"2026-02-24T09:09:26.267687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:20:15.556479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334746+0000","last_change":"2026-02-24T09:09:25.269804+0000","last_active":"2026-02-24T09:09:26.334746+0000","last_peered":"2026-02-24T09:09:26.334746+0000","last_clean":"2026-02-24T09:09:26.334746+0000","last_became_active":"2026-02-24T09:09:25.268973+0000","last_became_peered":"2026-02-24T09:09:25.268973+0000","last_unstale":"2026-02-24T09:09:26.334746+0000","last_undegraded":"2026-02-24T09:09:26.334746+0000","last_fullsized":"2026-02-24T09:09:26.334746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:33:39.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942003+0000","last_change":"2026-02-24T09:09:24.257428+0000","last_active":"2026-02-24T09:09:28.942003+0000","last_peered":"2026-02-24T09:09:28.942003+0000","last_clean":"2026-02-24T09:09:28.942003+0000","last_became_active":"2026-02-24T09:09:24.256679+0000","last_became_peered":"2026-02-24T09:09:24.256679+0000","last_unstale":"2026-02-24T09:09:28.942003+0000","last_undegraded":"2026-02-24T09:09:28.942003+0000","last_fullsized":"2026-02-24T09:09:28.942003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:39:28.664820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267792+0000","last_change":"2026-02-24T09:09:25.268127+0000","last_active":"2026-02-24T09:09:26.267792+0000","last_peered":"2026-02-24T09:09:26.267792+0000","last_clean":"2026-02-24T09:09:26.267792+0000","last_became_active":"2026-02-24T09:09:25.267860+0000","last_became_peered":"2026-02-24T09:09:25.267860+0000","last_unstale":"2026-02-24T09:09:26.267792+0000","last_undegraded":"2026-02-24T09:09:26.267792+0000","last_fullsized":"2026-02-24T09:09:26.267792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:37:52.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269053+0000","last_change":"2026-02-24T09:09:24.257552+0000","last_active":"2026-02-24T09:09:26.269053+0000","last_peered":"2026-02-24T09:09:26.269053+0000","last_clean":"2026-02-24T09:09:26.269053+0000","last_became_active":"2026-02-24T09:09:24.257163+0000","last_became_peered":"2026-02-24T09:09:24.257163+0000","last_unstale":"2026-02-24T09:09:26.269053+0000","last_undegraded":"2026-02-24T09:09:26.269053+0000","last_fullsized":"2026-02-24T09:09:26.269053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:30:54.285800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268961+0000","last_change":"2026-02-24T09:09:25.268695+0000","last_active":"2026-02-24T09:09:26.268961+0000","last_peered":"2026-02-24T09:09:26.268961+0000","last_clean":"2026-02-24T09:09:26.268961+0000","last_became_active":"2026-02-24T09:09:25.268128+0000","last_became_peered":"2026-02-24T09:09:25.268128+0000","last_unstale":"2026-02-24T09:09:26.268961+0000","last_undegraded":"2026-02-24T09:09:26.268961+0000","last_fullsized":"2026-02-24T09:09:26.268961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:23.987958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942226+0000","last_change":"2026-02-24T09:09:24.257602+0000","last_active":"2026-02-24T09:09:28.942226+0000","last_peered":"2026-02-24T09:09:28.942226+0000","last_clean":"2026-02-24T09:09:28.942226+0000","last_became_active":"2026-02-24T09:09:24.257440+0000","last_became_peered":"2026-02-24T09:09:24.257440+0000","last_unstale":"2026-02-24T09:09:28.942226+0000","last_undegraded":"2026-02-24T09:09:28.942226+0000","last_fullsized":"2026-02-24T09:09:28.942226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:13:51.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56294,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":69,"num_read_kb":93,"num_write":150,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":168882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119304,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":259322,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710729,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":395125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":27582038},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939657,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27900,"kb_used_data":936,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975300,"statfs":{"total":751619276800,"available":751590707200,"internally_reserved":0,"allocated":958464,"data_stored":1039260,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23856,"internal_metadata":27566800},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070476,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24845,"internal_metadata":27565811},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299404,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32653,"internal_metadata":27558003},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":987230,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28867,"internal_metadata":27561789},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":394740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888081,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":986504,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":32062,"internal_metadata":27558594},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018899,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31416,"internal_metadata":27559240},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247829,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":395051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46746,"internal_metadata":27543910},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27840,"kb_used_data":876,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975360,"statfs":{"total":751619276800,"available":751590768640,"internally_reserved":0,"allocated":897024,"data_stored":448137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34581,"internal_metadata":27556075},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607575,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27816,"kb_used_data":852,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975384,"statfs":{"total":751619276800,"available":751590793216,"internally_reserved":0,"allocated":872448,"data_stored":446777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738394,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49917,"internal_metadata":27540739},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11012,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":52244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":53604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12011,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13639,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6329,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13842,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3422,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31059,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9492,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13536,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:09:40.333 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T09:09:40.333 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T09:09:40.333 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-24T09:09:40.334 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph health --format=json 2026-02-24T09:09:40.484 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:40.582 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.578+0000 7f051ade2640 1 -- 10.20.193.4:0/222009517 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0514115470 msgr2=0x7f0514175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.582 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.578+0000 7f051ade2640 1 --2- 10.20.193.4:0/222009517 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0514115470 0x7f0514175e40 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=1848181741189044379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f051000aa30 tx=0x7f0510030280 comp rx=0 tx=0).stop 2026-02-24T09:09:40.582 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.578+0000 7f051ade2640 1 -- 10.20.193.4:0/222009517 shutdown_connections 2026-02-24T09:09:40.582 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.578+0000 7f051ade2640 1 --2- 10.20.193.4:0/222009517 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0514115470 0x7f0514175e40 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=1848181741189044379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.582 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.578+0000 7f051ade2640 1 --2- 10.20.193.4:0/222009517 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f051410fc70 0x7f0514114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.582 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.578+0000 7f051ade2640 1 --2- 10.20.193.4:0/222009517 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f051410f280 0x7f051410f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.582 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.578+0000 7f051ade2640 1 -- 10.20.193.4:0/222009517 >> 10.20.193.4:0/222009517 conn(0x7f051405f830 msgr2=0x7f051410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:40.583 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.578+0000 7f051ade2640 1 -- 10.20.193.4:0/222009517 shutdown_connections 2026-02-24T09:09:40.583 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.578+0000 7f051ade2640 1 -- 10.20.193.4:0/222009517 wait complete. 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2716049043' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2170052114' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2143692865' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4173935402' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3562394203' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1046951157' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1316864319' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3588938351' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2324330126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2252042314' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:09:40.583 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:40 trial004 ceph-mon[41596]: pgmap v144: 97 pgs: 97 active+clean; 632 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f051ade2640 1 Processor -- start 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f051ade2640 1 -- start start 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f051ade2640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f051410f280 0x7f05140f5510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f051ade2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f051410fc70 0x7f0514175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f051ade2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0514115470 0x7f05140f5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f051ade2640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f05140fae20 con 0x7f0514115470 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f051ade2640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f05140faf90 con 0x7f051410f280 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f051ade2640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05140fb150 con 0x7f051410fc70 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f0519358640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0514115470 0x7f05140f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f0519358640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0514115470 0x7f05140f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59916/0 (socket says 10.20.193.4:59916) 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f0519358640 1 -- 10.20.193.4:0/1718587185 learned_addr learned my addr 10.20.193.4:0/1718587185 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f0518b57640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f051410f280 0x7f05140f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f050bfff640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f051410fc70 0x7f0514175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f0519358640 1 -- 10.20.193.4:0/1718587185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f051410fc70 msgr2=0x7f0514175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f0519358640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f051410fc70 0x7f0514175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f0519358640 1 -- 10.20.193.4:0/1718587185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f051410f280 msgr2=0x7f05140f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f0519358640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f051410f280 0x7f05140f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f0519358640 1 -- 10.20.193.4:0/1718587185 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051000a650 con 0x7f0514115470 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.579+0000 7f0519358640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0514115470 0x7f05140f5c10 secure :-1 s=READY pgs=344 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f051000a330 tx=0x7f05100039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.580+0000 7f0509ffb640 1 -- 10.20.193.4:0/1718587185 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f051003e070 con 0x7f0514115470 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.580+0000 7f0509ffb640 1 -- 10.20.193.4:0/1718587185 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f05100055a0 con 0x7f0514115470 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.580+0000 7f051ade2640 1 -- 10.20.193.4:0/1718587185 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05140fb3d0 con 0x7f0514115470 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.580+0000 7f0509ffb640 1 -- 10.20.193.4:0/1718587185 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0510042910 con 0x7f0514115470 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.580+0000 7f051ade2640 1 -- 10.20.193.4:0/1718587185 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05140fb870 con 0x7f0514115470 2026-02-24T09:09:40.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.580+0000 7f051ade2640 1 -- 10.20.193.4:0/1718587185 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0514110560 con 0x7f0514115470 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2716049043' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2170052114' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2143692865' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4173935402' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3562394203' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1046951157' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1316864319' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3588938351' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2324330126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2252042314' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:09:40.585 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:40 trial090 ceph-mon[47278]: pgmap v144: 97 pgs: 97 active+clean; 632 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2026-02-24T09:09:40.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.582+0000 7f0509ffb640 1 -- 10.20.193.4:0/1718587185 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f0510042b40 con 0x7f0514115470 2026-02-24T09:09:40.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.582+0000 7f0509ffb640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f00b5760 0x7f04f00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.582+0000 7f0509ffb640 1 -- 10.20.193.4:0/1718587185 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f051010ccf0 con 0x7f0514115470 2026-02-24T09:09:40.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.582+0000 7f0518b57640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f00b5760 0x7f04f00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.582+0000 7f0518b57640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f00b5760 0x7f04f00d5c10 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0504004740 tx=0x7f0504005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:40.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.583+0000 7f0509ffb640 1 -- 10.20.193.4:0/1718587185 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f05100cf790 con 0x7f0514115470 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2716049043' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2170052114' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2143692865' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4173935402' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3562394203' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1046951157' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1316864319' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3588938351' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2324330126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2252042314' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T09:09:40.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:40 trial014 ceph-mon[46941]: pgmap v144: 97 pgs: 97 active+clean; 632 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2026-02-24T09:09:40.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.715+0000 7f051ade2640 1 -- 10.20.193.4:0/1718587185 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f05140fba90 con 0x7f0514115470 2026-02-24T09:09:40.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.715+0000 7f0509ffb640 1 -- 10.20.193.4:0/1718587185 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f05100d2940 con 0x7f0514115470 2026-02-24T09:09:40.720 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:40.720 INFO:teuthology.orchestra.run.trial004.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T09:09:40.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 -- 10.20.193.4:0/1718587185 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f00b5760 msgr2=0x7f04f00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f00b5760 0x7f04f00d5c10 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0504004740 tx=0x7f0504005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:40.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 -- 10.20.193.4:0/1718587185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0514115470 msgr2=0x7f05140f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0514115470 0x7f05140f5c10 secure :-1 s=READY pgs=344 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f051000a330 tx=0x7f05100039b0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 -- 10.20.193.4:0/1718587185 shutdown_connections 2026-02-24T09:09:40.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f00b5760 0x7f04f00d5c10 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0514115470 0x7f05140f5c10 unknown :-1 s=CLOSED pgs=344 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f051410fc70 0x7f0514175d40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 --2- 10.20.193.4:0/1718587185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f051410f280 0x7f05140f5510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 -- 10.20.193.4:0/1718587185 >> 10.20.193.4:0/1718587185 conn(0x7f051405f830 msgr2=0x7f051410d730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:40.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 -- 10.20.193.4:0/1718587185 shutdown_connections 2026-02-24T09:09:40.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.716+0000 7f051ade2640 1 -- 10.20.193.4:0/1718587185 wait complete. 2026-02-24T09:09:40.757 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-24T09:09:40.757 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:40.874 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:40.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 -- 10.20.193.4:0/1468682103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c9c115470 msgr2=0x7f9c9c175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 --2- 10.20.193.4:0/1468682103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c9c115470 0x7f9c9c175e40 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=5032467830596676484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c8c00aa30 tx=0x7f9c8c030280 comp rx=0 tx=0).stop 2026-02-24T09:09:40.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 -- 10.20.193.4:0/1468682103 shutdown_connections 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 --2- 10.20.193.4:0/1468682103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c9c115470 0x7f9c9c175e40 unknown :-1 s=CLOSED pgs=345 gs=1 cs=0 l=1 c_cookie=5032467830596676484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 --2- 10.20.193.4:0/1468682103 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c9c10fc70 0x7f9c9c114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 --2- 10.20.193.4:0/1468682103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c9c10f280 0x7f9c9c10f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 -- 10.20.193.4:0/1468682103 >> 10.20.193.4:0/1468682103 conn(0x7f9c9c05f830 msgr2=0x7f9c9c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 -- 10.20.193.4:0/1468682103 shutdown_connections 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 -- 10.20.193.4:0/1468682103 wait complete. 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 Processor -- start 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 -- start start 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c9c10f280 0x7f9c9c11db80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.971+0000 7f9ca0be1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c9c10fc70 0x7f9c9c11e0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9ca0be1640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c9c115470 0x7f9c9c123490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9ca0be1640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c123ab0 con 0x7f9c9c10f280 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9ca0be1640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c123c20 con 0x7f9c9c115470 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9ca0be1640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c123de0 con 0x7f9c9c10fc70 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c9a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c9c10f280 0x7f9c9c11db80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c9a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c9c10f280 0x7f9c9c11db80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59944/0 (socket says 10.20.193.4:59944) 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c9a575640 1 -- 10.20.193.4:0/275271615 learned_addr learned my addr 10.20.193.4:0/275271615 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c99d74640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c9c10fc70 0x7f9c9c11e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c9ad76640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c9c115470 0x7f9c9c123490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c9a575640 1 -- 10.20.193.4:0/275271615 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c9c10fc70 msgr2=0x7f9c9c11e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c9a575640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c9c10fc70 0x7f9c9c11e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c9a575640 1 -- 10.20.193.4:0/275271615 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c9c115470 msgr2=0x7f9c9c123490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c9a575640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c9c115470 0x7f9c9c123490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c9a575640 1 -- 10.20.193.4:0/275271615 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8c00a650 con 0x7f9c9c10f280 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c9a575640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c9c10f280 0x7f9c9c11db80 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c9000d950 tx=0x7f9c9000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c837fe640 1 -- 10.20.193.4:0/275271615 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c90004540 con 0x7f9c9c10f280 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c837fe640 1 -- 10.20.193.4:0/275271615 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9c90009d00 con 0x7f9c9c10f280 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9ca0be1640 1 -- 10.20.193.4:0/275271615 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9c1240c0 con 0x7f9c9c10f280 2026-02-24T09:09:40.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9c837fe640 1 -- 10.20.193.4:0/275271615 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c900106e0 con 0x7f9c9c10f280 2026-02-24T09:09:40.977 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9ca0be1640 1 -- 10.20.193.4:0/275271615 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9c1647c0 con 0x7f9c9c10f280 2026-02-24T09:09:40.977 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.972+0000 7f9ca0be1640 1 -- 10.20.193.4:0/275271615 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9c110560 con 0x7f9c9c10f280 2026-02-24T09:09:40.977 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.974+0000 7f9c837fe640 1 -- 10.20.193.4:0/275271615 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f9c900097c0 con 0x7f9c9c10f280 2026-02-24T09:09:40.977 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.974+0000 7f9c837fe640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c740b57f0 0x7f9c740d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:40.978 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.974+0000 7f9c99d74640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c740b57f0 0x7f9c740d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:40.978 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.974+0000 7f9c837fe640 1 -- 10.20.193.4:0/275271615 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9c900e7170 con 0x7f9c9c10f280 2026-02-24T09:09:40.978 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.975+0000 7f9c99d74640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c740b57f0 0x7f9c740d5ca0 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c9c124520 tx=0x7f9c840073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:40.978 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:40.975+0000 7f9c837fe640 1 -- 10.20.193.4:0/275271615 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f9c900a9ac0 con 0x7f9c9c10f280 2026-02-24T09:09:41.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.108+0000 7f9ca0be1640 1 -- 10.20.193.4:0/275271615 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c9c10f650 con 0x7f9c9c10f280 2026-02-24T09:09:41.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.108+0000 7f9c837fe640 1 -- 10.20.193.4:0/275271615 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+11882 (secure 0 0 0) 0x7f9c900acc70 con 0x7f9c9c10f280 2026-02-24T09:09:41.112 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:41.113 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":18,"btime":"2026-02-24T09:09:29:940018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:29.940013+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24637,24625,24620]},"id":1}]} 2026-02-24T09:09:41.114 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 18 2026-02-24T09:09:41.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 -- 10.20.193.4:0/275271615 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c740b57f0 msgr2=0x7f9c740d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c740b57f0 0x7f9c740d5ca0 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c9c124520 tx=0x7f9c840073d0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 -- 10.20.193.4:0/275271615 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c9c10f280 msgr2=0x7f9c9c11db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c9c10f280 0x7f9c9c11db80 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c9000d950 tx=0x7f9c9000de20 comp rx=0 tx=0).stop 2026-02-24T09:09:41.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 -- 10.20.193.4:0/275271615 shutdown_connections 2026-02-24T09:09:41.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c740b57f0 0x7f9c740d5ca0 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c9c115470 0x7f9c9c123490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c9c10fc70 0x7f9c9c11e0c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 --2- 10.20.193.4:0/275271615 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c9c10f280 0x7f9c9c11db80 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 -- 10.20.193.4:0/275271615 >> 10.20.193.4:0/275271615 conn(0x7f9c9c05f830 msgr2=0x7f9c9c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:41.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 -- 10.20.193.4:0/275271615 shutdown_connections 2026-02-24T09:09:41.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.109+0000 7f9ca0be1640 1 -- 10.20.193.4:0/275271615 wait complete. 2026-02-24T09:09:41.150 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:41.267 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:41.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 -- 10.20.193.4:0/2521472748 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f648c10f280 msgr2=0x7f648c10f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 --2- 10.20.193.4:0/2521472748 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f648c10f280 0x7f648c10f650 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=12921632496578270581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6480009950 tx=0x7f648002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 -- 10.20.193.4:0/2521472748 shutdown_connections 2026-02-24T09:09:41.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 --2- 10.20.193.4:0/2521472748 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f648c115470 0x7f648c175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 --2- 10.20.193.4:0/2521472748 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f648c10fc70 0x7f648c114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 --2- 10.20.193.4:0/2521472748 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f648c10f280 0x7f648c10f650 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=12921632496578270581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 -- 10.20.193.4:0/2521472748 >> 10.20.193.4:0/2521472748 conn(0x7f648c05f830 msgr2=0x7f648c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:41.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 -- 10.20.193.4:0/2521472748 shutdown_connections 2026-02-24T09:09:41.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 -- 10.20.193.4:0/2521472748 wait complete. 2026-02-24T09:09:41.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 Processor -- start 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 -- start start 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f648c10f280 0x7f648c11dbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f648c10fc70 0x7f648c11e0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f648c115470 0x7f648c1234c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f648c123ae0 con 0x7f648c115470 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f648c123c50 con 0x7f648c10f280 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.373+0000 7f649158b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f648c123e10 con 0x7f648c10fc70 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f648c115470 0x7f648c1234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f648c115470 0x7f648c1234c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59952/0 (socket says 10.20.193.4:59952) 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648b7fe640 1 -- 10.20.193.4:0/1818655111 learned_addr learned my addr 10.20.193.4:0/1818655111 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648affd640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f648c10f280 0x7f648c11dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648a7fc640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f648c10fc70 0x7f648c11e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648b7fe640 1 -- 10.20.193.4:0/1818655111 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f648c10fc70 msgr2=0x7f648c11e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648b7fe640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f648c10fc70 0x7f648c11e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648b7fe640 1 -- 10.20.193.4:0/1818655111 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f648c10f280 msgr2=0x7f648c11dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648b7fe640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f648c10f280 0x7f648c11dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648b7fe640 1 -- 10.20.193.4:0/1818655111 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6480009570 con 0x7f648c115470 2026-02-24T09:09:41.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f648b7fe640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f648c115470 0x7f648c1234c0 secure :-1 s=READY pgs=348 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f647c006e90 tx=0x7f647c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:41.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f646bfff640 1 -- 10.20.193.4:0/1818655111 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f647c005500 con 0x7f648c115470 2026-02-24T09:09:41.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f646bfff640 1 -- 10.20.193.4:0/1818655111 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f647c005e10 con 0x7f648c115470 2026-02-24T09:09:41.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f649158b640 1 -- 10.20.193.4:0/1818655111 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c1240f0 con 0x7f648c115470 2026-02-24T09:09:41.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f646bfff640 1 -- 10.20.193.4:0/1818655111 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f647c003a90 con 0x7f648c115470 2026-02-24T09:09:41.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f649158b640 1 -- 10.20.193.4:0/1818655111 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c1647f0 con 0x7f648c115470 2026-02-24T09:09:41.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.374+0000 7f649158b640 1 -- 10.20.193.4:0/1818655111 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c110560 con 0x7f648c115470 2026-02-24T09:09:41.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.376+0000 7f646bfff640 1 -- 10.20.193.4:0/1818655111 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f647c00c840 con 0x7f648c115470 2026-02-24T09:09:41.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.376+0000 7f646bfff640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f64600b5770 0x7f64600d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:41.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.376+0000 7f646bfff640 1 -- 10.20.193.4:0/1818655111 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f647c0e7ce0 con 0x7f648c115470 2026-02-24T09:09:41.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.376+0000 7f648affd640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f64600b5770 0x7f64600d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:41.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.377+0000 7f648affd640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f64600b5770 0x7f64600d5c20 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6480005b30 tx=0x7f648003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:41.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.377+0000 7f646bfff640 1 -- 10.20.193.4:0/1818655111 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f647c0aa670 con 0x7f648c115470 2026-02-24T09:09:41.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:41 trial004 ceph-mon[41596]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:41.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:41 trial004 ceph-mon[41596]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:41.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:41 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1718587185' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-24T09:09:41.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:41 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/275271615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:41.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.507+0000 7f649158b640 1 -- 10.20.193.4:0/1818655111 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f648c10f650 con 0x7f648c115470 2026-02-24T09:09:41.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.508+0000 7f646bfff640 1 -- 10.20.193.4:0/1818655111 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+11882 (secure 0 0 0) 0x7f647c0ad820 con 0x7f648c115470 2026-02-24T09:09:41.512 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:41.512 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":18,"btime":"2026-02-24T09:09:29:940018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:29.940013+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24637,24625,24620]},"id":1}]} 2026-02-24T09:09:41.513 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 18 2026-02-24T09:09:41.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 -- 10.20.193.4:0/1818655111 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f64600b5770 msgr2=0x7f64600d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f64600b5770 0x7f64600d5c20 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6480005b30 tx=0x7f648003a040 comp rx=0 tx=0).stop 2026-02-24T09:09:41.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 -- 10.20.193.4:0/1818655111 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f648c115470 msgr2=0x7f648c1234c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f648c115470 0x7f648c1234c0 secure :-1 s=READY pgs=348 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f647c006e90 tx=0x7f647c00edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 -- 10.20.193.4:0/1818655111 shutdown_connections 2026-02-24T09:09:41.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f64600b5770 0x7f64600d5c20 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f648c115470 0x7f648c1234c0 unknown :-1 s=CLOSED pgs=348 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f648c10fc70 0x7f648c11e0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 --2- 10.20.193.4:0/1818655111 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f648c10f280 0x7f648c11dbb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 -- 10.20.193.4:0/1818655111 >> 10.20.193.4:0/1818655111 conn(0x7f648c05f830 msgr2=0x7f648c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:41.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 -- 10.20.193.4:0/1818655111 shutdown_connections 2026-02-24T09:09:41.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.509+0000 7f649158b640 1 -- 10.20.193.4:0/1818655111 wait complete. 2026-02-24T09:09:41.551 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:09:41.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:41 trial090 ceph-mon[47278]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:41.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:41 trial090 ceph-mon[47278]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:41.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:41 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1718587185' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-24T09:09:41.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:41 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/275271615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:41.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:41 trial014 ceph-mon[46941]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:41.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:41 trial014 ceph-mon[46941]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:41.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:41 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1718587185' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-24T09:09:41.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:41 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/275271615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:41.666 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.769+0000 7f25fb141640 1 -- 10.20.193.4:0/3429197000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f25f410fc70 msgr2=0x7f25f4114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.769+0000 7f25fb141640 1 --2- 10.20.193.4:0/3429197000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f25f410fc70 0x7f25f4114cc0 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=8787412030788032145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25dc009950 tx=0x7f25dc02f190 comp rx=0 tx=0).stop 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 -- 10.20.193.4:0/3429197000 shutdown_connections 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 --2- 10.20.193.4:0/3429197000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f25f4115470 0x7f25f4175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 --2- 10.20.193.4:0/3429197000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f25f410fc70 0x7f25f4114cc0 unknown :-1 s=CLOSED pgs=349 gs=1 cs=0 l=1 c_cookie=8787412030788032145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 --2- 10.20.193.4:0/3429197000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f25f410f280 0x7f25f410f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 -- 10.20.193.4:0/3429197000 >> 10.20.193.4:0/3429197000 conn(0x7f25f405f830 msgr2=0x7f25f410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 -- 10.20.193.4:0/3429197000 shutdown_connections 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 -- 10.20.193.4:0/3429197000 wait complete. 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 Processor -- start 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 -- start start 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f25f410f280 0x7f25f40f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:41.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f25f410fc70 0x7f25f4175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f25f4115470 0x7f25f40f5cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f25f40faec0 con 0x7f25f410f280 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f25f40fb030 con 0x7f25f4115470 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25fb141640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25f40fb1f0 con 0x7f25f410fc70 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25f8eb6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f25f410f280 0x7f25f40f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25f8eb6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f25f410f280 0x7f25f40f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59972/0 (socket says 10.20.193.4:59972) 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25f8eb6640 1 -- 10.20.193.4:0/2945614951 learned_addr learned my addr 10.20.193.4:0/2945614951 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25ebfff640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f25f410fc70 0x7f25f4175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25f96b7640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f25f4115470 0x7f25f40f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25f8eb6640 1 -- 10.20.193.4:0/2945614951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f25f410fc70 msgr2=0x7f25f4175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25f8eb6640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f25f410fc70 0x7f25f4175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25f8eb6640 1 -- 10.20.193.4:0/2945614951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f25f4115470 msgr2=0x7f25f40f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25f8eb6640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f25f4115470 0x7f25f40f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25f8eb6640 1 -- 10.20.193.4:0/2945614951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25dc009570 con 0x7f25f410f280 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25ebfff640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f25f410fc70 0x7f25f4175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.770+0000 7f25f8eb6640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f25f410f280 0x7f25f40f55b0 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25e400d950 tx=0x7f25e400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.771+0000 7f25e9ffb640 1 -- 10.20.193.4:0/2945614951 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25e4004540 con 0x7f25f410f280 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.771+0000 7f25fb141640 1 -- 10.20.193.4:0/2945614951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f40fb4d0 con 0x7f25f410f280 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.771+0000 7f25e9ffb640 1 -- 10.20.193.4:0/2945614951 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f25e4009d00 con 0x7f25f410f280 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.771+0000 7f25e9ffb640 1 -- 10.20.193.4:0/2945614951 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25e40106e0 con 0x7f25f410f280 2026-02-24T09:09:41.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.771+0000 7f25fb141640 1 -- 10.20.193.4:0/2945614951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f40fb9f0 con 0x7f25f410f280 2026-02-24T09:09:41.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.771+0000 7f25fb141640 1 -- 10.20.193.4:0/2945614951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f4110560 con 0x7f25f410f280 2026-02-24T09:09:41.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.772+0000 7f25e9ffb640 1 -- 10.20.193.4:0/2945614951 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f25e40027c0 con 0x7f25f410f280 2026-02-24T09:09:41.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.773+0000 7f25e9ffb640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25d00b5770 0x7f25d00d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:41.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.773+0000 7f25e9ffb640 1 -- 10.20.193.4:0/2945614951 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f25e40e72e0 con 0x7f25f410f280 2026-02-24T09:09:41.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.773+0000 7f25ebfff640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25d00b5770 0x7f25d00d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:41.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.773+0000 7f25ebfff640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25d00b5770 0x7f25d00d5c20 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25dc0098a0 tx=0x7f25dc031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:41.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.773+0000 7f25e9ffb640 1 -- 10.20.193.4:0/2945614951 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f25e40a9c70 con 0x7f25f410f280 2026-02-24T09:09:41.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.877+0000 7f25fb141640 1 -- 10.20.193.4:0/2945614951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25f40f6710 con 0x7f25f410f280 2026-02-24T09:09:41.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.877+0000 7f25e9ffb640 1 -- 10.20.193.4:0/2945614951 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22231 (secure 0 0 0) 0x7f25e40ace20 con 0x7f25f410f280 2026-02-24T09:09:41.882 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:41.882 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":75,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:26.263940+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:41.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 -- 10.20.193.4:0/2945614951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25d00b5770 msgr2=0x7f25d00d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25d00b5770 0x7f25d00d5c20 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25dc0098a0 tx=0x7f25dc031040 comp rx=0 tx=0).stop 2026-02-24T09:09:41.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 -- 10.20.193.4:0/2945614951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f25f410f280 msgr2=0x7f25f40f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:41.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f25f410f280 0x7f25f40f55b0 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25e400d950 tx=0x7f25e400de20 comp rx=0 tx=0).stop 2026-02-24T09:09:41.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 -- 10.20.193.4:0/2945614951 shutdown_connections 2026-02-24T09:09:41.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25d00b5770 0x7f25d00d5c20 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f25f4115470 0x7f25f40f5cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f25f410fc70 0x7f25f4175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 --2- 10.20.193.4:0/2945614951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f25f410f280 0x7f25f40f55b0 unknown :-1 s=CLOSED pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:41.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 -- 10.20.193.4:0/2945614951 >> 10.20.193.4:0/2945614951 conn(0x7f25f405f830 msgr2=0x7f25f4111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:41.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 -- 10.20.193.4:0/2945614951 shutdown_connections 2026-02-24T09:09:41.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:41.879+0000 7f25fb141640 1 -- 10.20.193.4:0/2945614951 wait complete. 2026-02-24T09:09:41.919 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:42.036 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 -- 10.20.193.4:0/1775198035 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbc2c10fc70 msgr2=0x7fbc2c114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 --2- 10.20.193.4:0/1775198035 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbc2c10fc70 0x7fbc2c114cc0 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=9959523784665994419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc20009950 tx=0x7fbc2002f190 comp rx=0 tx=0).stop 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 -- 10.20.193.4:0/1775198035 shutdown_connections 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 --2- 10.20.193.4:0/1775198035 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbc2c115470 0x7fbc2c175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 --2- 10.20.193.4:0/1775198035 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbc2c10fc70 0x7fbc2c114cc0 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=9959523784665994419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 --2- 10.20.193.4:0/1775198035 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbc2c10f280 0x7fbc2c10f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 -- 10.20.193.4:0/1775198035 >> 10.20.193.4:0/1775198035 conn(0x7fbc2c05f830 msgr2=0x7fbc2c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 -- 10.20.193.4:0/1775198035 shutdown_connections 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 -- 10.20.193.4:0/1775198035 wait complete. 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 Processor -- start 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 -- start start 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbc2c10f280 0x7fbc2c0f5540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbc2c10fc70 0x7fbc2c175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbc2c115470 0x7fbc2c0f5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c0fae50 con 0x7fbc2c10fc70 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c0fafc0 con 0x7fbc2c115470 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc33f11640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c0fb180 con 0x7fbc2c10f280 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc31485640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbc2c10fc70 0x7fbc2c175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc31485640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbc2c10fc70 0x7fbc2c175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59988/0 (socket says 10.20.193.4:59988) 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc31485640 1 -- 10.20.193.4:0/4241178694 learned_addr learned my addr 10.20.193.4:0/4241178694 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc31c86640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbc2c10f280 0x7fbc2c0f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc32487640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbc2c115470 0x7fbc2c0f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc31485640 1 -- 10.20.193.4:0/4241178694 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbc2c10f280 msgr2=0x7fbc2c0f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc31485640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbc2c10f280 0x7fbc2c0f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc31485640 1 -- 10.20.193.4:0/4241178694 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbc2c115470 msgr2=0x7fbc2c0f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc31485640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbc2c115470 0x7fbc2c0f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc31485640 1 -- 10.20.193.4:0/4241178694 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc20009570 con 0x7fbc2c10fc70 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.138+0000 7fbc31c86640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbc2c10f280 0x7fbc2c0f5540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.139+0000 7fbc31485640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbc2c10fc70 0x7fbc2c175d40 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc200023d0 tx=0x7fbc200043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.139+0000 7fbc1affd640 1 -- 10.20.193.4:0/4241178694 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc2003d070 con 0x7fbc2c10fc70 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.139+0000 7fbc1affd640 1 -- 10.20.193.4:0/4241178694 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbc20038920 con 0x7fbc2c10fc70 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.139+0000 7fbc33f11640 1 -- 10.20.193.4:0/4241178694 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2c0fb400 con 0x7fbc2c10fc70 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.139+0000 7fbc1affd640 1 -- 10.20.193.4:0/4241178694 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc200419d0 con 0x7fbc2c10fc70 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.139+0000 7fbc33f11640 1 -- 10.20.193.4:0/4241178694 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc2c0fb8c0 con 0x7fbc2c10fc70 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.139+0000 7fbc33f11640 1 -- 10.20.193.4:0/4241178694 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2c110560 con 0x7fbc2c10fc70 2026-02-24T09:09:42.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.140+0000 7fbc1affd640 1 -- 10.20.193.4:0/4241178694 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fbc20038a90 con 0x7fbc2c10fc70 2026-02-24T09:09:42.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.141+0000 7fbc1affd640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbc080b57e0 0x7fbc080d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.141+0000 7fbc1affd640 1 -- 10.20.193.4:0/4241178694 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fbc2010b880 con 0x7fbc2c10fc70 2026-02-24T09:09:42.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.141+0000 7fbc31c86640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbc080b57e0 0x7fbc080d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.141+0000 7fbc31c86640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbc080b57e0 0x7fbc080d5c90 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc1c005970 tx=0x7fbc1c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.142+0000 7fbc1affd640 1 -- 10.20.193.4:0/4241178694 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbc200ce320 con 0x7fbc2c10fc70 2026-02-24T09:09:42.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.273+0000 7fbc33f11640 1 -- 10.20.193.4:0/4241178694 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc2c10f650 con 0x7fbc2c10fc70 2026-02-24T09:09:42.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.274+0000 7fbc1affd640 1 -- 10.20.193.4:0/4241178694 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+11882 (secure 0 0 0) 0x7fbc200d14d0 con 0x7fbc2c10fc70 2026-02-24T09:09:42.277 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:42.277 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":18,"btime":"2026-02-24T09:09:29:940018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:29.940013+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24637,24625,24620]},"id":1}]} 2026-02-24T09:09:42.278 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 18 2026-02-24T09:09:42.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 -- 10.20.193.4:0/4241178694 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbc080b57e0 msgr2=0x7fbc080d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbc080b57e0 0x7fbc080d5c90 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc1c005970 tx=0x7fbc1c005900 comp rx=0 tx=0).stop 2026-02-24T09:09:42.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 -- 10.20.193.4:0/4241178694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbc2c10fc70 msgr2=0x7fbc2c175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbc2c10fc70 0x7fbc2c175d40 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc200023d0 tx=0x7fbc200043d0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 -- 10.20.193.4:0/4241178694 shutdown_connections 2026-02-24T09:09:42.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbc080b57e0 0x7fbc080d5c90 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbc2c115470 0x7fbc2c0f5c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbc2c10fc70 0x7fbc2c175d40 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 --2- 10.20.193.4:0/4241178694 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbc2c10f280 0x7fbc2c0f5540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 -- 10.20.193.4:0/4241178694 >> 10.20.193.4:0/4241178694 conn(0x7fbc2c05f830 msgr2=0x7fbc2c111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 -- 10.20.193.4:0/4241178694 shutdown_connections 2026-02-24T09:09:42.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.275+0000 7fbc33f11640 1 -- 10.20.193.4:0/4241178694 wait complete. 2026-02-24T09:09:42.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-24T09:09:24.652522+0000', 'modified': '2026-02-24T09:09:29.940013+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24637, 'mds_1': 24625, 'mds_2': 24620}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24580': {'gid': 24580, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.90:6833/931807729', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6832', 'nonce': 931807729}, {'type': 'v1', 'addr': '10.20.193.90:6833', 'nonce': 931807729}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24596': {'gid': 24596, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.14:6837/524790199', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.14:6836', 'nonce': 524790199}, {'type': 'v1', 'addr': '10.20.193.14:6837', 'nonce': 524790199}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.90:6835/1296342299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6834', 'nonce': 1296342299}, {'type': 'v1', 'addr': '10.20.193.90:6835', 'nonce': 1296342299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24620': {'gid': 24620, 'name': 'b', 'rank': 2, 'incarnation': 16, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.14:6839/2269480307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.14:6838', 'nonce': 2269480307}, {'type': 'v1', 'addr': '10.20.193.14:6839', 'nonce': 2269480307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'c', 'rank': 1, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.90:6837/4190330264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6836', 'nonce': 4190330264}, {'type': 'v1', 'addr': '10.20.193.90:6837', 'nonce': 4190330264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'i', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.90:6839/2191295378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6838', 'nonce': 2191295378}, {'type': 'v1', 'addr': '10.20.193.90:6839', 'nonce': 2191295378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24637, 'qdb_cluster': [24637, 24625, 24620]} 2026-02-24T09:09:42.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2026-02-24T09:09:42.316 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.b status 2026-02-24T09:09:42.433 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:42.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.530+0000 7fd10adbb640 1 -- 10.20.193.4:0/3672520275 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd1041158b0 msgr2=0x7fd104176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.530+0000 7fd10adbb640 1 --2- 10.20.193.4:0/3672520275 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd1041158b0 0x7fd104176280 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=2187796649854208141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10000aa30 tx=0x7fd100030280 comp rx=0 tx=0).stop 2026-02-24T09:09:42.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.530+0000 7fd10adbb640 1 -- 10.20.193.4:0/3672520275 shutdown_connections 2026-02-24T09:09:42.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.530+0000 7fd10adbb640 1 --2- 10.20.193.4:0/3672520275 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd1041158b0 0x7fd104176280 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=2187796649854208141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 --2- 10.20.193.4:0/3672520275 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd1041100b0 0x7fd104115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 --2- 10.20.193.4:0/3672520275 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd10410f6c0 0x7fd10410fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 -- 10.20.193.4:0/3672520275 >> 10.20.193.4:0/3672520275 conn(0x7fd1040ecfd0 msgr2=0x7fd10410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 -- 10.20.193.4:0/3672520275 shutdown_connections 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 -- 10.20.193.4:0/3672520275 wait complete. 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 Processor -- start 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 -- start start 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd10410f6c0 0x7fd10411df70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd1041100b0 0x7fd10411e4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd1041158b0 0x7fd104123880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd104123ea0 con 0x7fd10410f6c0 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd104124010 con 0x7fd1041158b0 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd10adbb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041241d0 con 0x7fd1041100b0 2026-02-24T09:09:42.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd108b30640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd10410f6c0 0x7fd10411df70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd108b30640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd10410f6c0 0x7fd10411df70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60008/0 (socket says 10.20.193.4:60008) 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd108b30640 1 -- 10.20.193.4:0/282817871 learned_addr learned my addr 10.20.193.4:0/282817871 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd1041100b0 0x7fd10411e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd109331640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd1041158b0 0x7fd104123880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd108b30640 1 -- 10.20.193.4:0/282817871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd1041100b0 msgr2=0x7fd10411e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd108b30640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd1041100b0 0x7fd10411e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd108b30640 1 -- 10.20.193.4:0/282817871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd1041158b0 msgr2=0x7fd104123880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd108b30640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd1041158b0 0x7fd104123880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.531+0000 7fd108b30640 1 -- 10.20.193.4:0/282817871 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10000a650 con 0x7fd10410f6c0 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.532+0000 7fd108b30640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd10410f6c0 0x7fd10411df70 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f4005db0 tx=0x7fd0f400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.532+0000 7fd0f9ffb640 1 -- 10.20.193.4:0/282817871 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0f4004500 con 0x7fd10410f6c0 2026-02-24T09:09:42.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.532+0000 7fd10adbb640 1 -- 10.20.193.4:0/282817871 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1041244b0 con 0x7fd10410f6c0 2026-02-24T09:09:42.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.532+0000 7fd0f9ffb640 1 -- 10.20.193.4:0/282817871 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0f4004d30 con 0x7fd10410f6c0 2026-02-24T09:09:42.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.532+0000 7fd10adbb640 1 -- 10.20.193.4:0/282817871 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd104164bb0 con 0x7fd10410f6c0 2026-02-24T09:09:42.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.532+0000 7fd0f9ffb640 1 -- 10.20.193.4:0/282817871 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0f4005310 con 0x7fd10410f6c0 2026-02-24T09:09:42.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.533+0000 7fd0f9ffb640 1 -- 10.20.193.4:0/282817871 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fd0f40054a0 con 0x7fd10410f6c0 2026-02-24T09:09:42.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.534+0000 7fd0f9ffb640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0e00b57f0 0x7fd0e00d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.534+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0e00b57f0 0x7fd0e00d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.534+0000 7fd0f9ffb640 1 -- 10.20.193.4:0/282817871 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fd0f40e6cb0 con 0x7fd10410f6c0 2026-02-24T09:09:42.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.534+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0e00b57f0 0x7fd0e00d5ca0 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd104124910 tx=0x7fd0ec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.535+0000 7fd10cdb5e00 1 Processor -- start 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.535+0000 7fd10cdb5e00 1 -- start start 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.535+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 0x5614f79888a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79cd540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79cda80 0x5614f79ede60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5614f7898d70 con 0x5614f7988de0 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5614f7894aa0 con 0x5614f79cda80 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5614f788ec00 con 0x5614f79884d0 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0fbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0fbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60022/0 (socket says 10.20.193.4:60022) 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0fbfff640 1 -- 10.20.193.4:0/3014621667 learned_addr learned my addr 10.20.193.4:0/3014621667 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd108b30640 1 --2- 10.20.193.4:0/3014621667 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 0x5614f79888a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0fbfff640 1 -- 10.20.193.4:0/3014621667 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 msgr2=0x5614f79888a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/3014621667 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 0x5614f79888a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0fbfff640 1 -- 10.20.193.4:0/3014621667 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79cda80 msgr2=0x5614f79ede60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/3014621667 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79cda80 0x5614f79ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0fbfff640 1 -- 10.20.193.4:0/3014621667 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f783a300 con 0x5614f7988de0 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/3014621667 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79cd540 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=13381130335981716318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ec0043f0 tx=0x7fd0ec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b35324f164c35e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0d14e4640 1 -- 10.20.193.4:0/3014621667 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0ec01d460 con 0x5614f7988de0 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0d14e4640 1 -- 10.20.193.4:0/3014621667 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0ec01daa0 con 0x5614f7988de0 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd0d14e4640 1 -- 10.20.193.4:0/3014621667 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0ec01aae0 con 0x5614f7988de0 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3014621667 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 msgr2=0x5614f79cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/3014621667 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79cd540 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=13381130335981716318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ec0043f0 tx=0x7fd0ec013000 comp rx=0 tx=0).stop 2026-02-24T09:09:42.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3014621667 shutdown_connections 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/3014621667 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79cda80 0x5614f79ede60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/3014621667 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79cd540 unknown :-1 s=CLOSED pgs=355 gs=1 cs=0 l=1 c_cookie=13381130335981716318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/3014621667 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 0x5614f79888a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3014621667 >> 10.20.193.4:0/3014621667 conn(0x5614f78a7480 msgr2=0x5614f7986db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3014621667 shutdown_connections 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.536+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3014621667 wait complete. 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd10cdb5e00 1 -- start start 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd10cdb5e00 1 Processor -- start 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 0x5614f79a09d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a0f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79cda80 0x5614f79a5f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5614f79a6440 con 0x5614f7988de0 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5614f79a65b0 con 0x5614f79cda80 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5614f79a6770 con 0x5614f79884d0 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd0fbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd0fbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60032/0 (socket says 10.20.193.4:60032) 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.537+0000 7fd0fbfff640 1 -- 10.20.193.4:0/4224619769 learned_addr learned my addr 10.20.193.4:0/4224619769 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd109331640 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79cda80 0x5614f79a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0fbfff640 1 -- 10.20.193.4:0/4224619769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 msgr2=0x5614f79a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd108b30640 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 0x5614f79a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 0x5614f79a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0fbfff640 1 -- 10.20.193.4:0/4224619769 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79cda80 msgr2=0x5614f79a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79cda80 0x5614f79a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0fbfff640 1 -- 10.20.193.4:0/4224619769 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f78128b0 con 0x5614f7988de0 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd109331640 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79cda80 0x5614f79a5f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd108b30640 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 0x5614f79a09d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a0f10 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=16179478536074856803 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ec009ef0 tx=0x7fd0ec011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0890e0189cc8963 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0c27fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0c27fc640 1 -- 10.20.193.4:0/4224619769 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0ec02c070 con 0x5614f7988de0 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0c27fc640 1 -- 10.20.193.4:0/4224619769 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0ec01a3f0 con 0x5614f7988de0 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/4224619769 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ec009890 con 0x5614f7988de0 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0c27fc640 1 -- 10.20.193.4:0/4224619769 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0ec027ce0 con 0x5614f7988de0 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 10 client.15279 _ll_register_callbacks cb 0x5614f780ff00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/4224619769 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5614f751c600 con 0x5614f7988de0 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0c27fc640 1 -- 10.20.193.4:0/4224619769 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fd0ec03b3f0 con 0x5614f7988de0 2026-02-24T09:09:42.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0c27fc640 1 -- 10.20.193.4:0/4224619769 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fd0ec03b610 con 0x5614f7988de0 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 10 client.15279 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/4224619769 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x5614f78246d0 con 0x5614f7988de0 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd0c27fc640 1 -- 10.20.193.4:0/4224619769 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7fd0ec039060 con 0x5614f7988de0 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 10 client.15279 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 10 client.15279 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 20 client.15279 populate_metadata read hostname 'trial004' 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5614f79cbe80 0x5614f79cd2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 4 client.15279 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/4224619769 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614f789fd50 con 0x5614f79cbe80 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.538+0000 7fd108b30640 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5614f79cbe80 0x5614f79cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.539+0000 7fd108b30640 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5614f79cbe80 0x5614f79cd2f0 crc :-1 s=READY pgs=15 gs=4 cs=0 l=0 c_cookie=623912896475720322 s_cookie=11167066691102575177 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a8957945386a82 server_cookie=9af963fd6a440a49 in_seq=0 out_seq=0 2026-02-24T09:09:42.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.539+0000 7fd0c27fc640 10 client.15279 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd0c27fc640 1 -- 10.20.193.4:0/4224619769 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5614f789fd50 con 0x5614f79cbe80 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd0c27fc640 10 client.15279 handle_command_reply: tid=0 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 client.15279 shutdown 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/4224619769 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 msgr2=0x5614f79a0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a0f10 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=16179478536074856803 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ec009ef0 tx=0x7fd0ec011f20 comp rx=0 tx=0).stop 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/4224619769 shutdown_connections 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5614f79cbe80 0x5614f79cd2f0 crc :-1 s=READY pgs=15 gs=4 cs=0 l=0 c_cookie=623912896475720322 s_cookie=11167066691102575177 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79cda80 0x5614f79a5f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a0f10 unknown :-1 s=CLOSED pgs=356 gs=1 cs=0 l=1 c_cookie=16179478536074856803 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/4224619769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79884d0 0x5614f79a09d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd0c27fc640 0 client.15279 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/4224619769 >> 10.20.193.4:0/4224619769 conn(0x5614f78a7480 msgr2=0x5614f79874c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/4224619769 shutdown_connections 2026-02-24T09:09:42.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/4224619769 wait complete. 2026-02-24T09:09:42.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.540+0000 7fd10cdb5e00 20 client.15279 trim_cache size 0 max 16384 2026-02-24T09:09:42.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd10cdb5e00 1 Processor -- start 2026-02-24T09:09:42.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd10cdb5e00 1 -- start start 2026-02-24T09:09:42.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f79884d0 0x5614f79927d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f7988de0 0x5614f798b3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79cda80 0x5614f79cab70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5614f788c830 con 0x5614f79884d0 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5614f7557e60 con 0x5614f7988de0 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5614f79a68b0 con 0x5614f79cda80 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd108b30640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f79884d0 0x5614f79927d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd108b30640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f79884d0 0x5614f79927d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60036/0 (socket says 10.20.193.4:60036) 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd108b30640 1 -- 10.20.193.4:0/1541025321 learned_addr learned my addr 10.20.193.4:0/1541025321 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd108b30640 1 -- 10.20.193.4:0/1541025321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79cda80 msgr2=0x5614f79cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd108b30640 1 --2- 10.20.193.4:0/1541025321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79cda80 0x5614f79cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd108b30640 1 -- 10.20.193.4:0/1541025321 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f7988de0 msgr2=0x5614f798b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/1541025321 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f7988de0 0x5614f798b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd108b30640 1 --2- 10.20.193.4:0/1541025321 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f7988de0 0x5614f798b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd108b30640 1 -- 10.20.193.4:0/1541025321 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f781f150 con 0x5614f79884d0 2026-02-24T09:09:42.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd108b30640 1 --2- 10.20.193.4:0/1541025321 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f79884d0 0x5614f79927d0 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=6898552896513392712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f40e4770 tx=0x7fd0f4009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbc954f2cec4048 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd0d0ce3640 1 -- 10.20.193.4:0/1541025321 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0f40ad9f0 con 0x5614f79884d0 2026-02-24T09:09:42.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd0d0ce3640 1 -- 10.20.193.4:0/1541025321 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0f40b2d10 con 0x5614f79884d0 2026-02-24T09:09:42.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.549+0000 7fd0d0ce3640 1 -- 10.20.193.4:0/1541025321 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0f40acb90 con 0x5614f79884d0 2026-02-24T09:09:42.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/1541025321 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f79884d0 msgr2=0x5614f79927d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/1541025321 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f79884d0 0x5614f79927d0 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=6898552896513392712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f40e4770 tx=0x7fd0f4009d40 comp rx=0 tx=0).stop 2026-02-24T09:09:42.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/1541025321 shutdown_connections 2026-02-24T09:09:42.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/1541025321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79cda80 0x5614f79cab70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/1541025321 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f7988de0 0x5614f798b3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/1541025321 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f79884d0 0x5614f79927d0 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=6898552896513392712 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/1541025321 >> 10.20.193.4:0/1541025321 conn(0x5614f78a7480 msgr2=0x5614f799dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/1541025321 shutdown_connections 2026-02-24T09:09:42.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/1541025321 wait complete. 2026-02-24T09:09:42.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 -- start start 2026-02-24T09:09:42.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 Processor -- start 2026-02-24T09:09:42.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79884d0 0x5614f79a5530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a6e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79cda80 0x5614f79a7370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.550+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5614f79cc780 con 0x5614f7988de0 2026-02-24T09:09:42.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5614f79a7960 con 0x5614f79884d0 2026-02-24T09:09:42.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5614f79a7b20 con 0x5614f79cda80 2026-02-24T09:09:42.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0fbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0fbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60038/0 (socket says 10.20.193.4:60038) 2026-02-24T09:09:42.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0fbfff640 1 -- 10.20.193.4:0/3420146800 learned_addr learned my addr 10.20.193.4:0/3420146800 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd109331640 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79cda80 0x5614f79a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd108b30640 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79884d0 0x5614f79a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0fbfff640 1 -- 10.20.193.4:0/3420146800 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79cda80 msgr2=0x5614f79a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79cda80 0x5614f79a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0fbfff640 1 -- 10.20.193.4:0/3420146800 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79884d0 msgr2=0x5614f79a5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79884d0 0x5614f79a5530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0fbfff640 1 -- 10.20.193.4:0/3420146800 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f7812be0 con 0x5614f7988de0 2026-02-24T09:09:42.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0fbfff640 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a6e30 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=18216064630250493028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ec0058d0 tx=0x7fd0ec01a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccc7644b3a35464 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0c27fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:42.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0c27fc640 1 -- 10.20.193.4:0/3420146800 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0ec02c040 con 0x5614f7988de0 2026-02-24T09:09:42.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0c27fc640 1 -- 10.20.193.4:0/3420146800 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0ec03f020 con 0x5614f7988de0 2026-02-24T09:09:42.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0c27fc640 1 -- 10.20.193.4:0/3420146800 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0ec027a40 con 0x5614f7988de0 2026-02-24T09:09:42.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3420146800 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd104164bb0 con 0x5614f7988de0 2026-02-24T09:09:42.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0c27fc640 1 -- 10.20.193.4:0/3420146800 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fd0ec040030 con 0x5614f7988de0 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0c27fc640 10 client.15285 inactive, discarding osd_map(75..75 src has 1..75) 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 10 client.15285 _ll_register_callbacks cb 0x5614f79a14f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3420146800 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0ec01daa0 con 0x5614f7988de0 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0c27fc640 1 -- 10.20.193.4:0/3420146800 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fd0ec027440 con 0x5614f7988de0 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 10 client.15285 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3420146800 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x5614f7824930 con 0x5614f7988de0 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd0c27fc640 1 -- 10.20.193.4:0/3420146800 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7fd0ec025070 con 0x5614f7988de0 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 10 client.15285 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 10 client.15285 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 20 client.15285 populate_metadata read hostname 'trial004' 2026-02-24T09:09:42.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5614f7a7f610 0x5614f7a7e320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 4 client.15285 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.551+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3420146800 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "status"}) -- 0x5614f7519e50 con 0x5614f7a7f610 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.552+0000 7fd108b30640 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5614f7a7f610 0x5614f7a7e320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.552+0000 7fd108b30640 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5614f7a7f610 0x5614f7a7e320 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=8126363948734138815 s_cookie=13719897027065404175 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70c6a4f4bfd6c9bf server_cookie=be66dda7ad2bdb0f in_seq=0 out_seq=0 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.552+0000 7fd0c27fc640 10 client.15285 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.552+0000 7fd0c27fc640 1 -- 10.20.193.4:0/3420146800 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1212 (crc 0 0 0) 0x5614f7519e50 con 0x5614f7a7f610 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.552+0000 7fd0c27fc640 10 client.15285 handle_command_reply: tid=0 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.552+0000 7fd10cdb5e00 1 client.15285 shutdown 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.552+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3420146800 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 msgr2=0x5614f79a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.552+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a6e30 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=18216064630250493028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ec0058d0 tx=0x7fd0ec01a7d0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3420146800 shutdown_connections 2026-02-24T09:09:42.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5614f7a7f610 0x5614f7a7e320 crc :-1 s=READY pgs=16 gs=4 cs=0 l=0 c_cookie=8126363948734138815 s_cookie=13719897027065404175 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5614f79cda80 0x5614f79a7370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd0c27fc640 0 client.15285 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:42.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5614f7988de0 0x5614f79a6e30 unknown :-1 s=CLOSED pgs=358 gs=1 cs=0 l=1 c_cookie=18216064630250493028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10cdb5e00 1 --2- 10.20.193.4:0/3420146800 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5614f79884d0 0x5614f79a5530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3420146800 >> 10.20.193.4:0/3420146800 conn(0x5614f78a7480 msgr2=0x5614f79927d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3420146800 shutdown_connections 2026-02-24T09:09:42.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10cdb5e00 1 -- 10.20.193.4:0/3420146800 wait complete. 2026-02-24T09:09:42.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10cdb5e00 20 client.15285 trim_cache size 0 max 16384 2026-02-24T09:09:42.567 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:42.567 INFO:teuthology.orchestra.run.trial004.stdout: "cluster_fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:09:42.567 INFO:teuthology.orchestra.run.trial004.stdout: "whoami": 2, 2026-02-24T09:09:42.567 INFO:teuthology.orchestra.run.trial004.stdout: "id": 24620, 2026-02-24T09:09:42.567 INFO:teuthology.orchestra.run.trial004.stdout: "want_state": "up:active", 2026-02-24T09:09:42.567 INFO:teuthology.orchestra.run.trial004.stdout: "state": "up:active", 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "fs_name": "cephfs", 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "rank_uptime": 13.616111702, 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "mdsmap_epoch": 18, 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch": 75, 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch_barrier": 75, 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "uptime": 21.879708376, 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "sysinfo": { 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "arch": "x86_64", 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_release": "tentacle", 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:09:42.568 INFO:teuthology.orchestra.run.trial004.stdout: "container_hostname": "trial014", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "distro": "centos", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "distro_version": "9", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": "trial014", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "mem_total_kb": "130438936", 2026-02-24T09:09:42.569 INFO:teuthology.orchestra.run.trial004.stdout: "os": "Linux" 2026-02-24T09:09:42.570 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:09:42.570 INFO:teuthology.orchestra.run.trial004.stdout: "endian": "little" 2026-02-24T09:09:42.570 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:42.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 -- 10.20.193.4:0/282817871 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0e00b57f0 msgr2=0x7fd0e00d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0e00b57f0 0x7fd0e00d5ca0 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd104124910 tx=0x7fd0ec005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:42.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 -- 10.20.193.4:0/282817871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd10410f6c0 msgr2=0x7fd10411df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd10410f6c0 0x7fd10411df70 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f4005db0 tx=0x7fd0f400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 -- 10.20.193.4:0/282817871 shutdown_connections 2026-02-24T09:09:42.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0e00b57f0 0x7fd0e00d5ca0 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd1041158b0 0x7fd104123880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd1041100b0 0x7fd10411e4b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 --2- 10.20.193.4:0/282817871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd10410f6c0 0x7fd10411df70 unknown :-1 s=CLOSED pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 -- 10.20.193.4:0/282817871 >> 10.20.193.4:0/282817871 conn(0x7fd1040ecfd0 msgr2=0x7fd10410d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.572 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 -- 10.20.193.4:0/282817871 shutdown_connections 2026-02-24T09:09:42.572 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.553+0000 7fd10adbb640 1 -- 10.20.193.4:0/282817871 wait complete. 2026-02-24T09:09:42.572 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:42 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1818655111' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:42.572 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:42 trial004 ceph-mon[41596]: pgmap v145: 97 pgs: 97 active+clean; 632 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2026-02-24T09:09:42.572 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:42 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2945614951' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:42.572 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:42 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4241178694' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:42.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:42 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1818655111' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:42.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:42 trial090 ceph-mon[47278]: pgmap v145: 97 pgs: 97 active+clean; 632 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2026-02-24T09:09:42.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:42 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2945614951' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:42.583 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:42 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4241178694' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:42.591 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.c status 2026-02-24T09:09:42.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:42 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1818655111' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:42.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:42 trial014 ceph-mon[46941]: pgmap v145: 97 pgs: 97 active+clean; 632 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2026-02-24T09:09:42.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:42 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2945614951' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:42.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:42 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4241178694' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:42.706 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:42.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.805+0000 7fecbb9e8640 1 -- 10.20.193.4:0/3527257281 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fecb410d010 msgr2=0x7fecb410d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.805+0000 7fecbb9e8640 1 --2- 10.20.193.4:0/3527257281 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fecb410d010 0x7fecb410d3e0 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=3361730529949135861 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca4009950 tx=0x7feca402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 -- 10.20.193.4:0/3527257281 shutdown_connections 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 --2- 10.20.193.4:0/3527257281 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fecb4113200 0x7fecb4173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 --2- 10.20.193.4:0/3527257281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fecb410da00 0x7fecb4112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 --2- 10.20.193.4:0/3527257281 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fecb410d010 0x7fecb410d3e0 unknown :-1 s=CLOSED pgs=359 gs=1 cs=0 l=1 c_cookie=3361730529949135861 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 -- 10.20.193.4:0/3527257281 >> 10.20.193.4:0/3527257281 conn(0x7fecb405f830 msgr2=0x7fecb410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 -- 10.20.193.4:0/3527257281 shutdown_connections 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 -- 10.20.193.4:0/3527257281 wait complete. 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 Processor -- start 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 -- start start 2026-02-24T09:09:42.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fecb410d010 0x7fecb4060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fecb410da00 0x7fecb40614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fecb4113200 0x7fecb4061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fecb4163c60 con 0x7fecb410d010 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fecb4163dd0 con 0x7fecb410da00 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecbb9e8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fecb4163f90 con 0x7fecb4113200 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecb975d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fecb410d010 0x7fecb4060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecb975d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fecb410d010 0x7fecb4060f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60058/0 (socket says 10.20.193.4:60058) 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecb975d640 1 -- 10.20.193.4:0/541940198 learned_addr learned my addr 10.20.193.4:0/541940198 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.806+0000 7fecb9f5e640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fecb4113200 0x7fecb4061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7fecb8f5c640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fecb410da00 0x7fecb40614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7fecb975d640 1 -- 10.20.193.4:0/541940198 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fecb4113200 msgr2=0x7fecb4061a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7fecb975d640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fecb4113200 0x7fecb4061a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7fecb975d640 1 -- 10.20.193.4:0/541940198 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fecb410da00 msgr2=0x7fecb40614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7fecb975d640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fecb410da00 0x7fecb40614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7fecb975d640 1 -- 10.20.193.4:0/541940198 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca4009570 con 0x7fecb410d010 2026-02-24T09:09:42.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7fecb975d640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fecb410d010 0x7fecb4060f90 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca40023d0 tx=0x7feca4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7feca27fc640 1 -- 10.20.193.4:0/541940198 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feca403d070 con 0x7fecb410d010 2026-02-24T09:09:42.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7fecbb9e8640 1 -- 10.20.193.4:0/541940198 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb4164210 con 0x7fecb410d010 2026-02-24T09:09:42.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7feca27fc640 1 -- 10.20.193.4:0/541940198 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feca4002ad0 con 0x7fecb410d010 2026-02-24T09:09:42.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7feca27fc640 1 -- 10.20.193.4:0/541940198 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feca40418a0 con 0x7fecb410d010 2026-02-24T09:09:42.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.807+0000 7fecbb9e8640 1 -- 10.20.193.4:0/541940198 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb41646d0 con 0x7fecb410d010 2026-02-24T09:09:42.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.809+0000 7feca27fc640 1 -- 10.20.193.4:0/541940198 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7feca402f9f0 con 0x7fecb410d010 2026-02-24T09:09:42.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.810+0000 7feca27fc640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fec900b5770 0x7fec900d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.810+0000 7fecb8f5c640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fec900b5770 0x7fec900d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.810+0000 7feca27fc640 1 -- 10.20.193.4:0/541940198 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7feca410b0d0 con 0x7fecb410d010 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.810+0000 7fecb8f5c640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fec900b5770 0x7fec900d5c20 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb4111a70 tx=0x7feca8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.810+0000 7fecbd9e2e00 1 Processor -- start 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecbd9e2e00 1 -- start start 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa6948a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa694de0 0x55dcfa6d9540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6f9e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa5a4d70 con 0x55dcfa6944d0 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa5a0aa0 con 0x55dcfa694de0 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa59ac00 con 0x55dcfa6d9a80 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecb975d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa6948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecb975d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa6948a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60072/0 (socket says 10.20.193.4:60072) 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecb975d640 1 -- 10.20.193.4:0/3185504851 learned_addr learned my addr 10.20.193.4:0/3185504851 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecb9f5e640 1 --2- 10.20.193.4:0/3185504851 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecb975d640 1 -- 10.20.193.4:0/3185504851 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa6d9a80 msgr2=0x55dcfa6f9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecb975d640 1 --2- 10.20.193.4:0/3185504851 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6f9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecb975d640 1 -- 10.20.193.4:0/3185504851 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa694de0 msgr2=0x55dcfa6d9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecb975d640 1 --2- 10.20.193.4:0/3185504851 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa694de0 0x55dcfa6d9540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecb975d640 1 -- 10.20.193.4:0/3185504851 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfa546300 con 0x55dcfa6944d0 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fecb975d640 1 --2- 10.20.193.4:0/3185504851 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa6948a0 secure :-1 s=READY pgs=361 gs=1 cs=0 l=1 c_cookie=11064495287654579159 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca4108c70 tx=0x7feca4038f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998cfbd787a27bd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fec81ce5640 1 -- 10.20.193.4:0/3185504851 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feca40d0d20 con 0x55dcfa6944d0 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fec81ce5640 1 -- 10.20.193.4:0/3185504851 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feca40d1f20 con 0x55dcfa6944d0 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.811+0000 7fec81ce5640 1 -- 10.20.193.4:0/3185504851 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feca402fcd0 con 0x55dcfa6944d0 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.812+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/3185504851 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 msgr2=0x55dcfa6948a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.812+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/3185504851 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa6948a0 secure :-1 s=READY pgs=361 gs=1 cs=0 l=1 c_cookie=11064495287654579159 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca4108c70 tx=0x7feca4038f90 comp rx=0 tx=0).stop 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.812+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/3185504851 shutdown_connections 2026-02-24T09:09:42.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.812+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/3185504851 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6f9e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.812+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/3185504851 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa694de0 0x55dcfa6d9540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.812+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/3185504851 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa6948a0 unknown :-1 s=CLOSED pgs=361 gs=1 cs=0 l=1 c_cookie=11064495287654579159 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.812+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/3185504851 >> 10.20.193.4:0/3185504851 conn(0x55dcfa5b3480 msgr2=0x55dcfa692db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.812+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/3185504851 shutdown_connections 2026-02-24T09:09:42.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.812+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/3185504851 wait complete. 2026-02-24T09:09:42.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 1 -- start start 2026-02-24T09:09:42.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 1 Processor -- start 2026-02-24T09:09:42.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6944d0 0x55dcfa6ac720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa694de0 0x55dcfa6acc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6b1c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa6b2190 con 0x55dcfa6d9a80 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa6b2300 con 0x55dcfa6944d0 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa6b24c0 con 0x55dcfa694de0 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb9f5e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb9f5e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60078/0 (socket says 10.20.193.4:60078) 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb9f5e640 1 -- 10.20.193.4:0/2681892990 learned_addr learned my addr 10.20.193.4:0/2681892990 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb9f5e640 1 -- 10.20.193.4:0/2681892990 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa694de0 msgr2=0x55dcfa6acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb9f5e640 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa694de0 0x55dcfa6acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb9f5e640 1 -- 10.20.193.4:0/2681892990 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6944d0 msgr2=0x55dcfa6ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb975d640 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6944d0 0x55dcfa6ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb9f5e640 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6944d0 0x55dcfa6ac720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb9f5e640 1 -- 10.20.193.4:0/2681892990 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfa51e8b0 con 0x55dcfa6d9a80 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb975d640 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6944d0 0x55dcfa6ac720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecb9f5e640 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6b1c50 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=5153274959629978763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb0003a00 tx=0x7fecb000aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47841c45c6a90c8b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fec6effd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:42.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fec6effd640 1 -- 10.20.193.4:0/2681892990 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecb0011890 con 0x55dcfa6d9a80 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/2681892990 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb41646d0 con 0x55dcfa6d9a80 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fec6effd640 1 -- 10.20.193.4:0/2681892990 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fecb0013450 con 0x55dcfa6d9a80 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fec6effd640 1 -- 10.20.193.4:0/2681892990 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecb0010640 con 0x55dcfa6d9a80 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 10 client.15297 _ll_register_callbacks cb 0x55dcfa51bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/2681892990 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dcfa228600 con 0x55dcfa6d9a80 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.813+0000 7fec6effd640 1 -- 10.20.193.4:0/2681892990 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fecb00107a0 con 0x55dcfa6d9a80 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fec6effd640 1 -- 10.20.193.4:0/2681892990 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fecb00109e0 con 0x55dcfa6d9a80 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fecbd9e2e00 10 client.15297 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/2681892990 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x55dcfa5306d0 con 0x55dcfa6d9a80 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fec6effd640 1 -- 10.20.193.4:0/2681892990 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7fecb001b070 con 0x55dcfa6d9a80 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fecbd9e2e00 10 client.15297 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fecbd9e2e00 10 client.15297 resolve_mds: resolved name 'c' to daemon mds.c 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fecbd9e2e00 20 client.15297 populate_metadata read hostname 'trial004' 2026-02-24T09:09:42.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55dcfa6d7e20 0x55dcfa6d9290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fecbd9e2e00 4 client.15297 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/2681892990 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcfa5abd50 con 0x55dcfa6d7e20 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fecb975d640 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55dcfa6d7e20 0x55dcfa6d9290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fecb975d640 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55dcfa6d7e20 0x55dcfa6d9290 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=4560937440926793279 s_cookie=1976355146819164259 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f4bb47009387e3f server_cookie=1b6d6c88ec2bd863 in_seq=0 out_seq=0 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.814+0000 7fec6effd640 10 client.15297 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fec6effd640 1 -- 10.20.193.4:0/2681892990 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55dcfa5abd50 con 0x55dcfa6d7e20 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fec6effd640 10 client.15297 handle_command_reply: tid=0 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 client.15297 shutdown 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/2681892990 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6d9a80 msgr2=0x55dcfa6b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6b1c50 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=5153274959629978763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb0003a00 tx=0x7fecb000aa00 comp rx=0 tx=0).stop 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/2681892990 shutdown_connections 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55dcfa6d7e20 0x55dcfa6d9290 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=4560937440926793279 s_cookie=1976355146819164259 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6b1c50 unknown :-1 s=CLOSED pgs=362 gs=1 cs=0 l=1 c_cookie=5153274959629978763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa694de0 0x55dcfa6acc60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fec6effd640 0 client.15297 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:42.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/2681892990 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6944d0 0x55dcfa6ac720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/2681892990 >> 10.20.193.4:0/2681892990 conn(0x55dcfa5b3480 msgr2=0x55dcfa6934c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/2681892990 shutdown_connections 2026-02-24T09:09:42.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/2681892990 wait complete. 2026-02-24T09:09:42.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.815+0000 7fecbd9e2e00 20 client.15297 trim_cache size 0 max 16384 2026-02-24T09:09:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecbd9e2e00 1 Processor -- start 2026-02-24T09:09:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecbd9e2e00 1 -- start start 2026-02-24T09:09:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa69e560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa694de0 0x55dcfa6971c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6d6b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa598830 con 0x55dcfa6944d0 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa263e60 con 0x55dcfa6d9a80 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa71a110 con 0x55dcfa694de0 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecb975d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa69e560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecb975d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa69e560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60082/0 (socket says 10.20.193.4:60082) 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecb975d640 1 -- 10.20.193.4:0/3151370397 learned_addr learned my addr 10.20.193.4:0/3151370397 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecb9f5e640 1 --2- 10.20.193.4:0/3151370397 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecb975d640 1 -- 10.20.193.4:0/3151370397 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa694de0 msgr2=0x55dcfa6971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecb975d640 1 --2- 10.20.193.4:0/3151370397 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa694de0 0x55dcfa6971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecb975d640 1 -- 10.20.193.4:0/3151370397 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6d9a80 msgr2=0x55dcfa6d6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecb975d640 1 --2- 10.20.193.4:0/3151370397 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6d6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecb975d640 1 -- 10.20.193.4:0/3151370397 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfa52b150 con 0x55dcfa6944d0 2026-02-24T09:09:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fecb975d640 1 --2- 10.20.193.4:0/3151370397 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa69e560 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=7779024665624102443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca40cdaf0 tx=0x7feca402f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf4a5b7e586c62b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.824+0000 7fec814e4640 1 -- 10.20.193.4:0/3151370397 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feca4038920 con 0x55dcfa6944d0 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fec814e4640 1 -- 10.20.193.4:0/3151370397 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feca40d9820 con 0x55dcfa6944d0 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fec814e4640 1 -- 10.20.193.4:0/3151370397 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feca40d21b0 con 0x55dcfa6944d0 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/3151370397 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 msgr2=0x55dcfa69e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/3151370397 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa69e560 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=7779024665624102443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca40cdaf0 tx=0x7feca402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/3151370397 shutdown_connections 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/3151370397 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6d6b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/3151370397 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa694de0 0x55dcfa6971c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/3151370397 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa6944d0 0x55dcfa69e560 unknown :-1 s=CLOSED pgs=363 gs=1 cs=0 l=1 c_cookie=7779024665624102443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/3151370397 >> 10.20.193.4:0/3151370397 conn(0x55dcfa5b3480 msgr2=0x55dcfa6a9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/3151370397 shutdown_connections 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/3151370397 wait complete. 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 -- start start 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.825+0000 7fecbd9e2e00 1 Processor -- start 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa6944d0 0x55dcfa6b13f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa694de0 0x55dcfa6b2d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6b3250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa6d3940 con 0x55dcfa694de0 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa5a0aa0 con 0x55dcfa6d9a80 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa5a4d70 con 0x55dcfa6944d0 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecb8f5c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa694de0 0x55dcfa6b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecb8f5c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa694de0 0x55dcfa6b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60098/0 (socket says 10.20.193.4:60098) 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecb8f5c640 1 -- 10.20.193.4:0/310329855 learned_addr learned my addr 10.20.193.4:0/310329855 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecb975d640 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa6944d0 0x55dcfa6b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecb8f5c640 1 -- 10.20.193.4:0/310329855 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa6944d0 msgr2=0x55dcfa6b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecb8f5c640 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa6944d0 0x55dcfa6b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecb8f5c640 1 -- 10.20.193.4:0/310329855 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6d9a80 msgr2=0x55dcfa6b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecb8f5c640 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecb8f5c640 1 -- 10.20.193.4:0/310329855 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfa51ebe0 con 0x55dcfa694de0 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecb8f5c640 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa694de0 0x55dcfa6b2d10 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=11499636934986279877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca8004740 tx=0x7feca8011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f96eadd5bd1abc5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fec6effd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fec6effd640 1 -- 10.20.193.4:0/310329855 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feca8004390 con 0x55dcfa694de0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/310329855 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcfa546300 con 0x55dcfa694de0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fec6effd640 1 -- 10.20.193.4:0/310329855 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feca8009e40 con 0x55dcfa694de0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fec6effd640 1 -- 10.20.193.4:0/310329855 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feca801a440 con 0x55dcfa694de0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 10 client.15303 _ll_register_callbacks cb 0x55dcfa51bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/310329855 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca40d1f20 con 0x55dcfa694de0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fec6effd640 1 -- 10.20.193.4:0/310329855 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7feca801a5a0 con 0x55dcfa694de0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fec6effd640 1 -- 10.20.193.4:0/310329855 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7feca801a7a0 con 0x55dcfa694de0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 10 client.15303 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/310329855 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x55dcfa530930 con 0x55dcfa694de0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fec6effd640 1 -- 10.20.193.4:0/310329855 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7feca802d070 con 0x55dcfa694de0 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 10 client.15303 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 10 client.15303 resolve_mds: resolved name 'c' to daemon mds.c 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 20 client.15303 populate_metadata read hostname 'trial004' 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55dcfa78bba0 0x55dcfa78a8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:42.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 4 client.15303 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.826+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/310329855 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "status"}) -- 0x55dcfa225e50 con 0x55dcfa78bba0 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecb975d640 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55dcfa78bba0 0x55dcfa78a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecb975d640 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55dcfa78bba0 0x55dcfa78a8b0 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=6601624960317864981 s_cookie=18424594857116238970 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5b9daeecac193c15 server_cookie=ffb14f67a4e7047a in_seq=0 out_seq=0 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fec6effd640 10 client.15303 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fec6effd640 1 -- 10.20.193.4:0/310329855 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1218 (crc 0 0 0) 0x55dcfa225e50 con 0x55dcfa78bba0 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fec6effd640 10 client.15303 handle_command_reply: tid=0 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 client.15303 shutdown 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/310329855 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa694de0 msgr2=0x55dcfa6b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa694de0 0x55dcfa6b2d10 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=11499636934986279877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca8004740 tx=0x7feca8011b60 comp rx=0 tx=0).stop 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/310329855 shutdown_connections 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55dcfa78bba0 0x55dcfa78a8b0 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=6601624960317864981 s_cookie=18424594857116238970 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dcfa6d9a80 0x55dcfa6b3250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dcfa694de0 0x55dcfa6b2d10 unknown :-1 s=CLOSED pgs=364 gs=1 cs=0 l=1 c_cookie=11499636934986279877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 --2- 10.20.193.4:0/310329855 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dcfa6944d0 0x55dcfa6b13f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fec6effd640 0 client.15303 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:42.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/310329855 >> 10.20.193.4:0/310329855 conn(0x55dcfa5b3480 msgr2=0x55dcfa69e560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/310329855 shutdown_connections 2026-02-24T09:09:42.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 1 -- 10.20.193.4:0/310329855 wait complete. 2026-02-24T09:09:42.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.827+0000 7fecbd9e2e00 20 client.15303 trim_cache size 0 max 16384 2026-02-24T09:09:42.837 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:42.837 INFO:teuthology.orchestra.run.trial004.stdout: "cluster_fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:09:42.837 INFO:teuthology.orchestra.run.trial004.stdout: "whoami": 1, 2026-02-24T09:09:42.837 INFO:teuthology.orchestra.run.trial004.stdout: "id": 24625, 2026-02-24T09:09:42.837 INFO:teuthology.orchestra.run.trial004.stdout: "want_state": "up:active", 2026-02-24T09:09:42.837 INFO:teuthology.orchestra.run.trial004.stdout: "state": "up:active", 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "fs_name": "cephfs", 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "rank_uptime": 14.894300569, 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "mdsmap_epoch": 18, 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch": 75, 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch_barrier": 75, 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "uptime": 25.635211906999999, 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "sysinfo": { 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "arch": "x86_64", 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_release": "tentacle", 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "container_hostname": "trial090", 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:09:42.838 INFO:teuthology.orchestra.run.trial004.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: "distro": "centos", 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: "distro_version": "9", 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": "trial090", 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: "mem_total_kb": "130438940", 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: "os": "Linux" 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout: "endian": "little" 2026-02-24T09:09:42.839 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 -- 10.20.193.4:0/541940198 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fec900b5770 msgr2=0x7fec900d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fec900b5770 0x7fec900d5c20 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecb4111a70 tx=0x7feca8005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 -- 10.20.193.4:0/541940198 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fecb410d010 msgr2=0x7fecb4060f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fecb410d010 0x7fecb4060f90 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca40023d0 tx=0x7feca4004290 comp rx=0 tx=0).stop 2026-02-24T09:09:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 -- 10.20.193.4:0/541940198 shutdown_connections 2026-02-24T09:09:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fec900b5770 0x7fec900d5c20 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fecb4113200 0x7fecb4061a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fecb410da00 0x7fecb40614d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 --2- 10.20.193.4:0/541940198 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fecb410d010 0x7fecb4060f90 unknown :-1 s=CLOSED pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:42.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 -- 10.20.193.4:0/541940198 >> 10.20.193.4:0/541940198 conn(0x7fecb405f830 msgr2=0x7fecb410ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:42.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 -- 10.20.193.4:0/541940198 shutdown_connections 2026-02-24T09:09:42.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:42.828+0000 7fecbb9e8640 1 -- 10.20.193.4:0/541940198 wait complete. 2026-02-24T09:09:42.869 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.i status 2026-02-24T09:09:42.985 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.089+0000 7ff6c5c78640 1 -- 10.20.193.4:0/822081794 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff6c010f280 msgr2=0x7ff6c010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.089+0000 7ff6c5c78640 1 --2- 10.20.193.4:0/822081794 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff6c010f280 0x7ff6c010f650 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=6605281586649422867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6ac009950 tx=0x7ff6ac02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.089+0000 7ff6c5c78640 1 -- 10.20.193.4:0/822081794 shutdown_connections 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.089+0000 7ff6c5c78640 1 --2- 10.20.193.4:0/822081794 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff6c0115470 0x7ff6c0175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.089+0000 7ff6c5c78640 1 --2- 10.20.193.4:0/822081794 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff6c010fc70 0x7ff6c0114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.089+0000 7ff6c5c78640 1 --2- 10.20.193.4:0/822081794 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff6c010f280 0x7ff6c010f650 unknown :-1 s=CLOSED pgs=365 gs=1 cs=0 l=1 c_cookie=6605281586649422867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.089+0000 7ff6c5c78640 1 -- 10.20.193.4:0/822081794 >> 10.20.193.4:0/822081794 conn(0x7ff6c005f830 msgr2=0x7ff6c010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.089+0000 7ff6c5c78640 1 -- 10.20.193.4:0/822081794 shutdown_connections 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.089+0000 7ff6c5c78640 1 -- 10.20.193.4:0/822081794 wait complete. 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.089+0000 7ff6c5c78640 1 Processor -- start 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6c5c78640 1 -- start start 2026-02-24T09:09:43.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6c5c78640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff6c010f280 0x7ff6c011c840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6c5c78640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff6c010fc70 0x7ff6c011cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6c5c78640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff6c0115470 0x7ff6c0122150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6c5c78640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c0122770 con 0x7ff6c010f280 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6c5c78640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c01228e0 con 0x7ff6c010fc70 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6c5c78640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c0122aa0 con 0x7ff6c0115470 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bf7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff6c010f280 0x7ff6c011c840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bf7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff6c010f280 0x7ff6c011c840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33476/0 (socket says 10.20.193.4:33476) 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bf7fe640 1 -- 10.20.193.4:0/2679128498 learned_addr learned my addr 10.20.193.4:0/2679128498 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bffff640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff6c0115470 0x7ff6c0122150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6beffd640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff6c010fc70 0x7ff6c011cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bf7fe640 1 -- 10.20.193.4:0/2679128498 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff6c0115470 msgr2=0x7ff6c0122150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bf7fe640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff6c0115470 0x7ff6c0122150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bf7fe640 1 -- 10.20.193.4:0/2679128498 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff6c010fc70 msgr2=0x7ff6c011cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bf7fe640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff6c010fc70 0x7ff6c011cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bf7fe640 1 -- 10.20.193.4:0/2679128498 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac009570 con 0x7ff6c010f280 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bf7fe640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff6c010f280 0x7ff6c011c840 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6ac038820 tx=0x7ff6ac004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bcff9640 1 -- 10.20.193.4:0/2679128498 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6ac03d070 con 0x7ff6c010f280 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6c5c78640 1 -- 10.20.193.4:0/2679128498 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c0122d20 con 0x7ff6c010f280 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bcff9640 1 -- 10.20.193.4:0/2679128498 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6ac002ad0 con 0x7ff6c010f280 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6bcff9640 1 -- 10.20.193.4:0/2679128498 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6ac041940 con 0x7ff6c010f280 2026-02-24T09:09:43.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.090+0000 7ff6c5c78640 1 -- 10.20.193.4:0/2679128498 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c0163480 con 0x7ff6c010f280 2026-02-24T09:09:43.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.092+0000 7ff6bcff9640 1 -- 10.20.193.4:0/2679128498 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7ff6ac041ad0 con 0x7ff6c010f280 2026-02-24T09:09:43.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.093+0000 7ff6bcff9640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6940b5770 0x7ff6940d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.093+0000 7ff6beffd640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6940b5770 0x7ff6940d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.093+0000 7ff6bcff9640 1 -- 10.20.193.4:0/2679128498 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7ff6ac10b1e0 con 0x7ff6c010f280 2026-02-24T09:09:43.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.093+0000 7ff6beffd640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6940b5770 0x7ff6940d5c20 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6c01231e0 tx=0x7ff6b0004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:43.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.094+0000 7ff6c7c72e00 1 Processor -- start 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.094+0000 7ff6c7c72e00 1 -- start start 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8a4d0 0x557d5ea8a8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5ea8ade0 0x557d5eacf540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacfa80 0x557d5eaefe60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557d5e99ad70 con 0x557d5eacfa80 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557d5e996aa0 con 0x557d5ea8ade0 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557d5e990c00 con 0x557d5ea8a4d0 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacfa80 0x557d5eaefe60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacfa80 0x557d5eaefe60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33482/0 (socket says 10.20.193.4:33482) 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6bffff640 1 -- 10.20.193.4:0/4265498842 learned_addr learned my addr 10.20.193.4:0/4265498842 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6beffd640 1 --2- 10.20.193.4:0/4265498842 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5ea8ade0 0x557d5eacf540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6bffff640 1 -- 10.20.193.4:0/4265498842 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8a4d0 msgr2=0x557d5ea8a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6bffff640 1 --2- 10.20.193.4:0/4265498842 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8a4d0 0x557d5ea8a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6bffff640 1 -- 10.20.193.4:0/4265498842 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5ea8ade0 msgr2=0x557d5eacf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6bffff640 1 --2- 10.20.193.4:0/4265498842 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5ea8ade0 0x557d5eacf540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6bffff640 1 -- 10.20.193.4:0/4265498842 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5e93c300 con 0x557d5eacfa80 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6bffff640 1 --2- 10.20.193.4:0/4265498842 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacfa80 0x557d5eaefe60 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=8036626645801678414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6b4006a50 tx=0x7ff6b4003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f87d55abf72b64e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff683fff640 1 -- 10.20.193.4:0/4265498842 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6b400ae30 con 0x557d5eacfa80 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff683fff640 1 -- 10.20.193.4:0/4265498842 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6b4003e90 con 0x557d5eacfa80 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff683fff640 1 -- 10.20.193.4:0/4265498842 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6b4012a30 con 0x557d5eacfa80 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/4265498842 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacfa80 msgr2=0x557d5eaefe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/4265498842 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacfa80 0x557d5eaefe60 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=8036626645801678414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6b4006a50 tx=0x7ff6b4003c30 comp rx=0 tx=0).stop 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/4265498842 shutdown_connections 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/4265498842 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacfa80 0x557d5eaefe60 unknown :-1 s=CLOSED pgs=367 gs=1 cs=0 l=1 c_cookie=8036626645801678414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/4265498842 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5ea8ade0 0x557d5eacf540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/4265498842 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8a4d0 0x557d5ea8a8a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/4265498842 >> 10.20.193.4:0/4265498842 conn(0x557d5e9a9480 msgr2=0x557d5ea88db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/4265498842 shutdown_connections 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.095+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/4265498842 wait complete. 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6c7c72e00 1 -- start start 2026-02-24T09:09:43.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6c7c72e00 1 Processor -- start 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8a4d0 0x557d5eaa2a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8ade0 0x557d5eaa2f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5eacfa80 0x557d5eaa7f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557d5eaa84c0 con 0x557d5ea8a4d0 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557d5eaa8630 con 0x557d5eacfa80 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557d5eaa87f0 con 0x557d5ea8ade0 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6bf7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8a4d0 0x557d5eaa2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6bf7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8a4d0 0x557d5eaa2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33498/0 (socket says 10.20.193.4:33498) 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.096+0000 7ff6bf7fe640 1 -- 10.20.193.4:0/1090441150 learned_addr learned my addr 10.20.193.4:0/1090441150 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6bffff640 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5eacfa80 0x557d5eaa7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6bf7fe640 1 -- 10.20.193.4:0/1090441150 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8ade0 msgr2=0x557d5eaa2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6bf7fe640 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8ade0 0x557d5eaa2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6bf7fe640 1 -- 10.20.193.4:0/1090441150 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5eacfa80 msgr2=0x557d5eaa7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6bf7fe640 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5eacfa80 0x557d5eaa7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6bf7fe640 1 -- 10.20.193.4:0/1090441150 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5e9148b0 con 0x557d5ea8a4d0 2026-02-24T09:09:43.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6bf7fe640 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8a4d0 0x557d5eaa2a50 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=1450558814426454270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6ac041aa0 tx=0x7ff6ac038de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14216b8e6bb358fe server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6817fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6817fa640 1 -- 10.20.193.4:0/1090441150 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6ac07dea0 con 0x557d5ea8a4d0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6817fa640 1 -- 10.20.193.4:0/1090441150 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6ac0d70d0 con 0x557d5ea8a4d0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1090441150 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b4005350 con 0x557d5ea8a4d0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6817fa640 1 -- 10.20.193.4:0/1090441150 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6ac096a30 con 0x557d5ea8a4d0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 10 client.15315 _ll_register_callbacks cb 0x557d5e911f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1090441150 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d5e61e600 con 0x557d5ea8a4d0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6817fa640 1 -- 10.20.193.4:0/1090441150 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7ff6ac0d2280 con 0x557d5ea8a4d0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6817fa640 1 -- 10.20.193.4:0/1090441150 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff6ac0d2440 con 0x557d5ea8a4d0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 10 client.15315 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1090441150 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x557d5e9266d0 con 0x557d5ea8a4d0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6817fa640 1 -- 10.20.193.4:0/1090441150 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7ff6ac0f6040 con 0x557d5ea8a4d0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 10 client.15315 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 10 client.15315 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 20 client.15315 populate_metadata read hostname 'trial004' 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557d5eacdee0 0x557d5eacf200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 4 client.15315 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1090441150 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d5e9a1d50 con 0x557d5eacdee0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.097+0000 7ff6beffd640 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557d5eacdee0 0x557d5eacf200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.098+0000 7ff6817fa640 10 client.15315 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:43.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.098+0000 7ff6beffd640 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557d5eacdee0 0x557d5eacf200 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=15793360136462254203 s_cookie=15538355341185187233 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db2d495e07a5c07b server_cookie=d7a353db6922fda1 in_seq=0 out_seq=0 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6817fa640 1 -- 10.20.193.4:0/1090441150 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557d5e9a1d50 con 0x557d5eacdee0 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6817fa640 10 client.15315 handle_command_reply: tid=0 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 client.15315 shutdown 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1090441150 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8a4d0 msgr2=0x557d5eaa2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8a4d0 0x557d5eaa2a50 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=1450558814426454270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6ac041aa0 tx=0x7ff6ac038de0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1090441150 shutdown_connections 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557d5eacdee0 0x557d5eacf200 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=15793360136462254203 s_cookie=15538355341185187233 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5eacfa80 0x557d5eaa7f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6817fa640 0 client.15315 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8ade0 0x557d5eaa2f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1090441150 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8a4d0 0x557d5eaa2a50 unknown :-1 s=CLOSED pgs=368 gs=1 cs=0 l=1 c_cookie=1450558814426454270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1090441150 >> 10.20.193.4:0/1090441150 conn(0x557d5e9a9480 msgr2=0x557d5ea894c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1090441150 shutdown_connections 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1090441150 wait complete. 2026-02-24T09:09:43.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.099+0000 7ff6c7c72e00 20 client.15315 trim_cache size 0 max 16384 2026-02-24T09:09:43.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6c7c72e00 1 Processor -- start 2026-02-24T09:09:43.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6c7c72e00 1 -- start start 2026-02-24T09:09:43.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5ea8a4d0 0x557d5ea9fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8ade0 0x557d5eaa0380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacdee0 0x557d5ea896c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557d5e98e830 con 0x557d5eacdee0 2026-02-24T09:09:43.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557d5e659e60 con 0x557d5ea8a4d0 2026-02-24T09:09:43.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557d5e9fe650 con 0x557d5ea8ade0 2026-02-24T09:09:43.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacdee0 0x557d5ea896c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacdee0 0x557d5ea896c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33508/0 (socket says 10.20.193.4:33508) 2026-02-24T09:09:43.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6bffff640 1 -- 10.20.193.4:0/4132659067 learned_addr learned my addr 10.20.193.4:0/4132659067 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:43.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6bf7fe640 1 --2- 10.20.193.4:0/4132659067 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5ea8a4d0 0x557d5ea9fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6bffff640 1 -- 10.20.193.4:0/4132659067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8ade0 msgr2=0x557d5eaa0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:43.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6bffff640 1 --2- 10.20.193.4:0/4132659067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8ade0 0x557d5eaa0380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6bffff640 1 -- 10.20.193.4:0/4132659067 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5ea8a4d0 msgr2=0x557d5ea9fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:43.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6bffff640 1 --2- 10.20.193.4:0/4132659067 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5ea8a4d0 0x557d5ea9fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6bffff640 1 -- 10.20.193.4:0/4132659067 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5eacdbd0 con 0x557d5eacdee0 2026-02-24T09:09:43.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6bffff640 1 --2- 10.20.193.4:0/4132659067 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacdee0 0x557d5ea896c0 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=6137786541458519070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6b4006a20 tx=0x7ff6b4006790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552dcc570ecef41e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:43.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.108+0000 7ff6837fe640 1 -- 10.20.193.4:0/4132659067 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6b401bea0 con 0x557d5eacdee0 2026-02-24T09:09:43.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6837fe640 1 -- 10.20.193.4:0/4132659067 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6b400ae30 con 0x557d5eacdee0 2026-02-24T09:09:43.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6837fe640 1 -- 10.20.193.4:0/4132659067 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6b4012ac0 con 0x557d5eacdee0 2026-02-24T09:09:43.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/4132659067 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacdee0 msgr2=0x557d5ea896c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/4132659067 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacdee0 0x557d5ea896c0 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=6137786541458519070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6b4006a20 tx=0x7ff6b4006790 comp rx=0 tx=0).stop 2026-02-24T09:09:43.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/4132659067 shutdown_connections 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/4132659067 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5eacdee0 0x557d5ea896c0 unknown :-1 s=CLOSED pgs=369 gs=1 cs=0 l=1 c_cookie=6137786541458519070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/4132659067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8ade0 0x557d5eaa0380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/4132659067 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5ea8a4d0 0x557d5ea9fe40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/4132659067 >> 10.20.193.4:0/4132659067 conn(0x557d5e9a9480 msgr2=0x557d5eaccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/4132659067 shutdown_connections 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.109+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/4132659067 wait complete. 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6c7c72e00 1 -- start start 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6c7c72e00 1 Processor -- start 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8a4d0 0x557d5ea8bde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8ade0 0x557d5eaa8e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6c7c72e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5eacdee0 0x557d5eaa93b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557d5eac9860 con 0x557d5ea8ade0 2026-02-24T09:09:43.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557d5e9f9c40 con 0x557d5eacdee0 2026-02-24T09:09:43.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6c7c72e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557d5eaa9b60 con 0x557d5ea8a4d0 2026-02-24T09:09:43.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6beffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8ade0 0x557d5eaa8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6beffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8ade0 0x557d5eaa8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33514/0 (socket says 10.20.193.4:33514) 2026-02-24T09:09:43.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6beffd640 1 -- 10.20.193.4:0/1617216802 learned_addr learned my addr 10.20.193.4:0/1617216802 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:43.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6bf7fe640 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8a4d0 0x557d5ea8bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6bffff640 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5eacdee0 0x557d5eaa93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6beffd640 1 -- 10.20.193.4:0/1617216802 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8a4d0 msgr2=0x557d5ea8bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:43.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6beffd640 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8a4d0 0x557d5ea8bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6beffd640 1 -- 10.20.193.4:0/1617216802 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5eacdee0 msgr2=0x557d5eaa93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6beffd640 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5eacdee0 0x557d5eaa93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6beffd640 1 -- 10.20.193.4:0/1617216802 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5e921150 con 0x557d5ea8ade0 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6beffd640 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8ade0 0x557d5eaa8e70 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=5394442264869784984 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6b00046f0 tx=0x7ff6b0021830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adce8a8aeeacd98 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6817fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6817fa640 1 -- 10.20.193.4:0/1617216802 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6b0026070 con 0x557d5ea8ade0 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6817fa640 1 -- 10.20.193.4:0/1617216802 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6b00212e0 con 0x557d5ea8ade0 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6817fa640 1 -- 10.20.193.4:0/1617216802 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6b0011a30 con 0x557d5ea8ade0 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1617216802 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b4023040 con 0x557d5ea8ade0 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.110+0000 7ff6817fa640 1 -- 10.20.193.4:0/1617216802 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7ff6b0011bc0 con 0x557d5ea8ade0 2026-02-24T09:09:43.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6817fa640 10 client.15321 inactive, discarding osd_map(75..75 src has 1..75) 2026-02-24T09:09:43.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6c7c72e00 10 client.15321 _ll_register_callbacks cb 0x557d5e911f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:43.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1617216802 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6b4003e90 con 0x557d5ea8ade0 2026-02-24T09:09:43.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6817fa640 1 -- 10.20.193.4:0/1617216802 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff6b000feb0 con 0x557d5ea8ade0 2026-02-24T09:09:43.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6c7c72e00 10 client.15321 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:43.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1617216802 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x557d5e914be0 con 0x557d5ea8ade0 2026-02-24T09:09:43.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6817fa640 1 -- 10.20.193.4:0/1617216802 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7ff6b0019040 con 0x557d5ea8ade0 2026-02-24T09:09:43.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6c7c72e00 10 client.15321 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:43.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6c7c72e00 10 client.15321 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-24T09:09:43.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6c7c72e00 20 client.15321 populate_metadata read hostname 'trial004' 2026-02-24T09:09:43.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557d5eacfa80 0x557d5eb80820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6c7c72e00 4 client.15321 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1617216802 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "status"}) -- 0x557d5e61be50 con 0x557d5eacfa80 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.111+0000 7ff6bf7fe640 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557d5eacfa80 0x557d5eb80820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6817fa640 10 client.15321 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6bf7fe640 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557d5eacfa80 0x557d5eb80820 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=10882724011660091235 s_cookie=1024671068672369906 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=970733d4579d1f63 server_cookie=e385ce873d624f2 in_seq=0 out_seq=0 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6817fa640 1 -- 10.20.193.4:0/1617216802 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x557d5e61be50 con 0x557d5eacfa80 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6817fa640 10 client.15321 handle_command_reply: tid=0 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 client.15321 shutdown 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1617216802 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8ade0 msgr2=0x557d5eaa8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8ade0 0x557d5eaa8e70 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=5394442264869784984 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6b00046f0 tx=0x7ff6b0021830 comp rx=0 tx=0).stop 2026-02-24T09:09:43.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1617216802 shutdown_connections 2026-02-24T09:09:43.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557d5eacfa80 0x557d5eb80820 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=10882724011660091235 s_cookie=1024671068672369906 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557d5eacdee0 0x557d5eaa93b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557d5ea8ade0 0x557d5eaa8e70 unknown :-1 s=CLOSED pgs=370 gs=1 cs=0 l=1 c_cookie=5394442264869784984 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6817fa640 0 client.15321 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:43.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 --2- 10.20.193.4:0/1617216802 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557d5ea8a4d0 0x557d5ea8bde0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1617216802 >> 10.20.193.4:0/1617216802 conn(0x557d5e9a9480 msgr2=0x557d5eaa2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:43.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1617216802 shutdown_connections 2026-02-24T09:09:43.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 1 -- 10.20.193.4:0/1617216802 wait complete. 2026-02-24T09:09:43.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.112+0000 7ff6c7c72e00 20 client.15321 trim_cache size 0 max 16384 2026-02-24T09:09:43.126 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:43.126 INFO:teuthology.orchestra.run.trial004.stdout: "cluster_fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:09:43.126 INFO:teuthology.orchestra.run.trial004.stdout: "whoami": 0, 2026-02-24T09:09:43.126 INFO:teuthology.orchestra.run.trial004.stdout: "id": 24637, 2026-02-24T09:09:43.126 INFO:teuthology.orchestra.run.trial004.stdout: "want_state": "up:active", 2026-02-24T09:09:43.126 INFO:teuthology.orchestra.run.trial004.stdout: "state": "up:active", 2026-02-24T09:09:43.126 INFO:teuthology.orchestra.run.trial004.stdout: "fs_name": "cephfs", 2026-02-24T09:09:43.126 INFO:teuthology.orchestra.run.trial004.stdout: "rank_uptime": 17.848580433999999, 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "mdsmap_epoch": 18, 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch": 75, 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch_barrier": 75, 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "uptime": 24.543556812999999, 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "sysinfo": { 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "arch": "x86_64", 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_release": "tentacle", 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "container_hostname": "trial090", 2026-02-24T09:09:43.127 INFO:teuthology.orchestra.run.trial004.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "distro": "centos", 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "distro_version": "9", 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": "trial090", 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "mem_total_kb": "130438940", 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "os": "Linux" 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:09:43.128 INFO:teuthology.orchestra.run.trial004.stdout: "endian": "little" 2026-02-24T09:09:43.129 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 -- 10.20.193.4:0/2679128498 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6940b5770 msgr2=0x7ff6940d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6940b5770 0x7ff6940d5c20 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6c01231e0 tx=0x7ff6b0004420 comp rx=0 tx=0).stop 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 -- 10.20.193.4:0/2679128498 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff6c010f280 msgr2=0x7ff6c011c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff6c010f280 0x7ff6c011c840 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6ac038820 tx=0x7ff6ac004300 comp rx=0 tx=0).stop 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 -- 10.20.193.4:0/2679128498 shutdown_connections 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6940b5770 0x7ff6940d5c20 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff6c0115470 0x7ff6c0122150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff6c010fc70 0x7ff6c011cd80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 --2- 10.20.193.4:0/2679128498 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff6c010f280 0x7ff6c011c840 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 -- 10.20.193.4:0/2679128498 >> 10.20.193.4:0/2679128498 conn(0x7ff6c005f830 msgr2=0x7ff6c010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 -- 10.20.193.4:0/2679128498 shutdown_connections 2026-02-24T09:09:43.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.113+0000 7ff6c5c78640 1 -- 10.20.193.4:0/2679128498 wait complete. 2026-02-24T09:09:43.152 INFO:tasks.cephadm:Setup complete, yielding 2026-02-24T09:09:43.152 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-24T09:09:43.165 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial004.front.sepia.ceph.com 2026-02-24T09:09:43.165 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-24T09:09:43.281 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 -- 10.20.193.4:0/197729991 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe250110d90 msgr2=0x7fe250171720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 --2- 10.20.193.4:0/197729991 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe250110d90 0x7fe250171720 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=8514168430409992506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe24c00aa30 tx=0x7fe24c030270 comp rx=0 tx=0).stop 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 -- 10.20.193.4:0/197729991 shutdown_connections 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 --2- 10.20.193.4:0/197729991 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe250110d90 0x7fe250171720 unknown :-1 s=CLOSED pgs=371 gs=1 cs=0 l=1 c_cookie=8514168430409992506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 --2- 10.20.193.4:0/197729991 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe2501103e0 0x7fe250110850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 --2- 10.20.193.4:0/197729991 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe25010f250 0x7fe25010f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 -- 10.20.193.4:0/197729991 >> 10.20.193.4:0/197729991 conn(0x7fe2500ec980 msgr2=0x7fe25010cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 -- 10.20.193.4:0/197729991 shutdown_connections 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 -- 10.20.193.4:0/197729991 wait complete. 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 Processor -- start 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 -- start start 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe25010f250 0x7fe2500f88c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.375+0000 7fe258141640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe2501103e0 0x7fe250171700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe258141640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe250110d90 0x7fe2500f9100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe258141640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe2500f9cd0 con 0x7fe2501103e0 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe258141640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe2500f9e40 con 0x7fe25010f250 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe258141640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2500fa000 con 0x7fe250110d90 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe2556b5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe2501103e0 0x7fe250171700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe2556b5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe2501103e0 0x7fe250171700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33522/0 (socket says 10.20.193.4:33522) 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe2556b5640 1 -- 10.20.193.4:0/4249229138 learned_addr learned my addr 10.20.193.4:0/4249229138 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe255eb6640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe25010f250 0x7fe2500f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe2556b5640 1 -- 10.20.193.4:0/4249229138 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe250110d90 msgr2=0x7fe2500f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe2556b5640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe250110d90 0x7fe2500f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe2556b5640 1 -- 10.20.193.4:0/4249229138 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe25010f250 msgr2=0x7fe2500f88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe2556b5640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe25010f250 0x7fe2500f88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe2556b5640 1 -- 10.20.193.4:0/4249229138 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c00a650 con 0x7fe2501103e0 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe2556b5640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe2501103e0 0x7fe250171700 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe24400c9b0 tx=0x7fe24400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe23effd640 1 -- 10.20.193.4:0/4249229138 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe2440044a0 con 0x7fe2501103e0 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe23effd640 1 -- 10.20.193.4:0/4249229138 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe244007da0 con 0x7fe2501103e0 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe258141640 1 -- 10.20.193.4:0/4249229138 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2500fa2e0 con 0x7fe2501103e0 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe23effd640 1 -- 10.20.193.4:0/4249229138 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe24400f6d0 con 0x7fe2501103e0 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe258141640 1 -- 10.20.193.4:0/4249229138 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2500fa800 con 0x7fe2501103e0 2026-02-24T09:09:43.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.376+0000 7fe258141640 1 -- 10.20.193.4:0/4249229138 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe250175740 con 0x7fe2501103e0 2026-02-24T09:09:43.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.378+0000 7fe23effd640 1 -- 10.20.193.4:0/4249229138 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fe244002880 con 0x7fe2501103e0 2026-02-24T09:09:43.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.378+0000 7fe23effd640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe22c0b57f0 0x7fe22c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.379+0000 7fe255eb6640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe22c0b57f0 0x7fe22c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.379+0000 7fe23effd640 1 -- 10.20.193.4:0/4249229138 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fe2440e6f70 con 0x7fe2501103e0 2026-02-24T09:09:43.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.379+0000 7fe255eb6640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe22c0b57f0 0x7fe22c0d5ca0 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe240005970 tx=0x7fe240005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:43.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.379+0000 7fe23effd640 1 -- 10.20.193.4:0/4249229138 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe2440a9110 con 0x7fe2501103e0 2026-02-24T09:09:43.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.491+0000 7fe258141640 1 -- 10.20.193.4:0/4249229138 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fe250174ea0 con 0x7fe22c0b57f0 2026-02-24T09:09:43.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.492+0000 7fe23effd640 1 -- 10.20.193.4:0/4249229138 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fe250174ea0 con 0x7fe22c0b57f0 2026-02-24T09:09:43.495 INFO:teuthology.orchestra.run.trial004.stdout:Backend: cephadm 2026-02-24T09:09:43.495 INFO:teuthology.orchestra.run.trial004.stdout:Available: Yes 2026-02-24T09:09:43.495 INFO:teuthology.orchestra.run.trial004.stdout:Paused: No 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.492+0000 7fe258141640 1 -- 10.20.193.4:0/4249229138 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe22c0b57f0 msgr2=0x7fe22c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.492+0000 7fe258141640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe22c0b57f0 0x7fe22c0d5ca0 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe240005970 tx=0x7fe240005900 comp rx=0 tx=0).stop 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.493+0000 7fe258141640 1 -- 10.20.193.4:0/4249229138 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe2501103e0 msgr2=0x7fe250171700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.493+0000 7fe258141640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe2501103e0 0x7fe250171700 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe24400c9b0 tx=0x7fe24400ce80 comp rx=0 tx=0).stop 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.493+0000 7fe258141640 1 -- 10.20.193.4:0/4249229138 shutdown_connections 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.493+0000 7fe258141640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe22c0b57f0 0x7fe22c0d5ca0 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.493+0000 7fe258141640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe250110d90 0x7fe2500f9100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.493+0000 7fe258141640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe2501103e0 0x7fe250171700 unknown :-1 s=CLOSED pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.493+0000 7fe258141640 1 --2- 10.20.193.4:0/4249229138 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe25010f250 0x7fe2500f88c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.493+0000 7fe258141640 1 -- 10.20.193.4:0/4249229138 >> 10.20.193.4:0/4249229138 conn(0x7fe2500ec980 msgr2=0x7fe2500eeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.493+0000 7fe258141640 1 -- 10.20.193.4:0/4249229138 shutdown_connections 2026-02-24T09:09:43.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.493+0000 7fe258141640 1 -- 10.20.193.4:0/4249229138 wait complete. 2026-02-24T09:09:43.532 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-24T09:09:43.647 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:43.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/2959848196 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc3f810f250 msgr2=0x7fc3f810f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 --2- 10.20.193.4:0/2959848196 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc3f810f250 0x7fc3f810f640 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=8951806257105895823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3ec009950 tx=0x7fc3ec02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/2959848196 shutdown_connections 2026-02-24T09:09:43.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 --2- 10.20.193.4:0/2959848196 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc3f8110d90 0x7fc3f8171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 --2- 10.20.193.4:0/2959848196 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3f81103e0 0x7fc3f8110850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 --2- 10.20.193.4:0/2959848196 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc3f810f250 0x7fc3f810f640 unknown :-1 s=CLOSED pgs=373 gs=1 cs=0 l=1 c_cookie=8951806257105895823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/2959848196 >> 10.20.193.4:0/2959848196 conn(0x7fc3f80ec980 msgr2=0x7fc3f810cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:43.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/2959848196 shutdown_connections 2026-02-24T09:09:43.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/2959848196 wait complete. 2026-02-24T09:09:43.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 Processor -- start 2026-02-24T09:09:43.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 -- start start 2026-02-24T09:09:43.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3f810f250 0x7fc3f80f8900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc3f81103e0 0x7fc3f8171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc3f8110d90 0x7fc3f80f9160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f80f9d50 con 0x7fc3f8110d90 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f80f9ec0 con 0x7fc3f81103e0 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3fd3e8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f80fa080 con 0x7fc3f810f250 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3f77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc3f8110d90 0x7fc3f80f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3f77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc3f8110d90 0x7fc3f80f9160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33532/0 (socket says 10.20.193.4:33532) 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3f77fe640 1 -- 10.20.193.4:0/495885417 learned_addr learned my addr 10.20.193.4:0/495885417 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.748+0000 7fc3f6ffd640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3f810f250 0x7fc3f80f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3f67fc640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc3f81103e0 0x7fc3f8171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3f77fe640 1 -- 10.20.193.4:0/495885417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3f810f250 msgr2=0x7fc3f80f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3f77fe640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3f810f250 0x7fc3f80f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3f77fe640 1 -- 10.20.193.4:0/495885417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc3f81103e0 msgr2=0x7fc3f8171720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3f77fe640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc3f81103e0 0x7fc3f8171720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3f77fe640 1 -- 10.20.193.4:0/495885417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec009570 con 0x7fc3f8110d90 2026-02-24T09:09:43.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3f77fe640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc3f8110d90 0x7fc3f80f9160 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3e8006e90 tx=0x7fc3e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:43.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3d7fff640 1 -- 10.20.193.4:0/495885417 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3e8005500 con 0x7fc3f8110d90 2026-02-24T09:09:43.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/495885417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f80fa360 con 0x7fc3f8110d90 2026-02-24T09:09:43.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3d7fff640 1 -- 10.20.193.4:0/495885417 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc3e8005e10 con 0x7fc3f8110d90 2026-02-24T09:09:43.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3d7fff640 1 -- 10.20.193.4:0/495885417 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc3e8003a90 con 0x7fc3f8110d90 2026-02-24T09:09:43.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/495885417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f80fa830 con 0x7fc3f8110d90 2026-02-24T09:09:43.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.749+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/495885417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f8175740 con 0x7fc3f8110d90 2026-02-24T09:09:43.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.750+0000 7fc3d7fff640 1 -- 10.20.193.4:0/495885417 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fc3e800c840 con 0x7fc3f8110d90 2026-02-24T09:09:43.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.751+0000 7fc3d7fff640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3cc0b5770 0x7fc3cc0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:43.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.751+0000 7fc3d7fff640 1 -- 10.20.193.4:0/495885417 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fc3e80e7d90 con 0x7fc3f8110d90 2026-02-24T09:09:43.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.751+0000 7fc3f6ffd640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3cc0b5770 0x7fc3cc0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:43.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.751+0000 7fc3f6ffd640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3cc0b5770 0x7fc3cc0d5c20 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3ec0023d0 tx=0x7fc3ec031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:43.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.752+0000 7fc3d7fff640 1 -- 10.20.193.4:0/495885417 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fc3e80aa720 con 0x7fc3f8110d90 2026-02-24T09:09:43.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.861+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/495885417 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc3f8174e70 con 0x7fc3cc0b5770 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.866+0000 7fc3d7fff640 1 -- 10.20.193.4:0/495885417 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fc3f8174e70 con 0x7fc3cc0b5770 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.a trial004 running (23s) 21s ago 23s 14.8M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 471b2e6a38f3 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.b trial014 running (23s) 21s ago 23s 13.7M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 a1d6f3ae05c7 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.c trial090 running (26s) 21s ago 26s 17.2M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 08936578865d 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.d trial004 running (28s) 21s ago 28s 16.9M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 2acdb750a9bc 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.e trial014 running (28s) 21s ago 28s 17.2M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 8cd41bb966e9 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.f trial090 running (27s) 21s ago 27s 14.7M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 e88de4f57ef3 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.g trial004 running (24s) 21s ago 24s 14.8M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 8bb4726960dd 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.h trial014 running (26s) 21s ago 26s 14.3M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 f85c0241d2f6 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.i trial090 running (25s) 21s ago 25s 14.6M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 2144f8863283 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.j trial004 running (29s) 21s ago 29s 14.8M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 3fef49ca7d2f 2026-02-24T09:09:43.870 INFO:teuthology.orchestra.run.trial004.stdout:mds.k trial014 running (30s) 21s ago 30s 14.8M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 c2c6bcedde23 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:mds.l trial090 running (30s) 21s ago 30s 14.7M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 510b22294ebe 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:mgr.x trial004 *:9283,8765 running (3m) 21s ago 3m 563M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 4b06235aa8ca 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:mgr.y trial014 *:8443,8765 running (2m) 21s ago 2m 494M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 9ade078f4ad7 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:mgr.z trial090 *:8443,8765 running (2m) 21s ago 2m 494M - 20.3.0-5537-g5bc9a1ff 5573ff5fc120 bd6eaddae545 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:mon.a trial004 running (3m) 21s ago 3m 54.3M 2048M 20.3.0-5537-g5bc9a1ff 5573ff5fc120 953bcc75edc7 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:mon.b trial014 running (2m) 21s ago 2m 47.7M 2048M 20.3.0-5537-g5bc9a1ff 5573ff5fc120 39baf9f280e1 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:mon.c trial090 running (2m) 21s ago 2m 48.9M 2048M 20.3.0-5537-g5bc9a1ff 5573ff5fc120 66e3dfa3eeee 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.0 trial004 running (2m) 21s ago 2m 43.7M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 1438836dce99 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.1 trial014 running (117s) 21s ago 118s 47.5M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 871ac0f658cc 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.2 trial090 running (109s) 21s ago 110s 46.0M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 c9d3d9ca4364 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.3 trial004 running (100s) 21s ago 102s 41.9M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 24e84c9bde0b 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.4 trial014 running (92s) 21s ago 94s 41.0M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 8e335aae109c 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.5 trial090 running (84s) 21s ago 86s 46.0M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 756fef11b747 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.6 trial004 running (76s) 21s ago 78s 39.9M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 dd5f5332a8ef 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.7 trial014 running (69s) 21s ago 70s 43.9M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 443bae031308 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.8 trial090 running (61s) 21s ago 62s 45.7M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 ada8e37b5c80 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.9 trial004 running (53s) 21s ago 54s 39.9M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 aedf49e11300 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.10 trial014 running (45s) 21s ago 47s 42.5M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 3a77890e646a 2026-02-24T09:09:43.871 INFO:teuthology.orchestra.run.trial004.stdout:osd.11 trial090 running (37s) 21s ago 39s 38.9M 20.5G 20.3.0-5537-g5bc9a1ff 5573ff5fc120 bb80b59d12b5 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/495885417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3cc0b5770 msgr2=0x7fc3cc0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3cc0b5770 0x7fc3cc0d5c20 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3ec0023d0 tx=0x7fc3ec031040 comp rx=0 tx=0).stop 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/495885417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc3f8110d90 msgr2=0x7fc3f80f9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc3f8110d90 0x7fc3f80f9160 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc3e8006e90 tx=0x7fc3e800edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/495885417 shutdown_connections 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3cc0b5770 0x7fc3cc0d5c20 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc3f8110d90 0x7fc3f80f9160 unknown :-1 s=CLOSED pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc3f81103e0 0x7fc3f8171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 --2- 10.20.193.4:0/495885417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3f810f250 0x7fc3f80f8900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/495885417 >> 10.20.193.4:0/495885417 conn(0x7fc3f80ec980 msgr2=0x7fc3f80eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/495885417 shutdown_connections 2026-02-24T09:09:43.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:43.868+0000 7fc3fd3e8640 1 -- 10.20.193.4:0/495885417 wait complete. 2026-02-24T09:09:43.907 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-24T09:09:44.023 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.128+0000 7f0e9f962640 1 -- 10.20.193.4:0/429883106 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e9810f250 msgr2=0x7f0e9810f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.128+0000 7f0e9f962640 1 --2- 10.20.193.4:0/429883106 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e9810f250 0x7f0e9810f640 secure :-1 s=READY pgs=375 gs=1 cs=0 l=1 c_cookie=9398997241715075110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e88009950 tx=0x7f0e8802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.128+0000 7f0e9f962640 1 -- 10.20.193.4:0/429883106 shutdown_connections 2026-02-24T09:09:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.128+0000 7f0e9f962640 1 --2- 10.20.193.4:0/429883106 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e98110d90 0x7f0e98171720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.128+0000 7f0e9f962640 1 --2- 10.20.193.4:0/429883106 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e981103e0 0x7f0e98110850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.128+0000 7f0e9f962640 1 --2- 10.20.193.4:0/429883106 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e9810f250 0x7f0e9810f640 unknown :-1 s=CLOSED pgs=375 gs=1 cs=0 l=1 c_cookie=9398997241715075110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.128+0000 7f0e9f962640 1 -- 10.20.193.4:0/429883106 >> 10.20.193.4:0/429883106 conn(0x7f0e980ec980 msgr2=0x7f0e9810cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.128+0000 7f0e9f962640 1 -- 10.20.193.4:0/429883106 shutdown_connections 2026-02-24T09:09:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.128+0000 7f0e9f962640 1 -- 10.20.193.4:0/429883106 wait complete. 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9f962640 1 Processor -- start 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9f962640 1 -- start start 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9f962640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e9810f250 0x7f0e980f8940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9f962640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e981103e0 0x7f0e98171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9f962640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e98110d90 0x7f0e980f91a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9f962640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0e980f9d90 con 0x7f0e9810f250 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9f962640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0e980f9f00 con 0x7f0e981103e0 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9f962640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e980fa0c0 con 0x7f0e98110d90 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9d6d7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e9810f250 0x7f0e980f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9d6d7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e9810f250 0x7f0e980f8940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33550/0 (socket says 10.20.193.4:33550) 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9d6d7640 1 -- 10.20.193.4:0/2227595554 learned_addr learned my addr 10.20.193.4:0/2227595554 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9ced6640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e981103e0 0x7f0e98171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9ded8640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e98110d90 0x7f0e980f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9d6d7640 1 -- 10.20.193.4:0/2227595554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e98110d90 msgr2=0x7f0e980f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9d6d7640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e98110d90 0x7f0e980f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9d6d7640 1 -- 10.20.193.4:0/2227595554 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e981103e0 msgr2=0x7f0e98171720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9d6d7640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e981103e0 0x7f0e98171720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9d6d7640 1 -- 10.20.193.4:0/2227595554 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e88009570 con 0x7f0e9810f250 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9d6d7640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e9810f250 0x7f0e980f8940 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e88038820 tx=0x7f0e880028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e867fc640 1 -- 10.20.193.4:0/2227595554 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e8803d070 con 0x7f0e9810f250 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9f962640 1 -- 10.20.193.4:0/2227595554 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e980fa340 con 0x7f0e9810f250 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e867fc640 1 -- 10.20.193.4:0/2227595554 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e88002e90 con 0x7f0e9810f250 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e867fc640 1 -- 10.20.193.4:0/2227595554 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e88041a60 con 0x7f0e9810f250 2026-02-24T09:09:44.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.129+0000 7f0e9f962640 1 -- 10.20.193.4:0/2227595554 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e980fa7b0 con 0x7f0e9810f250 2026-02-24T09:09:44.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.130+0000 7f0e9f962640 1 -- 10.20.193.4:0/2227595554 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e98175720 con 0x7f0e9810f250 2026-02-24T09:09:44.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.131+0000 7f0e867fc640 1 -- 10.20.193.4:0/2227595554 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f0e88051020 con 0x7f0e9810f250 2026-02-24T09:09:44.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.132+0000 7f0e867fc640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e740b5770 0x7f0e740d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.132+0000 7f0e9ced6640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e740b5770 0x7f0e740d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.132+0000 7f0e867fc640 1 -- 10.20.193.4:0/2227595554 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f0e8810bdf0 con 0x7f0e9810f250 2026-02-24T09:09:44.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.132+0000 7f0e867fc640 1 -- 10.20.193.4:0/2227595554 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f0e880d1e10 con 0x7f0e9810f250 2026-02-24T09:09:44.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.132+0000 7f0e9ced6640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e740b5770 0x7f0e740d5c20 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e8c004740 tx=0x7f0e8c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:44.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.240+0000 7f0e9f962640 1 -- 10.20.193.4:0/2227595554 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0e98174dc0 con 0x7f0e740b5770 2026-02-24T09:09:44.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.243+0000 7f0e867fc640 1 -- 10.20.193.4:0/2227595554 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+940 (secure 0 0 0) 0x7f0e98174dc0 con 0x7f0e740b5770 2026-02-24T09:09:44.246 INFO:teuthology.orchestra.run.trial004.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-24T09:09:44.247 INFO:teuthology.orchestra.run.trial004.stdout:mds.all 12/12 22s ago 33s trial004=a;trial004=d;trial004=g;trial004=j;trial014=b;trial014=e;trial014=h;trial014=k;trial090=c;trial090=f;trial090=i;trial090=l;count:12 2026-02-24T09:09:44.247 INFO:teuthology.orchestra.run.trial004.stdout:mgr 3/3 22s ago 2m trial004=x;trial014=y;trial090=z;count:3 2026-02-24T09:09:44.247 INFO:teuthology.orchestra.run.trial004.stdout:mon 3/3 22s ago 2m trial004:10.20.193.4=a;trial014:10.20.193.14=b;trial090:10.20.193.90=c;count:3 2026-02-24T09:09:44.247 INFO:teuthology.orchestra.run.trial004.stdout:osd.default 12 22s ago 44s trial090 2026-02-24T09:09:44.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 -- 10.20.193.4:0/2227595554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e740b5770 msgr2=0x7f0e740d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e740b5770 0x7f0e740d5c20 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e8c004740 tx=0x7f0e8c005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:44.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 -- 10.20.193.4:0/2227595554 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e9810f250 msgr2=0x7f0e980f8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e9810f250 0x7f0e980f8940 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e88038820 tx=0x7f0e880028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 -- 10.20.193.4:0/2227595554 shutdown_connections 2026-02-24T09:09:44.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e740b5770 0x7f0e740d5c20 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e98110d90 0x7f0e980f91a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e981103e0 0x7f0e98171720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 --2- 10.20.193.4:0/2227595554 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e9810f250 0x7f0e980f8940 unknown :-1 s=CLOSED pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 -- 10.20.193.4:0/2227595554 >> 10.20.193.4:0/2227595554 conn(0x7f0e980ec980 msgr2=0x7f0e980eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:44.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 -- 10.20.193.4:0/2227595554 shutdown_connections 2026-02-24T09:09:44.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.244+0000 7f0e9f962640 1 -- 10.20.193.4:0/2227595554 wait complete. 2026-02-24T09:09:44.282 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-24T09:09:44.400 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:44.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 -- 10.20.193.4:0/3442008956 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66f01103e0 msgr2=0x7f66f0110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 --2- 10.20.193.4:0/3442008956 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66f01103e0 0x7f66f0110850 secure :-1 s=READY pgs=377 gs=1 cs=0 l=1 c_cookie=17056250406719863892 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66e4009950 tx=0x7f66e402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 -- 10.20.193.4:0/3442008956 shutdown_connections 2026-02-24T09:09:44.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 --2- 10.20.193.4:0/3442008956 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66f0110d90 0x7f66f0171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 --2- 10.20.193.4:0/3442008956 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66f01103e0 0x7f66f0110850 unknown :-1 s=CLOSED pgs=377 gs=1 cs=0 l=1 c_cookie=17056250406719863892 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 --2- 10.20.193.4:0/3442008956 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66f010f250 0x7f66f010f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 -- 10.20.193.4:0/3442008956 >> 10.20.193.4:0/3442008956 conn(0x7f66f00ec980 msgr2=0x7f66f010cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:44.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 -- 10.20.193.4:0/3442008956 shutdown_connections 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 -- 10.20.193.4:0/3442008956 wait complete. 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 Processor -- start 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.495+0000 7f66f73ae640 1 -- start start 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f73ae640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66f010f250 0x7f66f00f8950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f73ae640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66f01103e0 0x7f66f0171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f73ae640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66f0110d90 0x7f66f00f91b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f73ae640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f66f00f9da0 con 0x7f66f01103e0 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f73ae640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f66f00f9f10 con 0x7f66f010f250 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f73ae640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66f00fa0d0 con 0x7f66f0110d90 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f4922640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66f01103e0 0x7f66f0171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f4922640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66f01103e0 0x7f66f0171720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33570/0 (socket says 10.20.193.4:33570) 2026-02-24T09:09:44.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f4922640 1 -- 10.20.193.4:0/1852183424 learned_addr learned my addr 10.20.193.4:0/1852183424 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f5924640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66f0110d90 0x7f66f00f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f5123640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66f010f250 0x7f66f00f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f4922640 1 -- 10.20.193.4:0/1852183424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66f0110d90 msgr2=0x7f66f00f91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f4922640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66f0110d90 0x7f66f00f91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f4922640 1 -- 10.20.193.4:0/1852183424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66f010f250 msgr2=0x7f66f00f8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f4922640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66f010f250 0x7f66f00f8950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f4922640 1 -- 10.20.193.4:0/1852183424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e4009570 con 0x7f66f01103e0 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f5924640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66f0110d90 0x7f66f00f91b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f4922640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66f01103e0 0x7f66f0171720 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66e4038820 tx=0x7f66e40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66de7fc640 1 -- 10.20.193.4:0/1852183424 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66e403d070 con 0x7f66f01103e0 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f73ae640 1 -- 10.20.193.4:0/1852183424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f00fa350 con 0x7f66f01103e0 2026-02-24T09:09:44.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66de7fc640 1 -- 10.20.193.4:0/1852183424 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f66e40043d0 con 0x7f66f01103e0 2026-02-24T09:09:44.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66de7fc640 1 -- 10.20.193.4:0/1852183424 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66e4041be0 con 0x7f66f01103e0 2026-02-24T09:09:44.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.496+0000 7f66f73ae640 1 -- 10.20.193.4:0/1852183424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f00fa7c0 con 0x7f66f01103e0 2026-02-24T09:09:44.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.497+0000 7f66f73ae640 1 -- 10.20.193.4:0/1852183424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f00fa9e0 con 0x7f66f01103e0 2026-02-24T09:09:44.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.498+0000 7f66de7fc640 1 -- 10.20.193.4:0/1852183424 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f66e4038920 con 0x7f66f01103e0 2026-02-24T09:09:44.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.498+0000 7f66de7fc640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66cc0b5770 0x7f66cc0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.498+0000 7f66f5123640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66cc0b5770 0x7f66cc0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.499+0000 7f66de7fc640 1 -- 10.20.193.4:0/1852183424 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f66e410baa0 con 0x7f66f01103e0 2026-02-24T09:09:44.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.499+0000 7f66f5123640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66cc0b5770 0x7f66cc0d5c20 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66e0004740 tx=0x7f66e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:44.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.500+0000 7f66de7fc640 1 -- 10.20.193.4:0/1852183424 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f66e40ce5f0 con 0x7f66f01103e0 2026-02-24T09:09:44.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.606+0000 7f66f73ae640 1 -- 10.20.193.4:0/1852183424 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f66f0174e30 con 0x7f66cc0b5770 2026-02-24T09:09:44.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.607+0000 7f66de7fc640 1 -- 10.20.193.4:0/1852183424 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+183 (secure 0 0 0) 0x7f66f0174e30 con 0x7f66cc0b5770 2026-02-24T09:09:44.611 INFO:teuthology.orchestra.run.trial004.stdout:HOST ADDR LABELS STATUS 2026-02-24T09:09:44.611 INFO:teuthology.orchestra.run.trial004.stdout:trial004 10.20.193.4 2026-02-24T09:09:44.611 INFO:teuthology.orchestra.run.trial004.stdout:trial014 10.20.193.14 2026-02-24T09:09:44.611 INFO:teuthology.orchestra.run.trial004.stdout:trial090 10.20.193.90 2026-02-24T09:09:44.612 INFO:teuthology.orchestra.run.trial004.stdout:3 hosts in cluster 2026-02-24T09:09:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 -- 10.20.193.4:0/1852183424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66cc0b5770 msgr2=0x7f66cc0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66cc0b5770 0x7f66cc0d5c20 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66e0004740 tx=0x7f66e0005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 -- 10.20.193.4:0/1852183424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66f01103e0 msgr2=0x7f66f0171720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66f01103e0 0x7f66f0171720 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66e4038820 tx=0x7f66e40028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 -- 10.20.193.4:0/1852183424 shutdown_connections 2026-02-24T09:09:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f66cc0b5770 0x7f66cc0d5c20 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66f0110d90 0x7f66f00f91b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f66f01103e0 0x7f66f0171720 unknown :-1 s=CLOSED pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 --2- 10.20.193.4:0/1852183424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f66f010f250 0x7f66f00f8950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 -- 10.20.193.4:0/1852183424 >> 10.20.193.4:0/1852183424 conn(0x7f66f00ec980 msgr2=0x7f66f00eefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:44.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 -- 10.20.193.4:0/1852183424 shutdown_connections 2026-02-24T09:09:44.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.608+0000 7f66f73ae640 1 -- 10.20.193.4:0/1852183424 wait complete. 2026-02-24T09:09:44.648 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-24T09:09:44.765 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:44.788 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:44 trial004 ceph-mon[41596]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:44.788 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:44 trial004 ceph-mon[41596]: pgmap v146: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2026-02-24T09:09:44.788 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:44 trial004 ceph-mon[41596]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:44.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 -- 10.20.193.4:0/3474934123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e8410f250 msgr2=0x7f9e8410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 --2- 10.20.193.4:0/3474934123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e8410f250 0x7f9e8410f640 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=1512167269506085758 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e74009950 tx=0x7f9e7402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 -- 10.20.193.4:0/3474934123 shutdown_connections 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 --2- 10.20.193.4:0/3474934123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e84110d90 0x7f9e84171720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 --2- 10.20.193.4:0/3474934123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e841103e0 0x7f9e84110850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 --2- 10.20.193.4:0/3474934123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e8410f250 0x7f9e8410f640 unknown :-1 s=CLOSED pgs=379 gs=1 cs=0 l=1 c_cookie=1512167269506085758 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 -- 10.20.193.4:0/3474934123 >> 10.20.193.4:0/3474934123 conn(0x7f9e840ec980 msgr2=0x7f9e8410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 -- 10.20.193.4:0/3474934123 shutdown_connections 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 -- 10.20.193.4:0/3474934123 wait complete. 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 Processor -- start 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 -- start start 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.865+0000 7f9e8aec5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e8410f250 0x7f9e840f8900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e8aec5640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e841103e0 0x7f9e84171720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e8aec5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e84110d90 0x7f9e840f9160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e8aec5640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9e840f9d50 con 0x7f9e8410f250 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e8aec5640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9e840f9ec0 con 0x7f9e841103e0 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e8aec5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e840fa080 con 0x7f9e84110d90 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e88c3a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e8410f250 0x7f9e840f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e88c3a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e8410f250 0x7f9e840f8900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33582/0 (socket says 10.20.193.4:33582) 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e88c3a640 1 -- 10.20.193.4:0/749717164 learned_addr learned my addr 10.20.193.4:0/749717164 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e88c3a640 1 -- 10.20.193.4:0/749717164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e84110d90 msgr2=0x7f9e840f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e88c3a640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e84110d90 0x7f9e840f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e841103e0 0x7f9e84171720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e88c3a640 1 -- 10.20.193.4:0/749717164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e841103e0 msgr2=0x7f9e84171720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e88c3a640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e841103e0 0x7f9e84171720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e88c3a640 1 -- 10.20.193.4:0/749717164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e74009570 con 0x7f9e8410f250 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e841103e0 0x7f9e84171720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e88c3a640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e8410f250 0x7f9e840f8900 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e74002d80 tx=0x7f9e740028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e79ffb640 1 -- 10.20.193.4:0/749717164 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e7403d070 con 0x7f9e8410f250 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e8aec5640 1 -- 10.20.193.4:0/749717164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e840fa300 con 0x7f9e8410f250 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e79ffb640 1 -- 10.20.193.4:0/749717164 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9e740043d0 con 0x7f9e8410f250 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e79ffb640 1 -- 10.20.193.4:0/749717164 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e74041aa0 con 0x7f9e8410f250 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e8aec5640 1 -- 10.20.193.4:0/749717164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e840fa770 con 0x7f9e8410f250 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.866+0000 7f9e8aec5640 1 -- 10.20.193.4:0/749717164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e840fa990 con 0x7f9e8410f250 2026-02-24T09:09:44.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.867+0000 7f9e79ffb640 1 -- 10.20.193.4:0/749717164 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f9e74038920 con 0x7f9e8410f250 2026-02-24T09:09:44.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.868+0000 7f9e79ffb640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e600b5770 0x7f9e600d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:44.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.868+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e600b5770 0x7f9e600d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:44.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.868+0000 7f9e79ffb640 1 -- 10.20.193.4:0/749717164 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9e7410bc90 con 0x7f9e8410f250 2026-02-24T09:09:44.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.869+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e600b5770 0x7f9e600d5c20 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e6c004740 tx=0x7f9e6c005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:44.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.869+0000 7f9e79ffb640 1 -- 10.20.193.4:0/749717164 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f9e740ce6f0 con 0x7f9e8410f250 2026-02-24T09:09:44.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.977+0000 7f9e8aec5640 1 -- 10.20.193.4:0/749717164 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f9e84174e00 con 0x7f9e600b5770 2026-02-24T09:09:44.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.979+0000 7f9e79ffb640 1 -- 10.20.193.4:0/749717164 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+910 (secure 0 0 0) 0x7f9e84174e00 con 0x7f9e600b5770 2026-02-24T09:09:44.982 INFO:teuthology.orchestra.run.trial004.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-24T09:09:44.982 INFO:teuthology.orchestra.run.trial004.stdout:trial004 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00448 1788G No 44s ago Has a FileSystem, LVM detected 2026-02-24T09:09:44.983 INFO:teuthology.orchestra.run.trial004.stdout:trial004 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B003FD 1788G No 44s ago Has a FileSystem, LVM detected 2026-02-24T09:09:44.983 INFO:teuthology.orchestra.run.trial004.stdout:trial014 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47B1C 1788G No 36s ago Has a FileSystem, LVM detected 2026-02-24T09:09:44.983 INFO:teuthology.orchestra.run.trial004.stdout:trial014 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00421 1788G No 36s ago Has a FileSystem, LVM detected 2026-02-24T09:09:44.983 INFO:teuthology.orchestra.run.trial004.stdout:trial090 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B0029E 1788G No 32s ago Has a FileSystem, LVM detected 2026-02-24T09:09:44.983 INFO:teuthology.orchestra.run.trial004.stdout:trial090 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B00140 1788G No 32s ago Has a FileSystem, LVM detected 2026-02-24T09:09:44.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.979+0000 7f9e8aec5640 1 -- 10.20.193.4:0/749717164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e600b5770 msgr2=0x7f9e600d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.979+0000 7f9e8aec5640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e600b5770 0x7f9e600d5c20 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e6c004740 tx=0x7f9e6c005f00 comp rx=0 tx=0).stop 2026-02-24T09:09:44.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.979+0000 7f9e8aec5640 1 -- 10.20.193.4:0/749717164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e8410f250 msgr2=0x7f9e840f8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:44.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.979+0000 7f9e8aec5640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e8410f250 0x7f9e840f8900 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e74002d80 tx=0x7f9e740028d0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.980+0000 7f9e8aec5640 1 -- 10.20.193.4:0/749717164 shutdown_connections 2026-02-24T09:09:44.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.980+0000 7f9e8aec5640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e600b5770 0x7f9e600d5c20 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.980+0000 7f9e8aec5640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e84110d90 0x7f9e840f9160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.980+0000 7f9e8aec5640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e841103e0 0x7f9e84171720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.980+0000 7f9e8aec5640 1 --2- 10.20.193.4:0/749717164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e8410f250 0x7f9e840f8900 unknown :-1 s=CLOSED pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:44.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.980+0000 7f9e8aec5640 1 -- 10.20.193.4:0/749717164 >> 10.20.193.4:0/749717164 conn(0x7f9e840ec980 msgr2=0x7f9e840eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:44.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.980+0000 7f9e8aec5640 1 -- 10.20.193.4:0/749717164 shutdown_connections 2026-02-24T09:09:44.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:44.980+0000 7f9e8aec5640 1 -- 10.20.193.4:0/749717164 wait complete. 2026-02-24T09:09:45.020 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-24T09:09:45.032 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial004.front.sepia.ceph.com 2026-02-24T09:09:45.032 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- bash -c 'ceph fs dump' 2026-02-24T09:09:45.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:44 trial090 ceph-mon[47278]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:45.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:44 trial090 ceph-mon[47278]: pgmap v146: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2026-02-24T09:09:45.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:44 trial090 ceph-mon[47278]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:45.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:44 trial014 ceph-mon[46941]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:45.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:44 trial014 ceph-mon[46941]: pgmap v146: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 13 op/s 2026-02-24T09:09:45.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:44 trial014 ceph-mon[46941]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:45.147 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 -- 10.20.193.4:0/906457272 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9bb4110d90 msgr2=0x7f9bb4171720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 --2- 10.20.193.4:0/906457272 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9bb4110d90 0x7f9bb4171720 secure :-1 s=READY pgs=381 gs=1 cs=0 l=1 c_cookie=1342610256676366349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ba400aa30 tx=0x7f9ba4030280 comp rx=0 tx=0).stop 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 -- 10.20.193.4:0/906457272 shutdown_connections 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 --2- 10.20.193.4:0/906457272 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9bb4110d90 0x7f9bb4171720 unknown :-1 s=CLOSED pgs=381 gs=1 cs=0 l=1 c_cookie=1342610256676366349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 --2- 10.20.193.4:0/906457272 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9bb41103e0 0x7f9bb4110850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 --2- 10.20.193.4:0/906457272 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bb410f250 0x7f9bb410f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 -- 10.20.193.4:0/906457272 >> 10.20.193.4:0/906457272 conn(0x7f9bb40ec980 msgr2=0x7f9bb410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 -- 10.20.193.4:0/906457272 shutdown_connections 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 -- 10.20.193.4:0/906457272 wait complete. 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 Processor -- start 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 -- start start 2026-02-24T09:09:45.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9bb410f250 0x7f9bb40f88d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9bb41103e0 0x7f9bb4171700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bb4110d90 0x7f9bb40f9110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb40f9d70 con 0x7f9bb41103e0 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb40f9ee0 con 0x7f9bb410f250 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb8cca640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb40fa0a0 con 0x7f9bb4110d90 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb1d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9bb41103e0 0x7f9bb4171700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb1d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9bb41103e0 0x7f9bb4171700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33604/0 (socket says 10.20.193.4:33604) 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb1d74640 1 -- 10.20.193.4:0/942762140 learned_addr learned my addr 10.20.193.4:0/942762140 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.242+0000 7f9bb2d76640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bb4110d90 0x7f9bb40f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9bb2575640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9bb410f250 0x7f9bb40f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9bb1d74640 1 -- 10.20.193.4:0/942762140 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bb4110d90 msgr2=0x7f9bb40f9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9bb1d74640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bb4110d90 0x7f9bb40f9110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9bb1d74640 1 -- 10.20.193.4:0/942762140 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9bb410f250 msgr2=0x7f9bb40f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9bb1d74640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9bb410f250 0x7f9bb40f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9bb1d74640 1 -- 10.20.193.4:0/942762140 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba400a650 con 0x7f9bb41103e0 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9bb1d74640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9bb41103e0 0x7f9bb4171700 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b9c00d8d0 tx=0x7f9b9c00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9b9b7fe640 1 -- 10.20.193.4:0/942762140 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b9c00bea0 con 0x7f9bb41103e0 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9bb8cca640 1 -- 10.20.193.4:0/942762140 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb40fa380 con 0x7f9bb41103e0 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9b9b7fe640 1 -- 10.20.193.4:0/942762140 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9b9c004540 con 0x7f9bb41103e0 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9b9b7fe640 1 -- 10.20.193.4:0/942762140 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b9c002ea0 con 0x7f9bb41103e0 2026-02-24T09:09:45.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9bb8cca640 1 -- 10.20.193.4:0/942762140 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb40fa850 con 0x7f9bb41103e0 2026-02-24T09:09:45.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.243+0000 7f9bb8cca640 1 -- 10.20.193.4:0/942762140 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb4175740 con 0x7f9bb41103e0 2026-02-24T09:09:45.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.245+0000 7f9b9b7fe640 1 -- 10.20.193.4:0/942762140 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f9b9c005070 con 0x7f9bb41103e0 2026-02-24T09:09:45.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.245+0000 7f9b9b7fe640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b8c0b5770 0x7f9b8c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:45.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.245+0000 7f9b9b7fe640 1 -- 10.20.193.4:0/942762140 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9b9c0e7190 con 0x7f9bb41103e0 2026-02-24T09:09:45.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.245+0000 7f9bb2575640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b8c0b5770 0x7f9b8c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:45.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.246+0000 7f9b9b7fe640 1 -- 10.20.193.4:0/942762140 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f9b9c0a9ae0 con 0x7f9bb41103e0 2026-02-24T09:09:45.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.246+0000 7f9bb2575640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b8c0b5770 0x7f9b8c0d5c20 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ba8004740 tx=0x7f9ba8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:45.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.378+0000 7f9bb8cca640 1 -- 10.20.193.4:0/942762140 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9bb410f640 con 0x7f9bb41103e0 2026-02-24T09:09:45.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.378+0000 7f9b9b7fe640 1 -- 10.20.193.4:0/942762140 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) ==== 76+0+3068 (secure 0 0 0) 0x7f9b9c0acc90 con 0x7f9bb41103e0 2026-02-24T09:09:45.383 INFO:teuthology.orchestra.run.trial004.stdout:e18 2026-02-24T09:09:45.383 INFO:teuthology.orchestra.run.trial004.stdout:btime 2026-02-24T09:09:29:940018+0000 2026-02-24T09:09:45.383 INFO:teuthology.orchestra.run.trial004.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-24T09:09:45.383 INFO:teuthology.orchestra.run.trial004.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-24T09:09:45.383 INFO:teuthology.orchestra.run.trial004.stdout:legacy client fscid: 1 2026-02-24T09:09:45.383 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:45.383 INFO:teuthology.orchestra.run.trial004.stdout:Filesystem 'cephfs' (1) 2026-02-24T09:09:45.383 INFO:teuthology.orchestra.run.trial004.stdout:fs_name cephfs 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:epoch 18 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:created 2026-02-24T09:09:24.652522+0000 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:modified 2026-02-24T09:09:29.940013+0000 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:tableserver 0 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:root 0 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:session_timeout 300 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:session_autoclose 300 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:max_file_size 1099511627776 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:max_xattr_size 65536 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:required_client_features {} 2026-02-24T09:09:45.384 INFO:teuthology.orchestra.run.trial004.stdout:last_failure 0 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:last_failure_osd_epoch 0 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:max_mds 3 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:in 0,1,2 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:up {0=24637,1=24625,2=24620} 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:failed 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:damaged 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:stopped 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:data_pools [3] 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:metadata_pool 2 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:inline_data disabled 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:balancer 2026-02-24T09:09:45.385 INFO:teuthology.orchestra.run.trial004.stdout:bal_rank_mask -1 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout:standby_count_wanted 0 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout:qdb_cluster leader: 24637 members: 24637,24625,24620 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout:[mds.i{0:24637} state up:active seq 3 addr [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout:[mds.f{0:24613} state up:standby-replay seq 1 addr [v2:10.20.193.90:6834/1296342299,v1:10.20.193.90:6835/1296342299] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout:[mds.c{1:24625} state up:active seq 4 addr [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout:[mds.h{1:24596} state up:standby-replay seq 1 addr [v2:10.20.193.14:6836/524790199,v1:10.20.193.14:6837/524790199] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout:[mds.b{2:24620} state up:active seq 4 addr [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout:[mds.l{2:24580} state up:standby-replay seq 1 addr [v2:10.20.193.90:6832/931807729,v1:10.20.193.90:6833/931807729] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout:Standby daemons: 2026-02-24T09:09:45.386 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:45.387 INFO:teuthology.orchestra.run.trial004.stdout:[mds.j{-1:14742} state up:standby seq 1 addr [v2:10.20.193.4:6834/1622269315,v1:10.20.193.4:6835/1622269315] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.387 INFO:teuthology.orchestra.run.trial004.stdout:[mds.d{-1:14748} state up:standby seq 1 addr [v2:10.20.193.4:6836/3175863747,v1:10.20.193.4:6837/3175863747] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.387 INFO:teuthology.orchestra.run.trial004.stdout:[mds.g{-1:14790} state up:standby seq 1 addr [v2:10.20.193.4:6838/1186492308,v1:10.20.193.4:6839/1186492308] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.387 INFO:teuthology.orchestra.run.trial004.stdout:[mds.a{-1:14796} state up:standby seq 1 addr [v2:10.20.193.4:6840/1594740511,v1:10.20.193.4:6841/1594740511] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.387 INFO:teuthology.orchestra.run.trial004.stdout:[mds.k{-1:24557} state up:standby seq 1 addr [v2:10.20.193.14:6832/1885006877,v1:10.20.193.14:6833/1885006877] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.387 INFO:teuthology.orchestra.run.trial004.stdout:[mds.e{-1:24575} state up:standby seq 1 addr [v2:10.20.193.14:6834/4114810438,v1:10.20.193.14:6835/4114810438] compat {c=[1],r=[1],i=[1fff]}] 2026-02-24T09:09:45.388 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 18 2026-02-24T09:09:45.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 -- 10.20.193.4:0/942762140 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b8c0b5770 msgr2=0x7f9b8c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:45.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b8c0b5770 0x7f9b8c0d5c20 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ba8004740 tx=0x7f9ba8005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:45.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 -- 10.20.193.4:0/942762140 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9bb41103e0 msgr2=0x7f9bb4171700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:45.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9bb41103e0 0x7f9bb4171700 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b9c00d8d0 tx=0x7f9b9c00dda0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 -- 10.20.193.4:0/942762140 shutdown_connections 2026-02-24T09:09:45.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9b8c0b5770 0x7f9b8c0d5c20 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bb4110d90 0x7f9bb40f9110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9bb41103e0 0x7f9bb4171700 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 --2- 10.20.193.4:0/942762140 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9bb410f250 0x7f9bb40f88d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 -- 10.20.193.4:0/942762140 >> 10.20.193.4:0/942762140 conn(0x7f9bb40ec980 msgr2=0x7f9bb40eef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:45.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 -- 10.20.193.4:0/942762140 shutdown_connections 2026-02-24T09:09:45.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.380+0000 7f9bb8cca640 1 -- 10.20.193.4:0/942762140 wait complete. 2026-02-24T09:09:45.421 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- bash -c 'ceph osd dump' 2026-02-24T09:09:45.538 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:45.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 -- 10.20.193.4:0/3502236393 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb54c110d90 msgr2=0x7fb54c171720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:45.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 --2- 10.20.193.4:0/3502236393 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb54c110d90 0x7fb54c171720 secure :-1 s=READY pgs=383 gs=1 cs=0 l=1 c_cookie=315345157781652900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb54800aa30 tx=0x7fb548030280 comp rx=0 tx=0).stop 2026-02-24T09:09:45.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 -- 10.20.193.4:0/3502236393 shutdown_connections 2026-02-24T09:09:45.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 --2- 10.20.193.4:0/3502236393 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb54c110d90 0x7fb54c171720 unknown :-1 s=CLOSED pgs=383 gs=1 cs=0 l=1 c_cookie=315345157781652900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 --2- 10.20.193.4:0/3502236393 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb54c1103e0 0x7fb54c110850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 --2- 10.20.193.4:0/3502236393 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb54c10f250 0x7fb54c10f640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 -- 10.20.193.4:0/3502236393 >> 10.20.193.4:0/3502236393 conn(0x7fb54c0ec980 msgr2=0x7fb54c10cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:45.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 -- 10.20.193.4:0/3502236393 shutdown_connections 2026-02-24T09:09:45.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 -- 10.20.193.4:0/3502236393 wait complete. 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 Processor -- start 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 -- start start 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb54c10f250 0x7fb54c0f88c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb54c1103e0 0x7fb54c171700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb54c110d90 0x7fb54c0f9100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0f9d60 con 0x7fb54c10f250 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0f9ed0 con 0x7fb54c1103e0 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb553b65640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0fa090 con 0x7fb54c110d90 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb5518da640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb54c10f250 0x7fb54c0f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb5518da640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb54c10f250 0x7fb54c0f88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33618/0 (socket says 10.20.193.4:33618) 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb5518da640 1 -- 10.20.193.4:0/1721973043 learned_addr learned my addr 10.20.193.4:0/1721973043 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:45.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb5510d9640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb54c1103e0 0x7fb54c171700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.638+0000 7fb5520db640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb54c110d90 0x7fb54c0f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb5518da640 1 -- 10.20.193.4:0/1721973043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb54c110d90 msgr2=0x7fb54c0f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb5518da640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb54c110d90 0x7fb54c0f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb5518da640 1 -- 10.20.193.4:0/1721973043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb54c1103e0 msgr2=0x7fb54c171700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb5518da640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb54c1103e0 0x7fb54c171700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb5518da640 1 -- 10.20.193.4:0/1721973043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54800a650 con 0x7fb54c10f250 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb5518da640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb54c10f250 0x7fb54c0f88c0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb53c009480 tx=0x7fb53c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb53affd640 1 -- 10.20.193.4:0/1721973043 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb53c00ccc0 con 0x7fb54c10f250 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb553b65640 1 -- 10.20.193.4:0/1721973043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54c0fa370 con 0x7fb54c10f250 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb53affd640 1 -- 10.20.193.4:0/1721973043 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb53c00ce20 con 0x7fb54c10f250 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb53affd640 1 -- 10.20.193.4:0/1721973043 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb53c0106b0 con 0x7fb54c10f250 2026-02-24T09:09:45.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb553b65640 1 -- 10.20.193.4:0/1721973043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb54c0fa840 con 0x7fb54c10f250 2026-02-24T09:09:45.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.639+0000 7fb553b65640 1 -- 10.20.193.4:0/1721973043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb54c175740 con 0x7fb54c10f250 2026-02-24T09:09:45.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.640+0000 7fb53affd640 1 -- 10.20.193.4:0/1721973043 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fb53c01f060 con 0x7fb54c10f250 2026-02-24T09:09:45.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.641+0000 7fb53affd640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb5280b5770 0x7fb5280d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:45.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.641+0000 7fb53affd640 1 -- 10.20.193.4:0/1721973043 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb53c014070 con 0x7fb54c10f250 2026-02-24T09:09:45.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.641+0000 7fb5510d9640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb5280b5770 0x7fb5280d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:45.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.641+0000 7fb5510d9640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb5280b5770 0x7fb5280d5c20 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb540004740 tx=0x7fb5400073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:45.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.642+0000 7fb53affd640 1 -- 10.20.193.4:0/1721973043 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fb53c0a97c0 con 0x7fb54c10f250 2026-02-24T09:09:45.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.749+0000 7fb553b65640 1 -- 10.20.193.4:0/1721973043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fb54c10f640 con 0x7fb54c10f250 2026-02-24T09:09:45.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.750+0000 7fb53affd640 1 -- 10.20.193.4:0/1721973043 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v75) ==== 56+0+5023 (secure 0 0 0) 0x7fb53c0ac970 con 0x7fb54c10f250 2026-02-24T09:09:45.753 INFO:teuthology.orchestra.run.trial004.stdout:epoch 75 2026-02-24T09:09:45.753 INFO:teuthology.orchestra.run.trial004.stdout:fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:09:45.753 INFO:teuthology.orchestra.run.trial004.stdout:created 2026-02-24T09:06:42.076379+0000 2026-02-24T09:09:45.753 INFO:teuthology.orchestra.run.trial004.stdout:modified 2026-02-24T09:09:26.263940+0000 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:crush_version 26 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:full_ratio 0.95 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:backfillfull_ratio 0.9 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:nearfull_ratio 0.85 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:require_min_compat_client luminous 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:min_compat_client jewel 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:require_osd_release tentacle 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:stretch_mode_enabled false 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:max_osd 12 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.0 up in weight 1 up_from 8 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.4:6802/2373413233,v1:10.20.193.4:6803/2373413233] [v2:10.20.193.4:6804/2373413233,v1:10.20.193.4:6805/2373413233] exists,up b567c39f-8e27-4d34-80f4-602463d6baa0 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.1 up in weight 1 up_from 12 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.14:6800/1845604691,v1:10.20.193.14:6801/1845604691] [v2:10.20.193.14:6802/1845604691,v1:10.20.193.14:6803/1845604691] exists,up f911e6cb-66df-49e1-b032-3df5206c1b44 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.2 up in weight 1 up_from 16 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.90:6800/3627753021,v1:10.20.193.90:6801/3627753021] [v2:10.20.193.90:6802/3627753021,v1:10.20.193.90:6803/3627753021] exists,up cd4a3bca-f02a-4c44-bf95-807c6df67daa 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.3 up in weight 1 up_from 23 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.4:6810/1170432191,v1:10.20.193.4:6811/1170432191] [v2:10.20.193.4:6812/1170432191,v1:10.20.193.4:6813/1170432191] exists,up df7ad596-6759-4a7f-9699-264361763b82 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.4 up in weight 1 up_from 30 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.14:6808/1479310505,v1:10.20.193.14:6809/1479310505] [v2:10.20.193.14:6810/1479310505,v1:10.20.193.14:6811/1479310505] exists,up 2242ac52-60ee-4ca6-8a5d-a50e99be2cca 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.5 up in weight 1 up_from 34 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.90:6808/3682673793,v1:10.20.193.90:6809/3682673793] [v2:10.20.193.90:6810/3682673793,v1:10.20.193.90:6811/3682673793] exists,up e41925be-d3db-4038-a54b-50329f4f89b3 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.6 up in weight 1 up_from 41 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.4:6818/3822012168,v1:10.20.193.4:6819/3822012168] [v2:10.20.193.4:6820/3822012168,v1:10.20.193.4:6821/3822012168] exists,up 43940c98-7188-4b67-b1c0-b7f7d7b73a0f 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.7 up in weight 1 up_from 45 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.14:6816/144746180,v1:10.20.193.14:6817/144746180] [v2:10.20.193.14:6818/144746180,v1:10.20.193.14:6819/144746180] exists,up 09b73119-5f2d-4d33-b62a-1b2f2421232e 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.8 up in weight 1 up_from 52 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.90:6816/1972287488,v1:10.20.193.90:6817/1972287488] [v2:10.20.193.90:6818/1972287488,v1:10.20.193.90:6819/1972287488] exists,up df60627d-303b-4c18-80fc-21774d90b61c 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.9 up in weight 1 up_from 59 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.4:6826/2740686484,v1:10.20.193.4:6827/2740686484] [v2:10.20.193.4:6828/2740686484,v1:10.20.193.4:6829/2740686484] exists,up b446de8d-9063-4793-ad1f-a3db68e735ff 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.10 up in weight 1 up_from 63 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.14:6824/3870052801,v1:10.20.193.14:6825/3870052801] [v2:10.20.193.14:6826/3870052801,v1:10.20.193.14:6827/3870052801] exists,up 8825787e-e402-47ad-ae91-e3c270aefd15 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:osd.11 up in weight 1 up_from 70 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:10.20.193.90:6824/3154606116,v1:10.20.193.90:6825/3154606116] [v2:10.20.193.90:6826/3154606116,v1:10.20.193.90:6827/3154606116] exists,up 3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:blocklist 10.20.193.4:0/733625572 expires 2026-02-25T09:07:01.644667+0000 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:blocklist 10.20.193.4:6801/1585316508 expires 2026-02-25T09:07:01.644667+0000 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:blocklist 10.20.193.4:0/3431762797 expires 2026-02-25T09:07:01.644667+0000 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:blocklist 10.20.193.4:0/2777942857 expires 2026-02-25T09:07:01.644667+0000 2026-02-24T09:09:45.754 INFO:teuthology.orchestra.run.trial004.stdout:blocklist 10.20.193.4:6801/89142516 expires 2026-02-25T09:06:52.024416+0000 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stdout:blocklist 10.20.193.4:6800/89142516 expires 2026-02-25T09:06:52.024416+0000 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stdout:blocklist 10.20.193.4:0/2450775687 expires 2026-02-25T09:06:52.024416+0000 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stdout:blocklist 10.20.193.4:6800/1585316508 expires 2026-02-25T09:07:01.644667+0000 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stdout:blocklist 10.20.193.4:0/1377200746 expires 2026-02-25T09:06:52.024416+0000 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stdout:blocklist 10.20.193.4:0/3128547937 expires 2026-02-25T09:06:52.024416+0000 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 -- 10.20.193.4:0/1721973043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb5280b5770 msgr2=0x7fb5280d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb5280b5770 0x7fb5280d5c20 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb540004740 tx=0x7fb5400073d0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 -- 10.20.193.4:0/1721973043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb54c10f250 msgr2=0x7fb54c0f88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb54c10f250 0x7fb54c0f88c0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb53c009480 tx=0x7fb53c00ee60 comp rx=0 tx=0).stop 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 -- 10.20.193.4:0/1721973043 shutdown_connections 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb5280b5770 0x7fb5280d5c20 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb54c110d90 0x7fb54c0f9100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb54c1103e0 0x7fb54c171700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 --2- 10.20.193.4:0/1721973043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb54c10f250 0x7fb54c0f88c0 unknown :-1 s=CLOSED pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 -- 10.20.193.4:0/1721973043 >> 10.20.193.4:0/1721973043 conn(0x7fb54c0ec980 msgr2=0x7fb54c0eeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 -- 10.20.193.4:0/1721973043 shutdown_connections 2026-02-24T09:09:45.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:45.752+0000 7fb553b65640 1 -- 10.20.193.4:0/1721973043 wait complete. 2026-02-24T09:09:45.792 INFO:teuthology.run_tasks:Running task fs.ready... 2026-02-24T09:09:45.807 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:45.923 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:45.945 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:45 trial004 ceph-mon[41596]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:45.945 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:45 trial004 ceph-mon[41596]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:45.945 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:45 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/942762140' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2026-02-24T09:09:46.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 -- 10.20.193.4:0/626142154 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f807c10f280 msgr2=0x7f807c10f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 --2- 10.20.193.4:0/626142154 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f807c10f280 0x7f807c10f650 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=12056198103318013037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f806c009950 tx=0x7f806c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 -- 10.20.193.4:0/626142154 shutdown_connections 2026-02-24T09:09:46.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 --2- 10.20.193.4:0/626142154 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f807c115470 0x7f807c175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 --2- 10.20.193.4:0/626142154 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f807c10fc70 0x7f807c114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 --2- 10.20.193.4:0/626142154 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f807c10f280 0x7f807c10f650 unknown :-1 s=CLOSED pgs=385 gs=1 cs=0 l=1 c_cookie=12056198103318013037 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 -- 10.20.193.4:0/626142154 >> 10.20.193.4:0/626142154 conn(0x7f807c05f830 msgr2=0x7f807c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:46.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 -- 10.20.193.4:0/626142154 shutdown_connections 2026-02-24T09:09:46.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 -- 10.20.193.4:0/626142154 wait complete. 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 Processor -- start 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 -- start start 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f807c10f280 0x7f807c11dbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f807c10fc70 0x7f807c11e130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f807c115470 0x7f807c1234b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f807c123ad0 con 0x7f807c115470 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f807c123c40 con 0x7f807c10fc70 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8083ede640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f807c123e00 con 0x7f807c10f280 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8082454640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f807c115470 0x7f807c1234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8082454640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f807c115470 0x7f807c1234b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33638/0 (socket says 10.20.193.4:33638) 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8082454640 1 -- 10.20.193.4:0/3624761147 learned_addr learned my addr 10.20.193.4:0/3624761147 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8081452640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f807c10fc70 0x7f807c11e130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8081c53640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f807c10f280 0x7f807c11dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8082454640 1 -- 10.20.193.4:0/3624761147 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f807c10f280 msgr2=0x7f807c11dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8082454640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f807c10f280 0x7f807c11dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8082454640 1 -- 10.20.193.4:0/3624761147 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f807c10fc70 msgr2=0x7f807c11e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8082454640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f807c10fc70 0x7f807c11e130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.019+0000 7f8082454640 1 -- 10.20.193.4:0/3624761147 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c009570 con 0x7f807c115470 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.020+0000 7f8081c53640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f807c10f280 0x7f807c11dbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.020+0000 7f8082454640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f807c115470 0x7f807c1234b0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f807800e650 tx=0x7f807800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.020+0000 7f806affd640 1 -- 10.20.193.4:0/3624761147 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f807800aa20 con 0x7f807c115470 2026-02-24T09:09:46.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.020+0000 7f8083ede640 1 -- 10.20.193.4:0/3624761147 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807c1240e0 con 0x7f807c115470 2026-02-24T09:09:46.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.020+0000 7f806affd640 1 -- 10.20.193.4:0/3624761147 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f807800ab80 con 0x7f807c115470 2026-02-24T09:09:46.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.020+0000 7f806affd640 1 -- 10.20.193.4:0/3624761147 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8078010760 con 0x7f807c115470 2026-02-24T09:09:46.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.020+0000 7f8083ede640 1 -- 10.20.193.4:0/3624761147 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807c1647e0 con 0x7f807c115470 2026-02-24T09:09:46.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.020+0000 7f8083ede640 1 -- 10.20.193.4:0/3624761147 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807c110560 con 0x7f807c115470 2026-02-24T09:09:46.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.021+0000 7f806affd640 1 -- 10.20.193.4:0/3624761147 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f807800acf0 con 0x7f807c115470 2026-02-24T09:09:46.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.022+0000 7f806affd640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80580b5770 0x7f80580d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.022+0000 7f8081c53640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80580b5770 0x7f80580d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.022+0000 7f806affd640 1 -- 10.20.193.4:0/3624761147 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f80780e80f0 con 0x7f807c115470 2026-02-24T09:09:46.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.022+0000 7f8081c53640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80580b5770 0x7f80580d5c20 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f806c0098a0 tx=0x7f806c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:46.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.023+0000 7f806affd640 1 -- 10.20.193.4:0/3624761147 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f80780aaa40 con 0x7f807c115470 2026-02-24T09:09:46.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:45 trial090 ceph-mon[47278]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:46.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:45 trial090 ceph-mon[47278]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:46.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:45 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/942762140' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2026-02-24T09:09:46.092 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:45 trial014 ceph-mon[46941]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:46.092 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:45 trial014 ceph-mon[46941]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:46.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:45 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/942762140' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2026-02-24T09:09:46.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.157+0000 7f8083ede640 1 -- 10.20.193.4:0/3624761147 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f807c11ed60 con 0x7f807c115470 2026-02-24T09:09:46.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.157+0000 7f806affd640 1 -- 10.20.193.4:0/3624761147 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+11882 (secure 0 0 0) 0x7f80780adbf0 con 0x7f807c115470 2026-02-24T09:09:46.161 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:46.161 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":18,"btime":"2026-02-24T09:09:29:940018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:29.940013+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24637,24625,24620]},"id":1}]} 2026-02-24T09:09:46.161 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 18 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.158+0000 7f8083ede640 1 -- 10.20.193.4:0/3624761147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80580b5770 msgr2=0x7f80580d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.158+0000 7f8083ede640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80580b5770 0x7f80580d5c20 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f806c0098a0 tx=0x7f806c031040 comp rx=0 tx=0).stop 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.158+0000 7f8083ede640 1 -- 10.20.193.4:0/3624761147 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f807c115470 msgr2=0x7f807c1234b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.158+0000 7f8083ede640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f807c115470 0x7f807c1234b0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f807800e650 tx=0x7f807800eb20 comp rx=0 tx=0).stop 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.158+0000 7f8083ede640 1 -- 10.20.193.4:0/3624761147 shutdown_connections 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.158+0000 7f8083ede640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80580b5770 0x7f80580d5c20 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.158+0000 7f8083ede640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f807c115470 0x7f807c1234b0 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.159+0000 7f8083ede640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f807c10fc70 0x7f807c11e130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.159+0000 7f8083ede640 1 --2- 10.20.193.4:0/3624761147 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f807c10f280 0x7f807c11dbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.159+0000 7f8083ede640 1 -- 10.20.193.4:0/3624761147 >> 10.20.193.4:0/3624761147 conn(0x7f807c05f830 msgr2=0x7f807c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.159+0000 7f8083ede640 1 -- 10.20.193.4:0/3624761147 shutdown_connections 2026-02-24T09:09:46.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.159+0000 7f8083ede640 1 -- 10.20.193.4:0/3624761147 wait complete. 2026-02-24T09:09:46.199 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:46.313 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:46.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 -- 10.20.193.4:0/3298636679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2920115470 msgr2=0x7f2920175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 --2- 10.20.193.4:0/3298636679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2920115470 0x7f2920175e40 secure :-1 s=READY pgs=387 gs=1 cs=0 l=1 c_cookie=51401819221008979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f291000aa30 tx=0x7f2910030280 comp rx=0 tx=0).stop 2026-02-24T09:09:46.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 -- 10.20.193.4:0/3298636679 shutdown_connections 2026-02-24T09:09:46.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 --2- 10.20.193.4:0/3298636679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2920115470 0x7f2920175e40 unknown :-1 s=CLOSED pgs=387 gs=1 cs=0 l=1 c_cookie=51401819221008979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 --2- 10.20.193.4:0/3298636679 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292010fc70 0x7f2920114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 --2- 10.20.193.4:0/3298636679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f292010f280 0x7f292010f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 -- 10.20.193.4:0/3298636679 >> 10.20.193.4:0/3298636679 conn(0x7f292005f830 msgr2=0x7f292010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:46.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 -- 10.20.193.4:0/3298636679 shutdown_connections 2026-02-24T09:09:46.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 -- 10.20.193.4:0/3298636679 wait complete. 2026-02-24T09:09:46.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 Processor -- start 2026-02-24T09:09:46.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 -- start start 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292010f280 0x7f292011dbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292010fc70 0x7f292011e0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2920115470 0x7f29201234c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2920123ae0 con 0x7f292010f280 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2920123c50 con 0x7f292010fc70 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f292549f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2920123e10 con 0x7f2920115470 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f291effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292010f280 0x7f292011dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f291effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292010f280 0x7f292011dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33660/0 (socket says 10.20.193.4:33660) 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.416+0000 7f291effd640 1 -- 10.20.193.4:0/2279929458 learned_addr learned my addr 10.20.193.4:0/2279929458 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f291e7fc640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292010fc70 0x7f292011e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f291f7fe640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2920115470 0x7f29201234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f291effd640 1 -- 10.20.193.4:0/2279929458 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2920115470 msgr2=0x7f29201234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f291effd640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2920115470 0x7f29201234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f291effd640 1 -- 10.20.193.4:0/2279929458 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292010fc70 msgr2=0x7f292011e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f291effd640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292010fc70 0x7f292011e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f291effd640 1 -- 10.20.193.4:0/2279929458 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291000a650 con 0x7f292010f280 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f291effd640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292010f280 0x7f292011dbb0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2914005db0 tx=0x7f291400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f28fffff640 1 -- 10.20.193.4:0/2279929458 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2914004500 con 0x7f292010f280 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f28fffff640 1 -- 10.20.193.4:0/2279929458 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2914004d30 con 0x7f292010f280 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f28fffff640 1 -- 10.20.193.4:0/2279929458 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2914005310 con 0x7f292010f280 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f292549f640 1 -- 10.20.193.4:0/2279929458 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29201240f0 con 0x7f292010f280 2026-02-24T09:09:46.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f292549f640 1 -- 10.20.193.4:0/2279929458 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29201647f0 con 0x7f292010f280 2026-02-24T09:09:46.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.417+0000 7f292549f640 1 -- 10.20.193.4:0/2279929458 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2920110560 con 0x7f292010f280 2026-02-24T09:09:46.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.419+0000 7f28fffff640 1 -- 10.20.193.4:0/2279929458 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f29140054a0 con 0x7f292010f280 2026-02-24T09:09:46.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.420+0000 7f28fffff640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f40b57f0 0x7f28f40d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.420+0000 7f291e7fc640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f40b57f0 0x7f28f40d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.420+0000 7f28fffff640 1 -- 10.20.193.4:0/2279929458 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f29140e7080 con 0x7f292010f280 2026-02-24T09:09:46.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.420+0000 7f291e7fc640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f40b57f0 0x7f28f40d5ca0 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2920124550 tx=0x7f2908004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:46.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.421+0000 7f28fffff640 1 -- 10.20.193.4:0/2279929458 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f29140a9a10 con 0x7f292010f280 2026-02-24T09:09:46.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.554+0000 7f292549f640 1 -- 10.20.193.4:0/2279929458 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f292010f650 con 0x7f292010f280 2026-02-24T09:09:46.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.554+0000 7f28fffff640 1 -- 10.20.193.4:0/2279929458 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+11882 (secure 0 0 0) 0x7f29140acbc0 con 0x7f292010f280 2026-02-24T09:09:46.558 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:46.559 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":18,"btime":"2026-02-24T09:09:29:940018+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:29.940013+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24637,24625,24620]},"id":1}]} 2026-02-24T09:09:46.559 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 18 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 -- 10.20.193.4:0/2279929458 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f40b57f0 msgr2=0x7f28f40d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f40b57f0 0x7f28f40d5ca0 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2920124550 tx=0x7f2908004420 comp rx=0 tx=0).stop 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 -- 10.20.193.4:0/2279929458 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292010f280 msgr2=0x7f292011dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292010f280 0x7f292011dbb0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2914005db0 tx=0x7f291400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 -- 10.20.193.4:0/2279929458 shutdown_connections 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f28f40b57f0 0x7f28f40d5ca0 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2920115470 0x7f29201234c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f292010fc70 0x7f292011e0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 --2- 10.20.193.4:0/2279929458 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f292010f280 0x7f292011dbb0 unknown :-1 s=CLOSED pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 -- 10.20.193.4:0/2279929458 >> 10.20.193.4:0/2279929458 conn(0x7f292005f830 msgr2=0x7f292010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 -- 10.20.193.4:0/2279929458 shutdown_connections 2026-02-24T09:09:46.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.555+0000 7f292549f640 1 -- 10.20.193.4:0/2279929458 wait complete. 2026-02-24T09:09:46.595 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:09:46.712 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:46.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.805+0000 7f7d80a09640 1 -- 10.20.193.4:0/1799216328 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d7c10ccc0 msgr2=0x7f7d7c111d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.805+0000 7f7d80a09640 1 --2- 10.20.193.4:0/1799216328 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d7c10ccc0 0x7f7d7c111d10 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=12949377186665013718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d6c009950 tx=0x7f7d6c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.805+0000 7f7d80a09640 1 -- 10.20.193.4:0/1799216328 shutdown_connections 2026-02-24T09:09:46.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.805+0000 7f7d80a09640 1 --2- 10.20.193.4:0/1799216328 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d7c1124c0 0x7f7d7c172e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.805+0000 7f7d80a09640 1 --2- 10.20.193.4:0/1799216328 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d7c10ccc0 0x7f7d7c111d10 unknown :-1 s=CLOSED pgs=389 gs=1 cs=0 l=1 c_cookie=12949377186665013718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.805+0000 7f7d80a09640 1 --2- 10.20.193.4:0/1799216328 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d7c10c2d0 0x7f7d7c10c6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.805+0000 7f7d80a09640 1 -- 10.20.193.4:0/1799216328 >> 10.20.193.4:0/1799216328 conn(0x7f7d7c0e9bc0 msgr2=0x7f7d7c109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:46.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.805+0000 7f7d80a09640 1 -- 10.20.193.4:0/1799216328 shutdown_connections 2026-02-24T09:09:46.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.805+0000 7f7d80a09640 1 -- 10.20.193.4:0/1799216328 wait complete. 2026-02-24T09:09:46.809 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:46 trial004 ceph-mon[41596]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:46.809 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:46 trial004 ceph-mon[41596]: pgmap v147: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2026-02-24T09:09:46.809 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:46 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1721973043' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-24T09:09:46.809 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:46 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3624761147' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:46.809 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:46 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2279929458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d80a09640 1 Processor -- start 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d80a09640 1 -- start start 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d80a09640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d7c10c2d0 0x7f7d7c0f5900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d80a09640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d7c10ccc0 0x7f7d7c172d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d80a09640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d7c1124c0 0x7f7d7c0f6000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d80a09640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7c0fb210 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d80a09640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7c0fb380 con 0x7f7d7c10c2d0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d80a09640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7c0fb540 con 0x7f7d7c1124c0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d7affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d7c10ccc0 0x7f7d7c172d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d7affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d7c10ccc0 0x7f7d7c172d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33690/0 (socket says 10.20.193.4:33690) 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d7affd640 1 -- 10.20.193.4:0/3042032314 learned_addr learned my addr 10.20.193.4:0/3042032314 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d7bfff640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d7c1124c0 0x7f7d7c0f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d7affd640 1 -- 10.20.193.4:0/3042032314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d7c1124c0 msgr2=0x7f7d7c0f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d7affd640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d7c1124c0 0x7f7d7c0f6000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d7affd640 1 -- 10.20.193.4:0/3042032314 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d7c10c2d0 msgr2=0x7f7d7c0f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d7affd640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d7c10c2d0 0x7f7d7c0f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d7affd640 1 -- 10.20.193.4:0/3042032314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c009570 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d7affd640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d7c10ccc0 0x7f7d7c172d90 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d6c0023d0 tx=0x7f7d6c0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d78ff9640 1 -- 10.20.193.4:0/3042032314 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d6c03d070 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d78ff9640 1 -- 10.20.193.4:0/3042032314 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7d6c038920 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d80a09640 1 -- 10.20.193.4:0/3042032314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7c0fb7c0 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d78ff9640 1 -- 10.20.193.4:0/3042032314 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d6c0419d0 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.806+0000 7f7d80a09640 1 -- 10.20.193.4:0/3042032314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d7c0fbc30 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.807+0000 7f7d80a09640 1 -- 10.20.193.4:0/3042032314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d7c10d5b0 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.808+0000 7f7d78ff9640 1 -- 10.20.193.4:0/3042032314 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f7d6c038a90 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.808+0000 7f7d78ff9640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d500b5760 0x7f7d500d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:46.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.809+0000 7f7d78ff9640 1 -- 10.20.193.4:0/3042032314 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f7d6c10b930 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.809+0000 7f7d7b7fe640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d500b5760 0x7f7d500d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:46.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.809+0000 7f7d7b7fe640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d500b5760 0x7f7d500d5c10 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d68005970 tx=0x7f7d68005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:46.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.810+0000 7f7d78ff9640 1 -- 10.20.193.4:0/3042032314 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f7d6c0ce3d0 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.915+0000 7f7d80a09640 1 -- 10.20.193.4:0/3042032314 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d7c0f6a60 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.915+0000 7f7d78ff9640 1 -- 10.20.193.4:0/3042032314 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22231 (secure 0 0 0) 0x7f7d6c0d1580 con 0x7f7d7c10ccc0 2026-02-24T09:09:46.920 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:46.920 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":75,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:26.263940+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:46.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 -- 10.20.193.4:0/3042032314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d500b5760 msgr2=0x7f7d500d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d500b5760 0x7f7d500d5c10 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d68005970 tx=0x7f7d68005900 comp rx=0 tx=0).stop 2026-02-24T09:09:46.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 -- 10.20.193.4:0/3042032314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d7c10ccc0 msgr2=0x7f7d7c172d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:46.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d7c10ccc0 0x7f7d7c172d90 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d6c0023d0 tx=0x7f7d6c0043d0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 -- 10.20.193.4:0/3042032314 shutdown_connections 2026-02-24T09:09:46.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d500b5760 0x7f7d500d5c10 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d7c1124c0 0x7f7d7c0f6000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d7c10ccc0 0x7f7d7c172d90 unknown :-1 s=CLOSED pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 --2- 10.20.193.4:0/3042032314 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d7c10c2d0 0x7f7d7c0f5900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:46.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 -- 10.20.193.4:0/3042032314 >> 10.20.193.4:0/3042032314 conn(0x7f7d7c0e9bc0 msgr2=0x7f7d7c10f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:46.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 -- 10.20.193.4:0/3042032314 shutdown_connections 2026-02-24T09:09:46.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:46.916+0000 7f7d80a09640 1 -- 10.20.193.4:0/3042032314 wait complete. 2026-02-24T09:09:46.959 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-24T09:09:24.652522+0000', 'modified': '2026-02-24T09:09:29.940013+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24637, 'mds_1': 24625, 'mds_2': 24620}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24580': {'gid': 24580, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.90:6833/931807729', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6832', 'nonce': 931807729}, {'type': 'v1', 'addr': '10.20.193.90:6833', 'nonce': 931807729}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24596': {'gid': 24596, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.14:6837/524790199', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.14:6836', 'nonce': 524790199}, {'type': 'v1', 'addr': '10.20.193.14:6837', 'nonce': 524790199}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.90:6835/1296342299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6834', 'nonce': 1296342299}, {'type': 'v1', 'addr': '10.20.193.90:6835', 'nonce': 1296342299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24620': {'gid': 24620, 'name': 'b', 'rank': 2, 'incarnation': 16, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.14:6839/2269480307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.14:6838', 'nonce': 2269480307}, {'type': 'v1', 'addr': '10.20.193.14:6839', 'nonce': 2269480307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'c', 'rank': 1, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.90:6837/4190330264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6836', 'nonce': 4190330264}, {'type': 'v1', 'addr': '10.20.193.90:6837', 'nonce': 4190330264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'i', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.90:6839/2191295378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6838', 'nonce': 2191295378}, {'type': 'v1', 'addr': '10.20.193.90:6839', 'nonce': 2191295378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24637, 'qdb_cluster': [24637, 24625, 24620]} 2026-02-24T09:09:46.959 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2026-02-24T09:09:46.960 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.b status 2026-02-24T09:09:47.077 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:47.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:46 trial090 ceph-mon[47278]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:47.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:46 trial090 ceph-mon[47278]: pgmap v147: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2026-02-24T09:09:47.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:46 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1721973043' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-24T09:09:47.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:46 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3624761147' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:47.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:46 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2279929458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:47.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:46 trial014 ceph-mon[46941]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:47.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:46 trial014 ceph-mon[46941]: pgmap v147: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2026-02-24T09:09:47.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:46 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1721973043' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-24T09:09:47.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:46 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3624761147' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:47.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:46 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2279929458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:47.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2864928221 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4cc1158b0 msgr2=0x7fb4cc176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 --2- 10.20.193.4:0/2864928221 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4cc1158b0 0x7fb4cc176280 secure :-1 s=READY pgs=391 gs=1 cs=0 l=1 c_cookie=940950531576990152 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4bc00aa30 tx=0x7fb4bc030280 comp rx=0 tx=0).stop 2026-02-24T09:09:47.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2864928221 shutdown_connections 2026-02-24T09:09:47.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 --2- 10.20.193.4:0/2864928221 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4cc1158b0 0x7fb4cc176280 unknown :-1 s=CLOSED pgs=391 gs=1 cs=0 l=1 c_cookie=940950531576990152 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 --2- 10.20.193.4:0/2864928221 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4cc1100b0 0x7fb4cc115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 --2- 10.20.193.4:0/2864928221 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4cc10f6c0 0x7fb4cc10fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2864928221 >> 10.20.193.4:0/2864928221 conn(0x7fb4cc0ecfd0 msgr2=0x7fb4cc10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2864928221 shutdown_connections 2026-02-24T09:09:47.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2864928221 wait complete. 2026-02-24T09:09:47.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 Processor -- start 2026-02-24T09:09:47.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 -- start start 2026-02-24T09:09:47.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4cc10f6c0 0x7fb4cc11e060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4cc1100b0 0x7fb4cc11e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4cc1158b0 0x7fb4cc123970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc123f90 con 0x7fb4cc1158b0 2026-02-24T09:09:47.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc124100 con 0x7fb4cc1100b0 2026-02-24T09:09:47.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4d0e94640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc1242c0 con 0x7fb4cc10f6c0 2026-02-24T09:09:47.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4cad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4cc1158b0 0x7fb4cc123970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4cad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4cc1158b0 0x7fb4cc123970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33706/0 (socket says 10.20.193.4:33706) 2026-02-24T09:09:47.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4cad76640 1 -- 10.20.193.4:0/2636105748 learned_addr learned my addr 10.20.193.4:0/2636105748 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.178+0000 7fb4c9d74640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4cc1100b0 0x7fb4cc11e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4ca575640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4cc10f6c0 0x7fb4cc11e060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4cad76640 1 -- 10.20.193.4:0/2636105748 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4cc10f6c0 msgr2=0x7fb4cc11e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4cad76640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4cc10f6c0 0x7fb4cc11e060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4cad76640 1 -- 10.20.193.4:0/2636105748 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4cc1100b0 msgr2=0x7fb4cc11e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4cad76640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4cc1100b0 0x7fb4cc11e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4cad76640 1 -- 10.20.193.4:0/2636105748 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4bc00a650 con 0x7fb4cc1158b0 2026-02-24T09:09:47.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4ca575640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4cc10f6c0 0x7fb4cc11e060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:47.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4cad76640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4cc1158b0 0x7fb4cc123970 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4bc00a330 tx=0x7fb4bc0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4b37fe640 1 -- 10.20.193.4:0/2636105748 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4bc03e070 con 0x7fb4cc1158b0 2026-02-24T09:09:47.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2636105748 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc124540 con 0x7fb4cc1158b0 2026-02-24T09:09:47.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4b37fe640 1 -- 10.20.193.4:0/2636105748 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb4bc0055a0 con 0x7fb4cc1158b0 2026-02-24T09:09:47.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4b37fe640 1 -- 10.20.193.4:0/2636105748 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4bc042a70 con 0x7fb4cc1158b0 2026-02-24T09:09:47.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.179+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2636105748 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc164ca0 con 0x7fb4cc1158b0 2026-02-24T09:09:47.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.181+0000 7fb4b37fe640 1 -- 10.20.193.4:0/2636105748 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fb4bc0050c0 con 0x7fb4cc1158b0 2026-02-24T09:09:47.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.181+0000 7fb4b37fe640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4a40b57f0 0x7fb4a40d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.181+0000 7fb4ca575640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4a40b57f0 0x7fb4a40d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.181+0000 7fb4b37fe640 1 -- 10.20.193.4:0/2636105748 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb4bc10cc40 con 0x7fb4cc1158b0 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.182+0000 7fb4ca575640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4a40b57f0 0x7fb4a40d5ca0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4c0004740 tx=0x7fb4c0005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.182+0000 7fb4d2e8ee00 1 Processor -- start 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.182+0000 7fb4d2e8ee00 1 -- start start 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce208a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce65540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce65a80 0x560cdce85e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560cdcd30d70 con 0x560cdce65a80 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560cdcd2caa0 con 0x560cdce204d0 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560cdcd26c00 con 0x560cdce20de0 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4cad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce65a80 0x560cdce85e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4ca575640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4cad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce65a80 0x560cdce85e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33710/0 (socket says 10.20.193.4:33710) 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4cad76640 1 -- 10.20.193.4:0/3810459088 learned_addr learned my addr 10.20.193.4:0/3810459088 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4c9d74640 1 --2- 10.20.193.4:0/3810459088 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce65540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4cad76640 1 -- 10.20.193.4:0/3810459088 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 msgr2=0x560cdce65540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4cad76640 1 --2- 10.20.193.4:0/3810459088 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce65540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4cad76640 1 -- 10.20.193.4:0/3810459088 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 msgr2=0x560cdce208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4cad76640 1 --2- 10.20.193.4:0/3810459088 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce208a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4cad76640 1 -- 10.20.193.4:0/3810459088 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdccd2300 con 0x560cdce65a80 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4cad76640 1 --2- 10.20.193.4:0/3810459088 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce65a80 0x560cdce85e60 secure :-1 s=READY pgs=393 gs=2 cs=0 l=1 c_cookie=15496378809110463986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4bc10a8c0 tx=0x7fb4bc005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70e326c6deb85f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4b0ff9640 1 -- 10.20.193.4:0/3810459088 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4bc0d2890 con 0x560cdce65a80 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4b0ff9640 1 -- 10.20.193.4:0/3810459088 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb4bc0d3a90 con 0x560cdce65a80 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4b0ff9640 1 -- 10.20.193.4:0/3810459088 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4bc098220 con 0x560cdce65a80 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/3810459088 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce65a80 msgr2=0x560cdce85e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/3810459088 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce65a80 0x560cdce85e60 secure :-1 s=READY pgs=393 gs=2 cs=0 l=1 c_cookie=15496378809110463986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4bc10a8c0 tx=0x7fb4bc005710 comp rx=0 tx=0).stop 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/3810459088 shutdown_connections 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/3810459088 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce65a80 0x560cdce85e60 unknown :-1 s=CLOSED pgs=393 gs=2 cs=0 l=1 c_cookie=15496378809110463986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/3810459088 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce65540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/3810459088 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce208a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/3810459088 >> 10.20.193.4:0/3810459088 conn(0x560cdcd3f480 msgr2=0x560cdce1edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/3810459088 shutdown_connections 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.183+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/3810459088 wait complete. 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4d2e8ee00 1 -- start start 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4d2e8ee00 1 Processor -- start 2026-02-24T09:09:47.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce38710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce20de0 0x560cdce38c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce65a80 0x560cdce3dc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560cdce3e180 con 0x560cdce20de0 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560cdce3e2f0 con 0x560cdce204d0 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560cdce3e4b0 con 0x560cdce65a80 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4c9d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce20de0 0x560cdce38c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4c9d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce20de0 0x560cdce38c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33718/0 (socket says 10.20.193.4:33718) 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.184+0000 7fb4c9d74640 1 -- 10.20.193.4:0/695174634 learned_addr learned my addr 10.20.193.4:0/695174634 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4ca575640 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce38710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4cad76640 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce65a80 0x560cdce3dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4c9d74640 1 -- 10.20.193.4:0/695174634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce65a80 msgr2=0x560cdce3dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4c9d74640 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce65a80 0x560cdce3dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4c9d74640 1 -- 10.20.193.4:0/695174634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 msgr2=0x560cdce38710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4c9d74640 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce38710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4c9d74640 1 -- 10.20.193.4:0/695174634 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdccaa8b0 con 0x560cdce20de0 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4ca575640 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce38710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4c9d74640 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce20de0 0x560cdce38c50 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=13395819507518700467 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4b4002b50 tx=0x7fb4b40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e782de34e67bb3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb47bfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb47bfff640 1 -- 10.20.193.4:0/695174634 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4b401b690 con 0x560cdce20de0 2026-02-24T09:09:47.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb47bfff640 1 -- 10.20.193.4:0/695174634 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb4b4002e60 con 0x560cdce20de0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/695174634 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc164ca0 con 0x560cdce20de0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb47bfff640 1 -- 10.20.193.4:0/695174634 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4b400f3d0 con 0x560cdce20de0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 10 client.15393 _ll_register_callbacks cb 0x560cdcca7f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/695174634 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cdc9b4600 con 0x560cdce20de0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb47bfff640 1 -- 10.20.193.4:0/695174634 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb4b400f560 con 0x560cdce20de0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb47bfff640 1 -- 10.20.193.4:0/695174634 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb4b400f740 con 0x560cdce20de0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 10 client.15393 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/695174634 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x560cdccbc6d0 con 0x560cdce20de0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb47bfff640 1 -- 10.20.193.4:0/695174634 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7fb4b400f960 con 0x560cdce20de0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 10 client.15393 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 10 client.15393 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 20 client.15393 populate_metadata read hostname 'trial004' 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x560cdce63d90 0x560cdce65200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 4 client.15393 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/695174634 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cdcd37d50 con 0x560cdce63d90 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.185+0000 7fb4ca575640 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x560cdce63d90 0x560cdce65200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4ca575640 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x560cdce63d90 0x560cdce65200 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=17914722294271010054 s_cookie=8939398358120281204 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f89de102a7cb6506 server_cookie=7c0f1f7199783474 in_seq=0 out_seq=0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb47bfff640 10 client.15393 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb47bfff640 1 -- 10.20.193.4:0/695174634 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560cdcd37d50 con 0x560cdce63d90 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb47bfff640 10 client.15393 handle_command_reply: tid=0 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 client.15393 shutdown 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/695174634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce20de0 msgr2=0x560cdce38c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce20de0 0x560cdce38c50 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=13395819507518700467 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4b4002b50 tx=0x7fb4b40117b0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/695174634 shutdown_connections 2026-02-24T09:09:47.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x560cdce63d90 0x560cdce65200 crc :-1 s=READY pgs=17 gs=4 cs=0 l=0 c_cookie=17914722294271010054 s_cookie=8939398358120281204 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce65a80 0x560cdce3dc40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce20de0 0x560cdce38c50 unknown :-1 s=CLOSED pgs=394 gs=1 cs=0 l=1 c_cookie=13395819507518700467 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/695174634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce38710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb47bfff640 0 client.15393 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:47.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/695174634 >> 10.20.193.4:0/695174634 conn(0x560cdcd3f480 msgr2=0x560cdce1f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/695174634 shutdown_connections 2026-02-24T09:09:47.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/695174634 wait complete. 2026-02-24T09:09:47.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.186+0000 7fb4d2e8ee00 20 client.15393 trim_cache size 0 max 16384 2026-02-24T09:09:47.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4d2e8ee00 1 Processor -- start 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4d2e8ee00 1 -- start start 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce204d0 0x560cdce1f6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce1fc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce63d90 0x560cdce5e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560cdcd24830 con 0x560cdce204d0 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560cdc9efe60 con 0x560cdce63d90 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560cdcd2caa0 con 0x560cdce20de0 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4ca575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce204d0 0x560cdce1f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4ca575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce204d0 0x560cdce1f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33728/0 (socket says 10.20.193.4:33728) 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4ca575640 1 -- 10.20.193.4:0/1036193323 learned_addr learned my addr 10.20.193.4:0/1036193323 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.195+0000 7fb4c9d74640 1 --2- 10.20.193.4:0/1036193323 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce1fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4ca575640 1 -- 10.20.193.4:0/1036193323 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 msgr2=0x560cdce1fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4ca575640 1 --2- 10.20.193.4:0/1036193323 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce1fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4ca575640 1 -- 10.20.193.4:0/1036193323 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce63d90 msgr2=0x560cdce5e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4ca575640 1 --2- 10.20.193.4:0/1036193323 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce63d90 0x560cdce5e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4ca575640 1 -- 10.20.193.4:0/1036193323 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdce2ace0 con 0x560cdce204d0 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4ca575640 1 --2- 10.20.193.4:0/1036193323 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce204d0 0x560cdce1f6c0 secure :-1 s=READY pgs=395 gs=1 cs=0 l=1 c_cookie=14146980032916704216 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4c00106e0 tx=0x7fb4c0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4542b62d28b4bd8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4964e6640 1 -- 10.20.193.4:0/1036193323 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4c0022040 con 0x560cdce204d0 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4964e6640 1 -- 10.20.193.4:0/1036193323 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb4c0005020 con 0x560cdce204d0 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4964e6640 1 -- 10.20.193.4:0/1036193323 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4c0028320 con 0x560cdce204d0 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1036193323 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce204d0 msgr2=0x560cdce1f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/1036193323 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce204d0 0x560cdce1f6c0 secure :-1 s=READY pgs=395 gs=1 cs=0 l=1 c_cookie=14146980032916704216 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4c00106e0 tx=0x7fb4c0011000 comp rx=0 tx=0).stop 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1036193323 shutdown_connections 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/1036193323 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce63d90 0x560cdce5e070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/1036193323 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce1fc00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/1036193323 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce204d0 0x560cdce1f6c0 unknown :-1 s=CLOSED pgs=395 gs=1 cs=0 l=1 c_cookie=14146980032916704216 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1036193323 >> 10.20.193.4:0/1036193323 conn(0x560cdcd3f480 msgr2=0x560cdce62ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1036193323 shutdown_connections 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1036193323 wait complete. 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.196+0000 7fb4d2e8ee00 1 -- start start 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 Processor -- start 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce3ebb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce3f130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce63d90 0x560cdce43a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560cdce5f810 con 0x560cdce63d90 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560cdce39230 con 0x560cdce204d0 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560cdcd8fc40 con 0x560cdce20de0 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4cad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce63d90 0x560cdce43a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4cad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce63d90 0x560cdce43a50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33740/0 (socket says 10.20.193.4:33740) 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4cad76640 1 -- 10.20.193.4:0/1475444281 learned_addr learned my addr 10.20.193.4:0/1475444281 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4c9d74640 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce3f130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4ca575640 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce3ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4cad76640 1 -- 10.20.193.4:0/1475444281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 msgr2=0x560cdce3f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4cad76640 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce3f130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4cad76640 1 -- 10.20.193.4:0/1475444281 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 msgr2=0x560cdce3ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4cad76640 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce3ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4cad76640 1 -- 10.20.193.4:0/1475444281 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdccb7150 con 0x560cdce63d90 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4cad76640 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce63d90 0x560cdce43a50 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=11658604399741587352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4bc0d0300 tx=0x7fb4bc0cf0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cbaeee7f674f98 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb47bfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb47bfff640 1 -- 10.20.193.4:0/1475444281 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4bc0d8db0 con 0x560cdce63d90 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb47bfff640 1 -- 10.20.193.4:0/1475444281 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb4bc0db390 con 0x560cdce63d90 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1475444281 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c000add0 con 0x560cdce63d90 2026-02-24T09:09:47.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb47bfff640 1 -- 10.20.193.4:0/1475444281 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4bc0ddfc0 con 0x560cdce63d90 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 10 client.15399 _ll_register_callbacks cb 0x560cdcca7f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1475444281 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4bc0d3a90 con 0x560cdce63d90 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb47bfff640 1 -- 10.20.193.4:0/1475444281 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb4bc098220 con 0x560cdce63d90 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb47bfff640 1 -- 10.20.193.4:0/1475444281 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fb4bc098480 con 0x560cdce63d90 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 10 client.15399 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1475444281 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x560cdccaabe0 con 0x560cdce63d90 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb47bfff640 1 -- 10.20.193.4:0/1475444281 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7fb4bc0f0020 con 0x560cdce63d90 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 10 client.15399 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 10 client.15399 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 20 client.15399 populate_metadata read hostname 'trial004' 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x560cdce65a80 0x560cdcf16700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 4 client.15399 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.197+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1475444281 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "status"}) -- 0x560cdc9b1e50 con 0x560cdce65a80 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4ca575640 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x560cdce65a80 0x560cdcf16700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4ca575640 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x560cdce65a80 0x560cdcf16700 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=10605273204489319052 s_cookie=11238957691886875431 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=932d7fca538df28c server_cookie=9bf8cc79668fb327 in_seq=0 out_seq=0 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb47bfff640 10 client.15399 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb47bfff640 1 -- 10.20.193.4:0/1475444281 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1216 (crc 0 0 0) 0x560cdc9b1e50 con 0x560cdce65a80 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb47bfff640 10 client.15399 handle_command_reply: tid=0 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 client.15399 shutdown 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1475444281 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce63d90 msgr2=0x560cdce43a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce63d90 0x560cdce43a50 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=11658604399741587352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4bc0d0300 tx=0x7fb4bc0cf0f0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1475444281 shutdown_connections 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x560cdce65a80 0x560cdcf16700 crc :-1 s=READY pgs=18 gs=4 cs=0 l=0 c_cookie=10605273204489319052 s_cookie=11238957691886875431 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cdce63d90 0x560cdce43a50 unknown :-1 s=CLOSED pgs=396 gs=1 cs=0 l=1 c_cookie=11658604399741587352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb47bfff640 0 client.15399 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cdce20de0 0x560cdce3f130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 --2- 10.20.193.4:0/1475444281 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cdce204d0 0x560cdce3ebb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1475444281 >> 10.20.193.4:0/1475444281 conn(0x560cdcd3f480 msgr2=0x560cdce36b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1475444281 shutdown_connections 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 1 -- 10.20.193.4:0/1475444281 wait complete. 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.198+0000 7fb4d2e8ee00 20 client.15399 trim_cache size 0 max 16384 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "cluster_fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "whoami": 2, 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "id": 24620, 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "want_state": "up:active", 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "state": "up:active", 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "fs_name": "cephfs", 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "rank_uptime": 18.261818898000001, 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "mdsmap_epoch": 18, 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch": 75, 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch_barrier": 75, 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "uptime": 26.5254151, 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "sysinfo": { 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "arch": "x86_64", 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_release": "tentacle", 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:09:47.208 INFO:teuthology.orchestra.run.trial004.stdout: "container_hostname": "trial014", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "distro": "centos", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "distro_version": "9", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": "trial014", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "mem_total_kb": "130438936", 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "os": "Linux" 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout: "endian": "little" 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2636105748 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4a40b57f0 msgr2=0x7fb4a40d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4a40b57f0 0x7fb4a40d5ca0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4c0004740 tx=0x7fb4c0005f00 comp rx=0 tx=0).stop 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2636105748 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4cc1158b0 msgr2=0x7fb4cc123970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4cc1158b0 0x7fb4cc123970 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4bc00a330 tx=0x7fb4bc0039b0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2636105748 shutdown_connections 2026-02-24T09:09:47.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4a40b57f0 0x7fb4a40d5ca0 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb4cc1158b0 0x7fb4cc123970 unknown :-1 s=CLOSED pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb4cc1100b0 0x7fb4cc11e5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 --2- 10.20.193.4:0/2636105748 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb4cc10f6c0 0x7fb4cc11e060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2636105748 >> 10.20.193.4:0/2636105748 conn(0x7fb4cc0ecfd0 msgr2=0x7fb4cc10d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2636105748 shutdown_connections 2026-02-24T09:09:47.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.199+0000 7fb4d0e94640 1 -- 10.20.193.4:0/2636105748 wait complete. 2026-02-24T09:09:47.236 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.c status 2026-02-24T09:09:47.354 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:47.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.461+0000 7fbee8584640 1 -- 10.20.193.4:0/2138002229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbee0115470 msgr2=0x7fbee0175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.461+0000 7fbee8584640 1 --2- 10.20.193.4:0/2138002229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbee0115470 0x7fbee0175e40 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=5156735306567632902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbedc00aa30 tx=0x7fbedc030280 comp rx=0 tx=0).stop 2026-02-24T09:09:47.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.461+0000 7fbee8584640 1 -- 10.20.193.4:0/2138002229 shutdown_connections 2026-02-24T09:09:47.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.461+0000 7fbee8584640 1 --2- 10.20.193.4:0/2138002229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbee0115470 0x7fbee0175e40 unknown :-1 s=CLOSED pgs=397 gs=1 cs=0 l=1 c_cookie=5156735306567632902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.461+0000 7fbee8584640 1 --2- 10.20.193.4:0/2138002229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbee010fc70 0x7fbee0114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.461+0000 7fbee8584640 1 --2- 10.20.193.4:0/2138002229 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbee010f280 0x7fbee010f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.461+0000 7fbee8584640 1 -- 10.20.193.4:0/2138002229 >> 10.20.193.4:0/2138002229 conn(0x7fbee005f830 msgr2=0x7fbee010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.461+0000 7fbee8584640 1 -- 10.20.193.4:0/2138002229 shutdown_connections 2026-02-24T09:09:47.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.461+0000 7fbee8584640 1 -- 10.20.193.4:0/2138002229 wait complete. 2026-02-24T09:09:47.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee8584640 1 Processor -- start 2026-02-24T09:09:47.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee8584640 1 -- start start 2026-02-24T09:09:47.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee8584640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbee010f280 0x7fbee011db50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee8584640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbee010fc70 0x7fbee011e090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee8584640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbee0115470 0x7fbee0123460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee8584640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0123a80 con 0x7fbee010fc70 2026-02-24T09:09:47.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee8584640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0123bf0 con 0x7fbee0115470 2026-02-24T09:09:47.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee8584640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0123db0 con 0x7fbee010f280 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee5af8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbee010fc70 0x7fbee011e090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee5af8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbee010fc70 0x7fbee011e090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33758/0 (socket says 10.20.193.4:33758) 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee5af8640 1 -- 10.20.193.4:0/1687032387 learned_addr learned my addr 10.20.193.4:0/1687032387 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee62f9640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbee010f280 0x7fbee011db50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee6afa640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbee0115470 0x7fbee0123460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee5af8640 1 -- 10.20.193.4:0/1687032387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbee010f280 msgr2=0x7fbee011db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee5af8640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbee010f280 0x7fbee011db50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee5af8640 1 -- 10.20.193.4:0/1687032387 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbee0115470 msgr2=0x7fbee0123460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee5af8640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbee0115470 0x7fbee0123460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee5af8640 1 -- 10.20.193.4:0/1687032387 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc00a650 con 0x7fbee010fc70 2026-02-24T09:09:47.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee6afa640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbee0115470 0x7fbee0123460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:47.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee5af8640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbee010fc70 0x7fbee011e090 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed4005db0 tx=0x7fbed400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbec77fe640 1 -- 10.20.193.4:0/1687032387 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed4004500 con 0x7fbee010fc70 2026-02-24T09:09:47.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbec77fe640 1 -- 10.20.193.4:0/1687032387 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbed4004d30 con 0x7fbee010fc70 2026-02-24T09:09:47.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee8584640 1 -- 10.20.193.4:0/1687032387 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee0124090 con 0x7fbee010fc70 2026-02-24T09:09:47.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbec77fe640 1 -- 10.20.193.4:0/1687032387 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed40053c0 con 0x7fbee010fc70 2026-02-24T09:09:47.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.462+0000 7fbee8584640 1 -- 10.20.193.4:0/1687032387 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee0164790 con 0x7fbee010fc70 2026-02-24T09:09:47.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.464+0000 7fbec77fe640 1 -- 10.20.193.4:0/1687032387 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fbed4005550 con 0x7fbee010fc70 2026-02-24T09:09:47.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.465+0000 7fbec77fe640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbebc0b57f0 0x7fbebc0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.465+0000 7fbee62f9640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbebc0b57f0 0x7fbebc0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.465+0000 7fbec77fe640 1 -- 10.20.193.4:0/1687032387 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fbed40e6c90 con 0x7fbee010fc70 2026-02-24T09:09:47.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.465+0000 7fbee62f9640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbebc0b57f0 0x7fbebc0d5ca0 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed0004740 tx=0x7fbed0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbeea57ee00 1 Processor -- start 2026-02-24T09:09:47.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbeea57ee00 1 -- start start 2026-02-24T09:09:47.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e8298a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e86e540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e86ea80 0x557e3e88ee60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557e3e739d70 con 0x557e3e829de0 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557e3e735aa0 con 0x557e3e86ea80 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557e3e72fc00 con 0x557e3e8294d0 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbee5af8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e86e540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbee5af8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e86e540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33764/0 (socket says 10.20.193.4:33764) 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbee5af8640 1 -- 10.20.193.4:0/2187689203 learned_addr learned my addr 10.20.193.4:0/2187689203 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.466+0000 7fbee62f9640 1 --2- 10.20.193.4:0/2187689203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e8298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbee5af8640 1 -- 10.20.193.4:0/2187689203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 msgr2=0x557e3e8298a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbee5af8640 1 --2- 10.20.193.4:0/2187689203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e8298a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbee5af8640 1 -- 10.20.193.4:0/2187689203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e86ea80 msgr2=0x557e3e88ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbee5af8640 1 --2- 10.20.193.4:0/2187689203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e86ea80 0x557e3e88ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbee5af8640 1 -- 10.20.193.4:0/2187689203 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3e6db300 con 0x557e3e829de0 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbee5af8640 1 --2- 10.20.193.4:0/2187689203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e86e540 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=10807239911902633741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed40e4780 tx=0x7fbed40ad080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fb0770cf615f0d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbec4b0a640 1 -- 10.20.193.4:0/2187689203 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed4020300 con 0x557e3e829de0 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbec4b0a640 1 -- 10.20.193.4:0/2187689203 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbed40ad9d0 con 0x557e3e829de0 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbec4b0a640 1 -- 10.20.193.4:0/2187689203 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed4009a60 con 0x557e3e829de0 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbeea57ee00 1 -- 10.20.193.4:0/2187689203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 msgr2=0x557e3e86e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/2187689203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e86e540 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=10807239911902633741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed40e4780 tx=0x7fbed40ad080 comp rx=0 tx=0).stop 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbeea57ee00 1 -- 10.20.193.4:0/2187689203 shutdown_connections 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/2187689203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e86ea80 0x557e3e88ee60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/2187689203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e86e540 unknown :-1 s=CLOSED pgs=399 gs=1 cs=0 l=1 c_cookie=10807239911902633741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/2187689203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e8298a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbeea57ee00 1 -- 10.20.193.4:0/2187689203 >> 10.20.193.4:0/2187689203 conn(0x557e3e748480 msgr2=0x557e3e827db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbeea57ee00 1 -- 10.20.193.4:0/2187689203 shutdown_connections 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.467+0000 7fbeea57ee00 1 -- 10.20.193.4:0/2187689203 wait complete. 2026-02-24T09:09:47.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbeea57ee00 1 -- start start 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbeea57ee00 1 Processor -- start 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e841a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e841fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e86ea80 0x557e3e846fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557e3e8474e0 con 0x557e3e829de0 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557e3e847650 con 0x557e3e86ea80 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557e3e847810 con 0x557e3e8294d0 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbee5af8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e841fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbee5af8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e841fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33778/0 (socket says 10.20.193.4:33778) 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbee5af8640 1 -- 10.20.193.4:0/578466823 learned_addr learned my addr 10.20.193.4:0/578466823 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.468+0000 7fbee6afa640 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e86ea80 0x557e3e846fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbee62f9640 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e841a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbee5af8640 1 -- 10.20.193.4:0/578466823 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 msgr2=0x557e3e841a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbee5af8640 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e841a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbee5af8640 1 -- 10.20.193.4:0/578466823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e86ea80 msgr2=0x557e3e846fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbee5af8640 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e86ea80 0x557e3e846fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbee5af8640 1 -- 10.20.193.4:0/578466823 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3e6b38b0 con 0x557e3e829de0 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbee6afa640 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e86ea80 0x557e3e846fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbee5af8640 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e841fb0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=4325982055627717274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed40a9790 tx=0x7fbed4009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c08f9c272677a9a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbe93fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbe93fff640 1 -- 10.20.193.4:0/578466823 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed4020300 con 0x557e3e829de0 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbe93fff640 1 -- 10.20.193.4:0/578466823 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbed40b2cf0 con 0x557e3e829de0 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 1 -- 10.20.193.4:0/578466823 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee0164790 con 0x557e3e829de0 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbe93fff640 1 -- 10.20.193.4:0/578466823 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed40adc60 con 0x557e3e829de0 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 10 client.15411 _ll_register_callbacks cb 0x557e3e6b0f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 1 -- 10.20.193.4:0/578466823 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557e3e3bd600 con 0x557e3e829de0 2026-02-24T09:09:47.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbe93fff640 1 -- 10.20.193.4:0/578466823 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fbed40addc0 con 0x557e3e829de0 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbe93fff640 1 -- 10.20.193.4:0/578466823 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fbed40b7c80 con 0x557e3e829de0 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 10 client.15411 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 1 -- 10.20.193.4:0/578466823 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x557e3e6c56d0 con 0x557e3e829de0 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbe93fff640 1 -- 10.20.193.4:0/578466823 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7fbed40d2110 con 0x557e3e829de0 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 10 client.15411 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 10 client.15411 resolve_mds: resolved name 'c' to daemon mds.c 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 20 client.15411 populate_metadata read hostname 'trial004' 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x557e3e86d180 0x557e3e86df20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 4 client.15411 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbeea57ee00 1 -- 10.20.193.4:0/578466823 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e3e740d50 con 0x557e3e86d180 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.469+0000 7fbee62f9640 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x557e3e86d180 0x557e3e86df20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbe93fff640 10 client.15411 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbee62f9640 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x557e3e86d180 0x557e3e86df20 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=2226300972198774877 s_cookie=3973382319832706378 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ee568f05303c85d server_cookie=37244a2b02722d4a in_seq=0 out_seq=0 2026-02-24T09:09:47.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbe93fff640 1 -- 10.20.193.4:0/578466823 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557e3e740d50 con 0x557e3e86d180 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbe93fff640 10 client.15411 handle_command_reply: tid=0 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 client.15411 shutdown 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 -- 10.20.193.4:0/578466823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 msgr2=0x557e3e841fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e841fb0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=4325982055627717274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed40a9790 tx=0x7fbed4009d70 comp rx=0 tx=0).stop 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 -- 10.20.193.4:0/578466823 shutdown_connections 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x557e3e86d180 0x557e3e86df20 crc :-1 s=READY pgs=19 gs=4 cs=0 l=0 c_cookie=2226300972198774877 s_cookie=3973382319832706378 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e86ea80 0x557e3e846fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e829de0 0x557e3e841fb0 unknown :-1 s=CLOSED pgs=400 gs=1 cs=0 l=1 c_cookie=4325982055627717274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/578466823 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e841a70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbe93fff640 0 client.15411 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 -- 10.20.193.4:0/578466823 >> 10.20.193.4:0/578466823 conn(0x557e3e748480 msgr2=0x557e3e8284c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 -- 10.20.193.4:0/578466823 shutdown_connections 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 1 -- 10.20.193.4:0/578466823 wait complete. 2026-02-24T09:09:47.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.470+0000 7fbeea57ee00 20 client.15411 trim_cache size 0 max 16384 2026-02-24T09:09:47.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.479+0000 7fbeea57ee00 1 Processor -- start 2026-02-24T09:09:47.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbeea57ee00 1 -- start start 2026-02-24T09:09:47.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e8294d0 0x557e3e8286c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e829de0 0x557e3e828c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e82c3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557e3e72d830 con 0x557e3e86ea80 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557e3e3f8e60 con 0x557e3e8294d0 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557e3e804820 con 0x557e3e829de0 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee6afa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e82c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee6afa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e82c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33792/0 (socket says 10.20.193.4:33792) 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee6afa640 1 -- 10.20.193.4:0/1370997211 learned_addr learned my addr 10.20.193.4:0/1370997211 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee62f9640 1 --2- 10.20.193.4:0/1370997211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e8294d0 0x557e3e8286c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee5af8640 1 --2- 10.20.193.4:0/1370997211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e829de0 0x557e3e828c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee6afa640 1 -- 10.20.193.4:0/1370997211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e829de0 msgr2=0x557e3e828c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee6afa640 1 --2- 10.20.193.4:0/1370997211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e829de0 0x557e3e828c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee6afa640 1 -- 10.20.193.4:0/1370997211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e8294d0 msgr2=0x557e3e8286c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee6afa640 1 --2- 10.20.193.4:0/1370997211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e8294d0 0x557e3e8286c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee6afa640 1 -- 10.20.193.4:0/1370997211 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3e6c0150 con 0x557e3e86ea80 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbee6afa640 1 --2- 10.20.193.4:0/1370997211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e82c3f0 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=16375860260534705996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbedc00aa30 tx=0x7fbedc006cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e342be24d89b5f4c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbeae4e6640 1 -- 10.20.193.4:0/1370997211 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbedc00a310 con 0x557e3e86ea80 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbeae4e6640 1 -- 10.20.193.4:0/1370997211 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbedc030ae0 con 0x557e3e86ea80 2026-02-24T09:09:47.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.480+0000 7fbeae4e6640 1 -- 10.20.193.4:0/1370997211 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbedc0050c0 con 0x557e3e86ea80 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 -- 10.20.193.4:0/1370997211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 msgr2=0x557e3e82c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/1370997211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e82c3f0 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=16375860260534705996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbedc00aa30 tx=0x7fbedc006cb0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 -- 10.20.193.4:0/1370997211 shutdown_connections 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/1370997211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e82c3f0 unknown :-1 s=CLOSED pgs=401 gs=1 cs=0 l=1 c_cookie=16375860260534705996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/1370997211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e829de0 0x557e3e828c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/1370997211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e8294d0 0x557e3e8286c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 -- 10.20.193.4:0/1370997211 >> 10.20.193.4:0/1370997211 conn(0x557e3e748480 msgr2=0x557e3e841c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 -- 10.20.193.4:0/1370997211 shutdown_connections 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 -- 10.20.193.4:0/1370997211 wait complete. 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 -- start start 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 Processor -- start 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e8466a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e829de0 0x557e3e847fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e8484f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557e3e848a60 con 0x557e3e86ea80 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557e3e848bd0 con 0x557e3e829de0 2026-02-24T09:09:47.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbeea57ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557e3e848d90 con 0x557e3e8294d0 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbee6afa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e8484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbee6afa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e8484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33808/0 (socket says 10.20.193.4:33808) 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbee6afa640 1 -- 10.20.193.4:0/3367512798 learned_addr learned my addr 10.20.193.4:0/3367512798 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbee62f9640 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e8466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbee5af8640 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e829de0 0x557e3e847fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbee6afa640 1 -- 10.20.193.4:0/3367512798 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 msgr2=0x557e3e8466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbee6afa640 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e8466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbee6afa640 1 -- 10.20.193.4:0/3367512798 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e829de0 msgr2=0x557e3e847fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbee6afa640 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e829de0 0x557e3e847fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.481+0000 7fbee6afa640 1 -- 10.20.193.4:0/3367512798 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3e6b3be0 con 0x557e3e86ea80 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbee62f9640 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e8466a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbee5af8640 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e829de0 0x557e3e847fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbee6afa640 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e8484f0 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=11588634810562712900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbedc030790 tx=0x7fbedc030920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d319f603511544 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbe93fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbe93fff640 1 -- 10.20.193.4:0/3367512798 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbedc0050c0 con 0x557e3e86ea80 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbe93fff640 1 -- 10.20.193.4:0/3367512798 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbedc00a310 con 0x557e3e86ea80 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbe93fff640 1 -- 10.20.193.4:0/3367512798 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbedc044cb0 con 0x557e3e86ea80 2026-02-24T09:09:47.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 1 -- 10.20.193.4:0/3367512798 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee01766b0 con 0x557e3e86ea80 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbe93fff640 1 -- 10.20.193.4:0/3367512798 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fbedc044e40 con 0x557e3e86ea80 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbe93fff640 10 client.15417 inactive, discarding osd_map(75..75 src has 1..75) 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 10 client.15417 _ll_register_callbacks cb 0x557e3e6b0f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 1 -- 10.20.193.4:0/3367512798 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed40ad9d0 con 0x557e3e86ea80 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbe93fff640 1 -- 10.20.193.4:0/3367512798 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fbedc0039a0 con 0x557e3e86ea80 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 10 client.15417 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 1 -- 10.20.193.4:0/3367512798 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x557e3e6c5930 con 0x557e3e86ea80 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbe93fff640 1 -- 10.20.193.4:0/3367512798 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7fbedc057030 con 0x557e3e86ea80 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 10 client.15417 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 10 client.15417 resolve_mds: resolved name 'c' to daemon mds.c 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 20 client.15417 populate_metadata read hostname 'trial004' 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x557e3e9205f0 0x557e3e91f300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 4 client.15417 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.482+0000 7fbeea57ee00 1 -- 10.20.193.4:0/3367512798 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "status"}) -- 0x557e3e3bae50 con 0x557e3e9205f0 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.483+0000 7fbee62f9640 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x557e3e9205f0 0x557e3e91f300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.483+0000 7fbee62f9640 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x557e3e9205f0 0x557e3e91f300 crc :-1 s=READY pgs=20 gs=4 cs=0 l=0 c_cookie=6269306216654729276 s_cookie=14895311890045352381 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57010cc9afda703c server_cookie=ceb6c73ec8ce39bd in_seq=0 out_seq=0 2026-02-24T09:09:47.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.483+0000 7fbe93fff640 10 client.15417 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbe93fff640 1 -- 10.20.193.4:0/3367512798 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1218 (crc 0 0 0) 0x557e3e3bae50 con 0x557e3e9205f0 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbe93fff640 10 client.15417 handle_command_reply: tid=0 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 client.15417 shutdown 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 -- 10.20.193.4:0/3367512798 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 msgr2=0x557e3e8484f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e8484f0 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=11588634810562712900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbedc030790 tx=0x7fbedc030920 comp rx=0 tx=0).stop 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 -- 10.20.193.4:0/3367512798 shutdown_connections 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x557e3e9205f0 0x557e3e91f300 crc :-1 s=READY pgs=20 gs=4 cs=0 l=0 c_cookie=6269306216654729276 s_cookie=14895311890045352381 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557e3e86ea80 0x557e3e8484f0 unknown :-1 s=CLOSED pgs=402 gs=1 cs=0 l=1 c_cookie=11588634810562712900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557e3e829de0 0x557e3e847fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbe93fff640 0 client.15417 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 --2- 10.20.193.4:0/3367512798 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557e3e8294d0 0x557e3e8466a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 -- 10.20.193.4:0/3367512798 >> 10.20.193.4:0/3367512798 conn(0x557e3e748480 msgr2=0x557e3e82c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 -- 10.20.193.4:0/3367512798 shutdown_connections 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 1 -- 10.20.193.4:0/3367512798 wait complete. 2026-02-24T09:09:47.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbeea57ee00 20 client.15417 trim_cache size 0 max 16384 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "cluster_fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "whoami": 1, 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "id": 24625, 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "want_state": "up:active", 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "state": "up:active", 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "fs_name": "cephfs", 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "rank_uptime": 19.550706876, 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "mdsmap_epoch": 18, 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch": 75, 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch_barrier": 75, 2026-02-24T09:09:47.494 INFO:teuthology.orchestra.run.trial004.stdout: "uptime": 30.291619006000001, 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "sysinfo": { 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "arch": "x86_64", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_release": "tentacle", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "container_hostname": "trial090", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "distro": "centos", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "distro_version": "9", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": "trial090", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "mem_total_kb": "130438940", 2026-02-24T09:09:47.495 INFO:teuthology.orchestra.run.trial004.stdout: "os": "Linux" 2026-02-24T09:09:47.496 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:09:47.496 INFO:teuthology.orchestra.run.trial004.stdout: "endian": "little" 2026-02-24T09:09:47.496 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:47.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 -- 10.20.193.4:0/1687032387 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbebc0b57f0 msgr2=0x7fbebc0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbebc0b57f0 0x7fbebc0d5ca0 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed0004740 tx=0x7fbed0005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:47.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 -- 10.20.193.4:0/1687032387 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbee010fc70 msgr2=0x7fbee011e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbee010fc70 0x7fbee011e090 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed4005db0 tx=0x7fbed400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 -- 10.20.193.4:0/1687032387 shutdown_connections 2026-02-24T09:09:47.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbebc0b57f0 0x7fbebc0d5ca0 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbee0115470 0x7fbee0123460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbee010fc70 0x7fbee011e090 unknown :-1 s=CLOSED pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 --2- 10.20.193.4:0/1687032387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbee010f280 0x7fbee011db50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 -- 10.20.193.4:0/1687032387 >> 10.20.193.4:0/1687032387 conn(0x7fbee005f830 msgr2=0x7fbee010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 -- 10.20.193.4:0/1687032387 shutdown_connections 2026-02-24T09:09:47.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.484+0000 7fbee8584640 1 -- 10.20.193.4:0/1687032387 wait complete. 2026-02-24T09:09:47.522 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.i status 2026-02-24T09:09:47.638 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:47.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 -- 10.20.193.4:0/656594143 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fefec10d010 msgr2=0x7fefec10d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 --2- 10.20.193.4:0/656594143 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fefec10d010 0x7fefec10d3e0 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=12112063976828434718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe0009950 tx=0x7fefe002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 -- 10.20.193.4:0/656594143 shutdown_connections 2026-02-24T09:09:47.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 --2- 10.20.193.4:0/656594143 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fefec113200 0x7fefec173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 --2- 10.20.193.4:0/656594143 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fefec10da00 0x7fefec112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 --2- 10.20.193.4:0/656594143 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fefec10d010 0x7fefec10d3e0 unknown :-1 s=CLOSED pgs=403 gs=1 cs=0 l=1 c_cookie=12112063976828434718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 -- 10.20.193.4:0/656594143 >> 10.20.193.4:0/656594143 conn(0x7fefec05f830 msgr2=0x7fefec10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 -- 10.20.193.4:0/656594143 shutdown_connections 2026-02-24T09:09:47.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 -- 10.20.193.4:0/656594143 wait complete. 2026-02-24T09:09:47.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 Processor -- start 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.735+0000 7feff108a640 1 -- start start 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7feff108a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fefec10d010 0x7fefec060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7feff108a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fefec10da00 0x7fefec0614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7feff108a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fefec113200 0x7fefec061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7feff108a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fefec163d20 con 0x7fefec10da00 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7feff108a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fefec163e90 con 0x7fefec113200 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7feff108a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fefec164050 con 0x7fefec10d010 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefea575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fefec10da00 0x7fefec0614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefea575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fefec10da00 0x7fefec0614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33818/0 (socket says 10.20.193.4:33818) 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefea575640 1 -- 10.20.193.4:0/895143123 learned_addr learned my addr 10.20.193.4:0/895143123 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefeb577640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fefec113200 0x7fefec061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefea575640 1 -- 10.20.193.4:0/895143123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fefec10d010 msgr2=0x7fefec060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefead76640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fefec10d010 0x7fefec060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefea575640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fefec10d010 0x7fefec060f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefea575640 1 -- 10.20.193.4:0/895143123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fefec113200 msgr2=0x7fefec061a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefea575640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fefec113200 0x7fefec061a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefea575640 1 -- 10.20.193.4:0/895143123 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe0009570 con 0x7fefec10da00 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefead76640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fefec10d010 0x7fefec060f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefea575640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fefec10da00 0x7fefec0614d0 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefd400d950 tx=0x7fefd400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefcbfff640 1 -- 10.20.193.4:0/895143123 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefd4004540 con 0x7fefec10da00 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefcbfff640 1 -- 10.20.193.4:0/895143123 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefd4009d00 con 0x7fefec10da00 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7feff108a640 1 -- 10.20.193.4:0/895143123 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefec164330 con 0x7fefec10da00 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7fefcbfff640 1 -- 10.20.193.4:0/895143123 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefd40106e0 con 0x7fefec10da00 2026-02-24T09:09:47.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.736+0000 7feff108a640 1 -- 10.20.193.4:0/895143123 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefec164850 con 0x7fefec10da00 2026-02-24T09:09:47.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.738+0000 7fefcbfff640 1 -- 10.20.193.4:0/895143123 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fefd40097c0 con 0x7fefec10da00 2026-02-24T09:09:47.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.738+0000 7fefcbfff640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fefc00b57f0 0x7fefc00d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.738+0000 7fefead76640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fefc00b57f0 0x7fefc00d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.738+0000 7fefcbfff640 1 -- 10.20.193.4:0/895143123 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fefd40e6e60 con 0x7fefec10da00 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.739+0000 7fefead76640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fefc00b57f0 0x7fefc00d5ca0 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe00023d0 tx=0x7fefe0031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.740+0000 7feff3084e00 1 Processor -- start 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.740+0000 7feff3084e00 1 -- start start 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba4c8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba91540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0bab1e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558f0b95cd70 con 0x558f0ba4c4d0 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558f0b958aa0 con 0x558f0ba4cde0 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558f0b952c00 con 0x558f0ba91a80 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefead76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba4c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefead76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba4c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33834/0 (socket says 10.20.193.4:33834) 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefead76640 1 -- 10.20.193.4:0/3348748418 learned_addr learned my addr 10.20.193.4:0/3348748418 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefeb577640 1 --2- 10.20.193.4:0/3348748418 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0bab1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefead76640 1 -- 10.20.193.4:0/3348748418 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 msgr2=0x558f0bab1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefead76640 1 --2- 10.20.193.4:0/3348748418 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0bab1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefead76640 1 -- 10.20.193.4:0/3348748418 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 msgr2=0x558f0ba91540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefead76640 1 --2- 10.20.193.4:0/3348748418 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba91540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefead76640 1 -- 10.20.193.4:0/3348748418 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0b8fe300 con 0x558f0ba4c4d0 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefead76640 1 --2- 10.20.193.4:0/3348748418 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba4c8a0 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=5375165203429749081 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe0005e40 tx=0x7fefe003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a986c460f787159 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefb77fe640 1 -- 10.20.193.4:0/3348748418 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe004b070 con 0x558f0ba4c4d0 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefb77fe640 1 -- 10.20.193.4:0/3348748418 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefe0002a00 con 0x558f0ba4c4d0 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7fefb77fe640 1 -- 10.20.193.4:0/3348748418 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe003f070 con 0x558f0ba4c4d0 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 -- 10.20.193.4:0/3348748418 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 msgr2=0x558f0ba4c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 --2- 10.20.193.4:0/3348748418 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba4c8a0 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=5375165203429749081 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe0005e40 tx=0x7fefe003f000 comp rx=0 tx=0).stop 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 -- 10.20.193.4:0/3348748418 shutdown_connections 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 --2- 10.20.193.4:0/3348748418 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0bab1e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 --2- 10.20.193.4:0/3348748418 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba91540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 --2- 10.20.193.4:0/3348748418 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba4c8a0 unknown :-1 s=CLOSED pgs=405 gs=1 cs=0 l=1 c_cookie=5375165203429749081 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 -- 10.20.193.4:0/3348748418 >> 10.20.193.4:0/3348748418 conn(0x558f0b96b480 msgr2=0x558f0ba4adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 -- 10.20.193.4:0/3348748418 shutdown_connections 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.741+0000 7feff3084e00 1 -- 10.20.193.4:0/3348748418 wait complete. 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7feff3084e00 1 -- start start 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7feff3084e00 1 Processor -- start 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7feff3084e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba649a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7feff3084e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba64ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7feff3084e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0ba69ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7feff3084e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558f0ba6a410 con 0x558f0ba4c4d0 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7feff3084e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558f0ba6a580 con 0x558f0ba4cde0 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7feff3084e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558f0ba6a740 con 0x558f0ba91a80 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7fefead76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7fefead76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba649a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33848/0 (socket says 10.20.193.4:33848) 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.742+0000 7fefead76640 1 -- 10.20.193.4:0/1716625152 learned_addr learned my addr 10.20.193.4:0/1716625152 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefea575640 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba64ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefeb577640 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0ba69ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefead76640 1 -- 10.20.193.4:0/1716625152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 msgr2=0x558f0ba69ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefead76640 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0ba69ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefead76640 1 -- 10.20.193.4:0/1716625152 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 msgr2=0x558f0ba64ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefead76640 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba64ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefead76640 1 -- 10.20.193.4:0/1716625152 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0b8d68b0 con 0x558f0ba4c4d0 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefea575640 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba64ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefeb577640 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0ba69ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefead76640 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba649a0 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=5570740062576862143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe0039fd0 tx=0x7fefe0002b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4f3e9265ee63bf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefb4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefb4ff9640 1 -- 10.20.193.4:0/1716625152 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe004b050 con 0x558f0ba4c4d0 2026-02-24T09:09:47.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefb4ff9640 1 -- 10.20.193.4:0/1716625152 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefe002fe50 con 0x558f0ba4c4d0 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefb4ff9640 1 -- 10.20.193.4:0/1716625152 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe00583d0 con 0x558f0ba4c4d0 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 1 -- 10.20.193.4:0/1716625152 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefec174440 con 0x558f0ba4c4d0 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefb4ff9640 1 -- 10.20.193.4:0/1716625152 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fefe0058560 con 0x558f0ba4c4d0 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefb4ff9640 10 client.15429 inactive, discarding osd_map(75..75 src has 1..75) 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 10 client.15429 _ll_register_callbacks cb 0x558f0b8d3f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 1 -- 10.20.193.4:0/1716625152 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558f0b5e0600 con 0x558f0ba4c4d0 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefb4ff9640 1 -- 10.20.193.4:0/1716625152 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fefe003f020 con 0x558f0ba4c4d0 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 10 client.15429 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 1 -- 10.20.193.4:0/1716625152 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x558f0b8e86d0 con 0x558f0ba4c4d0 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefb4ff9640 1 -- 10.20.193.4:0/1716625152 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7fefe0044a60 con 0x558f0ba4c4d0 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 10 client.15429 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 10 client.15429 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 20 client.15429 populate_metadata read hostname 'trial004' 2026-02-24T09:09:47.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558f0ba8fc10 0x558f0ba91080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 4 client.15429 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7feff3084e00 1 -- 10.20.193.4:0/1716625152 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f0b963d50 con 0x558f0ba8fc10 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.743+0000 7fefea575640 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558f0ba8fc10 0x558f0ba91080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7fefea575640 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558f0ba8fc10 0x558f0ba91080 crc :-1 s=READY pgs=20 gs=4 cs=0 l=0 c_cookie=1328236973866033494 s_cookie=9331734355664811753 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=126ed87d8cd32156 server_cookie=8180faf46fb5b6e9 in_seq=0 out_seq=0 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7fefb4ff9640 10 client.15429 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7fefb4ff9640 1 -- 10.20.193.4:0/1716625152 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558f0b963d50 con 0x558f0ba8fc10 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7fefb4ff9640 10 client.15429 handle_command_reply: tid=0 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7feff3084e00 1 client.15429 shutdown 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7feff3084e00 1 -- 10.20.193.4:0/1716625152 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 msgr2=0x558f0ba649a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7feff3084e00 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba649a0 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=5570740062576862143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe0039fd0 tx=0x7fefe0002b70 comp rx=0 tx=0).stop 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7feff3084e00 1 -- 10.20.193.4:0/1716625152 shutdown_connections 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7feff3084e00 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558f0ba8fc10 0x558f0ba91080 crc :-1 s=READY pgs=20 gs=4 cs=0 l=0 c_cookie=1328236973866033494 s_cookie=9331734355664811753 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7feff3084e00 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0ba69ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7feff3084e00 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba64ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7fefb4ff9640 0 client.15429 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:47.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7feff3084e00 1 --2- 10.20.193.4:0/1716625152 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba649a0 unknown :-1 s=CLOSED pgs=406 gs=1 cs=0 l=1 c_cookie=5570740062576862143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.744+0000 7feff3084e00 1 -- 10.20.193.4:0/1716625152 >> 10.20.193.4:0/1716625152 conn(0x558f0b96b480 msgr2=0x558f0ba4b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.745+0000 7feff3084e00 1 -- 10.20.193.4:0/1716625152 shutdown_connections 2026-02-24T09:09:47.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.745+0000 7feff3084e00 1 -- 10.20.193.4:0/1716625152 wait complete. 2026-02-24T09:09:47.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.745+0000 7feff3084e00 20 client.15429 trim_cache size 0 max 16384 2026-02-24T09:09:47.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7feff3084e00 1 Processor -- start 2026-02-24T09:09:47.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7feff3084e00 1 -- start start 2026-02-24T09:09:47.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7feff3084e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba4c4d0 0x558f0ba51b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7feff3084e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4cde0 0x558f0ba61d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7feff3084e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba91a80 0x558f0ba622d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7feff3084e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558f0b950830 con 0x558f0ba4cde0 2026-02-24T09:09:47.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7feff3084e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558f0b61be60 con 0x558f0ba91a80 2026-02-24T09:09:47.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7feff3084e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558f0ba15520 con 0x558f0ba4c4d0 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefea575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4cde0 0x558f0ba61d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefea575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4cde0 0x558f0ba61d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33856/0 (socket says 10.20.193.4:33856) 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefea575640 1 -- 10.20.193.4:0/4272478313 learned_addr learned my addr 10.20.193.4:0/4272478313 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefeb577640 1 --2- 10.20.193.4:0/4272478313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba91a80 0x558f0ba622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefead76640 1 --2- 10.20.193.4:0/4272478313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba4c4d0 0x558f0ba51b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefea575640 1 -- 10.20.193.4:0/4272478313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba4c4d0 msgr2=0x558f0ba51b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefea575640 1 --2- 10.20.193.4:0/4272478313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba4c4d0 0x558f0ba51b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefea575640 1 -- 10.20.193.4:0/4272478313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba91a80 msgr2=0x558f0ba622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefea575640 1 --2- 10.20.193.4:0/4272478313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba91a80 0x558f0ba622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefea575640 1 -- 10.20.193.4:0/4272478313 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0ba56f70 con 0x558f0ba4cde0 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.754+0000 7fefead76640 1 --2- 10.20.193.4:0/4272478313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba4c4d0 0x558f0ba51b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:47.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7fefea575640 1 --2- 10.20.193.4:0/4272478313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4cde0 0x558f0ba61d90 secure :-1 s=READY pgs=407 gs=1 cs=0 l=1 c_cookie=3022384284328161470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefd40a9210 tx=0x7fefd40d2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f1aa7e4a1a70be server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7fefb6ffd640 1 -- 10.20.193.4:0/4272478313 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefd40acb40 con 0x558f0ba4cde0 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7fefb6ffd640 1 -- 10.20.193.4:0/4272478313 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefd40ac960 con 0x558f0ba4cde0 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7fefb6ffd640 1 -- 10.20.193.4:0/4272478313 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefd40acd00 con 0x558f0ba4cde0 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 -- 10.20.193.4:0/4272478313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4cde0 msgr2=0x558f0ba61d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 --2- 10.20.193.4:0/4272478313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4cde0 0x558f0ba61d90 secure :-1 s=READY pgs=407 gs=1 cs=0 l=1 c_cookie=3022384284328161470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefd40a9210 tx=0x7fefd40d2040 comp rx=0 tx=0).stop 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 -- 10.20.193.4:0/4272478313 shutdown_connections 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 --2- 10.20.193.4:0/4272478313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba91a80 0x558f0ba622d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 --2- 10.20.193.4:0/4272478313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4cde0 0x558f0ba61d90 unknown :-1 s=CLOSED pgs=407 gs=1 cs=0 l=1 c_cookie=3022384284328161470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 --2- 10.20.193.4:0/4272478313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba4c4d0 0x558f0ba51b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 -- 10.20.193.4:0/4272478313 >> 10.20.193.4:0/4272478313 conn(0x558f0b96b480 msgr2=0x558f0ba648b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 -- 10.20.193.4:0/4272478313 shutdown_connections 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 -- 10.20.193.4:0/4272478313 wait complete. 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 -- start start 2026-02-24T09:09:47.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.755+0000 7feff3084e00 1 Processor -- start 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba6af70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba6b4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0ba6fe10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558f0ba5c640 con 0x558f0ba4c4d0 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558f0ba8b6d0 con 0x558f0ba4cde0 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558f0b9c0650 con 0x558f0ba91a80 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefead76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba6af70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefead76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba6af70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33858/0 (socket says 10.20.193.4:33858) 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefead76640 1 -- 10.20.193.4:0/2621679053 learned_addr learned my addr 10.20.193.4:0/2621679053 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefeb577640 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0ba6fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefea575640 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba6b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefead76640 1 -- 10.20.193.4:0/2621679053 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 msgr2=0x558f0ba6fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefead76640 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0ba6fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefead76640 1 -- 10.20.193.4:0/2621679053 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 msgr2=0x558f0ba6b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefead76640 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba6b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefead76640 1 -- 10.20.193.4:0/2621679053 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f0b8e3150 con 0x558f0ba4c4d0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefead76640 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba6af70 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=14998503721406756882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe0051ff0 tx=0x7fefe005c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02563ab4cd2f812 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefb4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefb4ff9640 1 -- 10.20.193.4:0/2621679053 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe004b050 con 0x558f0ba4c4d0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefb4ff9640 1 -- 10.20.193.4:0/2621679053 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x558f0b5e0600 con 0x558f0ba4c4d0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefb4ff9640 1 -- 10.20.193.4:0/2621679053 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe003f040 con 0x558f0ba4c4d0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 1 -- 10.20.193.4:0/2621679053 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd40e4e70 con 0x558f0ba4c4d0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefb4ff9640 1 -- 10.20.193.4:0/2621679053 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fefe0043be0 con 0x558f0ba4c4d0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefb4ff9640 10 client.15435 inactive, discarding osd_map(75..75 src has 1..75) 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 10 client.15435 _ll_register_callbacks cb 0x558f0b8d3f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 1 -- 10.20.193.4:0/2621679053 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefe0002a00 con 0x558f0ba4c4d0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7fefb4ff9640 1 -- 10.20.193.4:0/2621679053 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fefe0043da0 con 0x558f0ba4c4d0 2026-02-24T09:09:47.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 10 client.15435 fetch_fsmap learned FSMap version 18 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.756+0000 7feff3084e00 1 -- 10.20.193.4:0/2621679053 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=18}) -- 0x558f0b8d6be0 con 0x558f0ba4c4d0 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7fefb4ff9640 1 -- 10.20.193.4:0/2621679053 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 18) ==== 8346+0+0 (secure 0 0 0) 0x7fefe006e060 con 0x558f0ba4c4d0 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7feff3084e00 10 client.15435 fetch_fsmap finished waiting for FSMap version 18 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7feff3084e00 10 client.15435 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7feff3084e00 20 client.15435 populate_metadata read hostname 'trial004' 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7feff3084e00 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558f0bb437c0 0x558f0bb424d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7feff3084e00 4 client.15435 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7feff3084e00 1 -- 10.20.193.4:0/2621679053 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "status"}) -- 0x558f0b5dde50 con 0x558f0bb437c0 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7fefea575640 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558f0bb437c0 0x558f0bb424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7fefea575640 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558f0bb437c0 0x558f0bb424d0 crc :-1 s=READY pgs=21 gs=4 cs=0 l=0 c_cookie=9385794862051803199 s_cookie=235507198425510686 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82410ab2ef48c03f server_cookie=344b08c9833331e in_seq=0 out_seq=0 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7fefb4ff9640 10 client.15435 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7fefb4ff9640 1 -- 10.20.193.4:0/2621679053 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1218 (crc 0 0 0) 0x558f0b5dde50 con 0x558f0bb437c0 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7fefb4ff9640 10 client.15435 handle_command_reply: tid=0 2026-02-24T09:09:47.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.757+0000 7feff3084e00 1 client.15435 shutdown 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 1 -- 10.20.193.4:0/2621679053 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 msgr2=0x558f0ba6af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba6af70 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=14998503721406756882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe0051ff0 tx=0x7fefe005c000 comp rx=0 tx=0).stop 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 1 -- 10.20.193.4:0/2621679053 shutdown_connections 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558f0bb437c0 0x558f0bb424d0 crc :-1 s=READY pgs=21 gs=4 cs=0 l=0 c_cookie=9385794862051803199 s_cookie=235507198425510686 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f0ba91a80 0x558f0ba6fe10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f0ba4cde0 0x558f0ba6b4b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 1 --2- 10.20.193.4:0/2621679053 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f0ba4c4d0 0x558f0ba6af70 unknown :-1 s=CLOSED pgs=408 gs=1 cs=0 l=1 c_cookie=14998503721406756882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7fefb4ff9640 0 client.15435 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 1 -- 10.20.193.4:0/2621679053 >> 10.20.193.4:0/2621679053 conn(0x558f0b96b480 msgr2=0x558f0ba68d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 1 -- 10.20.193.4:0/2621679053 shutdown_connections 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 1 -- 10.20.193.4:0/2621679053 wait complete. 2026-02-24T09:09:47.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff3084e00 20 client.15435 trim_cache size 0 max 16384 2026-02-24T09:09:47.770 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:47.770 INFO:teuthology.orchestra.run.trial004.stdout: "cluster_fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:09:47.770 INFO:teuthology.orchestra.run.trial004.stdout: "whoami": 0, 2026-02-24T09:09:47.770 INFO:teuthology.orchestra.run.trial004.stdout: "id": 24637, 2026-02-24T09:09:47.770 INFO:teuthology.orchestra.run.trial004.stdout: "want_state": "up:active", 2026-02-24T09:09:47.770 INFO:teuthology.orchestra.run.trial004.stdout: "state": "up:active", 2026-02-24T09:09:47.770 INFO:teuthology.orchestra.run.trial004.stdout: "fs_name": "cephfs", 2026-02-24T09:09:47.770 INFO:teuthology.orchestra.run.trial004.stdout: "rank_uptime": 22.494199573, 2026-02-24T09:09:47.770 INFO:teuthology.orchestra.run.trial004.stdout: "mdsmap_epoch": 18, 2026-02-24T09:09:47.770 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch": 75, 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch_barrier": 75, 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "uptime": 29.189175892000002, 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "sysinfo": { 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "arch": "x86_64", 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_release": "tentacle", 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "container_hostname": "trial090", 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "distro": "centos", 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "distro_version": "9", 2026-02-24T09:09:47.771 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": "trial090", 2026-02-24T09:09:47.772 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-24T09:09:47.772 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-24T09:09:47.772 INFO:teuthology.orchestra.run.trial004.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:09:47.772 INFO:teuthology.orchestra.run.trial004.stdout: "mem_total_kb": "130438940", 2026-02-24T09:09:47.772 INFO:teuthology.orchestra.run.trial004.stdout: "os": "Linux" 2026-02-24T09:09:47.772 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:09:47.772 INFO:teuthology.orchestra.run.trial004.stdout: "endian": "little" 2026-02-24T09:09:47.772 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:47.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 -- 10.20.193.4:0/895143123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fefc00b57f0 msgr2=0x7fefc00d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fefc00b57f0 0x7fefc00d5ca0 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe00023d0 tx=0x7fefe0031040 comp rx=0 tx=0).stop 2026-02-24T09:09:47.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 -- 10.20.193.4:0/895143123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fefec10da00 msgr2=0x7fefec0614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:47.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fefec10da00 0x7fefec0614d0 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefd400d950 tx=0x7fefd400de20 comp rx=0 tx=0).stop 2026-02-24T09:09:47.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 -- 10.20.193.4:0/895143123 shutdown_connections 2026-02-24T09:09:47.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fefc00b57f0 0x7fefc00d5ca0 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fefec113200 0x7fefec061a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fefec10da00 0x7fefec0614d0 unknown :-1 s=CLOSED pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 --2- 10.20.193.4:0/895143123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fefec10d010 0x7fefec060f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:47.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 -- 10.20.193.4:0/895143123 >> 10.20.193.4:0/895143123 conn(0x7fefec05f830 msgr2=0x7fefec10ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:47.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 -- 10.20.193.4:0/895143123 shutdown_connections 2026-02-24T09:09:47.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:47.758+0000 7feff108a640 1 -- 10.20.193.4:0/895143123 wait complete. 2026-02-24T09:09:47.799 INFO:teuthology.run_tasks:Running task kclient... 2026-02-24T09:09:47.837 INFO:tasks.kclient:Mounting kernel clients... 2026-02-24T09:09:47.837 INFO:tasks.kclient:config is {'client.0': {}} 2026-02-24T09:09:47.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:09:47.837 DEBUG:teuthology.orchestra.run.trial004:> ip netns list 2026-02-24T09:09:47.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:09:47.854 DEBUG:teuthology.orchestra.run.trial004:> sudo ip link delete ceph-brx 2026-02-24T09:09:47.917 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:47 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3042032314' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:47.922 INFO:teuthology.orchestra.run.trial004.stderr:Cannot find device "ceph-brx" 2026-02-24T09:09:47.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:09:47.924 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2026-02-24T09:09:47.924 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-24T09:09:47.924 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-24T09:09:47.924 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs ls 2026-02-24T09:09:48.081 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:48.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:47 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3042032314' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:48.092 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:47 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3042032314' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:48.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 -- 10.20.193.4:0/3235114545 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84b810f280 msgr2=0x7f84b810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:48.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 --2- 10.20.193.4:0/3235114545 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84b810f280 0x7f84b810f650 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=6410849403903416517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a8009950 tx=0x7f84a802f190 comp rx=0 tx=0).stop 2026-02-24T09:09:48.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 -- 10.20.193.4:0/3235114545 shutdown_connections 2026-02-24T09:09:48.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 --2- 10.20.193.4:0/3235114545 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84b8115470 0x7f84b8175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:48.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 --2- 10.20.193.4:0/3235114545 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84b810fc70 0x7f84b8114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:48.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 --2- 10.20.193.4:0/3235114545 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84b810f280 0x7f84b810f650 unknown :-1 s=CLOSED pgs=409 gs=1 cs=0 l=1 c_cookie=6410849403903416517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:48.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 -- 10.20.193.4:0/3235114545 >> 10.20.193.4:0/3235114545 conn(0x7f84b805f830 msgr2=0x7f84b810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:48.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 -- 10.20.193.4:0/3235114545 shutdown_connections 2026-02-24T09:09:48.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 -- 10.20.193.4:0/3235114545 wait complete. 2026-02-24T09:09:48.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 Processor -- start 2026-02-24T09:09:48.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 -- start start 2026-02-24T09:09:48.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84b810f280 0x7f84b811dbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:48.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84b810fc70 0x7f84b811e130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:48.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84b8115470 0x7f84b81234b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:48.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8123a40 con 0x7f84b8115470 2026-02-24T09:09:48.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8123bb0 con 0x7f84b810f280 2026-02-24T09:09:48.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bf807640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8123d70 con 0x7f84b810fc70 2026-02-24T09:09:48.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bdd7d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84b8115470 0x7f84b81234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:48.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bdd7d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84b8115470 0x7f84b81234b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33886/0 (socket says 10.20.193.4:33886) 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bdd7d640 1 -- 10.20.193.4:0/3272559861 learned_addr learned my addr 10.20.193.4:0/3272559861 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.176+0000 7f84bcd7b640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84b810fc70 0x7f84b811e130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84bd57c640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84b810f280 0x7f84b811dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84bdd7d640 1 -- 10.20.193.4:0/3272559861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84b810fc70 msgr2=0x7f84b811e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84bdd7d640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84b810fc70 0x7f84b811e130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84bdd7d640 1 -- 10.20.193.4:0/3272559861 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84b810f280 msgr2=0x7f84b811dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84bdd7d640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84b810f280 0x7f84b811dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84bdd7d640 1 -- 10.20.193.4:0/3272559861 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a8009570 con 0x7f84b8115470 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84bdd7d640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84b8115470 0x7f84b81234b0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b400b270 tx=0x7f84b400de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84a67fc640 1 -- 10.20.193.4:0/3272559861 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84b4008cf0 con 0x7f84b8115470 2026-02-24T09:09:48.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84a67fc640 1 -- 10.20.193.4:0/3272559861 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f84b4008e50 con 0x7f84b8115470 2026-02-24T09:09:48.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84bf807640 1 -- 10.20.193.4:0/3272559861 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b8124050 con 0x7f84b8115470 2026-02-24T09:09:48.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84a67fc640 1 -- 10.20.193.4:0/3272559861 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84b40106b0 con 0x7f84b8115470 2026-02-24T09:09:48.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84bf807640 1 -- 10.20.193.4:0/3272559861 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b81647e0 con 0x7f84b8115470 2026-02-24T09:09:48.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.177+0000 7f84bf807640 1 -- 10.20.193.4:0/3272559861 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b8110560 con 0x7f84b8115470 2026-02-24T09:09:48.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.178+0000 7f84a67fc640 1 -- 10.20.193.4:0/3272559861 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f84b40050b0 con 0x7f84b8115470 2026-02-24T09:09:48.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.179+0000 7f84a67fc640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84940b5770 0x7f84940d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:48.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.179+0000 7f84bd57c640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84940b5770 0x7f84940d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:48.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.179+0000 7f84a67fc640 1 -- 10.20.193.4:0/3272559861 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f84b40e7fe0 con 0x7f84b8115470 2026-02-24T09:09:48.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.179+0000 7f84bd57c640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84940b5770 0x7f84940d5c20 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a80023d0 tx=0x7f84a8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:48.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.180+0000 7f84a67fc640 1 -- 10.20.193.4:0/3272559861 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f84b40aa930 con 0x7f84b8115470 2026-02-24T09:09:48.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.311+0000 7f84bf807640 1 -- 10.20.193.4:0/3272559861 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f84b811ed00 con 0x7f84b8115470 2026-02-24T09:09:48.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.311+0000 7f84a67fc640 1 -- 10.20.193.4:0/3272559861 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f84b40adae0 con 0x7f84b8115470 2026-02-24T09:09:48.315 INFO:teuthology.orchestra.run.trial004.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2026-02-24T09:09:48.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 -- 10.20.193.4:0/3272559861 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84940b5770 msgr2=0x7f84940d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:48.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84940b5770 0x7f84940d5c20 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a80023d0 tx=0x7f84a8031040 comp rx=0 tx=0).stop 2026-02-24T09:09:48.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 -- 10.20.193.4:0/3272559861 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84b8115470 msgr2=0x7f84b81234b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:48.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84b8115470 0x7f84b81234b0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b400b270 tx=0x7f84b400de70 comp rx=0 tx=0).stop 2026-02-24T09:09:48.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 -- 10.20.193.4:0/3272559861 shutdown_connections 2026-02-24T09:09:48.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f84940b5770 0x7f84940d5c20 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:48.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84b8115470 0x7f84b81234b0 unknown :-1 s=CLOSED pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:48.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84b810fc70 0x7f84b811e130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:48.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 --2- 10.20.193.4:0/3272559861 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84b810f280 0x7f84b811dbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:48.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 -- 10.20.193.4:0/3272559861 >> 10.20.193.4:0/3272559861 conn(0x7f84b805f830 msgr2=0x7f84b810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:48.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 -- 10.20.193.4:0/3272559861 shutdown_connections 2026-02-24T09:09:48.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48.312+0000 7f84bf807640 1 -- 10.20.193.4:0/3272559861 wait complete. 2026-02-24T09:09:48.353 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2026-02-24T09:09:48.354 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-24T09:09:48.354 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial004.front.sepia.ceph.com 2026-02-24T09:09:48.354 INFO:tasks.cephfs.mount:self.client.name = client.0 2026-02-24T09:09:48.354 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-24T09:09:48.354 INFO:tasks.cephfs.mount:self.cephfs_name = None 2026-02-24T09:09:48.354 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-24T09:09:48.354 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-24T09:09:48.354 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2026-02-24T09:09:48.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:09:48.354 DEBUG:teuthology.orchestra.run.trial004:> ip addr 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: inet 127.0.0.1/8 scope host lo 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: valid_lft forever preferred_lft forever 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: inet6 ::1/128 scope host 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: valid_lft forever preferred_lft forever 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout:2: enp7s0f4u2u2c2: mtu 1500 qdisc fq_codel state UNKNOWN group default qlen 1000 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: link/ether 9a:33:05:46:30:b3 brd ff:ff:ff:ff:ff:ff 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: inet 169.254.3.1/24 brd 169.254.3.255 scope link dynamic noprefixroute enp7s0f4u2u2c2 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: valid_lft 863473sec preferred_lft 863473sec 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: inet6 fe80::9f7b:4aa1:caae:54d7/64 scope link noprefixroute 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: valid_lft forever preferred_lft forever 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout:3: enp1s0f0: mtu 1500 qdisc mq state UP group default qlen 1000 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: link/ether 90:5a:08:77:5e:ae brd ff:ff:ff:ff:ff:ff 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: inet 10.20.193.4/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: valid_lft 824sec preferred_lft 824sec 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: inet6 fe80::925a:8ff:fe77:5eae/64 scope link 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: valid_lft forever preferred_lft forever 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout:4: enp1s0f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2026-02-24T09:09:48.371 INFO:teuthology.orchestra.run.trial004.stdout: link/ether 90:5a:08:77:5e:af brd ff:ff:ff:ff:ff:ff 2026-02-24T09:09:48.372 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-24T09:09:48.372 DEBUG:teuthology.orchestra.run.trial004:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-24T09:09:48.372 DEBUG:teuthology.orchestra.run.trial004:> set -e 2026-02-24T09:09:48.372 DEBUG:teuthology.orchestra.run.trial004:> sudo ip link add name ceph-brx type bridge 2026-02-24T09:09:48.372 DEBUG:teuthology.orchestra.run.trial004:> sudo ip addr flush dev ceph-brx 2026-02-24T09:09:48.372 DEBUG:teuthology.orchestra.run.trial004:> sudo ip link set ceph-brx up 2026-02-24T09:09:48.372 DEBUG:teuthology.orchestra.run.trial004:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-24T09:09:48.372 DEBUG:teuthology.orchestra.run.trial004:> ') 2026-02-24T09:09:48.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:09:48.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:09:48.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:09:48.526 DEBUG:teuthology.orchestra.run.trial004:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-24T09:09:48.592 INFO:teuthology.orchestra.run.trial004.stdout:1 2026-02-24T09:09:48.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:09:48.594 DEBUG:teuthology.orchestra.run.trial004:> ip r 2026-02-24T09:09:48.650 INFO:teuthology.orchestra.run.trial004.stdout:default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.4 metric 102 2026-02-24T09:09:48.651 INFO:teuthology.orchestra.run.trial004.stdout:10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.4 metric 102 2026-02-24T09:09:48.651 INFO:teuthology.orchestra.run.trial004.stdout:169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-24T09:09:48.651 INFO:teuthology.orchestra.run.trial004.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-24T09:09:48.651 DEBUG:teuthology.orchestra.run.trial004:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-24T09:09:48.651 DEBUG:teuthology.orchestra.run.trial004:> set -e 2026-02-24T09:09:48.651 DEBUG:teuthology.orchestra.run.trial004:> sudo iptables -A FORWARD -o enp1s0f0 -i ceph-brx -j ACCEPT 2026-02-24T09:09:48.651 DEBUG:teuthology.orchestra.run.trial004:> sudo iptables -A FORWARD -i enp1s0f0 -o ceph-brx -j ACCEPT 2026-02-24T09:09:48.651 DEBUG:teuthology.orchestra.run.trial004:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0 -j MASQUERADE 2026-02-24T09:09:48.651 DEBUG:teuthology.orchestra.run.trial004:> ') 2026-02-24T09:09:48.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:09:48.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:09:48.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:09:48.872 DEBUG:teuthology.orchestra.run.trial004:> ip netns list 2026-02-24T09:09:48.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:09:48.929 DEBUG:teuthology.orchestra.run.trial004:> ip netns list-id 2026-02-24T09:09:48.984 DEBUG:teuthology.orchestra.run.trial004:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-24T09:09:48.985 DEBUG:teuthology.orchestra.run.trial004:> set -e 2026-02-24T09:09:48.985 DEBUG:teuthology.orchestra.run.trial004:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-24T09:09:48.985 DEBUG:teuthology.orchestra.run.trial004:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2026-02-24T09:09:48.985 DEBUG:teuthology.orchestra.run.trial004:> ') 2026-02-24T09:09:49.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:09:49.066 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:48 trial004 ceph-mon[41596]: pgmap v148: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2026-02-24T09:09:49.066 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:48 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3272559861' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2026-02-24T09:09:49.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:09:49.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:48 trial090 ceph-mon[47278]: pgmap v148: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2026-02-24T09:09:49.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:48 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3272559861' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2026-02-24T09:09:49.086 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.144.1/20 2026-02-24T09:09:49.086 DEBUG:teuthology.orchestra.run.trial004:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-24T09:09:49.086 DEBUG:teuthology.orchestra.run.trial004:> set -e 2026-02-24T09:09:49.086 DEBUG:teuthology.orchestra.run.trial004:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2026-02-24T09:09:49.086 DEBUG:teuthology.orchestra.run.trial004:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-24T09:09:49.087 DEBUG:teuthology.orchestra.run.trial004:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2026-02-24T09:09:49.087 DEBUG:teuthology.orchestra.run.trial004:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2026-02-24T09:09:49.087 DEBUG:teuthology.orchestra.run.trial004:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.159.254 2026-02-24T09:09:49.087 DEBUG:teuthology.orchestra.run.trial004:> ') 2026-02-24T09:09:49.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:48 trial014 ceph-mon[46941]: pgmap v148: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2026-02-24T09:09:49.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:48 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3272559861' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2026-02-24T09:09:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:09:49.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:09:49.219 DEBUG:teuthology.orchestra.run.trial004:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-24T09:09:49.219 DEBUG:teuthology.orchestra.run.trial004:> set -e 2026-02-24T09:09:49.219 DEBUG:teuthology.orchestra.run.trial004:> sudo ip link set brx.0 up 2026-02-24T09:09:49.219 DEBUG:teuthology.orchestra.run.trial004:> sudo ip link set dev brx.0 master ceph-brx 2026-02-24T09:09:49.219 DEBUG:teuthology.orchestra.run.trial004:> ') 2026-02-24T09:09:49.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:09:49.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:09:49.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-24T09:09:49.322 DEBUG:teuthology.orchestra.run.trial004:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2026-02-24T09:09:49.378 INFO:teuthology.orchestra.run.trial004.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2026-02-24T09:09:49.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-24T09:09:49.378 DEBUG:teuthology.orchestra.run.trial004:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2026-02-24T09:09:49.435 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2026-02-24T09:09:49.435 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2026-02-24T09:09:49.435 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/b9a35c6a-b2c2-4a63-877b-bc71ed48210e 2026-02-24T09:09:49.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:09:49.435 DEBUG:teuthology.orchestra.run.trial004:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/b9a35c6a-b2c2-4a63-877b-bc71ed48210e /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2026-02-24T09:09:49.510 INFO:teuthology.orchestra.run.trial004.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2026-02-24T09:09:49.510 INFO:teuthology.orchestra.run.trial004.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2026-02-24T09:09:49.620 INFO:teuthology.orchestra.run.trial004.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2026-02-24T09:09:49.620 INFO:teuthology.orchestra.run.trial004.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2026-02-24T09:09:49.620 INFO:teuthology.orchestra.run.trial004.stdout:mount.ceph: resolved to: "10.20.193.4:3300,10.20.193.14:3300,10.20.193.90:3300" 2026-02-24T09:09:49.620 INFO:teuthology.orchestra.run.trial004.stdout:mount.ceph: trying mount with new device syntax: 0@19e0945d-1160-11f1-92cf-d404e6e7d460.cephfs=/volumes/qa/sv_1/b9a35c6a-b2c2-4a63-877b-bc71ed48210e 2026-02-24T09:09:49.620 INFO:teuthology.orchestra.run.trial004.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=10.20.193.4:3300/10.20.193.14:3300/10.20.193.90:3300" will pass to kernel 2026-02-24T09:09:49.620 INFO:teuthology.orchestra.run.trial004.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2026-02-24T09:09:49.620 INFO:teuthology.orchestra.run.trial004.stdout: You just mounted a file system that supports labels which does not 2026-02-24T09:09:49.620 INFO:teuthology.orchestra.run.trial004.stdout: contain labels, onto an SELinux box. It is likely that confined 2026-02-24T09:09:49.620 INFO:teuthology.orchestra.run.trial004.stdout: applications will generate AVC messages and not be allowed access to 2026-02-24T09:09:49.621 INFO:teuthology.orchestra.run.trial004.stdout: this file system. For more details see restorecon(8) and mount(8). 2026-02-24T09:09:49.622 INFO:tasks.cephfs.kernel_mount:mount command passed 2026-02-24T09:09:49.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:09:49.622 DEBUG:teuthology.orchestra.run.trial004:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2026-02-24T09:09:49.689 DEBUG:teuthology.orchestra.run.trial004:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-24T09:09:49.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-24T09:09:49.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:09:49.776 INFO:teuthology.orchestra.run.trial004.stdout:client25207 2026-02-24T09:09:49.777 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:09:49.777 DEBUG:teuthology.orchestra.run.trial004:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-24T09:09:49.833 DEBUG:teuthology.orchestra.run.trial004:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-24T09:09:49.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-24T09:09:49.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:09:49.917 INFO:teuthology.orchestra.run.trial004.stdout:client25207 2026-02-24T09:09:49.917 DEBUG:teuthology.orchestra.run.trial004:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-24T09:09:49.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-24T09:09:49.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:09:50.000 INFO:teuthology.orchestra.run.trial004.stdout:client25207 2026-02-24T09:09:50.001 DEBUG:teuthology.orchestra.run.trial004:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460.client25207/status') 2026-02-24T09:09:50.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-24T09:09:50.088 INFO:teuthology.orchestra.run.trial004.stdout:instance: client.25207 (3)10.20.193.4:0/581588828 2026-02-24T09:09:50.088 INFO:teuthology.orchestra.run.trial004.stdout:blocklisted: false 2026-02-24T09:09:50.089 INFO:teuthology.orchestra.run.trial004.stderr:0+1 records in 2026-02-24T09:09:50.089 INFO:teuthology.orchestra.run.trial004.stderr:0+1 records out 2026-02-24T09:09:50.089 INFO:teuthology.orchestra.run.trial004.stderr:69 bytes copied, 2.0187e-05 s, 3.4 MB/s 2026-02-24T09:09:50.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-24T09:09:50.094 INFO:teuthology.run_tasks:Running task exec... 2026-02-24T09:09:50.108 INFO:teuthology.task.exec:Executing custom commands... 2026-02-24T09:09:50.108 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial004.front.sepia.ceph.com 2026-02-24T09:09:50.108 DEBUG:teuthology.orchestra.run.trial004:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2026-02-24T09:09:50.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 -- 10.20.193.4:0/4087378634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb2c810f210 msgr2=0x7fb2c810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:50.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 --2- 10.20.193.4:0/4087378634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb2c810f210 0x7fb2c810f600 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=13765039642680675171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2b4009950 tx=0x7fb2b402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 -- 10.20.193.4:0/4087378634 shutdown_connections 2026-02-24T09:09:50.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 --2- 10.20.193.4:0/4087378634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2c8110d50 0x7fb2c81716e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 --2- 10.20.193.4:0/4087378634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb2c81103a0 0x7fb2c8110810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 --2- 10.20.193.4:0/4087378634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb2c810f210 0x7fb2c810f600 unknown :-1 s=CLOSED pgs=411 gs=1 cs=0 l=1 c_cookie=13765039642680675171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 -- 10.20.193.4:0/4087378634 >> 10.20.193.4:0/4087378634 conn(0x7fb2c80ec960 msgr2=0x7fb2c810cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:50.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 -- 10.20.193.4:0/4087378634 shutdown_connections 2026-02-24T09:09:50.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 -- 10.20.193.4:0/4087378634 wait complete. 2026-02-24T09:09:50.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 Processor -- start 2026-02-24T09:09:50.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.199+0000 7fb2ce10c640 1 -- start start 2026-02-24T09:09:50.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2ce10c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb2c810f210 0x7fb2c80f87f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:50.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2ce10c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2c81103a0 0x7fb2c81716e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:50.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2ce10c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb2c8110d50 0x7fb2c80f9050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:50.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2ce10c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c80f9c40 con 0x7fb2c8110d50 2026-02-24T09:09:50.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2ce10c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c80f9db0 con 0x7fb2c810f210 2026-02-24T09:09:50.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2ce10c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c80f9f70 con 0x7fb2c81103a0 2026-02-24T09:09:50.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb2c8110d50 0x7fb2c80f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:50.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb2c8110d50 0x7fb2c80f9050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33910/0 (socket says 10.20.193.4:33910) 2026-02-24T09:09:50.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c7fff640 1 -- 10.20.193.4:0/3027627304 learned_addr learned my addr 10.20.193.4:0/3027627304 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:50.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c77fe640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb2c810f210 0x7fb2c80f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:50.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c6ffd640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2c81103a0 0x7fb2c81716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c7fff640 1 -- 10.20.193.4:0/3027627304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2c81103a0 msgr2=0x7fb2c81716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c7fff640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2c81103a0 0x7fb2c81716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c7fff640 1 -- 10.20.193.4:0/3027627304 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb2c810f210 msgr2=0x7fb2c80f87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c7fff640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb2c810f210 0x7fb2c80f87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c7fff640 1 -- 10.20.193.4:0/3027627304 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b4009570 con 0x7fb2c8110d50 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c7fff640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb2c8110d50 0x7fb2c80f9050 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2bc00f8d0 tx=0x7fb2bc00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c4ff9640 1 -- 10.20.193.4:0/3027627304 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2bc00dce0 con 0x7fb2c8110d50 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c4ff9640 1 -- 10.20.193.4:0/3027627304 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb2bc00de40 con 0x7fb2c8110d50 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2ce10c640 1 -- 10.20.193.4:0/3027627304 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c80fa250 con 0x7fb2c8110d50 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2c4ff9640 1 -- 10.20.193.4:0/3027627304 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2bc011740 con 0x7fb2c8110d50 2026-02-24T09:09:50.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.200+0000 7fb2ce10c640 1 -- 10.20.193.4:0/3027627304 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c80fa750 con 0x7fb2c8110d50 2026-02-24T09:09:50.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.201+0000 7fb2ce10c640 1 -- 10.20.193.4:0/3027627304 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c8060010 con 0x7fb2c8110d50 2026-02-24T09:09:50.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.202+0000 7fb2c4ff9640 1 -- 10.20.193.4:0/3027627304 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fb2bc020060 con 0x7fb2c8110d50 2026-02-24T09:09:50.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.202+0000 7fb2c4ff9640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb29c0b5770 0x7fb29c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:50.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.202+0000 7fb2c4ff9640 1 -- 10.20.193.4:0/3027627304 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb2bc015070 con 0x7fb2c8110d50 2026-02-24T09:09:50.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.202+0000 7fb2c77fe640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb29c0b5770 0x7fb29c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:50.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.203+0000 7fb2c77fe640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb29c0b5770 0x7fb29c0d5c20 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2b40023d0 tx=0x7fb2b4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:50.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.203+0000 7fb2c4ff9640 1 -- 10.20.193.4:0/3027627304 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fb2bc0aa7f0 con 0x7fb2c8110d50 2026-02-24T09:09:50.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.336+0000 7fb2ce10c640 1 -- 10.20.193.4:0/3027627304 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fb2c810f5e0 con 0x7fb2c8110d50 2026-02-24T09:09:50.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.730+0000 7fb2c4ff9640 1 -- 10.20.193.4:0/3027627304 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7fb2bc0d1e60 con 0x7fb2c8110d50 2026-02-24T09:09:50.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 -- 10.20.193.4:0/3027627304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb29c0b5770 msgr2=0x7fb29c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:50.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb29c0b5770 0x7fb29c0d5c20 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2b40023d0 tx=0x7fb2b4031040 comp rx=0 tx=0).stop 2026-02-24T09:09:50.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 -- 10.20.193.4:0/3027627304 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb2c8110d50 msgr2=0x7fb2c80f9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:50.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb2c8110d50 0x7fb2c80f9050 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2bc00f8d0 tx=0x7fb2bc00fda0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 -- 10.20.193.4:0/3027627304 shutdown_connections 2026-02-24T09:09:50.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb29c0b5770 0x7fb29c0d5c20 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb2c8110d50 0x7fb2c80f9050 unknown :-1 s=CLOSED pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2c81103a0 0x7fb2c81716e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 --2- 10.20.193.4:0/3027627304 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb2c810f210 0x7fb2c80f87f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 -- 10.20.193.4:0/3027627304 >> 10.20.193.4:0/3027627304 conn(0x7fb2c80ec960 msgr2=0x7fb2c80ee8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:50.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 -- 10.20.193.4:0/3027627304 shutdown_connections 2026-02-24T09:09:50.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.733+0000 7fb2ce10c640 1 -- 10.20.193.4:0/3027627304 wait complete. 2026-02-24T09:09:50.745 DEBUG:teuthology.orchestra.run.trial004:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.20' 2026-02-24T09:09:50.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.808+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/3688554388 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2bc810f1e0 msgr2=0x7f2bc810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:50.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.808+0000 7f2bcdd0c640 1 --2- 10.20.193.4:0/3688554388 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2bc810f1e0 0x7f2bc810f5d0 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=15717315208371460335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bb4009950 tx=0x7f2bb402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.808+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/3688554388 shutdown_connections 2026-02-24T09:09:50.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.808+0000 7f2bcdd0c640 1 --2- 10.20.193.4:0/3688554388 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2bc8110d20 0x7f2bc81716b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.808+0000 7f2bcdd0c640 1 --2- 10.20.193.4:0/3688554388 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2bc8110370 0x7f2bc81107e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.808+0000 7f2bcdd0c640 1 --2- 10.20.193.4:0/3688554388 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2bc810f1e0 0x7f2bc810f5d0 unknown :-1 s=CLOSED pgs=413 gs=1 cs=0 l=1 c_cookie=15717315208371460335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.808+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/3688554388 >> 10.20.193.4:0/3688554388 conn(0x7f2bc80ec930 msgr2=0x7f2bc810cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:50.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.808+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/3688554388 shutdown_connections 2026-02-24T09:09:50.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/3688554388 wait complete. 2026-02-24T09:09:50.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bcdd0c640 1 Processor -- start 2026-02-24T09:09:50.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bcdd0c640 1 -- start start 2026-02-24T09:09:50.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bcdd0c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2bc810f1e0 0x7f2bc80f88f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:50.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bcdd0c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2bc8110370 0x7f2bc81716b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:50.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bcdd0c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2bc8110d20 0x7f2bc80f9150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:50.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bcdd0c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc80f9d40 con 0x7f2bc8110d20 2026-02-24T09:09:50.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bcdd0c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc80f9eb0 con 0x7f2bc8110370 2026-02-24T09:09:50.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bcdd0c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc80fa070 con 0x7f2bc810f1e0 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2bc8110d20 0x7f2bc80f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2bc8110d20 0x7f2bc80f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33928/0 (socket says 10.20.193.4:33928) 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc7fff640 1 -- 10.20.193.4:0/516268895 learned_addr learned my addr 10.20.193.4:0/516268895 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc6ffd640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2bc8110370 0x7f2bc81716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc77fe640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2bc810f1e0 0x7f2bc80f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc7fff640 1 -- 10.20.193.4:0/516268895 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2bc810f1e0 msgr2=0x7f2bc80f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc7fff640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2bc810f1e0 0x7f2bc80f88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc7fff640 1 -- 10.20.193.4:0/516268895 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2bc8110370 msgr2=0x7f2bc81716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc7fff640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2bc8110370 0x7f2bc81716b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc7fff640 1 -- 10.20.193.4:0/516268895 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb4009570 con 0x7f2bc8110d20 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc6ffd640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2bc8110370 0x7f2bc81716b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:50.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.809+0000 7f2bc7fff640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2bc8110d20 0x7f2bc80f9150 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bbc00e650 tx=0x7f2bbc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:50.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.810+0000 7f2bc4ff9640 1 -- 10.20.193.4:0/516268895 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2bbc00aa20 con 0x7f2bc8110d20 2026-02-24T09:09:50.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.810+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/516268895 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc80fa350 con 0x7f2bc8110d20 2026-02-24T09:09:50.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.810+0000 7f2bc4ff9640 1 -- 10.20.193.4:0/516268895 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2bbc00ab80 con 0x7f2bc8110d20 2026-02-24T09:09:50.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.810+0000 7f2bc4ff9640 1 -- 10.20.193.4:0/516268895 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2bbc0106d0 con 0x7f2bc8110d20 2026-02-24T09:09:50.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.810+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/516268895 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc80fa870 con 0x7f2bc8110d20 2026-02-24T09:09:50.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.810+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/516268895 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc81756c0 con 0x7f2bc8110d20 2026-02-24T09:09:50.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.811+0000 7f2bc4ff9640 1 -- 10.20.193.4:0/516268895 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f2bbc011460 con 0x7f2bc8110d20 2026-02-24T09:09:50.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.812+0000 7f2bc4ff9640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b9c0b5770 0x7f2b9c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:50.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.812+0000 7f2bc77fe640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b9c0b5770 0x7f2b9c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:50.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.812+0000 7f2bc4ff9640 1 -- 10.20.193.4:0/516268895 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f2bbc0e80a0 con 0x7f2bc8110d20 2026-02-24T09:09:50.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.812+0000 7f2bc77fe640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b9c0b5770 0x7f2b9c0d5c20 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bb40023d0 tx=0x7f2bb4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:50.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.813+0000 7f2bc4ff9640 1 -- 10.20.193.4:0/516268895 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f2bbc0aaa30 con 0x7f2bc8110d20 2026-02-24T09:09:50.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.937+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/516268895 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.20", "target": ["mon-mgr", ""]}) -- 0x7f2bc8174e40 con 0x7f2b9c0b5770 2026-02-24T09:09:50.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bc4ff9640 1 -- 10.20.193.4:0/516268895 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f2bc8174e40 con 0x7f2b9c0b5770 2026-02-24T09:09:50.943 INFO:teuthology.orchestra.run.trial004.stdout:{} 2026-02-24T09:09:50.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/516268895 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b9c0b5770 msgr2=0x7f2b9c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:50.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b9c0b5770 0x7f2b9c0d5c20 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bb40023d0 tx=0x7f2bb4031040 comp rx=0 tx=0).stop 2026-02-24T09:09:50.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/516268895 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2bc8110d20 msgr2=0x7f2bc80f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:50.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2bc8110d20 0x7f2bc80f9150 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bbc00e650 tx=0x7f2bbc00eb20 comp rx=0 tx=0).stop 2026-02-24T09:09:50.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/516268895 shutdown_connections 2026-02-24T09:09:50.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b9c0b5770 0x7f2b9c0d5c20 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2bc8110d20 0x7f2bc80f9150 unknown :-1 s=CLOSED pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2bc8110370 0x7f2bc81716b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 --2- 10.20.193.4:0/516268895 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2bc810f1e0 0x7f2bc80f88f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:50.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/516268895 >> 10.20.193.4:0/516268895 conn(0x7f2bc80ec930 msgr2=0x7f2bc80eeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:50.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/516268895 shutdown_connections 2026-02-24T09:09:50.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:50.940+0000 7f2bcdd0c640 1 -- 10.20.193.4:0/516268895 wait complete. 2026-02-24T09:09:50.952 INFO:teuthology.run_tasks:Running task check-counter... 2026-02-24T09:09:50.976 INFO:teuthology.run_tasks:Running task fwd_scrub... 2026-02-24T09:09:50.996 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T09:09:51.019 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:50 trial004 ceph-mon[41596]: pgmap v149: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2026-02-24T09:09:51.019 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:50 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3027627304' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2026-02-24T09:09:51.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.062+0000 7f5d792cc640 1 -- 10.20.193.4:0/3706680285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d7410f1f0 msgr2=0x7f5d7410f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.062+0000 7f5d792cc640 1 --2- 10.20.193.4:0/3706680285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d7410f1f0 0x7f5d7410f5e0 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=6642462449562247992 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d68009950 tx=0x7f5d6802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.062+0000 7f5d792cc640 1 -- 10.20.193.4:0/3706680285 shutdown_connections 2026-02-24T09:09:51.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.062+0000 7f5d792cc640 1 --2- 10.20.193.4:0/3706680285 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d74110d30 0x7f5d741716c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.062+0000 7f5d792cc640 1 --2- 10.20.193.4:0/3706680285 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d74110380 0x7f5d741107f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.062+0000 7f5d792cc640 1 --2- 10.20.193.4:0/3706680285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d7410f1f0 0x7f5d7410f5e0 unknown :-1 s=CLOSED pgs=415 gs=1 cs=0 l=1 c_cookie=6642462449562247992 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.062+0000 7f5d792cc640 1 -- 10.20.193.4:0/3706680285 >> 10.20.193.4:0/3706680285 conn(0x7f5d740ec920 msgr2=0x7f5d7410cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.062+0000 7f5d792cc640 1 -- 10.20.193.4:0/3706680285 shutdown_connections 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.062+0000 7f5d792cc640 1 -- 10.20.193.4:0/3706680285 wait complete. 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.062+0000 7f5d792cc640 1 Processor -- start 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d792cc640 1 -- start start 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d792cc640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d7410f1f0 0x7f5d740f8850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d792cc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d74110380 0x7f5d741716c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d792cc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d74110d30 0x7f5d740f90b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d792cc640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f5d740f9ca0 con 0x7f5d74110380 2026-02-24T09:09:51.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d792cc640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f5d740f9e10 con 0x7f5d7410f1f0 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d792cc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d740f9fd0 con 0x7f5d74110d30 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d727fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d74110380 0x7f5d741716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d727fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d74110380 0x7f5d741716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33942/0 (socket says 10.20.193.4:33942) 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d727fc640 1 -- 10.20.193.4:0/3767946089 learned_addr learned my addr 10.20.193.4:0/3767946089 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d72ffd640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d7410f1f0 0x7f5d740f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d737fe640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d74110d30 0x7f5d740f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d727fc640 1 -- 10.20.193.4:0/3767946089 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d74110d30 msgr2=0x7f5d740f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d727fc640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d74110d30 0x7f5d740f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d727fc640 1 -- 10.20.193.4:0/3767946089 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d7410f1f0 msgr2=0x7f5d740f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d727fc640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d7410f1f0 0x7f5d740f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d727fc640 1 -- 10.20.193.4:0/3767946089 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d68009570 con 0x7f5d74110380 2026-02-24T09:09:51.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d737fe640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d74110d30 0x7f5d740f90b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:51.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d72ffd640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d7410f1f0 0x7f5d740f8850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:51.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d727fc640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d74110380 0x7f5d741716c0 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d5c0072a0 tx=0x7f5d5c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:51.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d53fff640 1 -- 10.20.193.4:0/3767946089 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d5c004500 con 0x7f5d74110380 2026-02-24T09:09:51.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d53fff640 1 -- 10.20.193.4:0/3767946089 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5d5c00bd20 con 0x7f5d74110380 2026-02-24T09:09:51.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d792cc640 1 -- 10.20.193.4:0/3767946089 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d740fa2b0 con 0x7f5d74110380 2026-02-24T09:09:51.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d53fff640 1 -- 10.20.193.4:0/3767946089 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d5c002ea0 con 0x7f5d74110380 2026-02-24T09:09:51.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.063+0000 7f5d792cc640 1 -- 10.20.193.4:0/3767946089 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d740fa7d0 con 0x7f5d74110380 2026-02-24T09:09:51.071 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.064+0000 7f5d792cc640 1 -- 10.20.193.4:0/3767946089 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d741756c0 con 0x7f5d74110380 2026-02-24T09:09:51.072 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.065+0000 7f5d53fff640 1 -- 10.20.193.4:0/3767946089 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f5d5c00b840 con 0x7f5d74110380 2026-02-24T09:09:51.072 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.066+0000 7f5d53fff640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d480b57f0 0x7f5d480d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.066+0000 7f5d72ffd640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d480b57f0 0x7f5d480d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.066+0000 7f5d53fff640 1 -- 10.20.193.4:0/3767946089 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f5d5c0e6c10 con 0x7f5d74110380 2026-02-24T09:09:51.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.066+0000 7f5d72ffd640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d480b57f0 0x7f5d480d5ca0 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d680023d0 tx=0x7f5d68031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:51.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.066+0000 7f5d53fff640 1 -- 10.20.193.4:0/3767946089 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f5d5c0a95a0 con 0x7f5d74110380 2026-02-24T09:09:51.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:50 trial090 ceph-mon[47278]: pgmap v149: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2026-02-24T09:09:51.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:50 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3027627304' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2026-02-24T09:09:51.092 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:50 trial014 ceph-mon[46941]: pgmap v149: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2026-02-24T09:09:51.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:50 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3027627304' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2026-02-24T09:09:51.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.169+0000 7f5d792cc640 1 -- 10.20.193.4:0/3767946089 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d741107f0 con 0x7f5d74110380 2026-02-24T09:09:51.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.170+0000 7f5d53fff640 1 -- 10.20.193.4:0/3767946089 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22231 (secure 0 0 0) 0x7f5d5c0ac750 con 0x7f5d74110380 2026-02-24T09:09:51.174 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:51.174 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":75,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:26.263940+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:51.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 -- 10.20.193.4:0/3767946089 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d480b57f0 msgr2=0x7f5d480d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d480b57f0 0x7f5d480d5ca0 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d680023d0 tx=0x7f5d68031040 comp rx=0 tx=0).stop 2026-02-24T09:09:51.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 -- 10.20.193.4:0/3767946089 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d74110380 msgr2=0x7f5d741716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d74110380 0x7f5d741716c0 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d5c0072a0 tx=0x7f5d5c00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 -- 10.20.193.4:0/3767946089 shutdown_connections 2026-02-24T09:09:51.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d480b57f0 0x7f5d480d5ca0 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d74110d30 0x7f5d740f90b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d74110380 0x7f5d741716c0 unknown :-1 s=CLOSED pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 --2- 10.20.193.4:0/3767946089 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d7410f1f0 0x7f5d740f8850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 -- 10.20.193.4:0/3767946089 >> 10.20.193.4:0/3767946089 conn(0x7f5d740ec920 msgr2=0x7f5d740eeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:51.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 -- 10.20.193.4:0/3767946089 shutdown_connections 2026-02-24T09:09:51.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.171+0000 7f5d792cc640 1 -- 10.20.193.4:0/3767946089 wait complete. 2026-02-24T09:09:51.184 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-24T09:07:59.854959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2026-02-24T09:09:22.406160+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2026-02-24T09:09:23.651007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-24T09:09:51.185 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-24T09:09:51.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 -- 10.20.193.4:0/1013944516 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f92e81103a0 msgr2=0x7f92e8110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 --2- 10.20.193.4:0/1013944516 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f92e81103a0 0x7f92e8110810 secure :-1 s=READY pgs=417 gs=2 cs=0 l=1 c_cookie=7098657229256235022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92d0009950 tx=0x7f92d002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 -- 10.20.193.4:0/1013944516 shutdown_connections 2026-02-24T09:09:51.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 --2- 10.20.193.4:0/1013944516 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f92e8110d50 0x7f92e81716e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 --2- 10.20.193.4:0/1013944516 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f92e81103a0 0x7f92e8110810 unknown :-1 s=CLOSED pgs=417 gs=2 cs=0 l=1 c_cookie=7098657229256235022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 --2- 10.20.193.4:0/1013944516 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f92e810f210 0x7f92e810f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 -- 10.20.193.4:0/1013944516 >> 10.20.193.4:0/1013944516 conn(0x7f92e80ec960 msgr2=0x7f92e810cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 -- 10.20.193.4:0/1013944516 shutdown_connections 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 -- 10.20.193.4:0/1013944516 wait complete. 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 Processor -- start 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 -- start start 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f92e810f210 0x7f92e80f8860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f92e81103a0 0x7f92e81716e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f92e8110d50 0x7f92e80f90c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f92e80f9cb0 con 0x7f92e810f210 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f92e80f9e20 con 0x7f92e8110d50 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ef0b8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f92e80f9fe0 con 0x7f92e81103a0 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ece2d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f92e810f210 0x7f92e80f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ece2d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f92e810f210 0x7f92e80f8860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33950/0 (socket says 10.20.193.4:33950) 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ece2d640 1 -- 10.20.193.4:0/4079401010 learned_addr learned my addr 10.20.193.4:0/4079401010 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.289+0000 7f92ed62e640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f92e8110d50 0x7f92e80f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ece2d640 1 -- 10.20.193.4:0/4079401010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f92e81103a0 msgr2=0x7f92e81716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ece2d640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f92e81103a0 0x7f92e81716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ece2d640 1 -- 10.20.193.4:0/4079401010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f92e8110d50 msgr2=0x7f92e80f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ece2d640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f92e8110d50 0x7f92e80f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ece2d640 1 -- 10.20.193.4:0/4079401010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d0009570 con 0x7f92e810f210 2026-02-24T09:09:51.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ed62e640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f92e8110d50 0x7f92e80f90c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:51.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ece2d640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f92e810f210 0x7f92e80f8860 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92d80072a0 tx=0x7f92d800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:51.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ddffb640 1 -- 10.20.193.4:0/4079401010 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92d8004500 con 0x7f92e810f210 2026-02-24T09:09:51.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ef0b8640 1 -- 10.20.193.4:0/4079401010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e80fa2c0 con 0x7f92e810f210 2026-02-24T09:09:51.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ddffb640 1 -- 10.20.193.4:0/4079401010 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f92d800bd20 con 0x7f92e810f210 2026-02-24T09:09:51.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ddffb640 1 -- 10.20.193.4:0/4079401010 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f92d8002ea0 con 0x7f92e810f210 2026-02-24T09:09:51.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ef0b8640 1 -- 10.20.193.4:0/4079401010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e80fa7e0 con 0x7f92e810f210 2026-02-24T09:09:51.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.290+0000 7f92ef0b8640 1 -- 10.20.193.4:0/4079401010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e8060010 con 0x7f92e810f210 2026-02-24T09:09:51.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.292+0000 7f92ddffb640 1 -- 10.20.193.4:0/4079401010 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f92d800b840 con 0x7f92e810f210 2026-02-24T09:09:51.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.292+0000 7f92ddffb640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f92c40b57f0 0x7f92c40d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.292+0000 7f92dffff640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f92c40b57f0 0x7f92c40d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.292+0000 7f92ddffb640 1 -- 10.20.193.4:0/4079401010 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f92d80e6c10 con 0x7f92e810f210 2026-02-24T09:09:51.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.293+0000 7f92dffff640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f92c40b57f0 0x7f92c40d5ca0 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92d002f6e0 tx=0x7f92d0005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:51.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.293+0000 7f92ddffb640 1 -- 10.20.193.4:0/4079401010 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f92d80a95a0 con 0x7f92e810f210 2026-02-24T09:09:51.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.401+0000 7f92ef0b8640 1 -- 10.20.193.4:0/4079401010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f92e810f600 con 0x7f92e810f210 2026-02-24T09:09:51.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.402+0000 7f92ddffb640 1 -- 10.20.193.4:0/4079401010 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f92d80ac750 con 0x7f92e810f210 2026-02-24T09:09:51.406 INFO:teuthology.orchestra.run.trial004.stdout:pg_num: 1 2026-02-24T09:09:51.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 -- 10.20.193.4:0/4079401010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f92c40b57f0 msgr2=0x7f92c40d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f92c40b57f0 0x7f92c40d5ca0 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92d002f6e0 tx=0x7f92d0005900 comp rx=0 tx=0).stop 2026-02-24T09:09:51.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 -- 10.20.193.4:0/4079401010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f92e810f210 msgr2=0x7f92e80f8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f92e810f210 0x7f92e80f8860 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92d80072a0 tx=0x7f92d800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 -- 10.20.193.4:0/4079401010 shutdown_connections 2026-02-24T09:09:51.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f92c40b57f0 0x7f92c40d5ca0 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f92e8110d50 0x7f92e80f90c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f92e81103a0 0x7f92e81716e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 --2- 10.20.193.4:0/4079401010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f92e810f210 0x7f92e80f8860 unknown :-1 s=CLOSED pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 -- 10.20.193.4:0/4079401010 >> 10.20.193.4:0/4079401010 conn(0x7f92e80ec960 msgr2=0x7f92e80eef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:51.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 -- 10.20.193.4:0/4079401010 shutdown_connections 2026-02-24T09:09:51.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.403+0000 7f92ef0b8640 1 -- 10.20.193.4:0/4079401010 wait complete. 2026-02-24T09:09:51.416 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2026-02-24T09:09:51.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/1142897864 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd0c81103a0 msgr2=0x7fd0c8110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 --2- 10.20.193.4:0/1142897864 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd0c81103a0 0x7fd0c8110810 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=8858573471980886556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b0009950 tx=0x7fd0b002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/1142897864 shutdown_connections 2026-02-24T09:09:51.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 --2- 10.20.193.4:0/1142897864 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd0c8110d50 0x7fd0c81716e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 --2- 10.20.193.4:0/1142897864 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd0c81103a0 0x7fd0c8110810 unknown :-1 s=CLOSED pgs=419 gs=1 cs=0 l=1 c_cookie=8858573471980886556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 --2- 10.20.193.4:0/1142897864 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd0c810f210 0x7fd0c810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/1142897864 >> 10.20.193.4:0/1142897864 conn(0x7fd0c80ec960 msgr2=0x7fd0c810cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:51.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/1142897864 shutdown_connections 2026-02-24T09:09:51.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/1142897864 wait complete. 2026-02-24T09:09:51.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 Processor -- start 2026-02-24T09:09:51.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 -- start start 2026-02-24T09:09:51.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd0c810f210 0x7fd0c80f88a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd0c81103a0 0x7fd0c81716e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd0c8110d50 0x7fd0c80f9100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c80f9cf0 con 0x7fd0c8110d50 2026-02-24T09:09:51.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c80f9e60 con 0x7fd0c810f210 2026-02-24T09:09:51.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cf1a5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c80fa020 con 0x7fd0c81103a0 2026-02-24T09:09:51.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.483+0000 7fd0cd71b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd0c8110d50 0x7fd0c80f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cd71b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd0c8110d50 0x7fd0c80f9100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33974/0 (socket says 10.20.193.4:33974) 2026-02-24T09:09:51.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cd71b640 1 -- 10.20.193.4:0/494143155 learned_addr learned my addr 10.20.193.4:0/494143155 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:51.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0ccf1a640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd0c810f210 0x7fd0c80f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0bffff640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd0c81103a0 0x7fd0c81716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cd71b640 1 -- 10.20.193.4:0/494143155 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd0c81103a0 msgr2=0x7fd0c81716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cd71b640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd0c81103a0 0x7fd0c81716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cd71b640 1 -- 10.20.193.4:0/494143155 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd0c810f210 msgr2=0x7fd0c80f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cd71b640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd0c810f210 0x7fd0c80f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cd71b640 1 -- 10.20.193.4:0/494143155 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b0009570 con 0x7fd0c8110d50 2026-02-24T09:09:51.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0ccf1a640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd0c810f210 0x7fd0c80f88a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:51.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cd71b640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd0c8110d50 0x7fd0c80f9100 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0c4006e90 tx=0x7fd0c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:51.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0bdffb640 1 -- 10.20.193.4:0/494143155 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0c4005500 con 0x7fd0c8110d50 2026-02-24T09:09:51.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0bdffb640 1 -- 10.20.193.4:0/494143155 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0c4005e10 con 0x7fd0c8110d50 2026-02-24T09:09:51.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/494143155 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c80fa300 con 0x7fd0c8110d50 2026-02-24T09:09:51.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0bdffb640 1 -- 10.20.193.4:0/494143155 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0c4003a90 con 0x7fd0c8110d50 2026-02-24T09:09:51.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/494143155 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c80fa780 con 0x7fd0c8110d50 2026-02-24T09:09:51.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.484+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/494143155 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c8060010 con 0x7fd0c8110d50 2026-02-24T09:09:51.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.486+0000 7fd0bdffb640 1 -- 10.20.193.4:0/494143155 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fd0c400c840 con 0x7fd0c8110d50 2026-02-24T09:09:51.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.486+0000 7fd0bdffb640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0a40b5770 0x7fd0a40d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.486+0000 7fd0ccf1a640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0a40b5770 0x7fd0a40d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.487+0000 7fd0bdffb640 1 -- 10.20.193.4:0/494143155 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fd0c40e7df0 con 0x7fd0c8110d50 2026-02-24T09:09:51.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.487+0000 7fd0ccf1a640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0a40b5770 0x7fd0a40d5c20 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b8004740 tx=0x7fd0b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:51.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.487+0000 7fd0bdffb640 1 -- 10.20.193.4:0/494143155 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fd0c40aa740 con 0x7fd0c8110d50 2026-02-24T09:09:51.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.591+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/494143155 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd0c810f600 con 0x7fd0c8110d50 2026-02-24T09:09:51.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.591+0000 7fd0bdffb640 1 -- 10.20.193.4:0/494143155 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7fd0c40ad8f0 con 0x7fd0c8110d50 2026-02-24T09:09:51.595 INFO:teuthology.orchestra.run.trial004.stdout:pg_num: 32 2026-02-24T09:09:51.596 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/494143155 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0a40b5770 msgr2=0x7fd0a40d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.596 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0a40b5770 0x7fd0a40d5c20 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0b8004740 tx=0x7fd0b8005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:51.596 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/494143155 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd0c8110d50 msgr2=0x7fd0c80f9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.596 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd0c8110d50 0x7fd0c80f9100 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0c4006e90 tx=0x7fd0c400edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/494143155 shutdown_connections 2026-02-24T09:09:51.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0a40b5770 0x7fd0a40d5c20 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd0c8110d50 0x7fd0c80f9100 unknown :-1 s=CLOSED pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd0c81103a0 0x7fd0c81716e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 --2- 10.20.193.4:0/494143155 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd0c810f210 0x7fd0c80f88a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/494143155 >> 10.20.193.4:0/494143155 conn(0x7fd0c80ec960 msgr2=0x7fd0c80eef00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:51.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/494143155 shutdown_connections 2026-02-24T09:09:51.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.592+0000 7fd0cf1a5640 1 -- 10.20.193.4:0/494143155 wait complete. 2026-02-24T09:09:51.604 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2026-02-24T09:09:51.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 -- 10.20.193.4:0/377272671 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd86c060da0 msgr2=0x7fd86c061210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 --2- 10.20.193.4:0/377272671 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd86c060da0 0x7fd86c061210 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=11614025923905334450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd854009950 tx=0x7fd85402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 -- 10.20.193.4:0/377272671 shutdown_connections 2026-02-24T09:09:51.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 --2- 10.20.193.4:0/377272671 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd86c151040 0x7fd86c171420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 --2- 10.20.193.4:0/377272671 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd86c060da0 0x7fd86c061210 unknown :-1 s=CLOSED pgs=421 gs=1 cs=0 l=1 c_cookie=11614025923905334450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 --2- 10.20.193.4:0/377272671 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd86c0621d0 0x7fd86c060860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 -- 10.20.193.4:0/377272671 >> 10.20.193.4:0/377272671 conn(0x7fd86c0ea690 msgr2=0x7fd86c10aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 -- 10.20.193.4:0/377272671 shutdown_connections 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 -- 10.20.193.4:0/377272671 wait complete. 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 Processor -- start 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 -- start start 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd86c060da0 0x7fd86c15c8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd86c0621d0 0x7fd86c15cf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd86c151040 0x7fd86c15db10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c15e250 con 0x7fd86c151040 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c15e3c0 con 0x7fd86c0621d0 2026-02-24T09:09:51.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd871394640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c15e580 con 0x7fd86c060da0 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd86b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd86c151040 0x7fd86c15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd86b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd86c151040 0x7fd86c15db10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33992/0 (socket says 10.20.193.4:33992) 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd86b7fe640 1 -- 10.20.193.4:0/3372156098 learned_addr learned my addr 10.20.193.4:0/3372156098 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd86affd640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd86c060da0 0x7fd86c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd86a7fc640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd86c0621d0 0x7fd86c15cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd86b7fe640 1 -- 10.20.193.4:0/3372156098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd86c060da0 msgr2=0x7fd86c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd86b7fe640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd86c060da0 0x7fd86c15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd86b7fe640 1 -- 10.20.193.4:0/3372156098 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd86c0621d0 msgr2=0x7fd86c15cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd86b7fe640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd86c0621d0 0x7fd86c15cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.671+0000 7fd86b7fe640 1 -- 10.20.193.4:0/3372156098 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd854009570 con 0x7fd86c151040 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.672+0000 7fd86b7fe640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd86c151040 0x7fd86c15db10 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd85c006e90 tx=0x7fd85c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:51.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.672+0000 7fd84bfff640 1 -- 10.20.193.4:0/3372156098 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd85c005500 con 0x7fd86c151040 2026-02-24T09:09:51.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.672+0000 7fd84bfff640 1 -- 10.20.193.4:0/3372156098 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd85c005e10 con 0x7fd86c151040 2026-02-24T09:09:51.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.672+0000 7fd871394640 1 -- 10.20.193.4:0/3372156098 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86c15e860 con 0x7fd86c151040 2026-02-24T09:09:51.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.672+0000 7fd84bfff640 1 -- 10.20.193.4:0/3372156098 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd85c003a90 con 0x7fd86c151040 2026-02-24T09:09:51.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.672+0000 7fd871394640 1 -- 10.20.193.4:0/3372156098 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd86c15edd0 con 0x7fd86c151040 2026-02-24T09:09:51.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.672+0000 7fd871394640 1 -- 10.20.193.4:0/3372156098 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd86c060010 con 0x7fd86c151040 2026-02-24T09:09:51.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.673+0000 7fd84bfff640 1 -- 10.20.193.4:0/3372156098 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fd85c00c840 con 0x7fd86c151040 2026-02-24T09:09:51.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.674+0000 7fd84bfff640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8400b5770 0x7fd8400d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:51.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.674+0000 7fd84bfff640 1 -- 10.20.193.4:0/3372156098 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fd85c0e7ce0 con 0x7fd86c151040 2026-02-24T09:09:51.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.674+0000 7fd86affd640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8400b5770 0x7fd8400d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:51.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.674+0000 7fd86affd640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8400b5770 0x7fd8400d5c20 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd860004740 tx=0x7fd860005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:51.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.675+0000 7fd84bfff640 1 -- 10.20.193.4:0/3372156098 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fd85c0aa670 con 0x7fd86c151040 2026-02-24T09:09:51.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.780+0000 7fd871394640 1 -- 10.20.193.4:0/3372156098 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd86c060860 con 0x7fd86c151040 2026-02-24T09:09:51.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.780+0000 7fd84bfff640 1 -- 10.20.193.4:0/3372156098 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7fd85c0ad820 con 0x7fd86c151040 2026-02-24T09:09:51.785 INFO:teuthology.orchestra.run.trial004.stdout:pg_num: 64 2026-02-24T09:09:51.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 -- 10.20.193.4:0/3372156098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8400b5770 msgr2=0x7fd8400d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8400b5770 0x7fd8400d5c20 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd860004740 tx=0x7fd860005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:51.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 -- 10.20.193.4:0/3372156098 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd86c151040 msgr2=0x7fd86c15db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:51.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd86c151040 0x7fd86c15db10 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd85c006e90 tx=0x7fd85c00edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 -- 10.20.193.4:0/3372156098 shutdown_connections 2026-02-24T09:09:51.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8400b5770 0x7fd8400d5c20 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd86c151040 0x7fd86c15db10 unknown :-1 s=CLOSED pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd86c0621d0 0x7fd86c15cf10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 --2- 10.20.193.4:0/3372156098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd86c060da0 0x7fd86c15c8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:51.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 -- 10.20.193.4:0/3372156098 >> 10.20.193.4:0/3372156098 conn(0x7fd86c0ea690 msgr2=0x7fd86c10aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:51.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 -- 10.20.193.4:0/3372156098 shutdown_connections 2026-02-24T09:09:51.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:51.782+0000 7fd871394640 1 -- 10.20.193.4:0/3372156098 wait complete. 2026-02-24T09:09:51.794 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2026-02-24T09:09:51.794 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:51.911 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:52.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.020+0000 7efd001e3640 1 -- 10.20.193.4:0/3997421450 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efcf8061030 msgr2=0x7efcf8061400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.020+0000 7efd001e3640 1 --2- 10.20.193.4:0/3997421450 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efcf8061030 0x7efcf8061400 secure :-1 s=READY pgs=423 gs=1 cs=0 l=1 c_cookie=462433405950384367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efce8009950 tx=0x7efce802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.020+0000 7efd001e3640 1 -- 10.20.193.4:0/3997421450 shutdown_connections 2026-02-24T09:09:52.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.020+0000 7efd001e3640 1 --2- 10.20.193.4:0/3997421450 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efcf81556d0 0x7efcf8175ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.020+0000 7efd001e3640 1 --2- 10.20.193.4:0/3997421450 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efcf8061940 0x7efcf8155190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.020+0000 7efd001e3640 1 --2- 10.20.193.4:0/3997421450 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efcf8061030 0x7efcf8061400 unknown :-1 s=CLOSED pgs=423 gs=1 cs=0 l=1 c_cookie=462433405950384367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.020+0000 7efd001e3640 1 -- 10.20.193.4:0/3997421450 >> 10.20.193.4:0/3997421450 conn(0x7efcf805f830 msgr2=0x7efcf810ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:52.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.020+0000 7efd001e3640 1 -- 10.20.193.4:0/3997421450 shutdown_connections 2026-02-24T09:09:52.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.020+0000 7efd001e3640 1 -- 10.20.193.4:0/3997421450 wait complete. 2026-02-24T09:09:52.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efd001e3640 1 Processor -- start 2026-02-24T09:09:52.026 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:51 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3027627304' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2026-02-24T09:09:52.026 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:51 trial004 ceph-mon[41596]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:09:52.026 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:51 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3767946089' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:52.026 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:51 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4079401010' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:09:52.027 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:51 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/494143155' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-24T09:09:52.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efd001e3640 1 -- start start 2026-02-24T09:09:52.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efd001e3640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efcf8061030 0x7efcf8161d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efd001e3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efcf8061940 0x7efcf81622b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efd001e3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efcf81556d0 0x7efcf8167680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efd001e3640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8167ca0 con 0x7efcf8061940 2026-02-24T09:09:52.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efd001e3640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8167e10 con 0x7efcf8061030 2026-02-24T09:09:52.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efd001e3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8167fd0 con 0x7efcf81556d0 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfd757640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efcf8061940 0x7efcf81622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfd757640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efcf8061940 0x7efcf81622b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34016/0 (socket says 10.20.193.4:34016) 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfd757640 1 -- 10.20.193.4:0/2931161346 learned_addr learned my addr 10.20.193.4:0/2931161346 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfe759640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efcf81556d0 0x7efcf8167680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfdf58640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efcf8061030 0x7efcf8161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfd757640 1 -- 10.20.193.4:0/2931161346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efcf81556d0 msgr2=0x7efcf8167680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfd757640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efcf81556d0 0x7efcf8167680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfd757640 1 -- 10.20.193.4:0/2931161346 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efcf8061030 msgr2=0x7efcf8161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfd757640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efcf8061030 0x7efcf8161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfd757640 1 -- 10.20.193.4:0/2931161346 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce8009570 con 0x7efcf8061940 2026-02-24T09:09:52.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfe759640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efcf81556d0 0x7efcf8167680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efcfd757640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efcf8061940 0x7efcf81622b0 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcec00d950 tx=0x7efcec00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efce6ffd640 1 -- 10.20.193.4:0/2931161346 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcec004540 con 0x7efcf8061940 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efd001e3640 1 -- 10.20.193.4:0/2931161346 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf81682b0 con 0x7efcf8061940 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efce6ffd640 1 -- 10.20.193.4:0/2931161346 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efcec009d00 con 0x7efcf8061940 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efce6ffd640 1 -- 10.20.193.4:0/2931161346 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcec0106e0 con 0x7efcf8061940 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.021+0000 7efd001e3640 1 -- 10.20.193.4:0/2931161346 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf81512f0 con 0x7efcf8061940 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.022+0000 7efd001e3640 1 -- 10.20.193.4:0/2931161346 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf8062540 con 0x7efcf8061940 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.023+0000 7efce6ffd640 1 -- 10.20.193.4:0/2931161346 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7efcec0027c0 con 0x7efcf8061940 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.024+0000 7efce6ffd640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efcd40b5770 0x7efcd40d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.024+0000 7efce6ffd640 1 -- 10.20.193.4:0/2931161346 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7efcec0e72e0 con 0x7efcf8061940 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.024+0000 7efcfdf58640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efcd40b5770 0x7efcd40d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.024+0000 7efcfdf58640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efcd40b5770 0x7efcd40d5c20 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efce80023d0 tx=0x7efce8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:52.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.025+0000 7efce6ffd640 1 -- 10.20.193.4:0/2931161346 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7efcec0a9c70 con 0x7efcf8061940 2026-02-24T09:09:52.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:51 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3027627304' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2026-02-24T09:09:52.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:51 trial090 ceph-mon[47278]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:09:52.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:51 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3767946089' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:52.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:51 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4079401010' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:09:52.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:51 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/494143155' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-24T09:09:52.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:51 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3027627304' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2026-02-24T09:09:52.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:51 trial014 ceph-mon[46941]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2026-02-24T09:09:52.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:51 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3767946089' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:52.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:51 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4079401010' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:09:52.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:51 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/494143155' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-24T09:09:52.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.159+0000 7efd001e3640 1 -- 10.20.193.4:0/2931161346 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcf8061400 con 0x7efcf8061940 2026-02-24T09:09:52.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.159+0000 7efce6ffd640 1 -- 10.20.193.4:0/2931161346 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7efcec0ace20 con 0x7efcf8061940 2026-02-24T09:09:52.162 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:52.162 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:09:52.163 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:09:52.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 -- 10.20.193.4:0/2931161346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efcd40b5770 msgr2=0x7efcd40d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efcd40b5770 0x7efcd40d5c20 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efce80023d0 tx=0x7efce8031040 comp rx=0 tx=0).stop 2026-02-24T09:09:52.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 -- 10.20.193.4:0/2931161346 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efcf8061940 msgr2=0x7efcf81622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efcf8061940 0x7efcf81622b0 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcec00d950 tx=0x7efcec00de20 comp rx=0 tx=0).stop 2026-02-24T09:09:52.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 -- 10.20.193.4:0/2931161346 shutdown_connections 2026-02-24T09:09:52.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efcd40b5770 0x7efcd40d5c20 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efcf81556d0 0x7efcf8167680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efcf8061940 0x7efcf81622b0 unknown :-1 s=CLOSED pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 --2- 10.20.193.4:0/2931161346 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efcf8061030 0x7efcf8161d70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 -- 10.20.193.4:0/2931161346 >> 10.20.193.4:0/2931161346 conn(0x7efcf805f830 msgr2=0x7efcf810ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:52.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 -- 10.20.193.4:0/2931161346 shutdown_connections 2026-02-24T09:09:52.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.160+0000 7efd001e3640 1 -- 10.20.193.4:0/2931161346 wait complete. 2026-02-24T09:09:52.202 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2026-02-24T09:09:52.203 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2026-02-24T09:09:52.203 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T09:09:52.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.270+0000 7f6e963c9640 1 -- 10.20.193.4:0/4162769238 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6e9010f060 msgr2=0x7f6e9010f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.270+0000 7f6e963c9640 1 --2- 10.20.193.4:0/4162769238 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6e9010f060 0x7f6e9010f450 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=4278793561428248243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e80009950 tx=0x7f6e8002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.270+0000 7f6e963c9640 1 -- 10.20.193.4:0/4162769238 shutdown_connections 2026-02-24T09:09:52.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.270+0000 7f6e963c9640 1 --2- 10.20.193.4:0/4162769238 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6e90110ba0 0x7f6e90171530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.270+0000 7f6e963c9640 1 --2- 10.20.193.4:0/4162769238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6e901101f0 0x7f6e90110660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.270+0000 7f6e963c9640 1 --2- 10.20.193.4:0/4162769238 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6e9010f060 0x7f6e9010f450 unknown :-1 s=CLOSED pgs=425 gs=1 cs=0 l=1 c_cookie=4278793561428248243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 -- 10.20.193.4:0/4162769238 >> 10.20.193.4:0/4162769238 conn(0x7f6e900ec7b0 msgr2=0x7f6e9010cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:52.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 -- 10.20.193.4:0/4162769238 shutdown_connections 2026-02-24T09:09:52.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 -- 10.20.193.4:0/4162769238 wait complete. 2026-02-24T09:09:52.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 Processor -- start 2026-02-24T09:09:52.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 -- start start 2026-02-24T09:09:52.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6e9010f060 0x7f6e900f86e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6e901101f0 0x7f6e90171530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6e90110ba0 0x7f6e900f8f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900f9b30 con 0x7f6e90110ba0 2026-02-24T09:09:52.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900f9ca0 con 0x7f6e9010f060 2026-02-24T09:09:52.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900f9e60 con 0x7f6e901101f0 2026-02-24T09:09:52.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e95bc8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6e90110ba0 0x7f6e900f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e95bc8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6e90110ba0 0x7f6e900f8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34032/0 (socket says 10.20.193.4:34032) 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e95bc8640 1 -- 10.20.193.4:0/836111945 learned_addr learned my addr 10.20.193.4:0/836111945 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e953c7640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6e9010f060 0x7f6e900f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e94bc6640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6e901101f0 0x7f6e90171530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e95bc8640 1 -- 10.20.193.4:0/836111945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6e901101f0 msgr2=0x7f6e90171530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e95bc8640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6e901101f0 0x7f6e90171530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e95bc8640 1 -- 10.20.193.4:0/836111945 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6e9010f060 msgr2=0x7f6e900f86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e95bc8640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6e9010f060 0x7f6e900f86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e95bc8640 1 -- 10.20.193.4:0/836111945 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e80009570 con 0x7f6e90110ba0 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e95bc8640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6e90110ba0 0x7f6e900f8f40 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e8c006e90 tx=0x7f6e8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e7e7fc640 1 -- 10.20.193.4:0/836111945 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e8c005500 con 0x7f6e90110ba0 2026-02-24T09:09:52.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e963c9640 1 -- 10.20.193.4:0/836111945 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e900fa140 con 0x7f6e90110ba0 2026-02-24T09:09:52.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e7e7fc640 1 -- 10.20.193.4:0/836111945 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6e8c005e10 con 0x7f6e90110ba0 2026-02-24T09:09:52.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.271+0000 7f6e7e7fc640 1 -- 10.20.193.4:0/836111945 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e8c003a90 con 0x7f6e90110ba0 2026-02-24T09:09:52.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.272+0000 7f6e963c9640 1 -- 10.20.193.4:0/836111945 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e900fa610 con 0x7f6e90110ba0 2026-02-24T09:09:52.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.272+0000 7f6e963c9640 1 -- 10.20.193.4:0/836111945 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e90175550 con 0x7f6e90110ba0 2026-02-24T09:09:52.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.273+0000 7f6e7e7fc640 1 -- 10.20.193.4:0/836111945 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f6e8c00c840 con 0x7f6e90110ba0 2026-02-24T09:09:52.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.274+0000 7f6e7e7fc640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6e6c0b5770 0x7f6e6c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.274+0000 7f6e7e7fc640 1 -- 10.20.193.4:0/836111945 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f6e8c0e7ca0 con 0x7f6e90110ba0 2026-02-24T09:09:52.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.274+0000 7f6e953c7640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6e6c0b5770 0x7f6e6c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.274+0000 7f6e7e7fc640 1 -- 10.20.193.4:0/836111945 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f6e8c0aa630 con 0x7f6e90110ba0 2026-02-24T09:09:52.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.274+0000 7f6e953c7640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6e6c0b5770 0x7f6e6c0d5c20 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e800023d0 tx=0x7f6e80031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:52.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.376+0000 7f6e963c9640 1 -- 10.20.193.4:0/836111945 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e90174c80 con 0x7f6e6c0b5770 2026-02-24T09:09:52.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.379+0000 7f6e7e7fc640 1 -- 10.20.193.4:0/836111945 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7f6e90174c80 con 0x7f6e6c0b5770 2026-02-24T09:09:52.383 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:52.384 INFO:teuthology.orchestra.run.trial004.stderr:dumped all 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 -- 10.20.193.4:0/836111945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6e6c0b5770 msgr2=0x7f6e6c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6e6c0b5770 0x7f6e6c0d5c20 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e800023d0 tx=0x7f6e80031040 comp rx=0 tx=0).stop 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 -- 10.20.193.4:0/836111945 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6e90110ba0 msgr2=0x7f6e900f8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6e90110ba0 0x7f6e900f8f40 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e8c006e90 tx=0x7f6e8c00edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 -- 10.20.193.4:0/836111945 shutdown_connections 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6e6c0b5770 0x7f6e6c0d5c20 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6e90110ba0 0x7f6e900f8f40 unknown :-1 s=CLOSED pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6e901101f0 0x7f6e90171530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 --2- 10.20.193.4:0/836111945 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6e9010f060 0x7f6e900f86e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 -- 10.20.193.4:0/836111945 >> 10.20.193.4:0/836111945 conn(0x7f6e900ec7b0 msgr2=0x7f6e900edf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 -- 10.20.193.4:0/836111945 shutdown_connections 2026-02-24T09:09:52.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.380+0000 7f6e963c9640 1 -- 10.20.193.4:0/836111945 wait complete. 2026-02-24T09:09:52.391 INFO:teuthology.orchestra.run.trial004.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2026-02-24T09:09:51.668575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662006,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":241,"num_read_kb":234,"num_write":346,"num_write_kb":3837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333672,"kb_used_data":10104,"kb_used_omap":377,"kb_used_meta":322950,"kb_avail":8807704728,"statfs":{"total":9019431321600,"available":9019089641472,"internally_reserved":0,"allocated":10346496,"data_stored":6721869,"data_compressed":113181,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":386873,"internal_metadata":330700999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15110,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":5,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002256"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332664+0000","last_change":"2026-02-24T09:09:25.267627+0000","last_active":"2026-02-24T09:09:26.332664+0000","last_peered":"2026-02-24T09:09:26.332664+0000","last_clean":"2026-02-24T09:09:26.332664+0000","last_became_active":"2026-02-24T09:09:25.267439+0000","last_became_peered":"2026-02-24T09:09:25.267439+0000","last_unstale":"2026-02-24T09:09:26.332664+0000","last_undegraded":"2026-02-24T09:09:26.332664+0000","last_fullsized":"2026-02-24T09:09:26.332664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:24.034680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267727+0000","last_change":"2026-02-24T09:09:25.267299+0000","last_active":"2026-02-24T09:09:26.267727+0000","last_peered":"2026-02-24T09:09:26.267727+0000","last_clean":"2026-02-24T09:09:26.267727+0000","last_became_active":"2026-02-24T09:09:25.266956+0000","last_became_peered":"2026-02-24T09:09:25.266956+0000","last_unstale":"2026-02-24T09:09:26.267727+0000","last_undegraded":"2026-02-24T09:09:26.267727+0000","last_fullsized":"2026-02-24T09:09:26.267727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:05.466777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267738+0000","last_change":"2026-02-24T09:09:25.268761+0000","last_active":"2026-02-24T09:09:26.267738+0000","last_peered":"2026-02-24T09:09:26.267738+0000","last_clean":"2026-02-24T09:09:26.267738+0000","last_became_active":"2026-02-24T09:09:25.268476+0000","last_became_peered":"2026-02-24T09:09:25.268476+0000","last_unstale":"2026-02-24T09:09:26.267738+0000","last_undegraded":"2026-02-24T09:09:26.267738+0000","last_fullsized":"2026-02-24T09:09:26.267738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:26:00.680116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335046+0000","last_change":"2026-02-24T09:09:25.271303+0000","last_active":"2026-02-24T09:09:26.335046+0000","last_peered":"2026-02-24T09:09:26.335046+0000","last_clean":"2026-02-24T09:09:26.335046+0000","last_became_active":"2026-02-24T09:09:25.271175+0000","last_became_peered":"2026-02-24T09:09:25.271175+0000","last_unstale":"2026-02-24T09:09:26.335046+0000","last_undegraded":"2026-02-24T09:09:26.335046+0000","last_fullsized":"2026-02-24T09:09:26.335046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:55:25.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267634+0000","last_change":"2026-02-24T09:09:25.267923+0000","last_active":"2026-02-24T09:09:26.267634+0000","last_peered":"2026-02-24T09:09:26.267634+0000","last_clean":"2026-02-24T09:09:26.267634+0000","last_became_active":"2026-02-24T09:09:25.267775+0000","last_became_peered":"2026-02-24T09:09:25.267775+0000","last_unstale":"2026-02-24T09:09:26.267634+0000","last_undegraded":"2026-02-24T09:09:26.267634+0000","last_fullsized":"2026-02-24T09:09:26.267634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:54:25.575849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270023+0000","last_change":"2026-02-24T09:09:25.269603+0000","last_active":"2026-02-24T09:09:26.270023+0000","last_peered":"2026-02-24T09:09:26.270023+0000","last_clean":"2026-02-24T09:09:26.270023+0000","last_became_active":"2026-02-24T09:09:25.269057+0000","last_became_peered":"2026-02-24T09:09:25.269057+0000","last_unstale":"2026-02-24T09:09:26.270023+0000","last_undegraded":"2026-02-24T09:09:26.270023+0000","last_fullsized":"2026-02-24T09:09:26.270023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:39:21.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733238+0000","last_change":"2026-02-24T09:09:25.270852+0000","last_active":"2026-02-24T09:09:26.733238+0000","last_peered":"2026-02-24T09:09:26.733238+0000","last_clean":"2026-02-24T09:09:26.733238+0000","last_became_active":"2026-02-24T09:09:25.270607+0000","last_became_peered":"2026-02-24T09:09:25.270607+0000","last_unstale":"2026-02-24T09:09:26.733238+0000","last_undegraded":"2026-02-24T09:09:26.733238+0000","last_fullsized":"2026-02-24T09:09:26.733238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:45:43.574810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268619+0000","last_change":"2026-02-24T09:09:25.268833+0000","last_active":"2026-02-24T09:09:26.268619+0000","last_peered":"2026-02-24T09:09:26.268619+0000","last_clean":"2026-02-24T09:09:26.268619+0000","last_became_active":"2026-02-24T09:09:25.268462+0000","last_became_peered":"2026-02-24T09:09:25.268462+0000","last_unstale":"2026-02-24T09:09:26.268619+0000","last_undegraded":"2026-02-24T09:09:26.268619+0000","last_fullsized":"2026-02-24T09:09:26.268619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:47.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334895+0000","last_change":"2026-02-24T09:09:25.271419+0000","last_active":"2026-02-24T09:09:26.334895+0000","last_peered":"2026-02-24T09:09:26.334895+0000","last_clean":"2026-02-24T09:09:26.334895+0000","last_became_active":"2026-02-24T09:09:25.270954+0000","last_became_peered":"2026-02-24T09:09:25.270954+0000","last_unstale":"2026-02-24T09:09:26.334895+0000","last_undegraded":"2026-02-24T09:09:26.334895+0000","last_fullsized":"2026-02-24T09:09:26.334895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:07:15.889565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270286+0000","last_change":"2026-02-24T09:09:25.269709+0000","last_active":"2026-02-24T09:09:26.270286+0000","last_peered":"2026-02-24T09:09:26.270286+0000","last_clean":"2026-02-24T09:09:26.270286+0000","last_became_active":"2026-02-24T09:09:25.269136+0000","last_became_peered":"2026-02-24T09:09:25.269136+0000","last_unstale":"2026-02-24T09:09:26.270286+0000","last_undegraded":"2026-02-24T09:09:26.270286+0000","last_fullsized":"2026-02-24T09:09:26.270286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:42:02.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733508+0000","last_change":"2026-02-24T09:09:25.272025+0000","last_active":"2026-02-24T09:09:26.733508+0000","last_peered":"2026-02-24T09:09:26.733508+0000","last_clean":"2026-02-24T09:09:26.733508+0000","last_became_active":"2026-02-24T09:09:25.271851+0000","last_became_peered":"2026-02-24T09:09:25.271851+0000","last_unstale":"2026-02-24T09:09:26.733508+0000","last_undegraded":"2026-02-24T09:09:26.733508+0000","last_fullsized":"2026-02-24T09:09:26.733508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:49:57.365130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335160+0000","last_change":"2026-02-24T09:09:25.271156+0000","last_active":"2026-02-24T09:09:26.335160+0000","last_peered":"2026-02-24T09:09:26.335160+0000","last_clean":"2026-02-24T09:09:26.335160+0000","last_became_active":"2026-02-24T09:09:25.270992+0000","last_became_peered":"2026-02-24T09:09:25.270992+0000","last_unstale":"2026-02-24T09:09:26.335160+0000","last_undegraded":"2026-02-24T09:09:26.335160+0000","last_fullsized":"2026-02-24T09:09:26.335160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:56.324038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332309+0000","last_change":"2026-02-24T09:09:25.266871+0000","last_active":"2026-02-24T09:09:26.332309+0000","last_peered":"2026-02-24T09:09:26.332309+0000","last_clean":"2026-02-24T09:09:26.332309+0000","last_became_active":"2026-02-24T09:09:25.266438+0000","last_became_peered":"2026-02-24T09:09:25.266438+0000","last_unstale":"2026-02-24T09:09:26.332309+0000","last_undegraded":"2026-02-24T09:09:26.332309+0000","last_fullsized":"2026-02-24T09:09:26.332309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:24:17.014313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267591+0000","last_change":"2026-02-24T09:09:25.266851+0000","last_active":"2026-02-24T09:09:26.267591+0000","last_peered":"2026-02-24T09:09:26.267591+0000","last_clean":"2026-02-24T09:09:26.267591+0000","last_became_active":"2026-02-24T09:09:25.266530+0000","last_became_peered":"2026-02-24T09:09:25.266530+0000","last_unstale":"2026-02-24T09:09:26.267591+0000","last_undegraded":"2026-02-24T09:09:26.267591+0000","last_fullsized":"2026-02-24T09:09:26.267591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:53.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267465+0000","last_change":"2026-02-24T09:09:25.269561+0000","last_active":"2026-02-24T09:09:26.267465+0000","last_peered":"2026-02-24T09:09:26.267465+0000","last_clean":"2026-02-24T09:09:26.267465+0000","last_became_active":"2026-02-24T09:09:25.268979+0000","last_became_peered":"2026-02-24T09:09:25.268979+0000","last_unstale":"2026-02-24T09:09:26.267465+0000","last_undegraded":"2026-02-24T09:09:26.267465+0000","last_fullsized":"2026-02-24T09:09:26.267465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:16:56.110766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334540+0000","last_change":"2026-02-24T09:09:25.271426+0000","last_active":"2026-02-24T09:09:26.334540+0000","last_peered":"2026-02-24T09:09:26.334540+0000","last_clean":"2026-02-24T09:09:26.334540+0000","last_became_active":"2026-02-24T09:09:25.270917+0000","last_became_peered":"2026-02-24T09:09:25.270917+0000","last_unstale":"2026-02-24T09:09:26.334540+0000","last_undegraded":"2026-02-24T09:09:26.334540+0000","last_fullsized":"2026-02-24T09:09:26.334540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:58:52.125871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332673+0000","last_change":"2026-02-24T09:09:25.267238+0000","last_active":"2026-02-24T09:09:26.332673+0000","last_peered":"2026-02-24T09:09:26.332673+0000","last_clean":"2026-02-24T09:09:26.332673+0000","last_became_active":"2026-02-24T09:09:25.267060+0000","last_became_peered":"2026-02-24T09:09:25.267060+0000","last_unstale":"2026-02-24T09:09:26.332673+0000","last_undegraded":"2026-02-24T09:09:26.332673+0000","last_fullsized":"2026-02-24T09:09:26.332673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:00:58.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267495+0000","last_change":"2026-02-24T09:09:25.266005+0000","last_active":"2026-02-24T09:09:26.267495+0000","last_peered":"2026-02-24T09:09:26.267495+0000","last_clean":"2026-02-24T09:09:26.267495+0000","last_became_active":"2026-02-24T09:09:25.265847+0000","last_became_peered":"2026-02-24T09:09:25.265847+0000","last_unstale":"2026-02-24T09:09:26.267495+0000","last_undegraded":"2026-02-24T09:09:26.267495+0000","last_fullsized":"2026-02-24T09:09:26.267495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:29:02.137351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332638+0000","last_change":"2026-02-24T09:09:25.268822+0000","last_active":"2026-02-24T09:09:26.332638+0000","last_peered":"2026-02-24T09:09:26.332638+0000","last_clean":"2026-02-24T09:09:26.332638+0000","last_became_active":"2026-02-24T09:09:25.268683+0000","last_became_peered":"2026-02-24T09:09:25.268683+0000","last_unstale":"2026-02-24T09:09:26.332638+0000","last_undegraded":"2026-02-24T09:09:26.332638+0000","last_fullsized":"2026-02-24T09:09:26.332638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:23:58.256403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332429+0000","last_change":"2026-02-24T09:09:25.266214+0000","last_active":"2026-02-24T09:09:26.332429+0000","last_peered":"2026-02-24T09:09:26.332429+0000","last_clean":"2026-02-24T09:09:26.332429+0000","last_became_active":"2026-02-24T09:09:25.266019+0000","last_became_peered":"2026-02-24T09:09:25.266019+0000","last_unstale":"2026-02-24T09:09:26.332429+0000","last_undegraded":"2026-02-24T09:09:26.332429+0000","last_fullsized":"2026-02-24T09:09:26.332429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:17.141581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332384+0000","last_change":"2026-02-24T09:09:25.267493+0000","last_active":"2026-02-24T09:09:26.332384+0000","last_peered":"2026-02-24T09:09:26.332384+0000","last_clean":"2026-02-24T09:09:26.332384+0000","last_became_active":"2026-02-24T09:09:25.267314+0000","last_became_peered":"2026-02-24T09:09:25.267314+0000","last_unstale":"2026-02-24T09:09:26.332384+0000","last_undegraded":"2026-02-24T09:09:26.332384+0000","last_fullsized":"2026-02-24T09:09:26.332384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:59:11.536214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334717+0000","last_change":"2026-02-24T09:09:25.272131+0000","last_active":"2026-02-24T09:09:26.334717+0000","last_peered":"2026-02-24T09:09:26.334717+0000","last_clean":"2026-02-24T09:09:26.334717+0000","last_became_active":"2026-02-24T09:09:25.271680+0000","last_became_peered":"2026-02-24T09:09:25.271680+0000","last_unstale":"2026-02-24T09:09:26.334717+0000","last_undegraded":"2026-02-24T09:09:26.334717+0000","last_fullsized":"2026-02-24T09:09:26.334717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:07:33.257865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268617+0000","last_change":"2026-02-24T09:09:25.267808+0000","last_active":"2026-02-24T09:09:26.268617+0000","last_peered":"2026-02-24T09:09:26.268617+0000","last_clean":"2026-02-24T09:09:26.268617+0000","last_became_active":"2026-02-24T09:09:25.266759+0000","last_became_peered":"2026-02-24T09:09:25.266759+0000","last_unstale":"2026-02-24T09:09:26.268617+0000","last_undegraded":"2026-02-24T09:09:26.268617+0000","last_fullsized":"2026-02-24T09:09:26.268617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:55.312047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268133+0000","last_change":"2026-02-24T09:09:25.268500+0000","last_active":"2026-02-24T09:09:26.268133+0000","last_peered":"2026-02-24T09:09:26.268133+0000","last_clean":"2026-02-24T09:09:26.268133+0000","last_became_active":"2026-02-24T09:09:25.267904+0000","last_became_peered":"2026-02-24T09:09:25.267904+0000","last_unstale":"2026-02-24T09:09:26.268133+0000","last_undegraded":"2026-02-24T09:09:26.268133+0000","last_fullsized":"2026-02-24T09:09:26.268133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:38:47.330593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269021+0000","last_change":"2026-02-24T09:09:25.269694+0000","last_active":"2026-02-24T09:09:26.269021+0000","last_peered":"2026-02-24T09:09:26.269021+0000","last_clean":"2026-02-24T09:09:26.269021+0000","last_became_active":"2026-02-24T09:09:25.269068+0000","last_became_peered":"2026-02-24T09:09:25.269068+0000","last_unstale":"2026-02-24T09:09:26.269021+0000","last_undegraded":"2026-02-24T09:09:26.269021+0000","last_fullsized":"2026-02-24T09:09:26.269021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:04:44.772275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332668+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.332668+0000","last_peered":"2026-02-24T09:09:26.332668+0000","last_clean":"2026-02-24T09:09:26.332668+0000","last_became_active":"2026-02-24T09:09:25.269534+0000","last_became_peered":"2026-02-24T09:09:25.269534+0000","last_unstale":"2026-02-24T09:09:26.332668+0000","last_undegraded":"2026-02-24T09:09:26.332668+0000","last_fullsized":"2026-02-24T09:09:26.332668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:45:51.428970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332478+0000","last_change":"2026-02-24T09:09:25.266779+0000","last_active":"2026-02-24T09:09:26.332478+0000","last_peered":"2026-02-24T09:09:26.332478+0000","last_clean":"2026-02-24T09:09:26.332478+0000","last_became_active":"2026-02-24T09:09:25.266603+0000","last_became_peered":"2026-02-24T09:09:25.266603+0000","last_unstale":"2026-02-24T09:09:26.332478+0000","last_undegraded":"2026-02-24T09:09:26.332478+0000","last_fullsized":"2026-02-24T09:09:26.332478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:01:38.198458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332295+0000","last_change":"2026-02-24T09:09:25.266933+0000","last_active":"2026-02-24T09:09:26.332295+0000","last_peered":"2026-02-24T09:09:26.332295+0000","last_clean":"2026-02-24T09:09:26.332295+0000","last_became_active":"2026-02-24T09:09:25.266381+0000","last_became_peered":"2026-02-24T09:09:25.266381+0000","last_unstale":"2026-02-24T09:09:26.332295+0000","last_undegraded":"2026-02-24T09:09:26.332295+0000","last_fullsized":"2026-02-24T09:09:26.332295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:45:44.657482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267754+0000","last_change":"2026-02-24T09:09:25.269576+0000","last_active":"2026-02-24T09:09:26.267754+0000","last_peered":"2026-02-24T09:09:26.267754+0000","last_clean":"2026-02-24T09:09:26.267754+0000","last_became_active":"2026-02-24T09:09:25.269159+0000","last_became_peered":"2026-02-24T09:09:25.269159+0000","last_unstale":"2026-02-24T09:09:26.267754+0000","last_undegraded":"2026-02-24T09:09:26.267754+0000","last_fullsized":"2026-02-24T09:09:26.267754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:23:37.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332345+0000","last_change":"2026-02-24T09:09:25.269282+0000","last_active":"2026-02-24T09:09:26.332345+0000","last_peered":"2026-02-24T09:09:26.332345+0000","last_clean":"2026-02-24T09:09:26.332345+0000","last_became_active":"2026-02-24T09:09:25.269088+0000","last_became_peered":"2026-02-24T09:09:25.269088+0000","last_unstale":"2026-02-24T09:09:26.332345+0000","last_undegraded":"2026-02-24T09:09:26.332345+0000","last_fullsized":"2026-02-24T09:09:26.332345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:49.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332404+0000","last_change":"2026-02-24T09:09:25.270968+0000","last_active":"2026-02-24T09:09:26.332404+0000","last_peered":"2026-02-24T09:09:26.332404+0000","last_clean":"2026-02-24T09:09:26.332404+0000","last_became_active":"2026-02-24T09:09:25.270816+0000","last_became_peered":"2026-02-24T09:09:25.270816+0000","last_unstale":"2026-02-24T09:09:26.332404+0000","last_undegraded":"2026-02-24T09:09:26.332404+0000","last_fullsized":"2026-02-24T09:09:26.332404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:10:08.592263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332360+0000","last_change":"2026-02-24T09:09:25.267715+0000","last_active":"2026-02-24T09:09:26.332360+0000","last_peered":"2026-02-24T09:09:26.332360+0000","last_clean":"2026-02-24T09:09:26.332360+0000","last_became_active":"2026-02-24T09:09:25.267031+0000","last_became_peered":"2026-02-24T09:09:25.267031+0000","last_unstale":"2026-02-24T09:09:26.332360+0000","last_undegraded":"2026-02-24T09:09:26.332360+0000","last_fullsized":"2026-02-24T09:09:26.332360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:14:50.568512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267758+0000","last_change":"2026-02-24T09:09:25.268347+0000","last_active":"2026-02-24T09:09:26.267758+0000","last_peered":"2026-02-24T09:09:26.267758+0000","last_clean":"2026-02-24T09:09:26.267758+0000","last_became_active":"2026-02-24T09:09:25.268235+0000","last_became_peered":"2026-02-24T09:09:25.268235+0000","last_unstale":"2026-02-24T09:09:26.267758+0000","last_undegraded":"2026-02-24T09:09:26.267758+0000","last_fullsized":"2026-02-24T09:09:26.267758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:17.309082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:45.955218+0000","last_change":"2026-02-24T09:09:24.256941+0000","last_active":"2026-02-24T09:09:45.955218+0000","last_peered":"2026-02-24T09:09:45.955218+0000","last_clean":"2026-02-24T09:09:45.955218+0000","last_became_active":"2026-02-24T09:09:24.256577+0000","last_became_peered":"2026-02-24T09:09:24.256577+0000","last_unstale":"2026-02-24T09:09:45.955218+0000","last_undegraded":"2026-02-24T09:09:45.955218+0000","last_fullsized":"2026-02-24T09:09:45.955218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:13:19.756549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268000+0000","last_change":"2026-02-24T09:09:25.270452+0000","last_active":"2026-02-24T09:09:26.268000+0000","last_peered":"2026-02-24T09:09:26.268000+0000","last_clean":"2026-02-24T09:09:26.268000+0000","last_became_active":"2026-02-24T09:09:25.270184+0000","last_became_peered":"2026-02-24T09:09:25.270184+0000","last_unstale":"2026-02-24T09:09:26.268000+0000","last_undegraded":"2026-02-24T09:09:26.268000+0000","last_fullsized":"2026-02-24T09:09:26.268000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:07:41.652941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943662+0000","last_change":"2026-02-24T09:09:24.261249+0000","last_active":"2026-02-24T09:09:28.943662+0000","last_peered":"2026-02-24T09:09:28.943662+0000","last_clean":"2026-02-24T09:09:28.943662+0000","last_became_active":"2026-02-24T09:09:24.261064+0000","last_became_peered":"2026-02-24T09:09:24.261064+0000","last_unstale":"2026-02-24T09:09:28.943662+0000","last_undegraded":"2026-02-24T09:09:28.943662+0000","last_fullsized":"2026-02-24T09:09:28.943662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:59:42.964350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941445+0000","last_change":"2026-02-24T09:09:24.254918+0000","last_active":"2026-02-24T09:09:28.941445+0000","last_peered":"2026-02-24T09:09:28.941445+0000","last_clean":"2026-02-24T09:09:28.941445+0000","last_became_active":"2026-02-24T09:09:24.254590+0000","last_became_peered":"2026-02-24T09:09:24.254590+0000","last_unstale":"2026-02-24T09:09:28.941445+0000","last_undegraded":"2026-02-24T09:09:28.941445+0000","last_fullsized":"2026-02-24T09:09:28.941445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:03:19.504844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268666+0000","last_change":"2026-02-24T09:09:25.267204+0000","last_active":"2026-02-24T09:09:26.268666+0000","last_peered":"2026-02-24T09:09:26.268666+0000","last_clean":"2026-02-24T09:09:26.268666+0000","last_became_active":"2026-02-24T09:09:25.266489+0000","last_became_peered":"2026-02-24T09:09:25.266489+0000","last_unstale":"2026-02-24T09:09:26.268666+0000","last_undegraded":"2026-02-24T09:09:26.268666+0000","last_fullsized":"2026-02-24T09:09:26.268666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:26:34.500054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210732+0000","last_change":"2026-02-24T09:09:24.258042+0000","last_active":"2026-02-24T09:09:27.210732+0000","last_peered":"2026-02-24T09:09:27.210732+0000","last_clean":"2026-02-24T09:09:27.210732+0000","last_became_active":"2026-02-24T09:09:24.257801+0000","last_became_peered":"2026-02-24T09:09:24.257801+0000","last_unstale":"2026-02-24T09:09:27.210732+0000","last_undegraded":"2026-02-24T09:09:27.210732+0000","last_fullsized":"2026-02-24T09:09:27.210732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:27.596990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267334+0000","last_change":"2026-02-24T09:09:25.267636+0000","last_active":"2026-02-24T09:09:26.267334+0000","last_peered":"2026-02-24T09:09:26.267334+0000","last_clean":"2026-02-24T09:09:26.267334+0000","last_became_active":"2026-02-24T09:09:25.267505+0000","last_became_peered":"2026-02-24T09:09:25.267505+0000","last_unstale":"2026-02-24T09:09:26.267334+0000","last_undegraded":"2026-02-24T09:09:26.267334+0000","last_fullsized":"2026-02-24T09:09:26.267334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:20.660345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:44.956775+0000","last_change":"2026-02-24T09:09:24.260793+0000","last_active":"2026-02-24T09:09:44.956775+0000","last_peered":"2026-02-24T09:09:44.956775+0000","last_clean":"2026-02-24T09:09:44.956775+0000","last_became_active":"2026-02-24T09:09:24.260555+0000","last_became_peered":"2026-02-24T09:09:24.260555+0000","last_unstale":"2026-02-24T09:09:44.956775+0000","last_undegraded":"2026-02-24T09:09:44.956775+0000","last_fullsized":"2026-02-24T09:09:44.956775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:30:45.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334847+0000","last_change":"2026-02-24T09:09:25.271121+0000","last_active":"2026-02-24T09:09:26.334847+0000","last_peered":"2026-02-24T09:09:26.334847+0000","last_clean":"2026-02-24T09:09:26.334847+0000","last_became_active":"2026-02-24T09:09:25.270770+0000","last_became_peered":"2026-02-24T09:09:25.270770+0000","last_unstale":"2026-02-24T09:09:26.334847+0000","last_undegraded":"2026-02-24T09:09:26.334847+0000","last_fullsized":"2026-02-24T09:09:26.334847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:52:58.451719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940998+0000","last_change":"2026-02-24T09:09:24.259030+0000","last_active":"2026-02-24T09:09:27.940998+0000","last_peered":"2026-02-24T09:09:27.940998+0000","last_clean":"2026-02-24T09:09:27.940998+0000","last_became_active":"2026-02-24T09:09:24.258747+0000","last_became_peered":"2026-02-24T09:09:24.258747+0000","last_unstale":"2026-02-24T09:09:27.940998+0000","last_undegraded":"2026-02-24T09:09:27.940998+0000","last_fullsized":"2026-02-24T09:09:27.940998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:49:46.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267794+0000","last_change":"2026-02-24T09:09:25.269875+0000","last_active":"2026-02-24T09:09:26.267794+0000","last_peered":"2026-02-24T09:09:26.267794+0000","last_clean":"2026-02-24T09:09:26.267794+0000","last_became_active":"2026-02-24T09:09:25.269400+0000","last_became_peered":"2026-02-24T09:09:25.269400+0000","last_unstale":"2026-02-24T09:09:26.267794+0000","last_undegraded":"2026-02-24T09:09:26.267794+0000","last_fullsized":"2026-02-24T09:09:26.267794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:08:29.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938278+0000","last_change":"2026-02-24T09:09:24.256845+0000","last_active":"2026-02-24T09:09:27.938278+0000","last_peered":"2026-02-24T09:09:27.938278+0000","last_clean":"2026-02-24T09:09:27.938278+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:27.938278+0000","last_undegraded":"2026-02-24T09:09:27.938278+0000","last_fullsized":"2026-02-24T09:09:27.938278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:08:15.802226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334785+0000","last_change":"2026-02-24T09:09:25.269608+0000","last_active":"2026-02-24T09:09:26.334785+0000","last_peered":"2026-02-24T09:09:26.334785+0000","last_clean":"2026-02-24T09:09:26.334785+0000","last_became_active":"2026-02-24T09:09:25.268736+0000","last_became_peered":"2026-02-24T09:09:25.268736+0000","last_unstale":"2026-02-24T09:09:26.334785+0000","last_undegraded":"2026-02-24T09:09:26.334785+0000","last_fullsized":"2026-02-24T09:09:26.334785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:39:41.466580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'27","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:45.960158+0000","last_change":"2026-02-24T09:09:24.260591+0000","last_active":"2026-02-24T09:09:45.960158+0000","last_peered":"2026-02-24T09:09:45.960158+0000","last_clean":"2026-02-24T09:09:45.960158+0000","last_became_active":"2026-02-24T09:09:24.260382+0000","last_became_peered":"2026-02-24T09:09:24.260382+0000","last_unstale":"2026-02-24T09:09:45.960158+0000","last_undegraded":"2026-02-24T09:09:45.960158+0000","last_fullsized":"2026-02-24T09:09:45.960158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:05:00.313499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67354,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":86,"num_write":28,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267717+0000","last_change":"2026-02-24T09:09:25.266872+0000","last_active":"2026-02-24T09:09:26.267717+0000","last_peered":"2026-02-24T09:09:26.267717+0000","last_clean":"2026-02-24T09:09:26.267717+0000","last_became_active":"2026-02-24T09:09:25.266720+0000","last_became_peered":"2026-02-24T09:09:25.266720+0000","last_unstale":"2026-02-24T09:09:26.267717+0000","last_undegraded":"2026-02-24T09:09:26.267717+0000","last_fullsized":"2026-02-24T09:09:26.267717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:43.574647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941766+0000","last_change":"2026-02-24T09:09:24.256821+0000","last_active":"2026-02-24T09:09:28.941766+0000","last_peered":"2026-02-24T09:09:28.941766+0000","last_clean":"2026-02-24T09:09:28.941766+0000","last_became_active":"2026-02-24T09:09:24.256284+0000","last_became_peered":"2026-02-24T09:09:24.256284+0000","last_unstale":"2026-02-24T09:09:28.941766+0000","last_undegraded":"2026-02-24T09:09:28.941766+0000","last_fullsized":"2026-02-24T09:09:28.941766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:37:32.352734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332187+0000","last_change":"2026-02-24T09:09:25.268120+0000","last_active":"2026-02-24T09:09:26.332187+0000","last_peered":"2026-02-24T09:09:26.332187+0000","last_clean":"2026-02-24T09:09:26.332187+0000","last_became_active":"2026-02-24T09:09:25.267865+0000","last_became_peered":"2026-02-24T09:09:25.267865+0000","last_unstale":"2026-02-24T09:09:26.332187+0000","last_undegraded":"2026-02-24T09:09:26.332187+0000","last_fullsized":"2026-02-24T09:09:26.332187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:51:18.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938196+0000","last_change":"2026-02-24T09:09:24.257176+0000","last_active":"2026-02-24T09:09:27.938196+0000","last_peered":"2026-02-24T09:09:27.938196+0000","last_clean":"2026-02-24T09:09:27.938196+0000","last_became_active":"2026-02-24T09:09:24.256855+0000","last_became_peered":"2026-02-24T09:09:24.256855+0000","last_unstale":"2026-02-24T09:09:27.938196+0000","last_undegraded":"2026-02-24T09:09:27.938196+0000","last_fullsized":"2026-02-24T09:09:27.938196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:48:25.179774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733497+0000","last_change":"2026-02-24T09:09:25.271913+0000","last_active":"2026-02-24T09:09:26.733497+0000","last_peered":"2026-02-24T09:09:26.733497+0000","last_clean":"2026-02-24T09:09:26.733497+0000","last_became_active":"2026-02-24T09:09:25.271736+0000","last_became_peered":"2026-02-24T09:09:25.271736+0000","last_unstale":"2026-02-24T09:09:26.733497+0000","last_undegraded":"2026-02-24T09:09:26.733497+0000","last_fullsized":"2026-02-24T09:09:26.733497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:49.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:47.961761+0000","last_change":"2026-02-24T09:09:24.259308+0000","last_active":"2026-02-24T09:09:47.961761+0000","last_peered":"2026-02-24T09:09:47.961761+0000","last_clean":"2026-02-24T09:09:47.961761+0000","last_became_active":"2026-02-24T09:09:24.259131+0000","last_became_peered":"2026-02-24T09:09:24.259131+0000","last_unstale":"2026-02-24T09:09:47.961761+0000","last_undegraded":"2026-02-24T09:09:47.961761+0000","last_fullsized":"2026-02-24T09:09:47.961761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:52:00.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733165+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.733165+0000","last_peered":"2026-02-24T09:09:26.733165+0000","last_clean":"2026-02-24T09:09:26.733165+0000","last_became_active":"2026-02-24T09:09:25.269559+0000","last_became_peered":"2026-02-24T09:09:25.269559+0000","last_unstale":"2026-02-24T09:09:26.733165+0000","last_undegraded":"2026-02-24T09:09:26.733165+0000","last_fullsized":"2026-02-24T09:09:26.733165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:06:28.902948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942522+0000","last_change":"2026-02-24T09:09:24.257075+0000","last_active":"2026-02-24T09:09:28.942522+0000","last_peered":"2026-02-24T09:09:28.942522+0000","last_clean":"2026-02-24T09:09:28.942522+0000","last_became_active":"2026-02-24T09:09:24.256738+0000","last_became_peered":"2026-02-24T09:09:24.256738+0000","last_unstale":"2026-02-24T09:09:28.942522+0000","last_undegraded":"2026-02-24T09:09:28.942522+0000","last_fullsized":"2026-02-24T09:09:28.942522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:14.802040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268002+0000","last_change":"2026-02-24T09:09:25.271423+0000","last_active":"2026-02-24T09:09:26.268002+0000","last_peered":"2026-02-24T09:09:26.268002+0000","last_clean":"2026-02-24T09:09:26.268002+0000","last_became_active":"2026-02-24T09:09:25.271142+0000","last_became_peered":"2026-02-24T09:09:25.271142+0000","last_unstale":"2026-02-24T09:09:26.268002+0000","last_undegraded":"2026-02-24T09:09:26.268002+0000","last_fullsized":"2026-02-24T09:09:26.268002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:16.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.940354+0000","last_change":"2026-02-24T09:09:24.258426+0000","last_active":"2026-02-24T09:09:29.940354+0000","last_peered":"2026-02-24T09:09:29.940354+0000","last_clean":"2026-02-24T09:09:29.940354+0000","last_became_active":"2026-02-24T09:09:24.257941+0000","last_became_peered":"2026-02-24T09:09:24.257941+0000","last_unstale":"2026-02-24T09:09:29.940354+0000","last_undegraded":"2026-02-24T09:09:29.940354+0000","last_fullsized":"2026-02-24T09:09:29.940354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:30:29.724001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332552+0000","last_change":"2026-02-24T09:09:25.266758+0000","last_active":"2026-02-24T09:09:26.332552+0000","last_peered":"2026-02-24T09:09:26.332552+0000","last_clean":"2026-02-24T09:09:26.332552+0000","last_became_active":"2026-02-24T09:09:25.266569+0000","last_became_peered":"2026-02-24T09:09:25.266569+0000","last_unstale":"2026-02-24T09:09:26.332552+0000","last_undegraded":"2026-02-24T09:09:26.332552+0000","last_fullsized":"2026-02-24T09:09:26.332552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:13:56.985056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332354+0000","last_change":"2026-02-24T09:09:24.256974+0000","last_active":"2026-02-24T09:09:26.332354+0000","last_peered":"2026-02-24T09:09:26.332354+0000","last_clean":"2026-02-24T09:09:26.332354+0000","last_became_active":"2026-02-24T09:09:24.256617+0000","last_became_peered":"2026-02-24T09:09:24.256617+0000","last_unstale":"2026-02-24T09:09:26.332354+0000","last_undegraded":"2026-02-24T09:09:26.332354+0000","last_fullsized":"2026-02-24T09:09:26.332354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:28.318156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733475+0000","last_change":"2026-02-24T09:09:25.270445+0000","last_active":"2026-02-24T09:09:26.733475+0000","last_peered":"2026-02-24T09:09:26.733475+0000","last_clean":"2026-02-24T09:09:26.733475+0000","last_became_active":"2026-02-24T09:09:25.270275+0000","last_became_peered":"2026-02-24T09:09:25.270275+0000","last_unstale":"2026-02-24T09:09:26.733475+0000","last_undegraded":"2026-02-24T09:09:26.733475+0000","last_fullsized":"2026-02-24T09:09:26.733475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:53:49.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210815+0000","last_change":"2026-02-24T09:09:24.259031+0000","last_active":"2026-02-24T09:09:27.210815+0000","last_peered":"2026-02-24T09:09:27.210815+0000","last_clean":"2026-02-24T09:09:27.210815+0000","last_became_active":"2026-02-24T09:09:24.258899+0000","last_became_peered":"2026-02-24T09:09:24.258899+0000","last_unstale":"2026-02-24T09:09:27.210815+0000","last_undegraded":"2026-02-24T09:09:27.210815+0000","last_fullsized":"2026-02-24T09:09:27.210815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:16.802986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109422+0000","last_change":"2026-02-24T09:09:25.272707+0000","last_active":"2026-02-24T09:09:28.109422+0000","last_peered":"2026-02-24T09:09:28.109422+0000","last_clean":"2026-02-24T09:09:28.109422+0000","last_became_active":"2026-02-24T09:09:25.272563+0000","last_became_peered":"2026-02-24T09:09:25.272563+0000","last_unstale":"2026-02-24T09:09:28.109422+0000","last_undegraded":"2026-02-24T09:09:28.109422+0000","last_fullsized":"2026-02-24T09:09:28.109422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:41:22.895217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942219+0000","last_change":"2026-02-24T09:09:24.256493+0000","last_active":"2026-02-24T09:09:28.942219+0000","last_peered":"2026-02-24T09:09:28.942219+0000","last_clean":"2026-02-24T09:09:28.942219+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:28.942219+0000","last_undegraded":"2026-02-24T09:09:28.942219+0000","last_fullsized":"2026-02-24T09:09:28.942219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:43:12.259841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733528+0000","last_change":"2026-02-24T09:09:25.271977+0000","last_active":"2026-02-24T09:09:26.733528+0000","last_peered":"2026-02-24T09:09:26.733528+0000","last_clean":"2026-02-24T09:09:26.733528+0000","last_became_active":"2026-02-24T09:09:25.271650+0000","last_became_peered":"2026-02-24T09:09:25.271650+0000","last_unstale":"2026-02-24T09:09:26.733528+0000","last_undegraded":"2026-02-24T09:09:26.733528+0000","last_fullsized":"2026-02-24T09:09:26.733528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:10.062115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733207+0000","last_change":"2026-02-24T09:09:05.953512+0000","last_active":"2026-02-24T09:09:26.733207+0000","last_peered":"2026-02-24T09:09:26.733207+0000","last_clean":"2026-02-24T09:09:26.733207+0000","last_became_active":"2026-02-24T09:09:05.953360+0000","last_became_peered":"2026-02-24T09:09:05.953360+0000","last_unstale":"2026-02-24T09:09:26.733207+0000","last_undegraded":"2026-02-24T09:09:26.733207+0000","last_fullsized":"2026-02-24T09:09:26.733207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_clean_scrub_stamp":"2026-02-24T09:08:00.445410+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:48.550493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.945604+0000","last_change":"2026-02-24T09:09:24.259164+0000","last_active":"2026-02-24T09:09:29.945604+0000","last_peered":"2026-02-24T09:09:29.945604+0000","last_clean":"2026-02-24T09:09:29.945604+0000","last_became_active":"2026-02-24T09:09:24.259011+0000","last_became_peered":"2026-02-24T09:09:24.259011+0000","last_unstale":"2026-02-24T09:09:29.945604+0000","last_undegraded":"2026-02-24T09:09:29.945604+0000","last_fullsized":"2026-02-24T09:09:29.945604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:41.649484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268864+0000","last_change":"2026-02-24T09:09:25.269884+0000","last_active":"2026-02-24T09:09:26.268864+0000","last_peered":"2026-02-24T09:09:26.268864+0000","last_clean":"2026-02-24T09:09:26.268864+0000","last_became_active":"2026-02-24T09:09:25.269543+0000","last_became_peered":"2026-02-24T09:09:25.269543+0000","last_unstale":"2026-02-24T09:09:26.268864+0000","last_undegraded":"2026-02-24T09:09:26.268864+0000","last_fullsized":"2026-02-24T09:09:26.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:21:25.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943350+0000","last_change":"2026-02-24T09:09:24.259369+0000","last_active":"2026-02-24T09:09:28.943350+0000","last_peered":"2026-02-24T09:09:28.943350+0000","last_clean":"2026-02-24T09:09:28.943350+0000","last_became_active":"2026-02-24T09:09:24.259086+0000","last_became_peered":"2026-02-24T09:09:24.259086+0000","last_unstale":"2026-02-24T09:09:28.943350+0000","last_undegraded":"2026-02-24T09:09:28.943350+0000","last_fullsized":"2026-02-24T09:09:28.943350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:08.881900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332119+0000","last_change":"2026-02-24T09:09:25.266898+0000","last_active":"2026-02-24T09:09:26.332119+0000","last_peered":"2026-02-24T09:09:26.332119+0000","last_clean":"2026-02-24T09:09:26.332119+0000","last_became_active":"2026-02-24T09:09:25.266407+0000","last_became_peered":"2026-02-24T09:09:25.266407+0000","last_unstale":"2026-02-24T09:09:26.332119+0000","last_undegraded":"2026-02-24T09:09:26.332119+0000","last_fullsized":"2026-02-24T09:09:26.332119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:51.887929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:48.959424+0000","last_change":"2026-02-24T09:09:24.254126+0000","last_active":"2026-02-24T09:09:48.959424+0000","last_peered":"2026-02-24T09:09:48.959424+0000","last_clean":"2026-02-24T09:09:48.959424+0000","last_became_active":"2026-02-24T09:09:24.253911+0000","last_became_peered":"2026-02-24T09:09:24.253911+0000","last_unstale":"2026-02-24T09:09:48.959424+0000","last_undegraded":"2026-02-24T09:09:48.959424+0000","last_fullsized":"2026-02-24T09:09:48.959424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:09:56.146842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268161+0000","last_change":"2026-02-24T09:09:25.270387+0000","last_active":"2026-02-24T09:09:26.268161+0000","last_peered":"2026-02-24T09:09:26.268161+0000","last_clean":"2026-02-24T09:09:26.268161+0000","last_became_active":"2026-02-24T09:09:25.269478+0000","last_became_peered":"2026-02-24T09:09:25.269478+0000","last_unstale":"2026-02-24T09:09:26.268161+0000","last_undegraded":"2026-02-24T09:09:26.268161+0000","last_fullsized":"2026-02-24T09:09:26.268161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:32:15.217221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109411+0000","last_change":"2026-02-24T09:09:24.259169+0000","last_active":"2026-02-24T09:09:28.109411+0000","last_peered":"2026-02-24T09:09:28.109411+0000","last_clean":"2026-02-24T09:09:28.109411+0000","last_became_active":"2026-02-24T09:09:24.258755+0000","last_became_peered":"2026-02-24T09:09:24.258755+0000","last_unstale":"2026-02-24T09:09:28.109411+0000","last_undegraded":"2026-02-24T09:09:28.109411+0000","last_fullsized":"2026-02-24T09:09:28.109411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:33.438504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270152+0000","last_change":"2026-02-24T09:09:25.270732+0000","last_active":"2026-02-24T09:09:26.270152+0000","last_peered":"2026-02-24T09:09:26.270152+0000","last_clean":"2026-02-24T09:09:26.270152+0000","last_became_active":"2026-02-24T09:09:25.270200+0000","last_became_peered":"2026-02-24T09:09:25.270200+0000","last_unstale":"2026-02-24T09:09:26.270152+0000","last_undegraded":"2026-02-24T09:09:26.270152+0000","last_fullsized":"2026-02-24T09:09:26.270152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:59:28.115196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267351+0000","last_change":"2026-02-24T09:09:24.257488+0000","last_active":"2026-02-24T09:09:26.267351+0000","last_peered":"2026-02-24T09:09:26.267351+0000","last_clean":"2026-02-24T09:09:26.267351+0000","last_became_active":"2026-02-24T09:09:24.257202+0000","last_became_peered":"2026-02-24T09:09:24.257202+0000","last_unstale":"2026-02-24T09:09:26.267351+0000","last_undegraded":"2026-02-24T09:09:26.267351+0000","last_fullsized":"2026-02-24T09:09:26.267351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:41:24.345307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.674896+0000","last_change":"2026-02-24T09:09:25.272254+0000","last_active":"2026-02-24T09:09:26.674896+0000","last_peered":"2026-02-24T09:09:26.674896+0000","last_clean":"2026-02-24T09:09:26.674896+0000","last_became_active":"2026-02-24T09:09:25.271674+0000","last_became_peered":"2026-02-24T09:09:25.271674+0000","last_unstale":"2026-02-24T09:09:26.674896+0000","last_undegraded":"2026-02-24T09:09:26.674896+0000","last_fullsized":"2026-02-24T09:09:26.674896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:03:26.493850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938246+0000","last_change":"2026-02-24T09:09:24.257331+0000","last_active":"2026-02-24T09:09:27.938246+0000","last_peered":"2026-02-24T09:09:27.938246+0000","last_clean":"2026-02-24T09:09:27.938246+0000","last_became_active":"2026-02-24T09:09:24.256876+0000","last_became_peered":"2026-02-24T09:09:24.256876+0000","last_unstale":"2026-02-24T09:09:27.938246+0000","last_undegraded":"2026-02-24T09:09:27.938246+0000","last_fullsized":"2026-02-24T09:09:27.938246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:29:58.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332332+0000","last_change":"2026-02-24T09:09:25.266642+0000","last_active":"2026-02-24T09:09:26.332332+0000","last_peered":"2026-02-24T09:09:26.332332+0000","last_clean":"2026-02-24T09:09:26.332332+0000","last_became_active":"2026-02-24T09:09:25.266307+0000","last_became_peered":"2026-02-24T09:09:25.266307+0000","last_unstale":"2026-02-24T09:09:26.332332+0000","last_undegraded":"2026-02-24T09:09:26.332332+0000","last_fullsized":"2026-02-24T09:09:26.332332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:51.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:37.268830+0000","last_change":"2026-02-24T09:09:24.258807+0000","last_active":"2026-02-24T09:09:37.268830+0000","last_peered":"2026-02-24T09:09:37.268830+0000","last_clean":"2026-02-24T09:09:37.268830+0000","last_became_active":"2026-02-24T09:09:24.258649+0000","last_became_peered":"2026-02-24T09:09:24.258649+0000","last_unstale":"2026-02-24T09:09:37.268830+0000","last_undegraded":"2026-02-24T09:09:37.268830+0000","last_fullsized":"2026-02-24T09:09:37.268830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:10:48.348275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269009+0000","last_change":"2026-02-24T09:09:25.268491+0000","last_active":"2026-02-24T09:09:26.269009+0000","last_peered":"2026-02-24T09:09:26.269009+0000","last_clean":"2026-02-24T09:09:26.269009+0000","last_became_active":"2026-02-24T09:09:25.267341+0000","last_became_peered":"2026-02-24T09:09:25.267341+0000","last_unstale":"2026-02-24T09:09:26.269009+0000","last_undegraded":"2026-02-24T09:09:26.269009+0000","last_fullsized":"2026-02-24T09:09:26.269009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:18:29.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940964+0000","last_change":"2026-02-24T09:09:24.258484+0000","last_active":"2026-02-24T09:09:27.940964+0000","last_peered":"2026-02-24T09:09:27.940964+0000","last_clean":"2026-02-24T09:09:27.940964+0000","last_became_active":"2026-02-24T09:09:24.258249+0000","last_became_peered":"2026-02-24T09:09:24.258249+0000","last_unstale":"2026-02-24T09:09:27.940964+0000","last_undegraded":"2026-02-24T09:09:27.940964+0000","last_fullsized":"2026-02-24T09:09:27.940964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:32:56.722522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267783+0000","last_change":"2026-02-24T09:09:25.269738+0000","last_active":"2026-02-24T09:09:26.267783+0000","last_peered":"2026-02-24T09:09:26.267783+0000","last_clean":"2026-02-24T09:09:26.267783+0000","last_became_active":"2026-02-24T09:09:25.269413+0000","last_became_peered":"2026-02-24T09:09:25.269413+0000","last_unstale":"2026-02-24T09:09:26.267783+0000","last_undegraded":"2026-02-24T09:09:26.267783+0000","last_fullsized":"2026-02-24T09:09:26.267783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:00.412570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941334+0000","last_change":"2026-02-24T09:09:24.258901+0000","last_active":"2026-02-24T09:09:27.941334+0000","last_peered":"2026-02-24T09:09:27.941334+0000","last_clean":"2026-02-24T09:09:27.941334+0000","last_became_active":"2026-02-24T09:09:24.258325+0000","last_became_peered":"2026-02-24T09:09:24.258325+0000","last_unstale":"2026-02-24T09:09:27.941334+0000","last_undegraded":"2026-02-24T09:09:27.941334+0000","last_fullsized":"2026-02-24T09:09:27.941334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:36.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267522+0000","last_change":"2026-02-24T09:09:25.267368+0000","last_active":"2026-02-24T09:09:26.267522+0000","last_peered":"2026-02-24T09:09:26.267522+0000","last_clean":"2026-02-24T09:09:26.267522+0000","last_became_active":"2026-02-24T09:09:25.267168+0000","last_became_peered":"2026-02-24T09:09:25.267168+0000","last_unstale":"2026-02-24T09:09:26.267522+0000","last_undegraded":"2026-02-24T09:09:26.267522+0000","last_fullsized":"2026-02-24T09:09:26.267522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:57.616866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.939140+0000","last_change":"2026-02-24T09:09:24.257345+0000","last_active":"2026-02-24T09:09:27.939140+0000","last_peered":"2026-02-24T09:09:27.939140+0000","last_clean":"2026-02-24T09:09:27.939140+0000","last_became_active":"2026-02-24T09:09:24.256817+0000","last_became_peered":"2026-02-24T09:09:24.256817+0000","last_unstale":"2026-02-24T09:09:27.939140+0000","last_undegraded":"2026-02-24T09:09:27.939140+0000","last_fullsized":"2026-02-24T09:09:27.939140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:37:48.042471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332527+0000","last_change":"2026-02-24T09:09:25.267778+0000","last_active":"2026-02-24T09:09:26.332527+0000","last_peered":"2026-02-24T09:09:26.332527+0000","last_clean":"2026-02-24T09:09:26.332527+0000","last_became_active":"2026-02-24T09:09:25.267379+0000","last_became_peered":"2026-02-24T09:09:25.267379+0000","last_unstale":"2026-02-24T09:09:26.332527+0000","last_undegraded":"2026-02-24T09:09:26.332527+0000","last_fullsized":"2026-02-24T09:09:26.332527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:25:47.194857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.121396+0000","last_change":"2026-02-24T09:09:24.259141+0000","last_active":"2026-02-24T09:09:28.121396+0000","last_peered":"2026-02-24T09:09:28.121396+0000","last_clean":"2026-02-24T09:09:28.121396+0000","last_became_active":"2026-02-24T09:09:24.258981+0000","last_became_peered":"2026-02-24T09:09:24.258981+0000","last_unstale":"2026-02-24T09:09:28.121396+0000","last_undegraded":"2026-02-24T09:09:28.121396+0000","last_fullsized":"2026-02-24T09:09:28.121396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:48.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268774+0000","last_change":"2026-02-24T09:09:25.268540+0000","last_active":"2026-02-24T09:09:26.268774+0000","last_peered":"2026-02-24T09:09:26.268774+0000","last_clean":"2026-02-24T09:09:26.268774+0000","last_became_active":"2026-02-24T09:09:25.267915+0000","last_became_peered":"2026-02-24T09:09:25.267915+0000","last_unstale":"2026-02-24T09:09:26.268774+0000","last_undegraded":"2026-02-24T09:09:26.268774+0000","last_fullsized":"2026-02-24T09:09:26.268774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:55.564971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938005+0000","last_change":"2026-02-24T09:09:24.257964+0000","last_active":"2026-02-24T09:09:27.938005+0000","last_peered":"2026-02-24T09:09:27.938005+0000","last_clean":"2026-02-24T09:09:27.938005+0000","last_became_active":"2026-02-24T09:09:24.257717+0000","last_became_peered":"2026-02-24T09:09:24.257717+0000","last_unstale":"2026-02-24T09:09:27.938005+0000","last_undegraded":"2026-02-24T09:09:27.938005+0000","last_fullsized":"2026-02-24T09:09:27.938005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:23:24.989893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733433+0000","last_change":"2026-02-24T09:09:25.271214+0000","last_active":"2026-02-24T09:09:26.733433+0000","last_peered":"2026-02-24T09:09:26.733433+0000","last_clean":"2026-02-24T09:09:26.733433+0000","last_became_active":"2026-02-24T09:09:25.271038+0000","last_became_peered":"2026-02-24T09:09:25.271038+0000","last_unstale":"2026-02-24T09:09:26.733433+0000","last_undegraded":"2026-02-24T09:09:26.733433+0000","last_fullsized":"2026-02-24T09:09:26.733433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:58:44.899837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268097+0000","last_change":"2026-02-24T09:09:25.269834+0000","last_active":"2026-02-24T09:09:26.268097+0000","last_peered":"2026-02-24T09:09:26.268097+0000","last_clean":"2026-02-24T09:09:26.268097+0000","last_became_active":"2026-02-24T09:09:25.269526+0000","last_became_peered":"2026-02-24T09:09:25.269526+0000","last_unstale":"2026-02-24T09:09:26.268097+0000","last_undegraded":"2026-02-24T09:09:26.268097+0000","last_fullsized":"2026-02-24T09:09:26.268097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:36:54.610640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267687+0000","last_change":"2026-02-24T09:09:24.258597+0000","last_active":"2026-02-24T09:09:26.267687+0000","last_peered":"2026-02-24T09:09:26.267687+0000","last_clean":"2026-02-24T09:09:26.267687+0000","last_became_active":"2026-02-24T09:09:24.258302+0000","last_became_peered":"2026-02-24T09:09:24.258302+0000","last_unstale":"2026-02-24T09:09:26.267687+0000","last_undegraded":"2026-02-24T09:09:26.267687+0000","last_fullsized":"2026-02-24T09:09:26.267687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:20:15.556479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334746+0000","last_change":"2026-02-24T09:09:25.269804+0000","last_active":"2026-02-24T09:09:26.334746+0000","last_peered":"2026-02-24T09:09:26.334746+0000","last_clean":"2026-02-24T09:09:26.334746+0000","last_became_active":"2026-02-24T09:09:25.268973+0000","last_became_peered":"2026-02-24T09:09:25.268973+0000","last_unstale":"2026-02-24T09:09:26.334746+0000","last_undegraded":"2026-02-24T09:09:26.334746+0000","last_fullsized":"2026-02-24T09:09:26.334746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:33:39.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942003+0000","last_change":"2026-02-24T09:09:24.257428+0000","last_active":"2026-02-24T09:09:28.942003+0000","last_peered":"2026-02-24T09:09:28.942003+0000","last_clean":"2026-02-24T09:09:28.942003+0000","last_became_active":"2026-02-24T09:09:24.256679+0000","last_became_peered":"2026-02-24T09:09:24.256679+0000","last_unstale":"2026-02-24T09:09:28.942003+0000","last_undegraded":"2026-02-24T09:09:28.942003+0000","last_fullsized":"2026-02-24T09:09:28.942003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:39:28.664820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267792+0000","last_change":"2026-02-24T09:09:25.268127+0000","last_active":"2026-02-24T09:09:26.267792+0000","last_peered":"2026-02-24T09:09:26.267792+0000","last_clean":"2026-02-24T09:09:26.267792+0000","last_became_active":"2026-02-24T09:09:25.267860+0000","last_became_peered":"2026-02-24T09:09:25.267860+0000","last_unstale":"2026-02-24T09:09:26.267792+0000","last_undegraded":"2026-02-24T09:09:26.267792+0000","last_fullsized":"2026-02-24T09:09:26.267792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:37:52.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269053+0000","last_change":"2026-02-24T09:09:24.257552+0000","last_active":"2026-02-24T09:09:26.269053+0000","last_peered":"2026-02-24T09:09:26.269053+0000","last_clean":"2026-02-24T09:09:26.269053+0000","last_became_active":"2026-02-24T09:09:24.257163+0000","last_became_peered":"2026-02-24T09:09:24.257163+0000","last_unstale":"2026-02-24T09:09:26.269053+0000","last_undegraded":"2026-02-24T09:09:26.269053+0000","last_fullsized":"2026-02-24T09:09:26.269053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:30:54.285800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268961+0000","last_change":"2026-02-24T09:09:25.268695+0000","last_active":"2026-02-24T09:09:26.268961+0000","last_peered":"2026-02-24T09:09:26.268961+0000","last_clean":"2026-02-24T09:09:26.268961+0000","last_became_active":"2026-02-24T09:09:25.268128+0000","last_became_peered":"2026-02-24T09:09:25.268128+0000","last_unstale":"2026-02-24T09:09:26.268961+0000","last_undegraded":"2026-02-24T09:09:26.268961+0000","last_fullsized":"2026-02-24T09:09:26.268961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:23.987958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942226+0000","last_change":"2026-02-24T09:09:24.257602+0000","last_active":"2026-02-24T09:09:28.942226+0000","last_peered":"2026-02-24T09:09:28.942226+0000","last_clean":"2026-02-24T09:09:28.942226+0000","last_became_active":"2026-02-24T09:09:24.257440+0000","last_became_peered":"2026-02-24T09:09:24.257440+0000","last_unstale":"2026-02-24T09:09:28.942226+0000","last_undegraded":"2026-02-24T09:09:28.942226+0000","last_fullsized":"2026-02-24T09:09:28.942226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:13:51.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71404,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":135,"num_read_kb":143,"num_write":155,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":215667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119920,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":259322,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710732,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":395125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":27582038},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939659,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27916,"kb_used_data":952,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975284,"statfs":{"total":751619276800,"available":751590690816,"internally_reserved":0,"allocated":974848,"data_stored":1054370,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23856,"internal_metadata":27566800},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070478,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24845,"internal_metadata":27565811},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299407,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32956,"internal_metadata":27557700},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528337,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":987230,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28867,"internal_metadata":27561789},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659155,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":394740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888083,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":986504,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":32062,"internal_metadata":27558594},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018901,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31416,"internal_metadata":27559240},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247832,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":395051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47059,"internal_metadata":27543597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476760,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27856,"kb_used_data":892,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975344,"statfs":{"total":751619276800,"available":751590752256,"internally_reserved":0,"allocated":913408,"data_stored":463247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34581,"internal_metadata":27556075},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607578,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27832,"kb_used_data":868,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975368,"statfs":{"total":751619276800,"available":751590776832,"internally_reserved":0,"allocated":888832,"data_stored":463342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49917,"internal_metadata":27540739},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11012,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12011,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13952,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6329,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13842,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3422,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31362,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9492,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13536,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:09:52.399 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T09:09:52.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.495+0000 7f71c88c3640 1 -- 10.20.193.4:0/395425094 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71c010f210 msgr2=0x7f71c010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.495+0000 7f71c88c3640 1 --2- 10.20.193.4:0/395425094 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71c010f210 0x7f71c010f600 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=422983760348841166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71b8009950 tx=0x7f71b802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.495+0000 7f71c88c3640 1 -- 10.20.193.4:0/395425094 shutdown_connections 2026-02-24T09:09:52.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.495+0000 7f71c88c3640 1 --2- 10.20.193.4:0/395425094 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71c0110d50 0x7f71c01716e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.495+0000 7f71c88c3640 1 --2- 10.20.193.4:0/395425094 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71c01103a0 0x7f71c0110810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.495+0000 7f71c88c3640 1 --2- 10.20.193.4:0/395425094 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71c010f210 0x7f71c010f600 unknown :-1 s=CLOSED pgs=427 gs=1 cs=0 l=1 c_cookie=422983760348841166 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.495+0000 7f71c88c3640 1 -- 10.20.193.4:0/395425094 >> 10.20.193.4:0/395425094 conn(0x7f71c00ec920 msgr2=0x7f71c010cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.495+0000 7f71c88c3640 1 -- 10.20.193.4:0/395425094 shutdown_connections 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.495+0000 7f71c88c3640 1 -- 10.20.193.4:0/395425094 wait complete. 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c88c3640 1 Processor -- start 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c88c3640 1 -- start start 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c88c3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71c010f210 0x7f71c00f88d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c88c3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71c01103a0 0x7f71c01716e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c88c3640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71c0110d50 0x7f71c00f9130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c88c3640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00f9d20 con 0x7f71c01103a0 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c88c3640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00f9e90 con 0x7f71c0110d50 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c88c3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00fa050 con 0x7f71c010f210 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c5e37640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71c01103a0 0x7f71c01716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c5e37640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71c01103a0 0x7f71c01716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34054/0 (socket says 10.20.193.4:34054) 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c5e37640 1 -- 10.20.193.4:0/3817892411 learned_addr learned my addr 10.20.193.4:0/3817892411 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c6638640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71c010f210 0x7f71c00f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c6e39640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71c0110d50 0x7f71c00f9130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c5e37640 1 -- 10.20.193.4:0/3817892411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71c010f210 msgr2=0x7f71c00f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c5e37640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71c010f210 0x7f71c00f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c5e37640 1 -- 10.20.193.4:0/3817892411 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71c0110d50 msgr2=0x7f71c00f9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c5e37640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71c0110d50 0x7f71c00f9130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c5e37640 1 -- 10.20.193.4:0/3817892411 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b8009570 con 0x7f71c01103a0 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c6e39640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71c0110d50 0x7f71c00f9130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c5e37640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71c01103a0 0x7f71c01716e0 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71ac00b500 tx=0x7f71ac00b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71ab7fe640 1 -- 10.20.193.4:0/3817892411 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71ac0044a0 con 0x7f71c01103a0 2026-02-24T09:09:52.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c88c3640 1 -- 10.20.193.4:0/3817892411 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c00fa330 con 0x7f71c01103a0 2026-02-24T09:09:52.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71ab7fe640 1 -- 10.20.193.4:0/3817892411 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71ac002b80 con 0x7f71c01103a0 2026-02-24T09:09:52.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71ab7fe640 1 -- 10.20.193.4:0/3817892411 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71ac00fd90 con 0x7f71c01103a0 2026-02-24T09:09:52.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.496+0000 7f71c88c3640 1 -- 10.20.193.4:0/3817892411 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c00fa880 con 0x7f71c01103a0 2026-02-24T09:09:52.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.497+0000 7f71c88c3640 1 -- 10.20.193.4:0/3817892411 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c0175760 con 0x7f71c01103a0 2026-02-24T09:09:52.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.498+0000 7f71ab7fe640 1 -- 10.20.193.4:0/3817892411 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f71ac002cf0 con 0x7f71c01103a0 2026-02-24T09:09:52.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.499+0000 7f71ab7fe640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f719c0b5770 0x7f719c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.499+0000 7f71c6638640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f719c0b5770 0x7f719c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.499+0000 7f71ab7fe640 1 -- 10.20.193.4:0/3817892411 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f71ac0e66b0 con 0x7f71c01103a0 2026-02-24T09:09:52.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.499+0000 7f71c6638640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f719c0b5770 0x7f719c0d5c20 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71b8005b30 tx=0x7f71b803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:52.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.500+0000 7f71ab7fe640 1 -- 10.20.193.4:0/3817892411 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f71ac0a9110 con 0x7f71c01103a0 2026-02-24T09:09:52.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.606+0000 7f71c88c3640 1 -- 10.20.193.4:0/3817892411 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71c0174e70 con 0x7f719c0b5770 2026-02-24T09:09:52.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.608+0000 7f71ab7fe640 1 -- 10.20.193.4:0/3817892411 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7f71c0174e70 con 0x7f719c0b5770 2026-02-24T09:09:52.614 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:52.616 INFO:teuthology.orchestra.run.trial004.stderr:dumped all 2026-02-24T09:09:52.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 -- 10.20.193.4:0/3817892411 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f719c0b5770 msgr2=0x7f719c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f719c0b5770 0x7f719c0d5c20 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71b8005b30 tx=0x7f71b803a040 comp rx=0 tx=0).stop 2026-02-24T09:09:52.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 -- 10.20.193.4:0/3817892411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71c01103a0 msgr2=0x7f71c01716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71c01103a0 0x7f71c01716e0 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71ac00b500 tx=0x7f71ac00b9d0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 -- 10.20.193.4:0/3817892411 shutdown_connections 2026-02-24T09:09:52.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f719c0b5770 0x7f719c0d5c20 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71c0110d50 0x7f71c00f9130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71c01103a0 0x7f71c01716e0 unknown :-1 s=CLOSED pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 --2- 10.20.193.4:0/3817892411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71c010f210 0x7f71c00f88d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 -- 10.20.193.4:0/3817892411 >> 10.20.193.4:0/3817892411 conn(0x7f71c00ec920 msgr2=0x7f71c00eeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:52.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 -- 10.20.193.4:0/3817892411 shutdown_connections 2026-02-24T09:09:52.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.610+0000 7f71c88c3640 1 -- 10.20.193.4:0/3817892411 wait complete. 2026-02-24T09:09:52.621 INFO:teuthology.orchestra.run.trial004.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2026-02-24T09:09:51.668575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662006,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":241,"num_read_kb":234,"num_write":346,"num_write_kb":3837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333672,"kb_used_data":10104,"kb_used_omap":377,"kb_used_meta":322950,"kb_avail":8807704728,"statfs":{"total":9019431321600,"available":9019089641472,"internally_reserved":0,"allocated":10346496,"data_stored":6721869,"data_compressed":113181,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":386873,"internal_metadata":330700999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15110,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":5,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002256"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332664+0000","last_change":"2026-02-24T09:09:25.267627+0000","last_active":"2026-02-24T09:09:26.332664+0000","last_peered":"2026-02-24T09:09:26.332664+0000","last_clean":"2026-02-24T09:09:26.332664+0000","last_became_active":"2026-02-24T09:09:25.267439+0000","last_became_peered":"2026-02-24T09:09:25.267439+0000","last_unstale":"2026-02-24T09:09:26.332664+0000","last_undegraded":"2026-02-24T09:09:26.332664+0000","last_fullsized":"2026-02-24T09:09:26.332664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:24.034680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267727+0000","last_change":"2026-02-24T09:09:25.267299+0000","last_active":"2026-02-24T09:09:26.267727+0000","last_peered":"2026-02-24T09:09:26.267727+0000","last_clean":"2026-02-24T09:09:26.267727+0000","last_became_active":"2026-02-24T09:09:25.266956+0000","last_became_peered":"2026-02-24T09:09:25.266956+0000","last_unstale":"2026-02-24T09:09:26.267727+0000","last_undegraded":"2026-02-24T09:09:26.267727+0000","last_fullsized":"2026-02-24T09:09:26.267727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:05.466777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267738+0000","last_change":"2026-02-24T09:09:25.268761+0000","last_active":"2026-02-24T09:09:26.267738+0000","last_peered":"2026-02-24T09:09:26.267738+0000","last_clean":"2026-02-24T09:09:26.267738+0000","last_became_active":"2026-02-24T09:09:25.268476+0000","last_became_peered":"2026-02-24T09:09:25.268476+0000","last_unstale":"2026-02-24T09:09:26.267738+0000","last_undegraded":"2026-02-24T09:09:26.267738+0000","last_fullsized":"2026-02-24T09:09:26.267738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:26:00.680116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335046+0000","last_change":"2026-02-24T09:09:25.271303+0000","last_active":"2026-02-24T09:09:26.335046+0000","last_peered":"2026-02-24T09:09:26.335046+0000","last_clean":"2026-02-24T09:09:26.335046+0000","last_became_active":"2026-02-24T09:09:25.271175+0000","last_became_peered":"2026-02-24T09:09:25.271175+0000","last_unstale":"2026-02-24T09:09:26.335046+0000","last_undegraded":"2026-02-24T09:09:26.335046+0000","last_fullsized":"2026-02-24T09:09:26.335046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:55:25.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267634+0000","last_change":"2026-02-24T09:09:25.267923+0000","last_active":"2026-02-24T09:09:26.267634+0000","last_peered":"2026-02-24T09:09:26.267634+0000","last_clean":"2026-02-24T09:09:26.267634+0000","last_became_active":"2026-02-24T09:09:25.267775+0000","last_became_peered":"2026-02-24T09:09:25.267775+0000","last_unstale":"2026-02-24T09:09:26.267634+0000","last_undegraded":"2026-02-24T09:09:26.267634+0000","last_fullsized":"2026-02-24T09:09:26.267634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:54:25.575849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270023+0000","last_change":"2026-02-24T09:09:25.269603+0000","last_active":"2026-02-24T09:09:26.270023+0000","last_peered":"2026-02-24T09:09:26.270023+0000","last_clean":"2026-02-24T09:09:26.270023+0000","last_became_active":"2026-02-24T09:09:25.269057+0000","last_became_peered":"2026-02-24T09:09:25.269057+0000","last_unstale":"2026-02-24T09:09:26.270023+0000","last_undegraded":"2026-02-24T09:09:26.270023+0000","last_fullsized":"2026-02-24T09:09:26.270023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:39:21.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733238+0000","last_change":"2026-02-24T09:09:25.270852+0000","last_active":"2026-02-24T09:09:26.733238+0000","last_peered":"2026-02-24T09:09:26.733238+0000","last_clean":"2026-02-24T09:09:26.733238+0000","last_became_active":"2026-02-24T09:09:25.270607+0000","last_became_peered":"2026-02-24T09:09:25.270607+0000","last_unstale":"2026-02-24T09:09:26.733238+0000","last_undegraded":"2026-02-24T09:09:26.733238+0000","last_fullsized":"2026-02-24T09:09:26.733238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:45:43.574810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268619+0000","last_change":"2026-02-24T09:09:25.268833+0000","last_active":"2026-02-24T09:09:26.268619+0000","last_peered":"2026-02-24T09:09:26.268619+0000","last_clean":"2026-02-24T09:09:26.268619+0000","last_became_active":"2026-02-24T09:09:25.268462+0000","last_became_peered":"2026-02-24T09:09:25.268462+0000","last_unstale":"2026-02-24T09:09:26.268619+0000","last_undegraded":"2026-02-24T09:09:26.268619+0000","last_fullsized":"2026-02-24T09:09:26.268619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:47.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334895+0000","last_change":"2026-02-24T09:09:25.271419+0000","last_active":"2026-02-24T09:09:26.334895+0000","last_peered":"2026-02-24T09:09:26.334895+0000","last_clean":"2026-02-24T09:09:26.334895+0000","last_became_active":"2026-02-24T09:09:25.270954+0000","last_became_peered":"2026-02-24T09:09:25.270954+0000","last_unstale":"2026-02-24T09:09:26.334895+0000","last_undegraded":"2026-02-24T09:09:26.334895+0000","last_fullsized":"2026-02-24T09:09:26.334895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:07:15.889565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270286+0000","last_change":"2026-02-24T09:09:25.269709+0000","last_active":"2026-02-24T09:09:26.270286+0000","last_peered":"2026-02-24T09:09:26.270286+0000","last_clean":"2026-02-24T09:09:26.270286+0000","last_became_active":"2026-02-24T09:09:25.269136+0000","last_became_peered":"2026-02-24T09:09:25.269136+0000","last_unstale":"2026-02-24T09:09:26.270286+0000","last_undegraded":"2026-02-24T09:09:26.270286+0000","last_fullsized":"2026-02-24T09:09:26.270286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:42:02.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733508+0000","last_change":"2026-02-24T09:09:25.272025+0000","last_active":"2026-02-24T09:09:26.733508+0000","last_peered":"2026-02-24T09:09:26.733508+0000","last_clean":"2026-02-24T09:09:26.733508+0000","last_became_active":"2026-02-24T09:09:25.271851+0000","last_became_peered":"2026-02-24T09:09:25.271851+0000","last_unstale":"2026-02-24T09:09:26.733508+0000","last_undegraded":"2026-02-24T09:09:26.733508+0000","last_fullsized":"2026-02-24T09:09:26.733508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:49:57.365130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335160+0000","last_change":"2026-02-24T09:09:25.271156+0000","last_active":"2026-02-24T09:09:26.335160+0000","last_peered":"2026-02-24T09:09:26.335160+0000","last_clean":"2026-02-24T09:09:26.335160+0000","last_became_active":"2026-02-24T09:09:25.270992+0000","last_became_peered":"2026-02-24T09:09:25.270992+0000","last_unstale":"2026-02-24T09:09:26.335160+0000","last_undegraded":"2026-02-24T09:09:26.335160+0000","last_fullsized":"2026-02-24T09:09:26.335160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:56.324038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332309+0000","last_change":"2026-02-24T09:09:25.266871+0000","last_active":"2026-02-24T09:09:26.332309+0000","last_peered":"2026-02-24T09:09:26.332309+0000","last_clean":"2026-02-24T09:09:26.332309+0000","last_became_active":"2026-02-24T09:09:25.266438+0000","last_became_peered":"2026-02-24T09:09:25.266438+0000","last_unstale":"2026-02-24T09:09:26.332309+0000","last_undegraded":"2026-02-24T09:09:26.332309+0000","last_fullsized":"2026-02-24T09:09:26.332309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:24:17.014313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267591+0000","last_change":"2026-02-24T09:09:25.266851+0000","last_active":"2026-02-24T09:09:26.267591+0000","last_peered":"2026-02-24T09:09:26.267591+0000","last_clean":"2026-02-24T09:09:26.267591+0000","last_became_active":"2026-02-24T09:09:25.266530+0000","last_became_peered":"2026-02-24T09:09:25.266530+0000","last_unstale":"2026-02-24T09:09:26.267591+0000","last_undegraded":"2026-02-24T09:09:26.267591+0000","last_fullsized":"2026-02-24T09:09:26.267591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:53.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267465+0000","last_change":"2026-02-24T09:09:25.269561+0000","last_active":"2026-02-24T09:09:26.267465+0000","last_peered":"2026-02-24T09:09:26.267465+0000","last_clean":"2026-02-24T09:09:26.267465+0000","last_became_active":"2026-02-24T09:09:25.268979+0000","last_became_peered":"2026-02-24T09:09:25.268979+0000","last_unstale":"2026-02-24T09:09:26.267465+0000","last_undegraded":"2026-02-24T09:09:26.267465+0000","last_fullsized":"2026-02-24T09:09:26.267465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:16:56.110766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334540+0000","last_change":"2026-02-24T09:09:25.271426+0000","last_active":"2026-02-24T09:09:26.334540+0000","last_peered":"2026-02-24T09:09:26.334540+0000","last_clean":"2026-02-24T09:09:26.334540+0000","last_became_active":"2026-02-24T09:09:25.270917+0000","last_became_peered":"2026-02-24T09:09:25.270917+0000","last_unstale":"2026-02-24T09:09:26.334540+0000","last_undegraded":"2026-02-24T09:09:26.334540+0000","last_fullsized":"2026-02-24T09:09:26.334540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:58:52.125871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332673+0000","last_change":"2026-02-24T09:09:25.267238+0000","last_active":"2026-02-24T09:09:26.332673+0000","last_peered":"2026-02-24T09:09:26.332673+0000","last_clean":"2026-02-24T09:09:26.332673+0000","last_became_active":"2026-02-24T09:09:25.267060+0000","last_became_peered":"2026-02-24T09:09:25.267060+0000","last_unstale":"2026-02-24T09:09:26.332673+0000","last_undegraded":"2026-02-24T09:09:26.332673+0000","last_fullsized":"2026-02-24T09:09:26.332673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:00:58.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267495+0000","last_change":"2026-02-24T09:09:25.266005+0000","last_active":"2026-02-24T09:09:26.267495+0000","last_peered":"2026-02-24T09:09:26.267495+0000","last_clean":"2026-02-24T09:09:26.267495+0000","last_became_active":"2026-02-24T09:09:25.265847+0000","last_became_peered":"2026-02-24T09:09:25.265847+0000","last_unstale":"2026-02-24T09:09:26.267495+0000","last_undegraded":"2026-02-24T09:09:26.267495+0000","last_fullsized":"2026-02-24T09:09:26.267495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:29:02.137351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332638+0000","last_change":"2026-02-24T09:09:25.268822+0000","last_active":"2026-02-24T09:09:26.332638+0000","last_peered":"2026-02-24T09:09:26.332638+0000","last_clean":"2026-02-24T09:09:26.332638+0000","last_became_active":"2026-02-24T09:09:25.268683+0000","last_became_peered":"2026-02-24T09:09:25.268683+0000","last_unstale":"2026-02-24T09:09:26.332638+0000","last_undegraded":"2026-02-24T09:09:26.332638+0000","last_fullsized":"2026-02-24T09:09:26.332638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:23:58.256403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332429+0000","last_change":"2026-02-24T09:09:25.266214+0000","last_active":"2026-02-24T09:09:26.332429+0000","last_peered":"2026-02-24T09:09:26.332429+0000","last_clean":"2026-02-24T09:09:26.332429+0000","last_became_active":"2026-02-24T09:09:25.266019+0000","last_became_peered":"2026-02-24T09:09:25.266019+0000","last_unstale":"2026-02-24T09:09:26.332429+0000","last_undegraded":"2026-02-24T09:09:26.332429+0000","last_fullsized":"2026-02-24T09:09:26.332429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:17.141581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332384+0000","last_change":"2026-02-24T09:09:25.267493+0000","last_active":"2026-02-24T09:09:26.332384+0000","last_peered":"2026-02-24T09:09:26.332384+0000","last_clean":"2026-02-24T09:09:26.332384+0000","last_became_active":"2026-02-24T09:09:25.267314+0000","last_became_peered":"2026-02-24T09:09:25.267314+0000","last_unstale":"2026-02-24T09:09:26.332384+0000","last_undegraded":"2026-02-24T09:09:26.332384+0000","last_fullsized":"2026-02-24T09:09:26.332384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:59:11.536214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334717+0000","last_change":"2026-02-24T09:09:25.272131+0000","last_active":"2026-02-24T09:09:26.334717+0000","last_peered":"2026-02-24T09:09:26.334717+0000","last_clean":"2026-02-24T09:09:26.334717+0000","last_became_active":"2026-02-24T09:09:25.271680+0000","last_became_peered":"2026-02-24T09:09:25.271680+0000","last_unstale":"2026-02-24T09:09:26.334717+0000","last_undegraded":"2026-02-24T09:09:26.334717+0000","last_fullsized":"2026-02-24T09:09:26.334717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:07:33.257865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268617+0000","last_change":"2026-02-24T09:09:25.267808+0000","last_active":"2026-02-24T09:09:26.268617+0000","last_peered":"2026-02-24T09:09:26.268617+0000","last_clean":"2026-02-24T09:09:26.268617+0000","last_became_active":"2026-02-24T09:09:25.266759+0000","last_became_peered":"2026-02-24T09:09:25.266759+0000","last_unstale":"2026-02-24T09:09:26.268617+0000","last_undegraded":"2026-02-24T09:09:26.268617+0000","last_fullsized":"2026-02-24T09:09:26.268617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:55.312047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268133+0000","last_change":"2026-02-24T09:09:25.268500+0000","last_active":"2026-02-24T09:09:26.268133+0000","last_peered":"2026-02-24T09:09:26.268133+0000","last_clean":"2026-02-24T09:09:26.268133+0000","last_became_active":"2026-02-24T09:09:25.267904+0000","last_became_peered":"2026-02-24T09:09:25.267904+0000","last_unstale":"2026-02-24T09:09:26.268133+0000","last_undegraded":"2026-02-24T09:09:26.268133+0000","last_fullsized":"2026-02-24T09:09:26.268133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:38:47.330593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269021+0000","last_change":"2026-02-24T09:09:25.269694+0000","last_active":"2026-02-24T09:09:26.269021+0000","last_peered":"2026-02-24T09:09:26.269021+0000","last_clean":"2026-02-24T09:09:26.269021+0000","last_became_active":"2026-02-24T09:09:25.269068+0000","last_became_peered":"2026-02-24T09:09:25.269068+0000","last_unstale":"2026-02-24T09:09:26.269021+0000","last_undegraded":"2026-02-24T09:09:26.269021+0000","last_fullsized":"2026-02-24T09:09:26.269021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:04:44.772275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332668+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.332668+0000","last_peered":"2026-02-24T09:09:26.332668+0000","last_clean":"2026-02-24T09:09:26.332668+0000","last_became_active":"2026-02-24T09:09:25.269534+0000","last_became_peered":"2026-02-24T09:09:25.269534+0000","last_unstale":"2026-02-24T09:09:26.332668+0000","last_undegraded":"2026-02-24T09:09:26.332668+0000","last_fullsized":"2026-02-24T09:09:26.332668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:45:51.428970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332478+0000","last_change":"2026-02-24T09:09:25.266779+0000","last_active":"2026-02-24T09:09:26.332478+0000","last_peered":"2026-02-24T09:09:26.332478+0000","last_clean":"2026-02-24T09:09:26.332478+0000","last_became_active":"2026-02-24T09:09:25.266603+0000","last_became_peered":"2026-02-24T09:09:25.266603+0000","last_unstale":"2026-02-24T09:09:26.332478+0000","last_undegraded":"2026-02-24T09:09:26.332478+0000","last_fullsized":"2026-02-24T09:09:26.332478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:01:38.198458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332295+0000","last_change":"2026-02-24T09:09:25.266933+0000","last_active":"2026-02-24T09:09:26.332295+0000","last_peered":"2026-02-24T09:09:26.332295+0000","last_clean":"2026-02-24T09:09:26.332295+0000","last_became_active":"2026-02-24T09:09:25.266381+0000","last_became_peered":"2026-02-24T09:09:25.266381+0000","last_unstale":"2026-02-24T09:09:26.332295+0000","last_undegraded":"2026-02-24T09:09:26.332295+0000","last_fullsized":"2026-02-24T09:09:26.332295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:45:44.657482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267754+0000","last_change":"2026-02-24T09:09:25.269576+0000","last_active":"2026-02-24T09:09:26.267754+0000","last_peered":"2026-02-24T09:09:26.267754+0000","last_clean":"2026-02-24T09:09:26.267754+0000","last_became_active":"2026-02-24T09:09:25.269159+0000","last_became_peered":"2026-02-24T09:09:25.269159+0000","last_unstale":"2026-02-24T09:09:26.267754+0000","last_undegraded":"2026-02-24T09:09:26.267754+0000","last_fullsized":"2026-02-24T09:09:26.267754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:23:37.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332345+0000","last_change":"2026-02-24T09:09:25.269282+0000","last_active":"2026-02-24T09:09:26.332345+0000","last_peered":"2026-02-24T09:09:26.332345+0000","last_clean":"2026-02-24T09:09:26.332345+0000","last_became_active":"2026-02-24T09:09:25.269088+0000","last_became_peered":"2026-02-24T09:09:25.269088+0000","last_unstale":"2026-02-24T09:09:26.332345+0000","last_undegraded":"2026-02-24T09:09:26.332345+0000","last_fullsized":"2026-02-24T09:09:26.332345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:49.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332404+0000","last_change":"2026-02-24T09:09:25.270968+0000","last_active":"2026-02-24T09:09:26.332404+0000","last_peered":"2026-02-24T09:09:26.332404+0000","last_clean":"2026-02-24T09:09:26.332404+0000","last_became_active":"2026-02-24T09:09:25.270816+0000","last_became_peered":"2026-02-24T09:09:25.270816+0000","last_unstale":"2026-02-24T09:09:26.332404+0000","last_undegraded":"2026-02-24T09:09:26.332404+0000","last_fullsized":"2026-02-24T09:09:26.332404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:10:08.592263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332360+0000","last_change":"2026-02-24T09:09:25.267715+0000","last_active":"2026-02-24T09:09:26.332360+0000","last_peered":"2026-02-24T09:09:26.332360+0000","last_clean":"2026-02-24T09:09:26.332360+0000","last_became_active":"2026-02-24T09:09:25.267031+0000","last_became_peered":"2026-02-24T09:09:25.267031+0000","last_unstale":"2026-02-24T09:09:26.332360+0000","last_undegraded":"2026-02-24T09:09:26.332360+0000","last_fullsized":"2026-02-24T09:09:26.332360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:14:50.568512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267758+0000","last_change":"2026-02-24T09:09:25.268347+0000","last_active":"2026-02-24T09:09:26.267758+0000","last_peered":"2026-02-24T09:09:26.267758+0000","last_clean":"2026-02-24T09:09:26.267758+0000","last_became_active":"2026-02-24T09:09:25.268235+0000","last_became_peered":"2026-02-24T09:09:25.268235+0000","last_unstale":"2026-02-24T09:09:26.267758+0000","last_undegraded":"2026-02-24T09:09:26.267758+0000","last_fullsized":"2026-02-24T09:09:26.267758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:17.309082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:45.955218+0000","last_change":"2026-02-24T09:09:24.256941+0000","last_active":"2026-02-24T09:09:45.955218+0000","last_peered":"2026-02-24T09:09:45.955218+0000","last_clean":"2026-02-24T09:09:45.955218+0000","last_became_active":"2026-02-24T09:09:24.256577+0000","last_became_peered":"2026-02-24T09:09:24.256577+0000","last_unstale":"2026-02-24T09:09:45.955218+0000","last_undegraded":"2026-02-24T09:09:45.955218+0000","last_fullsized":"2026-02-24T09:09:45.955218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:13:19.756549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268000+0000","last_change":"2026-02-24T09:09:25.270452+0000","last_active":"2026-02-24T09:09:26.268000+0000","last_peered":"2026-02-24T09:09:26.268000+0000","last_clean":"2026-02-24T09:09:26.268000+0000","last_became_active":"2026-02-24T09:09:25.270184+0000","last_became_peered":"2026-02-24T09:09:25.270184+0000","last_unstale":"2026-02-24T09:09:26.268000+0000","last_undegraded":"2026-02-24T09:09:26.268000+0000","last_fullsized":"2026-02-24T09:09:26.268000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:07:41.652941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943662+0000","last_change":"2026-02-24T09:09:24.261249+0000","last_active":"2026-02-24T09:09:28.943662+0000","last_peered":"2026-02-24T09:09:28.943662+0000","last_clean":"2026-02-24T09:09:28.943662+0000","last_became_active":"2026-02-24T09:09:24.261064+0000","last_became_peered":"2026-02-24T09:09:24.261064+0000","last_unstale":"2026-02-24T09:09:28.943662+0000","last_undegraded":"2026-02-24T09:09:28.943662+0000","last_fullsized":"2026-02-24T09:09:28.943662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:59:42.964350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941445+0000","last_change":"2026-02-24T09:09:24.254918+0000","last_active":"2026-02-24T09:09:28.941445+0000","last_peered":"2026-02-24T09:09:28.941445+0000","last_clean":"2026-02-24T09:09:28.941445+0000","last_became_active":"2026-02-24T09:09:24.254590+0000","last_became_peered":"2026-02-24T09:09:24.254590+0000","last_unstale":"2026-02-24T09:09:28.941445+0000","last_undegraded":"2026-02-24T09:09:28.941445+0000","last_fullsized":"2026-02-24T09:09:28.941445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:03:19.504844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268666+0000","last_change":"2026-02-24T09:09:25.267204+0000","last_active":"2026-02-24T09:09:26.268666+0000","last_peered":"2026-02-24T09:09:26.268666+0000","last_clean":"2026-02-24T09:09:26.268666+0000","last_became_active":"2026-02-24T09:09:25.266489+0000","last_became_peered":"2026-02-24T09:09:25.266489+0000","last_unstale":"2026-02-24T09:09:26.268666+0000","last_undegraded":"2026-02-24T09:09:26.268666+0000","last_fullsized":"2026-02-24T09:09:26.268666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:26:34.500054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210732+0000","last_change":"2026-02-24T09:09:24.258042+0000","last_active":"2026-02-24T09:09:27.210732+0000","last_peered":"2026-02-24T09:09:27.210732+0000","last_clean":"2026-02-24T09:09:27.210732+0000","last_became_active":"2026-02-24T09:09:24.257801+0000","last_became_peered":"2026-02-24T09:09:24.257801+0000","last_unstale":"2026-02-24T09:09:27.210732+0000","last_undegraded":"2026-02-24T09:09:27.210732+0000","last_fullsized":"2026-02-24T09:09:27.210732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:27.596990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267334+0000","last_change":"2026-02-24T09:09:25.267636+0000","last_active":"2026-02-24T09:09:26.267334+0000","last_peered":"2026-02-24T09:09:26.267334+0000","last_clean":"2026-02-24T09:09:26.267334+0000","last_became_active":"2026-02-24T09:09:25.267505+0000","last_became_peered":"2026-02-24T09:09:25.267505+0000","last_unstale":"2026-02-24T09:09:26.267334+0000","last_undegraded":"2026-02-24T09:09:26.267334+0000","last_fullsized":"2026-02-24T09:09:26.267334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:20.660345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:44.956775+0000","last_change":"2026-02-24T09:09:24.260793+0000","last_active":"2026-02-24T09:09:44.956775+0000","last_peered":"2026-02-24T09:09:44.956775+0000","last_clean":"2026-02-24T09:09:44.956775+0000","last_became_active":"2026-02-24T09:09:24.260555+0000","last_became_peered":"2026-02-24T09:09:24.260555+0000","last_unstale":"2026-02-24T09:09:44.956775+0000","last_undegraded":"2026-02-24T09:09:44.956775+0000","last_fullsized":"2026-02-24T09:09:44.956775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:30:45.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334847+0000","last_change":"2026-02-24T09:09:25.271121+0000","last_active":"2026-02-24T09:09:26.334847+0000","last_peered":"2026-02-24T09:09:26.334847+0000","last_clean":"2026-02-24T09:09:26.334847+0000","last_became_active":"2026-02-24T09:09:25.270770+0000","last_became_peered":"2026-02-24T09:09:25.270770+0000","last_unstale":"2026-02-24T09:09:26.334847+0000","last_undegraded":"2026-02-24T09:09:26.334847+0000","last_fullsized":"2026-02-24T09:09:26.334847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:52:58.451719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940998+0000","last_change":"2026-02-24T09:09:24.259030+0000","last_active":"2026-02-24T09:09:27.940998+0000","last_peered":"2026-02-24T09:09:27.940998+0000","last_clean":"2026-02-24T09:09:27.940998+0000","last_became_active":"2026-02-24T09:09:24.258747+0000","last_became_peered":"2026-02-24T09:09:24.258747+0000","last_unstale":"2026-02-24T09:09:27.940998+0000","last_undegraded":"2026-02-24T09:09:27.940998+0000","last_fullsized":"2026-02-24T09:09:27.940998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:49:46.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267794+0000","last_change":"2026-02-24T09:09:25.269875+0000","last_active":"2026-02-24T09:09:26.267794+0000","last_peered":"2026-02-24T09:09:26.267794+0000","last_clean":"2026-02-24T09:09:26.267794+0000","last_became_active":"2026-02-24T09:09:25.269400+0000","last_became_peered":"2026-02-24T09:09:25.269400+0000","last_unstale":"2026-02-24T09:09:26.267794+0000","last_undegraded":"2026-02-24T09:09:26.267794+0000","last_fullsized":"2026-02-24T09:09:26.267794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:08:29.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938278+0000","last_change":"2026-02-24T09:09:24.256845+0000","last_active":"2026-02-24T09:09:27.938278+0000","last_peered":"2026-02-24T09:09:27.938278+0000","last_clean":"2026-02-24T09:09:27.938278+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:27.938278+0000","last_undegraded":"2026-02-24T09:09:27.938278+0000","last_fullsized":"2026-02-24T09:09:27.938278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:08:15.802226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334785+0000","last_change":"2026-02-24T09:09:25.269608+0000","last_active":"2026-02-24T09:09:26.334785+0000","last_peered":"2026-02-24T09:09:26.334785+0000","last_clean":"2026-02-24T09:09:26.334785+0000","last_became_active":"2026-02-24T09:09:25.268736+0000","last_became_peered":"2026-02-24T09:09:25.268736+0000","last_unstale":"2026-02-24T09:09:26.334785+0000","last_undegraded":"2026-02-24T09:09:26.334785+0000","last_fullsized":"2026-02-24T09:09:26.334785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:39:41.466580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'27","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:45.960158+0000","last_change":"2026-02-24T09:09:24.260591+0000","last_active":"2026-02-24T09:09:45.960158+0000","last_peered":"2026-02-24T09:09:45.960158+0000","last_clean":"2026-02-24T09:09:45.960158+0000","last_became_active":"2026-02-24T09:09:24.260382+0000","last_became_peered":"2026-02-24T09:09:24.260382+0000","last_unstale":"2026-02-24T09:09:45.960158+0000","last_undegraded":"2026-02-24T09:09:45.960158+0000","last_fullsized":"2026-02-24T09:09:45.960158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:05:00.313499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67354,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":86,"num_write":28,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267717+0000","last_change":"2026-02-24T09:09:25.266872+0000","last_active":"2026-02-24T09:09:26.267717+0000","last_peered":"2026-02-24T09:09:26.267717+0000","last_clean":"2026-02-24T09:09:26.267717+0000","last_became_active":"2026-02-24T09:09:25.266720+0000","last_became_peered":"2026-02-24T09:09:25.266720+0000","last_unstale":"2026-02-24T09:09:26.267717+0000","last_undegraded":"2026-02-24T09:09:26.267717+0000","last_fullsized":"2026-02-24T09:09:26.267717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:43.574647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941766+0000","last_change":"2026-02-24T09:09:24.256821+0000","last_active":"2026-02-24T09:09:28.941766+0000","last_peered":"2026-02-24T09:09:28.941766+0000","last_clean":"2026-02-24T09:09:28.941766+0000","last_became_active":"2026-02-24T09:09:24.256284+0000","last_became_peered":"2026-02-24T09:09:24.256284+0000","last_unstale":"2026-02-24T09:09:28.941766+0000","last_undegraded":"2026-02-24T09:09:28.941766+0000","last_fullsized":"2026-02-24T09:09:28.941766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:37:32.352734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332187+0000","last_change":"2026-02-24T09:09:25.268120+0000","last_active":"2026-02-24T09:09:26.332187+0000","last_peered":"2026-02-24T09:09:26.332187+0000","last_clean":"2026-02-24T09:09:26.332187+0000","last_became_active":"2026-02-24T09:09:25.267865+0000","last_became_peered":"2026-02-24T09:09:25.267865+0000","last_unstale":"2026-02-24T09:09:26.332187+0000","last_undegraded":"2026-02-24T09:09:26.332187+0000","last_fullsized":"2026-02-24T09:09:26.332187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:51:18.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938196+0000","last_change":"2026-02-24T09:09:24.257176+0000","last_active":"2026-02-24T09:09:27.938196+0000","last_peered":"2026-02-24T09:09:27.938196+0000","last_clean":"2026-02-24T09:09:27.938196+0000","last_became_active":"2026-02-24T09:09:24.256855+0000","last_became_peered":"2026-02-24T09:09:24.256855+0000","last_unstale":"2026-02-24T09:09:27.938196+0000","last_undegraded":"2026-02-24T09:09:27.938196+0000","last_fullsized":"2026-02-24T09:09:27.938196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:48:25.179774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733497+0000","last_change":"2026-02-24T09:09:25.271913+0000","last_active":"2026-02-24T09:09:26.733497+0000","last_peered":"2026-02-24T09:09:26.733497+0000","last_clean":"2026-02-24T09:09:26.733497+0000","last_became_active":"2026-02-24T09:09:25.271736+0000","last_became_peered":"2026-02-24T09:09:25.271736+0000","last_unstale":"2026-02-24T09:09:26.733497+0000","last_undegraded":"2026-02-24T09:09:26.733497+0000","last_fullsized":"2026-02-24T09:09:26.733497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:49.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:47.961761+0000","last_change":"2026-02-24T09:09:24.259308+0000","last_active":"2026-02-24T09:09:47.961761+0000","last_peered":"2026-02-24T09:09:47.961761+0000","last_clean":"2026-02-24T09:09:47.961761+0000","last_became_active":"2026-02-24T09:09:24.259131+0000","last_became_peered":"2026-02-24T09:09:24.259131+0000","last_unstale":"2026-02-24T09:09:47.961761+0000","last_undegraded":"2026-02-24T09:09:47.961761+0000","last_fullsized":"2026-02-24T09:09:47.961761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:52:00.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733165+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.733165+0000","last_peered":"2026-02-24T09:09:26.733165+0000","last_clean":"2026-02-24T09:09:26.733165+0000","last_became_active":"2026-02-24T09:09:25.269559+0000","last_became_peered":"2026-02-24T09:09:25.269559+0000","last_unstale":"2026-02-24T09:09:26.733165+0000","last_undegraded":"2026-02-24T09:09:26.733165+0000","last_fullsized":"2026-02-24T09:09:26.733165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:06:28.902948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942522+0000","last_change":"2026-02-24T09:09:24.257075+0000","last_active":"2026-02-24T09:09:28.942522+0000","last_peered":"2026-02-24T09:09:28.942522+0000","last_clean":"2026-02-24T09:09:28.942522+0000","last_became_active":"2026-02-24T09:09:24.256738+0000","last_became_peered":"2026-02-24T09:09:24.256738+0000","last_unstale":"2026-02-24T09:09:28.942522+0000","last_undegraded":"2026-02-24T09:09:28.942522+0000","last_fullsized":"2026-02-24T09:09:28.942522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:14.802040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268002+0000","last_change":"2026-02-24T09:09:25.271423+0000","last_active":"2026-02-24T09:09:26.268002+0000","last_peered":"2026-02-24T09:09:26.268002+0000","last_clean":"2026-02-24T09:09:26.268002+0000","last_became_active":"2026-02-24T09:09:25.271142+0000","last_became_peered":"2026-02-24T09:09:25.271142+0000","last_unstale":"2026-02-24T09:09:26.268002+0000","last_undegraded":"2026-02-24T09:09:26.268002+0000","last_fullsized":"2026-02-24T09:09:26.268002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:16.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.940354+0000","last_change":"2026-02-24T09:09:24.258426+0000","last_active":"2026-02-24T09:09:29.940354+0000","last_peered":"2026-02-24T09:09:29.940354+0000","last_clean":"2026-02-24T09:09:29.940354+0000","last_became_active":"2026-02-24T09:09:24.257941+0000","last_became_peered":"2026-02-24T09:09:24.257941+0000","last_unstale":"2026-02-24T09:09:29.940354+0000","last_undegraded":"2026-02-24T09:09:29.940354+0000","last_fullsized":"2026-02-24T09:09:29.940354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:30:29.724001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332552+0000","last_change":"2026-02-24T09:09:25.266758+0000","last_active":"2026-02-24T09:09:26.332552+0000","last_peered":"2026-02-24T09:09:26.332552+0000","last_clean":"2026-02-24T09:09:26.332552+0000","last_became_active":"2026-02-24T09:09:25.266569+0000","last_became_peered":"2026-02-24T09:09:25.266569+0000","last_unstale":"2026-02-24T09:09:26.332552+0000","last_undegraded":"2026-02-24T09:09:26.332552+0000","last_fullsized":"2026-02-24T09:09:26.332552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:13:56.985056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332354+0000","last_change":"2026-02-24T09:09:24.256974+0000","last_active":"2026-02-24T09:09:26.332354+0000","last_peered":"2026-02-24T09:09:26.332354+0000","last_clean":"2026-02-24T09:09:26.332354+0000","last_became_active":"2026-02-24T09:09:24.256617+0000","last_became_peered":"2026-02-24T09:09:24.256617+0000","last_unstale":"2026-02-24T09:09:26.332354+0000","last_undegraded":"2026-02-24T09:09:26.332354+0000","last_fullsized":"2026-02-24T09:09:26.332354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:28.318156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733475+0000","last_change":"2026-02-24T09:09:25.270445+0000","last_active":"2026-02-24T09:09:26.733475+0000","last_peered":"2026-02-24T09:09:26.733475+0000","last_clean":"2026-02-24T09:09:26.733475+0000","last_became_active":"2026-02-24T09:09:25.270275+0000","last_became_peered":"2026-02-24T09:09:25.270275+0000","last_unstale":"2026-02-24T09:09:26.733475+0000","last_undegraded":"2026-02-24T09:09:26.733475+0000","last_fullsized":"2026-02-24T09:09:26.733475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:53:49.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210815+0000","last_change":"2026-02-24T09:09:24.259031+0000","last_active":"2026-02-24T09:09:27.210815+0000","last_peered":"2026-02-24T09:09:27.210815+0000","last_clean":"2026-02-24T09:09:27.210815+0000","last_became_active":"2026-02-24T09:09:24.258899+0000","last_became_peered":"2026-02-24T09:09:24.258899+0000","last_unstale":"2026-02-24T09:09:27.210815+0000","last_undegraded":"2026-02-24T09:09:27.210815+0000","last_fullsized":"2026-02-24T09:09:27.210815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:16.802986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109422+0000","last_change":"2026-02-24T09:09:25.272707+0000","last_active":"2026-02-24T09:09:28.109422+0000","last_peered":"2026-02-24T09:09:28.109422+0000","last_clean":"2026-02-24T09:09:28.109422+0000","last_became_active":"2026-02-24T09:09:25.272563+0000","last_became_peered":"2026-02-24T09:09:25.272563+0000","last_unstale":"2026-02-24T09:09:28.109422+0000","last_undegraded":"2026-02-24T09:09:28.109422+0000","last_fullsized":"2026-02-24T09:09:28.109422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:41:22.895217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942219+0000","last_change":"2026-02-24T09:09:24.256493+0000","last_active":"2026-02-24T09:09:28.942219+0000","last_peered":"2026-02-24T09:09:28.942219+0000","last_clean":"2026-02-24T09:09:28.942219+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:28.942219+0000","last_undegraded":"2026-02-24T09:09:28.942219+0000","last_fullsized":"2026-02-24T09:09:28.942219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:43:12.259841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733528+0000","last_change":"2026-02-24T09:09:25.271977+0000","last_active":"2026-02-24T09:09:26.733528+0000","last_peered":"2026-02-24T09:09:26.733528+0000","last_clean":"2026-02-24T09:09:26.733528+0000","last_became_active":"2026-02-24T09:09:25.271650+0000","last_became_peered":"2026-02-24T09:09:25.271650+0000","last_unstale":"2026-02-24T09:09:26.733528+0000","last_undegraded":"2026-02-24T09:09:26.733528+0000","last_fullsized":"2026-02-24T09:09:26.733528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:10.062115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733207+0000","last_change":"2026-02-24T09:09:05.953512+0000","last_active":"2026-02-24T09:09:26.733207+0000","last_peered":"2026-02-24T09:09:26.733207+0000","last_clean":"2026-02-24T09:09:26.733207+0000","last_became_active":"2026-02-24T09:09:05.953360+0000","last_became_peered":"2026-02-24T09:09:05.953360+0000","last_unstale":"2026-02-24T09:09:26.733207+0000","last_undegraded":"2026-02-24T09:09:26.733207+0000","last_fullsized":"2026-02-24T09:09:26.733207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_clean_scrub_stamp":"2026-02-24T09:08:00.445410+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:48.550493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.945604+0000","last_change":"2026-02-24T09:09:24.259164+0000","last_active":"2026-02-24T09:09:29.945604+0000","last_peered":"2026-02-24T09:09:29.945604+0000","last_clean":"2026-02-24T09:09:29.945604+0000","last_became_active":"2026-02-24T09:09:24.259011+0000","last_became_peered":"2026-02-24T09:09:24.259011+0000","last_unstale":"2026-02-24T09:09:29.945604+0000","last_undegraded":"2026-02-24T09:09:29.945604+0000","last_fullsized":"2026-02-24T09:09:29.945604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:41.649484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268864+0000","last_change":"2026-02-24T09:09:25.269884+0000","last_active":"2026-02-24T09:09:26.268864+0000","last_peered":"2026-02-24T09:09:26.268864+0000","last_clean":"2026-02-24T09:09:26.268864+0000","last_became_active":"2026-02-24T09:09:25.269543+0000","last_became_peered":"2026-02-24T09:09:25.269543+0000","last_unstale":"2026-02-24T09:09:26.268864+0000","last_undegraded":"2026-02-24T09:09:26.268864+0000","last_fullsized":"2026-02-24T09:09:26.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:21:25.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943350+0000","last_change":"2026-02-24T09:09:24.259369+0000","last_active":"2026-02-24T09:09:28.943350+0000","last_peered":"2026-02-24T09:09:28.943350+0000","last_clean":"2026-02-24T09:09:28.943350+0000","last_became_active":"2026-02-24T09:09:24.259086+0000","last_became_peered":"2026-02-24T09:09:24.259086+0000","last_unstale":"2026-02-24T09:09:28.943350+0000","last_undegraded":"2026-02-24T09:09:28.943350+0000","last_fullsized":"2026-02-24T09:09:28.943350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:08.881900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332119+0000","last_change":"2026-02-24T09:09:25.266898+0000","last_active":"2026-02-24T09:09:26.332119+0000","last_peered":"2026-02-24T09:09:26.332119+0000","last_clean":"2026-02-24T09:09:26.332119+0000","last_became_active":"2026-02-24T09:09:25.266407+0000","last_became_peered":"2026-02-24T09:09:25.266407+0000","last_unstale":"2026-02-24T09:09:26.332119+0000","last_undegraded":"2026-02-24T09:09:26.332119+0000","last_fullsized":"2026-02-24T09:09:26.332119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:51.887929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:48.959424+0000","last_change":"2026-02-24T09:09:24.254126+0000","last_active":"2026-02-24T09:09:48.959424+0000","last_peered":"2026-02-24T09:09:48.959424+0000","last_clean":"2026-02-24T09:09:48.959424+0000","last_became_active":"2026-02-24T09:09:24.253911+0000","last_became_peered":"2026-02-24T09:09:24.253911+0000","last_unstale":"2026-02-24T09:09:48.959424+0000","last_undegraded":"2026-02-24T09:09:48.959424+0000","last_fullsized":"2026-02-24T09:09:48.959424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:09:56.146842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268161+0000","last_change":"2026-02-24T09:09:25.270387+0000","last_active":"2026-02-24T09:09:26.268161+0000","last_peered":"2026-02-24T09:09:26.268161+0000","last_clean":"2026-02-24T09:09:26.268161+0000","last_became_active":"2026-02-24T09:09:25.269478+0000","last_became_peered":"2026-02-24T09:09:25.269478+0000","last_unstale":"2026-02-24T09:09:26.268161+0000","last_undegraded":"2026-02-24T09:09:26.268161+0000","last_fullsized":"2026-02-24T09:09:26.268161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:32:15.217221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109411+0000","last_change":"2026-02-24T09:09:24.259169+0000","last_active":"2026-02-24T09:09:28.109411+0000","last_peered":"2026-02-24T09:09:28.109411+0000","last_clean":"2026-02-24T09:09:28.109411+0000","last_became_active":"2026-02-24T09:09:24.258755+0000","last_became_peered":"2026-02-24T09:09:24.258755+0000","last_unstale":"2026-02-24T09:09:28.109411+0000","last_undegraded":"2026-02-24T09:09:28.109411+0000","last_fullsized":"2026-02-24T09:09:28.109411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:33.438504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270152+0000","last_change":"2026-02-24T09:09:25.270732+0000","last_active":"2026-02-24T09:09:26.270152+0000","last_peered":"2026-02-24T09:09:26.270152+0000","last_clean":"2026-02-24T09:09:26.270152+0000","last_became_active":"2026-02-24T09:09:25.270200+0000","last_became_peered":"2026-02-24T09:09:25.270200+0000","last_unstale":"2026-02-24T09:09:26.270152+0000","last_undegraded":"2026-02-24T09:09:26.270152+0000","last_fullsized":"2026-02-24T09:09:26.270152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:59:28.115196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267351+0000","last_change":"2026-02-24T09:09:24.257488+0000","last_active":"2026-02-24T09:09:26.267351+0000","last_peered":"2026-02-24T09:09:26.267351+0000","last_clean":"2026-02-24T09:09:26.267351+0000","last_became_active":"2026-02-24T09:09:24.257202+0000","last_became_peered":"2026-02-24T09:09:24.257202+0000","last_unstale":"2026-02-24T09:09:26.267351+0000","last_undegraded":"2026-02-24T09:09:26.267351+0000","last_fullsized":"2026-02-24T09:09:26.267351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:41:24.345307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.674896+0000","last_change":"2026-02-24T09:09:25.272254+0000","last_active":"2026-02-24T09:09:26.674896+0000","last_peered":"2026-02-24T09:09:26.674896+0000","last_clean":"2026-02-24T09:09:26.674896+0000","last_became_active":"2026-02-24T09:09:25.271674+0000","last_became_peered":"2026-02-24T09:09:25.271674+0000","last_unstale":"2026-02-24T09:09:26.674896+0000","last_undegraded":"2026-02-24T09:09:26.674896+0000","last_fullsized":"2026-02-24T09:09:26.674896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:03:26.493850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938246+0000","last_change":"2026-02-24T09:09:24.257331+0000","last_active":"2026-02-24T09:09:27.938246+0000","last_peered":"2026-02-24T09:09:27.938246+0000","last_clean":"2026-02-24T09:09:27.938246+0000","last_became_active":"2026-02-24T09:09:24.256876+0000","last_became_peered":"2026-02-24T09:09:24.256876+0000","last_unstale":"2026-02-24T09:09:27.938246+0000","last_undegraded":"2026-02-24T09:09:27.938246+0000","last_fullsized":"2026-02-24T09:09:27.938246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:29:58.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332332+0000","last_change":"2026-02-24T09:09:25.266642+0000","last_active":"2026-02-24T09:09:26.332332+0000","last_peered":"2026-02-24T09:09:26.332332+0000","last_clean":"2026-02-24T09:09:26.332332+0000","last_became_active":"2026-02-24T09:09:25.266307+0000","last_became_peered":"2026-02-24T09:09:25.266307+0000","last_unstale":"2026-02-24T09:09:26.332332+0000","last_undegraded":"2026-02-24T09:09:26.332332+0000","last_fullsized":"2026-02-24T09:09:26.332332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:51.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:37.268830+0000","last_change":"2026-02-24T09:09:24.258807+0000","last_active":"2026-02-24T09:09:37.268830+0000","last_peered":"2026-02-24T09:09:37.268830+0000","last_clean":"2026-02-24T09:09:37.268830+0000","last_became_active":"2026-02-24T09:09:24.258649+0000","last_became_peered":"2026-02-24T09:09:24.258649+0000","last_unstale":"2026-02-24T09:09:37.268830+0000","last_undegraded":"2026-02-24T09:09:37.268830+0000","last_fullsized":"2026-02-24T09:09:37.268830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:10:48.348275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269009+0000","last_change":"2026-02-24T09:09:25.268491+0000","last_active":"2026-02-24T09:09:26.269009+0000","last_peered":"2026-02-24T09:09:26.269009+0000","last_clean":"2026-02-24T09:09:26.269009+0000","last_became_active":"2026-02-24T09:09:25.267341+0000","last_became_peered":"2026-02-24T09:09:25.267341+0000","last_unstale":"2026-02-24T09:09:26.269009+0000","last_undegraded":"2026-02-24T09:09:26.269009+0000","last_fullsized":"2026-02-24T09:09:26.269009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:18:29.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940964+0000","last_change":"2026-02-24T09:09:24.258484+0000","last_active":"2026-02-24T09:09:27.940964+0000","last_peered":"2026-02-24T09:09:27.940964+0000","last_clean":"2026-02-24T09:09:27.940964+0000","last_became_active":"2026-02-24T09:09:24.258249+0000","last_became_peered":"2026-02-24T09:09:24.258249+0000","last_unstale":"2026-02-24T09:09:27.940964+0000","last_undegraded":"2026-02-24T09:09:27.940964+0000","last_fullsized":"2026-02-24T09:09:27.940964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:32:56.722522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267783+0000","last_change":"2026-02-24T09:09:25.269738+0000","last_active":"2026-02-24T09:09:26.267783+0000","last_peered":"2026-02-24T09:09:26.267783+0000","last_clean":"2026-02-24T09:09:26.267783+0000","last_became_active":"2026-02-24T09:09:25.269413+0000","last_became_peered":"2026-02-24T09:09:25.269413+0000","last_unstale":"2026-02-24T09:09:26.267783+0000","last_undegraded":"2026-02-24T09:09:26.267783+0000","last_fullsized":"2026-02-24T09:09:26.267783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:00.412570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941334+0000","last_change":"2026-02-24T09:09:24.258901+0000","last_active":"2026-02-24T09:09:27.941334+0000","last_peered":"2026-02-24T09:09:27.941334+0000","last_clean":"2026-02-24T09:09:27.941334+0000","last_became_active":"2026-02-24T09:09:24.258325+0000","last_became_peered":"2026-02-24T09:09:24.258325+0000","last_unstale":"2026-02-24T09:09:27.941334+0000","last_undegraded":"2026-02-24T09:09:27.941334+0000","last_fullsized":"2026-02-24T09:09:27.941334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:36.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267522+0000","last_change":"2026-02-24T09:09:25.267368+0000","last_active":"2026-02-24T09:09:26.267522+0000","last_peered":"2026-02-24T09:09:26.267522+0000","last_clean":"2026-02-24T09:09:26.267522+0000","last_became_active":"2026-02-24T09:09:25.267168+0000","last_became_peered":"2026-02-24T09:09:25.267168+0000","last_unstale":"2026-02-24T09:09:26.267522+0000","last_undegraded":"2026-02-24T09:09:26.267522+0000","last_fullsized":"2026-02-24T09:09:26.267522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:57.616866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.939140+0000","last_change":"2026-02-24T09:09:24.257345+0000","last_active":"2026-02-24T09:09:27.939140+0000","last_peered":"2026-02-24T09:09:27.939140+0000","last_clean":"2026-02-24T09:09:27.939140+0000","last_became_active":"2026-02-24T09:09:24.256817+0000","last_became_peered":"2026-02-24T09:09:24.256817+0000","last_unstale":"2026-02-24T09:09:27.939140+0000","last_undegraded":"2026-02-24T09:09:27.939140+0000","last_fullsized":"2026-02-24T09:09:27.939140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:37:48.042471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332527+0000","last_change":"2026-02-24T09:09:25.267778+0000","last_active":"2026-02-24T09:09:26.332527+0000","last_peered":"2026-02-24T09:09:26.332527+0000","last_clean":"2026-02-24T09:09:26.332527+0000","last_became_active":"2026-02-24T09:09:25.267379+0000","last_became_peered":"2026-02-24T09:09:25.267379+0000","last_unstale":"2026-02-24T09:09:26.332527+0000","last_undegraded":"2026-02-24T09:09:26.332527+0000","last_fullsized":"2026-02-24T09:09:26.332527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:25:47.194857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.121396+0000","last_change":"2026-02-24T09:09:24.259141+0000","last_active":"2026-02-24T09:09:28.121396+0000","last_peered":"2026-02-24T09:09:28.121396+0000","last_clean":"2026-02-24T09:09:28.121396+0000","last_became_active":"2026-02-24T09:09:24.258981+0000","last_became_peered":"2026-02-24T09:09:24.258981+0000","last_unstale":"2026-02-24T09:09:28.121396+0000","last_undegraded":"2026-02-24T09:09:28.121396+0000","last_fullsized":"2026-02-24T09:09:28.121396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:48.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268774+0000","last_change":"2026-02-24T09:09:25.268540+0000","last_active":"2026-02-24T09:09:26.268774+0000","last_peered":"2026-02-24T09:09:26.268774+0000","last_clean":"2026-02-24T09:09:26.268774+0000","last_became_active":"2026-02-24T09:09:25.267915+0000","last_became_peered":"2026-02-24T09:09:25.267915+0000","last_unstale":"2026-02-24T09:09:26.268774+0000","last_undegraded":"2026-02-24T09:09:26.268774+0000","last_fullsized":"2026-02-24T09:09:26.268774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:55.564971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938005+0000","last_change":"2026-02-24T09:09:24.257964+0000","last_active":"2026-02-24T09:09:27.938005+0000","last_peered":"2026-02-24T09:09:27.938005+0000","last_clean":"2026-02-24T09:09:27.938005+0000","last_became_active":"2026-02-24T09:09:24.257717+0000","last_became_peered":"2026-02-24T09:09:24.257717+0000","last_unstale":"2026-02-24T09:09:27.938005+0000","last_undegraded":"2026-02-24T09:09:27.938005+0000","last_fullsized":"2026-02-24T09:09:27.938005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:23:24.989893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733433+0000","last_change":"2026-02-24T09:09:25.271214+0000","last_active":"2026-02-24T09:09:26.733433+0000","last_peered":"2026-02-24T09:09:26.733433+0000","last_clean":"2026-02-24T09:09:26.733433+0000","last_became_active":"2026-02-24T09:09:25.271038+0000","last_became_peered":"2026-02-24T09:09:25.271038+0000","last_unstale":"2026-02-24T09:09:26.733433+0000","last_undegraded":"2026-02-24T09:09:26.733433+0000","last_fullsized":"2026-02-24T09:09:26.733433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:58:44.899837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268097+0000","last_change":"2026-02-24T09:09:25.269834+0000","last_active":"2026-02-24T09:09:26.268097+0000","last_peered":"2026-02-24T09:09:26.268097+0000","last_clean":"2026-02-24T09:09:26.268097+0000","last_became_active":"2026-02-24T09:09:25.269526+0000","last_became_peered":"2026-02-24T09:09:25.269526+0000","last_unstale":"2026-02-24T09:09:26.268097+0000","last_undegraded":"2026-02-24T09:09:26.268097+0000","last_fullsized":"2026-02-24T09:09:26.268097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:36:54.610640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267687+0000","last_change":"2026-02-24T09:09:24.258597+0000","last_active":"2026-02-24T09:09:26.267687+0000","last_peered":"2026-02-24T09:09:26.267687+0000","last_clean":"2026-02-24T09:09:26.267687+0000","last_became_active":"2026-02-24T09:09:24.258302+0000","last_became_peered":"2026-02-24T09:09:24.258302+0000","last_unstale":"2026-02-24T09:09:26.267687+0000","last_undegraded":"2026-02-24T09:09:26.267687+0000","last_fullsized":"2026-02-24T09:09:26.267687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:20:15.556479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334746+0000","last_change":"2026-02-24T09:09:25.269804+0000","last_active":"2026-02-24T09:09:26.334746+0000","last_peered":"2026-02-24T09:09:26.334746+0000","last_clean":"2026-02-24T09:09:26.334746+0000","last_became_active":"2026-02-24T09:09:25.268973+0000","last_became_peered":"2026-02-24T09:09:25.268973+0000","last_unstale":"2026-02-24T09:09:26.334746+0000","last_undegraded":"2026-02-24T09:09:26.334746+0000","last_fullsized":"2026-02-24T09:09:26.334746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:33:39.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942003+0000","last_change":"2026-02-24T09:09:24.257428+0000","last_active":"2026-02-24T09:09:28.942003+0000","last_peered":"2026-02-24T09:09:28.942003+0000","last_clean":"2026-02-24T09:09:28.942003+0000","last_became_active":"2026-02-24T09:09:24.256679+0000","last_became_peered":"2026-02-24T09:09:24.256679+0000","last_unstale":"2026-02-24T09:09:28.942003+0000","last_undegraded":"2026-02-24T09:09:28.942003+0000","last_fullsized":"2026-02-24T09:09:28.942003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:39:28.664820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267792+0000","last_change":"2026-02-24T09:09:25.268127+0000","last_active":"2026-02-24T09:09:26.267792+0000","last_peered":"2026-02-24T09:09:26.267792+0000","last_clean":"2026-02-24T09:09:26.267792+0000","last_became_active":"2026-02-24T09:09:25.267860+0000","last_became_peered":"2026-02-24T09:09:25.267860+0000","last_unstale":"2026-02-24T09:09:26.267792+0000","last_undegraded":"2026-02-24T09:09:26.267792+0000","last_fullsized":"2026-02-24T09:09:26.267792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:37:52.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269053+0000","last_change":"2026-02-24T09:09:24.257552+0000","last_active":"2026-02-24T09:09:26.269053+0000","last_peered":"2026-02-24T09:09:26.269053+0000","last_clean":"2026-02-24T09:09:26.269053+0000","last_became_active":"2026-02-24T09:09:24.257163+0000","last_became_peered":"2026-02-24T09:09:24.257163+0000","last_unstale":"2026-02-24T09:09:26.269053+0000","last_undegraded":"2026-02-24T09:09:26.269053+0000","last_fullsized":"2026-02-24T09:09:26.269053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:30:54.285800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268961+0000","last_change":"2026-02-24T09:09:25.268695+0000","last_active":"2026-02-24T09:09:26.268961+0000","last_peered":"2026-02-24T09:09:26.268961+0000","last_clean":"2026-02-24T09:09:26.268961+0000","last_became_active":"2026-02-24T09:09:25.268128+0000","last_became_peered":"2026-02-24T09:09:25.268128+0000","last_unstale":"2026-02-24T09:09:26.268961+0000","last_undegraded":"2026-02-24T09:09:26.268961+0000","last_fullsized":"2026-02-24T09:09:26.268961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:23.987958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942226+0000","last_change":"2026-02-24T09:09:24.257602+0000","last_active":"2026-02-24T09:09:28.942226+0000","last_peered":"2026-02-24T09:09:28.942226+0000","last_clean":"2026-02-24T09:09:28.942226+0000","last_became_active":"2026-02-24T09:09:24.257440+0000","last_became_peered":"2026-02-24T09:09:24.257440+0000","last_unstale":"2026-02-24T09:09:28.942226+0000","last_undegraded":"2026-02-24T09:09:28.942226+0000","last_fullsized":"2026-02-24T09:09:28.942226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:13:51.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71404,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":135,"num_read_kb":143,"num_write":155,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":215667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119920,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":259322,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710732,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":395125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":27582038},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939659,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27916,"kb_used_data":952,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975284,"statfs":{"total":751619276800,"available":751590690816,"internally_reserved":0,"allocated":974848,"data_stored":1054370,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23856,"internal_metadata":27566800},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070478,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24845,"internal_metadata":27565811},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299407,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32956,"internal_metadata":27557700},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528337,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":987230,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28867,"internal_metadata":27561789},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659155,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":394740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888083,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":986504,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":32062,"internal_metadata":27558594},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018901,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31416,"internal_metadata":27559240},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247832,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":395051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47059,"internal_metadata":27543597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476760,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27856,"kb_used_data":892,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975344,"statfs":{"total":751619276800,"available":751590752256,"internally_reserved":0,"allocated":913408,"data_stored":463247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34581,"internal_metadata":27556075},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607578,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27832,"kb_used_data":868,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975368,"statfs":{"total":751619276800,"available":751590776832,"internally_reserved":0,"allocated":888832,"data_stored":463342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49917,"internal_metadata":27540739},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11012,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12011,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13952,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6329,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13842,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3422,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31362,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9492,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13536,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:09:52.628 INFO:tasks.fwd_scrub.ceph_manager:clean! 2026-02-24T09:09:52.629 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T09:09:52.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 -- 10.20.193.4:0/237271675 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f08901103a0 msgr2=0x7f0890110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 --2- 10.20.193.4:0/237271675 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f08901103a0 0x7f0890110810 secure :-1 s=READY pgs=429 gs=1 cs=0 l=1 c_cookie=17231044440857131948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0880009950 tx=0x7f088002f190 comp rx=0 tx=0).stop 2026-02-24T09:09:52.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 -- 10.20.193.4:0/237271675 shutdown_connections 2026-02-24T09:09:52.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 --2- 10.20.193.4:0/237271675 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0890110d50 0x7f08901716e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 --2- 10.20.193.4:0/237271675 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f08901103a0 0x7f0890110810 unknown :-1 s=CLOSED pgs=429 gs=1 cs=0 l=1 c_cookie=17231044440857131948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 --2- 10.20.193.4:0/237271675 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f089010f210 0x7f089010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 -- 10.20.193.4:0/237271675 >> 10.20.193.4:0/237271675 conn(0x7f08900ec920 msgr2=0x7f089010cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:52.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 -- 10.20.193.4:0/237271675 shutdown_connections 2026-02-24T09:09:52.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 -- 10.20.193.4:0/237271675 wait complete. 2026-02-24T09:09:52.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 Processor -- start 2026-02-24T09:09:52.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 -- start start 2026-02-24T09:09:52.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f089010f210 0x7f08900f88e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08901103a0 0x7f08901716c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.726+0000 7f089678d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0890110d50 0x7f08900f9120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f089678d640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f08900f9d80 con 0x7f089010f210 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f089678d640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f08900f9ef0 con 0x7f0890110d50 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f089678d640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08900fa0b0 con 0x7f08901103a0 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f089010f210 0x7f08900f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f089010f210 0x7f08900f88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34068/0 (socket says 10.20.193.4:34068) 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088ffff640 1 -- 10.20.193.4:0/1461416080 learned_addr learned my addr 10.20.193.4:0/1461416080 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f0894d03640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0890110d50 0x7f08900f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088f7fe640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08901103a0 0x7f08901716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088ffff640 1 -- 10.20.193.4:0/1461416080 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08901103a0 msgr2=0x7f08901716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088ffff640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08901103a0 0x7f08901716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088ffff640 1 -- 10.20.193.4:0/1461416080 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0890110d50 msgr2=0x7f08900f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088ffff640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0890110d50 0x7f08900f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088ffff640 1 -- 10.20.193.4:0/1461416080 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0880009570 con 0x7f089010f210 2026-02-24T09:09:52.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088ffff640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f089010f210 0x7f08900f88e0 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f087c005db0 tx=0x7f087c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:52.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088d7fa640 1 -- 10.20.193.4:0/1461416080 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f087c004500 con 0x7f089010f210 2026-02-24T09:09:52.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088d7fa640 1 -- 10.20.193.4:0/1461416080 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f087c004d30 con 0x7f089010f210 2026-02-24T09:09:52.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f089678d640 1 -- 10.20.193.4:0/1461416080 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08900fa390 con 0x7f089010f210 2026-02-24T09:09:52.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f088d7fa640 1 -- 10.20.193.4:0/1461416080 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f087c005310 con 0x7f089010f210 2026-02-24T09:09:52.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f089678d640 1 -- 10.20.193.4:0/1461416080 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08900fa810 con 0x7f089010f210 2026-02-24T09:09:52.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.727+0000 7f089678d640 1 -- 10.20.193.4:0/1461416080 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0890175700 con 0x7f089010f210 2026-02-24T09:09:52.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.729+0000 7f088d7fa640 1 -- 10.20.193.4:0/1461416080 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f087c0054a0 con 0x7f089010f210 2026-02-24T09:09:52.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.729+0000 7f088d7fa640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f08640b5770 0x7f08640d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:52.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.729+0000 7f088f7fe640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f08640b5770 0x7f08640d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:52.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.730+0000 7f088d7fa640 1 -- 10.20.193.4:0/1461416080 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f087c0e7130 con 0x7f089010f210 2026-02-24T09:09:52.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.730+0000 7f088f7fe640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f08640b5770 0x7f08640d5c20 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08800023d0 tx=0x7f0880031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:52.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.730+0000 7f088d7fa640 1 -- 10.20.193.4:0/1461416080 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f087c0a9a80 con 0x7f089010f210 2026-02-24T09:09:52.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.834+0000 7f089678d640 1 -- 10.20.193.4:0/1461416080 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0890174dc0 con 0x7f08640b5770 2026-02-24T09:09:52.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.836+0000 7f088d7fa640 1 -- 10.20.193.4:0/1461416080 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7f0890174dc0 con 0x7f08640b5770 2026-02-24T09:09:52.842 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:52.844 INFO:teuthology.orchestra.run.trial004.stderr:dumped all 2026-02-24T09:09:52.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.837+0000 7f089678d640 1 -- 10.20.193.4:0/1461416080 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f08640b5770 msgr2=0x7f08640d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.837+0000 7f089678d640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f08640b5770 0x7f08640d5c20 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08800023d0 tx=0x7f0880031040 comp rx=0 tx=0).stop 2026-02-24T09:09:52.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.837+0000 7f089678d640 1 -- 10.20.193.4:0/1461416080 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f089010f210 msgr2=0x7f08900f88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:52.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.837+0000 7f089678d640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f089010f210 0x7f08900f88e0 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f087c005db0 tx=0x7f087c00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.837+0000 7f089678d640 1 -- 10.20.193.4:0/1461416080 shutdown_connections 2026-02-24T09:09:52.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.837+0000 7f089678d640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f08640b5770 0x7f08640d5c20 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.837+0000 7f089678d640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0890110d50 0x7f08900f9120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.837+0000 7f089678d640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08901103a0 0x7f08901716c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.837+0000 7f089678d640 1 --2- 10.20.193.4:0/1461416080 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f089010f210 0x7f08900f88e0 unknown :-1 s=CLOSED pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:52.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.838+0000 7f089678d640 1 -- 10.20.193.4:0/1461416080 >> 10.20.193.4:0/1461416080 conn(0x7f08900ec920 msgr2=0x7f08900eeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:52.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.838+0000 7f089678d640 1 -- 10.20.193.4:0/1461416080 shutdown_connections 2026-02-24T09:09:52.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:52.838+0000 7f089678d640 1 -- 10.20.193.4:0/1461416080 wait complete. 2026-02-24T09:09:52.850 INFO:teuthology.orchestra.run.trial004.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2026-02-24T09:09:51.668575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662006,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":241,"num_read_kb":234,"num_write":346,"num_write_kb":3837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333672,"kb_used_data":10104,"kb_used_omap":377,"kb_used_meta":322950,"kb_avail":8807704728,"statfs":{"total":9019431321600,"available":9019089641472,"internally_reserved":0,"allocated":10346496,"data_stored":6721869,"data_compressed":113181,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":386873,"internal_metadata":330700999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15110,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":50,"num_write":5,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002256"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332664+0000","last_change":"2026-02-24T09:09:25.267627+0000","last_active":"2026-02-24T09:09:26.332664+0000","last_peered":"2026-02-24T09:09:26.332664+0000","last_clean":"2026-02-24T09:09:26.332664+0000","last_became_active":"2026-02-24T09:09:25.267439+0000","last_became_peered":"2026-02-24T09:09:25.267439+0000","last_unstale":"2026-02-24T09:09:26.332664+0000","last_undegraded":"2026-02-24T09:09:26.332664+0000","last_fullsized":"2026-02-24T09:09:26.332664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:24.034680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267727+0000","last_change":"2026-02-24T09:09:25.267299+0000","last_active":"2026-02-24T09:09:26.267727+0000","last_peered":"2026-02-24T09:09:26.267727+0000","last_clean":"2026-02-24T09:09:26.267727+0000","last_became_active":"2026-02-24T09:09:25.266956+0000","last_became_peered":"2026-02-24T09:09:25.266956+0000","last_unstale":"2026-02-24T09:09:26.267727+0000","last_undegraded":"2026-02-24T09:09:26.267727+0000","last_fullsized":"2026-02-24T09:09:26.267727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:05.466777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267738+0000","last_change":"2026-02-24T09:09:25.268761+0000","last_active":"2026-02-24T09:09:26.267738+0000","last_peered":"2026-02-24T09:09:26.267738+0000","last_clean":"2026-02-24T09:09:26.267738+0000","last_became_active":"2026-02-24T09:09:25.268476+0000","last_became_peered":"2026-02-24T09:09:25.268476+0000","last_unstale":"2026-02-24T09:09:26.267738+0000","last_undegraded":"2026-02-24T09:09:26.267738+0000","last_fullsized":"2026-02-24T09:09:26.267738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:26:00.680116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335046+0000","last_change":"2026-02-24T09:09:25.271303+0000","last_active":"2026-02-24T09:09:26.335046+0000","last_peered":"2026-02-24T09:09:26.335046+0000","last_clean":"2026-02-24T09:09:26.335046+0000","last_became_active":"2026-02-24T09:09:25.271175+0000","last_became_peered":"2026-02-24T09:09:25.271175+0000","last_unstale":"2026-02-24T09:09:26.335046+0000","last_undegraded":"2026-02-24T09:09:26.335046+0000","last_fullsized":"2026-02-24T09:09:26.335046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:55:25.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267634+0000","last_change":"2026-02-24T09:09:25.267923+0000","last_active":"2026-02-24T09:09:26.267634+0000","last_peered":"2026-02-24T09:09:26.267634+0000","last_clean":"2026-02-24T09:09:26.267634+0000","last_became_active":"2026-02-24T09:09:25.267775+0000","last_became_peered":"2026-02-24T09:09:25.267775+0000","last_unstale":"2026-02-24T09:09:26.267634+0000","last_undegraded":"2026-02-24T09:09:26.267634+0000","last_fullsized":"2026-02-24T09:09:26.267634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:54:25.575849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270023+0000","last_change":"2026-02-24T09:09:25.269603+0000","last_active":"2026-02-24T09:09:26.270023+0000","last_peered":"2026-02-24T09:09:26.270023+0000","last_clean":"2026-02-24T09:09:26.270023+0000","last_became_active":"2026-02-24T09:09:25.269057+0000","last_became_peered":"2026-02-24T09:09:25.269057+0000","last_unstale":"2026-02-24T09:09:26.270023+0000","last_undegraded":"2026-02-24T09:09:26.270023+0000","last_fullsized":"2026-02-24T09:09:26.270023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:39:21.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733238+0000","last_change":"2026-02-24T09:09:25.270852+0000","last_active":"2026-02-24T09:09:26.733238+0000","last_peered":"2026-02-24T09:09:26.733238+0000","last_clean":"2026-02-24T09:09:26.733238+0000","last_became_active":"2026-02-24T09:09:25.270607+0000","last_became_peered":"2026-02-24T09:09:25.270607+0000","last_unstale":"2026-02-24T09:09:26.733238+0000","last_undegraded":"2026-02-24T09:09:26.733238+0000","last_fullsized":"2026-02-24T09:09:26.733238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:45:43.574810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268619+0000","last_change":"2026-02-24T09:09:25.268833+0000","last_active":"2026-02-24T09:09:26.268619+0000","last_peered":"2026-02-24T09:09:26.268619+0000","last_clean":"2026-02-24T09:09:26.268619+0000","last_became_active":"2026-02-24T09:09:25.268462+0000","last_became_peered":"2026-02-24T09:09:25.268462+0000","last_unstale":"2026-02-24T09:09:26.268619+0000","last_undegraded":"2026-02-24T09:09:26.268619+0000","last_fullsized":"2026-02-24T09:09:26.268619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:47.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334895+0000","last_change":"2026-02-24T09:09:25.271419+0000","last_active":"2026-02-24T09:09:26.334895+0000","last_peered":"2026-02-24T09:09:26.334895+0000","last_clean":"2026-02-24T09:09:26.334895+0000","last_became_active":"2026-02-24T09:09:25.270954+0000","last_became_peered":"2026-02-24T09:09:25.270954+0000","last_unstale":"2026-02-24T09:09:26.334895+0000","last_undegraded":"2026-02-24T09:09:26.334895+0000","last_fullsized":"2026-02-24T09:09:26.334895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:07:15.889565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270286+0000","last_change":"2026-02-24T09:09:25.269709+0000","last_active":"2026-02-24T09:09:26.270286+0000","last_peered":"2026-02-24T09:09:26.270286+0000","last_clean":"2026-02-24T09:09:26.270286+0000","last_became_active":"2026-02-24T09:09:25.269136+0000","last_became_peered":"2026-02-24T09:09:25.269136+0000","last_unstale":"2026-02-24T09:09:26.270286+0000","last_undegraded":"2026-02-24T09:09:26.270286+0000","last_fullsized":"2026-02-24T09:09:26.270286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:42:02.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733508+0000","last_change":"2026-02-24T09:09:25.272025+0000","last_active":"2026-02-24T09:09:26.733508+0000","last_peered":"2026-02-24T09:09:26.733508+0000","last_clean":"2026-02-24T09:09:26.733508+0000","last_became_active":"2026-02-24T09:09:25.271851+0000","last_became_peered":"2026-02-24T09:09:25.271851+0000","last_unstale":"2026-02-24T09:09:26.733508+0000","last_undegraded":"2026-02-24T09:09:26.733508+0000","last_fullsized":"2026-02-24T09:09:26.733508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:49:57.365130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335160+0000","last_change":"2026-02-24T09:09:25.271156+0000","last_active":"2026-02-24T09:09:26.335160+0000","last_peered":"2026-02-24T09:09:26.335160+0000","last_clean":"2026-02-24T09:09:26.335160+0000","last_became_active":"2026-02-24T09:09:25.270992+0000","last_became_peered":"2026-02-24T09:09:25.270992+0000","last_unstale":"2026-02-24T09:09:26.335160+0000","last_undegraded":"2026-02-24T09:09:26.335160+0000","last_fullsized":"2026-02-24T09:09:26.335160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:56.324038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332309+0000","last_change":"2026-02-24T09:09:25.266871+0000","last_active":"2026-02-24T09:09:26.332309+0000","last_peered":"2026-02-24T09:09:26.332309+0000","last_clean":"2026-02-24T09:09:26.332309+0000","last_became_active":"2026-02-24T09:09:25.266438+0000","last_became_peered":"2026-02-24T09:09:25.266438+0000","last_unstale":"2026-02-24T09:09:26.332309+0000","last_undegraded":"2026-02-24T09:09:26.332309+0000","last_fullsized":"2026-02-24T09:09:26.332309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:24:17.014313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267591+0000","last_change":"2026-02-24T09:09:25.266851+0000","last_active":"2026-02-24T09:09:26.267591+0000","last_peered":"2026-02-24T09:09:26.267591+0000","last_clean":"2026-02-24T09:09:26.267591+0000","last_became_active":"2026-02-24T09:09:25.266530+0000","last_became_peered":"2026-02-24T09:09:25.266530+0000","last_unstale":"2026-02-24T09:09:26.267591+0000","last_undegraded":"2026-02-24T09:09:26.267591+0000","last_fullsized":"2026-02-24T09:09:26.267591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:53.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267465+0000","last_change":"2026-02-24T09:09:25.269561+0000","last_active":"2026-02-24T09:09:26.267465+0000","last_peered":"2026-02-24T09:09:26.267465+0000","last_clean":"2026-02-24T09:09:26.267465+0000","last_became_active":"2026-02-24T09:09:25.268979+0000","last_became_peered":"2026-02-24T09:09:25.268979+0000","last_unstale":"2026-02-24T09:09:26.267465+0000","last_undegraded":"2026-02-24T09:09:26.267465+0000","last_fullsized":"2026-02-24T09:09:26.267465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:16:56.110766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334540+0000","last_change":"2026-02-24T09:09:25.271426+0000","last_active":"2026-02-24T09:09:26.334540+0000","last_peered":"2026-02-24T09:09:26.334540+0000","last_clean":"2026-02-24T09:09:26.334540+0000","last_became_active":"2026-02-24T09:09:25.270917+0000","last_became_peered":"2026-02-24T09:09:25.270917+0000","last_unstale":"2026-02-24T09:09:26.334540+0000","last_undegraded":"2026-02-24T09:09:26.334540+0000","last_fullsized":"2026-02-24T09:09:26.334540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:58:52.125871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332673+0000","last_change":"2026-02-24T09:09:25.267238+0000","last_active":"2026-02-24T09:09:26.332673+0000","last_peered":"2026-02-24T09:09:26.332673+0000","last_clean":"2026-02-24T09:09:26.332673+0000","last_became_active":"2026-02-24T09:09:25.267060+0000","last_became_peered":"2026-02-24T09:09:25.267060+0000","last_unstale":"2026-02-24T09:09:26.332673+0000","last_undegraded":"2026-02-24T09:09:26.332673+0000","last_fullsized":"2026-02-24T09:09:26.332673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:00:58.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267495+0000","last_change":"2026-02-24T09:09:25.266005+0000","last_active":"2026-02-24T09:09:26.267495+0000","last_peered":"2026-02-24T09:09:26.267495+0000","last_clean":"2026-02-24T09:09:26.267495+0000","last_became_active":"2026-02-24T09:09:25.265847+0000","last_became_peered":"2026-02-24T09:09:25.265847+0000","last_unstale":"2026-02-24T09:09:26.267495+0000","last_undegraded":"2026-02-24T09:09:26.267495+0000","last_fullsized":"2026-02-24T09:09:26.267495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:29:02.137351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332638+0000","last_change":"2026-02-24T09:09:25.268822+0000","last_active":"2026-02-24T09:09:26.332638+0000","last_peered":"2026-02-24T09:09:26.332638+0000","last_clean":"2026-02-24T09:09:26.332638+0000","last_became_active":"2026-02-24T09:09:25.268683+0000","last_became_peered":"2026-02-24T09:09:25.268683+0000","last_unstale":"2026-02-24T09:09:26.332638+0000","last_undegraded":"2026-02-24T09:09:26.332638+0000","last_fullsized":"2026-02-24T09:09:26.332638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:23:58.256403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332429+0000","last_change":"2026-02-24T09:09:25.266214+0000","last_active":"2026-02-24T09:09:26.332429+0000","last_peered":"2026-02-24T09:09:26.332429+0000","last_clean":"2026-02-24T09:09:26.332429+0000","last_became_active":"2026-02-24T09:09:25.266019+0000","last_became_peered":"2026-02-24T09:09:25.266019+0000","last_unstale":"2026-02-24T09:09:26.332429+0000","last_undegraded":"2026-02-24T09:09:26.332429+0000","last_fullsized":"2026-02-24T09:09:26.332429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:17.141581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332384+0000","last_change":"2026-02-24T09:09:25.267493+0000","last_active":"2026-02-24T09:09:26.332384+0000","last_peered":"2026-02-24T09:09:26.332384+0000","last_clean":"2026-02-24T09:09:26.332384+0000","last_became_active":"2026-02-24T09:09:25.267314+0000","last_became_peered":"2026-02-24T09:09:25.267314+0000","last_unstale":"2026-02-24T09:09:26.332384+0000","last_undegraded":"2026-02-24T09:09:26.332384+0000","last_fullsized":"2026-02-24T09:09:26.332384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:59:11.536214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334717+0000","last_change":"2026-02-24T09:09:25.272131+0000","last_active":"2026-02-24T09:09:26.334717+0000","last_peered":"2026-02-24T09:09:26.334717+0000","last_clean":"2026-02-24T09:09:26.334717+0000","last_became_active":"2026-02-24T09:09:25.271680+0000","last_became_peered":"2026-02-24T09:09:25.271680+0000","last_unstale":"2026-02-24T09:09:26.334717+0000","last_undegraded":"2026-02-24T09:09:26.334717+0000","last_fullsized":"2026-02-24T09:09:26.334717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:07:33.257865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268617+0000","last_change":"2026-02-24T09:09:25.267808+0000","last_active":"2026-02-24T09:09:26.268617+0000","last_peered":"2026-02-24T09:09:26.268617+0000","last_clean":"2026-02-24T09:09:26.268617+0000","last_became_active":"2026-02-24T09:09:25.266759+0000","last_became_peered":"2026-02-24T09:09:25.266759+0000","last_unstale":"2026-02-24T09:09:26.268617+0000","last_undegraded":"2026-02-24T09:09:26.268617+0000","last_fullsized":"2026-02-24T09:09:26.268617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:55.312047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268133+0000","last_change":"2026-02-24T09:09:25.268500+0000","last_active":"2026-02-24T09:09:26.268133+0000","last_peered":"2026-02-24T09:09:26.268133+0000","last_clean":"2026-02-24T09:09:26.268133+0000","last_became_active":"2026-02-24T09:09:25.267904+0000","last_became_peered":"2026-02-24T09:09:25.267904+0000","last_unstale":"2026-02-24T09:09:26.268133+0000","last_undegraded":"2026-02-24T09:09:26.268133+0000","last_fullsized":"2026-02-24T09:09:26.268133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:38:47.330593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269021+0000","last_change":"2026-02-24T09:09:25.269694+0000","last_active":"2026-02-24T09:09:26.269021+0000","last_peered":"2026-02-24T09:09:26.269021+0000","last_clean":"2026-02-24T09:09:26.269021+0000","last_became_active":"2026-02-24T09:09:25.269068+0000","last_became_peered":"2026-02-24T09:09:25.269068+0000","last_unstale":"2026-02-24T09:09:26.269021+0000","last_undegraded":"2026-02-24T09:09:26.269021+0000","last_fullsized":"2026-02-24T09:09:26.269021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:04:44.772275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332668+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.332668+0000","last_peered":"2026-02-24T09:09:26.332668+0000","last_clean":"2026-02-24T09:09:26.332668+0000","last_became_active":"2026-02-24T09:09:25.269534+0000","last_became_peered":"2026-02-24T09:09:25.269534+0000","last_unstale":"2026-02-24T09:09:26.332668+0000","last_undegraded":"2026-02-24T09:09:26.332668+0000","last_fullsized":"2026-02-24T09:09:26.332668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:45:51.428970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332478+0000","last_change":"2026-02-24T09:09:25.266779+0000","last_active":"2026-02-24T09:09:26.332478+0000","last_peered":"2026-02-24T09:09:26.332478+0000","last_clean":"2026-02-24T09:09:26.332478+0000","last_became_active":"2026-02-24T09:09:25.266603+0000","last_became_peered":"2026-02-24T09:09:25.266603+0000","last_unstale":"2026-02-24T09:09:26.332478+0000","last_undegraded":"2026-02-24T09:09:26.332478+0000","last_fullsized":"2026-02-24T09:09:26.332478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:01:38.198458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332295+0000","last_change":"2026-02-24T09:09:25.266933+0000","last_active":"2026-02-24T09:09:26.332295+0000","last_peered":"2026-02-24T09:09:26.332295+0000","last_clean":"2026-02-24T09:09:26.332295+0000","last_became_active":"2026-02-24T09:09:25.266381+0000","last_became_peered":"2026-02-24T09:09:25.266381+0000","last_unstale":"2026-02-24T09:09:26.332295+0000","last_undegraded":"2026-02-24T09:09:26.332295+0000","last_fullsized":"2026-02-24T09:09:26.332295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:45:44.657482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267754+0000","last_change":"2026-02-24T09:09:25.269576+0000","last_active":"2026-02-24T09:09:26.267754+0000","last_peered":"2026-02-24T09:09:26.267754+0000","last_clean":"2026-02-24T09:09:26.267754+0000","last_became_active":"2026-02-24T09:09:25.269159+0000","last_became_peered":"2026-02-24T09:09:25.269159+0000","last_unstale":"2026-02-24T09:09:26.267754+0000","last_undegraded":"2026-02-24T09:09:26.267754+0000","last_fullsized":"2026-02-24T09:09:26.267754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:23:37.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332345+0000","last_change":"2026-02-24T09:09:25.269282+0000","last_active":"2026-02-24T09:09:26.332345+0000","last_peered":"2026-02-24T09:09:26.332345+0000","last_clean":"2026-02-24T09:09:26.332345+0000","last_became_active":"2026-02-24T09:09:25.269088+0000","last_became_peered":"2026-02-24T09:09:25.269088+0000","last_unstale":"2026-02-24T09:09:26.332345+0000","last_undegraded":"2026-02-24T09:09:26.332345+0000","last_fullsized":"2026-02-24T09:09:26.332345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:49.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332404+0000","last_change":"2026-02-24T09:09:25.270968+0000","last_active":"2026-02-24T09:09:26.332404+0000","last_peered":"2026-02-24T09:09:26.332404+0000","last_clean":"2026-02-24T09:09:26.332404+0000","last_became_active":"2026-02-24T09:09:25.270816+0000","last_became_peered":"2026-02-24T09:09:25.270816+0000","last_unstale":"2026-02-24T09:09:26.332404+0000","last_undegraded":"2026-02-24T09:09:26.332404+0000","last_fullsized":"2026-02-24T09:09:26.332404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:10:08.592263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332360+0000","last_change":"2026-02-24T09:09:25.267715+0000","last_active":"2026-02-24T09:09:26.332360+0000","last_peered":"2026-02-24T09:09:26.332360+0000","last_clean":"2026-02-24T09:09:26.332360+0000","last_became_active":"2026-02-24T09:09:25.267031+0000","last_became_peered":"2026-02-24T09:09:25.267031+0000","last_unstale":"2026-02-24T09:09:26.332360+0000","last_undegraded":"2026-02-24T09:09:26.332360+0000","last_fullsized":"2026-02-24T09:09:26.332360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:14:50.568512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267758+0000","last_change":"2026-02-24T09:09:25.268347+0000","last_active":"2026-02-24T09:09:26.267758+0000","last_peered":"2026-02-24T09:09:26.267758+0000","last_clean":"2026-02-24T09:09:26.267758+0000","last_became_active":"2026-02-24T09:09:25.268235+0000","last_became_peered":"2026-02-24T09:09:25.268235+0000","last_unstale":"2026-02-24T09:09:26.267758+0000","last_undegraded":"2026-02-24T09:09:26.267758+0000","last_fullsized":"2026-02-24T09:09:26.267758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:17.309082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:45.955218+0000","last_change":"2026-02-24T09:09:24.256941+0000","last_active":"2026-02-24T09:09:45.955218+0000","last_peered":"2026-02-24T09:09:45.955218+0000","last_clean":"2026-02-24T09:09:45.955218+0000","last_became_active":"2026-02-24T09:09:24.256577+0000","last_became_peered":"2026-02-24T09:09:24.256577+0000","last_unstale":"2026-02-24T09:09:45.955218+0000","last_undegraded":"2026-02-24T09:09:45.955218+0000","last_fullsized":"2026-02-24T09:09:45.955218+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:13:19.756549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268000+0000","last_change":"2026-02-24T09:09:25.270452+0000","last_active":"2026-02-24T09:09:26.268000+0000","last_peered":"2026-02-24T09:09:26.268000+0000","last_clean":"2026-02-24T09:09:26.268000+0000","last_became_active":"2026-02-24T09:09:25.270184+0000","last_became_peered":"2026-02-24T09:09:25.270184+0000","last_unstale":"2026-02-24T09:09:26.268000+0000","last_undegraded":"2026-02-24T09:09:26.268000+0000","last_fullsized":"2026-02-24T09:09:26.268000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:07:41.652941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943662+0000","last_change":"2026-02-24T09:09:24.261249+0000","last_active":"2026-02-24T09:09:28.943662+0000","last_peered":"2026-02-24T09:09:28.943662+0000","last_clean":"2026-02-24T09:09:28.943662+0000","last_became_active":"2026-02-24T09:09:24.261064+0000","last_became_peered":"2026-02-24T09:09:24.261064+0000","last_unstale":"2026-02-24T09:09:28.943662+0000","last_undegraded":"2026-02-24T09:09:28.943662+0000","last_fullsized":"2026-02-24T09:09:28.943662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:59:42.964350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941445+0000","last_change":"2026-02-24T09:09:24.254918+0000","last_active":"2026-02-24T09:09:28.941445+0000","last_peered":"2026-02-24T09:09:28.941445+0000","last_clean":"2026-02-24T09:09:28.941445+0000","last_became_active":"2026-02-24T09:09:24.254590+0000","last_became_peered":"2026-02-24T09:09:24.254590+0000","last_unstale":"2026-02-24T09:09:28.941445+0000","last_undegraded":"2026-02-24T09:09:28.941445+0000","last_fullsized":"2026-02-24T09:09:28.941445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:03:19.504844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268666+0000","last_change":"2026-02-24T09:09:25.267204+0000","last_active":"2026-02-24T09:09:26.268666+0000","last_peered":"2026-02-24T09:09:26.268666+0000","last_clean":"2026-02-24T09:09:26.268666+0000","last_became_active":"2026-02-24T09:09:25.266489+0000","last_became_peered":"2026-02-24T09:09:25.266489+0000","last_unstale":"2026-02-24T09:09:26.268666+0000","last_undegraded":"2026-02-24T09:09:26.268666+0000","last_fullsized":"2026-02-24T09:09:26.268666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:26:34.500054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210732+0000","last_change":"2026-02-24T09:09:24.258042+0000","last_active":"2026-02-24T09:09:27.210732+0000","last_peered":"2026-02-24T09:09:27.210732+0000","last_clean":"2026-02-24T09:09:27.210732+0000","last_became_active":"2026-02-24T09:09:24.257801+0000","last_became_peered":"2026-02-24T09:09:24.257801+0000","last_unstale":"2026-02-24T09:09:27.210732+0000","last_undegraded":"2026-02-24T09:09:27.210732+0000","last_fullsized":"2026-02-24T09:09:27.210732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:27.596990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267334+0000","last_change":"2026-02-24T09:09:25.267636+0000","last_active":"2026-02-24T09:09:26.267334+0000","last_peered":"2026-02-24T09:09:26.267334+0000","last_clean":"2026-02-24T09:09:26.267334+0000","last_became_active":"2026-02-24T09:09:25.267505+0000","last_became_peered":"2026-02-24T09:09:25.267505+0000","last_unstale":"2026-02-24T09:09:26.267334+0000","last_undegraded":"2026-02-24T09:09:26.267334+0000","last_fullsized":"2026-02-24T09:09:26.267334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:20.660345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:44.956775+0000","last_change":"2026-02-24T09:09:24.260793+0000","last_active":"2026-02-24T09:09:44.956775+0000","last_peered":"2026-02-24T09:09:44.956775+0000","last_clean":"2026-02-24T09:09:44.956775+0000","last_became_active":"2026-02-24T09:09:24.260555+0000","last_became_peered":"2026-02-24T09:09:24.260555+0000","last_unstale":"2026-02-24T09:09:44.956775+0000","last_undegraded":"2026-02-24T09:09:44.956775+0000","last_fullsized":"2026-02-24T09:09:44.956775+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:30:45.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334847+0000","last_change":"2026-02-24T09:09:25.271121+0000","last_active":"2026-02-24T09:09:26.334847+0000","last_peered":"2026-02-24T09:09:26.334847+0000","last_clean":"2026-02-24T09:09:26.334847+0000","last_became_active":"2026-02-24T09:09:25.270770+0000","last_became_peered":"2026-02-24T09:09:25.270770+0000","last_unstale":"2026-02-24T09:09:26.334847+0000","last_undegraded":"2026-02-24T09:09:26.334847+0000","last_fullsized":"2026-02-24T09:09:26.334847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:52:58.451719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940998+0000","last_change":"2026-02-24T09:09:24.259030+0000","last_active":"2026-02-24T09:09:27.940998+0000","last_peered":"2026-02-24T09:09:27.940998+0000","last_clean":"2026-02-24T09:09:27.940998+0000","last_became_active":"2026-02-24T09:09:24.258747+0000","last_became_peered":"2026-02-24T09:09:24.258747+0000","last_unstale":"2026-02-24T09:09:27.940998+0000","last_undegraded":"2026-02-24T09:09:27.940998+0000","last_fullsized":"2026-02-24T09:09:27.940998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:49:46.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267794+0000","last_change":"2026-02-24T09:09:25.269875+0000","last_active":"2026-02-24T09:09:26.267794+0000","last_peered":"2026-02-24T09:09:26.267794+0000","last_clean":"2026-02-24T09:09:26.267794+0000","last_became_active":"2026-02-24T09:09:25.269400+0000","last_became_peered":"2026-02-24T09:09:25.269400+0000","last_unstale":"2026-02-24T09:09:26.267794+0000","last_undegraded":"2026-02-24T09:09:26.267794+0000","last_fullsized":"2026-02-24T09:09:26.267794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:08:29.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938278+0000","last_change":"2026-02-24T09:09:24.256845+0000","last_active":"2026-02-24T09:09:27.938278+0000","last_peered":"2026-02-24T09:09:27.938278+0000","last_clean":"2026-02-24T09:09:27.938278+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:27.938278+0000","last_undegraded":"2026-02-24T09:09:27.938278+0000","last_fullsized":"2026-02-24T09:09:27.938278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:08:15.802226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334785+0000","last_change":"2026-02-24T09:09:25.269608+0000","last_active":"2026-02-24T09:09:26.334785+0000","last_peered":"2026-02-24T09:09:26.334785+0000","last_clean":"2026-02-24T09:09:26.334785+0000","last_became_active":"2026-02-24T09:09:25.268736+0000","last_became_peered":"2026-02-24T09:09:25.268736+0000","last_unstale":"2026-02-24T09:09:26.334785+0000","last_undegraded":"2026-02-24T09:09:26.334785+0000","last_fullsized":"2026-02-24T09:09:26.334785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:39:41.466580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'27","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:45.960158+0000","last_change":"2026-02-24T09:09:24.260591+0000","last_active":"2026-02-24T09:09:45.960158+0000","last_peered":"2026-02-24T09:09:45.960158+0000","last_clean":"2026-02-24T09:09:45.960158+0000","last_became_active":"2026-02-24T09:09:24.260382+0000","last_became_peered":"2026-02-24T09:09:24.260382+0000","last_unstale":"2026-02-24T09:09:45.960158+0000","last_undegraded":"2026-02-24T09:09:45.960158+0000","last_fullsized":"2026-02-24T09:09:45.960158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:05:00.313499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67354,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":86,"num_write":28,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267717+0000","last_change":"2026-02-24T09:09:25.266872+0000","last_active":"2026-02-24T09:09:26.267717+0000","last_peered":"2026-02-24T09:09:26.267717+0000","last_clean":"2026-02-24T09:09:26.267717+0000","last_became_active":"2026-02-24T09:09:25.266720+0000","last_became_peered":"2026-02-24T09:09:25.266720+0000","last_unstale":"2026-02-24T09:09:26.267717+0000","last_undegraded":"2026-02-24T09:09:26.267717+0000","last_fullsized":"2026-02-24T09:09:26.267717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:43.574647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941766+0000","last_change":"2026-02-24T09:09:24.256821+0000","last_active":"2026-02-24T09:09:28.941766+0000","last_peered":"2026-02-24T09:09:28.941766+0000","last_clean":"2026-02-24T09:09:28.941766+0000","last_became_active":"2026-02-24T09:09:24.256284+0000","last_became_peered":"2026-02-24T09:09:24.256284+0000","last_unstale":"2026-02-24T09:09:28.941766+0000","last_undegraded":"2026-02-24T09:09:28.941766+0000","last_fullsized":"2026-02-24T09:09:28.941766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:37:32.352734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332187+0000","last_change":"2026-02-24T09:09:25.268120+0000","last_active":"2026-02-24T09:09:26.332187+0000","last_peered":"2026-02-24T09:09:26.332187+0000","last_clean":"2026-02-24T09:09:26.332187+0000","last_became_active":"2026-02-24T09:09:25.267865+0000","last_became_peered":"2026-02-24T09:09:25.267865+0000","last_unstale":"2026-02-24T09:09:26.332187+0000","last_undegraded":"2026-02-24T09:09:26.332187+0000","last_fullsized":"2026-02-24T09:09:26.332187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:51:18.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938196+0000","last_change":"2026-02-24T09:09:24.257176+0000","last_active":"2026-02-24T09:09:27.938196+0000","last_peered":"2026-02-24T09:09:27.938196+0000","last_clean":"2026-02-24T09:09:27.938196+0000","last_became_active":"2026-02-24T09:09:24.256855+0000","last_became_peered":"2026-02-24T09:09:24.256855+0000","last_unstale":"2026-02-24T09:09:27.938196+0000","last_undegraded":"2026-02-24T09:09:27.938196+0000","last_fullsized":"2026-02-24T09:09:27.938196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:48:25.179774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733497+0000","last_change":"2026-02-24T09:09:25.271913+0000","last_active":"2026-02-24T09:09:26.733497+0000","last_peered":"2026-02-24T09:09:26.733497+0000","last_clean":"2026-02-24T09:09:26.733497+0000","last_became_active":"2026-02-24T09:09:25.271736+0000","last_became_peered":"2026-02-24T09:09:25.271736+0000","last_unstale":"2026-02-24T09:09:26.733497+0000","last_undegraded":"2026-02-24T09:09:26.733497+0000","last_fullsized":"2026-02-24T09:09:26.733497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:49.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:47.961761+0000","last_change":"2026-02-24T09:09:24.259308+0000","last_active":"2026-02-24T09:09:47.961761+0000","last_peered":"2026-02-24T09:09:47.961761+0000","last_clean":"2026-02-24T09:09:47.961761+0000","last_became_active":"2026-02-24T09:09:24.259131+0000","last_became_peered":"2026-02-24T09:09:24.259131+0000","last_unstale":"2026-02-24T09:09:47.961761+0000","last_undegraded":"2026-02-24T09:09:47.961761+0000","last_fullsized":"2026-02-24T09:09:47.961761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:52:00.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733165+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.733165+0000","last_peered":"2026-02-24T09:09:26.733165+0000","last_clean":"2026-02-24T09:09:26.733165+0000","last_became_active":"2026-02-24T09:09:25.269559+0000","last_became_peered":"2026-02-24T09:09:25.269559+0000","last_unstale":"2026-02-24T09:09:26.733165+0000","last_undegraded":"2026-02-24T09:09:26.733165+0000","last_fullsized":"2026-02-24T09:09:26.733165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:06:28.902948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942522+0000","last_change":"2026-02-24T09:09:24.257075+0000","last_active":"2026-02-24T09:09:28.942522+0000","last_peered":"2026-02-24T09:09:28.942522+0000","last_clean":"2026-02-24T09:09:28.942522+0000","last_became_active":"2026-02-24T09:09:24.256738+0000","last_became_peered":"2026-02-24T09:09:24.256738+0000","last_unstale":"2026-02-24T09:09:28.942522+0000","last_undegraded":"2026-02-24T09:09:28.942522+0000","last_fullsized":"2026-02-24T09:09:28.942522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:14.802040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268002+0000","last_change":"2026-02-24T09:09:25.271423+0000","last_active":"2026-02-24T09:09:26.268002+0000","last_peered":"2026-02-24T09:09:26.268002+0000","last_clean":"2026-02-24T09:09:26.268002+0000","last_became_active":"2026-02-24T09:09:25.271142+0000","last_became_peered":"2026-02-24T09:09:25.271142+0000","last_unstale":"2026-02-24T09:09:26.268002+0000","last_undegraded":"2026-02-24T09:09:26.268002+0000","last_fullsized":"2026-02-24T09:09:26.268002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:16.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.940354+0000","last_change":"2026-02-24T09:09:24.258426+0000","last_active":"2026-02-24T09:09:29.940354+0000","last_peered":"2026-02-24T09:09:29.940354+0000","last_clean":"2026-02-24T09:09:29.940354+0000","last_became_active":"2026-02-24T09:09:24.257941+0000","last_became_peered":"2026-02-24T09:09:24.257941+0000","last_unstale":"2026-02-24T09:09:29.940354+0000","last_undegraded":"2026-02-24T09:09:29.940354+0000","last_fullsized":"2026-02-24T09:09:29.940354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:30:29.724001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332552+0000","last_change":"2026-02-24T09:09:25.266758+0000","last_active":"2026-02-24T09:09:26.332552+0000","last_peered":"2026-02-24T09:09:26.332552+0000","last_clean":"2026-02-24T09:09:26.332552+0000","last_became_active":"2026-02-24T09:09:25.266569+0000","last_became_peered":"2026-02-24T09:09:25.266569+0000","last_unstale":"2026-02-24T09:09:26.332552+0000","last_undegraded":"2026-02-24T09:09:26.332552+0000","last_fullsized":"2026-02-24T09:09:26.332552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:13:56.985056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332354+0000","last_change":"2026-02-24T09:09:24.256974+0000","last_active":"2026-02-24T09:09:26.332354+0000","last_peered":"2026-02-24T09:09:26.332354+0000","last_clean":"2026-02-24T09:09:26.332354+0000","last_became_active":"2026-02-24T09:09:24.256617+0000","last_became_peered":"2026-02-24T09:09:24.256617+0000","last_unstale":"2026-02-24T09:09:26.332354+0000","last_undegraded":"2026-02-24T09:09:26.332354+0000","last_fullsized":"2026-02-24T09:09:26.332354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:28.318156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733475+0000","last_change":"2026-02-24T09:09:25.270445+0000","last_active":"2026-02-24T09:09:26.733475+0000","last_peered":"2026-02-24T09:09:26.733475+0000","last_clean":"2026-02-24T09:09:26.733475+0000","last_became_active":"2026-02-24T09:09:25.270275+0000","last_became_peered":"2026-02-24T09:09:25.270275+0000","last_unstale":"2026-02-24T09:09:26.733475+0000","last_undegraded":"2026-02-24T09:09:26.733475+0000","last_fullsized":"2026-02-24T09:09:26.733475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:53:49.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210815+0000","last_change":"2026-02-24T09:09:24.259031+0000","last_active":"2026-02-24T09:09:27.210815+0000","last_peered":"2026-02-24T09:09:27.210815+0000","last_clean":"2026-02-24T09:09:27.210815+0000","last_became_active":"2026-02-24T09:09:24.258899+0000","last_became_peered":"2026-02-24T09:09:24.258899+0000","last_unstale":"2026-02-24T09:09:27.210815+0000","last_undegraded":"2026-02-24T09:09:27.210815+0000","last_fullsized":"2026-02-24T09:09:27.210815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:16.802986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109422+0000","last_change":"2026-02-24T09:09:25.272707+0000","last_active":"2026-02-24T09:09:28.109422+0000","last_peered":"2026-02-24T09:09:28.109422+0000","last_clean":"2026-02-24T09:09:28.109422+0000","last_became_active":"2026-02-24T09:09:25.272563+0000","last_became_peered":"2026-02-24T09:09:25.272563+0000","last_unstale":"2026-02-24T09:09:28.109422+0000","last_undegraded":"2026-02-24T09:09:28.109422+0000","last_fullsized":"2026-02-24T09:09:28.109422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:41:22.895217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942219+0000","last_change":"2026-02-24T09:09:24.256493+0000","last_active":"2026-02-24T09:09:28.942219+0000","last_peered":"2026-02-24T09:09:28.942219+0000","last_clean":"2026-02-24T09:09:28.942219+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:28.942219+0000","last_undegraded":"2026-02-24T09:09:28.942219+0000","last_fullsized":"2026-02-24T09:09:28.942219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:43:12.259841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733528+0000","last_change":"2026-02-24T09:09:25.271977+0000","last_active":"2026-02-24T09:09:26.733528+0000","last_peered":"2026-02-24T09:09:26.733528+0000","last_clean":"2026-02-24T09:09:26.733528+0000","last_became_active":"2026-02-24T09:09:25.271650+0000","last_became_peered":"2026-02-24T09:09:25.271650+0000","last_unstale":"2026-02-24T09:09:26.733528+0000","last_undegraded":"2026-02-24T09:09:26.733528+0000","last_fullsized":"2026-02-24T09:09:26.733528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:10.062115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733207+0000","last_change":"2026-02-24T09:09:05.953512+0000","last_active":"2026-02-24T09:09:26.733207+0000","last_peered":"2026-02-24T09:09:26.733207+0000","last_clean":"2026-02-24T09:09:26.733207+0000","last_became_active":"2026-02-24T09:09:05.953360+0000","last_became_peered":"2026-02-24T09:09:05.953360+0000","last_unstale":"2026-02-24T09:09:26.733207+0000","last_undegraded":"2026-02-24T09:09:26.733207+0000","last_fullsized":"2026-02-24T09:09:26.733207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_clean_scrub_stamp":"2026-02-24T09:08:00.445410+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:48.550493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.945604+0000","last_change":"2026-02-24T09:09:24.259164+0000","last_active":"2026-02-24T09:09:29.945604+0000","last_peered":"2026-02-24T09:09:29.945604+0000","last_clean":"2026-02-24T09:09:29.945604+0000","last_became_active":"2026-02-24T09:09:24.259011+0000","last_became_peered":"2026-02-24T09:09:24.259011+0000","last_unstale":"2026-02-24T09:09:29.945604+0000","last_undegraded":"2026-02-24T09:09:29.945604+0000","last_fullsized":"2026-02-24T09:09:29.945604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:41.649484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268864+0000","last_change":"2026-02-24T09:09:25.269884+0000","last_active":"2026-02-24T09:09:26.268864+0000","last_peered":"2026-02-24T09:09:26.268864+0000","last_clean":"2026-02-24T09:09:26.268864+0000","last_became_active":"2026-02-24T09:09:25.269543+0000","last_became_peered":"2026-02-24T09:09:25.269543+0000","last_unstale":"2026-02-24T09:09:26.268864+0000","last_undegraded":"2026-02-24T09:09:26.268864+0000","last_fullsized":"2026-02-24T09:09:26.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:21:25.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943350+0000","last_change":"2026-02-24T09:09:24.259369+0000","last_active":"2026-02-24T09:09:28.943350+0000","last_peered":"2026-02-24T09:09:28.943350+0000","last_clean":"2026-02-24T09:09:28.943350+0000","last_became_active":"2026-02-24T09:09:24.259086+0000","last_became_peered":"2026-02-24T09:09:24.259086+0000","last_unstale":"2026-02-24T09:09:28.943350+0000","last_undegraded":"2026-02-24T09:09:28.943350+0000","last_fullsized":"2026-02-24T09:09:28.943350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:08.881900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332119+0000","last_change":"2026-02-24T09:09:25.266898+0000","last_active":"2026-02-24T09:09:26.332119+0000","last_peered":"2026-02-24T09:09:26.332119+0000","last_clean":"2026-02-24T09:09:26.332119+0000","last_became_active":"2026-02-24T09:09:25.266407+0000","last_became_peered":"2026-02-24T09:09:25.266407+0000","last_unstale":"2026-02-24T09:09:26.332119+0000","last_undegraded":"2026-02-24T09:09:26.332119+0000","last_fullsized":"2026-02-24T09:09:26.332119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:51.887929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:48.959424+0000","last_change":"2026-02-24T09:09:24.254126+0000","last_active":"2026-02-24T09:09:48.959424+0000","last_peered":"2026-02-24T09:09:48.959424+0000","last_clean":"2026-02-24T09:09:48.959424+0000","last_became_active":"2026-02-24T09:09:24.253911+0000","last_became_peered":"2026-02-24T09:09:24.253911+0000","last_unstale":"2026-02-24T09:09:48.959424+0000","last_undegraded":"2026-02-24T09:09:48.959424+0000","last_fullsized":"2026-02-24T09:09:48.959424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:09:56.146842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268161+0000","last_change":"2026-02-24T09:09:25.270387+0000","last_active":"2026-02-24T09:09:26.268161+0000","last_peered":"2026-02-24T09:09:26.268161+0000","last_clean":"2026-02-24T09:09:26.268161+0000","last_became_active":"2026-02-24T09:09:25.269478+0000","last_became_peered":"2026-02-24T09:09:25.269478+0000","last_unstale":"2026-02-24T09:09:26.268161+0000","last_undegraded":"2026-02-24T09:09:26.268161+0000","last_fullsized":"2026-02-24T09:09:26.268161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:32:15.217221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109411+0000","last_change":"2026-02-24T09:09:24.259169+0000","last_active":"2026-02-24T09:09:28.109411+0000","last_peered":"2026-02-24T09:09:28.109411+0000","last_clean":"2026-02-24T09:09:28.109411+0000","last_became_active":"2026-02-24T09:09:24.258755+0000","last_became_peered":"2026-02-24T09:09:24.258755+0000","last_unstale":"2026-02-24T09:09:28.109411+0000","last_undegraded":"2026-02-24T09:09:28.109411+0000","last_fullsized":"2026-02-24T09:09:28.109411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:33.438504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270152+0000","last_change":"2026-02-24T09:09:25.270732+0000","last_active":"2026-02-24T09:09:26.270152+0000","last_peered":"2026-02-24T09:09:26.270152+0000","last_clean":"2026-02-24T09:09:26.270152+0000","last_became_active":"2026-02-24T09:09:25.270200+0000","last_became_peered":"2026-02-24T09:09:25.270200+0000","last_unstale":"2026-02-24T09:09:26.270152+0000","last_undegraded":"2026-02-24T09:09:26.270152+0000","last_fullsized":"2026-02-24T09:09:26.270152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:59:28.115196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267351+0000","last_change":"2026-02-24T09:09:24.257488+0000","last_active":"2026-02-24T09:09:26.267351+0000","last_peered":"2026-02-24T09:09:26.267351+0000","last_clean":"2026-02-24T09:09:26.267351+0000","last_became_active":"2026-02-24T09:09:24.257202+0000","last_became_peered":"2026-02-24T09:09:24.257202+0000","last_unstale":"2026-02-24T09:09:26.267351+0000","last_undegraded":"2026-02-24T09:09:26.267351+0000","last_fullsized":"2026-02-24T09:09:26.267351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:41:24.345307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.674896+0000","last_change":"2026-02-24T09:09:25.272254+0000","last_active":"2026-02-24T09:09:26.674896+0000","last_peered":"2026-02-24T09:09:26.674896+0000","last_clean":"2026-02-24T09:09:26.674896+0000","last_became_active":"2026-02-24T09:09:25.271674+0000","last_became_peered":"2026-02-24T09:09:25.271674+0000","last_unstale":"2026-02-24T09:09:26.674896+0000","last_undegraded":"2026-02-24T09:09:26.674896+0000","last_fullsized":"2026-02-24T09:09:26.674896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:03:26.493850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938246+0000","last_change":"2026-02-24T09:09:24.257331+0000","last_active":"2026-02-24T09:09:27.938246+0000","last_peered":"2026-02-24T09:09:27.938246+0000","last_clean":"2026-02-24T09:09:27.938246+0000","last_became_active":"2026-02-24T09:09:24.256876+0000","last_became_peered":"2026-02-24T09:09:24.256876+0000","last_unstale":"2026-02-24T09:09:27.938246+0000","last_undegraded":"2026-02-24T09:09:27.938246+0000","last_fullsized":"2026-02-24T09:09:27.938246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:29:58.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332332+0000","last_change":"2026-02-24T09:09:25.266642+0000","last_active":"2026-02-24T09:09:26.332332+0000","last_peered":"2026-02-24T09:09:26.332332+0000","last_clean":"2026-02-24T09:09:26.332332+0000","last_became_active":"2026-02-24T09:09:25.266307+0000","last_became_peered":"2026-02-24T09:09:25.266307+0000","last_unstale":"2026-02-24T09:09:26.332332+0000","last_undegraded":"2026-02-24T09:09:26.332332+0000","last_fullsized":"2026-02-24T09:09:26.332332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:51.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:37.268830+0000","last_change":"2026-02-24T09:09:24.258807+0000","last_active":"2026-02-24T09:09:37.268830+0000","last_peered":"2026-02-24T09:09:37.268830+0000","last_clean":"2026-02-24T09:09:37.268830+0000","last_became_active":"2026-02-24T09:09:24.258649+0000","last_became_peered":"2026-02-24T09:09:24.258649+0000","last_unstale":"2026-02-24T09:09:37.268830+0000","last_undegraded":"2026-02-24T09:09:37.268830+0000","last_fullsized":"2026-02-24T09:09:37.268830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:10:48.348275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269009+0000","last_change":"2026-02-24T09:09:25.268491+0000","last_active":"2026-02-24T09:09:26.269009+0000","last_peered":"2026-02-24T09:09:26.269009+0000","last_clean":"2026-02-24T09:09:26.269009+0000","last_became_active":"2026-02-24T09:09:25.267341+0000","last_became_peered":"2026-02-24T09:09:25.267341+0000","last_unstale":"2026-02-24T09:09:26.269009+0000","last_undegraded":"2026-02-24T09:09:26.269009+0000","last_fullsized":"2026-02-24T09:09:26.269009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:18:29.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940964+0000","last_change":"2026-02-24T09:09:24.258484+0000","last_active":"2026-02-24T09:09:27.940964+0000","last_peered":"2026-02-24T09:09:27.940964+0000","last_clean":"2026-02-24T09:09:27.940964+0000","last_became_active":"2026-02-24T09:09:24.258249+0000","last_became_peered":"2026-02-24T09:09:24.258249+0000","last_unstale":"2026-02-24T09:09:27.940964+0000","last_undegraded":"2026-02-24T09:09:27.940964+0000","last_fullsized":"2026-02-24T09:09:27.940964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:32:56.722522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267783+0000","last_change":"2026-02-24T09:09:25.269738+0000","last_active":"2026-02-24T09:09:26.267783+0000","last_peered":"2026-02-24T09:09:26.267783+0000","last_clean":"2026-02-24T09:09:26.267783+0000","last_became_active":"2026-02-24T09:09:25.269413+0000","last_became_peered":"2026-02-24T09:09:25.269413+0000","last_unstale":"2026-02-24T09:09:26.267783+0000","last_undegraded":"2026-02-24T09:09:26.267783+0000","last_fullsized":"2026-02-24T09:09:26.267783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:00.412570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941334+0000","last_change":"2026-02-24T09:09:24.258901+0000","last_active":"2026-02-24T09:09:27.941334+0000","last_peered":"2026-02-24T09:09:27.941334+0000","last_clean":"2026-02-24T09:09:27.941334+0000","last_became_active":"2026-02-24T09:09:24.258325+0000","last_became_peered":"2026-02-24T09:09:24.258325+0000","last_unstale":"2026-02-24T09:09:27.941334+0000","last_undegraded":"2026-02-24T09:09:27.941334+0000","last_fullsized":"2026-02-24T09:09:27.941334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:36.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267522+0000","last_change":"2026-02-24T09:09:25.267368+0000","last_active":"2026-02-24T09:09:26.267522+0000","last_peered":"2026-02-24T09:09:26.267522+0000","last_clean":"2026-02-24T09:09:26.267522+0000","last_became_active":"2026-02-24T09:09:25.267168+0000","last_became_peered":"2026-02-24T09:09:25.267168+0000","last_unstale":"2026-02-24T09:09:26.267522+0000","last_undegraded":"2026-02-24T09:09:26.267522+0000","last_fullsized":"2026-02-24T09:09:26.267522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:57.616866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.939140+0000","last_change":"2026-02-24T09:09:24.257345+0000","last_active":"2026-02-24T09:09:27.939140+0000","last_peered":"2026-02-24T09:09:27.939140+0000","last_clean":"2026-02-24T09:09:27.939140+0000","last_became_active":"2026-02-24T09:09:24.256817+0000","last_became_peered":"2026-02-24T09:09:24.256817+0000","last_unstale":"2026-02-24T09:09:27.939140+0000","last_undegraded":"2026-02-24T09:09:27.939140+0000","last_fullsized":"2026-02-24T09:09:27.939140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:37:48.042471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332527+0000","last_change":"2026-02-24T09:09:25.267778+0000","last_active":"2026-02-24T09:09:26.332527+0000","last_peered":"2026-02-24T09:09:26.332527+0000","last_clean":"2026-02-24T09:09:26.332527+0000","last_became_active":"2026-02-24T09:09:25.267379+0000","last_became_peered":"2026-02-24T09:09:25.267379+0000","last_unstale":"2026-02-24T09:09:26.332527+0000","last_undegraded":"2026-02-24T09:09:26.332527+0000","last_fullsized":"2026-02-24T09:09:26.332527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:25:47.194857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.121396+0000","last_change":"2026-02-24T09:09:24.259141+0000","last_active":"2026-02-24T09:09:28.121396+0000","last_peered":"2026-02-24T09:09:28.121396+0000","last_clean":"2026-02-24T09:09:28.121396+0000","last_became_active":"2026-02-24T09:09:24.258981+0000","last_became_peered":"2026-02-24T09:09:24.258981+0000","last_unstale":"2026-02-24T09:09:28.121396+0000","last_undegraded":"2026-02-24T09:09:28.121396+0000","last_fullsized":"2026-02-24T09:09:28.121396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:48.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268774+0000","last_change":"2026-02-24T09:09:25.268540+0000","last_active":"2026-02-24T09:09:26.268774+0000","last_peered":"2026-02-24T09:09:26.268774+0000","last_clean":"2026-02-24T09:09:26.268774+0000","last_became_active":"2026-02-24T09:09:25.267915+0000","last_became_peered":"2026-02-24T09:09:25.267915+0000","last_unstale":"2026-02-24T09:09:26.268774+0000","last_undegraded":"2026-02-24T09:09:26.268774+0000","last_fullsized":"2026-02-24T09:09:26.268774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:55.564971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938005+0000","last_change":"2026-02-24T09:09:24.257964+0000","last_active":"2026-02-24T09:09:27.938005+0000","last_peered":"2026-02-24T09:09:27.938005+0000","last_clean":"2026-02-24T09:09:27.938005+0000","last_became_active":"2026-02-24T09:09:24.257717+0000","last_became_peered":"2026-02-24T09:09:24.257717+0000","last_unstale":"2026-02-24T09:09:27.938005+0000","last_undegraded":"2026-02-24T09:09:27.938005+0000","last_fullsized":"2026-02-24T09:09:27.938005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:23:24.989893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733433+0000","last_change":"2026-02-24T09:09:25.271214+0000","last_active":"2026-02-24T09:09:26.733433+0000","last_peered":"2026-02-24T09:09:26.733433+0000","last_clean":"2026-02-24T09:09:26.733433+0000","last_became_active":"2026-02-24T09:09:25.271038+0000","last_became_peered":"2026-02-24T09:09:25.271038+0000","last_unstale":"2026-02-24T09:09:26.733433+0000","last_undegraded":"2026-02-24T09:09:26.733433+0000","last_fullsized":"2026-02-24T09:09:26.733433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:58:44.899837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268097+0000","last_change":"2026-02-24T09:09:25.269834+0000","last_active":"2026-02-24T09:09:26.268097+0000","last_peered":"2026-02-24T09:09:26.268097+0000","last_clean":"2026-02-24T09:09:26.268097+0000","last_became_active":"2026-02-24T09:09:25.269526+0000","last_became_peered":"2026-02-24T09:09:25.269526+0000","last_unstale":"2026-02-24T09:09:26.268097+0000","last_undegraded":"2026-02-24T09:09:26.268097+0000","last_fullsized":"2026-02-24T09:09:26.268097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:36:54.610640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267687+0000","last_change":"2026-02-24T09:09:24.258597+0000","last_active":"2026-02-24T09:09:26.267687+0000","last_peered":"2026-02-24T09:09:26.267687+0000","last_clean":"2026-02-24T09:09:26.267687+0000","last_became_active":"2026-02-24T09:09:24.258302+0000","last_became_peered":"2026-02-24T09:09:24.258302+0000","last_unstale":"2026-02-24T09:09:26.267687+0000","last_undegraded":"2026-02-24T09:09:26.267687+0000","last_fullsized":"2026-02-24T09:09:26.267687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:20:15.556479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334746+0000","last_change":"2026-02-24T09:09:25.269804+0000","last_active":"2026-02-24T09:09:26.334746+0000","last_peered":"2026-02-24T09:09:26.334746+0000","last_clean":"2026-02-24T09:09:26.334746+0000","last_became_active":"2026-02-24T09:09:25.268973+0000","last_became_peered":"2026-02-24T09:09:25.268973+0000","last_unstale":"2026-02-24T09:09:26.334746+0000","last_undegraded":"2026-02-24T09:09:26.334746+0000","last_fullsized":"2026-02-24T09:09:26.334746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:33:39.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942003+0000","last_change":"2026-02-24T09:09:24.257428+0000","last_active":"2026-02-24T09:09:28.942003+0000","last_peered":"2026-02-24T09:09:28.942003+0000","last_clean":"2026-02-24T09:09:28.942003+0000","last_became_active":"2026-02-24T09:09:24.256679+0000","last_became_peered":"2026-02-24T09:09:24.256679+0000","last_unstale":"2026-02-24T09:09:28.942003+0000","last_undegraded":"2026-02-24T09:09:28.942003+0000","last_fullsized":"2026-02-24T09:09:28.942003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:39:28.664820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267792+0000","last_change":"2026-02-24T09:09:25.268127+0000","last_active":"2026-02-24T09:09:26.267792+0000","last_peered":"2026-02-24T09:09:26.267792+0000","last_clean":"2026-02-24T09:09:26.267792+0000","last_became_active":"2026-02-24T09:09:25.267860+0000","last_became_peered":"2026-02-24T09:09:25.267860+0000","last_unstale":"2026-02-24T09:09:26.267792+0000","last_undegraded":"2026-02-24T09:09:26.267792+0000","last_fullsized":"2026-02-24T09:09:26.267792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:37:52.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269053+0000","last_change":"2026-02-24T09:09:24.257552+0000","last_active":"2026-02-24T09:09:26.269053+0000","last_peered":"2026-02-24T09:09:26.269053+0000","last_clean":"2026-02-24T09:09:26.269053+0000","last_became_active":"2026-02-24T09:09:24.257163+0000","last_became_peered":"2026-02-24T09:09:24.257163+0000","last_unstale":"2026-02-24T09:09:26.269053+0000","last_undegraded":"2026-02-24T09:09:26.269053+0000","last_fullsized":"2026-02-24T09:09:26.269053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:30:54.285800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268961+0000","last_change":"2026-02-24T09:09:25.268695+0000","last_active":"2026-02-24T09:09:26.268961+0000","last_peered":"2026-02-24T09:09:26.268961+0000","last_clean":"2026-02-24T09:09:26.268961+0000","last_became_active":"2026-02-24T09:09:25.268128+0000","last_became_peered":"2026-02-24T09:09:25.268128+0000","last_unstale":"2026-02-24T09:09:26.268961+0000","last_undegraded":"2026-02-24T09:09:26.268961+0000","last_fullsized":"2026-02-24T09:09:26.268961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:23.987958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942226+0000","last_change":"2026-02-24T09:09:24.257602+0000","last_active":"2026-02-24T09:09:28.942226+0000","last_peered":"2026-02-24T09:09:28.942226+0000","last_clean":"2026-02-24T09:09:28.942226+0000","last_became_active":"2026-02-24T09:09:24.257440+0000","last_became_peered":"2026-02-24T09:09:24.257440+0000","last_unstale":"2026-02-24T09:09:28.942226+0000","last_undegraded":"2026-02-24T09:09:28.942226+0000","last_fullsized":"2026-02-24T09:09:28.942226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:13:51.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71404,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":135,"num_read_kb":143,"num_write":155,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":215667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119920,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":259322,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710732,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":395125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":27582038},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939659,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27916,"kb_used_data":952,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975284,"statfs":{"total":751619276800,"available":751590690816,"internally_reserved":0,"allocated":974848,"data_stored":1054370,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23856,"internal_metadata":27566800},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070478,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24845,"internal_metadata":27565811},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299407,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32956,"internal_metadata":27557700},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528337,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":987230,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28867,"internal_metadata":27561789},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659155,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":394740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888083,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":986504,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":32062,"internal_metadata":27558594},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018901,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31416,"internal_metadata":27559240},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247832,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":395051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47059,"internal_metadata":27543597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476760,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27856,"kb_used_data":892,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975344,"statfs":{"total":751619276800,"available":751590752256,"internally_reserved":0,"allocated":913408,"data_stored":463247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34581,"internal_metadata":27556075},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607578,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27832,"kb_used_data":868,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975368,"statfs":{"total":751619276800,"available":751590776832,"internally_reserved":0,"allocated":888832,"data_stored":463342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49917,"internal_metadata":27540739},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11012,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12011,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13952,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6329,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13842,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3422,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31362,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9492,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13536,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:09:52.857 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:52.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:52 trial004 ceph-mon[41596]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.20", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:52.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:52 trial004 ceph-mon[41596]: pgmap v150: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2026-02-24T09:09:52.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:52 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3372156098' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-24T09:09:52.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:52 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2931161346' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:53.006 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:53.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:52 trial090 ceph-mon[47278]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.20", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:53.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:52 trial090 ceph-mon[47278]: pgmap v150: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2026-02-24T09:09:53.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:52 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3372156098' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-24T09:09:53.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:52 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2931161346' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:53.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:52 trial014 ceph-mon[46941]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.20", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T09:09:53.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:52 trial014 ceph-mon[46941]: pgmap v150: 97 pgs: 97 active+clean; 646 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2026-02-24T09:09:53.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:52 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3372156098' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-24T09:09:53.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:52 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2931161346' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:53.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.105+0000 7f7d5d77b640 1 -- 10.20.193.4:0/200004029 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d58115470 msgr2=0x7f7d58175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.105+0000 7f7d5d77b640 1 --2- 10.20.193.4:0/200004029 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d58115470 0x7f7d58175e40 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=11891324335853959941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d4800aa30 tx=0x7f7d48030270 comp rx=0 tx=0).stop 2026-02-24T09:09:53.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.105+0000 7f7d5d77b640 1 -- 10.20.193.4:0/200004029 shutdown_connections 2026-02-24T09:09:53.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.105+0000 7f7d5d77b640 1 --2- 10.20.193.4:0/200004029 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d58115470 0x7f7d58175e40 unknown :-1 s=CLOSED pgs=431 gs=1 cs=0 l=1 c_cookie=11891324335853959941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.105+0000 7f7d5d77b640 1 --2- 10.20.193.4:0/200004029 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d5810fc70 0x7f7d58114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.105+0000 7f7d5d77b640 1 --2- 10.20.193.4:0/200004029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d5810f280 0x7f7d5810f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.105+0000 7f7d5d77b640 1 -- 10.20.193.4:0/200004029 >> 10.20.193.4:0/200004029 conn(0x7f7d5805f830 msgr2=0x7f7d5810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.105+0000 7f7d5d77b640 1 -- 10.20.193.4:0/200004029 shutdown_connections 2026-02-24T09:09:53.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.105+0000 7f7d5d77b640 1 -- 10.20.193.4:0/200004029 wait complete. 2026-02-24T09:09:53.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d5d77b640 1 Processor -- start 2026-02-24T09:09:53.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d5d77b640 1 -- start start 2026-02-24T09:09:53.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d5d77b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d5810f280 0x7f7d5811db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d5d77b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d5810fc70 0x7f7d5811e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d5d77b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d58115470 0x7f7d58123480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d5d77b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58123a10 con 0x7f7d58115470 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d5d77b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58123b80 con 0x7f7d5810f280 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d5d77b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58123d40 con 0x7f7d5810fc70 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d577fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d58115470 0x7f7d58123480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d577fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d58115470 0x7f7d58123480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50546/0 (socket says 10.20.193.4:50546) 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d577fe640 1 -- 10.20.193.4:0/2709349400 learned_addr learned my addr 10.20.193.4:0/2709349400 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d56ffd640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d5810f280 0x7f7d5811db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d567fc640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d5810fc70 0x7f7d5811e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d577fe640 1 -- 10.20.193.4:0/2709349400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d5810fc70 msgr2=0x7f7d5811e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d577fe640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d5810fc70 0x7f7d5811e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d577fe640 1 -- 10.20.193.4:0/2709349400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d5810f280 msgr2=0x7f7d5811db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d577fe640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d5810f280 0x7f7d5811db70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d577fe640 1 -- 10.20.193.4:0/2709349400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4800a650 con 0x7f7d58115470 2026-02-24T09:09:53.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d56ffd640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d5810f280 0x7f7d5811db70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:53.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d577fe640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d58115470 0x7f7d58123480 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d48032fe0 tx=0x7f7d480039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d37fff640 1 -- 10.20.193.4:0/2709349400 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d4803e070 con 0x7f7d58115470 2026-02-24T09:09:53.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d5d77b640 1 -- 10.20.193.4:0/2709349400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d58123fc0 con 0x7f7d58115470 2026-02-24T09:09:53.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d37fff640 1 -- 10.20.193.4:0/2709349400 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7d480055a0 con 0x7f7d58115470 2026-02-24T09:09:53.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d37fff640 1 -- 10.20.193.4:0/2709349400 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d48042b70 con 0x7f7d58115470 2026-02-24T09:09:53.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.106+0000 7f7d5d77b640 1 -- 10.20.193.4:0/2709349400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d58164610 con 0x7f7d58115470 2026-02-24T09:09:53.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.107+0000 7f7d5d77b640 1 -- 10.20.193.4:0/2709349400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d58110560 con 0x7f7d58115470 2026-02-24T09:09:53.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.108+0000 7f7d37fff640 1 -- 10.20.193.4:0/2709349400 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f7d480050c0 con 0x7f7d58115470 2026-02-24T09:09:53.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.109+0000 7f7d37fff640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d2c0b5770 0x7f7d2c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.109+0000 7f7d56ffd640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d2c0b5770 0x7f7d2c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.109+0000 7f7d37fff640 1 -- 10.20.193.4:0/2709349400 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f7d4810d170 con 0x7f7d58115470 2026-02-24T09:09:53.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.109+0000 7f7d37fff640 1 -- 10.20.193.4:0/2709349400 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f7d480cfbd0 con 0x7f7d58115470 2026-02-24T09:09:53.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.109+0000 7f7d56ffd640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d2c0b5770 0x7f7d2c0d5c20 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d4c005970 tx=0x7f7d4c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.242+0000 7f7d5d77b640 1 -- 10.20.193.4:0/2709349400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d5810f650 con 0x7f7d58115470 2026-02-24T09:09:53.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.242+0000 7f7d37fff640 1 -- 10.20.193.4:0/2709349400 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f7d480d2d80 con 0x7f7d58115470 2026-02-24T09:09:53.246 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:53.247 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:09:53.248 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:09:53.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.243+0000 7f7d5d77b640 1 -- 10.20.193.4:0/2709349400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d2c0b5770 msgr2=0x7f7d2c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.243+0000 7f7d5d77b640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d2c0b5770 0x7f7d2c0d5c20 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d4c005970 tx=0x7f7d4c005900 comp rx=0 tx=0).stop 2026-02-24T09:09:53.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.243+0000 7f7d5d77b640 1 -- 10.20.193.4:0/2709349400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d58115470 msgr2=0x7f7d58123480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.243+0000 7f7d5d77b640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d58115470 0x7f7d58123480 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d48032fe0 tx=0x7f7d480039b0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.244+0000 7f7d5d77b640 1 -- 10.20.193.4:0/2709349400 shutdown_connections 2026-02-24T09:09:53.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.244+0000 7f7d5d77b640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d2c0b5770 0x7f7d2c0d5c20 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.244+0000 7f7d5d77b640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d58115470 0x7f7d58123480 unknown :-1 s=CLOSED pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.244+0000 7f7d5d77b640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d5810fc70 0x7f7d5811e0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.244+0000 7f7d5d77b640 1 --2- 10.20.193.4:0/2709349400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d5810f280 0x7f7d5811db70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.244+0000 7f7d5d77b640 1 -- 10.20.193.4:0/2709349400 >> 10.20.193.4:0/2709349400 conn(0x7f7d5805f830 msgr2=0x7f7d5810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.244+0000 7f7d5d77b640 1 -- 10.20.193.4:0/2709349400 shutdown_connections 2026-02-24T09:09:53.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.244+0000 7f7d5d77b640 1 -- 10.20.193.4:0/2709349400 wait complete. 2026-02-24T09:09:53.285 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:09:53.402 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:53.512 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.506+0000 7fdd5ea00640 1 -- 10.20.193.4:0/983479687 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd58115470 msgr2=0x7fdd58175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.512 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.506+0000 7fdd5ea00640 1 --2- 10.20.193.4:0/983479687 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd58115470 0x7fdd58175e40 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=6541910141072783387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd4c00aa30 tx=0x7fdd4c030280 comp rx=0 tx=0).stop 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.506+0000 7fdd5ea00640 1 -- 10.20.193.4:0/983479687 shutdown_connections 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.506+0000 7fdd5ea00640 1 --2- 10.20.193.4:0/983479687 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd58115470 0x7fdd58175e40 unknown :-1 s=CLOSED pgs=433 gs=1 cs=0 l=1 c_cookie=6541910141072783387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.506+0000 7fdd5ea00640 1 --2- 10.20.193.4:0/983479687 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd5810fc70 0x7fdd58114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.506+0000 7fdd5ea00640 1 --2- 10.20.193.4:0/983479687 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd5810f280 0x7fdd5810f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.506+0000 7fdd5ea00640 1 -- 10.20.193.4:0/983479687 >> 10.20.193.4:0/983479687 conn(0x7fdd5805f830 msgr2=0x7fdd5810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.506+0000 7fdd5ea00640 1 -- 10.20.193.4:0/983479687 shutdown_connections 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.506+0000 7fdd5ea00640 1 -- 10.20.193.4:0/983479687 wait complete. 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd5ea00640 1 Processor -- start 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd5ea00640 1 -- start start 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd5ea00640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd5810f280 0x7fdd580f54e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd5ea00640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd5810fc70 0x7fdd58175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd5ea00640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd58115470 0x7fdd580f5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd5ea00640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fdd580fadf0 con 0x7fdd5810fc70 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd5ea00640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fdd580faf60 con 0x7fdd58115470 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd5ea00640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdd580fb120 con 0x7fdd5810f280 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd577fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd5810fc70 0x7fdd58175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd577fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd5810fc70 0x7fdd58175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50570/0 (socket says 10.20.193.4:50570) 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd577fe640 1 -- 10.20.193.4:0/454949164 learned_addr learned my addr 10.20.193.4:0/454949164 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd57fff640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd5810f280 0x7fdd580f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd5cf76640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd58115470 0x7fdd580f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd577fe640 1 -- 10.20.193.4:0/454949164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd5810f280 msgr2=0x7fdd580f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd577fe640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd5810f280 0x7fdd580f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd577fe640 1 -- 10.20.193.4:0/454949164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd58115470 msgr2=0x7fdd580f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd577fe640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd58115470 0x7fdd580f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd577fe640 1 -- 10.20.193.4:0/454949164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c00a650 con 0x7fdd5810fc70 2026-02-24T09:09:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd577fe640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd5810fc70 0x7fdd58175d40 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd48005db0 tx=0x7fdd4800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.507+0000 7fdd557fa640 1 -- 10.20.193.4:0/454949164 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd48004500 con 0x7fdd5810fc70 2026-02-24T09:09:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.508+0000 7fdd5ea00640 1 -- 10.20.193.4:0/454949164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd580fb400 con 0x7fdd5810fc70 2026-02-24T09:09:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.508+0000 7fdd557fa640 1 -- 10.20.193.4:0/454949164 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdd48004d30 con 0x7fdd5810fc70 2026-02-24T09:09:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.508+0000 7fdd557fa640 1 -- 10.20.193.4:0/454949164 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd48005330 con 0x7fdd5810fc70 2026-02-24T09:09:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.508+0000 7fdd5ea00640 1 -- 10.20.193.4:0/454949164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd580fb880 con 0x7fdd5810fc70 2026-02-24T09:09:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.508+0000 7fdd5ea00640 1 -- 10.20.193.4:0/454949164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd58110560 con 0x7fdd5810fc70 2026-02-24T09:09:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.509+0000 7fdd557fa640 1 -- 10.20.193.4:0/454949164 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fdd480054c0 con 0x7fdd5810fc70 2026-02-24T09:09:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.510+0000 7fdd557fa640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdd2c0b5760 0x7fdd2c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.510+0000 7fdd57fff640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdd2c0b5760 0x7fdd2c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.510+0000 7fdd557fa640 1 -- 10.20.193.4:0/454949164 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fdd480e6fd0 con 0x7fdd5810fc70 2026-02-24T09:09:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.510+0000 7fdd57fff640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdd2c0b5760 0x7fdd2c0d5c10 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd44004740 tx=0x7fdd44005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.511+0000 7fdd557fa640 1 -- 10.20.193.4:0/454949164 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fdd480a9920 con 0x7fdd5810fc70 2026-02-24T09:09:53.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.617+0000 7fdd5ea00640 1 -- 10.20.193.4:0/454949164 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd5810f650 con 0x7fdd5810fc70 2026-02-24T09:09:53.622 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.618+0000 7fdd557fa640 1 -- 10.20.193.4:0/454949164 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22231 (secure 0 0 0) 0x7fdd480acad0 con 0x7fdd5810fc70 2026-02-24T09:09:53.622 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:53.622 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":75,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:26.263940+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:53.623 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 -- 10.20.193.4:0/454949164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdd2c0b5760 msgr2=0x7fdd2c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.623 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdd2c0b5760 0x7fdd2c0d5c10 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd44004740 tx=0x7fdd44005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:53.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 -- 10.20.193.4:0/454949164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd5810fc70 msgr2=0x7fdd58175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd5810fc70 0x7fdd58175d40 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd48005db0 tx=0x7fdd4800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 -- 10.20.193.4:0/454949164 shutdown_connections 2026-02-24T09:09:53.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdd2c0b5760 0x7fdd2c0d5c10 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd58115470 0x7fdd580f5be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd5810fc70 0x7fdd58175d40 unknown :-1 s=CLOSED pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 --2- 10.20.193.4:0/454949164 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd5810f280 0x7fdd580f54e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 -- 10.20.193.4:0/454949164 >> 10.20.193.4:0/454949164 conn(0x7fdd5805f830 msgr2=0x7fdd58112ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 -- 10.20.193.4:0/454949164 shutdown_connections 2026-02-24T09:09:53.624 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.619+0000 7fdd5ea00640 1 -- 10.20.193.4:0/454949164 wait complete. 2026-02-24T09:09:53.677 DEBUG:tasks.fwd_scrub:Yielding 2026-02-24T09:09:53.677 INFO:teuthology.run_tasks:Running task quiescer... 2026-02-24T09:09:53.700 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T09:09:53.700 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:09:53.701 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2026-02-24T09:09:53.701 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:09:53.701 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:09:53.818 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:53.819 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:53.873 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:53 trial004 ceph-mon[41596]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:53.873 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:53 trial004 ceph-mon[41596]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:53.874 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:53 trial004 ceph-mon[41596]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:53.874 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:53 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2709349400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:53.874 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:53 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/454949164' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:53.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 -- 10.20.193.4:0/3772630450 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f100c10f280 msgr2=0x7f100c10f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 --2- 10.20.193.4:0/3772630450 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f100c10f280 0x7f100c10f650 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=9597350927793513272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1000009950 tx=0x7f100002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 -- 10.20.193.4:0/3772630450 shutdown_connections 2026-02-24T09:09:53.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 --2- 10.20.193.4:0/3772630450 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f100c115470 0x7f100c175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 --2- 10.20.193.4:0/3772630450 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f100c10fc70 0x7f100c114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 --2- 10.20.193.4:0/3772630450 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f100c10f280 0x7f100c10f650 unknown :-1 s=CLOSED pgs=435 gs=1 cs=0 l=1 c_cookie=9597350927793513272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 -- 10.20.193.4:0/3772630450 >> 10.20.193.4:0/3772630450 conn(0x7f100c05f830 msgr2=0x7f100c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 -- 10.20.193.4:0/3772630450 shutdown_connections 2026-02-24T09:09:53.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 -- 10.20.193.4:0/3772630450 wait complete. 2026-02-24T09:09:53.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 Processor -- start 2026-02-24T09:09:53.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 -- start start 2026-02-24T09:09:53.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f100c10f280 0x7f100c11dbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f100c10fc70 0x7f100c11e0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f100c115470 0x7f100c1234c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f100c123ae0 con 0x7f100c115470 2026-02-24T09:09:53.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f100c123c50 con 0x7f100c10fc70 2026-02-24T09:09:53.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f101132a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f100c123e10 con 0x7f100c10f280 2026-02-24T09:09:53.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f100c115470 0x7f100c1234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f100c115470 0x7f100c1234c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50590/0 (socket says 10.20.193.4:50590) 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100b7fe640 1 -- 10.20.193.4:0/1396295199 learned_addr learned my addr 10.20.193.4:0/1396295199 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100affd640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f100c10f280 0x7f100c11dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100a7fc640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f100c10fc70 0x7f100c11e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100b7fe640 1 -- 10.20.193.4:0/1396295199 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f100c10f280 msgr2=0x7f100c11dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100b7fe640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f100c10f280 0x7f100c11dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100b7fe640 1 -- 10.20.193.4:0/1396295199 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f100c10fc70 msgr2=0x7f100c11e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100b7fe640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f100c10fc70 0x7f100c11e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100b7fe640 1 -- 10.20.193.4:0/1396295199 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1000009570 con 0x7f100c115470 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100affd640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f100c10f280 0x7f100c11dbb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.924+0000 7f100b7fe640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f100c115470 0x7f100c1234c0 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ffc006e90 tx=0x7f0ffc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.925+0000 7f0febfff640 1 -- 10.20.193.4:0/1396295199 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ffc005500 con 0x7f100c115470 2026-02-24T09:09:53.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.925+0000 7f0febfff640 1 -- 10.20.193.4:0/1396295199 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ffc005e10 con 0x7f100c115470 2026-02-24T09:09:53.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.925+0000 7f101132a640 1 -- 10.20.193.4:0/1396295199 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100c1240f0 con 0x7f100c115470 2026-02-24T09:09:53.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.925+0000 7f0febfff640 1 -- 10.20.193.4:0/1396295199 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ffc003a90 con 0x7f100c115470 2026-02-24T09:09:53.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.925+0000 7f101132a640 1 -- 10.20.193.4:0/1396295199 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100c1647f0 con 0x7f100c115470 2026-02-24T09:09:53.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.925+0000 7f101132a640 1 -- 10.20.193.4:0/1396295199 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f100c110560 con 0x7f100c115470 2026-02-24T09:09:53.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.926+0000 7f0febfff640 1 -- 10.20.193.4:0/1396295199 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f0ffc00c840 con 0x7f100c115470 2026-02-24T09:09:53.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7fa2a6cab640 1 -- 10.20.193.4:0/2926175026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2a010f280 msgr2=0x7fa2a010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7fa2a6cab640 1 --2- 10.20.193.4:0/2926175026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2a010f280 0x7fa2a010f650 secure :-1 s=READY pgs=72 gs=2 cs=0 l=1 c_cookie=4615276774477634952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa290009950 tx=0x7fa29002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7fa2a6cab640 1 -- 10.20.193.4:0/2926175026 shutdown_connections 2026-02-24T09:09:53.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7fa2a6cab640 1 --2- 10.20.193.4:0/2926175026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2a0115470 0x7fa2a0175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7fa2a6cab640 1 --2- 10.20.193.4:0/2926175026 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2a010fc70 0x7fa2a0114cc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7fa2a6cab640 1 --2- 10.20.193.4:0/2926175026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2a010f280 0x7fa2a010f650 unknown :-1 s=CLOSED pgs=72 gs=2 cs=0 l=1 c_cookie=4615276774477634952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7fa2a6cab640 1 -- 10.20.193.4:0/2926175026 >> 10.20.193.4:0/2926175026 conn(0x7fa2a005f830 msgr2=0x7fa2a010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7fa2a6cab640 1 -- 10.20.193.4:0/2926175026 shutdown_connections 2026-02-24T09:09:53.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7f0febfff640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0fe00b5770 0x7f0fe00d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7f0febfff640 1 -- 10.20.193.4:0/1396295199 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f0ffc0e7d90 con 0x7f100c115470 2026-02-24T09:09:53.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7f100affd640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0fe00b5770 0x7f0fe00d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7fa2a6cab640 1 -- 10.20.193.4:0/2926175026 wait complete. 2026-02-24T09:09:53.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.927+0000 7fa2a6cab640 1 Processor -- start 2026-02-24T09:09:53.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7f100affd640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0fe00b5770 0x7f0fe00d5c20 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10000023d0 tx=0x7f1000031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a6cab640 1 -- start start 2026-02-24T09:09:53.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a6cab640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2a010f280 0x7fa2a011dbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a6cab640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2a010fc70 0x7fa2a011e130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a6cab640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2a0115470 0x7fa2a01234b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a6cab640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0123ad0 con 0x7fa2a0115470 2026-02-24T09:09:53.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a6cab640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0123c40 con 0x7fa2a010fc70 2026-02-24T09:09:53.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a6cab640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0123e00 con 0x7fa2a010f280 2026-02-24T09:09:53.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a5221640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2a0115470 0x7fa2a01234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a5221640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2a0115470 0x7fa2a01234b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50610/0 (socket says 10.20.193.4:50610) 2026-02-24T09:09:53.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a5221640 1 -- 10.20.193.4:0/494145818 learned_addr learned my addr 10.20.193.4:0/494145818 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:53.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2a010f280 0x7fa2a011dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa297fff640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2a010fc70 0x7fa2a011e130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7f0febfff640 1 -- 10.20.193.4:0/1396295199 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f0ffc0aa720 con 0x7f100c115470 2026-02-24T09:09:53.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a5221640 1 -- 10.20.193.4:0/494145818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2a010f280 msgr2=0x7fa2a011dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a5221640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2a010f280 0x7fa2a011dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a5221640 1 -- 10.20.193.4:0/494145818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2a010fc70 msgr2=0x7fa2a011e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a5221640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2a010fc70 0x7fa2a011e130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a5221640 1 -- 10.20.193.4:0/494145818 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa290009570 con 0x7fa2a0115470 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2a010f280 0x7fa2a011dbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa297fff640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2a010fc70 0x7fa2a011e130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a5221640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2a0115470 0x7fa2a01234b0 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa29c006e90 tx=0x7fa29c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa295ffb640 1 -- 10.20.193.4:0/494145818 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa29c005500 con 0x7fa2a0115470 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a6cab640 1 -- 10.20.193.4:0/494145818 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a01240e0 con 0x7fa2a0115470 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa295ffb640 1 -- 10.20.193.4:0/494145818 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa29c005e10 con 0x7fa2a0115470 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa295ffb640 1 -- 10.20.193.4:0/494145818 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa29c003a90 con 0x7fa2a0115470 2026-02-24T09:09:53.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.928+0000 7fa2a6cab640 1 -- 10.20.193.4:0/494145818 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a01647e0 con 0x7fa2a0115470 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.930+0000 7fa295ffb640 1 -- 10.20.193.4:0/494145818 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fa29c003c20 con 0x7fa2a0115470 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.931+0000 7fa295ffb640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa27c0b5770 0x7fa27c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.931+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa27c0b5770 0x7fa27c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.931+0000 7fa295ffb640 1 -- 10.20.193.4:0/494145818 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fa29c0e7a60 con 0x7fa2a0115470 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.931+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa27c0b5770 0x7fa27c0d5c20 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2900023d0 tx=0x7fa290031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a8ca5e00 1 Processor -- start 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a8ca5e00 1 -- start start 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909300 0x560cb39096d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909c10 0x560cb394e370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb394e8b0 0x560cb396ec90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560cb3819520 con 0x560cb394e8b0 2026-02-24T09:09:53.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560cb3815250 con 0x560cb3909c10 2026-02-24T09:09:53.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560cb380f3b0 con 0x560cb3909300 2026-02-24T09:09:53.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a5221640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb394e8b0 0x560cb396ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a5221640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb394e8b0 0x560cb396ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50618/0 (socket says 10.20.193.4:50618) 2026-02-24T09:09:53.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.932+0000 7fa2a5221640 1 -- 10.20.193.4:0/4076883640 learned_addr learned my addr 10.20.193.4:0/4076883640 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:53.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa297fff640 1 --2- 10.20.193.4:0/4076883640 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909c10 0x560cb394e370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/4076883640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909300 0x560cb39096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a5221640 1 -- 10.20.193.4:0/4076883640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909300 msgr2=0x560cb39096d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:53.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a5221640 1 --2- 10.20.193.4:0/4076883640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909300 0x560cb39096d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a5221640 1 -- 10.20.193.4:0/4076883640 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909c10 msgr2=0x560cb394e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:53.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a5221640 1 --2- 10.20.193.4:0/4076883640 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909c10 0x560cb394e370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a5221640 1 -- 10.20.193.4:0/4076883640 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb37ba6e0 con 0x560cb394e8b0 2026-02-24T09:09:53.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a5221640 1 --2- 10.20.193.4:0/4076883640 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb394e8b0 0x560cb396ec90 secure :-1 s=READY pgs=438 gs=2 cs=0 l=1 c_cookie=18004363359118136101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa29c0e55d0 tx=0x7fa29c0aa4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dc59157b4b9325 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa26d4e4640 1 -- 10.20.193.4:0/4076883640 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa29c0ad5a0 con 0x560cb394e8b0 2026-02-24T09:09:53.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa26d4e4640 1 -- 10.20.193.4:0/4076883640 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa29c0ae7a0 con 0x560cb394e8b0 2026-02-24T09:09:53.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa26d4e4640 1 -- 10.20.193.4:0/4076883640 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa29c0ad940 con 0x560cb394e8b0 2026-02-24T09:09:53.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/4076883640 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb394e8b0 msgr2=0x560cb396ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/4076883640 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb394e8b0 0x560cb396ec90 secure :-1 s=READY pgs=438 gs=2 cs=0 l=1 c_cookie=18004363359118136101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa29c0e55d0 tx=0x7fa29c0aa4c0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/4076883640 shutdown_connections 2026-02-24T09:09:53.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/4076883640 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb394e8b0 0x560cb396ec90 unknown :-1 s=CLOSED pgs=438 gs=2 cs=0 l=1 c_cookie=18004363359118136101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/4076883640 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909c10 0x560cb394e370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/4076883640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909300 0x560cb39096d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/4076883640 >> 10.20.193.4:0/4076883640 conn(0x560cb38274f0 msgr2=0x560cb3907be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/4076883640 shutdown_connections 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.933+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/4076883640 wait complete. 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa2a8ca5e00 1 -- start start 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa2a8ca5e00 1 Processor -- start 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909300 0x560cb39212b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909c10 0x560cb39217f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 0x560cb39267e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560cb3926d20 con 0x560cb3909c10 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560cb3926e90 con 0x560cb3909300 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560cb3927050 con 0x560cb394e8b0 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa297fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909c10 0x560cb39217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa297fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909c10 0x560cb39217f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50620/0 (socket says 10.20.193.4:50620) 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa297fff640 1 -- 10.20.193.4:0/2762943852 learned_addr learned my addr 10.20.193.4:0/2762943852 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909300 0x560cb39212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa2a5221640 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 0x560cb39267e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa297fff640 1 -- 10.20.193.4:0/2762943852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 msgr2=0x560cb39267e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa297fff640 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 0x560cb39267e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa297fff640 1 -- 10.20.193.4:0/2762943852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909300 msgr2=0x560cb39212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:53.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa297fff640 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909300 0x560cb39212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.934+0000 7fa297fff640 1 -- 10.20.193.4:0/2762943852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb3792cd0 con 0x560cb3909c10 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa297fff640 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909c10 0x560cb39217f0 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=1873121400543918104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2880106d0 tx=0x7fa288010ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fea9fd549a3818 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa25e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa25e7fc640 1 -- 10.20.193.4:0/2762943852 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa28800e8d0 con 0x560cb3909c10 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/2762943852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a01647e0 con 0x560cb3909c10 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa25e7fc640 1 -- 10.20.193.4:0/2762943852 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa288015070 con 0x560cb3909c10 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa25e7fc640 1 -- 10.20.193.4:0/2762943852 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa288005280 con 0x560cb3909c10 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 10 client.15528 _ll_register_callbacks cb 0x560cb378b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/2762943852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cb349c9d0 con 0x560cb3909c10 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa25e7fc640 1 -- 10.20.193.4:0/2762943852 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fa288005410 con 0x560cb3909c10 2026-02-24T09:09:53.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa25e7fc640 1 -- 10.20.193.4:0/2762943852 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa288005610 con 0x560cb3909c10 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 10 client.15528 fetch_fsmap learned FSMap version 19 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/2762943852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x560cb37a4ab0 con 0x560cb3909c10 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa25e7fc640 1 -- 10.20.193.4:0/2762943852 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa288011440 con 0x560cb3909c10 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 10 client.15528 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 20 client.15528 populate_metadata read hostname 'trial004' 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560cb394bc00 0x560cb394c0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 4 client.15528 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/2762943852 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cb381fb70 con 0x560cb394bc00 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.935+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560cb394bc00 0x560cb394c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa25e7fc640 10 client.15528 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560cb394bc00 0x560cb394c0a0 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=4496852157609524369 s_cookie=3070170284021220468 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e68073645c3bc91 server_cookie=2a9b6f9b5b0b8474 in_seq=0 out_seq=0 2026-02-24T09:09:53.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa25e7fc640 1 -- 10.20.193.4:0/2762943852 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560cb381fb70 con 0x560cb394bc00 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa25e7fc640 10 client.15528 handle_command_reply: tid=0 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 client.15528 shutdown 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/2762943852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909c10 msgr2=0x560cb39217f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909c10 0x560cb39217f0 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=1873121400543918104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2880106d0 tx=0x7fa288010ba0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/2762943852 shutdown_connections 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560cb394bc00 0x560cb394c0a0 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=4496852157609524369 s_cookie=3070170284021220468 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 0x560cb39267e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909c10 0x560cb39217f0 unknown :-1 s=CLOSED pgs=439 gs=1 cs=0 l=1 c_cookie=1873121400543918104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa25e7fc640 0 client.15528 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/2762943852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909300 0x560cb39212b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/2762943852 >> 10.20.193.4:0/2762943852 conn(0x560cb38274f0 msgr2=0x560cb39082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/2762943852 shutdown_connections 2026-02-24T09:09:53.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/2762943852 wait complete. 2026-02-24T09:09:53.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.936+0000 7fa2a8ca5e00 20 client.15528 trim_cache size 0 max 16384 2026-02-24T09:09:53.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a8ca5e00 1 Processor -- start 2026-02-24T09:09:53.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a8ca5e00 1 -- start start 2026-02-24T09:09:53.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb394d990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909c10 0x560cb394ded0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 0x560cb3946a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560cb380cfe0 con 0x560cb3909300 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560cb34d7fe0 con 0x560cb3909c10 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560cb39268f0 con 0x560cb394e8b0 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a4a20640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb394d990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a4a20640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb394d990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50626/0 (socket says 10.20.193.4:50626) 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.945+0000 7fa2a4a20640 1 -- 10.20.193.4:0/4168680191 learned_addr learned my addr 10.20.193.4:0/4168680191 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a5221640 1 --2- 10.20.193.4:0/4168680191 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 0x560cb3946a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa297fff640 1 --2- 10.20.193.4:0/4168680191 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909c10 0x560cb394ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a4a20640 1 -- 10.20.193.4:0/4168680191 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 msgr2=0x560cb3946a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/4168680191 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 0x560cb3946a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a4a20640 1 -- 10.20.193.4:0/4168680191 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909c10 msgr2=0x560cb394ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:53.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/4168680191 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909c10 0x560cb394ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a4a20640 1 -- 10.20.193.4:0/4168680191 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb379f530 con 0x560cb3909300 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a5221640 1 --2- 10.20.193.4:0/4168680191 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 0x560cb3946a10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/4168680191 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb394d990 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=7089228179689172441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa29002f6e0 tx=0x7fa29003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6261ff78160fedd9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa26cce3640 1 -- 10.20.193.4:0/4168680191 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa290002940 con 0x560cb3909300 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa26cce3640 1 -- 10.20.193.4:0/4168680191 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa2900561b0 con 0x560cb3909300 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa26cce3640 1 -- 10.20.193.4:0/4168680191 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa290056890 con 0x560cb3909300 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/4168680191 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 msgr2=0x560cb394d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/4168680191 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb394d990 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=7089228179689172441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa29002f6e0 tx=0x7fa29003b000 comp rx=0 tx=0).stop 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/4168680191 shutdown_connections 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/4168680191 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb394e8b0 0x560cb3946a10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/4168680191 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb3909c10 0x560cb394ded0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/4168680191 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb394d990 unknown :-1 s=CLOSED pgs=440 gs=1 cs=0 l=1 c_cookie=7089228179689172441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/4168680191 >> 10.20.193.4:0/4168680191 conn(0x560cb38274f0 msgr2=0x560cb391d870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/4168680191 shutdown_connections 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.946+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/4168680191 wait complete. 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a8ca5e00 1 -- start start 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a8ca5e00 1 Processor -- start 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb392ce80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909c10 0x560cb392d3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a8ca5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb394e8b0 0x560cb39275f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560cb3927cf0 con 0x560cb3909300 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560cb3927e60 con 0x560cb394e8b0 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a8ca5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560cb3928020 con 0x560cb3909c10 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a4a20640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb392ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a4a20640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb392ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50630/0 (socket says 10.20.193.4:50630) 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a4a20640 1 -- 10.20.193.4:0/1104940092 learned_addr learned my addr 10.20.193.4:0/1104940092 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:53.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a5221640 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb394e8b0 0x560cb39275f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa297fff640 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909c10 0x560cb392d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a4a20640 1 -- 10.20.193.4:0/1104940092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909c10 msgr2=0x560cb392d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909c10 0x560cb392d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a4a20640 1 -- 10.20.193.4:0/1104940092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb394e8b0 msgr2=0x560cb39275f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb394e8b0 0x560cb39275f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a4a20640 1 -- 10.20.193.4:0/1104940092 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb3793000 con 0x560cb3909300 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa297fff640 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909c10 0x560cb392d3c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a5221640 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb394e8b0 0x560cb39275f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a4a20640 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb392ce80 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=14449690902214953624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa290005b30 tx=0x7fa2900389b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8879d515cb74a98 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa25e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa25e7fc640 1 -- 10.20.193.4:0/1104940092 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa290056830 con 0x560cb3909300 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa25e7fc640 1 -- 10.20.193.4:0/1104940092 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa290038da0 con 0x560cb3909300 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa25e7fc640 1 -- 10.20.193.4:0/1104940092 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2900546b0 con 0x560cb3909300 2026-02-24T09:09:53.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/1104940092 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29004c040 con 0x560cb3909300 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa25e7fc640 1 -- 10.20.193.4:0/1104940092 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fa290054840 con 0x560cb3909300 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.947+0000 7fa25e7fc640 10 client.15534 inactive, discarding osd_map(75..75 src has 1..75) 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa2a8ca5e00 10 client.15534 _ll_register_callbacks cb 0x560cb39480d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/1104940092 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cb38217e0 con 0x560cb3909300 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa25e7fc640 1 -- 10.20.193.4:0/1104940092 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa29002fe40 con 0x560cb3909300 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa2a8ca5e00 10 client.15534 fetch_fsmap learned FSMap version 19 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/1104940092 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x560cb37a4d10 con 0x560cb3909300 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa25e7fc640 1 -- 10.20.193.4:0/1104940092 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa29002f9f0 con 0x560cb3909300 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa2a8ca5e00 10 client.15534 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa2a8ca5e00 10 client.15534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa2a8ca5e00 20 client.15534 populate_metadata read hostname 'trial004' 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560cb39fc780 0x560cb3a1cc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa2a8ca5e00 4 client.15534 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:09:53.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/1104940092 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560cb349a220 con 0x560cb39fc780 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa297fff640 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560cb39fc780 0x560cb3a1cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa25e7fc640 10 client.15534 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.948+0000 7fa297fff640 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560cb39fc780 0x560cb3a1cc00 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=18107580979812480679 s_cookie=16559728244301614012 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb4b0cf68b57b6a7 server_cookie=e5cff919da99cbbc in_seq=0 out_seq=0 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa25e7fc640 1 -- 10.20.193.4:0/1104940092 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560cb349a220 con 0x560cb39fc780 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa25e7fc640 10 client.15534 handle_command_reply: tid=0 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 client.15534 shutdown 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/1104940092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 msgr2=0x560cb392ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb392ce80 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=14449690902214953624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa290005b30 tx=0x7fa2900389b0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/1104940092 shutdown_connections 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560cb39fc780 0x560cb3a1cc00 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=18107580979812480679 s_cookie=16559728244301614012 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560cb394e8b0 0x560cb39275f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa25e7fc640 0 client.15534 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560cb3909c10 0x560cb392d3c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 --2- 10.20.193.4:0/1104940092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560cb3909300 0x560cb392ce80 unknown :-1 s=CLOSED pgs=441 gs=1 cs=0 l=1 c_cookie=14449690902214953624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/1104940092 >> 10.20.193.4:0/1104940092 conn(0x560cb38274f0 msgr2=0x560cb391e060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/1104940092 shutdown_connections 2026-02-24T09:09:53.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 1 -- 10.20.193.4:0/1104940092 wait complete. 2026-02-24T09:09:53.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.949+0000 7fa2a8ca5e00 20 client.15534 trim_cache size 0 max 16384 2026-02-24T09:09:53.968 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:53.968 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:09:53.968 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "04559c85-9dcc-42e4-b7df-73a410372b47", 2026-02-24T09:09:53.968 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:09:53.968 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:53.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 -- 10.20.193.4:0/494145818 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa27c0b5770 msgr2=0x7fa27c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa27c0b5770 0x7fa27c0d5c20 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2900023d0 tx=0x7fa290031040 comp rx=0 tx=0).stop 2026-02-24T09:09:53.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 -- 10.20.193.4:0/494145818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2a0115470 msgr2=0x7fa2a01234b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:53.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2a0115470 0x7fa2a01234b0 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa29c006e90 tx=0x7fa29c00edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 -- 10.20.193.4:0/494145818 shutdown_connections 2026-02-24T09:09:53.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa27c0b5770 0x7fa27c0d5c20 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2a0115470 0x7fa2a01234b0 unknown :-1 s=CLOSED pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2a010fc70 0x7fa2a011e130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 --2- 10.20.193.4:0/494145818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2a010f280 0x7fa2a011dbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:53.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 -- 10.20.193.4:0/494145818 >> 10.20.193.4:0/494145818 conn(0x7fa2a005f830 msgr2=0x7fa2a010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:53.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 -- 10.20.193.4:0/494145818 shutdown_connections 2026-02-24T09:09:53.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:53.950+0000 7fa2a6cab640 1 -- 10.20.193.4:0/494145818 wait complete. 2026-02-24T09:09:53.991 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:09:54.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.036+0000 7f101132a640 1 -- 10.20.193.4:0/1396295199 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f100c11ed10 con 0x7f0fe00b5770 2026-02-24T09:09:54.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.039+0000 7f0febfff640 1 -- 10.20.193.4:0/1396295199 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7f100c11ed10 con 0x7f0fe00b5770 2026-02-24T09:09:54.045 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:54.046 INFO:teuthology.orchestra.run.trial004.stderr:dumped all 2026-02-24T09:09:54.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 -- 10.20.193.4:0/1396295199 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0fe00b5770 msgr2=0x7f0fe00d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0fe00b5770 0x7f0fe00d5c20 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10000023d0 tx=0x7f1000031040 comp rx=0 tx=0).stop 2026-02-24T09:09:54.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 -- 10.20.193.4:0/1396295199 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f100c115470 msgr2=0x7f100c1234c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f100c115470 0x7f100c1234c0 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ffc006e90 tx=0x7f0ffc00edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 -- 10.20.193.4:0/1396295199 shutdown_connections 2026-02-24T09:09:54.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0fe00b5770 0x7f0fe00d5c20 unknown :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f100c115470 0x7f100c1234c0 unknown :-1 s=CLOSED pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f100c10fc70 0x7f100c11e0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 --2- 10.20.193.4:0/1396295199 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f100c10f280 0x7f100c11dbb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 -- 10.20.193.4:0/1396295199 >> 10.20.193.4:0/1396295199 conn(0x7f100c05f830 msgr2=0x7f100c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 -- 10.20.193.4:0/1396295199 shutdown_connections 2026-02-24T09:09:54.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.041+0000 7f101132a640 1 -- 10.20.193.4:0/1396295199 wait complete. 2026-02-24T09:09:54.083 INFO:teuthology.orchestra.run.trial004.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2026-02-24T09:09:53.668973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663461,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":263,"num_read_kb":247,"num_write":349,"num_write_kb":3841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":291,"ondisk_log_size":291,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333672,"kb_used_data":10104,"kb_used_omap":377,"kb_used_meta":322950,"kb_avail":8807704728,"statfs":{"total":9019431321600,"available":9019089641472,"internally_reserved":0,"allocated":10346496,"data_stored":6724779,"data_compressed":113181,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":386873,"internal_metadata":330700999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16565,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":58,"num_write":8,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002312"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332664+0000","last_change":"2026-02-24T09:09:25.267627+0000","last_active":"2026-02-24T09:09:26.332664+0000","last_peered":"2026-02-24T09:09:26.332664+0000","last_clean":"2026-02-24T09:09:26.332664+0000","last_became_active":"2026-02-24T09:09:25.267439+0000","last_became_peered":"2026-02-24T09:09:25.267439+0000","last_unstale":"2026-02-24T09:09:26.332664+0000","last_undegraded":"2026-02-24T09:09:26.332664+0000","last_fullsized":"2026-02-24T09:09:26.332664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:24.034680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267727+0000","last_change":"2026-02-24T09:09:25.267299+0000","last_active":"2026-02-24T09:09:26.267727+0000","last_peered":"2026-02-24T09:09:26.267727+0000","last_clean":"2026-02-24T09:09:26.267727+0000","last_became_active":"2026-02-24T09:09:25.266956+0000","last_became_peered":"2026-02-24T09:09:25.266956+0000","last_unstale":"2026-02-24T09:09:26.267727+0000","last_undegraded":"2026-02-24T09:09:26.267727+0000","last_fullsized":"2026-02-24T09:09:26.267727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:05.466777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267738+0000","last_change":"2026-02-24T09:09:25.268761+0000","last_active":"2026-02-24T09:09:26.267738+0000","last_peered":"2026-02-24T09:09:26.267738+0000","last_clean":"2026-02-24T09:09:26.267738+0000","last_became_active":"2026-02-24T09:09:25.268476+0000","last_became_peered":"2026-02-24T09:09:25.268476+0000","last_unstale":"2026-02-24T09:09:26.267738+0000","last_undegraded":"2026-02-24T09:09:26.267738+0000","last_fullsized":"2026-02-24T09:09:26.267738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:26:00.680116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335046+0000","last_change":"2026-02-24T09:09:25.271303+0000","last_active":"2026-02-24T09:09:26.335046+0000","last_peered":"2026-02-24T09:09:26.335046+0000","last_clean":"2026-02-24T09:09:26.335046+0000","last_became_active":"2026-02-24T09:09:25.271175+0000","last_became_peered":"2026-02-24T09:09:25.271175+0000","last_unstale":"2026-02-24T09:09:26.335046+0000","last_undegraded":"2026-02-24T09:09:26.335046+0000","last_fullsized":"2026-02-24T09:09:26.335046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:55:25.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267634+0000","last_change":"2026-02-24T09:09:25.267923+0000","last_active":"2026-02-24T09:09:26.267634+0000","last_peered":"2026-02-24T09:09:26.267634+0000","last_clean":"2026-02-24T09:09:26.267634+0000","last_became_active":"2026-02-24T09:09:25.267775+0000","last_became_peered":"2026-02-24T09:09:25.267775+0000","last_unstale":"2026-02-24T09:09:26.267634+0000","last_undegraded":"2026-02-24T09:09:26.267634+0000","last_fullsized":"2026-02-24T09:09:26.267634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:54:25.575849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270023+0000","last_change":"2026-02-24T09:09:25.269603+0000","last_active":"2026-02-24T09:09:26.270023+0000","last_peered":"2026-02-24T09:09:26.270023+0000","last_clean":"2026-02-24T09:09:26.270023+0000","last_became_active":"2026-02-24T09:09:25.269057+0000","last_became_peered":"2026-02-24T09:09:25.269057+0000","last_unstale":"2026-02-24T09:09:26.270023+0000","last_undegraded":"2026-02-24T09:09:26.270023+0000","last_fullsized":"2026-02-24T09:09:26.270023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:39:21.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733238+0000","last_change":"2026-02-24T09:09:25.270852+0000","last_active":"2026-02-24T09:09:26.733238+0000","last_peered":"2026-02-24T09:09:26.733238+0000","last_clean":"2026-02-24T09:09:26.733238+0000","last_became_active":"2026-02-24T09:09:25.270607+0000","last_became_peered":"2026-02-24T09:09:25.270607+0000","last_unstale":"2026-02-24T09:09:26.733238+0000","last_undegraded":"2026-02-24T09:09:26.733238+0000","last_fullsized":"2026-02-24T09:09:26.733238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:45:43.574810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268619+0000","last_change":"2026-02-24T09:09:25.268833+0000","last_active":"2026-02-24T09:09:26.268619+0000","last_peered":"2026-02-24T09:09:26.268619+0000","last_clean":"2026-02-24T09:09:26.268619+0000","last_became_active":"2026-02-24T09:09:25.268462+0000","last_became_peered":"2026-02-24T09:09:25.268462+0000","last_unstale":"2026-02-24T09:09:26.268619+0000","last_undegraded":"2026-02-24T09:09:26.268619+0000","last_fullsized":"2026-02-24T09:09:26.268619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:47.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334895+0000","last_change":"2026-02-24T09:09:25.271419+0000","last_active":"2026-02-24T09:09:26.334895+0000","last_peered":"2026-02-24T09:09:26.334895+0000","last_clean":"2026-02-24T09:09:26.334895+0000","last_became_active":"2026-02-24T09:09:25.270954+0000","last_became_peered":"2026-02-24T09:09:25.270954+0000","last_unstale":"2026-02-24T09:09:26.334895+0000","last_undegraded":"2026-02-24T09:09:26.334895+0000","last_fullsized":"2026-02-24T09:09:26.334895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:07:15.889565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270286+0000","last_change":"2026-02-24T09:09:25.269709+0000","last_active":"2026-02-24T09:09:26.270286+0000","last_peered":"2026-02-24T09:09:26.270286+0000","last_clean":"2026-02-24T09:09:26.270286+0000","last_became_active":"2026-02-24T09:09:25.269136+0000","last_became_peered":"2026-02-24T09:09:25.269136+0000","last_unstale":"2026-02-24T09:09:26.270286+0000","last_undegraded":"2026-02-24T09:09:26.270286+0000","last_fullsized":"2026-02-24T09:09:26.270286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:42:02.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733508+0000","last_change":"2026-02-24T09:09:25.272025+0000","last_active":"2026-02-24T09:09:26.733508+0000","last_peered":"2026-02-24T09:09:26.733508+0000","last_clean":"2026-02-24T09:09:26.733508+0000","last_became_active":"2026-02-24T09:09:25.271851+0000","last_became_peered":"2026-02-24T09:09:25.271851+0000","last_unstale":"2026-02-24T09:09:26.733508+0000","last_undegraded":"2026-02-24T09:09:26.733508+0000","last_fullsized":"2026-02-24T09:09:26.733508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:49:57.365130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335160+0000","last_change":"2026-02-24T09:09:25.271156+0000","last_active":"2026-02-24T09:09:26.335160+0000","last_peered":"2026-02-24T09:09:26.335160+0000","last_clean":"2026-02-24T09:09:26.335160+0000","last_became_active":"2026-02-24T09:09:25.270992+0000","last_became_peered":"2026-02-24T09:09:25.270992+0000","last_unstale":"2026-02-24T09:09:26.335160+0000","last_undegraded":"2026-02-24T09:09:26.335160+0000","last_fullsized":"2026-02-24T09:09:26.335160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:56.324038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332309+0000","last_change":"2026-02-24T09:09:25.266871+0000","last_active":"2026-02-24T09:09:26.332309+0000","last_peered":"2026-02-24T09:09:26.332309+0000","last_clean":"2026-02-24T09:09:26.332309+0000","last_became_active":"2026-02-24T09:09:25.266438+0000","last_became_peered":"2026-02-24T09:09:25.266438+0000","last_unstale":"2026-02-24T09:09:26.332309+0000","last_undegraded":"2026-02-24T09:09:26.332309+0000","last_fullsized":"2026-02-24T09:09:26.332309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:24:17.014313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267591+0000","last_change":"2026-02-24T09:09:25.266851+0000","last_active":"2026-02-24T09:09:26.267591+0000","last_peered":"2026-02-24T09:09:26.267591+0000","last_clean":"2026-02-24T09:09:26.267591+0000","last_became_active":"2026-02-24T09:09:25.266530+0000","last_became_peered":"2026-02-24T09:09:25.266530+0000","last_unstale":"2026-02-24T09:09:26.267591+0000","last_undegraded":"2026-02-24T09:09:26.267591+0000","last_fullsized":"2026-02-24T09:09:26.267591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:53.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267465+0000","last_change":"2026-02-24T09:09:25.269561+0000","last_active":"2026-02-24T09:09:26.267465+0000","last_peered":"2026-02-24T09:09:26.267465+0000","last_clean":"2026-02-24T09:09:26.267465+0000","last_became_active":"2026-02-24T09:09:25.268979+0000","last_became_peered":"2026-02-24T09:09:25.268979+0000","last_unstale":"2026-02-24T09:09:26.267465+0000","last_undegraded":"2026-02-24T09:09:26.267465+0000","last_fullsized":"2026-02-24T09:09:26.267465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:16:56.110766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334540+0000","last_change":"2026-02-24T09:09:25.271426+0000","last_active":"2026-02-24T09:09:26.334540+0000","last_peered":"2026-02-24T09:09:26.334540+0000","last_clean":"2026-02-24T09:09:26.334540+0000","last_became_active":"2026-02-24T09:09:25.270917+0000","last_became_peered":"2026-02-24T09:09:25.270917+0000","last_unstale":"2026-02-24T09:09:26.334540+0000","last_undegraded":"2026-02-24T09:09:26.334540+0000","last_fullsized":"2026-02-24T09:09:26.334540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:58:52.125871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332673+0000","last_change":"2026-02-24T09:09:25.267238+0000","last_active":"2026-02-24T09:09:26.332673+0000","last_peered":"2026-02-24T09:09:26.332673+0000","last_clean":"2026-02-24T09:09:26.332673+0000","last_became_active":"2026-02-24T09:09:25.267060+0000","last_became_peered":"2026-02-24T09:09:25.267060+0000","last_unstale":"2026-02-24T09:09:26.332673+0000","last_undegraded":"2026-02-24T09:09:26.332673+0000","last_fullsized":"2026-02-24T09:09:26.332673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:00:58.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267495+0000","last_change":"2026-02-24T09:09:25.266005+0000","last_active":"2026-02-24T09:09:26.267495+0000","last_peered":"2026-02-24T09:09:26.267495+0000","last_clean":"2026-02-24T09:09:26.267495+0000","last_became_active":"2026-02-24T09:09:25.265847+0000","last_became_peered":"2026-02-24T09:09:25.265847+0000","last_unstale":"2026-02-24T09:09:26.267495+0000","last_undegraded":"2026-02-24T09:09:26.267495+0000","last_fullsized":"2026-02-24T09:09:26.267495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:29:02.137351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332638+0000","last_change":"2026-02-24T09:09:25.268822+0000","last_active":"2026-02-24T09:09:26.332638+0000","last_peered":"2026-02-24T09:09:26.332638+0000","last_clean":"2026-02-24T09:09:26.332638+0000","last_became_active":"2026-02-24T09:09:25.268683+0000","last_became_peered":"2026-02-24T09:09:25.268683+0000","last_unstale":"2026-02-24T09:09:26.332638+0000","last_undegraded":"2026-02-24T09:09:26.332638+0000","last_fullsized":"2026-02-24T09:09:26.332638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:23:58.256403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332429+0000","last_change":"2026-02-24T09:09:25.266214+0000","last_active":"2026-02-24T09:09:26.332429+0000","last_peered":"2026-02-24T09:09:26.332429+0000","last_clean":"2026-02-24T09:09:26.332429+0000","last_became_active":"2026-02-24T09:09:25.266019+0000","last_became_peered":"2026-02-24T09:09:25.266019+0000","last_unstale":"2026-02-24T09:09:26.332429+0000","last_undegraded":"2026-02-24T09:09:26.332429+0000","last_fullsized":"2026-02-24T09:09:26.332429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:17.141581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332384+0000","last_change":"2026-02-24T09:09:25.267493+0000","last_active":"2026-02-24T09:09:26.332384+0000","last_peered":"2026-02-24T09:09:26.332384+0000","last_clean":"2026-02-24T09:09:26.332384+0000","last_became_active":"2026-02-24T09:09:25.267314+0000","last_became_peered":"2026-02-24T09:09:25.267314+0000","last_unstale":"2026-02-24T09:09:26.332384+0000","last_undegraded":"2026-02-24T09:09:26.332384+0000","last_fullsized":"2026-02-24T09:09:26.332384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:59:11.536214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334717+0000","last_change":"2026-02-24T09:09:25.272131+0000","last_active":"2026-02-24T09:09:26.334717+0000","last_peered":"2026-02-24T09:09:26.334717+0000","last_clean":"2026-02-24T09:09:26.334717+0000","last_became_active":"2026-02-24T09:09:25.271680+0000","last_became_peered":"2026-02-24T09:09:25.271680+0000","last_unstale":"2026-02-24T09:09:26.334717+0000","last_undegraded":"2026-02-24T09:09:26.334717+0000","last_fullsized":"2026-02-24T09:09:26.334717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:07:33.257865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268617+0000","last_change":"2026-02-24T09:09:25.267808+0000","last_active":"2026-02-24T09:09:26.268617+0000","last_peered":"2026-02-24T09:09:26.268617+0000","last_clean":"2026-02-24T09:09:26.268617+0000","last_became_active":"2026-02-24T09:09:25.266759+0000","last_became_peered":"2026-02-24T09:09:25.266759+0000","last_unstale":"2026-02-24T09:09:26.268617+0000","last_undegraded":"2026-02-24T09:09:26.268617+0000","last_fullsized":"2026-02-24T09:09:26.268617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:55.312047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268133+0000","last_change":"2026-02-24T09:09:25.268500+0000","last_active":"2026-02-24T09:09:26.268133+0000","last_peered":"2026-02-24T09:09:26.268133+0000","last_clean":"2026-02-24T09:09:26.268133+0000","last_became_active":"2026-02-24T09:09:25.267904+0000","last_became_peered":"2026-02-24T09:09:25.267904+0000","last_unstale":"2026-02-24T09:09:26.268133+0000","last_undegraded":"2026-02-24T09:09:26.268133+0000","last_fullsized":"2026-02-24T09:09:26.268133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:38:47.330593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269021+0000","last_change":"2026-02-24T09:09:25.269694+0000","last_active":"2026-02-24T09:09:26.269021+0000","last_peered":"2026-02-24T09:09:26.269021+0000","last_clean":"2026-02-24T09:09:26.269021+0000","last_became_active":"2026-02-24T09:09:25.269068+0000","last_became_peered":"2026-02-24T09:09:25.269068+0000","last_unstale":"2026-02-24T09:09:26.269021+0000","last_undegraded":"2026-02-24T09:09:26.269021+0000","last_fullsized":"2026-02-24T09:09:26.269021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:04:44.772275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332668+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.332668+0000","last_peered":"2026-02-24T09:09:26.332668+0000","last_clean":"2026-02-24T09:09:26.332668+0000","last_became_active":"2026-02-24T09:09:25.269534+0000","last_became_peered":"2026-02-24T09:09:25.269534+0000","last_unstale":"2026-02-24T09:09:26.332668+0000","last_undegraded":"2026-02-24T09:09:26.332668+0000","last_fullsized":"2026-02-24T09:09:26.332668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:45:51.428970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332478+0000","last_change":"2026-02-24T09:09:25.266779+0000","last_active":"2026-02-24T09:09:26.332478+0000","last_peered":"2026-02-24T09:09:26.332478+0000","last_clean":"2026-02-24T09:09:26.332478+0000","last_became_active":"2026-02-24T09:09:25.266603+0000","last_became_peered":"2026-02-24T09:09:25.266603+0000","last_unstale":"2026-02-24T09:09:26.332478+0000","last_undegraded":"2026-02-24T09:09:26.332478+0000","last_fullsized":"2026-02-24T09:09:26.332478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:01:38.198458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332295+0000","last_change":"2026-02-24T09:09:25.266933+0000","last_active":"2026-02-24T09:09:26.332295+0000","last_peered":"2026-02-24T09:09:26.332295+0000","last_clean":"2026-02-24T09:09:26.332295+0000","last_became_active":"2026-02-24T09:09:25.266381+0000","last_became_peered":"2026-02-24T09:09:25.266381+0000","last_unstale":"2026-02-24T09:09:26.332295+0000","last_undegraded":"2026-02-24T09:09:26.332295+0000","last_fullsized":"2026-02-24T09:09:26.332295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:45:44.657482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267754+0000","last_change":"2026-02-24T09:09:25.269576+0000","last_active":"2026-02-24T09:09:26.267754+0000","last_peered":"2026-02-24T09:09:26.267754+0000","last_clean":"2026-02-24T09:09:26.267754+0000","last_became_active":"2026-02-24T09:09:25.269159+0000","last_became_peered":"2026-02-24T09:09:25.269159+0000","last_unstale":"2026-02-24T09:09:26.267754+0000","last_undegraded":"2026-02-24T09:09:26.267754+0000","last_fullsized":"2026-02-24T09:09:26.267754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:23:37.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332345+0000","last_change":"2026-02-24T09:09:25.269282+0000","last_active":"2026-02-24T09:09:26.332345+0000","last_peered":"2026-02-24T09:09:26.332345+0000","last_clean":"2026-02-24T09:09:26.332345+0000","last_became_active":"2026-02-24T09:09:25.269088+0000","last_became_peered":"2026-02-24T09:09:25.269088+0000","last_unstale":"2026-02-24T09:09:26.332345+0000","last_undegraded":"2026-02-24T09:09:26.332345+0000","last_fullsized":"2026-02-24T09:09:26.332345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:49.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332404+0000","last_change":"2026-02-24T09:09:25.270968+0000","last_active":"2026-02-24T09:09:26.332404+0000","last_peered":"2026-02-24T09:09:26.332404+0000","last_clean":"2026-02-24T09:09:26.332404+0000","last_became_active":"2026-02-24T09:09:25.270816+0000","last_became_peered":"2026-02-24T09:09:25.270816+0000","last_unstale":"2026-02-24T09:09:26.332404+0000","last_undegraded":"2026-02-24T09:09:26.332404+0000","last_fullsized":"2026-02-24T09:09:26.332404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:10:08.592263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332360+0000","last_change":"2026-02-24T09:09:25.267715+0000","last_active":"2026-02-24T09:09:26.332360+0000","last_peered":"2026-02-24T09:09:26.332360+0000","last_clean":"2026-02-24T09:09:26.332360+0000","last_became_active":"2026-02-24T09:09:25.267031+0000","last_became_peered":"2026-02-24T09:09:25.267031+0000","last_unstale":"2026-02-24T09:09:26.332360+0000","last_undegraded":"2026-02-24T09:09:26.332360+0000","last_fullsized":"2026-02-24T09:09:26.332360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:14:50.568512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267758+0000","last_change":"2026-02-24T09:09:25.268347+0000","last_active":"2026-02-24T09:09:26.267758+0000","last_peered":"2026-02-24T09:09:26.267758+0000","last_clean":"2026-02-24T09:09:26.267758+0000","last_became_active":"2026-02-24T09:09:25.268235+0000","last_became_peered":"2026-02-24T09:09:25.268235+0000","last_unstale":"2026-02-24T09:09:26.267758+0000","last_undegraded":"2026-02-24T09:09:26.267758+0000","last_fullsized":"2026-02-24T09:09:26.267758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:17.309082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:50.958117+0000","last_change":"2026-02-24T09:09:24.256941+0000","last_active":"2026-02-24T09:09:50.958117+0000","last_peered":"2026-02-24T09:09:50.958117+0000","last_clean":"2026-02-24T09:09:50.958117+0000","last_became_active":"2026-02-24T09:09:24.256577+0000","last_became_peered":"2026-02-24T09:09:24.256577+0000","last_unstale":"2026-02-24T09:09:50.958117+0000","last_undegraded":"2026-02-24T09:09:50.958117+0000","last_fullsized":"2026-02-24T09:09:50.958117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:13:19.756549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268000+0000","last_change":"2026-02-24T09:09:25.270452+0000","last_active":"2026-02-24T09:09:26.268000+0000","last_peered":"2026-02-24T09:09:26.268000+0000","last_clean":"2026-02-24T09:09:26.268000+0000","last_became_active":"2026-02-24T09:09:25.270184+0000","last_became_peered":"2026-02-24T09:09:25.270184+0000","last_unstale":"2026-02-24T09:09:26.268000+0000","last_undegraded":"2026-02-24T09:09:26.268000+0000","last_fullsized":"2026-02-24T09:09:26.268000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:07:41.652941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943662+0000","last_change":"2026-02-24T09:09:24.261249+0000","last_active":"2026-02-24T09:09:28.943662+0000","last_peered":"2026-02-24T09:09:28.943662+0000","last_clean":"2026-02-24T09:09:28.943662+0000","last_became_active":"2026-02-24T09:09:24.261064+0000","last_became_peered":"2026-02-24T09:09:24.261064+0000","last_unstale":"2026-02-24T09:09:28.943662+0000","last_undegraded":"2026-02-24T09:09:28.943662+0000","last_fullsized":"2026-02-24T09:09:28.943662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:59:42.964350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941445+0000","last_change":"2026-02-24T09:09:24.254918+0000","last_active":"2026-02-24T09:09:28.941445+0000","last_peered":"2026-02-24T09:09:28.941445+0000","last_clean":"2026-02-24T09:09:28.941445+0000","last_became_active":"2026-02-24T09:09:24.254590+0000","last_became_peered":"2026-02-24T09:09:24.254590+0000","last_unstale":"2026-02-24T09:09:28.941445+0000","last_undegraded":"2026-02-24T09:09:28.941445+0000","last_fullsized":"2026-02-24T09:09:28.941445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:03:19.504844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268666+0000","last_change":"2026-02-24T09:09:25.267204+0000","last_active":"2026-02-24T09:09:26.268666+0000","last_peered":"2026-02-24T09:09:26.268666+0000","last_clean":"2026-02-24T09:09:26.268666+0000","last_became_active":"2026-02-24T09:09:25.266489+0000","last_became_peered":"2026-02-24T09:09:25.266489+0000","last_unstale":"2026-02-24T09:09:26.268666+0000","last_undegraded":"2026-02-24T09:09:26.268666+0000","last_fullsized":"2026-02-24T09:09:26.268666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:26:34.500054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210732+0000","last_change":"2026-02-24T09:09:24.258042+0000","last_active":"2026-02-24T09:09:27.210732+0000","last_peered":"2026-02-24T09:09:27.210732+0000","last_clean":"2026-02-24T09:09:27.210732+0000","last_became_active":"2026-02-24T09:09:24.257801+0000","last_became_peered":"2026-02-24T09:09:24.257801+0000","last_unstale":"2026-02-24T09:09:27.210732+0000","last_undegraded":"2026-02-24T09:09:27.210732+0000","last_fullsized":"2026-02-24T09:09:27.210732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:27.596990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267334+0000","last_change":"2026-02-24T09:09:25.267636+0000","last_active":"2026-02-24T09:09:26.267334+0000","last_peered":"2026-02-24T09:09:26.267334+0000","last_clean":"2026-02-24T09:09:26.267334+0000","last_became_active":"2026-02-24T09:09:25.267505+0000","last_became_peered":"2026-02-24T09:09:25.267505+0000","last_unstale":"2026-02-24T09:09:26.267334+0000","last_undegraded":"2026-02-24T09:09:26.267334+0000","last_fullsized":"2026-02-24T09:09:26.267334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:20.660345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:49.959653+0000","last_change":"2026-02-24T09:09:24.260793+0000","last_active":"2026-02-24T09:09:49.959653+0000","last_peered":"2026-02-24T09:09:49.959653+0000","last_clean":"2026-02-24T09:09:49.959653+0000","last_became_active":"2026-02-24T09:09:24.260555+0000","last_became_peered":"2026-02-24T09:09:24.260555+0000","last_unstale":"2026-02-24T09:09:49.959653+0000","last_undegraded":"2026-02-24T09:09:49.959653+0000","last_fullsized":"2026-02-24T09:09:49.959653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:30:45.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334847+0000","last_change":"2026-02-24T09:09:25.271121+0000","last_active":"2026-02-24T09:09:26.334847+0000","last_peered":"2026-02-24T09:09:26.334847+0000","last_clean":"2026-02-24T09:09:26.334847+0000","last_became_active":"2026-02-24T09:09:25.270770+0000","last_became_peered":"2026-02-24T09:09:25.270770+0000","last_unstale":"2026-02-24T09:09:26.334847+0000","last_undegraded":"2026-02-24T09:09:26.334847+0000","last_fullsized":"2026-02-24T09:09:26.334847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:52:58.451719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940998+0000","last_change":"2026-02-24T09:09:24.259030+0000","last_active":"2026-02-24T09:09:27.940998+0000","last_peered":"2026-02-24T09:09:27.940998+0000","last_clean":"2026-02-24T09:09:27.940998+0000","last_became_active":"2026-02-24T09:09:24.258747+0000","last_became_peered":"2026-02-24T09:09:24.258747+0000","last_unstale":"2026-02-24T09:09:27.940998+0000","last_undegraded":"2026-02-24T09:09:27.940998+0000","last_fullsized":"2026-02-24T09:09:27.940998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:49:46.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267794+0000","last_change":"2026-02-24T09:09:25.269875+0000","last_active":"2026-02-24T09:09:26.267794+0000","last_peered":"2026-02-24T09:09:26.267794+0000","last_clean":"2026-02-24T09:09:26.267794+0000","last_became_active":"2026-02-24T09:09:25.269400+0000","last_became_peered":"2026-02-24T09:09:25.269400+0000","last_unstale":"2026-02-24T09:09:26.267794+0000","last_undegraded":"2026-02-24T09:09:26.267794+0000","last_fullsized":"2026-02-24T09:09:26.267794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:08:29.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938278+0000","last_change":"2026-02-24T09:09:24.256845+0000","last_active":"2026-02-24T09:09:27.938278+0000","last_peered":"2026-02-24T09:09:27.938278+0000","last_clean":"2026-02-24T09:09:27.938278+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:27.938278+0000","last_undegraded":"2026-02-24T09:09:27.938278+0000","last_fullsized":"2026-02-24T09:09:27.938278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:08:15.802226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334785+0000","last_change":"2026-02-24T09:09:25.269608+0000","last_active":"2026-02-24T09:09:26.334785+0000","last_peered":"2026-02-24T09:09:26.334785+0000","last_clean":"2026-02-24T09:09:26.334785+0000","last_became_active":"2026-02-24T09:09:25.268736+0000","last_became_peered":"2026-02-24T09:09:25.268736+0000","last_unstale":"2026-02-24T09:09:26.334785+0000","last_undegraded":"2026-02-24T09:09:26.334785+0000","last_fullsized":"2026-02-24T09:09:26.334785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:39:41.466580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'30","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:50.963515+0000","last_change":"2026-02-24T09:09:24.260591+0000","last_active":"2026-02-24T09:09:50.963515+0000","last_peered":"2026-02-24T09:09:50.963515+0000","last_clean":"2026-02-24T09:09:50.963515+0000","last_became_active":"2026-02-24T09:09:24.260382+0000","last_became_peered":"2026-02-24T09:09:24.260382+0000","last_unstale":"2026-02-24T09:09:50.963515+0000","last_undegraded":"2026-02-24T09:09:50.963515+0000","last_fullsized":"2026-02-24T09:09:50.963515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:05:00.313499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68809,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":94,"num_write":31,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267717+0000","last_change":"2026-02-24T09:09:25.266872+0000","last_active":"2026-02-24T09:09:26.267717+0000","last_peered":"2026-02-24T09:09:26.267717+0000","last_clean":"2026-02-24T09:09:26.267717+0000","last_became_active":"2026-02-24T09:09:25.266720+0000","last_became_peered":"2026-02-24T09:09:25.266720+0000","last_unstale":"2026-02-24T09:09:26.267717+0000","last_undegraded":"2026-02-24T09:09:26.267717+0000","last_fullsized":"2026-02-24T09:09:26.267717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:43.574647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941766+0000","last_change":"2026-02-24T09:09:24.256821+0000","last_active":"2026-02-24T09:09:28.941766+0000","last_peered":"2026-02-24T09:09:28.941766+0000","last_clean":"2026-02-24T09:09:28.941766+0000","last_became_active":"2026-02-24T09:09:24.256284+0000","last_became_peered":"2026-02-24T09:09:24.256284+0000","last_unstale":"2026-02-24T09:09:28.941766+0000","last_undegraded":"2026-02-24T09:09:28.941766+0000","last_fullsized":"2026-02-24T09:09:28.941766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:37:32.352734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332187+0000","last_change":"2026-02-24T09:09:25.268120+0000","last_active":"2026-02-24T09:09:26.332187+0000","last_peered":"2026-02-24T09:09:26.332187+0000","last_clean":"2026-02-24T09:09:26.332187+0000","last_became_active":"2026-02-24T09:09:25.267865+0000","last_became_peered":"2026-02-24T09:09:25.267865+0000","last_unstale":"2026-02-24T09:09:26.332187+0000","last_undegraded":"2026-02-24T09:09:26.332187+0000","last_fullsized":"2026-02-24T09:09:26.332187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:51:18.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938196+0000","last_change":"2026-02-24T09:09:24.257176+0000","last_active":"2026-02-24T09:09:27.938196+0000","last_peered":"2026-02-24T09:09:27.938196+0000","last_clean":"2026-02-24T09:09:27.938196+0000","last_became_active":"2026-02-24T09:09:24.256855+0000","last_became_peered":"2026-02-24T09:09:24.256855+0000","last_unstale":"2026-02-24T09:09:27.938196+0000","last_undegraded":"2026-02-24T09:09:27.938196+0000","last_fullsized":"2026-02-24T09:09:27.938196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:48:25.179774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733497+0000","last_change":"2026-02-24T09:09:25.271913+0000","last_active":"2026-02-24T09:09:26.733497+0000","last_peered":"2026-02-24T09:09:26.733497+0000","last_clean":"2026-02-24T09:09:26.733497+0000","last_became_active":"2026-02-24T09:09:25.271736+0000","last_became_peered":"2026-02-24T09:09:25.271736+0000","last_unstale":"2026-02-24T09:09:26.733497+0000","last_undegraded":"2026-02-24T09:09:26.733497+0000","last_fullsized":"2026-02-24T09:09:26.733497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:49.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:47.961761+0000","last_change":"2026-02-24T09:09:24.259308+0000","last_active":"2026-02-24T09:09:47.961761+0000","last_peered":"2026-02-24T09:09:47.961761+0000","last_clean":"2026-02-24T09:09:47.961761+0000","last_became_active":"2026-02-24T09:09:24.259131+0000","last_became_peered":"2026-02-24T09:09:24.259131+0000","last_unstale":"2026-02-24T09:09:47.961761+0000","last_undegraded":"2026-02-24T09:09:47.961761+0000","last_fullsized":"2026-02-24T09:09:47.961761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:52:00.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733165+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.733165+0000","last_peered":"2026-02-24T09:09:26.733165+0000","last_clean":"2026-02-24T09:09:26.733165+0000","last_became_active":"2026-02-24T09:09:25.269559+0000","last_became_peered":"2026-02-24T09:09:25.269559+0000","last_unstale":"2026-02-24T09:09:26.733165+0000","last_undegraded":"2026-02-24T09:09:26.733165+0000","last_fullsized":"2026-02-24T09:09:26.733165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:06:28.902948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942522+0000","last_change":"2026-02-24T09:09:24.257075+0000","last_active":"2026-02-24T09:09:28.942522+0000","last_peered":"2026-02-24T09:09:28.942522+0000","last_clean":"2026-02-24T09:09:28.942522+0000","last_became_active":"2026-02-24T09:09:24.256738+0000","last_became_peered":"2026-02-24T09:09:24.256738+0000","last_unstale":"2026-02-24T09:09:28.942522+0000","last_undegraded":"2026-02-24T09:09:28.942522+0000","last_fullsized":"2026-02-24T09:09:28.942522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:14.802040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268002+0000","last_change":"2026-02-24T09:09:25.271423+0000","last_active":"2026-02-24T09:09:26.268002+0000","last_peered":"2026-02-24T09:09:26.268002+0000","last_clean":"2026-02-24T09:09:26.268002+0000","last_became_active":"2026-02-24T09:09:25.271142+0000","last_became_peered":"2026-02-24T09:09:25.271142+0000","last_unstale":"2026-02-24T09:09:26.268002+0000","last_undegraded":"2026-02-24T09:09:26.268002+0000","last_fullsized":"2026-02-24T09:09:26.268002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:16.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.940354+0000","last_change":"2026-02-24T09:09:24.258426+0000","last_active":"2026-02-24T09:09:29.940354+0000","last_peered":"2026-02-24T09:09:29.940354+0000","last_clean":"2026-02-24T09:09:29.940354+0000","last_became_active":"2026-02-24T09:09:24.257941+0000","last_became_peered":"2026-02-24T09:09:24.257941+0000","last_unstale":"2026-02-24T09:09:29.940354+0000","last_undegraded":"2026-02-24T09:09:29.940354+0000","last_fullsized":"2026-02-24T09:09:29.940354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:30:29.724001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332552+0000","last_change":"2026-02-24T09:09:25.266758+0000","last_active":"2026-02-24T09:09:26.332552+0000","last_peered":"2026-02-24T09:09:26.332552+0000","last_clean":"2026-02-24T09:09:26.332552+0000","last_became_active":"2026-02-24T09:09:25.266569+0000","last_became_peered":"2026-02-24T09:09:25.266569+0000","last_unstale":"2026-02-24T09:09:26.332552+0000","last_undegraded":"2026-02-24T09:09:26.332552+0000","last_fullsized":"2026-02-24T09:09:26.332552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:13:56.985056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332354+0000","last_change":"2026-02-24T09:09:24.256974+0000","last_active":"2026-02-24T09:09:26.332354+0000","last_peered":"2026-02-24T09:09:26.332354+0000","last_clean":"2026-02-24T09:09:26.332354+0000","last_became_active":"2026-02-24T09:09:24.256617+0000","last_became_peered":"2026-02-24T09:09:24.256617+0000","last_unstale":"2026-02-24T09:09:26.332354+0000","last_undegraded":"2026-02-24T09:09:26.332354+0000","last_fullsized":"2026-02-24T09:09:26.332354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:28.318156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733475+0000","last_change":"2026-02-24T09:09:25.270445+0000","last_active":"2026-02-24T09:09:26.733475+0000","last_peered":"2026-02-24T09:09:26.733475+0000","last_clean":"2026-02-24T09:09:26.733475+0000","last_became_active":"2026-02-24T09:09:25.270275+0000","last_became_peered":"2026-02-24T09:09:25.270275+0000","last_unstale":"2026-02-24T09:09:26.733475+0000","last_undegraded":"2026-02-24T09:09:26.733475+0000","last_fullsized":"2026-02-24T09:09:26.733475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:53:49.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210815+0000","last_change":"2026-02-24T09:09:24.259031+0000","last_active":"2026-02-24T09:09:27.210815+0000","last_peered":"2026-02-24T09:09:27.210815+0000","last_clean":"2026-02-24T09:09:27.210815+0000","last_became_active":"2026-02-24T09:09:24.258899+0000","last_became_peered":"2026-02-24T09:09:24.258899+0000","last_unstale":"2026-02-24T09:09:27.210815+0000","last_undegraded":"2026-02-24T09:09:27.210815+0000","last_fullsized":"2026-02-24T09:09:27.210815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:16.802986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109422+0000","last_change":"2026-02-24T09:09:25.272707+0000","last_active":"2026-02-24T09:09:28.109422+0000","last_peered":"2026-02-24T09:09:28.109422+0000","last_clean":"2026-02-24T09:09:28.109422+0000","last_became_active":"2026-02-24T09:09:25.272563+0000","last_became_peered":"2026-02-24T09:09:25.272563+0000","last_unstale":"2026-02-24T09:09:28.109422+0000","last_undegraded":"2026-02-24T09:09:28.109422+0000","last_fullsized":"2026-02-24T09:09:28.109422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:41:22.895217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942219+0000","last_change":"2026-02-24T09:09:24.256493+0000","last_active":"2026-02-24T09:09:28.942219+0000","last_peered":"2026-02-24T09:09:28.942219+0000","last_clean":"2026-02-24T09:09:28.942219+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:28.942219+0000","last_undegraded":"2026-02-24T09:09:28.942219+0000","last_fullsized":"2026-02-24T09:09:28.942219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:43:12.259841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733528+0000","last_change":"2026-02-24T09:09:25.271977+0000","last_active":"2026-02-24T09:09:26.733528+0000","last_peered":"2026-02-24T09:09:26.733528+0000","last_clean":"2026-02-24T09:09:26.733528+0000","last_became_active":"2026-02-24T09:09:25.271650+0000","last_became_peered":"2026-02-24T09:09:25.271650+0000","last_unstale":"2026-02-24T09:09:26.733528+0000","last_undegraded":"2026-02-24T09:09:26.733528+0000","last_fullsized":"2026-02-24T09:09:26.733528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:10.062115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733207+0000","last_change":"2026-02-24T09:09:05.953512+0000","last_active":"2026-02-24T09:09:26.733207+0000","last_peered":"2026-02-24T09:09:26.733207+0000","last_clean":"2026-02-24T09:09:26.733207+0000","last_became_active":"2026-02-24T09:09:05.953360+0000","last_became_peered":"2026-02-24T09:09:05.953360+0000","last_unstale":"2026-02-24T09:09:26.733207+0000","last_undegraded":"2026-02-24T09:09:26.733207+0000","last_fullsized":"2026-02-24T09:09:26.733207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_clean_scrub_stamp":"2026-02-24T09:08:00.445410+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:48.550493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.945604+0000","last_change":"2026-02-24T09:09:24.259164+0000","last_active":"2026-02-24T09:09:29.945604+0000","last_peered":"2026-02-24T09:09:29.945604+0000","last_clean":"2026-02-24T09:09:29.945604+0000","last_became_active":"2026-02-24T09:09:24.259011+0000","last_became_peered":"2026-02-24T09:09:24.259011+0000","last_unstale":"2026-02-24T09:09:29.945604+0000","last_undegraded":"2026-02-24T09:09:29.945604+0000","last_fullsized":"2026-02-24T09:09:29.945604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:41.649484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268864+0000","last_change":"2026-02-24T09:09:25.269884+0000","last_active":"2026-02-24T09:09:26.268864+0000","last_peered":"2026-02-24T09:09:26.268864+0000","last_clean":"2026-02-24T09:09:26.268864+0000","last_became_active":"2026-02-24T09:09:25.269543+0000","last_became_peered":"2026-02-24T09:09:25.269543+0000","last_unstale":"2026-02-24T09:09:26.268864+0000","last_undegraded":"2026-02-24T09:09:26.268864+0000","last_fullsized":"2026-02-24T09:09:26.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:21:25.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943350+0000","last_change":"2026-02-24T09:09:24.259369+0000","last_active":"2026-02-24T09:09:28.943350+0000","last_peered":"2026-02-24T09:09:28.943350+0000","last_clean":"2026-02-24T09:09:28.943350+0000","last_became_active":"2026-02-24T09:09:24.259086+0000","last_became_peered":"2026-02-24T09:09:24.259086+0000","last_unstale":"2026-02-24T09:09:28.943350+0000","last_undegraded":"2026-02-24T09:09:28.943350+0000","last_fullsized":"2026-02-24T09:09:28.943350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:08.881900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332119+0000","last_change":"2026-02-24T09:09:25.266898+0000","last_active":"2026-02-24T09:09:26.332119+0000","last_peered":"2026-02-24T09:09:26.332119+0000","last_clean":"2026-02-24T09:09:26.332119+0000","last_became_active":"2026-02-24T09:09:25.266407+0000","last_became_peered":"2026-02-24T09:09:25.266407+0000","last_unstale":"2026-02-24T09:09:26.332119+0000","last_undegraded":"2026-02-24T09:09:26.332119+0000","last_fullsized":"2026-02-24T09:09:26.332119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:51.887929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:48.959424+0000","last_change":"2026-02-24T09:09:24.254126+0000","last_active":"2026-02-24T09:09:48.959424+0000","last_peered":"2026-02-24T09:09:48.959424+0000","last_clean":"2026-02-24T09:09:48.959424+0000","last_became_active":"2026-02-24T09:09:24.253911+0000","last_became_peered":"2026-02-24T09:09:24.253911+0000","last_unstale":"2026-02-24T09:09:48.959424+0000","last_undegraded":"2026-02-24T09:09:48.959424+0000","last_fullsized":"2026-02-24T09:09:48.959424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:09:56.146842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268161+0000","last_change":"2026-02-24T09:09:25.270387+0000","last_active":"2026-02-24T09:09:26.268161+0000","last_peered":"2026-02-24T09:09:26.268161+0000","last_clean":"2026-02-24T09:09:26.268161+0000","last_became_active":"2026-02-24T09:09:25.269478+0000","last_became_peered":"2026-02-24T09:09:25.269478+0000","last_unstale":"2026-02-24T09:09:26.268161+0000","last_undegraded":"2026-02-24T09:09:26.268161+0000","last_fullsized":"2026-02-24T09:09:26.268161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:32:15.217221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109411+0000","last_change":"2026-02-24T09:09:24.259169+0000","last_active":"2026-02-24T09:09:28.109411+0000","last_peered":"2026-02-24T09:09:28.109411+0000","last_clean":"2026-02-24T09:09:28.109411+0000","last_became_active":"2026-02-24T09:09:24.258755+0000","last_became_peered":"2026-02-24T09:09:24.258755+0000","last_unstale":"2026-02-24T09:09:28.109411+0000","last_undegraded":"2026-02-24T09:09:28.109411+0000","last_fullsized":"2026-02-24T09:09:28.109411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:33.438504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270152+0000","last_change":"2026-02-24T09:09:25.270732+0000","last_active":"2026-02-24T09:09:26.270152+0000","last_peered":"2026-02-24T09:09:26.270152+0000","last_clean":"2026-02-24T09:09:26.270152+0000","last_became_active":"2026-02-24T09:09:25.270200+0000","last_became_peered":"2026-02-24T09:09:25.270200+0000","last_unstale":"2026-02-24T09:09:26.270152+0000","last_undegraded":"2026-02-24T09:09:26.270152+0000","last_fullsized":"2026-02-24T09:09:26.270152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:59:28.115196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267351+0000","last_change":"2026-02-24T09:09:24.257488+0000","last_active":"2026-02-24T09:09:26.267351+0000","last_peered":"2026-02-24T09:09:26.267351+0000","last_clean":"2026-02-24T09:09:26.267351+0000","last_became_active":"2026-02-24T09:09:24.257202+0000","last_became_peered":"2026-02-24T09:09:24.257202+0000","last_unstale":"2026-02-24T09:09:26.267351+0000","last_undegraded":"2026-02-24T09:09:26.267351+0000","last_fullsized":"2026-02-24T09:09:26.267351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:41:24.345307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.674896+0000","last_change":"2026-02-24T09:09:25.272254+0000","last_active":"2026-02-24T09:09:26.674896+0000","last_peered":"2026-02-24T09:09:26.674896+0000","last_clean":"2026-02-24T09:09:26.674896+0000","last_became_active":"2026-02-24T09:09:25.271674+0000","last_became_peered":"2026-02-24T09:09:25.271674+0000","last_unstale":"2026-02-24T09:09:26.674896+0000","last_undegraded":"2026-02-24T09:09:26.674896+0000","last_fullsized":"2026-02-24T09:09:26.674896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:03:26.493850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938246+0000","last_change":"2026-02-24T09:09:24.257331+0000","last_active":"2026-02-24T09:09:27.938246+0000","last_peered":"2026-02-24T09:09:27.938246+0000","last_clean":"2026-02-24T09:09:27.938246+0000","last_became_active":"2026-02-24T09:09:24.256876+0000","last_became_peered":"2026-02-24T09:09:24.256876+0000","last_unstale":"2026-02-24T09:09:27.938246+0000","last_undegraded":"2026-02-24T09:09:27.938246+0000","last_fullsized":"2026-02-24T09:09:27.938246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:29:58.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332332+0000","last_change":"2026-02-24T09:09:25.266642+0000","last_active":"2026-02-24T09:09:26.332332+0000","last_peered":"2026-02-24T09:09:26.332332+0000","last_clean":"2026-02-24T09:09:26.332332+0000","last_became_active":"2026-02-24T09:09:25.266307+0000","last_became_peered":"2026-02-24T09:09:25.266307+0000","last_unstale":"2026-02-24T09:09:26.332332+0000","last_undegraded":"2026-02-24T09:09:26.332332+0000","last_fullsized":"2026-02-24T09:09:26.332332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:51.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:37.268830+0000","last_change":"2026-02-24T09:09:24.258807+0000","last_active":"2026-02-24T09:09:37.268830+0000","last_peered":"2026-02-24T09:09:37.268830+0000","last_clean":"2026-02-24T09:09:37.268830+0000","last_became_active":"2026-02-24T09:09:24.258649+0000","last_became_peered":"2026-02-24T09:09:24.258649+0000","last_unstale":"2026-02-24T09:09:37.268830+0000","last_undegraded":"2026-02-24T09:09:37.268830+0000","last_fullsized":"2026-02-24T09:09:37.268830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:10:48.348275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269009+0000","last_change":"2026-02-24T09:09:25.268491+0000","last_active":"2026-02-24T09:09:26.269009+0000","last_peered":"2026-02-24T09:09:26.269009+0000","last_clean":"2026-02-24T09:09:26.269009+0000","last_became_active":"2026-02-24T09:09:25.267341+0000","last_became_peered":"2026-02-24T09:09:25.267341+0000","last_unstale":"2026-02-24T09:09:26.269009+0000","last_undegraded":"2026-02-24T09:09:26.269009+0000","last_fullsized":"2026-02-24T09:09:26.269009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:18:29.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940964+0000","last_change":"2026-02-24T09:09:24.258484+0000","last_active":"2026-02-24T09:09:27.940964+0000","last_peered":"2026-02-24T09:09:27.940964+0000","last_clean":"2026-02-24T09:09:27.940964+0000","last_became_active":"2026-02-24T09:09:24.258249+0000","last_became_peered":"2026-02-24T09:09:24.258249+0000","last_unstale":"2026-02-24T09:09:27.940964+0000","last_undegraded":"2026-02-24T09:09:27.940964+0000","last_fullsized":"2026-02-24T09:09:27.940964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:32:56.722522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267783+0000","last_change":"2026-02-24T09:09:25.269738+0000","last_active":"2026-02-24T09:09:26.267783+0000","last_peered":"2026-02-24T09:09:26.267783+0000","last_clean":"2026-02-24T09:09:26.267783+0000","last_became_active":"2026-02-24T09:09:25.269413+0000","last_became_peered":"2026-02-24T09:09:25.269413+0000","last_unstale":"2026-02-24T09:09:26.267783+0000","last_undegraded":"2026-02-24T09:09:26.267783+0000","last_fullsized":"2026-02-24T09:09:26.267783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:00.412570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941334+0000","last_change":"2026-02-24T09:09:24.258901+0000","last_active":"2026-02-24T09:09:27.941334+0000","last_peered":"2026-02-24T09:09:27.941334+0000","last_clean":"2026-02-24T09:09:27.941334+0000","last_became_active":"2026-02-24T09:09:24.258325+0000","last_became_peered":"2026-02-24T09:09:24.258325+0000","last_unstale":"2026-02-24T09:09:27.941334+0000","last_undegraded":"2026-02-24T09:09:27.941334+0000","last_fullsized":"2026-02-24T09:09:27.941334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:36.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267522+0000","last_change":"2026-02-24T09:09:25.267368+0000","last_active":"2026-02-24T09:09:26.267522+0000","last_peered":"2026-02-24T09:09:26.267522+0000","last_clean":"2026-02-24T09:09:26.267522+0000","last_became_active":"2026-02-24T09:09:25.267168+0000","last_became_peered":"2026-02-24T09:09:25.267168+0000","last_unstale":"2026-02-24T09:09:26.267522+0000","last_undegraded":"2026-02-24T09:09:26.267522+0000","last_fullsized":"2026-02-24T09:09:26.267522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:57.616866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.939140+0000","last_change":"2026-02-24T09:09:24.257345+0000","last_active":"2026-02-24T09:09:27.939140+0000","last_peered":"2026-02-24T09:09:27.939140+0000","last_clean":"2026-02-24T09:09:27.939140+0000","last_became_active":"2026-02-24T09:09:24.256817+0000","last_became_peered":"2026-02-24T09:09:24.256817+0000","last_unstale":"2026-02-24T09:09:27.939140+0000","last_undegraded":"2026-02-24T09:09:27.939140+0000","last_fullsized":"2026-02-24T09:09:27.939140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:37:48.042471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332527+0000","last_change":"2026-02-24T09:09:25.267778+0000","last_active":"2026-02-24T09:09:26.332527+0000","last_peered":"2026-02-24T09:09:26.332527+0000","last_clean":"2026-02-24T09:09:26.332527+0000","last_became_active":"2026-02-24T09:09:25.267379+0000","last_became_peered":"2026-02-24T09:09:25.267379+0000","last_unstale":"2026-02-24T09:09:26.332527+0000","last_undegraded":"2026-02-24T09:09:26.332527+0000","last_fullsized":"2026-02-24T09:09:26.332527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:25:47.194857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.121396+0000","last_change":"2026-02-24T09:09:24.259141+0000","last_active":"2026-02-24T09:09:28.121396+0000","last_peered":"2026-02-24T09:09:28.121396+0000","last_clean":"2026-02-24T09:09:28.121396+0000","last_became_active":"2026-02-24T09:09:24.258981+0000","last_became_peered":"2026-02-24T09:09:24.258981+0000","last_unstale":"2026-02-24T09:09:28.121396+0000","last_undegraded":"2026-02-24T09:09:28.121396+0000","last_fullsized":"2026-02-24T09:09:28.121396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:48.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268774+0000","last_change":"2026-02-24T09:09:25.268540+0000","last_active":"2026-02-24T09:09:26.268774+0000","last_peered":"2026-02-24T09:09:26.268774+0000","last_clean":"2026-02-24T09:09:26.268774+0000","last_became_active":"2026-02-24T09:09:25.267915+0000","last_became_peered":"2026-02-24T09:09:25.267915+0000","last_unstale":"2026-02-24T09:09:26.268774+0000","last_undegraded":"2026-02-24T09:09:26.268774+0000","last_fullsized":"2026-02-24T09:09:26.268774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:55.564971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938005+0000","last_change":"2026-02-24T09:09:24.257964+0000","last_active":"2026-02-24T09:09:27.938005+0000","last_peered":"2026-02-24T09:09:27.938005+0000","last_clean":"2026-02-24T09:09:27.938005+0000","last_became_active":"2026-02-24T09:09:24.257717+0000","last_became_peered":"2026-02-24T09:09:24.257717+0000","last_unstale":"2026-02-24T09:09:27.938005+0000","last_undegraded":"2026-02-24T09:09:27.938005+0000","last_fullsized":"2026-02-24T09:09:27.938005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:23:24.989893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733433+0000","last_change":"2026-02-24T09:09:25.271214+0000","last_active":"2026-02-24T09:09:26.733433+0000","last_peered":"2026-02-24T09:09:26.733433+0000","last_clean":"2026-02-24T09:09:26.733433+0000","last_became_active":"2026-02-24T09:09:25.271038+0000","last_became_peered":"2026-02-24T09:09:25.271038+0000","last_unstale":"2026-02-24T09:09:26.733433+0000","last_undegraded":"2026-02-24T09:09:26.733433+0000","last_fullsized":"2026-02-24T09:09:26.733433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:58:44.899837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268097+0000","last_change":"2026-02-24T09:09:25.269834+0000","last_active":"2026-02-24T09:09:26.268097+0000","last_peered":"2026-02-24T09:09:26.268097+0000","last_clean":"2026-02-24T09:09:26.268097+0000","last_became_active":"2026-02-24T09:09:25.269526+0000","last_became_peered":"2026-02-24T09:09:25.269526+0000","last_unstale":"2026-02-24T09:09:26.268097+0000","last_undegraded":"2026-02-24T09:09:26.268097+0000","last_fullsized":"2026-02-24T09:09:26.268097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:36:54.610640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267687+0000","last_change":"2026-02-24T09:09:24.258597+0000","last_active":"2026-02-24T09:09:26.267687+0000","last_peered":"2026-02-24T09:09:26.267687+0000","last_clean":"2026-02-24T09:09:26.267687+0000","last_became_active":"2026-02-24T09:09:24.258302+0000","last_became_peered":"2026-02-24T09:09:24.258302+0000","last_unstale":"2026-02-24T09:09:26.267687+0000","last_undegraded":"2026-02-24T09:09:26.267687+0000","last_fullsized":"2026-02-24T09:09:26.267687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:20:15.556479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334746+0000","last_change":"2026-02-24T09:09:25.269804+0000","last_active":"2026-02-24T09:09:26.334746+0000","last_peered":"2026-02-24T09:09:26.334746+0000","last_clean":"2026-02-24T09:09:26.334746+0000","last_became_active":"2026-02-24T09:09:25.268973+0000","last_became_peered":"2026-02-24T09:09:25.268973+0000","last_unstale":"2026-02-24T09:09:26.334746+0000","last_undegraded":"2026-02-24T09:09:26.334746+0000","last_fullsized":"2026-02-24T09:09:26.334746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:33:39.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942003+0000","last_change":"2026-02-24T09:09:24.257428+0000","last_active":"2026-02-24T09:09:28.942003+0000","last_peered":"2026-02-24T09:09:28.942003+0000","last_clean":"2026-02-24T09:09:28.942003+0000","last_became_active":"2026-02-24T09:09:24.256679+0000","last_became_peered":"2026-02-24T09:09:24.256679+0000","last_unstale":"2026-02-24T09:09:28.942003+0000","last_undegraded":"2026-02-24T09:09:28.942003+0000","last_fullsized":"2026-02-24T09:09:28.942003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:39:28.664820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267792+0000","last_change":"2026-02-24T09:09:25.268127+0000","last_active":"2026-02-24T09:09:26.267792+0000","last_peered":"2026-02-24T09:09:26.267792+0000","last_clean":"2026-02-24T09:09:26.267792+0000","last_became_active":"2026-02-24T09:09:25.267860+0000","last_became_peered":"2026-02-24T09:09:25.267860+0000","last_unstale":"2026-02-24T09:09:26.267792+0000","last_undegraded":"2026-02-24T09:09:26.267792+0000","last_fullsized":"2026-02-24T09:09:26.267792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:37:52.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269053+0000","last_change":"2026-02-24T09:09:24.257552+0000","last_active":"2026-02-24T09:09:26.269053+0000","last_peered":"2026-02-24T09:09:26.269053+0000","last_clean":"2026-02-24T09:09:26.269053+0000","last_became_active":"2026-02-24T09:09:24.257163+0000","last_became_peered":"2026-02-24T09:09:24.257163+0000","last_unstale":"2026-02-24T09:09:26.269053+0000","last_undegraded":"2026-02-24T09:09:26.269053+0000","last_fullsized":"2026-02-24T09:09:26.269053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:30:54.285800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268961+0000","last_change":"2026-02-24T09:09:25.268695+0000","last_active":"2026-02-24T09:09:26.268961+0000","last_peered":"2026-02-24T09:09:26.268961+0000","last_clean":"2026-02-24T09:09:26.268961+0000","last_became_active":"2026-02-24T09:09:25.268128+0000","last_became_peered":"2026-02-24T09:09:25.268128+0000","last_unstale":"2026-02-24T09:09:26.268961+0000","last_undegraded":"2026-02-24T09:09:26.268961+0000","last_fullsized":"2026-02-24T09:09:26.268961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:23.987958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942226+0000","last_change":"2026-02-24T09:09:24.257602+0000","last_active":"2026-02-24T09:09:28.942226+0000","last_peered":"2026-02-24T09:09:28.942226+0000","last_clean":"2026-02-24T09:09:28.942226+0000","last_became_active":"2026-02-24T09:09:24.257440+0000","last_became_peered":"2026-02-24T09:09:24.257440+0000","last_unstale":"2026-02-24T09:09:28.942226+0000","last_undegraded":"2026-02-24T09:09:28.942226+0000","last_fullsized":"2026-02-24T09:09:28.942226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:13:51.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72859,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":157,"num_read_kb":156,"num_write":158,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":218577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119920,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":259322,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710732,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":395125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":27582038},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939660,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27916,"kb_used_data":952,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975284,"statfs":{"total":751619276800,"available":751590690816,"internally_reserved":0,"allocated":974848,"data_stored":1055825,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23856,"internal_metadata":27566800},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070478,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24845,"internal_metadata":27565811},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299407,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32956,"internal_metadata":27557700},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528338,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":987230,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28867,"internal_metadata":27561789},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659155,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":394740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888084,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":986504,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":32062,"internal_metadata":27558594},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018901,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31416,"internal_metadata":27559240},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247832,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":395051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47059,"internal_metadata":27543597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476761,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27856,"kb_used_data":892,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975344,"statfs":{"total":751619276800,"available":751590752256,"internally_reserved":0,"allocated":913408,"data_stored":464702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34581,"internal_metadata":27556075},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607578,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27832,"kb_used_data":868,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975368,"statfs":{"total":751619276800,"available":751590776832,"internally_reserved":0,"allocated":888832,"data_stored":463342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49917,"internal_metadata":27540739},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11012,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":70169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12011,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13952,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6329,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13842,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3422,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31362,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9492,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13536,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:09:54.090 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:09:54.091 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:53 trial090 ceph-mon[47278]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:54.092 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:53 trial090 ceph-mon[47278]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:54.092 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:53 trial090 ceph-mon[47278]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:54.092 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:53 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2709349400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:54.092 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:53 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/454949164' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:54.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:53 trial014 ceph-mon[46941]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:54.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:53 trial014 ceph-mon[46941]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:54.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:53 trial014 ceph-mon[46941]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:54.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:53 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2709349400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:54.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:53 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/454949164' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:54.109 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:54.225 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:54.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.224+0000 7f84c7009640 1 -- 10.20.193.4:0/2624804296 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84c01135c0 msgr2=0x7f84c0173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.224+0000 7f84c7009640 1 --2- 10.20.193.4:0/2624804296 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84c01135c0 0x7f84c0173f90 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=16282747477735027175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84bc00a970 tx=0x7f84bc0301b0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.224+0000 7f84c7009640 1 -- 10.20.193.4:0/2624804296 shutdown_connections 2026-02-24T09:09:54.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.224+0000 7f84c7009640 1 --2- 10.20.193.4:0/2624804296 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84c01135c0 0x7f84c0173f90 unknown :-1 s=CLOSED pgs=442 gs=1 cs=0 l=1 c_cookie=16282747477735027175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.224+0000 7f84c7009640 1 --2- 10.20.193.4:0/2624804296 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84c010ddc0 0x7f84c0112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.224+0000 7f84c7009640 1 --2- 10.20.193.4:0/2624804296 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84c010d3d0 0x7f84c010d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.224+0000 7f84c7009640 1 -- 10.20.193.4:0/2624804296 >> 10.20.193.4:0/2624804296 conn(0x7f84c00eaca0 msgr2=0x7f84c010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.224+0000 7f84c7009640 1 -- 10.20.193.4:0/2624804296 shutdown_connections 2026-02-24T09:09:54.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.224+0000 7f84c7009640 1 -- 10.20.193.4:0/2624804296 wait complete. 2026-02-24T09:09:54.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c7009640 1 Processor -- start 2026-02-24T09:09:54.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c7009640 1 -- start start 2026-02-24T09:09:54.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c7009640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84c010d3d0 0x7f84c0060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c7009640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84c010ddc0 0x7f84c00614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c7009640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84c01135c0 0x7f84c0061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c7009640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0163fb0 con 0x7f84c01135c0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c7009640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f84c0164120 con 0x7f84c010d3d0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c7009640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84c01642e0 con 0x7f84c010ddc0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c557f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84c01135c0 0x7f84c0061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c557f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84c01135c0 0x7f84c0061a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50648/0 (socket says 10.20.193.4:50648) 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c557f640 1 -- 10.20.193.4:0/476599955 learned_addr learned my addr 10.20.193.4:0/476599955 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84c010d3d0 0x7f84c0060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84b7fff640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84c010ddc0 0x7f84c00614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c557f640 1 -- 10.20.193.4:0/476599955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84c010ddc0 msgr2=0x7f84c00614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c557f640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84c010ddc0 0x7f84c00614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c557f640 1 -- 10.20.193.4:0/476599955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84c010d3d0 msgr2=0x7f84c0060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c557f640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84c010d3d0 0x7f84c0060f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c557f640 1 -- 10.20.193.4:0/476599955 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc00a590 con 0x7f84c01135c0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84c010d3d0 0x7f84c0060f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c557f640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84c01135c0 0x7f84c0061a10 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84bc005820 tx=0x7f84bc030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84b5ffb640 1 -- 10.20.193.4:0/476599955 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84bc03e070 con 0x7f84c01135c0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84b5ffb640 1 -- 10.20.193.4:0/476599955 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f84bc003b10 con 0x7f84c01135c0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c7009640 1 -- 10.20.193.4:0/476599955 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c0164560 con 0x7f84c01135c0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84b5ffb640 1 -- 10.20.193.4:0/476599955 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84bc042960 con 0x7f84c01135c0 2026-02-24T09:09:54.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.225+0000 7f84c7009640 1 -- 10.20.193.4:0/476599955 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c0164980 con 0x7f84c01135c0 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.228+0000 7f84b5ffb640 1 -- 10.20.193.4:0/476599955 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f84bc04c440 con 0x7f84c01135c0 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.228+0000 7f84b5ffb640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f849c0b5770 0x7f849c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.228+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f849c0b5770 0x7f849c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.228+0000 7f84b5ffb640 1 -- 10.20.193.4:0/476599955 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f84bc10c690 con 0x7f84c01135c0 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.229+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f849c0b5770 0x7f849c0d5c20 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b0004740 tx=0x7f84b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c9003e00 1 Processor -- start 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c9003e00 1 -- start start 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fb8bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb9130 0x55d875ffd890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d87601e1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c9003e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d875ec8de0 con 0x55d875fb8820 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c9003e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d875ec4b10 con 0x55d875ffddd0 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c9003e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d875ebeab0 con 0x55d875fb9130 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c4d7e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fb8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c4d7e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fb8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50660/0 (socket says 10.20.193.4:50660) 2026-02-24T09:09:54.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c4d7e640 1 -- 10.20.193.4:0/1968900297 learned_addr learned my addr 10.20.193.4:0/1968900297 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84b7fff640 1 --2- 10.20.193.4:0/1968900297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb9130 0x55d875ffd890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c4d7e640 1 -- 10.20.193.4:0/1968900297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb9130 msgr2=0x55d875ffd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/1968900297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb9130 0x55d875ffd890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c4d7e640 1 -- 10.20.193.4:0/1968900297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 msgr2=0x55d87601e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/1968900297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d87601e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c4d7e640 1 -- 10.20.193.4:0/1968900297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d875e6a310 con 0x55d875fb8820 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/1968900297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fb8bf0 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=7832890638535041625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b0003010 tx=0x7f84b0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb404890a5d2259 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f848d4e4640 1 -- 10.20.193.4:0/1968900297 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84b0011e60 con 0x55d875fb8820 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f848d4e4640 1 -- 10.20.193.4:0/1968900297 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f84b001d940 con 0x55d875fb8820 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.230+0000 7f848d4e4640 1 -- 10.20.193.4:0/1968900297 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84b001abd0 con 0x55d875fb8820 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.231+0000 7f84c9003e00 1 -- 10.20.193.4:0/1968900297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 msgr2=0x55d875fb8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.231+0000 7f84c9003e00 1 --2- 10.20.193.4:0/1968900297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fb8bf0 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=7832890638535041625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b0003010 tx=0x7f84b0013000 comp rx=0 tx=0).stop 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.231+0000 7f84c9003e00 1 -- 10.20.193.4:0/1968900297 shutdown_connections 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.231+0000 7f84c9003e00 1 --2- 10.20.193.4:0/1968900297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d87601e1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.231+0000 7f84c9003e00 1 --2- 10.20.193.4:0/1968900297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb9130 0x55d875ffd890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.231+0000 7f84c9003e00 1 --2- 10.20.193.4:0/1968900297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fb8bf0 unknown :-1 s=CLOSED pgs=444 gs=1 cs=0 l=1 c_cookie=7832890638535041625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.231+0000 7f84c9003e00 1 -- 10.20.193.4:0/1968900297 >> 10.20.193.4:0/1968900297 conn(0x55d875ed76b0 msgr2=0x55d875fb7100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.231+0000 7f84c9003e00 1 -- 10.20.193.4:0/1968900297 shutdown_connections 2026-02-24T09:09:54.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.231+0000 7f84c9003e00 1 -- 10.20.193.4:0/1968900297 wait complete. 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.231+0000 7f84c9003e00 1 -- start start 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 1 Processor -- start 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd0e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875fb9130 0x55d875fd1390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875ffddd0 0x55d875fd6380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d875fd68c0 con 0x55d875fb8820 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d875fd6a30 con 0x55d875fb9130 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d875fd6bf0 con 0x55d875ffddd0 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c4d7e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c4d7e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50672/0 (socket says 10.20.193.4:50672) 2026-02-24T09:09:54.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c4d7e640 1 -- 10.20.193.4:0/2388538427 learned_addr learned my addr 10.20.193.4:0/2388538427 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84b7fff640 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875fb9130 0x55d875fd1390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c557f640 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875ffddd0 0x55d875fd6380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c4d7e640 1 -- 10.20.193.4:0/2388538427 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875ffddd0 msgr2=0x55d875fd6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875ffddd0 0x55d875fd6380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c4d7e640 1 -- 10.20.193.4:0/2388538427 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875fb9130 msgr2=0x55d875fd1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875fb9130 0x55d875fd1390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c4d7e640 1 -- 10.20.193.4:0/2388538427 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d875e428c0 con 0x55d875fb8820 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c557f640 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875ffddd0 0x55d875fd6380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd0e50 secure :-1 s=READY pgs=445 gs=1 cs=0 l=1 c_cookie=3284403093112721833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b0004360 tx=0x7f84b0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d948b36302d91a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f847e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f847e7fc640 1 -- 10.20.193.4:0/2388538427 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84b002c070 con 0x55d875fb8820 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 1 -- 10.20.193.4:0/2388538427 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b0002dd0 con 0x55d875fb8820 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f847e7fc640 1 -- 10.20.193.4:0/2388538427 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f84b001ab40 con 0x55d875fb8820 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f847e7fc640 1 -- 10.20.193.4:0/2388538427 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84b0027a30 con 0x55d875fb8820 2026-02-24T09:09:54.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 10 client.15546 _ll_register_callbacks cb 0x55d875e5a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 1 -- 10.20.193.4:0/2388538427 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d875c0e4a0 con 0x55d875fb8820 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f847e7fc640 1 -- 10.20.193.4:0/2388538427 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f84b0027bc0 con 0x55d875fb8820 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f847e7fc640 1 -- 10.20.193.4:0/2388538427 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f84b0027dc0 con 0x55d875fb8820 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.232+0000 7f84c9003e00 10 client.15546 fetch_fsmap learned FSMap version 19 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.233+0000 7f84c9003e00 1 -- 10.20.193.4:0/2388538427 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d875e546e0 con 0x55d875fb8820 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.233+0000 7f847e7fc640 1 -- 10.20.193.4:0/2388538427 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f84b0039060 con 0x55d875fb8820 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.233+0000 7f84c9003e00 10 client.15546 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.233+0000 7f84c9003e00 10 client.15546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.233+0000 7f84c9003e00 20 client.15546 populate_metadata read hostname 'trial004' 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.233+0000 7f84c9003e00 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d875ffb6e0 0x55d875ffbb50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.233+0000 7f84c9003e00 4 client.15546 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.233+0000 7f84c9003e00 1 -- 10.20.193.4:0/2388538427 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d875eb44f0 con 0x55d875ffb6e0 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.233+0000 7f84b7fff640 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d875ffb6e0 0x55d875ffbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f847e7fc640 10 client.15546 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84b7fff640 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d875ffb6e0 0x55d875ffbb50 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=13642850597105783362 s_cookie=3132745887404932260 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd552455cc375242 server_cookie=2b79bfc95e563ca4 in_seq=0 out_seq=0 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f847e7fc640 1 -- 10.20.193.4:0/2388538427 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d875eb44f0 con 0x55d875ffb6e0 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f847e7fc640 10 client.15546 handle_command_reply: tid=0 2026-02-24T09:09:54.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84c9003e00 1 client.15546 shutdown 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84c9003e00 1 -- 10.20.193.4:0/2388538427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 msgr2=0x55d875fd0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84c9003e00 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd0e50 secure :-1 s=READY pgs=445 gs=1 cs=0 l=1 c_cookie=3284403093112721833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b0004360 tx=0x7f84b0005780 comp rx=0 tx=0).stop 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84c9003e00 1 -- 10.20.193.4:0/2388538427 shutdown_connections 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84c9003e00 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d875ffb6e0 0x55d875ffbb50 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=13642850597105783362 s_cookie=3132745887404932260 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84c9003e00 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875ffddd0 0x55d875fd6380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84c9003e00 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875fb9130 0x55d875fd1390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f847e7fc640 0 client.15546 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84c9003e00 1 --2- 10.20.193.4:0/2388538427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd0e50 unknown :-1 s=CLOSED pgs=445 gs=1 cs=0 l=1 c_cookie=3284403093112721833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84c9003e00 1 -- 10.20.193.4:0/2388538427 >> 10.20.193.4:0/2388538427 conn(0x55d875ed76b0 msgr2=0x55d875fb7810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.234+0000 7f84c9003e00 1 -- 10.20.193.4:0/2388538427 shutdown_connections 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.235+0000 7f84c9003e00 1 -- 10.20.193.4:0/2388538427 wait complete. 2026-02-24T09:09:54.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.235+0000 7f84c9003e00 20 client.15546 trim_cache size 0 max 16384 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.244+0000 7f84c9003e00 1 Processor -- start 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.244+0000 7f84c9003e00 1 -- start start 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.244+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb8820 0x55d875fce240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.244+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb9130 0x55d875fce780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.244+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d875fb7a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.244+0000 7f84c9003e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d875ebc6e0 con 0x55d875fb9130 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.244+0000 7f84c9003e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d875b87f50 con 0x55d875ffddd0 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.244+0000 7f84c9003e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d875f2c410 con 0x55d875fb8820 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84b7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb9130 0x55d875fce780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84b7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb9130 0x55d875fce780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50682/0 (socket says 10.20.193.4:50682) 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84b7fff640 1 -- 10.20.193.4:0/2571272825 learned_addr learned my addr 10.20.193.4:0/2571272825 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb8820 0x55d875fce240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c557f640 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d875fb7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84b7fff640 1 -- 10.20.193.4:0/2571272825 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb8820 msgr2=0x55d875fce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84b7fff640 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb8820 0x55d875fce240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84b7fff640 1 -- 10.20.193.4:0/2571272825 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 msgr2=0x55d875fb7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84b7fff640 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d875fb7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84b7fff640 1 -- 10.20.193.4:0/2571272825 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d875e4f160 con 0x55d875fb9130 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c557f640 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d875fb7a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb8820 0x55d875fce240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84b7fff640 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb9130 0x55d875fce780 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=507162786643469579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a8005e70 tx=0x7f84a8003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709cdde0d2e650b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f848cce3640 1 -- 10.20.193.4:0/2571272825 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84a8022070 con 0x55d875fb9130 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f848cce3640 1 -- 10.20.193.4:0/2571272825 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f84a8003e50 con 0x55d875fb9130 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f848cce3640 1 -- 10.20.193.4:0/2571272825 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84a8018040 con 0x55d875fb9130 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c9003e00 1 -- 10.20.193.4:0/2571272825 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb9130 msgr2=0x55d875fce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c9003e00 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb9130 0x55d875fce780 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=507162786643469579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84a8005e70 tx=0x7f84a8003c50 comp rx=0 tx=0).stop 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c9003e00 1 -- 10.20.193.4:0/2571272825 shutdown_connections 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c9003e00 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d875fb7a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c9003e00 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb9130 0x55d875fce780 unknown :-1 s=CLOSED pgs=446 gs=1 cs=0 l=1 c_cookie=507162786643469579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c9003e00 1 --2- 10.20.193.4:0/2571272825 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb8820 0x55d875fce240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c9003e00 1 -- 10.20.193.4:0/2571272825 >> 10.20.193.4:0/2571272825 conn(0x55d875ed76b0 msgr2=0x55d875fbb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.245+0000 7f84c9003e00 1 -- 10.20.193.4:0/2571272825 shutdown_connections 2026-02-24T09:09:54.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c9003e00 1 -- 10.20.193.4:0/2571272825 wait complete. 2026-02-24T09:09:54.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c9003e00 1 -- start start 2026-02-24T09:09:54.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c9003e00 1 Processor -- start 2026-02-24T09:09:54.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd7370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb9130 0x55d875fd78b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c9003e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d875fd7e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c9003e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d875fd1ef0 con 0x55d875fb8820 2026-02-24T09:09:54.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c9003e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d875fb9500 con 0x55d875ffddd0 2026-02-24T09:09:54.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c9003e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d875f27600 con 0x55d875fb9130 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c4d7e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd7370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c4d7e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd7370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50690/0 (socket says 10.20.193.4:50690) 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c4d7e640 1 -- 10.20.193.4:0/110334396 learned_addr learned my addr 10.20.193.4:0/110334396 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c557f640 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d875fd7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84b7fff640 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb9130 0x55d875fd78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c4d7e640 1 -- 10.20.193.4:0/110334396 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb9130 msgr2=0x55d875fd78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.246+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb9130 0x55d875fd78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c4d7e640 1 -- 10.20.193.4:0/110334396 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 msgr2=0x55d875fd7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d875fd7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c4d7e640 1 -- 10.20.193.4:0/110334396 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d875e42bf0 con 0x55d875fb8820 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c557f640 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d875fd7e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c4d7e640 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd7370 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=16996171867470541335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b0031b80 tx=0x7f84b00044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebde88438e11b217 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f847e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f847e7fc640 1 -- 10.20.193.4:0/110334396 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84b002c040 con 0x55d875fb8820 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 1 -- 10.20.193.4:0/110334396 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a8003870 con 0x55d875fb8820 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f847e7fc640 1 -- 10.20.193.4:0/110334396 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f84b003f020 con 0x55d875fb8820 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f847e7fc640 1 -- 10.20.193.4:0/110334396 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84b0031630 con 0x55d875fb8820 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 10 client.15552 _ll_register_callbacks cb 0x55d875e5a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 1 -- 10.20.193.4:0/110334396 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84b001d940 con 0x55d875fb8820 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f847e7fc640 1 -- 10.20.193.4:0/110334396 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f84b0040030 con 0x55d875fb8820 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f847e7fc640 1 -- 10.20.193.4:0/110334396 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f84b00317c0 con 0x55d875fb8820 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 10 client.15552 fetch_fsmap learned FSMap version 19 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 1 -- 10.20.193.4:0/110334396 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d875e54940 con 0x55d875fb8820 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f847e7fc640 1 -- 10.20.193.4:0/110334396 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f84b0039030 con 0x55d875fb8820 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 10 client.15552 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 10 client.15552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 20 client.15552 populate_metadata read hostname 'trial004' 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8760ab1a0 0x55d8760cb650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 4 client.15552 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84c9003e00 1 -- 10.20.193.4:0/110334396 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d875bf3160 con 0x55d8760ab1a0 2026-02-24T09:09:54.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.247+0000 7f84b7fff640 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8760ab1a0 0x55d8760cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f847e7fc640 10 client.15552 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84b7fff640 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8760ab1a0 0x55d8760cb650 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=12465950031034869396 s_cookie=1273062131641413577 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acfff3817b9a6694 server_cookie=11aad343857cefc9 in_seq=0 out_seq=0 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f847e7fc640 1 -- 10.20.193.4:0/110334396 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55d875bf3160 con 0x55d8760ab1a0 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f847e7fc640 10 client.15552 handle_command_reply: tid=0 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 client.15552 shutdown 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 -- 10.20.193.4:0/110334396 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 msgr2=0x55d875fd7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd7370 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=16996171867470541335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b0031b80 tx=0x7f84b00044b0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 -- 10.20.193.4:0/110334396 shutdown_connections 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8760ab1a0 0x55d8760cb650 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=12465950031034869396 s_cookie=1273062131641413577 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d875ffddd0 0x55d875fd7e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d875fb9130 0x55d875fd78b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 --2- 10.20.193.4:0/110334396 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d875fb8820 0x55d875fd7370 unknown :-1 s=CLOSED pgs=447 gs=1 cs=0 l=1 c_cookie=16996171867470541335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f847e7fc640 0 client.15552 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 -- 10.20.193.4:0/110334396 >> 10.20.193.4:0/110334396 conn(0x55d875ed76b0 msgr2=0x55d875fd51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 -- 10.20.193.4:0/110334396 shutdown_connections 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 1 -- 10.20.193.4:0/110334396 wait complete. 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c9003e00 20 client.15552 trim_cache size 0 max 16384 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "04559c85-9dcc-42e4-b7df-73a410372b47", 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:09:54.252 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 -- 10.20.193.4:0/476599955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f849c0b5770 msgr2=0x7f849c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f849c0b5770 0x7f849c0d5c20 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b0004740 tx=0x7f84b0005f90 comp rx=0 tx=0).stop 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 -- 10.20.193.4:0/476599955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84c01135c0 msgr2=0x7f84c0061a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84c01135c0 0x7f84c0061a10 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84bc005820 tx=0x7f84bc030d70 comp rx=0 tx=0).stop 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 -- 10.20.193.4:0/476599955 shutdown_connections 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f849c0b5770 0x7f849c0d5c20 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f84c01135c0 0x7f84c0061a10 unknown :-1 s=CLOSED pgs=443 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f84c010ddc0 0x7f84c00614d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 --2- 10.20.193.4:0/476599955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f84c010d3d0 0x7f84c0060f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 -- 10.20.193.4:0/476599955 >> 10.20.193.4:0/476599955 conn(0x7f84c00eaca0 msgr2=0x7f84c010b080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 -- 10.20.193.4:0/476599955 shutdown_connections 2026-02-24T09:09:54.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.248+0000 7f84c7009640 1 -- 10.20.193.4:0/476599955 wait complete. 2026-02-24T09:09:54.301 INFO:tasks.cephfs.filesystem:scrub status for tag:04559c85-9dcc-42e4-b7df-73a410372b47 - {'path': '/', 'tag': '04559c85-9dcc-42e4-b7df-73a410372b47', 'options': 'recursive,force'} 2026-02-24T09:09:54.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 -- 10.20.193.4:0/3949335059 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f11f810f280 msgr2=0x7f11f810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 --2- 10.20.193.4:0/3949335059 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f11f810f280 0x7f11f810f650 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=5054971578040060602 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e4009950 tx=0x7f11e402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 -- 10.20.193.4:0/3949335059 shutdown_connections 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 --2- 10.20.193.4:0/3949335059 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f11f8115470 0x7f11f8175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 --2- 10.20.193.4:0/3949335059 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f11f810fc70 0x7f11f8114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 --2- 10.20.193.4:0/3949335059 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f11f810f280 0x7f11f810f650 unknown :-1 s=CLOSED pgs=448 gs=1 cs=0 l=1 c_cookie=5054971578040060602 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 -- 10.20.193.4:0/3949335059 >> 10.20.193.4:0/3949335059 conn(0x7f11f805f830 msgr2=0x7f11f810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 -- 10.20.193.4:0/3949335059 shutdown_connections 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 -- 10.20.193.4:0/3949335059 wait complete. 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 Processor -- start 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.332+0000 7f11fe167640 1 -- start start 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11fe167640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f11f810f280 0x7f11f811dbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11fe167640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f11f810fc70 0x7f11f811e120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11fe167640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f11f8115470 0x7f11f81234f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11fe167640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8123a80 con 0x7f11f810f280 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11fe167640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8123bf0 con 0x7f11f8115470 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11fe167640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8123db0 con 0x7f11f810fc70 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f11f810f280 0x7f11f811dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f11f810f280 0x7f11f811dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50714/0 (socket says 10.20.193.4:50714) 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f77fe640 1 -- 10.20.193.4:0/3006857251 learned_addr learned my addr 10.20.193.4:0/3006857251 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f77fe640 1 -- 10.20.193.4:0/3006857251 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f11f810fc70 msgr2=0x7f11f811e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f77fe640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f11f810fc70 0x7f11f811e120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f77fe640 1 -- 10.20.193.4:0/3006857251 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f11f8115470 msgr2=0x7f11f81234f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f77fe640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f11f8115470 0x7f11f81234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f77fe640 1 -- 10.20.193.4:0/3006857251 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e4009570 con 0x7f11f810f280 2026-02-24T09:09:54.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f77fe640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f11f810f280 0x7f11f811dbe0 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e4038820 tx=0x7f11e40043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:54.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f4ff9640 1 -- 10.20.193.4:0/3006857251 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11e403d070 con 0x7f11f810f280 2026-02-24T09:09:54.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f4ff9640 1 -- 10.20.193.4:0/3006857251 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f11e4038920 con 0x7f11f810f280 2026-02-24T09:09:54.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11fe167640 1 -- 10.20.193.4:0/3006857251 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f8124030 con 0x7f11f810f280 2026-02-24T09:09:54.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11f4ff9640 1 -- 10.20.193.4:0/3006857251 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11e4041960 con 0x7f11f810f280 2026-02-24T09:09:54.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.333+0000 7f11fe167640 1 -- 10.20.193.4:0/3006857251 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f8164680 con 0x7f11f810f280 2026-02-24T09:09:54.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.334+0000 7f11fe167640 1 -- 10.20.193.4:0/3006857251 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f8110560 con 0x7f11f810f280 2026-02-24T09:09:54.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.335+0000 7f11f4ff9640 1 -- 10.20.193.4:0/3006857251 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f11e4038a90 con 0x7f11f810f280 2026-02-24T09:09:54.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.335+0000 7f11f4ff9640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f11cc0b57f0 0x7f11cc0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.336+0000 7f11f6ffd640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f11cc0b57f0 0x7f11cc0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.336+0000 7f11f4ff9640 1 -- 10.20.193.4:0/3006857251 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f11e410b4f0 con 0x7f11f810f280 2026-02-24T09:09:54.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.336+0000 7f11f6ffd640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f11cc0b57f0 0x7f11cc0d5ca0 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e8005db0 tx=0x7f11e8005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:54.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.336+0000 7f11f4ff9640 1 -- 10.20.193.4:0/3006857251 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f11e40cdfe0 con 0x7f11f810f280 2026-02-24T09:09:54.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.441+0000 7f11fe167640 1 -- 10.20.193.4:0/3006857251 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11f8179190 con 0x7f11cc0b57f0 2026-02-24T09:09:54.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.443+0000 7f11f4ff9640 1 -- 10.20.193.4:0/3006857251 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7f11f8179190 con 0x7f11cc0b57f0 2026-02-24T09:09:54.448 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:54.449 INFO:teuthology.orchestra.run.trial004.stderr:dumped all 2026-02-24T09:09:54.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.445+0000 7f11fe167640 1 -- 10.20.193.4:0/3006857251 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f11cc0b57f0 msgr2=0x7f11cc0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.445+0000 7f11fe167640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f11cc0b57f0 0x7f11cc0d5ca0 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e8005db0 tx=0x7f11e8005d20 comp rx=0 tx=0).stop 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.445+0000 7f11fe167640 1 -- 10.20.193.4:0/3006857251 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f11f810f280 msgr2=0x7f11f811dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.445+0000 7f11fe167640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f11f810f280 0x7f11f811dbe0 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e4038820 tx=0x7f11e40043d0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.445+0000 7f11fe167640 1 -- 10.20.193.4:0/3006857251 shutdown_connections 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.445+0000 7f11fe167640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f11cc0b57f0 0x7f11cc0d5ca0 unknown :-1 s=CLOSED pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.445+0000 7f11fe167640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f11f8115470 0x7f11f81234f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.445+0000 7f11fe167640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f11f810fc70 0x7f11f811e120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.445+0000 7f11fe167640 1 --2- 10.20.193.4:0/3006857251 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f11f810f280 0x7f11f811dbe0 unknown :-1 s=CLOSED pgs=449 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.445+0000 7f11fe167640 1 -- 10.20.193.4:0/3006857251 >> 10.20.193.4:0/3006857251 conn(0x7f11f805f830 msgr2=0x7f11f810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.446+0000 7f11fe167640 1 -- 10.20.193.4:0/3006857251 shutdown_connections 2026-02-24T09:09:54.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.446+0000 7f11fe167640 1 -- 10.20.193.4:0/3006857251 wait complete. 2026-02-24T09:09:54.488 INFO:teuthology.orchestra.run.trial004.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2026-02-24T09:09:53.668973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663461,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":263,"num_read_kb":247,"num_write":349,"num_write_kb":3841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":291,"ondisk_log_size":291,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333672,"kb_used_data":10104,"kb_used_omap":377,"kb_used_meta":322950,"kb_avail":8807704728,"statfs":{"total":9019431321600,"available":9019089641472,"internally_reserved":0,"allocated":10346496,"data_stored":6724779,"data_compressed":113181,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":386873,"internal_metadata":330700999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16565,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":58,"num_write":8,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002312"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332664+0000","last_change":"2026-02-24T09:09:25.267627+0000","last_active":"2026-02-24T09:09:26.332664+0000","last_peered":"2026-02-24T09:09:26.332664+0000","last_clean":"2026-02-24T09:09:26.332664+0000","last_became_active":"2026-02-24T09:09:25.267439+0000","last_became_peered":"2026-02-24T09:09:25.267439+0000","last_unstale":"2026-02-24T09:09:26.332664+0000","last_undegraded":"2026-02-24T09:09:26.332664+0000","last_fullsized":"2026-02-24T09:09:26.332664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:24.034680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267727+0000","last_change":"2026-02-24T09:09:25.267299+0000","last_active":"2026-02-24T09:09:26.267727+0000","last_peered":"2026-02-24T09:09:26.267727+0000","last_clean":"2026-02-24T09:09:26.267727+0000","last_became_active":"2026-02-24T09:09:25.266956+0000","last_became_peered":"2026-02-24T09:09:25.266956+0000","last_unstale":"2026-02-24T09:09:26.267727+0000","last_undegraded":"2026-02-24T09:09:26.267727+0000","last_fullsized":"2026-02-24T09:09:26.267727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:05.466777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267738+0000","last_change":"2026-02-24T09:09:25.268761+0000","last_active":"2026-02-24T09:09:26.267738+0000","last_peered":"2026-02-24T09:09:26.267738+0000","last_clean":"2026-02-24T09:09:26.267738+0000","last_became_active":"2026-02-24T09:09:25.268476+0000","last_became_peered":"2026-02-24T09:09:25.268476+0000","last_unstale":"2026-02-24T09:09:26.267738+0000","last_undegraded":"2026-02-24T09:09:26.267738+0000","last_fullsized":"2026-02-24T09:09:26.267738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:26:00.680116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335046+0000","last_change":"2026-02-24T09:09:25.271303+0000","last_active":"2026-02-24T09:09:26.335046+0000","last_peered":"2026-02-24T09:09:26.335046+0000","last_clean":"2026-02-24T09:09:26.335046+0000","last_became_active":"2026-02-24T09:09:25.271175+0000","last_became_peered":"2026-02-24T09:09:25.271175+0000","last_unstale":"2026-02-24T09:09:26.335046+0000","last_undegraded":"2026-02-24T09:09:26.335046+0000","last_fullsized":"2026-02-24T09:09:26.335046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:55:25.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267634+0000","last_change":"2026-02-24T09:09:25.267923+0000","last_active":"2026-02-24T09:09:26.267634+0000","last_peered":"2026-02-24T09:09:26.267634+0000","last_clean":"2026-02-24T09:09:26.267634+0000","last_became_active":"2026-02-24T09:09:25.267775+0000","last_became_peered":"2026-02-24T09:09:25.267775+0000","last_unstale":"2026-02-24T09:09:26.267634+0000","last_undegraded":"2026-02-24T09:09:26.267634+0000","last_fullsized":"2026-02-24T09:09:26.267634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:54:25.575849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270023+0000","last_change":"2026-02-24T09:09:25.269603+0000","last_active":"2026-02-24T09:09:26.270023+0000","last_peered":"2026-02-24T09:09:26.270023+0000","last_clean":"2026-02-24T09:09:26.270023+0000","last_became_active":"2026-02-24T09:09:25.269057+0000","last_became_peered":"2026-02-24T09:09:25.269057+0000","last_unstale":"2026-02-24T09:09:26.270023+0000","last_undegraded":"2026-02-24T09:09:26.270023+0000","last_fullsized":"2026-02-24T09:09:26.270023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:39:21.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733238+0000","last_change":"2026-02-24T09:09:25.270852+0000","last_active":"2026-02-24T09:09:26.733238+0000","last_peered":"2026-02-24T09:09:26.733238+0000","last_clean":"2026-02-24T09:09:26.733238+0000","last_became_active":"2026-02-24T09:09:25.270607+0000","last_became_peered":"2026-02-24T09:09:25.270607+0000","last_unstale":"2026-02-24T09:09:26.733238+0000","last_undegraded":"2026-02-24T09:09:26.733238+0000","last_fullsized":"2026-02-24T09:09:26.733238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:45:43.574810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268619+0000","last_change":"2026-02-24T09:09:25.268833+0000","last_active":"2026-02-24T09:09:26.268619+0000","last_peered":"2026-02-24T09:09:26.268619+0000","last_clean":"2026-02-24T09:09:26.268619+0000","last_became_active":"2026-02-24T09:09:25.268462+0000","last_became_peered":"2026-02-24T09:09:25.268462+0000","last_unstale":"2026-02-24T09:09:26.268619+0000","last_undegraded":"2026-02-24T09:09:26.268619+0000","last_fullsized":"2026-02-24T09:09:26.268619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:47.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334895+0000","last_change":"2026-02-24T09:09:25.271419+0000","last_active":"2026-02-24T09:09:26.334895+0000","last_peered":"2026-02-24T09:09:26.334895+0000","last_clean":"2026-02-24T09:09:26.334895+0000","last_became_active":"2026-02-24T09:09:25.270954+0000","last_became_peered":"2026-02-24T09:09:25.270954+0000","last_unstale":"2026-02-24T09:09:26.334895+0000","last_undegraded":"2026-02-24T09:09:26.334895+0000","last_fullsized":"2026-02-24T09:09:26.334895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:07:15.889565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270286+0000","last_change":"2026-02-24T09:09:25.269709+0000","last_active":"2026-02-24T09:09:26.270286+0000","last_peered":"2026-02-24T09:09:26.270286+0000","last_clean":"2026-02-24T09:09:26.270286+0000","last_became_active":"2026-02-24T09:09:25.269136+0000","last_became_peered":"2026-02-24T09:09:25.269136+0000","last_unstale":"2026-02-24T09:09:26.270286+0000","last_undegraded":"2026-02-24T09:09:26.270286+0000","last_fullsized":"2026-02-24T09:09:26.270286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:42:02.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733508+0000","last_change":"2026-02-24T09:09:25.272025+0000","last_active":"2026-02-24T09:09:26.733508+0000","last_peered":"2026-02-24T09:09:26.733508+0000","last_clean":"2026-02-24T09:09:26.733508+0000","last_became_active":"2026-02-24T09:09:25.271851+0000","last_became_peered":"2026-02-24T09:09:25.271851+0000","last_unstale":"2026-02-24T09:09:26.733508+0000","last_undegraded":"2026-02-24T09:09:26.733508+0000","last_fullsized":"2026-02-24T09:09:26.733508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:49:57.365130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335160+0000","last_change":"2026-02-24T09:09:25.271156+0000","last_active":"2026-02-24T09:09:26.335160+0000","last_peered":"2026-02-24T09:09:26.335160+0000","last_clean":"2026-02-24T09:09:26.335160+0000","last_became_active":"2026-02-24T09:09:25.270992+0000","last_became_peered":"2026-02-24T09:09:25.270992+0000","last_unstale":"2026-02-24T09:09:26.335160+0000","last_undegraded":"2026-02-24T09:09:26.335160+0000","last_fullsized":"2026-02-24T09:09:26.335160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:56.324038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332309+0000","last_change":"2026-02-24T09:09:25.266871+0000","last_active":"2026-02-24T09:09:26.332309+0000","last_peered":"2026-02-24T09:09:26.332309+0000","last_clean":"2026-02-24T09:09:26.332309+0000","last_became_active":"2026-02-24T09:09:25.266438+0000","last_became_peered":"2026-02-24T09:09:25.266438+0000","last_unstale":"2026-02-24T09:09:26.332309+0000","last_undegraded":"2026-02-24T09:09:26.332309+0000","last_fullsized":"2026-02-24T09:09:26.332309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:24:17.014313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267591+0000","last_change":"2026-02-24T09:09:25.266851+0000","last_active":"2026-02-24T09:09:26.267591+0000","last_peered":"2026-02-24T09:09:26.267591+0000","last_clean":"2026-02-24T09:09:26.267591+0000","last_became_active":"2026-02-24T09:09:25.266530+0000","last_became_peered":"2026-02-24T09:09:25.266530+0000","last_unstale":"2026-02-24T09:09:26.267591+0000","last_undegraded":"2026-02-24T09:09:26.267591+0000","last_fullsized":"2026-02-24T09:09:26.267591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:53.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267465+0000","last_change":"2026-02-24T09:09:25.269561+0000","last_active":"2026-02-24T09:09:26.267465+0000","last_peered":"2026-02-24T09:09:26.267465+0000","last_clean":"2026-02-24T09:09:26.267465+0000","last_became_active":"2026-02-24T09:09:25.268979+0000","last_became_peered":"2026-02-24T09:09:25.268979+0000","last_unstale":"2026-02-24T09:09:26.267465+0000","last_undegraded":"2026-02-24T09:09:26.267465+0000","last_fullsized":"2026-02-24T09:09:26.267465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:16:56.110766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334540+0000","last_change":"2026-02-24T09:09:25.271426+0000","last_active":"2026-02-24T09:09:26.334540+0000","last_peered":"2026-02-24T09:09:26.334540+0000","last_clean":"2026-02-24T09:09:26.334540+0000","last_became_active":"2026-02-24T09:09:25.270917+0000","last_became_peered":"2026-02-24T09:09:25.270917+0000","last_unstale":"2026-02-24T09:09:26.334540+0000","last_undegraded":"2026-02-24T09:09:26.334540+0000","last_fullsized":"2026-02-24T09:09:26.334540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:58:52.125871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332673+0000","last_change":"2026-02-24T09:09:25.267238+0000","last_active":"2026-02-24T09:09:26.332673+0000","last_peered":"2026-02-24T09:09:26.332673+0000","last_clean":"2026-02-24T09:09:26.332673+0000","last_became_active":"2026-02-24T09:09:25.267060+0000","last_became_peered":"2026-02-24T09:09:25.267060+0000","last_unstale":"2026-02-24T09:09:26.332673+0000","last_undegraded":"2026-02-24T09:09:26.332673+0000","last_fullsized":"2026-02-24T09:09:26.332673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:00:58.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267495+0000","last_change":"2026-02-24T09:09:25.266005+0000","last_active":"2026-02-24T09:09:26.267495+0000","last_peered":"2026-02-24T09:09:26.267495+0000","last_clean":"2026-02-24T09:09:26.267495+0000","last_became_active":"2026-02-24T09:09:25.265847+0000","last_became_peered":"2026-02-24T09:09:25.265847+0000","last_unstale":"2026-02-24T09:09:26.267495+0000","last_undegraded":"2026-02-24T09:09:26.267495+0000","last_fullsized":"2026-02-24T09:09:26.267495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:29:02.137351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332638+0000","last_change":"2026-02-24T09:09:25.268822+0000","last_active":"2026-02-24T09:09:26.332638+0000","last_peered":"2026-02-24T09:09:26.332638+0000","last_clean":"2026-02-24T09:09:26.332638+0000","last_became_active":"2026-02-24T09:09:25.268683+0000","last_became_peered":"2026-02-24T09:09:25.268683+0000","last_unstale":"2026-02-24T09:09:26.332638+0000","last_undegraded":"2026-02-24T09:09:26.332638+0000","last_fullsized":"2026-02-24T09:09:26.332638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:23:58.256403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332429+0000","last_change":"2026-02-24T09:09:25.266214+0000","last_active":"2026-02-24T09:09:26.332429+0000","last_peered":"2026-02-24T09:09:26.332429+0000","last_clean":"2026-02-24T09:09:26.332429+0000","last_became_active":"2026-02-24T09:09:25.266019+0000","last_became_peered":"2026-02-24T09:09:25.266019+0000","last_unstale":"2026-02-24T09:09:26.332429+0000","last_undegraded":"2026-02-24T09:09:26.332429+0000","last_fullsized":"2026-02-24T09:09:26.332429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:17.141581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332384+0000","last_change":"2026-02-24T09:09:25.267493+0000","last_active":"2026-02-24T09:09:26.332384+0000","last_peered":"2026-02-24T09:09:26.332384+0000","last_clean":"2026-02-24T09:09:26.332384+0000","last_became_active":"2026-02-24T09:09:25.267314+0000","last_became_peered":"2026-02-24T09:09:25.267314+0000","last_unstale":"2026-02-24T09:09:26.332384+0000","last_undegraded":"2026-02-24T09:09:26.332384+0000","last_fullsized":"2026-02-24T09:09:26.332384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:59:11.536214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334717+0000","last_change":"2026-02-24T09:09:25.272131+0000","last_active":"2026-02-24T09:09:26.334717+0000","last_peered":"2026-02-24T09:09:26.334717+0000","last_clean":"2026-02-24T09:09:26.334717+0000","last_became_active":"2026-02-24T09:09:25.271680+0000","last_became_peered":"2026-02-24T09:09:25.271680+0000","last_unstale":"2026-02-24T09:09:26.334717+0000","last_undegraded":"2026-02-24T09:09:26.334717+0000","last_fullsized":"2026-02-24T09:09:26.334717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:07:33.257865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268617+0000","last_change":"2026-02-24T09:09:25.267808+0000","last_active":"2026-02-24T09:09:26.268617+0000","last_peered":"2026-02-24T09:09:26.268617+0000","last_clean":"2026-02-24T09:09:26.268617+0000","last_became_active":"2026-02-24T09:09:25.266759+0000","last_became_peered":"2026-02-24T09:09:25.266759+0000","last_unstale":"2026-02-24T09:09:26.268617+0000","last_undegraded":"2026-02-24T09:09:26.268617+0000","last_fullsized":"2026-02-24T09:09:26.268617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:55.312047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268133+0000","last_change":"2026-02-24T09:09:25.268500+0000","last_active":"2026-02-24T09:09:26.268133+0000","last_peered":"2026-02-24T09:09:26.268133+0000","last_clean":"2026-02-24T09:09:26.268133+0000","last_became_active":"2026-02-24T09:09:25.267904+0000","last_became_peered":"2026-02-24T09:09:25.267904+0000","last_unstale":"2026-02-24T09:09:26.268133+0000","last_undegraded":"2026-02-24T09:09:26.268133+0000","last_fullsized":"2026-02-24T09:09:26.268133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:38:47.330593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269021+0000","last_change":"2026-02-24T09:09:25.269694+0000","last_active":"2026-02-24T09:09:26.269021+0000","last_peered":"2026-02-24T09:09:26.269021+0000","last_clean":"2026-02-24T09:09:26.269021+0000","last_became_active":"2026-02-24T09:09:25.269068+0000","last_became_peered":"2026-02-24T09:09:25.269068+0000","last_unstale":"2026-02-24T09:09:26.269021+0000","last_undegraded":"2026-02-24T09:09:26.269021+0000","last_fullsized":"2026-02-24T09:09:26.269021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:04:44.772275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332668+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.332668+0000","last_peered":"2026-02-24T09:09:26.332668+0000","last_clean":"2026-02-24T09:09:26.332668+0000","last_became_active":"2026-02-24T09:09:25.269534+0000","last_became_peered":"2026-02-24T09:09:25.269534+0000","last_unstale":"2026-02-24T09:09:26.332668+0000","last_undegraded":"2026-02-24T09:09:26.332668+0000","last_fullsized":"2026-02-24T09:09:26.332668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:45:51.428970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332478+0000","last_change":"2026-02-24T09:09:25.266779+0000","last_active":"2026-02-24T09:09:26.332478+0000","last_peered":"2026-02-24T09:09:26.332478+0000","last_clean":"2026-02-24T09:09:26.332478+0000","last_became_active":"2026-02-24T09:09:25.266603+0000","last_became_peered":"2026-02-24T09:09:25.266603+0000","last_unstale":"2026-02-24T09:09:26.332478+0000","last_undegraded":"2026-02-24T09:09:26.332478+0000","last_fullsized":"2026-02-24T09:09:26.332478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:01:38.198458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332295+0000","last_change":"2026-02-24T09:09:25.266933+0000","last_active":"2026-02-24T09:09:26.332295+0000","last_peered":"2026-02-24T09:09:26.332295+0000","last_clean":"2026-02-24T09:09:26.332295+0000","last_became_active":"2026-02-24T09:09:25.266381+0000","last_became_peered":"2026-02-24T09:09:25.266381+0000","last_unstale":"2026-02-24T09:09:26.332295+0000","last_undegraded":"2026-02-24T09:09:26.332295+0000","last_fullsized":"2026-02-24T09:09:26.332295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:45:44.657482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267754+0000","last_change":"2026-02-24T09:09:25.269576+0000","last_active":"2026-02-24T09:09:26.267754+0000","last_peered":"2026-02-24T09:09:26.267754+0000","last_clean":"2026-02-24T09:09:26.267754+0000","last_became_active":"2026-02-24T09:09:25.269159+0000","last_became_peered":"2026-02-24T09:09:25.269159+0000","last_unstale":"2026-02-24T09:09:26.267754+0000","last_undegraded":"2026-02-24T09:09:26.267754+0000","last_fullsized":"2026-02-24T09:09:26.267754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:23:37.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332345+0000","last_change":"2026-02-24T09:09:25.269282+0000","last_active":"2026-02-24T09:09:26.332345+0000","last_peered":"2026-02-24T09:09:26.332345+0000","last_clean":"2026-02-24T09:09:26.332345+0000","last_became_active":"2026-02-24T09:09:25.269088+0000","last_became_peered":"2026-02-24T09:09:25.269088+0000","last_unstale":"2026-02-24T09:09:26.332345+0000","last_undegraded":"2026-02-24T09:09:26.332345+0000","last_fullsized":"2026-02-24T09:09:26.332345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:49.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332404+0000","last_change":"2026-02-24T09:09:25.270968+0000","last_active":"2026-02-24T09:09:26.332404+0000","last_peered":"2026-02-24T09:09:26.332404+0000","last_clean":"2026-02-24T09:09:26.332404+0000","last_became_active":"2026-02-24T09:09:25.270816+0000","last_became_peered":"2026-02-24T09:09:25.270816+0000","last_unstale":"2026-02-24T09:09:26.332404+0000","last_undegraded":"2026-02-24T09:09:26.332404+0000","last_fullsized":"2026-02-24T09:09:26.332404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:10:08.592263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332360+0000","last_change":"2026-02-24T09:09:25.267715+0000","last_active":"2026-02-24T09:09:26.332360+0000","last_peered":"2026-02-24T09:09:26.332360+0000","last_clean":"2026-02-24T09:09:26.332360+0000","last_became_active":"2026-02-24T09:09:25.267031+0000","last_became_peered":"2026-02-24T09:09:25.267031+0000","last_unstale":"2026-02-24T09:09:26.332360+0000","last_undegraded":"2026-02-24T09:09:26.332360+0000","last_fullsized":"2026-02-24T09:09:26.332360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:14:50.568512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267758+0000","last_change":"2026-02-24T09:09:25.268347+0000","last_active":"2026-02-24T09:09:26.267758+0000","last_peered":"2026-02-24T09:09:26.267758+0000","last_clean":"2026-02-24T09:09:26.267758+0000","last_became_active":"2026-02-24T09:09:25.268235+0000","last_became_peered":"2026-02-24T09:09:25.268235+0000","last_unstale":"2026-02-24T09:09:26.267758+0000","last_undegraded":"2026-02-24T09:09:26.267758+0000","last_fullsized":"2026-02-24T09:09:26.267758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:17.309082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:50.958117+0000","last_change":"2026-02-24T09:09:24.256941+0000","last_active":"2026-02-24T09:09:50.958117+0000","last_peered":"2026-02-24T09:09:50.958117+0000","last_clean":"2026-02-24T09:09:50.958117+0000","last_became_active":"2026-02-24T09:09:24.256577+0000","last_became_peered":"2026-02-24T09:09:24.256577+0000","last_unstale":"2026-02-24T09:09:50.958117+0000","last_undegraded":"2026-02-24T09:09:50.958117+0000","last_fullsized":"2026-02-24T09:09:50.958117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:13:19.756549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268000+0000","last_change":"2026-02-24T09:09:25.270452+0000","last_active":"2026-02-24T09:09:26.268000+0000","last_peered":"2026-02-24T09:09:26.268000+0000","last_clean":"2026-02-24T09:09:26.268000+0000","last_became_active":"2026-02-24T09:09:25.270184+0000","last_became_peered":"2026-02-24T09:09:25.270184+0000","last_unstale":"2026-02-24T09:09:26.268000+0000","last_undegraded":"2026-02-24T09:09:26.268000+0000","last_fullsized":"2026-02-24T09:09:26.268000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:07:41.652941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943662+0000","last_change":"2026-02-24T09:09:24.261249+0000","last_active":"2026-02-24T09:09:28.943662+0000","last_peered":"2026-02-24T09:09:28.943662+0000","last_clean":"2026-02-24T09:09:28.943662+0000","last_became_active":"2026-02-24T09:09:24.261064+0000","last_became_peered":"2026-02-24T09:09:24.261064+0000","last_unstale":"2026-02-24T09:09:28.943662+0000","last_undegraded":"2026-02-24T09:09:28.943662+0000","last_fullsized":"2026-02-24T09:09:28.943662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:59:42.964350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941445+0000","last_change":"2026-02-24T09:09:24.254918+0000","last_active":"2026-02-24T09:09:28.941445+0000","last_peered":"2026-02-24T09:09:28.941445+0000","last_clean":"2026-02-24T09:09:28.941445+0000","last_became_active":"2026-02-24T09:09:24.254590+0000","last_became_peered":"2026-02-24T09:09:24.254590+0000","last_unstale":"2026-02-24T09:09:28.941445+0000","last_undegraded":"2026-02-24T09:09:28.941445+0000","last_fullsized":"2026-02-24T09:09:28.941445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:03:19.504844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268666+0000","last_change":"2026-02-24T09:09:25.267204+0000","last_active":"2026-02-24T09:09:26.268666+0000","last_peered":"2026-02-24T09:09:26.268666+0000","last_clean":"2026-02-24T09:09:26.268666+0000","last_became_active":"2026-02-24T09:09:25.266489+0000","last_became_peered":"2026-02-24T09:09:25.266489+0000","last_unstale":"2026-02-24T09:09:26.268666+0000","last_undegraded":"2026-02-24T09:09:26.268666+0000","last_fullsized":"2026-02-24T09:09:26.268666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:26:34.500054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210732+0000","last_change":"2026-02-24T09:09:24.258042+0000","last_active":"2026-02-24T09:09:27.210732+0000","last_peered":"2026-02-24T09:09:27.210732+0000","last_clean":"2026-02-24T09:09:27.210732+0000","last_became_active":"2026-02-24T09:09:24.257801+0000","last_became_peered":"2026-02-24T09:09:24.257801+0000","last_unstale":"2026-02-24T09:09:27.210732+0000","last_undegraded":"2026-02-24T09:09:27.210732+0000","last_fullsized":"2026-02-24T09:09:27.210732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:27.596990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267334+0000","last_change":"2026-02-24T09:09:25.267636+0000","last_active":"2026-02-24T09:09:26.267334+0000","last_peered":"2026-02-24T09:09:26.267334+0000","last_clean":"2026-02-24T09:09:26.267334+0000","last_became_active":"2026-02-24T09:09:25.267505+0000","last_became_peered":"2026-02-24T09:09:25.267505+0000","last_unstale":"2026-02-24T09:09:26.267334+0000","last_undegraded":"2026-02-24T09:09:26.267334+0000","last_fullsized":"2026-02-24T09:09:26.267334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:20.660345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:49.959653+0000","last_change":"2026-02-24T09:09:24.260793+0000","last_active":"2026-02-24T09:09:49.959653+0000","last_peered":"2026-02-24T09:09:49.959653+0000","last_clean":"2026-02-24T09:09:49.959653+0000","last_became_active":"2026-02-24T09:09:24.260555+0000","last_became_peered":"2026-02-24T09:09:24.260555+0000","last_unstale":"2026-02-24T09:09:49.959653+0000","last_undegraded":"2026-02-24T09:09:49.959653+0000","last_fullsized":"2026-02-24T09:09:49.959653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:30:45.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334847+0000","last_change":"2026-02-24T09:09:25.271121+0000","last_active":"2026-02-24T09:09:26.334847+0000","last_peered":"2026-02-24T09:09:26.334847+0000","last_clean":"2026-02-24T09:09:26.334847+0000","last_became_active":"2026-02-24T09:09:25.270770+0000","last_became_peered":"2026-02-24T09:09:25.270770+0000","last_unstale":"2026-02-24T09:09:26.334847+0000","last_undegraded":"2026-02-24T09:09:26.334847+0000","last_fullsized":"2026-02-24T09:09:26.334847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:52:58.451719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940998+0000","last_change":"2026-02-24T09:09:24.259030+0000","last_active":"2026-02-24T09:09:27.940998+0000","last_peered":"2026-02-24T09:09:27.940998+0000","last_clean":"2026-02-24T09:09:27.940998+0000","last_became_active":"2026-02-24T09:09:24.258747+0000","last_became_peered":"2026-02-24T09:09:24.258747+0000","last_unstale":"2026-02-24T09:09:27.940998+0000","last_undegraded":"2026-02-24T09:09:27.940998+0000","last_fullsized":"2026-02-24T09:09:27.940998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:49:46.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267794+0000","last_change":"2026-02-24T09:09:25.269875+0000","last_active":"2026-02-24T09:09:26.267794+0000","last_peered":"2026-02-24T09:09:26.267794+0000","last_clean":"2026-02-24T09:09:26.267794+0000","last_became_active":"2026-02-24T09:09:25.269400+0000","last_became_peered":"2026-02-24T09:09:25.269400+0000","last_unstale":"2026-02-24T09:09:26.267794+0000","last_undegraded":"2026-02-24T09:09:26.267794+0000","last_fullsized":"2026-02-24T09:09:26.267794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:08:29.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938278+0000","last_change":"2026-02-24T09:09:24.256845+0000","last_active":"2026-02-24T09:09:27.938278+0000","last_peered":"2026-02-24T09:09:27.938278+0000","last_clean":"2026-02-24T09:09:27.938278+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:27.938278+0000","last_undegraded":"2026-02-24T09:09:27.938278+0000","last_fullsized":"2026-02-24T09:09:27.938278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:08:15.802226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334785+0000","last_change":"2026-02-24T09:09:25.269608+0000","last_active":"2026-02-24T09:09:26.334785+0000","last_peered":"2026-02-24T09:09:26.334785+0000","last_clean":"2026-02-24T09:09:26.334785+0000","last_became_active":"2026-02-24T09:09:25.268736+0000","last_became_peered":"2026-02-24T09:09:25.268736+0000","last_unstale":"2026-02-24T09:09:26.334785+0000","last_undegraded":"2026-02-24T09:09:26.334785+0000","last_fullsized":"2026-02-24T09:09:26.334785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:39:41.466580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'30","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:50.963515+0000","last_change":"2026-02-24T09:09:24.260591+0000","last_active":"2026-02-24T09:09:50.963515+0000","last_peered":"2026-02-24T09:09:50.963515+0000","last_clean":"2026-02-24T09:09:50.963515+0000","last_became_active":"2026-02-24T09:09:24.260382+0000","last_became_peered":"2026-02-24T09:09:24.260382+0000","last_unstale":"2026-02-24T09:09:50.963515+0000","last_undegraded":"2026-02-24T09:09:50.963515+0000","last_fullsized":"2026-02-24T09:09:50.963515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:05:00.313499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68809,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":94,"num_write":31,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267717+0000","last_change":"2026-02-24T09:09:25.266872+0000","last_active":"2026-02-24T09:09:26.267717+0000","last_peered":"2026-02-24T09:09:26.267717+0000","last_clean":"2026-02-24T09:09:26.267717+0000","last_became_active":"2026-02-24T09:09:25.266720+0000","last_became_peered":"2026-02-24T09:09:25.266720+0000","last_unstale":"2026-02-24T09:09:26.267717+0000","last_undegraded":"2026-02-24T09:09:26.267717+0000","last_fullsized":"2026-02-24T09:09:26.267717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:43.574647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941766+0000","last_change":"2026-02-24T09:09:24.256821+0000","last_active":"2026-02-24T09:09:28.941766+0000","last_peered":"2026-02-24T09:09:28.941766+0000","last_clean":"2026-02-24T09:09:28.941766+0000","last_became_active":"2026-02-24T09:09:24.256284+0000","last_became_peered":"2026-02-24T09:09:24.256284+0000","last_unstale":"2026-02-24T09:09:28.941766+0000","last_undegraded":"2026-02-24T09:09:28.941766+0000","last_fullsized":"2026-02-24T09:09:28.941766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:37:32.352734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332187+0000","last_change":"2026-02-24T09:09:25.268120+0000","last_active":"2026-02-24T09:09:26.332187+0000","last_peered":"2026-02-24T09:09:26.332187+0000","last_clean":"2026-02-24T09:09:26.332187+0000","last_became_active":"2026-02-24T09:09:25.267865+0000","last_became_peered":"2026-02-24T09:09:25.267865+0000","last_unstale":"2026-02-24T09:09:26.332187+0000","last_undegraded":"2026-02-24T09:09:26.332187+0000","last_fullsized":"2026-02-24T09:09:26.332187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:51:18.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938196+0000","last_change":"2026-02-24T09:09:24.257176+0000","last_active":"2026-02-24T09:09:27.938196+0000","last_peered":"2026-02-24T09:09:27.938196+0000","last_clean":"2026-02-24T09:09:27.938196+0000","last_became_active":"2026-02-24T09:09:24.256855+0000","last_became_peered":"2026-02-24T09:09:24.256855+0000","last_unstale":"2026-02-24T09:09:27.938196+0000","last_undegraded":"2026-02-24T09:09:27.938196+0000","last_fullsized":"2026-02-24T09:09:27.938196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:48:25.179774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733497+0000","last_change":"2026-02-24T09:09:25.271913+0000","last_active":"2026-02-24T09:09:26.733497+0000","last_peered":"2026-02-24T09:09:26.733497+0000","last_clean":"2026-02-24T09:09:26.733497+0000","last_became_active":"2026-02-24T09:09:25.271736+0000","last_became_peered":"2026-02-24T09:09:25.271736+0000","last_unstale":"2026-02-24T09:09:26.733497+0000","last_undegraded":"2026-02-24T09:09:26.733497+0000","last_fullsized":"2026-02-24T09:09:26.733497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:49.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:47.961761+0000","last_change":"2026-02-24T09:09:24.259308+0000","last_active":"2026-02-24T09:09:47.961761+0000","last_peered":"2026-02-24T09:09:47.961761+0000","last_clean":"2026-02-24T09:09:47.961761+0000","last_became_active":"2026-02-24T09:09:24.259131+0000","last_became_peered":"2026-02-24T09:09:24.259131+0000","last_unstale":"2026-02-24T09:09:47.961761+0000","last_undegraded":"2026-02-24T09:09:47.961761+0000","last_fullsized":"2026-02-24T09:09:47.961761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:52:00.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733165+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.733165+0000","last_peered":"2026-02-24T09:09:26.733165+0000","last_clean":"2026-02-24T09:09:26.733165+0000","last_became_active":"2026-02-24T09:09:25.269559+0000","last_became_peered":"2026-02-24T09:09:25.269559+0000","last_unstale":"2026-02-24T09:09:26.733165+0000","last_undegraded":"2026-02-24T09:09:26.733165+0000","last_fullsized":"2026-02-24T09:09:26.733165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:06:28.902948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942522+0000","last_change":"2026-02-24T09:09:24.257075+0000","last_active":"2026-02-24T09:09:28.942522+0000","last_peered":"2026-02-24T09:09:28.942522+0000","last_clean":"2026-02-24T09:09:28.942522+0000","last_became_active":"2026-02-24T09:09:24.256738+0000","last_became_peered":"2026-02-24T09:09:24.256738+0000","last_unstale":"2026-02-24T09:09:28.942522+0000","last_undegraded":"2026-02-24T09:09:28.942522+0000","last_fullsized":"2026-02-24T09:09:28.942522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:14.802040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268002+0000","last_change":"2026-02-24T09:09:25.271423+0000","last_active":"2026-02-24T09:09:26.268002+0000","last_peered":"2026-02-24T09:09:26.268002+0000","last_clean":"2026-02-24T09:09:26.268002+0000","last_became_active":"2026-02-24T09:09:25.271142+0000","last_became_peered":"2026-02-24T09:09:25.271142+0000","last_unstale":"2026-02-24T09:09:26.268002+0000","last_undegraded":"2026-02-24T09:09:26.268002+0000","last_fullsized":"2026-02-24T09:09:26.268002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:16.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.940354+0000","last_change":"2026-02-24T09:09:24.258426+0000","last_active":"2026-02-24T09:09:29.940354+0000","last_peered":"2026-02-24T09:09:29.940354+0000","last_clean":"2026-02-24T09:09:29.940354+0000","last_became_active":"2026-02-24T09:09:24.257941+0000","last_became_peered":"2026-02-24T09:09:24.257941+0000","last_unstale":"2026-02-24T09:09:29.940354+0000","last_undegraded":"2026-02-24T09:09:29.940354+0000","last_fullsized":"2026-02-24T09:09:29.940354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:30:29.724001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332552+0000","last_change":"2026-02-24T09:09:25.266758+0000","last_active":"2026-02-24T09:09:26.332552+0000","last_peered":"2026-02-24T09:09:26.332552+0000","last_clean":"2026-02-24T09:09:26.332552+0000","last_became_active":"2026-02-24T09:09:25.266569+0000","last_became_peered":"2026-02-24T09:09:25.266569+0000","last_unstale":"2026-02-24T09:09:26.332552+0000","last_undegraded":"2026-02-24T09:09:26.332552+0000","last_fullsized":"2026-02-24T09:09:26.332552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:13:56.985056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332354+0000","last_change":"2026-02-24T09:09:24.256974+0000","last_active":"2026-02-24T09:09:26.332354+0000","last_peered":"2026-02-24T09:09:26.332354+0000","last_clean":"2026-02-24T09:09:26.332354+0000","last_became_active":"2026-02-24T09:09:24.256617+0000","last_became_peered":"2026-02-24T09:09:24.256617+0000","last_unstale":"2026-02-24T09:09:26.332354+0000","last_undegraded":"2026-02-24T09:09:26.332354+0000","last_fullsized":"2026-02-24T09:09:26.332354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:28.318156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733475+0000","last_change":"2026-02-24T09:09:25.270445+0000","last_active":"2026-02-24T09:09:26.733475+0000","last_peered":"2026-02-24T09:09:26.733475+0000","last_clean":"2026-02-24T09:09:26.733475+0000","last_became_active":"2026-02-24T09:09:25.270275+0000","last_became_peered":"2026-02-24T09:09:25.270275+0000","last_unstale":"2026-02-24T09:09:26.733475+0000","last_undegraded":"2026-02-24T09:09:26.733475+0000","last_fullsized":"2026-02-24T09:09:26.733475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:53:49.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210815+0000","last_change":"2026-02-24T09:09:24.259031+0000","last_active":"2026-02-24T09:09:27.210815+0000","last_peered":"2026-02-24T09:09:27.210815+0000","last_clean":"2026-02-24T09:09:27.210815+0000","last_became_active":"2026-02-24T09:09:24.258899+0000","last_became_peered":"2026-02-24T09:09:24.258899+0000","last_unstale":"2026-02-24T09:09:27.210815+0000","last_undegraded":"2026-02-24T09:09:27.210815+0000","last_fullsized":"2026-02-24T09:09:27.210815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:16.802986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109422+0000","last_change":"2026-02-24T09:09:25.272707+0000","last_active":"2026-02-24T09:09:28.109422+0000","last_peered":"2026-02-24T09:09:28.109422+0000","last_clean":"2026-02-24T09:09:28.109422+0000","last_became_active":"2026-02-24T09:09:25.272563+0000","last_became_peered":"2026-02-24T09:09:25.272563+0000","last_unstale":"2026-02-24T09:09:28.109422+0000","last_undegraded":"2026-02-24T09:09:28.109422+0000","last_fullsized":"2026-02-24T09:09:28.109422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:41:22.895217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942219+0000","last_change":"2026-02-24T09:09:24.256493+0000","last_active":"2026-02-24T09:09:28.942219+0000","last_peered":"2026-02-24T09:09:28.942219+0000","last_clean":"2026-02-24T09:09:28.942219+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:28.942219+0000","last_undegraded":"2026-02-24T09:09:28.942219+0000","last_fullsized":"2026-02-24T09:09:28.942219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:43:12.259841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733528+0000","last_change":"2026-02-24T09:09:25.271977+0000","last_active":"2026-02-24T09:09:26.733528+0000","last_peered":"2026-02-24T09:09:26.733528+0000","last_clean":"2026-02-24T09:09:26.733528+0000","last_became_active":"2026-02-24T09:09:25.271650+0000","last_became_peered":"2026-02-24T09:09:25.271650+0000","last_unstale":"2026-02-24T09:09:26.733528+0000","last_undegraded":"2026-02-24T09:09:26.733528+0000","last_fullsized":"2026-02-24T09:09:26.733528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:10.062115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733207+0000","last_change":"2026-02-24T09:09:05.953512+0000","last_active":"2026-02-24T09:09:26.733207+0000","last_peered":"2026-02-24T09:09:26.733207+0000","last_clean":"2026-02-24T09:09:26.733207+0000","last_became_active":"2026-02-24T09:09:05.953360+0000","last_became_peered":"2026-02-24T09:09:05.953360+0000","last_unstale":"2026-02-24T09:09:26.733207+0000","last_undegraded":"2026-02-24T09:09:26.733207+0000","last_fullsized":"2026-02-24T09:09:26.733207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_clean_scrub_stamp":"2026-02-24T09:08:00.445410+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:48.550493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.945604+0000","last_change":"2026-02-24T09:09:24.259164+0000","last_active":"2026-02-24T09:09:29.945604+0000","last_peered":"2026-02-24T09:09:29.945604+0000","last_clean":"2026-02-24T09:09:29.945604+0000","last_became_active":"2026-02-24T09:09:24.259011+0000","last_became_peered":"2026-02-24T09:09:24.259011+0000","last_unstale":"2026-02-24T09:09:29.945604+0000","last_undegraded":"2026-02-24T09:09:29.945604+0000","last_fullsized":"2026-02-24T09:09:29.945604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:41.649484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268864+0000","last_change":"2026-02-24T09:09:25.269884+0000","last_active":"2026-02-24T09:09:26.268864+0000","last_peered":"2026-02-24T09:09:26.268864+0000","last_clean":"2026-02-24T09:09:26.268864+0000","last_became_active":"2026-02-24T09:09:25.269543+0000","last_became_peered":"2026-02-24T09:09:25.269543+0000","last_unstale":"2026-02-24T09:09:26.268864+0000","last_undegraded":"2026-02-24T09:09:26.268864+0000","last_fullsized":"2026-02-24T09:09:26.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:21:25.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943350+0000","last_change":"2026-02-24T09:09:24.259369+0000","last_active":"2026-02-24T09:09:28.943350+0000","last_peered":"2026-02-24T09:09:28.943350+0000","last_clean":"2026-02-24T09:09:28.943350+0000","last_became_active":"2026-02-24T09:09:24.259086+0000","last_became_peered":"2026-02-24T09:09:24.259086+0000","last_unstale":"2026-02-24T09:09:28.943350+0000","last_undegraded":"2026-02-24T09:09:28.943350+0000","last_fullsized":"2026-02-24T09:09:28.943350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:08.881900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332119+0000","last_change":"2026-02-24T09:09:25.266898+0000","last_active":"2026-02-24T09:09:26.332119+0000","last_peered":"2026-02-24T09:09:26.332119+0000","last_clean":"2026-02-24T09:09:26.332119+0000","last_became_active":"2026-02-24T09:09:25.266407+0000","last_became_peered":"2026-02-24T09:09:25.266407+0000","last_unstale":"2026-02-24T09:09:26.332119+0000","last_undegraded":"2026-02-24T09:09:26.332119+0000","last_fullsized":"2026-02-24T09:09:26.332119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:51.887929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:48.959424+0000","last_change":"2026-02-24T09:09:24.254126+0000","last_active":"2026-02-24T09:09:48.959424+0000","last_peered":"2026-02-24T09:09:48.959424+0000","last_clean":"2026-02-24T09:09:48.959424+0000","last_became_active":"2026-02-24T09:09:24.253911+0000","last_became_peered":"2026-02-24T09:09:24.253911+0000","last_unstale":"2026-02-24T09:09:48.959424+0000","last_undegraded":"2026-02-24T09:09:48.959424+0000","last_fullsized":"2026-02-24T09:09:48.959424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:09:56.146842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268161+0000","last_change":"2026-02-24T09:09:25.270387+0000","last_active":"2026-02-24T09:09:26.268161+0000","last_peered":"2026-02-24T09:09:26.268161+0000","last_clean":"2026-02-24T09:09:26.268161+0000","last_became_active":"2026-02-24T09:09:25.269478+0000","last_became_peered":"2026-02-24T09:09:25.269478+0000","last_unstale":"2026-02-24T09:09:26.268161+0000","last_undegraded":"2026-02-24T09:09:26.268161+0000","last_fullsized":"2026-02-24T09:09:26.268161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:32:15.217221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109411+0000","last_change":"2026-02-24T09:09:24.259169+0000","last_active":"2026-02-24T09:09:28.109411+0000","last_peered":"2026-02-24T09:09:28.109411+0000","last_clean":"2026-02-24T09:09:28.109411+0000","last_became_active":"2026-02-24T09:09:24.258755+0000","last_became_peered":"2026-02-24T09:09:24.258755+0000","last_unstale":"2026-02-24T09:09:28.109411+0000","last_undegraded":"2026-02-24T09:09:28.109411+0000","last_fullsized":"2026-02-24T09:09:28.109411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:33.438504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270152+0000","last_change":"2026-02-24T09:09:25.270732+0000","last_active":"2026-02-24T09:09:26.270152+0000","last_peered":"2026-02-24T09:09:26.270152+0000","last_clean":"2026-02-24T09:09:26.270152+0000","last_became_active":"2026-02-24T09:09:25.270200+0000","last_became_peered":"2026-02-24T09:09:25.270200+0000","last_unstale":"2026-02-24T09:09:26.270152+0000","last_undegraded":"2026-02-24T09:09:26.270152+0000","last_fullsized":"2026-02-24T09:09:26.270152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:59:28.115196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267351+0000","last_change":"2026-02-24T09:09:24.257488+0000","last_active":"2026-02-24T09:09:26.267351+0000","last_peered":"2026-02-24T09:09:26.267351+0000","last_clean":"2026-02-24T09:09:26.267351+0000","last_became_active":"2026-02-24T09:09:24.257202+0000","last_became_peered":"2026-02-24T09:09:24.257202+0000","last_unstale":"2026-02-24T09:09:26.267351+0000","last_undegraded":"2026-02-24T09:09:26.267351+0000","last_fullsized":"2026-02-24T09:09:26.267351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:41:24.345307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.674896+0000","last_change":"2026-02-24T09:09:25.272254+0000","last_active":"2026-02-24T09:09:26.674896+0000","last_peered":"2026-02-24T09:09:26.674896+0000","last_clean":"2026-02-24T09:09:26.674896+0000","last_became_active":"2026-02-24T09:09:25.271674+0000","last_became_peered":"2026-02-24T09:09:25.271674+0000","last_unstale":"2026-02-24T09:09:26.674896+0000","last_undegraded":"2026-02-24T09:09:26.674896+0000","last_fullsized":"2026-02-24T09:09:26.674896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:03:26.493850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938246+0000","last_change":"2026-02-24T09:09:24.257331+0000","last_active":"2026-02-24T09:09:27.938246+0000","last_peered":"2026-02-24T09:09:27.938246+0000","last_clean":"2026-02-24T09:09:27.938246+0000","last_became_active":"2026-02-24T09:09:24.256876+0000","last_became_peered":"2026-02-24T09:09:24.256876+0000","last_unstale":"2026-02-24T09:09:27.938246+0000","last_undegraded":"2026-02-24T09:09:27.938246+0000","last_fullsized":"2026-02-24T09:09:27.938246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:29:58.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332332+0000","last_change":"2026-02-24T09:09:25.266642+0000","last_active":"2026-02-24T09:09:26.332332+0000","last_peered":"2026-02-24T09:09:26.332332+0000","last_clean":"2026-02-24T09:09:26.332332+0000","last_became_active":"2026-02-24T09:09:25.266307+0000","last_became_peered":"2026-02-24T09:09:25.266307+0000","last_unstale":"2026-02-24T09:09:26.332332+0000","last_undegraded":"2026-02-24T09:09:26.332332+0000","last_fullsized":"2026-02-24T09:09:26.332332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:51.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:37.268830+0000","last_change":"2026-02-24T09:09:24.258807+0000","last_active":"2026-02-24T09:09:37.268830+0000","last_peered":"2026-02-24T09:09:37.268830+0000","last_clean":"2026-02-24T09:09:37.268830+0000","last_became_active":"2026-02-24T09:09:24.258649+0000","last_became_peered":"2026-02-24T09:09:24.258649+0000","last_unstale":"2026-02-24T09:09:37.268830+0000","last_undegraded":"2026-02-24T09:09:37.268830+0000","last_fullsized":"2026-02-24T09:09:37.268830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:10:48.348275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269009+0000","last_change":"2026-02-24T09:09:25.268491+0000","last_active":"2026-02-24T09:09:26.269009+0000","last_peered":"2026-02-24T09:09:26.269009+0000","last_clean":"2026-02-24T09:09:26.269009+0000","last_became_active":"2026-02-24T09:09:25.267341+0000","last_became_peered":"2026-02-24T09:09:25.267341+0000","last_unstale":"2026-02-24T09:09:26.269009+0000","last_undegraded":"2026-02-24T09:09:26.269009+0000","last_fullsized":"2026-02-24T09:09:26.269009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:18:29.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940964+0000","last_change":"2026-02-24T09:09:24.258484+0000","last_active":"2026-02-24T09:09:27.940964+0000","last_peered":"2026-02-24T09:09:27.940964+0000","last_clean":"2026-02-24T09:09:27.940964+0000","last_became_active":"2026-02-24T09:09:24.258249+0000","last_became_peered":"2026-02-24T09:09:24.258249+0000","last_unstale":"2026-02-24T09:09:27.940964+0000","last_undegraded":"2026-02-24T09:09:27.940964+0000","last_fullsized":"2026-02-24T09:09:27.940964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:32:56.722522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267783+0000","last_change":"2026-02-24T09:09:25.269738+0000","last_active":"2026-02-24T09:09:26.267783+0000","last_peered":"2026-02-24T09:09:26.267783+0000","last_clean":"2026-02-24T09:09:26.267783+0000","last_became_active":"2026-02-24T09:09:25.269413+0000","last_became_peered":"2026-02-24T09:09:25.269413+0000","last_unstale":"2026-02-24T09:09:26.267783+0000","last_undegraded":"2026-02-24T09:09:26.267783+0000","last_fullsized":"2026-02-24T09:09:26.267783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:00.412570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941334+0000","last_change":"2026-02-24T09:09:24.258901+0000","last_active":"2026-02-24T09:09:27.941334+0000","last_peered":"2026-02-24T09:09:27.941334+0000","last_clean":"2026-02-24T09:09:27.941334+0000","last_became_active":"2026-02-24T09:09:24.258325+0000","last_became_peered":"2026-02-24T09:09:24.258325+0000","last_unstale":"2026-02-24T09:09:27.941334+0000","last_undegraded":"2026-02-24T09:09:27.941334+0000","last_fullsized":"2026-02-24T09:09:27.941334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:36.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267522+0000","last_change":"2026-02-24T09:09:25.267368+0000","last_active":"2026-02-24T09:09:26.267522+0000","last_peered":"2026-02-24T09:09:26.267522+0000","last_clean":"2026-02-24T09:09:26.267522+0000","last_became_active":"2026-02-24T09:09:25.267168+0000","last_became_peered":"2026-02-24T09:09:25.267168+0000","last_unstale":"2026-02-24T09:09:26.267522+0000","last_undegraded":"2026-02-24T09:09:26.267522+0000","last_fullsized":"2026-02-24T09:09:26.267522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:57.616866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.939140+0000","last_change":"2026-02-24T09:09:24.257345+0000","last_active":"2026-02-24T09:09:27.939140+0000","last_peered":"2026-02-24T09:09:27.939140+0000","last_clean":"2026-02-24T09:09:27.939140+0000","last_became_active":"2026-02-24T09:09:24.256817+0000","last_became_peered":"2026-02-24T09:09:24.256817+0000","last_unstale":"2026-02-24T09:09:27.939140+0000","last_undegraded":"2026-02-24T09:09:27.939140+0000","last_fullsized":"2026-02-24T09:09:27.939140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:37:48.042471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332527+0000","last_change":"2026-02-24T09:09:25.267778+0000","last_active":"2026-02-24T09:09:26.332527+0000","last_peered":"2026-02-24T09:09:26.332527+0000","last_clean":"2026-02-24T09:09:26.332527+0000","last_became_active":"2026-02-24T09:09:25.267379+0000","last_became_peered":"2026-02-24T09:09:25.267379+0000","last_unstale":"2026-02-24T09:09:26.332527+0000","last_undegraded":"2026-02-24T09:09:26.332527+0000","last_fullsized":"2026-02-24T09:09:26.332527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:25:47.194857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.121396+0000","last_change":"2026-02-24T09:09:24.259141+0000","last_active":"2026-02-24T09:09:28.121396+0000","last_peered":"2026-02-24T09:09:28.121396+0000","last_clean":"2026-02-24T09:09:28.121396+0000","last_became_active":"2026-02-24T09:09:24.258981+0000","last_became_peered":"2026-02-24T09:09:24.258981+0000","last_unstale":"2026-02-24T09:09:28.121396+0000","last_undegraded":"2026-02-24T09:09:28.121396+0000","last_fullsized":"2026-02-24T09:09:28.121396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:48.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268774+0000","last_change":"2026-02-24T09:09:25.268540+0000","last_active":"2026-02-24T09:09:26.268774+0000","last_peered":"2026-02-24T09:09:26.268774+0000","last_clean":"2026-02-24T09:09:26.268774+0000","last_became_active":"2026-02-24T09:09:25.267915+0000","last_became_peered":"2026-02-24T09:09:25.267915+0000","last_unstale":"2026-02-24T09:09:26.268774+0000","last_undegraded":"2026-02-24T09:09:26.268774+0000","last_fullsized":"2026-02-24T09:09:26.268774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:55.564971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938005+0000","last_change":"2026-02-24T09:09:24.257964+0000","last_active":"2026-02-24T09:09:27.938005+0000","last_peered":"2026-02-24T09:09:27.938005+0000","last_clean":"2026-02-24T09:09:27.938005+0000","last_became_active":"2026-02-24T09:09:24.257717+0000","last_became_peered":"2026-02-24T09:09:24.257717+0000","last_unstale":"2026-02-24T09:09:27.938005+0000","last_undegraded":"2026-02-24T09:09:27.938005+0000","last_fullsized":"2026-02-24T09:09:27.938005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:23:24.989893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733433+0000","last_change":"2026-02-24T09:09:25.271214+0000","last_active":"2026-02-24T09:09:26.733433+0000","last_peered":"2026-02-24T09:09:26.733433+0000","last_clean":"2026-02-24T09:09:26.733433+0000","last_became_active":"2026-02-24T09:09:25.271038+0000","last_became_peered":"2026-02-24T09:09:25.271038+0000","last_unstale":"2026-02-24T09:09:26.733433+0000","last_undegraded":"2026-02-24T09:09:26.733433+0000","last_fullsized":"2026-02-24T09:09:26.733433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:58:44.899837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268097+0000","last_change":"2026-02-24T09:09:25.269834+0000","last_active":"2026-02-24T09:09:26.268097+0000","last_peered":"2026-02-24T09:09:26.268097+0000","last_clean":"2026-02-24T09:09:26.268097+0000","last_became_active":"2026-02-24T09:09:25.269526+0000","last_became_peered":"2026-02-24T09:09:25.269526+0000","last_unstale":"2026-02-24T09:09:26.268097+0000","last_undegraded":"2026-02-24T09:09:26.268097+0000","last_fullsized":"2026-02-24T09:09:26.268097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:36:54.610640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267687+0000","last_change":"2026-02-24T09:09:24.258597+0000","last_active":"2026-02-24T09:09:26.267687+0000","last_peered":"2026-02-24T09:09:26.267687+0000","last_clean":"2026-02-24T09:09:26.267687+0000","last_became_active":"2026-02-24T09:09:24.258302+0000","last_became_peered":"2026-02-24T09:09:24.258302+0000","last_unstale":"2026-02-24T09:09:26.267687+0000","last_undegraded":"2026-02-24T09:09:26.267687+0000","last_fullsized":"2026-02-24T09:09:26.267687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:20:15.556479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334746+0000","last_change":"2026-02-24T09:09:25.269804+0000","last_active":"2026-02-24T09:09:26.334746+0000","last_peered":"2026-02-24T09:09:26.334746+0000","last_clean":"2026-02-24T09:09:26.334746+0000","last_became_active":"2026-02-24T09:09:25.268973+0000","last_became_peered":"2026-02-24T09:09:25.268973+0000","last_unstale":"2026-02-24T09:09:26.334746+0000","last_undegraded":"2026-02-24T09:09:26.334746+0000","last_fullsized":"2026-02-24T09:09:26.334746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:33:39.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942003+0000","last_change":"2026-02-24T09:09:24.257428+0000","last_active":"2026-02-24T09:09:28.942003+0000","last_peered":"2026-02-24T09:09:28.942003+0000","last_clean":"2026-02-24T09:09:28.942003+0000","last_became_active":"2026-02-24T09:09:24.256679+0000","last_became_peered":"2026-02-24T09:09:24.256679+0000","last_unstale":"2026-02-24T09:09:28.942003+0000","last_undegraded":"2026-02-24T09:09:28.942003+0000","last_fullsized":"2026-02-24T09:09:28.942003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:39:28.664820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267792+0000","last_change":"2026-02-24T09:09:25.268127+0000","last_active":"2026-02-24T09:09:26.267792+0000","last_peered":"2026-02-24T09:09:26.267792+0000","last_clean":"2026-02-24T09:09:26.267792+0000","last_became_active":"2026-02-24T09:09:25.267860+0000","last_became_peered":"2026-02-24T09:09:25.267860+0000","last_unstale":"2026-02-24T09:09:26.267792+0000","last_undegraded":"2026-02-24T09:09:26.267792+0000","last_fullsized":"2026-02-24T09:09:26.267792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:37:52.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269053+0000","last_change":"2026-02-24T09:09:24.257552+0000","last_active":"2026-02-24T09:09:26.269053+0000","last_peered":"2026-02-24T09:09:26.269053+0000","last_clean":"2026-02-24T09:09:26.269053+0000","last_became_active":"2026-02-24T09:09:24.257163+0000","last_became_peered":"2026-02-24T09:09:24.257163+0000","last_unstale":"2026-02-24T09:09:26.269053+0000","last_undegraded":"2026-02-24T09:09:26.269053+0000","last_fullsized":"2026-02-24T09:09:26.269053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:30:54.285800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268961+0000","last_change":"2026-02-24T09:09:25.268695+0000","last_active":"2026-02-24T09:09:26.268961+0000","last_peered":"2026-02-24T09:09:26.268961+0000","last_clean":"2026-02-24T09:09:26.268961+0000","last_became_active":"2026-02-24T09:09:25.268128+0000","last_became_peered":"2026-02-24T09:09:25.268128+0000","last_unstale":"2026-02-24T09:09:26.268961+0000","last_undegraded":"2026-02-24T09:09:26.268961+0000","last_fullsized":"2026-02-24T09:09:26.268961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:23.987958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942226+0000","last_change":"2026-02-24T09:09:24.257602+0000","last_active":"2026-02-24T09:09:28.942226+0000","last_peered":"2026-02-24T09:09:28.942226+0000","last_clean":"2026-02-24T09:09:28.942226+0000","last_became_active":"2026-02-24T09:09:24.257440+0000","last_became_peered":"2026-02-24T09:09:24.257440+0000","last_unstale":"2026-02-24T09:09:28.942226+0000","last_undegraded":"2026-02-24T09:09:28.942226+0000","last_fullsized":"2026-02-24T09:09:28.942226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:13:51.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72859,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":157,"num_read_kb":156,"num_write":158,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":218577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119920,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":259322,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710732,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":395125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":27582038},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939660,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27916,"kb_used_data":952,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975284,"statfs":{"total":751619276800,"available":751590690816,"internally_reserved":0,"allocated":974848,"data_stored":1055825,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23856,"internal_metadata":27566800},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070478,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24845,"internal_metadata":27565811},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299407,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32956,"internal_metadata":27557700},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528338,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":987230,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28867,"internal_metadata":27561789},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659155,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":394740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888084,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":986504,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":32062,"internal_metadata":27558594},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018901,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31416,"internal_metadata":27559240},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247832,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":395051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47059,"internal_metadata":27543597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476761,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27856,"kb_used_data":892,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975344,"statfs":{"total":751619276800,"available":751590752256,"internally_reserved":0,"allocated":913408,"data_stored":464702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34581,"internal_metadata":27556075},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607578,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27832,"kb_used_data":868,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975368,"statfs":{"total":751619276800,"available":751590776832,"internally_reserved":0,"allocated":888832,"data_stored":463342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49917,"internal_metadata":27540739},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11012,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":70169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12011,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13952,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6329,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13842,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3422,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31362,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9492,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13536,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:09:54.495 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T09:09:54.495 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T09:09:54.644 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.737+0000 7f5738340640 1 -- 10.20.193.4:0/3200578046 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5730115470 msgr2=0x7f5730175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.737+0000 7f5738340640 1 --2- 10.20.193.4:0/3200578046 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5730115470 0x7f5730175e40 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=12460206382157934448 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f572c00aa30 tx=0x7f572c030280 comp rx=0 tx=0).stop 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.737+0000 7f5738340640 1 -- 10.20.193.4:0/3200578046 shutdown_connections 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.737+0000 7f5738340640 1 --2- 10.20.193.4:0/3200578046 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5730115470 0x7f5730175e40 unknown :-1 s=CLOSED pgs=450 gs=1 cs=0 l=1 c_cookie=12460206382157934448 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.737+0000 7f5738340640 1 --2- 10.20.193.4:0/3200578046 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f573010fc70 0x7f5730114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.737+0000 7f5738340640 1 --2- 10.20.193.4:0/3200578046 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f573010f280 0x7f573010f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.737+0000 7f5738340640 1 -- 10.20.193.4:0/3200578046 >> 10.20.193.4:0/3200578046 conn(0x7f573005f830 msgr2=0x7f573010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.737+0000 7f5738340640 1 -- 10.20.193.4:0/3200578046 shutdown_connections 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.737+0000 7f5738340640 1 -- 10.20.193.4:0/3200578046 wait complete. 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f5738340640 1 Processor -- start 2026-02-24T09:09:54.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f5738340640 1 -- start start 2026-02-24T09:09:54.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f5738340640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f573010f280 0x7f573011db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f5738340640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f573010fc70 0x7f573011e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f5738340640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5730115470 0x7f5730123480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f5738340640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f5730123aa0 con 0x7f573010fc70 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f5738340640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f5730123c10 con 0x7f573010f280 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f5738340640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5730123dd0 con 0x7f5730115470 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57358b4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f573010fc70 0x7f573011e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57358b4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f573010fc70 0x7f573011e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50738/0 (socket says 10.20.193.4:50738) 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57358b4640 1 -- 10.20.193.4:0/2343241706 learned_addr learned my addr 10.20.193.4:0/2343241706 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57368b6640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5730115470 0x7f5730123480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57360b5640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f573010f280 0x7f573011db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57358b4640 1 -- 10.20.193.4:0/2343241706 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5730115470 msgr2=0x7f5730123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57358b4640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5730115470 0x7f5730123480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57358b4640 1 -- 10.20.193.4:0/2343241706 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f573010f280 msgr2=0x7f573011db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57358b4640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f573010f280 0x7f573011db70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57358b4640 1 -- 10.20.193.4:0/2343241706 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572c00a650 con 0x7f573010fc70 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57360b5640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f573010f280 0x7f573011db70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:54.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.738+0000 7f57358b4640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f573010fc70 0x7f573011e0b0 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f572400d950 tx=0x7f572400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:54.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.741+0000 7f57177fe640 1 -- 10.20.193.4:0/2343241706 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5724004540 con 0x7f573010fc70 2026-02-24T09:09:54.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.741+0000 7f57177fe640 1 -- 10.20.193.4:0/2343241706 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5724009d00 con 0x7f573010fc70 2026-02-24T09:09:54.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.741+0000 7f5738340640 1 -- 10.20.193.4:0/2343241706 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57301240b0 con 0x7f573010fc70 2026-02-24T09:09:54.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.741+0000 7f57177fe640 1 -- 10.20.193.4:0/2343241706 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57240106e0 con 0x7f573010fc70 2026-02-24T09:09:54.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.741+0000 7f5738340640 1 -- 10.20.193.4:0/2343241706 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57301647b0 con 0x7f573010fc70 2026-02-24T09:09:54.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.741+0000 7f5738340640 1 -- 10.20.193.4:0/2343241706 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5730110560 con 0x7f573010fc70 2026-02-24T09:09:54.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.743+0000 7f57177fe640 1 -- 10.20.193.4:0/2343241706 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f57240097c0 con 0x7f573010fc70 2026-02-24T09:09:54.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.743+0000 7f57177fe640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f570c0b5770 0x7f570c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:54.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.744+0000 7f57360b5640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f570c0b5770 0x7f570c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:54.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.744+0000 7f57177fe640 1 -- 10.20.193.4:0/2343241706 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f57240e72f0 con 0x7f573010fc70 2026-02-24T09:09:54.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.744+0000 7f57360b5640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f570c0b5770 0x7f570c0d5c20 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5720004740 tx=0x7f5720005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:54.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.744+0000 7f57177fe640 1 -- 10.20.193.4:0/2343241706 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f57240a9c40 con 0x7f573010fc70 2026-02-24T09:09:54.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.847+0000 7f5738340640 1 -- 10.20.193.4:0/2343241706 --> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f573011ecd0 con 0x7f570c0b5770 2026-02-24T09:09:54.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.850+0000 7f57177fe640 1 -- 10.20.193.4:0/2343241706 <== mgr.14152 v2:10.20.193.4:6800/2848002115 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7f573011ecd0 con 0x7f570c0b5770 2026-02-24T09:09:54.855 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:54.856 INFO:teuthology.orchestra.run.trial004.stderr:dumped all 2026-02-24T09:09:54.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 -- 10.20.193.4:0/2343241706 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f570c0b5770 msgr2=0x7f570c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f570c0b5770 0x7f570c0d5c20 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5720004740 tx=0x7f5720005f00 comp rx=0 tx=0).stop 2026-02-24T09:09:54.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 -- 10.20.193.4:0/2343241706 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f573010fc70 msgr2=0x7f573011e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:54.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f573010fc70 0x7f573011e0b0 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f572400d950 tx=0x7f572400de20 comp rx=0 tx=0).stop 2026-02-24T09:09:54.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 -- 10.20.193.4:0/2343241706 shutdown_connections 2026-02-24T09:09:54.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f570c0b5770 0x7f570c0d5c20 unknown :-1 s=CLOSED pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5730115470 0x7f5730123480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f573010fc70 0x7f573011e0b0 unknown :-1 s=CLOSED pgs=451 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 --2- 10.20.193.4:0/2343241706 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f573010f280 0x7f573011db70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:54.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 -- 10.20.193.4:0/2343241706 >> 10.20.193.4:0/2343241706 conn(0x7f573005f830 msgr2=0x7f573010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:54.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 -- 10.20.193.4:0/2343241706 shutdown_connections 2026-02-24T09:09:54.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:54.851+0000 7f5738340640 1 -- 10.20.193.4:0/2343241706 wait complete. 2026-02-24T09:09:54.893 INFO:teuthology.orchestra.run.trial004.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2026-02-24T09:09:53.668973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663461,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":263,"num_read_kb":247,"num_write":349,"num_write_kb":3841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":291,"ondisk_log_size":291,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333672,"kb_used_data":10104,"kb_used_omap":377,"kb_used_meta":322950,"kb_avail":8807704728,"statfs":{"total":9019431321600,"available":9019089641472,"internally_reserved":0,"allocated":10346496,"data_stored":6724779,"data_compressed":113181,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":386873,"internal_metadata":330700999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16565,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":58,"num_write":8,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002312"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332664+0000","last_change":"2026-02-24T09:09:25.267627+0000","last_active":"2026-02-24T09:09:26.332664+0000","last_peered":"2026-02-24T09:09:26.332664+0000","last_clean":"2026-02-24T09:09:26.332664+0000","last_became_active":"2026-02-24T09:09:25.267439+0000","last_became_peered":"2026-02-24T09:09:25.267439+0000","last_unstale":"2026-02-24T09:09:26.332664+0000","last_undegraded":"2026-02-24T09:09:26.332664+0000","last_fullsized":"2026-02-24T09:09:26.332664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:24.034680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267727+0000","last_change":"2026-02-24T09:09:25.267299+0000","last_active":"2026-02-24T09:09:26.267727+0000","last_peered":"2026-02-24T09:09:26.267727+0000","last_clean":"2026-02-24T09:09:26.267727+0000","last_became_active":"2026-02-24T09:09:25.266956+0000","last_became_peered":"2026-02-24T09:09:25.266956+0000","last_unstale":"2026-02-24T09:09:26.267727+0000","last_undegraded":"2026-02-24T09:09:26.267727+0000","last_fullsized":"2026-02-24T09:09:26.267727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:10:05.466777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267738+0000","last_change":"2026-02-24T09:09:25.268761+0000","last_active":"2026-02-24T09:09:26.267738+0000","last_peered":"2026-02-24T09:09:26.267738+0000","last_clean":"2026-02-24T09:09:26.267738+0000","last_became_active":"2026-02-24T09:09:25.268476+0000","last_became_peered":"2026-02-24T09:09:25.268476+0000","last_unstale":"2026-02-24T09:09:26.267738+0000","last_undegraded":"2026-02-24T09:09:26.267738+0000","last_fullsized":"2026-02-24T09:09:26.267738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:26:00.680116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335046+0000","last_change":"2026-02-24T09:09:25.271303+0000","last_active":"2026-02-24T09:09:26.335046+0000","last_peered":"2026-02-24T09:09:26.335046+0000","last_clean":"2026-02-24T09:09:26.335046+0000","last_became_active":"2026-02-24T09:09:25.271175+0000","last_became_peered":"2026-02-24T09:09:25.271175+0000","last_unstale":"2026-02-24T09:09:26.335046+0000","last_undegraded":"2026-02-24T09:09:26.335046+0000","last_fullsized":"2026-02-24T09:09:26.335046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:55:25.491769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267634+0000","last_change":"2026-02-24T09:09:25.267923+0000","last_active":"2026-02-24T09:09:26.267634+0000","last_peered":"2026-02-24T09:09:26.267634+0000","last_clean":"2026-02-24T09:09:26.267634+0000","last_became_active":"2026-02-24T09:09:25.267775+0000","last_became_peered":"2026-02-24T09:09:25.267775+0000","last_unstale":"2026-02-24T09:09:26.267634+0000","last_undegraded":"2026-02-24T09:09:26.267634+0000","last_fullsized":"2026-02-24T09:09:26.267634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:54:25.575849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270023+0000","last_change":"2026-02-24T09:09:25.269603+0000","last_active":"2026-02-24T09:09:26.270023+0000","last_peered":"2026-02-24T09:09:26.270023+0000","last_clean":"2026-02-24T09:09:26.270023+0000","last_became_active":"2026-02-24T09:09:25.269057+0000","last_became_peered":"2026-02-24T09:09:25.269057+0000","last_unstale":"2026-02-24T09:09:26.270023+0000","last_undegraded":"2026-02-24T09:09:26.270023+0000","last_fullsized":"2026-02-24T09:09:26.270023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:39:21.379774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733238+0000","last_change":"2026-02-24T09:09:25.270852+0000","last_active":"2026-02-24T09:09:26.733238+0000","last_peered":"2026-02-24T09:09:26.733238+0000","last_clean":"2026-02-24T09:09:26.733238+0000","last_became_active":"2026-02-24T09:09:25.270607+0000","last_became_peered":"2026-02-24T09:09:25.270607+0000","last_unstale":"2026-02-24T09:09:26.733238+0000","last_undegraded":"2026-02-24T09:09:26.733238+0000","last_fullsized":"2026-02-24T09:09:26.733238+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:45:43.574810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268619+0000","last_change":"2026-02-24T09:09:25.268833+0000","last_active":"2026-02-24T09:09:26.268619+0000","last_peered":"2026-02-24T09:09:26.268619+0000","last_clean":"2026-02-24T09:09:26.268619+0000","last_became_active":"2026-02-24T09:09:25.268462+0000","last_became_peered":"2026-02-24T09:09:25.268462+0000","last_unstale":"2026-02-24T09:09:26.268619+0000","last_undegraded":"2026-02-24T09:09:26.268619+0000","last_fullsized":"2026-02-24T09:09:26.268619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:47.759755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334895+0000","last_change":"2026-02-24T09:09:25.271419+0000","last_active":"2026-02-24T09:09:26.334895+0000","last_peered":"2026-02-24T09:09:26.334895+0000","last_clean":"2026-02-24T09:09:26.334895+0000","last_became_active":"2026-02-24T09:09:25.270954+0000","last_became_peered":"2026-02-24T09:09:25.270954+0000","last_unstale":"2026-02-24T09:09:26.334895+0000","last_undegraded":"2026-02-24T09:09:26.334895+0000","last_fullsized":"2026-02-24T09:09:26.334895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:07:15.889565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270286+0000","last_change":"2026-02-24T09:09:25.269709+0000","last_active":"2026-02-24T09:09:26.270286+0000","last_peered":"2026-02-24T09:09:26.270286+0000","last_clean":"2026-02-24T09:09:26.270286+0000","last_became_active":"2026-02-24T09:09:25.269136+0000","last_became_peered":"2026-02-24T09:09:25.269136+0000","last_unstale":"2026-02-24T09:09:26.270286+0000","last_undegraded":"2026-02-24T09:09:26.270286+0000","last_fullsized":"2026-02-24T09:09:26.270286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:42:02.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733508+0000","last_change":"2026-02-24T09:09:25.272025+0000","last_active":"2026-02-24T09:09:26.733508+0000","last_peered":"2026-02-24T09:09:26.733508+0000","last_clean":"2026-02-24T09:09:26.733508+0000","last_became_active":"2026-02-24T09:09:25.271851+0000","last_became_peered":"2026-02-24T09:09:25.271851+0000","last_unstale":"2026-02-24T09:09:26.733508+0000","last_undegraded":"2026-02-24T09:09:26.733508+0000","last_fullsized":"2026-02-24T09:09:26.733508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:49:57.365130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.335160+0000","last_change":"2026-02-24T09:09:25.271156+0000","last_active":"2026-02-24T09:09:26.335160+0000","last_peered":"2026-02-24T09:09:26.335160+0000","last_clean":"2026-02-24T09:09:26.335160+0000","last_became_active":"2026-02-24T09:09:25.270992+0000","last_became_peered":"2026-02-24T09:09:25.270992+0000","last_unstale":"2026-02-24T09:09:26.335160+0000","last_undegraded":"2026-02-24T09:09:26.335160+0000","last_fullsized":"2026-02-24T09:09:26.335160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:56.324038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332309+0000","last_change":"2026-02-24T09:09:25.266871+0000","last_active":"2026-02-24T09:09:26.332309+0000","last_peered":"2026-02-24T09:09:26.332309+0000","last_clean":"2026-02-24T09:09:26.332309+0000","last_became_active":"2026-02-24T09:09:25.266438+0000","last_became_peered":"2026-02-24T09:09:25.266438+0000","last_unstale":"2026-02-24T09:09:26.332309+0000","last_undegraded":"2026-02-24T09:09:26.332309+0000","last_fullsized":"2026-02-24T09:09:26.332309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:24:17.014313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267591+0000","last_change":"2026-02-24T09:09:25.266851+0000","last_active":"2026-02-24T09:09:26.267591+0000","last_peered":"2026-02-24T09:09:26.267591+0000","last_clean":"2026-02-24T09:09:26.267591+0000","last_became_active":"2026-02-24T09:09:25.266530+0000","last_became_peered":"2026-02-24T09:09:25.266530+0000","last_unstale":"2026-02-24T09:09:26.267591+0000","last_undegraded":"2026-02-24T09:09:26.267591+0000","last_fullsized":"2026-02-24T09:09:26.267591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:44:53.356890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267465+0000","last_change":"2026-02-24T09:09:25.269561+0000","last_active":"2026-02-24T09:09:26.267465+0000","last_peered":"2026-02-24T09:09:26.267465+0000","last_clean":"2026-02-24T09:09:26.267465+0000","last_became_active":"2026-02-24T09:09:25.268979+0000","last_became_peered":"2026-02-24T09:09:25.268979+0000","last_unstale":"2026-02-24T09:09:26.267465+0000","last_undegraded":"2026-02-24T09:09:26.267465+0000","last_fullsized":"2026-02-24T09:09:26.267465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:16:56.110766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334540+0000","last_change":"2026-02-24T09:09:25.271426+0000","last_active":"2026-02-24T09:09:26.334540+0000","last_peered":"2026-02-24T09:09:26.334540+0000","last_clean":"2026-02-24T09:09:26.334540+0000","last_became_active":"2026-02-24T09:09:25.270917+0000","last_became_peered":"2026-02-24T09:09:25.270917+0000","last_unstale":"2026-02-24T09:09:26.334540+0000","last_undegraded":"2026-02-24T09:09:26.334540+0000","last_fullsized":"2026-02-24T09:09:26.334540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:58:52.125871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332673+0000","last_change":"2026-02-24T09:09:25.267238+0000","last_active":"2026-02-24T09:09:26.332673+0000","last_peered":"2026-02-24T09:09:26.332673+0000","last_clean":"2026-02-24T09:09:26.332673+0000","last_became_active":"2026-02-24T09:09:25.267060+0000","last_became_peered":"2026-02-24T09:09:25.267060+0000","last_unstale":"2026-02-24T09:09:26.332673+0000","last_undegraded":"2026-02-24T09:09:26.332673+0000","last_fullsized":"2026-02-24T09:09:26.332673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:00:58.985150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267495+0000","last_change":"2026-02-24T09:09:25.266005+0000","last_active":"2026-02-24T09:09:26.267495+0000","last_peered":"2026-02-24T09:09:26.267495+0000","last_clean":"2026-02-24T09:09:26.267495+0000","last_became_active":"2026-02-24T09:09:25.265847+0000","last_became_peered":"2026-02-24T09:09:25.265847+0000","last_unstale":"2026-02-24T09:09:26.267495+0000","last_undegraded":"2026-02-24T09:09:26.267495+0000","last_fullsized":"2026-02-24T09:09:26.267495+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:29:02.137351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332638+0000","last_change":"2026-02-24T09:09:25.268822+0000","last_active":"2026-02-24T09:09:26.332638+0000","last_peered":"2026-02-24T09:09:26.332638+0000","last_clean":"2026-02-24T09:09:26.332638+0000","last_became_active":"2026-02-24T09:09:25.268683+0000","last_became_peered":"2026-02-24T09:09:25.268683+0000","last_unstale":"2026-02-24T09:09:26.332638+0000","last_undegraded":"2026-02-24T09:09:26.332638+0000","last_fullsized":"2026-02-24T09:09:26.332638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:23:58.256403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332429+0000","last_change":"2026-02-24T09:09:25.266214+0000","last_active":"2026-02-24T09:09:26.332429+0000","last_peered":"2026-02-24T09:09:26.332429+0000","last_clean":"2026-02-24T09:09:26.332429+0000","last_became_active":"2026-02-24T09:09:25.266019+0000","last_became_peered":"2026-02-24T09:09:25.266019+0000","last_unstale":"2026-02-24T09:09:26.332429+0000","last_undegraded":"2026-02-24T09:09:26.332429+0000","last_fullsized":"2026-02-24T09:09:26.332429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:17.141581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332384+0000","last_change":"2026-02-24T09:09:25.267493+0000","last_active":"2026-02-24T09:09:26.332384+0000","last_peered":"2026-02-24T09:09:26.332384+0000","last_clean":"2026-02-24T09:09:26.332384+0000","last_became_active":"2026-02-24T09:09:25.267314+0000","last_became_peered":"2026-02-24T09:09:25.267314+0000","last_unstale":"2026-02-24T09:09:26.332384+0000","last_undegraded":"2026-02-24T09:09:26.332384+0000","last_fullsized":"2026-02-24T09:09:26.332384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:59:11.536214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334717+0000","last_change":"2026-02-24T09:09:25.272131+0000","last_active":"2026-02-24T09:09:26.334717+0000","last_peered":"2026-02-24T09:09:26.334717+0000","last_clean":"2026-02-24T09:09:26.334717+0000","last_became_active":"2026-02-24T09:09:25.271680+0000","last_became_peered":"2026-02-24T09:09:25.271680+0000","last_unstale":"2026-02-24T09:09:26.334717+0000","last_undegraded":"2026-02-24T09:09:26.334717+0000","last_fullsized":"2026-02-24T09:09:26.334717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:07:33.257865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268617+0000","last_change":"2026-02-24T09:09:25.267808+0000","last_active":"2026-02-24T09:09:26.268617+0000","last_peered":"2026-02-24T09:09:26.268617+0000","last_clean":"2026-02-24T09:09:26.268617+0000","last_became_active":"2026-02-24T09:09:25.266759+0000","last_became_peered":"2026-02-24T09:09:25.266759+0000","last_unstale":"2026-02-24T09:09:26.268617+0000","last_undegraded":"2026-02-24T09:09:26.268617+0000","last_fullsized":"2026-02-24T09:09:26.268617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:49:55.312047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268133+0000","last_change":"2026-02-24T09:09:25.268500+0000","last_active":"2026-02-24T09:09:26.268133+0000","last_peered":"2026-02-24T09:09:26.268133+0000","last_clean":"2026-02-24T09:09:26.268133+0000","last_became_active":"2026-02-24T09:09:25.267904+0000","last_became_peered":"2026-02-24T09:09:25.267904+0000","last_unstale":"2026-02-24T09:09:26.268133+0000","last_undegraded":"2026-02-24T09:09:26.268133+0000","last_fullsized":"2026-02-24T09:09:26.268133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:38:47.330593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269021+0000","last_change":"2026-02-24T09:09:25.269694+0000","last_active":"2026-02-24T09:09:26.269021+0000","last_peered":"2026-02-24T09:09:26.269021+0000","last_clean":"2026-02-24T09:09:26.269021+0000","last_became_active":"2026-02-24T09:09:25.269068+0000","last_became_peered":"2026-02-24T09:09:25.269068+0000","last_unstale":"2026-02-24T09:09:26.269021+0000","last_undegraded":"2026-02-24T09:09:26.269021+0000","last_fullsized":"2026-02-24T09:09:26.269021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:04:44.772275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332668+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.332668+0000","last_peered":"2026-02-24T09:09:26.332668+0000","last_clean":"2026-02-24T09:09:26.332668+0000","last_became_active":"2026-02-24T09:09:25.269534+0000","last_became_peered":"2026-02-24T09:09:25.269534+0000","last_unstale":"2026-02-24T09:09:26.332668+0000","last_undegraded":"2026-02-24T09:09:26.332668+0000","last_fullsized":"2026-02-24T09:09:26.332668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:45:51.428970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332478+0000","last_change":"2026-02-24T09:09:25.266779+0000","last_active":"2026-02-24T09:09:26.332478+0000","last_peered":"2026-02-24T09:09:26.332478+0000","last_clean":"2026-02-24T09:09:26.332478+0000","last_became_active":"2026-02-24T09:09:25.266603+0000","last_became_peered":"2026-02-24T09:09:25.266603+0000","last_unstale":"2026-02-24T09:09:26.332478+0000","last_undegraded":"2026-02-24T09:09:26.332478+0000","last_fullsized":"2026-02-24T09:09:26.332478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:01:38.198458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332295+0000","last_change":"2026-02-24T09:09:25.266933+0000","last_active":"2026-02-24T09:09:26.332295+0000","last_peered":"2026-02-24T09:09:26.332295+0000","last_clean":"2026-02-24T09:09:26.332295+0000","last_became_active":"2026-02-24T09:09:25.266381+0000","last_became_peered":"2026-02-24T09:09:25.266381+0000","last_unstale":"2026-02-24T09:09:26.332295+0000","last_undegraded":"2026-02-24T09:09:26.332295+0000","last_fullsized":"2026-02-24T09:09:26.332295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:45:44.657482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267754+0000","last_change":"2026-02-24T09:09:25.269576+0000","last_active":"2026-02-24T09:09:26.267754+0000","last_peered":"2026-02-24T09:09:26.267754+0000","last_clean":"2026-02-24T09:09:26.267754+0000","last_became_active":"2026-02-24T09:09:25.269159+0000","last_became_peered":"2026-02-24T09:09:25.269159+0000","last_unstale":"2026-02-24T09:09:26.267754+0000","last_undegraded":"2026-02-24T09:09:26.267754+0000","last_fullsized":"2026-02-24T09:09:26.267754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:23:37.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332345+0000","last_change":"2026-02-24T09:09:25.269282+0000","last_active":"2026-02-24T09:09:26.332345+0000","last_peered":"2026-02-24T09:09:26.332345+0000","last_clean":"2026-02-24T09:09:26.332345+0000","last_became_active":"2026-02-24T09:09:25.269088+0000","last_became_peered":"2026-02-24T09:09:25.269088+0000","last_unstale":"2026-02-24T09:09:26.332345+0000","last_undegraded":"2026-02-24T09:09:26.332345+0000","last_fullsized":"2026-02-24T09:09:26.332345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:49.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332404+0000","last_change":"2026-02-24T09:09:25.270968+0000","last_active":"2026-02-24T09:09:26.332404+0000","last_peered":"2026-02-24T09:09:26.332404+0000","last_clean":"2026-02-24T09:09:26.332404+0000","last_became_active":"2026-02-24T09:09:25.270816+0000","last_became_peered":"2026-02-24T09:09:25.270816+0000","last_unstale":"2026-02-24T09:09:26.332404+0000","last_undegraded":"2026-02-24T09:09:26.332404+0000","last_fullsized":"2026-02-24T09:09:26.332404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:10:08.592263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332360+0000","last_change":"2026-02-24T09:09:25.267715+0000","last_active":"2026-02-24T09:09:26.332360+0000","last_peered":"2026-02-24T09:09:26.332360+0000","last_clean":"2026-02-24T09:09:26.332360+0000","last_became_active":"2026-02-24T09:09:25.267031+0000","last_became_peered":"2026-02-24T09:09:25.267031+0000","last_unstale":"2026-02-24T09:09:26.332360+0000","last_undegraded":"2026-02-24T09:09:26.332360+0000","last_fullsized":"2026-02-24T09:09:26.332360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:14:50.568512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267758+0000","last_change":"2026-02-24T09:09:25.268347+0000","last_active":"2026-02-24T09:09:26.267758+0000","last_peered":"2026-02-24T09:09:26.267758+0000","last_clean":"2026-02-24T09:09:26.267758+0000","last_became_active":"2026-02-24T09:09:25.268235+0000","last_became_peered":"2026-02-24T09:09:25.268235+0000","last_unstale":"2026-02-24T09:09:26.267758+0000","last_undegraded":"2026-02-24T09:09:26.267758+0000","last_fullsized":"2026-02-24T09:09:26.267758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:17.309082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:50.958117+0000","last_change":"2026-02-24T09:09:24.256941+0000","last_active":"2026-02-24T09:09:50.958117+0000","last_peered":"2026-02-24T09:09:50.958117+0000","last_clean":"2026-02-24T09:09:50.958117+0000","last_became_active":"2026-02-24T09:09:24.256577+0000","last_became_peered":"2026-02-24T09:09:24.256577+0000","last_unstale":"2026-02-24T09:09:50.958117+0000","last_undegraded":"2026-02-24T09:09:50.958117+0000","last_fullsized":"2026-02-24T09:09:50.958117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:13:19.756549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268000+0000","last_change":"2026-02-24T09:09:25.270452+0000","last_active":"2026-02-24T09:09:26.268000+0000","last_peered":"2026-02-24T09:09:26.268000+0000","last_clean":"2026-02-24T09:09:26.268000+0000","last_became_active":"2026-02-24T09:09:25.270184+0000","last_became_peered":"2026-02-24T09:09:25.270184+0000","last_unstale":"2026-02-24T09:09:26.268000+0000","last_undegraded":"2026-02-24T09:09:26.268000+0000","last_fullsized":"2026-02-24T09:09:26.268000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:07:41.652941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943662+0000","last_change":"2026-02-24T09:09:24.261249+0000","last_active":"2026-02-24T09:09:28.943662+0000","last_peered":"2026-02-24T09:09:28.943662+0000","last_clean":"2026-02-24T09:09:28.943662+0000","last_became_active":"2026-02-24T09:09:24.261064+0000","last_became_peered":"2026-02-24T09:09:24.261064+0000","last_unstale":"2026-02-24T09:09:28.943662+0000","last_undegraded":"2026-02-24T09:09:28.943662+0000","last_fullsized":"2026-02-24T09:09:28.943662+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:59:42.964350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941445+0000","last_change":"2026-02-24T09:09:24.254918+0000","last_active":"2026-02-24T09:09:28.941445+0000","last_peered":"2026-02-24T09:09:28.941445+0000","last_clean":"2026-02-24T09:09:28.941445+0000","last_became_active":"2026-02-24T09:09:24.254590+0000","last_became_peered":"2026-02-24T09:09:24.254590+0000","last_unstale":"2026-02-24T09:09:28.941445+0000","last_undegraded":"2026-02-24T09:09:28.941445+0000","last_fullsized":"2026-02-24T09:09:28.941445+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:03:19.504844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268666+0000","last_change":"2026-02-24T09:09:25.267204+0000","last_active":"2026-02-24T09:09:26.268666+0000","last_peered":"2026-02-24T09:09:26.268666+0000","last_clean":"2026-02-24T09:09:26.268666+0000","last_became_active":"2026-02-24T09:09:25.266489+0000","last_became_peered":"2026-02-24T09:09:25.266489+0000","last_unstale":"2026-02-24T09:09:26.268666+0000","last_undegraded":"2026-02-24T09:09:26.268666+0000","last_fullsized":"2026-02-24T09:09:26.268666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:26:34.500054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210732+0000","last_change":"2026-02-24T09:09:24.258042+0000","last_active":"2026-02-24T09:09:27.210732+0000","last_peered":"2026-02-24T09:09:27.210732+0000","last_clean":"2026-02-24T09:09:27.210732+0000","last_became_active":"2026-02-24T09:09:24.257801+0000","last_became_peered":"2026-02-24T09:09:24.257801+0000","last_unstale":"2026-02-24T09:09:27.210732+0000","last_undegraded":"2026-02-24T09:09:27.210732+0000","last_fullsized":"2026-02-24T09:09:27.210732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:53:27.596990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267334+0000","last_change":"2026-02-24T09:09:25.267636+0000","last_active":"2026-02-24T09:09:26.267334+0000","last_peered":"2026-02-24T09:09:26.267334+0000","last_clean":"2026-02-24T09:09:26.267334+0000","last_became_active":"2026-02-24T09:09:25.267505+0000","last_became_peered":"2026-02-24T09:09:25.267505+0000","last_unstale":"2026-02-24T09:09:26.267334+0000","last_undegraded":"2026-02-24T09:09:26.267334+0000","last_fullsized":"2026-02-24T09:09:26.267334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:19:20.660345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:49.959653+0000","last_change":"2026-02-24T09:09:24.260793+0000","last_active":"2026-02-24T09:09:49.959653+0000","last_peered":"2026-02-24T09:09:49.959653+0000","last_clean":"2026-02-24T09:09:49.959653+0000","last_became_active":"2026-02-24T09:09:24.260555+0000","last_became_peered":"2026-02-24T09:09:24.260555+0000","last_unstale":"2026-02-24T09:09:49.959653+0000","last_undegraded":"2026-02-24T09:09:49.959653+0000","last_fullsized":"2026-02-24T09:09:49.959653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:30:45.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334847+0000","last_change":"2026-02-24T09:09:25.271121+0000","last_active":"2026-02-24T09:09:26.334847+0000","last_peered":"2026-02-24T09:09:26.334847+0000","last_clean":"2026-02-24T09:09:26.334847+0000","last_became_active":"2026-02-24T09:09:25.270770+0000","last_became_peered":"2026-02-24T09:09:25.270770+0000","last_unstale":"2026-02-24T09:09:26.334847+0000","last_undegraded":"2026-02-24T09:09:26.334847+0000","last_fullsized":"2026-02-24T09:09:26.334847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:52:58.451719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940998+0000","last_change":"2026-02-24T09:09:24.259030+0000","last_active":"2026-02-24T09:09:27.940998+0000","last_peered":"2026-02-24T09:09:27.940998+0000","last_clean":"2026-02-24T09:09:27.940998+0000","last_became_active":"2026-02-24T09:09:24.258747+0000","last_became_peered":"2026-02-24T09:09:24.258747+0000","last_unstale":"2026-02-24T09:09:27.940998+0000","last_undegraded":"2026-02-24T09:09:27.940998+0000","last_fullsized":"2026-02-24T09:09:27.940998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:49:46.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267794+0000","last_change":"2026-02-24T09:09:25.269875+0000","last_active":"2026-02-24T09:09:26.267794+0000","last_peered":"2026-02-24T09:09:26.267794+0000","last_clean":"2026-02-24T09:09:26.267794+0000","last_became_active":"2026-02-24T09:09:25.269400+0000","last_became_peered":"2026-02-24T09:09:25.269400+0000","last_unstale":"2026-02-24T09:09:26.267794+0000","last_undegraded":"2026-02-24T09:09:26.267794+0000","last_fullsized":"2026-02-24T09:09:26.267794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:08:29.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938278+0000","last_change":"2026-02-24T09:09:24.256845+0000","last_active":"2026-02-24T09:09:27.938278+0000","last_peered":"2026-02-24T09:09:27.938278+0000","last_clean":"2026-02-24T09:09:27.938278+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:27.938278+0000","last_undegraded":"2026-02-24T09:09:27.938278+0000","last_fullsized":"2026-02-24T09:09:27.938278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:08:15.802226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334785+0000","last_change":"2026-02-24T09:09:25.269608+0000","last_active":"2026-02-24T09:09:26.334785+0000","last_peered":"2026-02-24T09:09:26.334785+0000","last_clean":"2026-02-24T09:09:26.334785+0000","last_became_active":"2026-02-24T09:09:25.268736+0000","last_became_peered":"2026-02-24T09:09:25.268736+0000","last_unstale":"2026-02-24T09:09:26.334785+0000","last_undegraded":"2026-02-24T09:09:26.334785+0000","last_fullsized":"2026-02-24T09:09:26.334785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:39:41.466580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'30","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:50.963515+0000","last_change":"2026-02-24T09:09:24.260591+0000","last_active":"2026-02-24T09:09:50.963515+0000","last_peered":"2026-02-24T09:09:50.963515+0000","last_clean":"2026-02-24T09:09:50.963515+0000","last_became_active":"2026-02-24T09:09:24.260382+0000","last_became_peered":"2026-02-24T09:09:24.260382+0000","last_unstale":"2026-02-24T09:09:50.963515+0000","last_undegraded":"2026-02-24T09:09:50.963515+0000","last_fullsized":"2026-02-24T09:09:50.963515+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:05:00.313499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68809,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":94,"num_write":31,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267717+0000","last_change":"2026-02-24T09:09:25.266872+0000","last_active":"2026-02-24T09:09:26.267717+0000","last_peered":"2026-02-24T09:09:26.267717+0000","last_clean":"2026-02-24T09:09:26.267717+0000","last_became_active":"2026-02-24T09:09:25.266720+0000","last_became_peered":"2026-02-24T09:09:25.266720+0000","last_unstale":"2026-02-24T09:09:26.267717+0000","last_undegraded":"2026-02-24T09:09:26.267717+0000","last_fullsized":"2026-02-24T09:09:26.267717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:43.574647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.941766+0000","last_change":"2026-02-24T09:09:24.256821+0000","last_active":"2026-02-24T09:09:28.941766+0000","last_peered":"2026-02-24T09:09:28.941766+0000","last_clean":"2026-02-24T09:09:28.941766+0000","last_became_active":"2026-02-24T09:09:24.256284+0000","last_became_peered":"2026-02-24T09:09:24.256284+0000","last_unstale":"2026-02-24T09:09:28.941766+0000","last_undegraded":"2026-02-24T09:09:28.941766+0000","last_fullsized":"2026-02-24T09:09:28.941766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:37:32.352734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332187+0000","last_change":"2026-02-24T09:09:25.268120+0000","last_active":"2026-02-24T09:09:26.332187+0000","last_peered":"2026-02-24T09:09:26.332187+0000","last_clean":"2026-02-24T09:09:26.332187+0000","last_became_active":"2026-02-24T09:09:25.267865+0000","last_became_peered":"2026-02-24T09:09:25.267865+0000","last_unstale":"2026-02-24T09:09:26.332187+0000","last_undegraded":"2026-02-24T09:09:26.332187+0000","last_fullsized":"2026-02-24T09:09:26.332187+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:51:18.647706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938196+0000","last_change":"2026-02-24T09:09:24.257176+0000","last_active":"2026-02-24T09:09:27.938196+0000","last_peered":"2026-02-24T09:09:27.938196+0000","last_clean":"2026-02-24T09:09:27.938196+0000","last_became_active":"2026-02-24T09:09:24.256855+0000","last_became_peered":"2026-02-24T09:09:24.256855+0000","last_unstale":"2026-02-24T09:09:27.938196+0000","last_undegraded":"2026-02-24T09:09:27.938196+0000","last_fullsized":"2026-02-24T09:09:27.938196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:48:25.179774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733497+0000","last_change":"2026-02-24T09:09:25.271913+0000","last_active":"2026-02-24T09:09:26.733497+0000","last_peered":"2026-02-24T09:09:26.733497+0000","last_clean":"2026-02-24T09:09:26.733497+0000","last_became_active":"2026-02-24T09:09:25.271736+0000","last_became_peered":"2026-02-24T09:09:25.271736+0000","last_unstale":"2026-02-24T09:09:26.733497+0000","last_undegraded":"2026-02-24T09:09:26.733497+0000","last_fullsized":"2026-02-24T09:09:26.733497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:58:49.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:47.961761+0000","last_change":"2026-02-24T09:09:24.259308+0000","last_active":"2026-02-24T09:09:47.961761+0000","last_peered":"2026-02-24T09:09:47.961761+0000","last_clean":"2026-02-24T09:09:47.961761+0000","last_became_active":"2026-02-24T09:09:24.259131+0000","last_became_peered":"2026-02-24T09:09:24.259131+0000","last_unstale":"2026-02-24T09:09:47.961761+0000","last_undegraded":"2026-02-24T09:09:47.961761+0000","last_fullsized":"2026-02-24T09:09:47.961761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:52:00.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733165+0000","last_change":"2026-02-24T09:09:25.269701+0000","last_active":"2026-02-24T09:09:26.733165+0000","last_peered":"2026-02-24T09:09:26.733165+0000","last_clean":"2026-02-24T09:09:26.733165+0000","last_became_active":"2026-02-24T09:09:25.269559+0000","last_became_peered":"2026-02-24T09:09:25.269559+0000","last_unstale":"2026-02-24T09:09:26.733165+0000","last_undegraded":"2026-02-24T09:09:26.733165+0000","last_fullsized":"2026-02-24T09:09:26.733165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:06:28.902948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942522+0000","last_change":"2026-02-24T09:09:24.257075+0000","last_active":"2026-02-24T09:09:28.942522+0000","last_peered":"2026-02-24T09:09:28.942522+0000","last_clean":"2026-02-24T09:09:28.942522+0000","last_became_active":"2026-02-24T09:09:24.256738+0000","last_became_peered":"2026-02-24T09:09:24.256738+0000","last_unstale":"2026-02-24T09:09:28.942522+0000","last_undegraded":"2026-02-24T09:09:28.942522+0000","last_fullsized":"2026-02-24T09:09:28.942522+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:58:14.802040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268002+0000","last_change":"2026-02-24T09:09:25.271423+0000","last_active":"2026-02-24T09:09:26.268002+0000","last_peered":"2026-02-24T09:09:26.268002+0000","last_clean":"2026-02-24T09:09:26.268002+0000","last_became_active":"2026-02-24T09:09:25.271142+0000","last_became_peered":"2026-02-24T09:09:25.271142+0000","last_unstale":"2026-02-24T09:09:26.268002+0000","last_undegraded":"2026-02-24T09:09:26.268002+0000","last_fullsized":"2026-02-24T09:09:26.268002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:28:16.997238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.940354+0000","last_change":"2026-02-24T09:09:24.258426+0000","last_active":"2026-02-24T09:09:29.940354+0000","last_peered":"2026-02-24T09:09:29.940354+0000","last_clean":"2026-02-24T09:09:29.940354+0000","last_became_active":"2026-02-24T09:09:24.257941+0000","last_became_peered":"2026-02-24T09:09:24.257941+0000","last_unstale":"2026-02-24T09:09:29.940354+0000","last_undegraded":"2026-02-24T09:09:29.940354+0000","last_fullsized":"2026-02-24T09:09:29.940354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:30:29.724001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332552+0000","last_change":"2026-02-24T09:09:25.266758+0000","last_active":"2026-02-24T09:09:26.332552+0000","last_peered":"2026-02-24T09:09:26.332552+0000","last_clean":"2026-02-24T09:09:26.332552+0000","last_became_active":"2026-02-24T09:09:25.266569+0000","last_became_peered":"2026-02-24T09:09:25.266569+0000","last_unstale":"2026-02-24T09:09:26.332552+0000","last_undegraded":"2026-02-24T09:09:26.332552+0000","last_fullsized":"2026-02-24T09:09:26.332552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:13:56.985056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332354+0000","last_change":"2026-02-24T09:09:24.256974+0000","last_active":"2026-02-24T09:09:26.332354+0000","last_peered":"2026-02-24T09:09:26.332354+0000","last_clean":"2026-02-24T09:09:26.332354+0000","last_became_active":"2026-02-24T09:09:24.256617+0000","last_became_peered":"2026-02-24T09:09:24.256617+0000","last_unstale":"2026-02-24T09:09:26.332354+0000","last_undegraded":"2026-02-24T09:09:26.332354+0000","last_fullsized":"2026-02-24T09:09:26.332354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:28.318156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733475+0000","last_change":"2026-02-24T09:09:25.270445+0000","last_active":"2026-02-24T09:09:26.733475+0000","last_peered":"2026-02-24T09:09:26.733475+0000","last_clean":"2026-02-24T09:09:26.733475+0000","last_became_active":"2026-02-24T09:09:25.270275+0000","last_became_peered":"2026-02-24T09:09:25.270275+0000","last_unstale":"2026-02-24T09:09:26.733475+0000","last_undegraded":"2026-02-24T09:09:26.733475+0000","last_fullsized":"2026-02-24T09:09:26.733475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:53:49.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.210815+0000","last_change":"2026-02-24T09:09:24.259031+0000","last_active":"2026-02-24T09:09:27.210815+0000","last_peered":"2026-02-24T09:09:27.210815+0000","last_clean":"2026-02-24T09:09:27.210815+0000","last_became_active":"2026-02-24T09:09:24.258899+0000","last_became_peered":"2026-02-24T09:09:24.258899+0000","last_unstale":"2026-02-24T09:09:27.210815+0000","last_undegraded":"2026-02-24T09:09:27.210815+0000","last_fullsized":"2026-02-24T09:09:27.210815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:37:16.802986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109422+0000","last_change":"2026-02-24T09:09:25.272707+0000","last_active":"2026-02-24T09:09:28.109422+0000","last_peered":"2026-02-24T09:09:28.109422+0000","last_clean":"2026-02-24T09:09:28.109422+0000","last_became_active":"2026-02-24T09:09:25.272563+0000","last_became_peered":"2026-02-24T09:09:25.272563+0000","last_unstale":"2026-02-24T09:09:28.109422+0000","last_undegraded":"2026-02-24T09:09:28.109422+0000","last_fullsized":"2026-02-24T09:09:28.109422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T18:41:22.895217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942219+0000","last_change":"2026-02-24T09:09:24.256493+0000","last_active":"2026-02-24T09:09:28.942219+0000","last_peered":"2026-02-24T09:09:28.942219+0000","last_clean":"2026-02-24T09:09:28.942219+0000","last_became_active":"2026-02-24T09:09:24.256130+0000","last_became_peered":"2026-02-24T09:09:24.256130+0000","last_unstale":"2026-02-24T09:09:28.942219+0000","last_undegraded":"2026-02-24T09:09:28.942219+0000","last_fullsized":"2026-02-24T09:09:28.942219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:43:12.259841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733528+0000","last_change":"2026-02-24T09:09:25.271977+0000","last_active":"2026-02-24T09:09:26.733528+0000","last_peered":"2026-02-24T09:09:26.733528+0000","last_clean":"2026-02-24T09:09:26.733528+0000","last_became_active":"2026-02-24T09:09:25.271650+0000","last_became_peered":"2026-02-24T09:09:25.271650+0000","last_unstale":"2026-02-24T09:09:26.733528+0000","last_undegraded":"2026-02-24T09:09:26.733528+0000","last_fullsized":"2026-02-24T09:09:26.733528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:14:10.062115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":339,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733207+0000","last_change":"2026-02-24T09:09:05.953512+0000","last_active":"2026-02-24T09:09:26.733207+0000","last_peered":"2026-02-24T09:09:26.733207+0000","last_clean":"2026-02-24T09:09:26.733207+0000","last_became_active":"2026-02-24T09:09:05.953360+0000","last_became_peered":"2026-02-24T09:09:05.953360+0000","last_unstale":"2026-02-24T09:09:26.733207+0000","last_undegraded":"2026-02-24T09:09:26.733207+0000","last_fullsized":"2026-02-24T09:09:26.733207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:08:00.445410+0000","last_clean_scrub_stamp":"2026-02-24T09:08:00.445410+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:09:48.550493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:29.945604+0000","last_change":"2026-02-24T09:09:24.259164+0000","last_active":"2026-02-24T09:09:29.945604+0000","last_peered":"2026-02-24T09:09:29.945604+0000","last_clean":"2026-02-24T09:09:29.945604+0000","last_became_active":"2026-02-24T09:09:24.259011+0000","last_became_peered":"2026-02-24T09:09:24.259011+0000","last_unstale":"2026-02-24T09:09:29.945604+0000","last_undegraded":"2026-02-24T09:09:29.945604+0000","last_fullsized":"2026-02-24T09:09:29.945604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:41:41.649484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268864+0000","last_change":"2026-02-24T09:09:25.269884+0000","last_active":"2026-02-24T09:09:26.268864+0000","last_peered":"2026-02-24T09:09:26.268864+0000","last_clean":"2026-02-24T09:09:26.268864+0000","last_became_active":"2026-02-24T09:09:25.269543+0000","last_became_peered":"2026-02-24T09:09:25.269543+0000","last_unstale":"2026-02-24T09:09:26.268864+0000","last_undegraded":"2026-02-24T09:09:26.268864+0000","last_fullsized":"2026-02-24T09:09:26.268864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:21:25.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.943350+0000","last_change":"2026-02-24T09:09:24.259369+0000","last_active":"2026-02-24T09:09:28.943350+0000","last_peered":"2026-02-24T09:09:28.943350+0000","last_clean":"2026-02-24T09:09:28.943350+0000","last_became_active":"2026-02-24T09:09:24.259086+0000","last_became_peered":"2026-02-24T09:09:24.259086+0000","last_unstale":"2026-02-24T09:09:28.943350+0000","last_undegraded":"2026-02-24T09:09:28.943350+0000","last_fullsized":"2026-02-24T09:09:28.943350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:19:08.881900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332119+0000","last_change":"2026-02-24T09:09:25.266898+0000","last_active":"2026-02-24T09:09:26.332119+0000","last_peered":"2026-02-24T09:09:26.332119+0000","last_clean":"2026-02-24T09:09:26.332119+0000","last_became_active":"2026-02-24T09:09:25.266407+0000","last_became_peered":"2026-02-24T09:09:25.266407+0000","last_unstale":"2026-02-24T09:09:26.332119+0000","last_undegraded":"2026-02-24T09:09:26.332119+0000","last_fullsized":"2026-02-24T09:09:26.332119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:51.887929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:48.959424+0000","last_change":"2026-02-24T09:09:24.254126+0000","last_active":"2026-02-24T09:09:48.959424+0000","last_peered":"2026-02-24T09:09:48.959424+0000","last_clean":"2026-02-24T09:09:48.959424+0000","last_became_active":"2026-02-24T09:09:24.253911+0000","last_became_peered":"2026-02-24T09:09:24.253911+0000","last_unstale":"2026-02-24T09:09:48.959424+0000","last_undegraded":"2026-02-24T09:09:48.959424+0000","last_fullsized":"2026-02-24T09:09:48.959424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:09:56.146842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268161+0000","last_change":"2026-02-24T09:09:25.270387+0000","last_active":"2026-02-24T09:09:26.268161+0000","last_peered":"2026-02-24T09:09:26.268161+0000","last_clean":"2026-02-24T09:09:26.268161+0000","last_became_active":"2026-02-24T09:09:25.269478+0000","last_became_peered":"2026-02-24T09:09:25.269478+0000","last_unstale":"2026-02-24T09:09:26.268161+0000","last_undegraded":"2026-02-24T09:09:26.268161+0000","last_fullsized":"2026-02-24T09:09:26.268161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:32:15.217221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.109411+0000","last_change":"2026-02-24T09:09:24.259169+0000","last_active":"2026-02-24T09:09:28.109411+0000","last_peered":"2026-02-24T09:09:28.109411+0000","last_clean":"2026-02-24T09:09:28.109411+0000","last_became_active":"2026-02-24T09:09:24.258755+0000","last_became_peered":"2026-02-24T09:09:24.258755+0000","last_unstale":"2026-02-24T09:09:28.109411+0000","last_undegraded":"2026-02-24T09:09:28.109411+0000","last_fullsized":"2026-02-24T09:09:28.109411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:11:33.438504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.270152+0000","last_change":"2026-02-24T09:09:25.270732+0000","last_active":"2026-02-24T09:09:26.270152+0000","last_peered":"2026-02-24T09:09:26.270152+0000","last_clean":"2026-02-24T09:09:26.270152+0000","last_became_active":"2026-02-24T09:09:25.270200+0000","last_became_peered":"2026-02-24T09:09:25.270200+0000","last_unstale":"2026-02-24T09:09:26.270152+0000","last_undegraded":"2026-02-24T09:09:26.270152+0000","last_fullsized":"2026-02-24T09:09:26.270152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:59:28.115196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267351+0000","last_change":"2026-02-24T09:09:24.257488+0000","last_active":"2026-02-24T09:09:26.267351+0000","last_peered":"2026-02-24T09:09:26.267351+0000","last_clean":"2026-02-24T09:09:26.267351+0000","last_became_active":"2026-02-24T09:09:24.257202+0000","last_became_peered":"2026-02-24T09:09:24.257202+0000","last_unstale":"2026-02-24T09:09:26.267351+0000","last_undegraded":"2026-02-24T09:09:26.267351+0000","last_fullsized":"2026-02-24T09:09:26.267351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:41:24.345307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.674896+0000","last_change":"2026-02-24T09:09:25.272254+0000","last_active":"2026-02-24T09:09:26.674896+0000","last_peered":"2026-02-24T09:09:26.674896+0000","last_clean":"2026-02-24T09:09:26.674896+0000","last_became_active":"2026-02-24T09:09:25.271674+0000","last_became_peered":"2026-02-24T09:09:25.271674+0000","last_unstale":"2026-02-24T09:09:26.674896+0000","last_undegraded":"2026-02-24T09:09:26.674896+0000","last_fullsized":"2026-02-24T09:09:26.674896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:03:26.493850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938246+0000","last_change":"2026-02-24T09:09:24.257331+0000","last_active":"2026-02-24T09:09:27.938246+0000","last_peered":"2026-02-24T09:09:27.938246+0000","last_clean":"2026-02-24T09:09:27.938246+0000","last_became_active":"2026-02-24T09:09:24.256876+0000","last_became_peered":"2026-02-24T09:09:24.256876+0000","last_unstale":"2026-02-24T09:09:27.938246+0000","last_undegraded":"2026-02-24T09:09:27.938246+0000","last_fullsized":"2026-02-24T09:09:27.938246+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:29:58.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332332+0000","last_change":"2026-02-24T09:09:25.266642+0000","last_active":"2026-02-24T09:09:26.332332+0000","last_peered":"2026-02-24T09:09:26.332332+0000","last_clean":"2026-02-24T09:09:26.332332+0000","last_became_active":"2026-02-24T09:09:25.266307+0000","last_became_peered":"2026-02-24T09:09:25.266307+0000","last_unstale":"2026-02-24T09:09:26.332332+0000","last_undegraded":"2026-02-24T09:09:26.332332+0000","last_fullsized":"2026-02-24T09:09:26.332332+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:29:51.170520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:37.268830+0000","last_change":"2026-02-24T09:09:24.258807+0000","last_active":"2026-02-24T09:09:37.268830+0000","last_peered":"2026-02-24T09:09:37.268830+0000","last_clean":"2026-02-24T09:09:37.268830+0000","last_became_active":"2026-02-24T09:09:24.258649+0000","last_became_peered":"2026-02-24T09:09:24.258649+0000","last_unstale":"2026-02-24T09:09:37.268830+0000","last_undegraded":"2026-02-24T09:09:37.268830+0000","last_fullsized":"2026-02-24T09:09:37.268830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:10:48.348275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269009+0000","last_change":"2026-02-24T09:09:25.268491+0000","last_active":"2026-02-24T09:09:26.269009+0000","last_peered":"2026-02-24T09:09:26.269009+0000","last_clean":"2026-02-24T09:09:26.269009+0000","last_became_active":"2026-02-24T09:09:25.267341+0000","last_became_peered":"2026-02-24T09:09:25.267341+0000","last_unstale":"2026-02-24T09:09:26.269009+0000","last_undegraded":"2026-02-24T09:09:26.269009+0000","last_fullsized":"2026-02-24T09:09:26.269009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:18:29.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.940964+0000","last_change":"2026-02-24T09:09:24.258484+0000","last_active":"2026-02-24T09:09:27.940964+0000","last_peered":"2026-02-24T09:09:27.940964+0000","last_clean":"2026-02-24T09:09:27.940964+0000","last_became_active":"2026-02-24T09:09:24.258249+0000","last_became_peered":"2026-02-24T09:09:24.258249+0000","last_unstale":"2026-02-24T09:09:27.940964+0000","last_undegraded":"2026-02-24T09:09:27.940964+0000","last_fullsized":"2026-02-24T09:09:27.940964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:32:56.722522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267783+0000","last_change":"2026-02-24T09:09:25.269738+0000","last_active":"2026-02-24T09:09:26.267783+0000","last_peered":"2026-02-24T09:09:26.267783+0000","last_clean":"2026-02-24T09:09:26.267783+0000","last_became_active":"2026-02-24T09:09:25.269413+0000","last_became_peered":"2026-02-24T09:09:25.269413+0000","last_unstale":"2026-02-24T09:09:26.267783+0000","last_undegraded":"2026-02-24T09:09:26.267783+0000","last_fullsized":"2026-02-24T09:09:26.267783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T12:35:00.412570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.941334+0000","last_change":"2026-02-24T09:09:24.258901+0000","last_active":"2026-02-24T09:09:27.941334+0000","last_peered":"2026-02-24T09:09:27.941334+0000","last_clean":"2026-02-24T09:09:27.941334+0000","last_became_active":"2026-02-24T09:09:24.258325+0000","last_became_peered":"2026-02-24T09:09:24.258325+0000","last_unstale":"2026-02-24T09:09:27.941334+0000","last_undegraded":"2026-02-24T09:09:27.941334+0000","last_fullsized":"2026-02-24T09:09:27.941334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:36.337800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267522+0000","last_change":"2026-02-24T09:09:25.267368+0000","last_active":"2026-02-24T09:09:26.267522+0000","last_peered":"2026-02-24T09:09:26.267522+0000","last_clean":"2026-02-24T09:09:26.267522+0000","last_became_active":"2026-02-24T09:09:25.267168+0000","last_became_peered":"2026-02-24T09:09:25.267168+0000","last_unstale":"2026-02-24T09:09:26.267522+0000","last_undegraded":"2026-02-24T09:09:26.267522+0000","last_fullsized":"2026-02-24T09:09:26.267522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:29:57.616866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.939140+0000","last_change":"2026-02-24T09:09:24.257345+0000","last_active":"2026-02-24T09:09:27.939140+0000","last_peered":"2026-02-24T09:09:27.939140+0000","last_clean":"2026-02-24T09:09:27.939140+0000","last_became_active":"2026-02-24T09:09:24.256817+0000","last_became_peered":"2026-02-24T09:09:24.256817+0000","last_unstale":"2026-02-24T09:09:27.939140+0000","last_undegraded":"2026-02-24T09:09:27.939140+0000","last_fullsized":"2026-02-24T09:09:27.939140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T11:37:48.042471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.332527+0000","last_change":"2026-02-24T09:09:25.267778+0000","last_active":"2026-02-24T09:09:26.332527+0000","last_peered":"2026-02-24T09:09:26.332527+0000","last_clean":"2026-02-24T09:09:26.332527+0000","last_became_active":"2026-02-24T09:09:25.267379+0000","last_became_peered":"2026-02-24T09:09:25.267379+0000","last_unstale":"2026-02-24T09:09:26.332527+0000","last_undegraded":"2026-02-24T09:09:26.332527+0000","last_fullsized":"2026-02-24T09:09:26.332527+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:25:47.194857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.121396+0000","last_change":"2026-02-24T09:09:24.259141+0000","last_active":"2026-02-24T09:09:28.121396+0000","last_peered":"2026-02-24T09:09:28.121396+0000","last_clean":"2026-02-24T09:09:28.121396+0000","last_became_active":"2026-02-24T09:09:24.258981+0000","last_became_peered":"2026-02-24T09:09:24.258981+0000","last_unstale":"2026-02-24T09:09:28.121396+0000","last_undegraded":"2026-02-24T09:09:28.121396+0000","last_fullsized":"2026-02-24T09:09:28.121396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T09:26:48.909980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268774+0000","last_change":"2026-02-24T09:09:25.268540+0000","last_active":"2026-02-24T09:09:26.268774+0000","last_peered":"2026-02-24T09:09:26.268774+0000","last_clean":"2026-02-24T09:09:26.268774+0000","last_became_active":"2026-02-24T09:09:25.267915+0000","last_became_peered":"2026-02-24T09:09:25.267915+0000","last_unstale":"2026-02-24T09:09:26.268774+0000","last_undegraded":"2026-02-24T09:09:26.268774+0000","last_fullsized":"2026-02-24T09:09:26.268774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:03:55.564971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:27.938005+0000","last_change":"2026-02-24T09:09:24.257964+0000","last_active":"2026-02-24T09:09:27.938005+0000","last_peered":"2026-02-24T09:09:27.938005+0000","last_clean":"2026-02-24T09:09:27.938005+0000","last_became_active":"2026-02-24T09:09:24.257717+0000","last_became_peered":"2026-02-24T09:09:24.257717+0000","last_unstale":"2026-02-24T09:09:27.938005+0000","last_undegraded":"2026-02-24T09:09:27.938005+0000","last_fullsized":"2026-02-24T09:09:27.938005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T15:23:24.989893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.733433+0000","last_change":"2026-02-24T09:09:25.271214+0000","last_active":"2026-02-24T09:09:26.733433+0000","last_peered":"2026-02-24T09:09:26.733433+0000","last_clean":"2026-02-24T09:09:26.733433+0000","last_became_active":"2026-02-24T09:09:25.271038+0000","last_became_peered":"2026-02-24T09:09:25.271038+0000","last_unstale":"2026-02-24T09:09:26.733433+0000","last_undegraded":"2026-02-24T09:09:26.733433+0000","last_fullsized":"2026-02-24T09:09:26.733433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:58:44.899837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268097+0000","last_change":"2026-02-24T09:09:25.269834+0000","last_active":"2026-02-24T09:09:26.268097+0000","last_peered":"2026-02-24T09:09:26.268097+0000","last_clean":"2026-02-24T09:09:26.268097+0000","last_became_active":"2026-02-24T09:09:25.269526+0000","last_became_peered":"2026-02-24T09:09:25.269526+0000","last_unstale":"2026-02-24T09:09:26.268097+0000","last_undegraded":"2026-02-24T09:09:26.268097+0000","last_fullsized":"2026-02-24T09:09:26.268097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T14:36:54.610640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267687+0000","last_change":"2026-02-24T09:09:24.258597+0000","last_active":"2026-02-24T09:09:26.267687+0000","last_peered":"2026-02-24T09:09:26.267687+0000","last_clean":"2026-02-24T09:09:26.267687+0000","last_became_active":"2026-02-24T09:09:24.258302+0000","last_became_peered":"2026-02-24T09:09:24.258302+0000","last_unstale":"2026-02-24T09:09:26.267687+0000","last_undegraded":"2026-02-24T09:09:26.267687+0000","last_fullsized":"2026-02-24T09:09:26.267687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T10:20:15.556479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.334746+0000","last_change":"2026-02-24T09:09:25.269804+0000","last_active":"2026-02-24T09:09:26.334746+0000","last_peered":"2026-02-24T09:09:26.334746+0000","last_clean":"2026-02-24T09:09:26.334746+0000","last_became_active":"2026-02-24T09:09:25.268973+0000","last_became_peered":"2026-02-24T09:09:25.268973+0000","last_unstale":"2026-02-24T09:09:26.334746+0000","last_undegraded":"2026-02-24T09:09:26.334746+0000","last_fullsized":"2026-02-24T09:09:26.334746+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:33:39.800443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942003+0000","last_change":"2026-02-24T09:09:24.257428+0000","last_active":"2026-02-24T09:09:28.942003+0000","last_peered":"2026-02-24T09:09:28.942003+0000","last_clean":"2026-02-24T09:09:28.942003+0000","last_became_active":"2026-02-24T09:09:24.256679+0000","last_became_peered":"2026-02-24T09:09:24.256679+0000","last_unstale":"2026-02-24T09:09:28.942003+0000","last_undegraded":"2026-02-24T09:09:28.942003+0000","last_fullsized":"2026-02-24T09:09:28.942003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T16:39:28.664820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.267792+0000","last_change":"2026-02-24T09:09:25.268127+0000","last_active":"2026-02-24T09:09:26.267792+0000","last_peered":"2026-02-24T09:09:26.267792+0000","last_clean":"2026-02-24T09:09:26.267792+0000","last_became_active":"2026-02-24T09:09:25.267860+0000","last_became_peered":"2026-02-24T09:09:25.267860+0000","last_unstale":"2026-02-24T09:09:26.267792+0000","last_undegraded":"2026-02-24T09:09:26.267792+0000","last_fullsized":"2026-02-24T09:09:26.267792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:37:52.562208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.269053+0000","last_change":"2026-02-24T09:09:24.257552+0000","last_active":"2026-02-24T09:09:26.269053+0000","last_peered":"2026-02-24T09:09:26.269053+0000","last_clean":"2026-02-24T09:09:26.269053+0000","last_became_active":"2026-02-24T09:09:24.257163+0000","last_became_peered":"2026-02-24T09:09:24.257163+0000","last_unstale":"2026-02-24T09:09:26.269053+0000","last_undegraded":"2026-02-24T09:09:26.269053+0000","last_fullsized":"2026-02-24T09:09:26.269053+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:30:54.285800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:26.268961+0000","last_change":"2026-02-24T09:09:25.268695+0000","last_active":"2026-02-24T09:09:26.268961+0000","last_peered":"2026-02-24T09:09:26.268961+0000","last_clean":"2026-02-24T09:09:26.268961+0000","last_became_active":"2026-02-24T09:09:25.268128+0000","last_became_peered":"2026-02-24T09:09:25.268128+0000","last_unstale":"2026-02-24T09:09:26.268961+0000","last_undegraded":"2026-02-24T09:09:26.268961+0000","last_fullsized":"2026-02-24T09:09:26.268961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:24.247189+0000","last_clean_scrub_stamp":"2026-02-24T09:09:24.247189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:23.987958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-24T09:09:28.942226+0000","last_change":"2026-02-24T09:09:24.257602+0000","last_active":"2026-02-24T09:09:28.942226+0000","last_peered":"2026-02-24T09:09:28.942226+0000","last_clean":"2026-02-24T09:09:28.942226+0000","last_became_active":"2026-02-24T09:09:24.257440+0000","last_became_peered":"2026-02-24T09:09:24.257440+0000","last_unstale":"2026-02-24T09:09:28.942226+0000","last_undegraded":"2026-02-24T09:09:28.942226+0000","last_fullsized":"2026-02-24T09:09:28.942226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T09:09:23.246048+0000","last_clean_scrub_stamp":"2026-02-24T09:09:23.246048+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T17:13:51.640918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72859,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":157,"num_read_kb":156,"num_write":158,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":218577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":119920,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":259322,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710732,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":395125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8618,"internal_metadata":27582038},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939660,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27916,"kb_used_data":952,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975284,"statfs":{"total":751619276800,"available":751590690816,"internally_reserved":0,"allocated":974848,"data_stored":1055825,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23856,"internal_metadata":27566800},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070478,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24845,"internal_metadata":27565811},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299407,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32956,"internal_metadata":27557700},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528338,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27824,"kb_used_data":860,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975376,"statfs":{"total":751619276800,"available":751590785024,"internally_reserved":0,"allocated":880640,"data_stored":987230,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":28867,"internal_metadata":27561789},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659155,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":394740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888084,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":986504,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":32062,"internal_metadata":27558594},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018901,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31416,"internal_metadata":27559240},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247832,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":395051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47059,"internal_metadata":27543597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476761,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27856,"kb_used_data":892,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975344,"statfs":{"total":751619276800,"available":751590752256,"internally_reserved":0,"allocated":913408,"data_stored":464702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34581,"internal_metadata":27556075},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607578,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27832,"kb_used_data":868,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975368,"statfs":{"total":751619276800,"available":751590776832,"internally_reserved":0,"allocated":888832,"data_stored":463342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45622,"internal_metadata":27545034},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49917,"internal_metadata":27540739},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36138,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":37727,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11012,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":70169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12011,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13952,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6329,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1018,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13842,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3422,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31362,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9492,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13536,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T09:09:54.900 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:54.957 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:54 trial004 ceph-mon[41596]: pgmap v151: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2026-02-24T09:09:54.957 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:54 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:09:54.958 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:54 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:09:54.958 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:54 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:09:54.958 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:54 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:09:55.051 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:55.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:54 trial090 ceph-mon[47278]: pgmap v151: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2026-02-24T09:09:55.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:54 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:09:55.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:54 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:09:55.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:54 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:09:55.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:54 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:09:55.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:54 trial014 ceph-mon[46941]: pgmap v151: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2026-02-24T09:09:55.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:54 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:09:55.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:54 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:09:55.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:54 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:09:55.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:54 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:09:55.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 -- 10.20.193.4:0/3820624240 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9010fc70 msgr2=0x7f1f90114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:55.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 --2- 10.20.193.4:0/3820624240 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9010fc70 0x7f1f90114cc0 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=9217948492248015841 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f84009950 tx=0x7f1f8402f190 comp rx=0 tx=0).stop 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 -- 10.20.193.4:0/3820624240 shutdown_connections 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 --2- 10.20.193.4:0/3820624240 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f90115470 0x7f1f90175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 --2- 10.20.193.4:0/3820624240 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9010fc70 0x7f1f90114cc0 unknown :-1 s=CLOSED pgs=452 gs=1 cs=0 l=1 c_cookie=9217948492248015841 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 --2- 10.20.193.4:0/3820624240 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9010f280 0x7f1f9010f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 -- 10.20.193.4:0/3820624240 >> 10.20.193.4:0/3820624240 conn(0x7f1f9005f830 msgr2=0x7f1f9010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 -- 10.20.193.4:0/3820624240 shutdown_connections 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 -- 10.20.193.4:0/3820624240 wait complete. 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 Processor -- start 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 -- start start 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9010f280 0x7f1f900f5550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9010fc70 0x7f1f90175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:55.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f90115470 0x7f1f900f5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f1f900fae60 con 0x7f1f9010f280 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f1f900fafd0 con 0x7f1f9010fc70 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f97695640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1f900fb190 con 0x7f1f90115470 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f9540a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9010f280 0x7f1f900f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f9540a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9010f280 0x7f1f900f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50762/0 (socket says 10.20.193.4:50762) 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f9540a640 1 -- 10.20.193.4:0/3783154955 learned_addr learned my addr 10.20.193.4:0/3783154955 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f95c0b640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f90115470 0x7f1f900f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f94c09640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9010fc70 0x7f1f90175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f9540a640 1 -- 10.20.193.4:0/3783154955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f90115470 msgr2=0x7f1f900f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f9540a640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f90115470 0x7f1f900f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f9540a640 1 -- 10.20.193.4:0/3783154955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9010fc70 msgr2=0x7f1f90175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:55.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f9540a640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9010fc70 0x7f1f90175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f9540a640 1 -- 10.20.193.4:0/3783154955 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f84009570 con 0x7f1f9010f280 2026-02-24T09:09:55.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.155+0000 7f1f94c09640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9010fc70 0x7f1f90175d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:55.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.156+0000 7f1f9540a640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9010f280 0x7f1f900f5550 secure :-1 s=READY pgs=453 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f8000c9b0 tx=0x7f1f8000ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:55.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.156+0000 7f1f7e7fc640 1 -- 10.20.193.4:0/3783154955 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f800044a0 con 0x7f1f9010f280 2026-02-24T09:09:55.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.156+0000 7f1f7e7fc640 1 -- 10.20.193.4:0/3783154955 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1f80007da0 con 0x7f1f9010f280 2026-02-24T09:09:55.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.156+0000 7f1f97695640 1 -- 10.20.193.4:0/3783154955 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f900fb470 con 0x7f1f9010f280 2026-02-24T09:09:55.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.156+0000 7f1f7e7fc640 1 -- 10.20.193.4:0/3783154955 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f8000f6d0 con 0x7f1f9010f280 2026-02-24T09:09:55.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.156+0000 7f1f97695640 1 -- 10.20.193.4:0/3783154955 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f900fb990 con 0x7f1f9010f280 2026-02-24T09:09:55.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.156+0000 7f1f97695640 1 -- 10.20.193.4:0/3783154955 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f90110560 con 0x7f1f9010f280 2026-02-24T09:09:55.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.157+0000 7f1f7e7fc640 1 -- 10.20.193.4:0/3783154955 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f1f80002880 con 0x7f1f9010f280 2026-02-24T09:09:55.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.158+0000 7f1f7e7fc640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f6c0b57f0 0x7f1f6c0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:55.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.158+0000 7f1f94c09640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f6c0b57f0 0x7f1f6c0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:55.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.158+0000 7f1f7e7fc640 1 -- 10.20.193.4:0/3783154955 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f1f800e6f70 con 0x7f1f9010f280 2026-02-24T09:09:55.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.158+0000 7f1f94c09640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f6c0b57f0 0x7f1f6c0d5ca0 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f840098a0 tx=0x7f1f84031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:55.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.159+0000 7f1f7e7fc640 1 -- 10.20.193.4:0/3783154955 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f1f800a98c0 con 0x7f1f9010f280 2026-02-24T09:09:55.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.292+0000 7f1f97695640 1 -- 10.20.193.4:0/3783154955 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f900f66b0 con 0x7f1f9010f280 2026-02-24T09:09:55.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.292+0000 7f1f7e7fc640 1 -- 10.20.193.4:0/3783154955 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f1f800aca70 con 0x7f1f9010f280 2026-02-24T09:09:55.297 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:55.297 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:09:55.298 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:09:55.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 -- 10.20.193.4:0/3783154955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f6c0b57f0 msgr2=0x7f1f6c0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:55.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f6c0b57f0 0x7f1f6c0d5ca0 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f840098a0 tx=0x7f1f84031040 comp rx=0 tx=0).stop 2026-02-24T09:09:55.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 -- 10.20.193.4:0/3783154955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9010f280 msgr2=0x7f1f900f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:55.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9010f280 0x7f1f900f5550 secure :-1 s=READY pgs=453 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f8000c9b0 tx=0x7f1f8000ce80 comp rx=0 tx=0).stop 2026-02-24T09:09:55.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 -- 10.20.193.4:0/3783154955 shutdown_connections 2026-02-24T09:09:55.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1f6c0b57f0 0x7f1f6c0d5ca0 unknown :-1 s=CLOSED pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1f90115470 0x7f1f900f5c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1f9010fc70 0x7f1f90175d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 --2- 10.20.193.4:0/3783154955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1f9010f280 0x7f1f900f5550 unknown :-1 s=CLOSED pgs=453 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 -- 10.20.193.4:0/3783154955 >> 10.20.193.4:0/3783154955 conn(0x7f1f9005f830 msgr2=0x7f1f90111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:55.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 -- 10.20.193.4:0/3783154955 shutdown_connections 2026-02-24T09:09:55.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.294+0000 7f1f97695640 1 -- 10.20.193.4:0/3783154955 wait complete. 2026-02-24T09:09:55.335 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:55.495 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:55.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 -- 10.20.193.4:0/2894641003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa54115470 msgr2=0x7ffa54175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:55.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 --2- 10.20.193.4:0/2894641003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa54115470 0x7ffa54175e40 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=10687743443198373193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa5000aa30 tx=0x7ffa50030280 comp rx=0 tx=0).stop 2026-02-24T09:09:55.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 -- 10.20.193.4:0/2894641003 shutdown_connections 2026-02-24T09:09:55.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 --2- 10.20.193.4:0/2894641003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa54115470 0x7ffa54175e40 unknown :-1 s=CLOSED pgs=454 gs=1 cs=0 l=1 c_cookie=10687743443198373193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 --2- 10.20.193.4:0/2894641003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa5410fc70 0x7ffa54114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 --2- 10.20.193.4:0/2894641003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa5410f280 0x7ffa5410f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 -- 10.20.193.4:0/2894641003 >> 10.20.193.4:0/2894641003 conn(0x7ffa5405f830 msgr2=0x7ffa5410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 -- 10.20.193.4:0/2894641003 shutdown_connections 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 -- 10.20.193.4:0/2894641003 wait complete. 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 Processor -- start 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 -- start start 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa5410f280 0x7ffa5411db50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa5410fc70 0x7ffa5411e090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa54115470 0x7ffa54123460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ffa54123a80 con 0x7ffa5410fc70 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ffa54123bf0 con 0x7ffa54115470 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5c1db640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa54123db0 con 0x7ffa5410f280 2026-02-24T09:09:55.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5974f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa5410fc70 0x7ffa5411e090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5974f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa5410fc70 0x7ffa5411e090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50784/0 (socket says 10.20.193.4:50784) 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa5974f640 1 -- 10.20.193.4:0/284100567 learned_addr learned my addr 10.20.193.4:0/284100567 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.601+0000 7ffa59f50640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa5410f280 0x7ffa5411db50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5a751640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa54115470 0x7ffa54123460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5974f640 1 -- 10.20.193.4:0/284100567 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa5410f280 msgr2=0x7ffa5411db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5974f640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa5410f280 0x7ffa5411db50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5974f640 1 -- 10.20.193.4:0/284100567 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa54115470 msgr2=0x7ffa54123460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5974f640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa54115470 0x7ffa54123460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5974f640 1 -- 10.20.193.4:0/284100567 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5000a650 con 0x7ffa5410fc70 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5a751640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa54115470 0x7ffa54123460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5974f640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa5410fc70 0x7ffa5411e090 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa48005db0 tx=0x7ffa4800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:55.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa42ffd640 1 -- 10.20.193.4:0/284100567 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa48004500 con 0x7ffa5410fc70 2026-02-24T09:09:55.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa42ffd640 1 -- 10.20.193.4:0/284100567 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa48004d30 con 0x7ffa5410fc70 2026-02-24T09:09:55.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5c1db640 1 -- 10.20.193.4:0/284100567 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa54124090 con 0x7ffa5410fc70 2026-02-24T09:09:55.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa42ffd640 1 -- 10.20.193.4:0/284100567 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa480053c0 con 0x7ffa5410fc70 2026-02-24T09:09:55.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5c1db640 1 -- 10.20.193.4:0/284100567 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa54164790 con 0x7ffa5410fc70 2026-02-24T09:09:55.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.602+0000 7ffa5c1db640 1 -- 10.20.193.4:0/284100567 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa54110560 con 0x7ffa5410fc70 2026-02-24T09:09:55.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.604+0000 7ffa42ffd640 1 -- 10.20.193.4:0/284100567 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7ffa48009940 con 0x7ffa5410fc70 2026-02-24T09:09:55.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.605+0000 7ffa42ffd640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa300b57f0 0x7ffa300d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:55.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.605+0000 7ffa59f50640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa300b57f0 0x7ffa300d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:55.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.605+0000 7ffa42ffd640 1 -- 10.20.193.4:0/284100567 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7ffa480e6fb0 con 0x7ffa5410fc70 2026-02-24T09:09:55.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.605+0000 7ffa42ffd640 1 -- 10.20.193.4:0/284100567 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ffa480a9150 con 0x7ffa5410fc70 2026-02-24T09:09:55.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.605+0000 7ffa59f50640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa300b57f0 0x7ffa300d5ca0 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa44004740 tx=0x7ffa440073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:55.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.735+0000 7ffa5c1db640 1 -- 10.20.193.4:0/284100567 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa5410f650 con 0x7ffa5410fc70 2026-02-24T09:09:55.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.735+0000 7ffa42ffd640 1 -- 10.20.193.4:0/284100567 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7ffa480738d0 con 0x7ffa5410fc70 2026-02-24T09:09:55.739 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:55.739 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:09:55.740 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:09:55.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 -- 10.20.193.4:0/284100567 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa300b57f0 msgr2=0x7ffa300d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:55.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa300b57f0 0x7ffa300d5ca0 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa44004740 tx=0x7ffa440073d0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 -- 10.20.193.4:0/284100567 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa5410fc70 msgr2=0x7ffa5411e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:55.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa5410fc70 0x7ffa5411e090 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa48005db0 tx=0x7ffa4800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 -- 10.20.193.4:0/284100567 shutdown_connections 2026-02-24T09:09:55.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa300b57f0 0x7ffa300d5ca0 unknown :-1 s=CLOSED pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa54115470 0x7ffa54123460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa5410fc70 0x7ffa5411e090 unknown :-1 s=CLOSED pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 --2- 10.20.193.4:0/284100567 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa5410f280 0x7ffa5411db50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:55.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 -- 10.20.193.4:0/284100567 >> 10.20.193.4:0/284100567 conn(0x7ffa5405f830 msgr2=0x7ffa5410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:55.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 -- 10.20.193.4:0/284100567 shutdown_connections 2026-02-24T09:09:55.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:55.736+0000 7ffa5c1db640 1 -- 10.20.193.4:0/284100567 wait complete. 2026-02-24T09:09:55.792 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:09:55.814 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:55 trial004 ceph-mon[41596]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:55.814 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:55 trial004 ceph-mon[41596]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:55.814 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:55 trial004 ceph-mon[41596]: from='client.15564 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:55.814 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:55 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3783154955' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:55.814 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:55 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/284100567' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:55.910 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:56.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 -- 10.20.193.4:0/82890044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f055410f280 msgr2=0x7f055410f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:56.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 --2- 10.20.193.4:0/82890044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f055410f280 0x7f055410f650 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=7767197742821074244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0540009950 tx=0x7f054002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 -- 10.20.193.4:0/82890044 shutdown_connections 2026-02-24T09:09:56.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 --2- 10.20.193.4:0/82890044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0554115470 0x7f0554175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 --2- 10.20.193.4:0/82890044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f055410fc70 0x7f0554114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 --2- 10.20.193.4:0/82890044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f055410f280 0x7f055410f650 unknown :-1 s=CLOSED pgs=456 gs=1 cs=0 l=1 c_cookie=7767197742821074244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 -- 10.20.193.4:0/82890044 >> 10.20.193.4:0/82890044 conn(0x7f055405f830 msgr2=0x7f055410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:56.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 -- 10.20.193.4:0/82890044 shutdown_connections 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 -- 10.20.193.4:0/82890044 wait complete. 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 Processor -- start 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 -- start start 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f055410f280 0x7f055411dc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f055410fc70 0x7f055411e190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0554115470 0x7f0554123560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0554123b80 con 0x7f055410f280 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0554123cf0 con 0x7f055410fc70 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f055a6c4640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0554123eb0 con 0x7f0554115470 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f0553fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f055410f280 0x7f055411dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f0553fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f055410f280 0x7f055411dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50804/0 (socket says 10.20.193.4:50804) 2026-02-24T09:09:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f0553fff640 1 -- 10.20.193.4:0/3918897965 learned_addr learned my addr 10.20.193.4:0/3918897965 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f05537fe640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f055410fc70 0x7f055411e190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f0558c3a640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0554115470 0x7f0554123560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f0553fff640 1 -- 10.20.193.4:0/3918897965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0554115470 msgr2=0x7f0554123560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f0553fff640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0554115470 0x7f0554123560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f0553fff640 1 -- 10.20.193.4:0/3918897965 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f055410fc70 msgr2=0x7f055411e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f0553fff640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f055410fc70 0x7f055411e190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.007+0000 7f0553fff640 1 -- 10.20.193.4:0/3918897965 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0540009570 con 0x7f055410f280 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.008+0000 7f0553fff640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f055410f280 0x7f055411dc50 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05400023d0 tx=0x7f05400043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.008+0000 7f05517fa640 1 -- 10.20.193.4:0/3918897965 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f054003d070 con 0x7f055410f280 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.008+0000 7f05517fa640 1 -- 10.20.193.4:0/3918897965 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0540038920 con 0x7f055410f280 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.008+0000 7f055a6c4640 1 -- 10.20.193.4:0/3918897965 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0554124130 con 0x7f055410f280 2026-02-24T09:09:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.008+0000 7f05517fa640 1 -- 10.20.193.4:0/3918897965 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05400419d0 con 0x7f055410f280 2026-02-24T09:09:56.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.008+0000 7f055a6c4640 1 -- 10.20.193.4:0/3918897965 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0554164890 con 0x7f055410f280 2026-02-24T09:09:56.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.008+0000 7f055a6c4640 1 -- 10.20.193.4:0/3918897965 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0554110560 con 0x7f055410f280 2026-02-24T09:09:56.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.010+0000 7f05517fa640 1 -- 10.20.193.4:0/3918897965 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f0540038a90 con 0x7f055410f280 2026-02-24T09:09:56.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.010+0000 7f05517fa640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f05280b5770 0x7f05280d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:56.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.010+0000 7f05517fa640 1 -- 10.20.193.4:0/3918897965 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f054010b7f0 con 0x7f055410f280 2026-02-24T09:09:56.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.010+0000 7f05537fe640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f05280b5770 0x7f05280d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:56.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.011+0000 7f05537fe640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f05280b5770 0x7f05280d5c20 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05541245f0 tx=0x7f054400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:56.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.011+0000 7f05517fa640 1 -- 10.20.193.4:0/3918897965 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f05400ce320 con 0x7f055410f280 2026-02-24T09:09:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:55 trial090 ceph-mon[47278]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:55 trial090 ceph-mon[47278]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:55 trial090 ceph-mon[47278]: from='client.15564 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:55 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3783154955' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:56.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:55 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/284100567' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:56.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:55 trial014 ceph-mon[46941]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:56.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:55 trial014 ceph-mon[46941]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:56.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:55 trial014 ceph-mon[46941]: from='client.15564 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T09:09:56.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:55 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3783154955' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:56.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:55 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/284100567' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:56.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.116+0000 7f055a6c4640 1 -- 10.20.193.4:0/3918897965 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f055411edb0 con 0x7f055410f280 2026-02-24T09:09:56.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.117+0000 7f05517fa640 1 -- 10.20.193.4:0/3918897965 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22231 (secure 0 0 0) 0x7f05400d1440 con 0x7f055410f280 2026-02-24T09:09:56.122 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:56.122 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":75,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:09:26.263940+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:09:56.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 -- 10.20.193.4:0/3918897965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f05280b5770 msgr2=0x7f05280d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:56.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f05280b5770 0x7f05280d5c20 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05541245f0 tx=0x7f054400b410 comp rx=0 tx=0).stop 2026-02-24T09:09:56.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 -- 10.20.193.4:0/3918897965 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f055410f280 msgr2=0x7f055411dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:56.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f055410f280 0x7f055411dc50 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05400023d0 tx=0x7f05400043d0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 -- 10.20.193.4:0/3918897965 shutdown_connections 2026-02-24T09:09:56.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f05280b5770 0x7f05280d5c20 unknown :-1 s=CLOSED pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0554115470 0x7f0554123560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f055410fc70 0x7f055411e190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 --2- 10.20.193.4:0/3918897965 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f055410f280 0x7f055411dc50 unknown :-1 s=CLOSED pgs=457 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 -- 10.20.193.4:0/3918897965 >> 10.20.193.4:0/3918897965 conn(0x7f055405f830 msgr2=0x7f055410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:56.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 -- 10.20.193.4:0/3918897965 shutdown_connections 2026-02-24T09:09:56.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.119+0000 7f055a6c4640 1 -- 10.20.193.4:0/3918897965 wait complete. 2026-02-24T09:09:56.161 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph daemon mon.a --format=json config get run_dir 2026-02-24T09:09:56.321 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:56.476 INFO:teuthology.orchestra.run.trial004.stdout:{"run_dir":"/var/run/ceph"} 2026-02-24T09:09:56.476 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2026-02-24T09:09:56.477 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 2406 2026-02-24T09:09:56.477 DEBUG:tasks.quiescer:Yielding 2026-02-24T09:09:56.477 INFO:teuthology.run_tasks:Running task workunit... 2026-02-24T09:09:56.507 INFO:tasks.workunit:Pulling workunits from ref 5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:09:56.507 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-24T09:09:56.507 INFO:tasks.workunit:timeout=3h 2026-02-24T09:09:56.508 INFO:tasks.workunit:cleanup=True 2026-02-24T09:09:56.508 DEBUG:teuthology.orchestra.run.trial004:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-24T09:09:56.509 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:09:56.528 INFO:teuthology.orchestra.run.trial004.stdout: File: /home/ubuntu/cephtest/mnt.0 2026-02-24T09:09:56.528 INFO:teuthology.orchestra.run.trial004.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2026-02-24T09:09:56.528 INFO:teuthology.orchestra.run.trial004.stdout:Device: 2bh/43d Inode: 1099511628283 Links: 2 2026-02-24T09:09:56.528 INFO:teuthology.orchestra.run.trial004.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T09:09:56.528 INFO:teuthology.orchestra.run.trial004.stdout:Context: system_u:object_r:unlabeled_t:s0 2026-02-24T09:09:56.529 INFO:teuthology.orchestra.run.trial004.stdout:Access: 2026-02-24 09:09:31.525119173 +0000 2026-02-24T09:09:56.529 INFO:teuthology.orchestra.run.trial004.stdout:Modify: 2026-02-24 09:09:31.525119173 +0000 2026-02-24T09:09:56.529 INFO:teuthology.orchestra.run.trial004.stdout:Change: 2026-02-24 09:09:49.684582755 +0000 2026-02-24T09:09:56.529 INFO:teuthology.orchestra.run.trial004.stdout: Birth: 2026-02-24 09:09:31.525119173 +0000 2026-02-24T09:09:56.529 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2026-02-24T09:09:56.530 DEBUG:teuthology.orchestra.run.trial004:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2026-02-24T09:09:56.599 DEBUG:teuthology.orchestra.run.trial004:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5bc9a1ffc19df681248ece8c3c8c7191a571745b 2026-02-24T09:09:56.628 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:56.652 INFO:tasks.workunit.client.0.trial004.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-24T09:09:56.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 -- 10.20.193.4:0/4038448019 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21a01158b0 msgr2=0x7f21a0176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:56.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 --2- 10.20.193.4:0/4038448019 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21a01158b0 0x7f21a0176280 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=542625217546186009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f219000aa30 tx=0x7f2190030270 comp rx=0 tx=0).stop 2026-02-24T09:09:56.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 -- 10.20.193.4:0/4038448019 shutdown_connections 2026-02-24T09:09:56.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 --2- 10.20.193.4:0/4038448019 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21a01158b0 0x7f21a0176280 unknown :-1 s=CLOSED pgs=458 gs=1 cs=0 l=1 c_cookie=542625217546186009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 --2- 10.20.193.4:0/4038448019 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f21a01100b0 0x7f21a0115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 --2- 10.20.193.4:0/4038448019 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21a010f6c0 0x7f21a010fa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 -- 10.20.193.4:0/4038448019 >> 10.20.193.4:0/4038448019 conn(0x7f21a00ecfd0 msgr2=0x7f21a010d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 -- 10.20.193.4:0/4038448019 shutdown_connections 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 -- 10.20.193.4:0/4038448019 wait complete. 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 Processor -- start 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.732+0000 7f21a4f21640 1 -- start start 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21a4f21640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f21a010f6c0 0x7f21a011e060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21a4f21640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21a01100b0 0x7f21a011e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21a4f21640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21a01158b0 0x7f21a0123970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21a4f21640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f21a0123f00 con 0x7f21a01158b0 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21a4f21640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f21a0124070 con 0x7f21a01100b0 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21a4f21640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f21a0124230 con 0x7f21a010f6c0 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21a01158b0 0x7f21a0123970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21a01158b0 0x7f21a0123970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50830/0 (socket says 10.20.193.4:50830) 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219ed76640 1 -- 10.20.193.4:0/3215051032 learned_addr learned my addr 10.20.193.4:0/3215051032 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219dd74640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21a01100b0 0x7f21a011e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:56.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219ed76640 1 -- 10.20.193.4:0/3215051032 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f21a010f6c0 msgr2=0x7f21a011e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219ed76640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f21a010f6c0 0x7f21a011e060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219ed76640 1 -- 10.20.193.4:0/3215051032 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21a01100b0 msgr2=0x7f21a011e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219ed76640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21a01100b0 0x7f21a011e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219ed76640 1 -- 10.20.193.4:0/3215051032 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219000a650 con 0x7f21a01158b0 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219dd74640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21a01100b0 0x7f21a011e5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f219ed76640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21a01158b0 0x7f21a0123970 secure :-1 s=READY pgs=459 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2190032fe0 tx=0x7f21900039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21877fe640 1 -- 10.20.193.4:0/3215051032 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f219003e070 con 0x7f21a01158b0 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21877fe640 1 -- 10.20.193.4:0/3215051032 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f21900055a0 con 0x7f21a01158b0 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21a4f21640 1 -- 10.20.193.4:0/3215051032 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a01244b0 con 0x7f21a01158b0 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21877fe640 1 -- 10.20.193.4:0/3215051032 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2190042b70 con 0x7f21a01158b0 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.733+0000 7f21a4f21640 1 -- 10.20.193.4:0/3215051032 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a0164b00 con 0x7f21a01158b0 2026-02-24T09:09:56.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.734+0000 7f21a4f21640 1 -- 10.20.193.4:0/3215051032 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a01109a0 con 0x7f21a01158b0 2026-02-24T09:09:56.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.735+0000 7f21877fe640 1 -- 10.20.193.4:0/3215051032 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f21900050c0 con 0x7f21a01158b0 2026-02-24T09:09:56.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.735+0000 7f21877fe640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21780b57f0 0x7f21780d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:56.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.736+0000 7f21877fe640 1 -- 10.20.193.4:0/3215051032 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f219010d0f0 con 0x7f21a01158b0 2026-02-24T09:09:56.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.736+0000 7f219e575640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21780b57f0 0x7f21780d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:56.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.736+0000 7f219e575640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21780b57f0 0x7f21780d5ca0 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2194004740 tx=0x7f2194005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:56.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.736+0000 7f21877fe640 1 -- 10.20.193.4:0/3215051032 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f21900cfb50 con 0x7f21a01158b0 2026-02-24T09:09:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.870+0000 7f21a4f21640 1 -- 10.20.193.4:0/3215051032 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21a010fa90 con 0x7f21a01158b0 2026-02-24T09:09:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.870+0000 7f21877fe640 1 -- 10.20.193.4:0/3215051032 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f21900d2d00 con 0x7f21a01158b0 2026-02-24T09:09:56.875 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:09:56.875 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:09:56.876 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:09:56.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 -- 10.20.193.4:0/3215051032 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21780b57f0 msgr2=0x7f21780d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:56.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21780b57f0 0x7f21780d5ca0 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2194004740 tx=0x7f2194005d20 comp rx=0 tx=0).stop 2026-02-24T09:09:56.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 -- 10.20.193.4:0/3215051032 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21a01158b0 msgr2=0x7f21a0123970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:56.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21a01158b0 0x7f21a0123970 secure :-1 s=READY pgs=459 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2190032fe0 tx=0x7f21900039b0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 -- 10.20.193.4:0/3215051032 shutdown_connections 2026-02-24T09:09:56.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21780b57f0 0x7f21780d5ca0 unknown :-1 s=CLOSED pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f21a01158b0 0x7f21a0123970 unknown :-1 s=CLOSED pgs=459 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f21a01100b0 0x7f21a011e5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 --2- 10.20.193.4:0/3215051032 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f21a010f6c0 0x7f21a011e060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:56.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 -- 10.20.193.4:0/3215051032 >> 10.20.193.4:0/3215051032 conn(0x7f21a00ecfd0 msgr2=0x7f21a010d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:56.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 -- 10.20.193.4:0/3215051032 shutdown_connections 2026-02-24T09:09:56.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:56.871+0000 7f21a4f21640 1 -- 10.20.193.4:0/3215051032 wait complete. 2026-02-24T09:09:56.912 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:56 trial004 ceph-mon[41596]: pgmap v152: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2026-02-24T09:09:56.912 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:56 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3918897965' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:56.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-24T09:09:24.652522+0000', 'modified': '2026-02-24T09:09:50.337608+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24637, 'mds_1': 24625, 'mds_2': 24620}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24580': {'gid': 24580, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.90:6833/931807729', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6832', 'nonce': 931807729}, {'type': 'v1', 'addr': '10.20.193.90:6833', 'nonce': 931807729}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24596': {'gid': 24596, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.14:6837/524790199', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.14:6836', 'nonce': 524790199}, {'type': 'v1', 'addr': '10.20.193.14:6837', 'nonce': 524790199}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.90:6835/1296342299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6834', 'nonce': 1296342299}, {'type': 'v1', 'addr': '10.20.193.90:6835', 'nonce': 1296342299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24620': {'gid': 24620, 'name': 'b', 'rank': 2, 'incarnation': 16, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.14:6839/2269480307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.14:6838', 'nonce': 2269480307}, {'type': 'v1', 'addr': '10.20.193.14:6839', 'nonce': 2269480307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'c', 'rank': 1, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.90:6837/4190330264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6836', 'nonce': 4190330264}, {'type': 'v1', 'addr': '10.20.193.90:6837', 'nonce': 4190330264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'i', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.90:6839/2191295378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.90:6838', 'nonce': 2191295378}, {'type': 'v1', 'addr': '10.20.193.90:6839', 'nonce': 2191295378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4544132024016699391, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24637, 'qdb_cluster': [24620, 24625, 24637]} 2026-02-24T09:09:56.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2026-02-24T09:09:56.914 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.b status 2026-02-24T09:09:57.074 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:57.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:56 trial090 ceph-mon[47278]: pgmap v152: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2026-02-24T09:09:57.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:56 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3918897965' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:57.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:56 trial014 ceph-mon[46941]: pgmap v152: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2026-02-24T09:09:57.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:56 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3918897965' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:09:57.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.172+0000 7f074d135640 1 -- 10.20.193.4:0/3812688340 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f074810f280 msgr2=0x7f074810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.172+0000 7f074d135640 1 --2- 10.20.193.4:0/3812688340 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f074810f280 0x7f074810f650 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=8340980256309070079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073c009950 tx=0x7f073c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 -- 10.20.193.4:0/3812688340 shutdown_connections 2026-02-24T09:09:57.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 --2- 10.20.193.4:0/3812688340 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0748115470 0x7f0748175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 --2- 10.20.193.4:0/3812688340 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f074810fc70 0x7f0748114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 --2- 10.20.193.4:0/3812688340 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f074810f280 0x7f074810f650 unknown :-1 s=CLOSED pgs=460 gs=1 cs=0 l=1 c_cookie=8340980256309070079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 -- 10.20.193.4:0/3812688340 >> 10.20.193.4:0/3812688340 conn(0x7f074805f830 msgr2=0x7f074810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 -- 10.20.193.4:0/3812688340 shutdown_connections 2026-02-24T09:09:57.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 -- 10.20.193.4:0/3812688340 wait complete. 2026-02-24T09:09:57.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 Processor -- start 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 -- start start 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f074810f280 0x7f074811db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f074810fc70 0x7f074811e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0748115470 0x7f0748123470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0748123a90 con 0x7f074810fc70 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0748123c00 con 0x7f074810f280 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f074d135640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0748123dc0 con 0x7f0748115470 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0746575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f074810fc70 0x7f074811e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0746575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f074810fc70 0x7f074811e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50856/0 (socket says 10.20.193.4:50856) 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0746575640 1 -- 10.20.193.4:0/3285872933 learned_addr learned my addr 10.20.193.4:0/3285872933 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0746d76640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f074810f280 0x7f074811db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0747577640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0748115470 0x7f0748123470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0746575640 1 -- 10.20.193.4:0/3285872933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0748115470 msgr2=0x7f0748123470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0746575640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0748115470 0x7f0748123470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0746575640 1 -- 10.20.193.4:0/3285872933 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f074810f280 msgr2=0x7f074811db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0746575640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f074810f280 0x7f074811db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0746575640 1 -- 10.20.193.4:0/3285872933 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073c009570 con 0x7f074810fc70 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0747577640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0748115470 0x7f0748123470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.173+0000 7f0746575640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f074810fc70 0x7f074811e0a0 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073000d950 tx=0x7f073000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.174+0000 7f0727fff640 1 -- 10.20.193.4:0/3285872933 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0730004540 con 0x7f074810fc70 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.174+0000 7f074d135640 1 -- 10.20.193.4:0/3285872933 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07481240a0 con 0x7f074810fc70 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.174+0000 7f0727fff640 1 -- 10.20.193.4:0/3285872933 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0730009d00 con 0x7f074810fc70 2026-02-24T09:09:57.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.174+0000 7f0727fff640 1 -- 10.20.193.4:0/3285872933 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07300106e0 con 0x7f074810fc70 2026-02-24T09:09:57.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.174+0000 7f074d135640 1 -- 10.20.193.4:0/3285872933 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07481647a0 con 0x7f074810fc70 2026-02-24T09:09:57.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.175+0000 7f0727fff640 1 -- 10.20.193.4:0/3285872933 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f07300027c0 con 0x7f074810fc70 2026-02-24T09:09:57.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.176+0000 7f0727fff640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f071c0b5770 0x7f071c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.176+0000 7f0746d76640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f071c0b5770 0x7f071c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.176+0000 7f0727fff640 1 -- 10.20.193.4:0/3285872933 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f07300e6ec0 con 0x7f074810fc70 2026-02-24T09:09:57.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.176+0000 7f0746d76640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f071c0b5770 0x7f071c0d5c20 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073c0023d0 tx=0x7f073c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f074f12fe00 1 Processor -- start 2026-02-24T09:09:57.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f074f12fe00 1 -- start start 2026-02-24T09:09:57.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 0x559997a188a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a5d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a7de60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f074f12fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559997928d70 con 0x559997a5da80 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f074f12fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559997924aa0 con 0x559997a184d0 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f074f12fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55999791ec00 con 0x559997a18de0 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f0747577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a7de60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f0747577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a7de60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50862/0 (socket says 10.20.193.4:50862) 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f0747577640 1 -- 10.20.193.4:0/943187287 learned_addr learned my addr 10.20.193.4:0/943187287 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f0746d76640 1 --2- 10.20.193.4:0/943187287 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 0x559997a188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.178+0000 7f0746575640 1 --2- 10.20.193.4:0/943187287 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a5d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f0747577640 1 -- 10.20.193.4:0/943187287 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 msgr2=0x559997a5d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f0747577640 1 --2- 10.20.193.4:0/943187287 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a5d540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f0747577640 1 -- 10.20.193.4:0/943187287 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 msgr2=0x559997a188a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f0747577640 1 --2- 10.20.193.4:0/943187287 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 0x559997a188a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f0747577640 1 -- 10.20.193.4:0/943187287 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599978ca300 con 0x559997a5da80 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f0746d76640 1 --2- 10.20.193.4:0/943187287 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 0x559997a188a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f0747577640 1 --2- 10.20.193.4:0/943187287 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a7de60 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=13179395739007380487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0738005730 tx=0x7f0738003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e69e98e1d4ec07 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f07137fe640 1 -- 10.20.193.4:0/943187287 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f073800add0 con 0x559997a5da80 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f07137fe640 1 -- 10.20.193.4:0/943187287 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f073801b950 con 0x559997a5da80 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f07137fe640 1 -- 10.20.193.4:0/943187287 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0738012b30 con 0x559997a5da80 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f074f12fe00 1 -- 10.20.193.4:0/943187287 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 msgr2=0x559997a7de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f074f12fe00 1 --2- 10.20.193.4:0/943187287 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a7de60 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=13179395739007380487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0738005730 tx=0x7f0738003d00 comp rx=0 tx=0).stop 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f074f12fe00 1 -- 10.20.193.4:0/943187287 shutdown_connections 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f074f12fe00 1 --2- 10.20.193.4:0/943187287 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a7de60 unknown :-1 s=CLOSED pgs=462 gs=1 cs=0 l=1 c_cookie=13179395739007380487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f074f12fe00 1 --2- 10.20.193.4:0/943187287 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a5d540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f074f12fe00 1 --2- 10.20.193.4:0/943187287 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 0x559997a188a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f074f12fe00 1 -- 10.20.193.4:0/943187287 >> 10.20.193.4:0/943187287 conn(0x559997937480 msgr2=0x559997a16db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f074f12fe00 1 -- 10.20.193.4:0/943187287 shutdown_connections 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.179+0000 7f074f12fe00 1 -- 10.20.193.4:0/943187287 wait complete. 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.180+0000 7f074f12fe00 1 -- start start 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.180+0000 7f074f12fe00 1 Processor -- start 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.180+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a30910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.180+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a18de0 0x559997a30e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.180+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a5da80 0x559997a35e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.180+0000 7f074f12fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559997a36380 con 0x559997a184d0 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.180+0000 7f074f12fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559997a364f0 con 0x559997a18de0 2026-02-24T09:09:57.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.180+0000 7f074f12fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559997a366b0 con 0x559997a5da80 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0746d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a30910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0746d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a30910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50876/0 (socket says 10.20.193.4:50876) 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0746d76640 1 -- 10.20.193.4:0/3140402043 learned_addr learned my addr 10.20.193.4:0/3140402043 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0746575640 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a18de0 0x559997a30e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0747577640 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a5da80 0x559997a35e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0746d76640 1 -- 10.20.193.4:0/3140402043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a5da80 msgr2=0x559997a35e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0746d76640 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a5da80 0x559997a35e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0746d76640 1 -- 10.20.193.4:0/3140402043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a18de0 msgr2=0x559997a30e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0746d76640 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a18de0 0x559997a30e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0746d76640 1 -- 10.20.193.4:0/3140402043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599978a28b0 con 0x559997a184d0 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0747577640 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a5da80 0x559997a35e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:57.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0746d76640 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a30910 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=676426798806382574 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073c004300 tx=0x7f073c02f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9632696f368b7ee server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0710ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0710ff9640 1 -- 10.20.193.4:0/3140402043 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f073c038d50 con 0x559997a184d0 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 1 -- 10.20.193.4:0/3140402043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0738005350 con 0x559997a184d0 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0710ff9640 1 -- 10.20.193.4:0/3140402043 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f073c051960 con 0x559997a184d0 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0710ff9640 1 -- 10.20.193.4:0/3140402043 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f073c043680 con 0x559997a184d0 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0710ff9640 1 -- 10.20.193.4:0/3140402043 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f073c043810 con 0x559997a184d0 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0710ff9640 10 client.15600 inactive, discarding osd_map(75..75 src has 1..75) 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 10 client.15600 _ll_register_callbacks cb 0x55999789ff00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 1 -- 10.20.193.4:0/3140402043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5599975ac600 con 0x559997a184d0 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0710ff9640 1 -- 10.20.193.4:0/3140402043 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f073c051480 con 0x559997a184d0 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 10 client.15600 fetch_fsmap learned FSMap version 19 2026-02-24T09:09:57.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 1 -- 10.20.193.4:0/3140402043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5599978b46d0 con 0x559997a184d0 2026-02-24T09:09:57.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f0710ff9640 1 -- 10.20.193.4:0/3140402043 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f073c051ad0 con 0x559997a184d0 2026-02-24T09:09:57.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 10 client.15600 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:09:57.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 10 client.15600 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-24T09:09:57.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 20 client.15600 populate_metadata read hostname 'trial004' 2026-02-24T09:09:57.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559997a5be90 0x559997a5d300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 4 client.15600 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:57.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.181+0000 7f074f12fe00 1 -- 10.20.193.4:0/3140402043 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55999792fd50 con 0x559997a5be90 2026-02-24T09:09:57.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.182+0000 7f0746575640 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559997a5be90 0x559997a5d300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.182+0000 7f0746575640 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559997a5be90 0x559997a5d300 crc :-1 s=READY pgs=20 gs=4 cs=0 l=0 c_cookie=9660976106991192867 s_cookie=15157931296724138225 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8612ae9550bf0b23 server_cookie=d25bca344704b8f1 in_seq=0 out_seq=0 2026-02-24T09:09:57.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.182+0000 7f0710ff9640 10 client.15600 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f0710ff9640 1 -- 10.20.193.4:0/3140402043 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55999792fd50 con 0x559997a5be90 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f0710ff9640 10 client.15600 handle_command_reply: tid=0 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 client.15600 shutdown 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 -- 10.20.193.4:0/3140402043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 msgr2=0x559997a30910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a30910 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=676426798806382574 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073c004300 tx=0x7f073c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 -- 10.20.193.4:0/3140402043 shutdown_connections 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559997a5be90 0x559997a5d300 crc :-1 s=READY pgs=20 gs=4 cs=0 l=0 c_cookie=9660976106991192867 s_cookie=15157931296724138225 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a5da80 0x559997a35e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a18de0 0x559997a30e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 --2- 10.20.193.4:0/3140402043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a30910 unknown :-1 s=CLOSED pgs=463 gs=1 cs=0 l=1 c_cookie=676426798806382574 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f0710ff9640 0 client.15600 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:57.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 -- 10.20.193.4:0/3140402043 >> 10.20.193.4:0/3140402043 conn(0x559997937480 msgr2=0x559997a174c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 -- 10.20.193.4:0/3140402043 shutdown_connections 2026-02-24T09:09:57.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 1 -- 10.20.193.4:0/3140402043 wait complete. 2026-02-24T09:09:57.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.183+0000 7f074f12fe00 20 client.15600 trim_cache size 0 max 16384 2026-02-24T09:09:57.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 Processor -- start 2026-02-24T09:09:57.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 -- start start 2026-02-24T09:09:57.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a1db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a1b360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a5da80 0x559997a1b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55999791c830 con 0x559997a184d0 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5599975e7e60 con 0x559997a5da80 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559997a9e190 con 0x559997a18de0 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0746d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a1db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0746d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a1db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50888/0 (socket says 10.20.193.4:50888) 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0746d76640 1 -- 10.20.193.4:0/930441190 learned_addr learned my addr 10.20.193.4:0/930441190 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0746575640 1 --2- 10.20.193.4:0/930441190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a1b360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0746d76640 1 -- 10.20.193.4:0/930441190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 msgr2=0x559997a1b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0746d76640 1 --2- 10.20.193.4:0/930441190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a1b360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0746d76640 1 -- 10.20.193.4:0/930441190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a5da80 msgr2=0x559997a1b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0746d76640 1 --2- 10.20.193.4:0/930441190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a5da80 0x559997a1b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0746d76640 1 -- 10.20.193.4:0/930441190 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599978af150 con 0x559997a184d0 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0746d76640 1 --2- 10.20.193.4:0/930441190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a1db60 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=4606718961549370370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073c02fdc0 tx=0x7f073c059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fee5a7cf334e402 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0712ffd640 1 -- 10.20.193.4:0/930441190 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f073c05a3b0 con 0x559997a184d0 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0712ffd640 1 -- 10.20.193.4:0/930441190 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5599975ac600 con 0x559997a184d0 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f0712ffd640 1 -- 10.20.193.4:0/930441190 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f073c05ad00 con 0x559997a184d0 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 -- 10.20.193.4:0/930441190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 msgr2=0x559997a1db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 --2- 10.20.193.4:0/930441190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a1db60 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=4606718961549370370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073c02fdc0 tx=0x7f073c059000 comp rx=0 tx=0).stop 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 -- 10.20.193.4:0/930441190 shutdown_connections 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 --2- 10.20.193.4:0/930441190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a5da80 0x559997a1b8a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 --2- 10.20.193.4:0/930441190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a1b360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 --2- 10.20.193.4:0/930441190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a184d0 0x559997a1db60 unknown :-1 s=CLOSED pgs=464 gs=1 cs=0 l=1 c_cookie=4606718961549370370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 -- 10.20.193.4:0/930441190 >> 10.20.193.4:0/930441190 conn(0x559997937480 msgr2=0x559997a5abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 -- 10.20.193.4:0/930441190 shutdown_connections 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.192+0000 7f074f12fe00 1 -- 10.20.193.4:0/930441190 wait complete. 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f074f12fe00 1 -- start start 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f074f12fe00 1 Processor -- start 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 0x559997a2dc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a2e1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f074f12fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a33cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f074f12fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55999798c650 con 0x559997a5da80 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f074f12fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559997a343e0 con 0x559997a184d0 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f074f12fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559997a345a0 con 0x559997a18de0 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0747577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a33cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0747577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a33cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50902/0 (socket says 10.20.193.4:50902) 2026-02-24T09:09:57.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0747577640 1 -- 10.20.193.4:0/4106095960 learned_addr learned my addr 10.20.193.4:0/4106095960 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0746575640 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a2e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0746d76640 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 0x559997a2dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0747577640 1 -- 10.20.193.4:0/4106095960 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 msgr2=0x559997a2e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0747577640 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a2e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0747577640 1 -- 10.20.193.4:0/4106095960 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 msgr2=0x559997a2dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0747577640 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 0x559997a2dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0747577640 1 -- 10.20.193.4:0/4106095960 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599978a2be0 con 0x559997a5da80 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0747577640 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a33cb0 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=15201859593175689976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07380037e0 tx=0x7f07380068a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f7dac1d099eaf8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.193+0000 7f0710ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f0710ff9640 1 -- 10.20.193.4:0/4106095960 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0738020050 con 0x559997a5da80 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f0710ff9640 1 -- 10.20.193.4:0/4106095960 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0738021040 con 0x559997a5da80 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f0710ff9640 1 -- 10.20.193.4:0/4106095960 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0738012ea0 con 0x559997a5da80 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 1 -- 10.20.193.4:0/4106095960 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599978b46d0 con 0x559997a5da80 2026-02-24T09:09:57.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f0710ff9640 1 -- 10.20.193.4:0/4106095960 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f07380256b0 con 0x559997a5da80 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f0710ff9640 10 client.15606 inactive, discarding osd_map(75..75 src has 1..75) 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 10 client.15606 _ll_register_callbacks cb 0x55999789ff00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 1 -- 10.20.193.4:0/4106095960 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f073801b950 con 0x559997a5da80 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f0710ff9640 1 -- 10.20.193.4:0/4106095960 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f073801bce0 con 0x559997a5da80 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 10 client.15606 fetch_fsmap learned FSMap version 19 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 1 -- 10.20.193.4:0/4106095960 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5599978b4930 con 0x559997a5da80 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f0710ff9640 1 -- 10.20.193.4:0/4106095960 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0738025870 con 0x559997a5da80 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 10 client.15606 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 10 client.15606 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 20 client.15606 populate_metadata read hostname 'trial004' 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559997a82330 0x559997a81040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 4 client.15606 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f074f12fe00 1 -- 10.20.193.4:0/4106095960 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "status"}) -- 0x5599975a9e50 con 0x559997a82330 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.194+0000 7f0746d76640 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559997a82330 0x559997a81040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f0746d76640 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559997a82330 0x559997a81040 crc :-1 s=READY pgs=21 gs=4 cs=0 l=0 c_cookie=5037129893017891211 s_cookie=8771393255820493546 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45e77af328d5318b server_cookie=79ba3fb17e7002ea in_seq=0 out_seq=0 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f0710ff9640 10 client.15606 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f0710ff9640 1 -- 10.20.193.4:0/4106095960 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1218 (crc 0 0 0) 0x5599975a9e50 con 0x559997a82330 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f0710ff9640 10 client.15606 handle_command_reply: tid=0 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 client.15606 shutdown 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 -- 10.20.193.4:0/4106095960 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 msgr2=0x559997a33cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a33cb0 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=15201859593175689976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07380037e0 tx=0x7f07380068a0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 -- 10.20.193.4:0/4106095960 shutdown_connections 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559997a82330 0x559997a81040 crc :-1 s=READY pgs=21 gs=4 cs=0 l=0 c_cookie=5037129893017891211 s_cookie=8771393255820493546 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559997a5da80 0x559997a33cb0 unknown :-1 s=CLOSED pgs=465 gs=1 cs=0 l=1 c_cookie=15201859593175689976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f0710ff9640 0 client.15606 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559997a18de0 0x559997a2e1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 --2- 10.20.193.4:0/4106095960 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559997a184d0 0x559997a2dc60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 -- 10.20.193.4:0/4106095960 >> 10.20.193.4:0/4106095960 conn(0x559997937480 msgr2=0x559997a1b360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 -- 10.20.193.4:0/4106095960 shutdown_connections 2026-02-24T09:09:57.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 1 -- 10.20.193.4:0/4106095960 wait complete. 2026-02-24T09:09:57.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074f12fe00 20 client.15606 trim_cache size 0 max 16384 2026-02-24T09:09:57.210 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:57.210 INFO:teuthology.orchestra.run.trial004.stdout: "cluster_fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:09:57.210 INFO:teuthology.orchestra.run.trial004.stdout: "whoami": 2, 2026-02-24T09:09:57.210 INFO:teuthology.orchestra.run.trial004.stdout: "id": 24620, 2026-02-24T09:09:57.210 INFO:teuthology.orchestra.run.trial004.stdout: "want_state": "up:active", 2026-02-24T09:09:57.210 INFO:teuthology.orchestra.run.trial004.stdout: "state": "up:active", 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "fs_name": "cephfs", 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "rank_uptime": 28.258553057, 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "mdsmap_epoch": 19, 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch": 75, 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch_barrier": 75, 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "uptime": 36.522150160999999, 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "sysinfo": { 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "arch": "x86_64", 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_release": "tentacle", 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "container_hostname": "trial014", 2026-02-24T09:09:57.211 INFO:teuthology.orchestra.run.trial004.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "distro": "centos", 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "distro_version": "9", 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": "trial014", 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "mem_total_kb": "130438936", 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "os": "Linux" 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout: "endian": "little" 2026-02-24T09:09:57.212 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:57.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 -- 10.20.193.4:0/3285872933 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f071c0b5770 msgr2=0x7f071c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f071c0b5770 0x7f071c0d5c20 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073c0023d0 tx=0x7f073c031040 comp rx=0 tx=0).stop 2026-02-24T09:09:57.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 -- 10.20.193.4:0/3285872933 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f074810fc70 msgr2=0x7f074811e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f074810fc70 0x7f074811e0a0 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f073000d950 tx=0x7f073000de20 comp rx=0 tx=0).stop 2026-02-24T09:09:57.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 -- 10.20.193.4:0/3285872933 shutdown_connections 2026-02-24T09:09:57.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f071c0b5770 0x7f071c0d5c20 unknown :-1 s=CLOSED pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0748115470 0x7f0748123470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f074810fc70 0x7f074811e0a0 unknown :-1 s=CLOSED pgs=461 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 --2- 10.20.193.4:0/3285872933 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f074810f280 0x7f074811db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 -- 10.20.193.4:0/3285872933 >> 10.20.193.4:0/3285872933 conn(0x7f074805f830 msgr2=0x7f074810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.195+0000 7f074d135640 1 -- 10.20.193.4:0/3285872933 shutdown_connections 2026-02-24T09:09:57.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.196+0000 7f074d135640 1 -- 10.20.193.4:0/3285872933 wait complete. 2026-02-24T09:09:57.232 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.c status 2026-02-24T09:09:57.348 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:57.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/811119934 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c6410f280 msgr2=0x7f8c6410f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 --2- 10.20.193.4:0/811119934 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c6410f280 0x7f8c6410f650 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=15676910150555829281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c50009950 tx=0x7f8c5002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/811119934 shutdown_connections 2026-02-24T09:09:57.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 --2- 10.20.193.4:0/811119934 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c64115470 0x7f8c64175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 --2- 10.20.193.4:0/811119934 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c6410fc70 0x7f8c64114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 --2- 10.20.193.4:0/811119934 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c6410f280 0x7f8c6410f650 unknown :-1 s=CLOSED pgs=466 gs=1 cs=0 l=1 c_cookie=15676910150555829281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/811119934 >> 10.20.193.4:0/811119934 conn(0x7f8c6405f830 msgr2=0x7f8c6410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/811119934 shutdown_connections 2026-02-24T09:09:57.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/811119934 wait complete. 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 Processor -- start 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.452+0000 7f8c6a6e9640 1 -- start start 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c6a6e9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c6410f280 0x7f8c6411db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c6a6e9640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c6410fc70 0x7f8c6411e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c6a6e9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c64115470 0x7f8c64123470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c6a6e9640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64123a90 con 0x7f8c64115470 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c6a6e9640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64123c00 con 0x7f8c6410fc70 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c6a6e9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64123dc0 con 0x7f8c6410f280 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c68c5f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c64115470 0x7f8c64123470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c68c5f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c64115470 0x7f8c64123470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50920/0 (socket says 10.20.193.4:50920) 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c68c5f640 1 -- 10.20.193.4:0/3345078246 learned_addr learned my addr 10.20.193.4:0/3345078246 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c63fff640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c6410f280 0x7f8c6411db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c637fe640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c6410fc70 0x7f8c6411e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c68c5f640 1 -- 10.20.193.4:0/3345078246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c6410f280 msgr2=0x7f8c6411db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c68c5f640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c6410f280 0x7f8c6411db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c68c5f640 1 -- 10.20.193.4:0/3345078246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c6410fc70 msgr2=0x7f8c6411e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c68c5f640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c6410fc70 0x7f8c6411e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c68c5f640 1 -- 10.20.193.4:0/3345078246 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c50009570 con 0x7f8c64115470 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c637fe640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c6410fc70 0x7f8c6411e0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c68c5f640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c64115470 0x7f8c64123470 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c58006e90 tx=0x7f8c5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c617fa640 1 -- 10.20.193.4:0/3345078246 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c58005500 con 0x7f8c64115470 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c617fa640 1 -- 10.20.193.4:0/3345078246 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8c58005e10 con 0x7f8c64115470 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/3345078246 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c641240a0 con 0x7f8c64115470 2026-02-24T09:09:57.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c617fa640 1 -- 10.20.193.4:0/3345078246 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c58003a90 con 0x7f8c64115470 2026-02-24T09:09:57.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.453+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/3345078246 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c641647a0 con 0x7f8c64115470 2026-02-24T09:09:57.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.455+0000 7f8c617fa640 1 -- 10.20.193.4:0/3345078246 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f8c58003c20 con 0x7f8c64115470 2026-02-24T09:09:57.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.456+0000 7f8c617fa640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c380b5770 0x7f8c380d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.456+0000 7f8c63fff640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c380b5770 0x7f8c380d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.456+0000 7f8c617fa640 1 -- 10.20.193.4:0/3345078246 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f8c580e79e0 con 0x7f8c64115470 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.456+0000 7f8c63fff640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c380b5770 0x7f8c380d5c20 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c50005b30 tx=0x7f8c5003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c6c6e3e00 1 Processor -- start 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c6c6e3e00 1 -- start start 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f21187f8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 0x55f2118c4540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f2118e4e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f21178fd70 con 0x55f21187f4d0 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f21178baa0 con 0x55f21187fde0 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f211785c00 con 0x55f2118c4a80 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c63fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f21187f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c63fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f21187f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50936/0 (socket says 10.20.193.4:50936) 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c63fff640 1 -- 10.20.193.4:0/1359526871 learned_addr learned my addr 10.20.193.4:0/1359526871 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c68c5f640 1 --2- 10.20.193.4:0/1359526871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f2118e4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c63fff640 1 -- 10.20.193.4:0/1359526871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 msgr2=0x55f2118e4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c63fff640 1 --2- 10.20.193.4:0/1359526871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f2118e4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c637fe640 1 --2- 10.20.193.4:0/1359526871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 0x55f2118c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c63fff640 1 -- 10.20.193.4:0/1359526871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 msgr2=0x55f2118c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c63fff640 1 --2- 10.20.193.4:0/1359526871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 0x55f2118c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c63fff640 1 -- 10.20.193.4:0/1359526871 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f211731300 con 0x55f21187f4d0 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c637fe640 1 --2- 10.20.193.4:0/1359526871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 0x55f2118c4540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.457+0000 7f8c63fff640 1 --2- 10.20.193.4:0/1359526871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f21187f8a0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=8800964974867753135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c50005960 tx=0x7f8c50040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a234f03dfa5a8af server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c34ce3640 1 -- 10.20.193.4:0/1359526871 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c50002b00 con 0x55f21187f4d0 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c34ce3640 1 -- 10.20.193.4:0/1359526871 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8c5003e040 con 0x55f21187f4d0 2026-02-24T09:09:57.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c34ce3640 1 -- 10.20.193.4:0/1359526871 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c5004f970 con 0x55f21187f4d0 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/1359526871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 msgr2=0x55f21187f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/1359526871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f21187f8a0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=8800964974867753135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c50005960 tx=0x7f8c50040000 comp rx=0 tx=0).stop 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/1359526871 shutdown_connections 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/1359526871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f2118e4e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/1359526871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 0x55f2118c4540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/1359526871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f21187f8a0 unknown :-1 s=CLOSED pgs=468 gs=1 cs=0 l=1 c_cookie=8800964974867753135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/1359526871 >> 10.20.193.4:0/1359526871 conn(0x55f21179e480 msgr2=0x55f21187ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/1359526871 shutdown_connections 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.458+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/1359526871 wait complete. 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c6c6e3e00 1 -- start start 2026-02-24T09:09:57.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c6c6e3e00 1 Processor -- start 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187f4d0 0x55f2118978c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f211897e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f21189cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f21189d330 con 0x55f21187fde0 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f21189d4a0 con 0x55f21187f4d0 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f21189d660 con 0x55f2118c4a80 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c637fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f211897e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c637fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f211897e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50944/0 (socket says 10.20.193.4:50944) 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c637fe640 1 -- 10.20.193.4:0/3996742896 learned_addr learned my addr 10.20.193.4:0/3996742896 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c63fff640 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187f4d0 0x55f2118978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c68c5f640 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f21189cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c637fe640 1 -- 10.20.193.4:0/3996742896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 msgr2=0x55f21189cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c637fe640 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f21189cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c637fe640 1 -- 10.20.193.4:0/3996742896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187f4d0 msgr2=0x55f2118978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c637fe640 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187f4d0 0x55f2118978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c637fe640 1 -- 10.20.193.4:0/3996742896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2117098b0 con 0x55f21187fde0 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c68c5f640 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f21189cdf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c637fe640 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f211897e00 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=14018152625351093651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c54002fd0 tx=0x7f8c54010810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28a7b8a9942ed93 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c25ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c25ffb640 1 -- 10.20.193.4:0/3996742896 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c54012940 con 0x55f21187fde0 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c25ffb640 1 -- 10.20.193.4:0/3996742896 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8c5401b480 con 0x55f21187fde0 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/3996742896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c641766b0 con 0x55f21187fde0 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.459+0000 7f8c25ffb640 1 -- 10.20.193.4:0/3996742896 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c540116f0 con 0x55f21187fde0 2026-02-24T09:09:57.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c25ffb640 1 -- 10.20.193.4:0/3996742896 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f8c54016070 con 0x55f21187fde0 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c25ffb640 10 client.15618 inactive, discarding osd_map(75..75 src has 1..75) 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c6c6e3e00 10 client.15618 _ll_register_callbacks cb 0x55f211706f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/3996742896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f211413600 con 0x55f21187fde0 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c25ffb640 1 -- 10.20.193.4:0/3996742896 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8c54012aa0 con 0x55f21187fde0 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c6c6e3e00 10 client.15618 fetch_fsmap learned FSMap version 19 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/3996742896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f21171b6d0 con 0x55f21187fde0 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c25ffb640 1 -- 10.20.193.4:0/3996742896 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f8c54012c40 con 0x55f21187fde0 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c6c6e3e00 10 client.15618 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c6c6e3e00 10 client.15618 resolve_mds: resolved name 'c' to daemon mds.c 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c6c6e3e00 20 client.15618 populate_metadata read hostname 'trial004' 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f2118c3040 0x55f2118c4360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c6c6e3e00 4 client.15618 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/3996742896 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f211796d50 con 0x55f2118c3040 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.460+0000 7f8c63fff640 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f2118c3040 0x55f2118c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.461+0000 7f8c63fff640 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f2118c3040 0x55f2118c4360 crc :-1 s=READY pgs=21 gs=4 cs=0 l=0 c_cookie=789705744741214223 s_cookie=15320769321806131446 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af59930d862a80f server_cookie=d49e4e8677f4f0f6 in_seq=0 out_seq=0 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.461+0000 7f8c25ffb640 10 client.15618 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c25ffb640 1 -- 10.20.193.4:0/3996742896 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f211796d50 con 0x55f2118c3040 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c25ffb640 10 client.15618 handle_command_reply: tid=0 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 client.15618 shutdown 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/3996742896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 msgr2=0x55f211897e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f211897e00 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=14018152625351093651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c54002fd0 tx=0x7f8c54010810 comp rx=0 tx=0).stop 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/3996742896 shutdown_connections 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f2118c3040 0x55f2118c4360 crc :-1 s=READY pgs=21 gs=4 cs=0 l=0 c_cookie=789705744741214223 s_cookie=15320769321806131446 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f21189cdf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f211897e00 unknown :-1 s=CLOSED pgs=469 gs=1 cs=0 l=1 c_cookie=14018152625351093651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/3996742896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187f4d0 0x55f2118978c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c25ffb640 0 client.15618 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:57.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/3996742896 >> 10.20.193.4:0/3996742896 conn(0x55f21179e480 msgr2=0x55f21187e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/3996742896 shutdown_connections 2026-02-24T09:09:57.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/3996742896 wait complete. 2026-02-24T09:09:57.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.462+0000 7f8c6c6e3e00 20 client.15618 trim_cache size 0 max 16384 2026-02-24T09:09:57.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c6c6e3e00 1 Processor -- start 2026-02-24T09:09:57.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c6c6e3e00 1 -- start start 2026-02-24T09:09:57.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f211884ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 0x55f2118bd240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f2118bd780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f211783830 con 0x55f21187f4d0 2026-02-24T09:09:57.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f21144ee60 con 0x55f21187fde0 2026-02-24T09:09:57.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f21155fe60 con 0x55f2118c4a80 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c63fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f211884ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c63fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f211884ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50946/0 (socket says 10.20.193.4:50946) 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c63fff640 1 -- 10.20.193.4:0/607948944 learned_addr learned my addr 10.20.193.4:0/607948944 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c637fe640 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 0x55f2118bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c68c5f640 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f2118bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c63fff640 1 -- 10.20.193.4:0/607948944 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 msgr2=0x55f2118bd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c63fff640 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f2118bd780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c63fff640 1 -- 10.20.193.4:0/607948944 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 msgr2=0x55f2118bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c63fff640 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 0x55f2118bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c63fff640 1 -- 10.20.193.4:0/607948944 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f211716150 con 0x55f21187f4d0 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c68c5f640 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f2118bd780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:57.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c637fe640 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 0x55f2118bd240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c63fff640 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f211884ba0 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=13250475656788038112 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c5004f4b0 tx=0x7f8c50002e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e32567e3cfd1e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c27fff640 1 -- 10.20.193.4:0/607948944 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c50002b20 con 0x55f21187f4d0 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c27fff640 1 -- 10.20.193.4:0/607948944 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8c50038e90 con 0x55f21187f4d0 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.471+0000 7f8c27fff640 1 -- 10.20.193.4:0/607948944 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c5005fd40 con 0x55f21187f4d0 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/607948944 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 msgr2=0x55f211884ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f211884ba0 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=13250475656788038112 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c5004f4b0 tx=0x7f8c50002e60 comp rx=0 tx=0).stop 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/607948944 shutdown_connections 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f2118c4a80 0x55f2118bd780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f21187fde0 0x55f2118bd240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/607948944 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187f4d0 0x55f211884ba0 unknown :-1 s=CLOSED pgs=470 gs=1 cs=0 l=1 c_cookie=13250475656788038112 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/607948944 >> 10.20.193.4:0/607948944 conn(0x55f21179e480 msgr2=0x55f2118c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/607948944 shutdown_connections 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/607948944 wait complete. 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 -- start start 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.472+0000 7f8c6c6e3e00 1 Processor -- start 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f21187f4d0 0x55f211895490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f21189ddb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f2118c4a80 0x55f21189e2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f211898960 con 0x55f21187fde0 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f211848520 con 0x55f2118c4a80 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f211890a40 con 0x55f21187f4d0 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c637fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f21189ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c637fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f21189ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50956/0 (socket says 10.20.193.4:50956) 2026-02-24T09:09:57.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c637fe640 1 -- 10.20.193.4:0/4131295213 learned_addr learned my addr 10.20.193.4:0/4131295213 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c68c5f640 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f2118c4a80 0x55f21189e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c63fff640 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f21187f4d0 0x55f211895490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c637fe640 1 -- 10.20.193.4:0/4131295213 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f21187f4d0 msgr2=0x55f211895490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c637fe640 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f21187f4d0 0x55f211895490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c637fe640 1 -- 10.20.193.4:0/4131295213 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f2118c4a80 msgr2=0x55f21189e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c637fe640 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f2118c4a80 0x55f21189e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c637fe640 1 -- 10.20.193.4:0/4131295213 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f211709be0 con 0x55f21187fde0 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c637fe640 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f21189ddb0 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=2606820943357575748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c540254c0 tx=0x7f8c54011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242d49d621e08244 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c25ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c25ffb640 1 -- 10.20.193.4:0/4131295213 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c54033070 con 0x55f21187fde0 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/4131295213 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f211731300 con 0x55f21187fde0 2026-02-24T09:09:57.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c25ffb640 1 -- 10.20.193.4:0/4131295213 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f211413600 con 0x55f21187fde0 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c25ffb640 1 -- 10.20.193.4:0/4131295213 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c5401ba40 con 0x55f21187fde0 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 10 client.15624 _ll_register_callbacks cb 0x55f211706f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/4131295213 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c5003e040 con 0x55f21187fde0 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c25ffb640 1 -- 10.20.193.4:0/4131295213 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f8c54016050 con 0x55f21187fde0 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c25ffb640 1 -- 10.20.193.4:0/4131295213 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8c54012720 con 0x55f21187fde0 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 10 client.15624 fetch_fsmap learned FSMap version 19 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/4131295213 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f21171b930 con 0x55f21187fde0 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c25ffb640 1 -- 10.20.193.4:0/4131295213 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f8c540113e0 con 0x55f21187fde0 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 10 client.15624 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 10 client.15624 resolve_mds: resolved name 'c' to daemon mds.c 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 20 client.15624 populate_metadata read hostname 'trial004' 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f211976970 0x55f211975680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 4 client.15624 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.473+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/4131295213 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "status"}) -- 0x55f211410e50 con 0x55f211976970 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c63fff640 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f211976970 0x55f211975680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c63fff640 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f211976970 0x55f211975680 crc :-1 s=READY pgs=22 gs=4 cs=0 l=0 c_cookie=8988425421947684303 s_cookie=3266977359600828077 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7cbd4d4c6d4845cf server_cookie=2d56a29970403ead in_seq=0 out_seq=0 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c25ffb640 10 client.15624 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c25ffb640 1 -- 10.20.193.4:0/4131295213 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x55f211410e50 con 0x55f211976970 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c25ffb640 10 client.15624 handle_command_reply: tid=0 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 client.15624 shutdown 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/4131295213 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 msgr2=0x55f21189ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f21189ddb0 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=2606820943357575748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c540254c0 tx=0x7f8c54011b70 comp rx=0 tx=0).stop 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/4131295213 shutdown_connections 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f211976970 0x55f211975680 crc :-1 s=READY pgs=22 gs=4 cs=0 l=0 c_cookie=8988425421947684303 s_cookie=3266977359600828077 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f2118c4a80 0x55f21189e2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f21187fde0 0x55f21189ddb0 unknown :-1 s=CLOSED pgs=471 gs=1 cs=0 l=1 c_cookie=2606820943357575748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 --2- 10.20.193.4:0/4131295213 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f21187f4d0 0x55f211895490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c25ffb640 0 client.15624 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:09:57.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/4131295213 >> 10.20.193.4:0/4131295213 conn(0x55f21179e480 msgr2=0x55f211895cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/4131295213 shutdown_connections 2026-02-24T09:09:57.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.474+0000 7f8c6c6e3e00 1 -- 10.20.193.4:0/4131295213 wait complete. 2026-02-24T09:09:57.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6c6e3e00 20 client.15624 trim_cache size 0 max 16384 2026-02-24T09:09:57.487 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:57.488 INFO:teuthology.orchestra.run.trial004.stdout: "cluster_fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:09:57.488 INFO:teuthology.orchestra.run.trial004.stdout: "whoami": 1, 2026-02-24T09:09:57.488 INFO:teuthology.orchestra.run.trial004.stdout: "id": 24625, 2026-02-24T09:09:57.488 INFO:teuthology.orchestra.run.trial004.stdout: "want_state": "up:active", 2026-02-24T09:09:57.488 INFO:teuthology.orchestra.run.trial004.stdout: "state": "up:active", 2026-02-24T09:09:57.488 INFO:teuthology.orchestra.run.trial004.stdout: "fs_name": "cephfs", 2026-02-24T09:09:57.488 INFO:teuthology.orchestra.run.trial004.stdout: "rank_uptime": 29.540413449999999, 2026-02-24T09:09:57.488 INFO:teuthology.orchestra.run.trial004.stdout: "mdsmap_epoch": 19, 2026-02-24T09:09:57.488 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch": 75, 2026-02-24T09:09:57.488 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch_barrier": 75, 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "uptime": 40.281324408000003, 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "sysinfo": { 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "arch": "x86_64", 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_release": "tentacle", 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "container_hostname": "trial090", 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "distro": "centos", 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "distro_version": "9", 2026-02-24T09:09:57.489 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": "trial090", 2026-02-24T09:09:57.490 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-24T09:09:57.490 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-24T09:09:57.490 INFO:teuthology.orchestra.run.trial004.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:09:57.490 INFO:teuthology.orchestra.run.trial004.stdout: "mem_total_kb": "130438940", 2026-02-24T09:09:57.490 INFO:teuthology.orchestra.run.trial004.stdout: "os": "Linux" 2026-02-24T09:09:57.490 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:09:57.490 INFO:teuthology.orchestra.run.trial004.stdout: "endian": "little" 2026-02-24T09:09:57.490 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:57.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/3345078246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c380b5770 msgr2=0x7f8c380d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c380b5770 0x7f8c380d5c20 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c50005b30 tx=0x7f8c5003a040 comp rx=0 tx=0).stop 2026-02-24T09:09:57.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/3345078246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c64115470 msgr2=0x7f8c64123470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c64115470 0x7f8c64123470 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c58006e90 tx=0x7f8c5800edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/3345078246 shutdown_connections 2026-02-24T09:09:57.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c380b5770 0x7f8c380d5c20 unknown :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c64115470 0x7f8c64123470 unknown :-1 s=CLOSED pgs=467 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c6410fc70 0x7f8c6411e0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 --2- 10.20.193.4:0/3345078246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c6410f280 0x7f8c6411db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/3345078246 >> 10.20.193.4:0/3345078246 conn(0x7f8c6405f830 msgr2=0x7f8c6410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/3345078246 shutdown_connections 2026-02-24T09:09:57.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.475+0000 7f8c6a6e9640 1 -- 10.20.193.4:0/3345078246 wait complete. 2026-02-24T09:09:57.512 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.i status 2026-02-24T09:09:57.631 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.737+0000 7f1893c45640 1 -- 10.20.193.4:0/228125028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f188c10f6c0 msgr2=0x7f188c10fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.737+0000 7f1893c45640 1 --2- 10.20.193.4:0/228125028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f188c10f6c0 0x7f188c10fa90 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=15118679968494445474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f187c009950 tx=0x7f187c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.737+0000 7f1893c45640 1 -- 10.20.193.4:0/228125028 shutdown_connections 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.737+0000 7f1893c45640 1 --2- 10.20.193.4:0/228125028 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f188c1158b0 0x7f188c176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.737+0000 7f1893c45640 1 --2- 10.20.193.4:0/228125028 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f188c1100b0 0x7f188c115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.737+0000 7f1893c45640 1 --2- 10.20.193.4:0/228125028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f188c10f6c0 0x7f188c10fa90 unknown :-1 s=CLOSED pgs=472 gs=1 cs=0 l=1 c_cookie=15118679968494445474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.737+0000 7f1893c45640 1 -- 10.20.193.4:0/228125028 >> 10.20.193.4:0/228125028 conn(0x7f188c0ecfd0 msgr2=0x7f188c10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.737+0000 7f1893c45640 1 -- 10.20.193.4:0/228125028 shutdown_connections 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.737+0000 7f1893c45640 1 -- 10.20.193.4:0/228125028 wait complete. 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f1893c45640 1 Processor -- start 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f1893c45640 1 -- start start 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f1893c45640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f188c10f6c0 0x7f188c11dfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f1893c45640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f188c1100b0 0x7f188c11e510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f1893c45640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f188c1158b0 0x7f188c1238e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f1893c45640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f188c123f00 con 0x7f188c1158b0 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f1893c45640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f188c124070 con 0x7f188c1100b0 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f1893c45640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f188c124230 con 0x7f188c10f6c0 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18921bb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f188c1158b0 0x7f188c1238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18921bb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f188c1158b0 0x7f188c1238e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50972/0 (socket says 10.20.193.4:50972) 2026-02-24T09:09:57.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18921bb640 1 -- 10.20.193.4:0/2669716682 learned_addr learned my addr 10.20.193.4:0/2669716682 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18919ba640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f188c10f6c0 0x7f188c11dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18911b9640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f188c1100b0 0x7f188c11e510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18921bb640 1 -- 10.20.193.4:0/2669716682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f188c10f6c0 msgr2=0x7f188c11dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18921bb640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f188c10f6c0 0x7f188c11dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18921bb640 1 -- 10.20.193.4:0/2669716682 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f188c1100b0 msgr2=0x7f188c11e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18921bb640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f188c1100b0 0x7f188c11e510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18921bb640 1 -- 10.20.193.4:0/2669716682 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c009570 con 0x7f188c1158b0 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f18921bb640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f188c1158b0 0x7f188c1238e0 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1888006e90 tx=0x7f188800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f187affd640 1 -- 10.20.193.4:0/2669716682 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1888005500 con 0x7f188c1158b0 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f187affd640 1 -- 10.20.193.4:0/2669716682 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1888005e10 con 0x7f188c1158b0 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f1893c45640 1 -- 10.20.193.4:0/2669716682 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188c124510 con 0x7f188c1158b0 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f187affd640 1 -- 10.20.193.4:0/2669716682 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1888003a90 con 0x7f188c1158b0 2026-02-24T09:09:57.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.738+0000 7f1893c45640 1 -- 10.20.193.4:0/2669716682 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c164c10 con 0x7f188c1158b0 2026-02-24T09:09:57.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.740+0000 7f187affd640 1 -- 10.20.193.4:0/2669716682 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f188800c840 con 0x7f188c1158b0 2026-02-24T09:09:57.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.741+0000 7f187affd640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18680b57f0 0x7f18680d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.741+0000 7f18919ba640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18680b57f0 0x7f18680d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.741+0000 7f187affd640 1 -- 10.20.193.4:0/2669716682 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f18880e7870 con 0x7f188c1158b0 2026-02-24T09:09:57.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.741+0000 7f18919ba640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18680b57f0 0x7f18680d5ca0 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f187c005b30 tx=0x7f187c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f1895c3fe00 1 Processor -- start 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f1895c3fe00 1 -- start start 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fff4d0 0x557110fff8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557111044540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557111044a80 0x557111064e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557110f0fd70 con 0x557110fffde0 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557110f0baa0 con 0x557110fff4d0 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557110f05c00 con 0x557111044a80 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18911b9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557111044540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18911b9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557111044540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50978/0 (socket says 10.20.193.4:50978) 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18911b9640 1 -- 10.20.193.4:0/2522141653 learned_addr learned my addr 10.20.193.4:0/2522141653 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18921bb640 1 --2- 10.20.193.4:0/2522141653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557111044a80 0x557111064e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18919ba640 1 --2- 10.20.193.4:0/2522141653 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fff4d0 0x557110fff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18911b9640 1 -- 10.20.193.4:0/2522141653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557111044a80 msgr2=0x557111064e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18911b9640 1 --2- 10.20.193.4:0/2522141653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557111044a80 0x557111064e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18911b9640 1 -- 10.20.193.4:0/2522141653 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fff4d0 msgr2=0x557110fff8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18911b9640 1 --2- 10.20.193.4:0/2522141653 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fff4d0 0x557110fff8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18911b9640 1 -- 10.20.193.4:0/2522141653 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557110eb1300 con 0x557110fffde0 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18921bb640 1 --2- 10.20.193.4:0/2522141653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557111044a80 0x557111064e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.742+0000 7f18911b9640 1 --2- 10.20.193.4:0/2522141653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557111044540 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=9388965798943391534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1880002a80 tx=0x7f1880002f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824c4ea6364fff2e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f185a4e6640 1 -- 10.20.193.4:0/2522141653 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f188000fbc0 con 0x557110fffde0 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f185a4e6640 1 -- 10.20.193.4:0/2522141653 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f188000fd20 con 0x557110fffde0 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f185a4e6640 1 -- 10.20.193.4:0/2522141653 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18800109c0 con 0x557110fffde0 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2522141653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 msgr2=0x557111044540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/2522141653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557111044540 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=9388965798943391534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1880002a80 tx=0x7f1880002f50 comp rx=0 tx=0).stop 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2522141653 shutdown_connections 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/2522141653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557111044a80 0x557111064e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/2522141653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557111044540 unknown :-1 s=CLOSED pgs=474 gs=1 cs=0 l=1 c_cookie=9388965798943391534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/2522141653 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fff4d0 0x557110fff8a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2522141653 >> 10.20.193.4:0/2522141653 conn(0x557110f1e480 msgr2=0x557110ffddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2522141653 shutdown_connections 2026-02-24T09:09:57.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.743+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2522141653 wait complete. 2026-02-24T09:09:57.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f1895c3fe00 1 -- start start 2026-02-24T09:09:57.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f1895c3fe00 1 Processor -- start 2026-02-24T09:09:57.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fff4d0 0x5571110179b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fffde0 0x557111017ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101cee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55711101d420 con 0x557111044a80 2026-02-24T09:09:57.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55711101d590 con 0x557110fff4d0 2026-02-24T09:09:57.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55711101d750 con 0x557110fffde0 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18921bb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18921bb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50994/0 (socket says 10.20.193.4:50994) 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18919ba640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fff4d0 0x5571110179b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18911b9640 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fffde0 0x557111017ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18921bb640 1 -- 10.20.193.4:0/2297297974 learned_addr learned my addr 10.20.193.4:0/2297297974 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18921bb640 1 -- 10.20.193.4:0/2297297974 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fffde0 msgr2=0x557111017ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18921bb640 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fffde0 0x557111017ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18921bb640 1 -- 10.20.193.4:0/2297297974 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fff4d0 msgr2=0x5571110179b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18921bb640 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fff4d0 0x5571110179b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18921bb640 1 -- 10.20.193.4:0/2297297974 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18800026a0 con 0x557111044a80 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18921bb640 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101cee0 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=16412847588559189502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1888008fd0 tx=0x7f18880aa0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c625ec3cb275fe server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.744+0000 7f18477fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:57.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.746+0000 7f18477fe640 1 -- 10.20.193.4:0/2297297974 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18880ad970 con 0x557111044a80 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.746+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2297297974 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c164c10 con 0x557111044a80 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.746+0000 7f18477fe640 1 -- 10.20.193.4:0/2297297974 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18880ae5b0 con 0x557111044a80 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.746+0000 7f1895c3fe00 10 client.15636 _ll_register_callbacks cb 0x557110e86f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.746+0000 7f18477fe640 1 -- 10.20.193.4:0/2297297974 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18880ae840 con 0x557111044a80 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.746+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2297297974 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557110b93600 con 0x557111044a80 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.746+0000 7f18477fe640 1 -- 10.20.193.4:0/2297297974 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f18880ae9a0 con 0x557111044a80 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.746+0000 7f18477fe640 1 -- 10.20.193.4:0/2297297974 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f18880abb90 con 0x557111044a80 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.746+0000 7f1895c3fe00 10 client.15636 fetch_fsmap learned FSMap version 19 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.746+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2297297974 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557110e898b0 con 0x557111044a80 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.747+0000 7f18477fe640 1 -- 10.20.193.4:0/2297297974 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f18880970e0 con 0x557111044a80 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.747+0000 7f1895c3fe00 10 client.15636 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.747+0000 7f1895c3fe00 10 client.15636 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.747+0000 7f1895c3fe00 20 client.15636 populate_metadata read hostname 'trial004' 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.747+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557111042fa0 0x557111043d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.747+0000 7f1895c3fe00 4 client.15636 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.747+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2297297974 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557110f16d50 con 0x557111042fa0 2026-02-24T09:09:57.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.747+0000 7f18919ba640 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557111042fa0 0x557111043d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.748+0000 7f18919ba640 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557111042fa0 0x557111043d40 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=3678144135778720721 s_cookie=15182827477784823706 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=330b649a95c6dbd1 server_cookie=d2b43d262367879a in_seq=0 out_seq=0 2026-02-24T09:09:57.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.748+0000 7f18477fe640 10 client.15636 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:57.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.748+0000 7f18477fe640 1 -- 10.20.193.4:0/2297297974 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557110f16d50 con 0x557111042fa0 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.748+0000 7f18477fe640 10 client.15636 handle_command_reply: tid=0 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.748+0000 7f1895c3fe00 1 client.15636 shutdown 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2297297974 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 msgr2=0x55711101cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101cee0 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=16412847588559189502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1888008fd0 tx=0x7f18880aa0a0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2297297974 shutdown_connections 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557111042fa0 0x557111043d40 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=3678144135778720721 s_cookie=15182827477784823706 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101cee0 unknown :-1 s=CLOSED pgs=475 gs=1 cs=0 l=1 c_cookie=16412847588559189502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fffde0 0x557111017ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/2297297974 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fff4d0 0x5571110179b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f18477fe640 0 client.15636 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2297297974 >> 10.20.193.4:0/2297297974 conn(0x557110f1e480 msgr2=0x557110ffe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2297297974 shutdown_connections 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 1 -- 10.20.193.4:0/2297297974 wait complete. 2026-02-24T09:09:57.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.749+0000 7f1895c3fe00 20 client.15636 trim_cache size 0 max 16384 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.757+0000 7f1895c3fe00 1 Processor -- start 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f1895c3fe00 1 -- start start 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fff4d0 0x557110ffe6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557110ffec00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557111044a80 0x55711103d3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557110f03830 con 0x557110fffde0 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557110bcee60 con 0x557111044a80 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5571110438a0 con 0x557110fff4d0 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18911b9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557110ffec00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18911b9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557110ffec00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51008/0 (socket says 10.20.193.4:51008) 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18911b9640 1 -- 10.20.193.4:0/3195857762 learned_addr learned my addr 10.20.193.4:0/3195857762 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18919ba640 1 --2- 10.20.193.4:0/3195857762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fff4d0 0x557110ffe6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18921bb640 1 --2- 10.20.193.4:0/3195857762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557111044a80 0x55711103d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18911b9640 1 -- 10.20.193.4:0/3195857762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fff4d0 msgr2=0x557110ffe6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18911b9640 1 --2- 10.20.193.4:0/3195857762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fff4d0 0x557110ffe6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18911b9640 1 -- 10.20.193.4:0/3195857762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557111044a80 msgr2=0x55711103d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18911b9640 1 --2- 10.20.193.4:0/3195857762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557111044a80 0x55711103d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18911b9640 1 -- 10.20.193.4:0/3195857762 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557110e9b6d0 con 0x557110fffde0 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18921bb640 1 --2- 10.20.193.4:0/3195857762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557111044a80 0x55711103d3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f18911b9640 1 --2- 10.20.193.4:0/3195857762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557110ffec00 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=4979423076891518091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18800040a0 tx=0x7f18800040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451a76e80480648b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f1859ce5640 1 -- 10.20.193.4:0/3195857762 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f188000fbc0 con 0x557110fffde0 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f1859ce5640 1 -- 10.20.193.4:0/3195857762 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1880020070 con 0x557110fffde0 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.758+0000 7f1859ce5640 1 -- 10.20.193.4:0/3195857762 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f188001a6d0 con 0x557110fffde0 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 -- 10.20.193.4:0/3195857762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 msgr2=0x557110ffec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/3195857762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557110ffec00 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=4979423076891518091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18800040a0 tx=0x7f18800040d0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 -- 10.20.193.4:0/3195857762 shutdown_connections 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/3195857762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557111044a80 0x55711103d3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/3195857762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557110fffde0 0x557110ffec00 unknown :-1 s=CLOSED pgs=476 gs=1 cs=0 l=1 c_cookie=4979423076891518091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/3195857762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fff4d0 0x557110ffe6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 -- 10.20.193.4:0/3195857762 >> 10.20.193.4:0/3195857762 conn(0x557110f1e480 msgr2=0x557111041d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 -- 10.20.193.4:0/3195857762 shutdown_connections 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 -- 10.20.193.4:0/3195857762 wait complete. 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 -- start start 2026-02-24T09:09:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 Processor -- start 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fff4d0 0x55711103d900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.759+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fffde0 0x55711101df70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101e4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55711103ea20 con 0x557111044a80 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55711101ebe0 con 0x557110fffde0 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55711101eda0 con 0x557110fff4d0 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18921bb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18921bb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51022/0 (socket says 10.20.193.4:51022) 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18921bb640 1 -- 10.20.193.4:0/1837865178 learned_addr learned my addr 10.20.193.4:0/1837865178 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18911b9640 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fffde0 0x55711101df70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18919ba640 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fff4d0 0x55711103d900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18921bb640 1 -- 10.20.193.4:0/1837865178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fff4d0 msgr2=0x55711103d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18921bb640 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fff4d0 0x55711103d900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18921bb640 1 -- 10.20.193.4:0/1837865178 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fffde0 msgr2=0x55711101df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18921bb640 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fffde0 0x55711101df70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18921bb640 1 -- 10.20.193.4:0/1837865178 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557110e96150 con 0x557111044a80 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18921bb640 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101e4b0 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=2492556453629783397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f188800c630 tx=0x7f188800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229756e37135ed65 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18477fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18477fe640 1 -- 10.20.193.4:0/1837865178 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18880b8b30 con 0x557111044a80 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 1 -- 10.20.193.4:0/1837865178 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557110eb1300 con 0x557111044a80 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18477fe640 1 -- 10.20.193.4:0/1837865178 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x557110b93600 con 0x557111044a80 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18477fe640 1 -- 10.20.193.4:0/1837865178 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18880e58c0 con 0x557111044a80 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 10 client.15642 _ll_register_callbacks cb 0x557110e86f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 1 -- 10.20.193.4:0/1837865178 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f188000fd20 con 0x557111044a80 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18477fe640 1 -- 10.20.193.4:0/1837865178 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f1888003e00 con 0x557111044a80 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18477fe640 1 -- 10.20.193.4:0/1837865178 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f18880ad750 con 0x557111044a80 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 10 client.15642 fetch_fsmap learned FSMap version 19 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 1 -- 10.20.193.4:0/1837865178 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557110e89be0 con 0x557111044a80 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18477fe640 1 -- 10.20.193.4:0/1837865178 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f18880ae840 con 0x557111044a80 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 10 client.15642 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 10 client.15642 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 20 client.15642 populate_metadata read hostname 'trial004' 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5571110f6630 0x5571110f5340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 4 client.15642 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f1895c3fe00 1 -- 10.20.193.4:0/1837865178 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "status"}) -- 0x557110b90e50 con 0x5571110f6630 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.760+0000 7f18919ba640 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5571110f6630 0x5571110f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f18919ba640 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5571110f6630 0x5571110f5340 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=13522515754962123461 s_cookie=12453373836733737267 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bba9a06f0c23fac5 server_cookie=acd3458611a86933 in_seq=0 out_seq=0 2026-02-24T09:09:57.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f18477fe640 10 client.15642 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f18477fe640 1 -- 10.20.193.4:0/1837865178 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1224 (crc 0 0 0) 0x557110b90e50 con 0x5571110f6630 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f18477fe640 10 client.15642 handle_command_reply: tid=0 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 client.15642 shutdown 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 -- 10.20.193.4:0/1837865178 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 msgr2=0x55711101e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101e4b0 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=2492556453629783397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f188800c630 tx=0x7f188800cc50 comp rx=0 tx=0).stop 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 -- 10.20.193.4:0/1837865178 shutdown_connections 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5571110f6630 0x5571110f5340 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=13522515754962123461 s_cookie=12453373836733737267 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557111044a80 0x55711101e4b0 unknown :-1 s=CLOSED pgs=477 gs=1 cs=0 l=1 c_cookie=2492556453629783397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f18477fe640 0 client.15642 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557110fffde0 0x55711101df70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 --2- 10.20.193.4:0/1837865178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557110fff4d0 0x55711103d900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 -- 10.20.193.4:0/1837865178 >> 10.20.193.4:0/1837865178 conn(0x557110f1e480 msgr2=0x5571110178c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 -- 10.20.193.4:0/1837865178 shutdown_connections 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 1 -- 10.20.193.4:0/1837865178 wait complete. 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.761+0000 7f1895c3fe00 20 client.15642 trim_cache size 0 max 16384 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "cluster_fsid": "19e0945d-1160-11f1-92cf-d404e6e7d460", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "whoami": 0, 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "id": 24637, 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "want_state": "up:active", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "state": "up:active", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "fs_name": "cephfs", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "rank_uptime": 32.496847365999997, 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "mdsmap_epoch": 19, 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch": 75, 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_epoch_barrier": 75, 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "uptime": 39.191823444000001, 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "sysinfo": { 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "arch": "x86_64", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_release": "tentacle", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version": "ceph version 20.3.0-5537-g5bc9a1ff (5bc9a1ffc19df681248ece8c3c8c7191a571745b) tentacle (dev - RelWithDebInfo)", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_version_short": "20.3.0-5537-g5bc9a1ff", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "container_hostname": "trial090", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "container_image": "quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-24T09:09:57.764 INFO:teuthology.orchestra.run.trial004.stdout: "distro": "centos", 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout: "distro_description": "CentOS Stream 9", 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout: "distro_version": "9", 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": "trial090", 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout: "mem_swap_kb": "8388604", 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout: "mem_total_kb": "130438940", 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout: "os": "Linux" 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout: "endian": "little" 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 -- 10.20.193.4:0/2669716682 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18680b57f0 msgr2=0x7f18680d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18680b57f0 0x7f18680d5ca0 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f187c005b30 tx=0x7f187c03a040 comp rx=0 tx=0).stop 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 -- 10.20.193.4:0/2669716682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f188c1158b0 msgr2=0x7f188c1238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f188c1158b0 0x7f188c1238e0 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1888006e90 tx=0x7f188800edf0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 -- 10.20.193.4:0/2669716682 shutdown_connections 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18680b57f0 0x7f18680d5ca0 unknown :-1 s=CLOSED pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f188c1158b0 0x7f188c1238e0 unknown :-1 s=CLOSED pgs=473 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f188c1100b0 0x7f188c11e510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 --2- 10.20.193.4:0/2669716682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f188c10f6c0 0x7f188c11dfd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 -- 10.20.193.4:0/2669716682 >> 10.20.193.4:0/2669716682 conn(0x7f188c0ecfd0 msgr2=0x7f188c10d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 -- 10.20.193.4:0/2669716682 shutdown_connections 2026-02-24T09:09:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:09:57.762+0000 7f1893c45640 1 -- 10.20.193.4:0/2669716682 wait complete. 2026-02-24T09:09:57.799 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2026-02-24T09:09:58.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:57 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3215051032' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:58.092 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:57 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3215051032' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:58.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:57 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3215051032' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:09:58.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:58 trial004 ceph-mon[41596]: pgmap v153: 97 pgs: 97 active+clean; 660 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2026-02-24T09:09:58.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:09:58 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:09:59.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:58 trial090 ceph-mon[47278]: pgmap v153: 97 pgs: 97 active+clean; 660 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2026-02-24T09:09:59.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:09:58 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:09:59.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:58 trial014 ceph-mon[46941]: pgmap v153: 97 pgs: 97 active+clean; 660 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2026-02-24T09:09:59.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:09:58 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:10:01.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:00 trial090 ceph-mon[47278]: pgmap v154: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2026-02-24T09:10:01.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:00 trial090 ceph-mon[47278]: overall HEALTH_OK 2026-02-24T09:10:01.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:00 trial014 ceph-mon[46941]: pgmap v154: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2026-02-24T09:10:01.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:00 trial014 ceph-mon[46941]: overall HEALTH_OK 2026-02-24T09:10:01.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:00 trial004 ceph-mon[41596]: pgmap v154: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2026-02-24T09:10:01.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:00 trial004 ceph-mon[41596]: overall HEALTH_OK 2026-02-24T09:10:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]} : dispatch 2026-02-24T09:10:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2026-02-24T09:10:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-24T09:10:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]} : dispatch 2026-02-24T09:10:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2026-02-24T09:10:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2026-02-24T09:10:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]} : dispatch 2026-02-24T09:10:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6, 5, 9]} : dispatch 2026-02-24T09:10:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2026-02-24T09:10:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]} : dispatch 2026-02-24T09:10:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2026-02-24T09:10:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-24T09:10:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]} : dispatch 2026-02-24T09:10:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2026-02-24T09:10:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2026-02-24T09:10:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]} : dispatch 2026-02-24T09:10:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6, 5, 9]} : dispatch 2026-02-24T09:10:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2026-02-24T09:10:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]} : dispatch 2026-02-24T09:10:02.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2026-02-24T09:10:02.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-24T09:10:02.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]} : dispatch 2026-02-24T09:10:02.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2026-02-24T09:10:02.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2026-02-24T09:10:02.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]} : dispatch 2026-02-24T09:10:02.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6, 5, 9]} : dispatch 2026-02-24T09:10:02.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2026-02-24T09:10:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: pgmap v155: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2026-02-24T09:10:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2026-02-24T09:10:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2026-02-24T09:10:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-24T09:10:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]}]': finished 2026-02-24T09:10:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2026-02-24T09:10:03.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2026-02-24T09:10:03.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2026-02-24T09:10:03.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6, 5, 9]}]': finished 2026-02-24T09:10:03.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2026-02-24T09:10:03.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:02 trial090 ceph-mon[47278]: osdmap e76: 12 total, 12 up, 12 in 2026-02-24T09:10:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: pgmap v155: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2026-02-24T09:10:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2026-02-24T09:10:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2026-02-24T09:10:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-24T09:10:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]}]': finished 2026-02-24T09:10:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2026-02-24T09:10:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2026-02-24T09:10:03.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2026-02-24T09:10:03.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6, 5, 9]}]': finished 2026-02-24T09:10:03.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2026-02-24T09:10:03.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:02 trial014 ceph-mon[46941]: osdmap e76: 12 total, 12 up, 12 in 2026-02-24T09:10:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: pgmap v155: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2026-02-24T09:10:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 6]}]': finished 2026-02-24T09:10:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2026-02-24T09:10:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-24T09:10:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]}]': finished 2026-02-24T09:10:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2026-02-24T09:10:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2026-02-24T09:10:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 7]}]': finished 2026-02-24T09:10:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6, 5, 9]}]': finished 2026-02-24T09:10:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2026-02-24T09:10:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:02 trial004 ceph-mon[41596]: osdmap e76: 12 total, 12 up, 12 in 2026-02-24T09:10:04.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:03 trial090 ceph-mon[47278]: osdmap e77: 12 total, 12 up, 12 in 2026-02-24T09:10:04.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:03 trial014 ceph-mon[46941]: osdmap e77: 12 total, 12 up, 12 in 2026-02-24T09:10:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:03 trial004 ceph-mon[41596]: osdmap e77: 12 total, 12 up, 12 in 2026-02-24T09:10:05.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:04 trial090 ceph-mon[47278]: pgmap v158: 97 pgs: 2 peering, 95 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2026-02-24T09:10:05.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:04 trial014 ceph-mon[46941]: pgmap v158: 97 pgs: 2 peering, 95 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2026-02-24T09:10:05.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:04 trial004 ceph-mon[41596]: pgmap v158: 97 pgs: 2 peering, 95 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2026-02-24T09:10:07.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:06 trial090 ceph-mon[47278]: pgmap v159: 97 pgs: 2 peering, 95 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 5 op/s; 147 B/s, 0 objects/s recovering 2026-02-24T09:10:07.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:06 trial014 ceph-mon[46941]: pgmap v159: 97 pgs: 2 peering, 95 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 5 op/s; 147 B/s, 0 objects/s recovering 2026-02-24T09:10:07.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:06 trial004 ceph-mon[41596]: pgmap v159: 97 pgs: 2 peering, 95 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 5 op/s; 147 B/s, 0 objects/s recovering 2026-02-24T09:10:09.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:08 trial090 ceph-mon[47278]: pgmap v160: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 127 B/s wr, 6 op/s; 147 B/s, 1 objects/s recovering 2026-02-24T09:10:09.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:08 trial014 ceph-mon[46941]: pgmap v160: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 127 B/s wr, 6 op/s; 147 B/s, 1 objects/s recovering 2026-02-24T09:10:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:08 trial004 ceph-mon[41596]: pgmap v160: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 127 B/s wr, 6 op/s; 147 B/s, 1 objects/s recovering 2026-02-24T09:10:11.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:10 trial090 ceph-mon[47278]: pgmap v161: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 147 B/s, 1 objects/s recovering 2026-02-24T09:10:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:10 trial014 ceph-mon[46941]: pgmap v161: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 147 B/s, 1 objects/s recovering 2026-02-24T09:10:11.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:10 trial004 ceph-mon[41596]: pgmap v161: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s; 147 B/s, 1 objects/s recovering 2026-02-24T09:10:12.800 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.5 2026-02-24T09:10:12.801 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:10:12.929 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:13.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 -- 10.20.193.4:0/1136438618 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe91010d010 msgr2=0x7fe91010d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 --2- 10.20.193.4:0/1136438618 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe91010d010 0x7fe91010d3e0 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=6698884688900064713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe900009950 tx=0x7fe90002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 -- 10.20.193.4:0/1136438618 shutdown_connections 2026-02-24T09:10:13.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 --2- 10.20.193.4:0/1136438618 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe910113200 0x7fe910173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 --2- 10.20.193.4:0/1136438618 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe91010da00 0x7fe910112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 --2- 10.20.193.4:0/1136438618 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe91010d010 0x7fe91010d3e0 unknown :-1 s=CLOSED pgs=478 gs=1 cs=0 l=1 c_cookie=6698884688900064713 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 -- 10.20.193.4:0/1136438618 >> 10.20.193.4:0/1136438618 conn(0x7fe91005f830 msgr2=0x7fe91010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:13.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 -- 10.20.193.4:0/1136438618 shutdown_connections 2026-02-24T09:10:13.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 -- 10.20.193.4:0/1136438618 wait complete. 2026-02-24T09:10:13.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 Processor -- start 2026-02-24T09:10:13.042 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:12 trial004 ceph-mon[41596]: pgmap v162: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 119 B/s, 1 objects/s recovering 2026-02-24T09:10:13.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.037+0000 7fe9181cc640 1 -- start start 2026-02-24T09:10:13.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe9181cc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe91010d010 0x7fe91011b920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe9181cc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91010da00 0x7fe91011be60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe9181cc640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe910113200 0x7fe910121230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe9181cc640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe910121850 con 0x7fe91010d010 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe9181cc640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe9101219c0 con 0x7fe910113200 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe9181cc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe910121b80 con 0x7fe91010da00 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915f41640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe91010d010 0x7fe91011b920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915f41640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe91010d010 0x7fe91011b920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:50900/0 (socket says 10.20.193.4:50900) 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915f41640 1 -- 10.20.193.4:0/1808078854 learned_addr learned my addr 10.20.193.4:0/1808078854 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe916742640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe910113200 0x7fe910121230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915f41640 1 -- 10.20.193.4:0/1808078854 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91010da00 msgr2=0x7fe91011be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915740640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91010da00 0x7fe91011be60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915f41640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91010da00 0x7fe91011be60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915f41640 1 -- 10.20.193.4:0/1808078854 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe910113200 msgr2=0x7fe910121230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915f41640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe910113200 0x7fe910121230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915f41640 1 -- 10.20.193.4:0/1808078854 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe900009570 con 0x7fe91010d010 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe916742640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe910113200 0x7fe910121230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915740640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91010da00 0x7fe91011be60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe915f41640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe91010d010 0x7fe91011b920 secure :-1 s=READY pgs=479 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9000023d0 tx=0x7fe9000043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe8feffd640 1 -- 10.20.193.4:0/1808078854 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe90003d070 con 0x7fe91010d010 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe9181cc640 1 -- 10.20.193.4:0/1808078854 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe910121e00 con 0x7fe91010d010 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe8feffd640 1 -- 10.20.193.4:0/1808078854 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe900038920 con 0x7fe91010d010 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe8feffd640 1 -- 10.20.193.4:0/1808078854 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9000419d0 con 0x7fe91010d010 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.038+0000 7fe9181cc640 1 -- 10.20.193.4:0/1808078854 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe910162560 con 0x7fe91010d010 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.039+0000 7fe9181cc640 1 -- 10.20.193.4:0/1808078854 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91010e2f0 con 0x7fe91010d010 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.040+0000 7fe8feffd640 1 -- 10.20.193.4:0/1808078854 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fe900038a90 con 0x7fe91010d010 2026-02-24T09:10:13.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.041+0000 7fe8feffd640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8ec0b5770 0x7fe8ec0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.041+0000 7fe8feffd640 1 -- 10.20.193.4:0/1808078854 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fe90010b9c0 con 0x7fe91010d010 2026-02-24T09:10:13.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.041+0000 7fe915740640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8ec0b5770 0x7fe8ec0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.041+0000 7fe915740640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8ec0b5770 0x7fe8ec0d5c20 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9101222c0 tx=0x7fe904005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:13.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.041+0000 7fe8feffd640 1 -- 10.20.193.4:0/1808078854 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe9000ce3d0 con 0x7fe91010d010 2026-02-24T09:10:13.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:12 trial090 ceph-mon[47278]: pgmap v162: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 119 B/s, 1 objects/s recovering 2026-02-24T09:10:13.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:12 trial014 ceph-mon[46941]: pgmap v162: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 119 B/s, 1 objects/s recovering 2026-02-24T09:10:13.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.173+0000 7fe9181cc640 1 -- 10.20.193.4:0/1808078854 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe91011ca80 con 0x7fe91010d010 2026-02-24T09:10:13.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.173+0000 7fe8feffd640 1 -- 10.20.193.4:0/1808078854 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fe9000d14f0 con 0x7fe91010d010 2026-02-24T09:10:13.177 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:10:13.177 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:10:13.177 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:10:13.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 -- 10.20.193.4:0/1808078854 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8ec0b5770 msgr2=0x7fe8ec0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8ec0b5770 0x7fe8ec0d5c20 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9101222c0 tx=0x7fe904005f00 comp rx=0 tx=0).stop 2026-02-24T09:10:13.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 -- 10.20.193.4:0/1808078854 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe91010d010 msgr2=0x7fe91011b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe91010d010 0x7fe91011b920 secure :-1 s=READY pgs=479 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9000023d0 tx=0x7fe9000043d0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 -- 10.20.193.4:0/1808078854 shutdown_connections 2026-02-24T09:10:13.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8ec0b5770 0x7fe8ec0d5c20 unknown :-1 s=CLOSED pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe910113200 0x7fe910121230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91010da00 0x7fe91011be60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 --2- 10.20.193.4:0/1808078854 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe91010d010 0x7fe91011b920 unknown :-1 s=CLOSED pgs=479 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 -- 10.20.193.4:0/1808078854 >> 10.20.193.4:0/1808078854 conn(0x7fe91005f830 msgr2=0x7fe91010ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:13.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 -- 10.20.193.4:0/1808078854 shutdown_connections 2026-02-24T09:10:13.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.175+0000 7fe9181cc640 1 -- 10.20.193.4:0/1808078854 wait complete. 2026-02-24T09:10:13.459 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 138.5 --await-for 45.0' 2026-02-24T09:10:13.459 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 138.5 --await-for 45.0 2026-02-24T09:10:13.590 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:13.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/2626889517 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d041100b0 msgr2=0x7f7d04115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 --2- 10.20.193.4:0/2626889517 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d041100b0 0x7f7d04115100 secure :-1 s=READY pgs=480 gs=1 cs=0 l=1 c_cookie=16040367491874347348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf8009950 tx=0x7f7cf802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/2626889517 shutdown_connections 2026-02-24T09:10:13.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 --2- 10.20.193.4:0/2626889517 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d041158b0 0x7f7d04176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 --2- 10.20.193.4:0/2626889517 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d041100b0 0x7f7d04115100 unknown :-1 s=CLOSED pgs=480 gs=1 cs=0 l=1 c_cookie=16040367491874347348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 --2- 10.20.193.4:0/2626889517 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d0410f6c0 0x7f7d0410fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/2626889517 >> 10.20.193.4:0/2626889517 conn(0x7f7d040ecfd0 msgr2=0x7f7d0410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:13.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/2626889517 shutdown_connections 2026-02-24T09:10:13.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/2626889517 wait complete. 2026-02-24T09:10:13.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 Processor -- start 2026-02-24T09:10:13.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 -- start start 2026-02-24T09:10:13.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d0410f6c0 0x7f7d040f5a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d041100b0 0x7f7d04176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d041158b0 0x7f7d040f6130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7d040fb340 con 0x7f7d041158b0 2026-02-24T09:10:13.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7d040fb4b0 con 0x7f7d0410f6c0 2026-02-24T09:10:13.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0c3b1640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d040fb670 con 0x7f7d041100b0 2026-02-24T09:10:13.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0a927640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d041158b0 0x7f7d040f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0a927640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d041158b0 0x7f7d040f6130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58620/0 (socket says 10.20.193.4:58620) 2026-02-24T09:10:13.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.711+0000 7f7d0a927640 1 -- 10.20.193.4:0/1185156868 learned_addr learned my addr 10.20.193.4:0/1185156868 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:13.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d0a126640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d0410f6c0 0x7f7d040f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d09925640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d041100b0 0x7f7d04176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d0a927640 1 -- 10.20.193.4:0/1185156868 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d041100b0 msgr2=0x7f7d04176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d0a927640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d041100b0 0x7f7d04176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d0a927640 1 -- 10.20.193.4:0/1185156868 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d0410f6c0 msgr2=0x7f7d040f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d0a927640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d0410f6c0 0x7f7d040f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d0a927640 1 -- 10.20.193.4:0/1185156868 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf8009570 con 0x7f7d041158b0 2026-02-24T09:10:13.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d0a126640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d0410f6c0 0x7f7d040f5a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:10:13.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d0a927640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d041158b0 0x7f7d040f6130 secure :-1 s=READY pgs=481 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d00006e90 tx=0x7f7d0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:13.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7ceb7fe640 1 -- 10.20.193.4:0/1185156868 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d00005500 con 0x7f7d041158b0 2026-02-24T09:10:13.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7ceb7fe640 1 -- 10.20.193.4:0/1185156868 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7d00005e10 con 0x7f7d041158b0 2026-02-24T09:10:13.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/1185156868 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d040fb950 con 0x7f7d041158b0 2026-02-24T09:10:13.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7ceb7fe640 1 -- 10.20.193.4:0/1185156868 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d00003a90 con 0x7f7d041158b0 2026-02-24T09:10:13.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.712+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/1185156868 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d040fbdd0 con 0x7f7d041158b0 2026-02-24T09:10:13.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.714+0000 7f7ceb7fe640 1 -- 10.20.193.4:0/1185156868 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f7d00003c20 con 0x7f7d041158b0 2026-02-24T09:10:13.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.714+0000 7f7ceb7fe640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7ce00b5760 0x7f7ce00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.714+0000 7f7ceb7fe640 1 -- 10.20.193.4:0/1185156868 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f7d000e7b70 con 0x7f7d041158b0 2026-02-24T09:10:13.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.714+0000 7f7d0a126640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7ce00b5760 0x7f7ce00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.714+0000 7f7d0a126640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7ce00b5760 0x7f7ce00d5c10 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf4004740 tx=0x7f7cf40043a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:13.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0e3abe00 1 Processor -- start 2026-02-24T09:10:13.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0e3abe00 1 -- start start 2026-02-24T09:10:13.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9e92bd0 0x5601e9e92fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9ed7c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9ed8180 0x5601e9ef8560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5601e9da1f20 con 0x5601e9ed8180 2026-02-24T09:10:13.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5601e9d9dc50 con 0x5601e9e934e0 2026-02-24T09:10:13.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5601e9d97db0 con 0x5601e9e92bd0 2026-02-24T09:10:13.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a927640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9ed8180 0x5601e9ef8560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a927640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9ed8180 0x5601e9ef8560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58632/0 (socket says 10.20.193.4:58632) 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a927640 1 -- 10.20.193.4:0/3828174261 learned_addr learned my addr 10.20.193.4:0/3828174261 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a126640 1 --2- 10.20.193.4:0/3828174261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9e92bd0 0x5601e9e92fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a927640 1 -- 10.20.193.4:0/3828174261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9e92bd0 msgr2=0x5601e9e92fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a927640 1 --2- 10.20.193.4:0/3828174261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9e92bd0 0x5601e9e92fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a927640 1 -- 10.20.193.4:0/3828174261 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 msgr2=0x5601e9ed7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a927640 1 --2- 10.20.193.4:0/3828174261 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9ed7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a927640 1 -- 10.20.193.4:0/3828174261 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e9d38690 con 0x5601e9ed8180 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a126640 1 --2- 10.20.193.4:0/3828174261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9e92bd0 0x5601e9e92fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7d0a927640 1 --2- 10.20.193.4:0/3828174261 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9ed8180 0x5601e9ef8560 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=8755521668386519920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d000e5540 tx=0x7f7d000adf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7981dc919369fb70 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7ce8884640 1 -- 10.20.193.4:0/3828174261 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d000b3ab0 con 0x5601e9ed8180 2026-02-24T09:10:13.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7ce8884640 1 -- 10.20.193.4:0/3828174261 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7d000b6090 con 0x5601e9ed8180 2026-02-24T09:10:13.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.716+0000 7f7ce8884640 1 -- 10.20.193.4:0/3828174261 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d000ad930 con 0x5601e9ed8180 2026-02-24T09:10:13.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.717+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/3828174261 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9ed8180 msgr2=0x5601e9ef8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.717+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/3828174261 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9ed8180 0x5601e9ef8560 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=8755521668386519920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d000e5540 tx=0x7f7d000adf10 comp rx=0 tx=0).stop 2026-02-24T09:10:13.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.717+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/3828174261 shutdown_connections 2026-02-24T09:10:13.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.717+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/3828174261 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9ed8180 0x5601e9ef8560 unknown :-1 s=CLOSED pgs=482 gs=1 cs=0 l=1 c_cookie=8755521668386519920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.717+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/3828174261 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9ed7c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.717+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/3828174261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9e92bd0 0x5601e9e92fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.717+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/3828174261 >> 10.20.193.4:0/3828174261 conn(0x5601e9db0880 msgr2=0x5601e9e914b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:13.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.717+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/3828174261 shutdown_connections 2026-02-24T09:10:13.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.717+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/3828174261 wait complete. 2026-02-24T09:10:13.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d0e3abe00 1 -- start start 2026-02-24T09:10:13.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d0e3abe00 1 Processor -- start 2026-02-24T09:10:13.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9e92bd0 0x5601e9eaaac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e934e0 0x5601e9eab000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9ed8180 0x5601e9eafff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5601e9eb0530 con 0x5601e9e934e0 2026-02-24T09:10:13.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5601e9eb06a0 con 0x5601e9ed8180 2026-02-24T09:10:13.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5601e9eb0860 con 0x5601e9e92bd0 2026-02-24T09:10:13.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d09925640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e934e0 0x5601e9eab000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d09925640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e934e0 0x5601e9eab000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58634/0 (socket says 10.20.193.4:58634) 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.718+0000 7f7d09925640 1 -- 10.20.193.4:0/2950285835 learned_addr learned my addr 10.20.193.4:0/2950285835 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d09925640 1 -- 10.20.193.4:0/2950285835 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9e92bd0 msgr2=0x5601e9eaaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d09925640 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9e92bd0 0x5601e9eaaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d09925640 1 -- 10.20.193.4:0/2950285835 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9ed8180 msgr2=0x5601e9eafff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d09925640 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9ed8180 0x5601e9eafff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d09925640 1 -- 10.20.193.4:0/2950285835 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e9d433d0 con 0x5601e9e934e0 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d09925640 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e934e0 0x5601e9eab000 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=9146575861565595698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf80386a0 tx=0x7f7cf80386d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eef2a4913c7a032 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7cb7fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7cb7fff640 1 -- 10.20.193.4:0/2950285835 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cf80026a0 con 0x5601e9e934e0 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/2950285835 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d040fbdd0 con 0x5601e9e934e0 2026-02-24T09:10:13.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7cb7fff640 1 -- 10.20.193.4:0/2950285835 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7cf8002800 con 0x5601e9e934e0 2026-02-24T09:10:13.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7cb7fff640 1 -- 10.20.193.4:0/2950285835 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cf8043680 con 0x5601e9e934e0 2026-02-24T09:10:13.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 10 client.15660 _ll_register_callbacks cb 0x5601e9d18a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:13.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/2950285835 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5601e9a25eb0 con 0x5601e9e934e0 2026-02-24T09:10:13.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7cb7fff640 1 -- 10.20.193.4:0/2950285835 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f7cf8038e30 con 0x5601e9e934e0 2026-02-24T09:10:13.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7cb7fff640 1 -- 10.20.193.4:0/2950285835 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7cf804d440 con 0x5601e9e934e0 2026-02-24T09:10:13.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 10 client.15660 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:13.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/2950285835 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5601e9d1b5c0 con 0x5601e9e934e0 2026-02-24T09:10:13.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7cb7fff640 1 -- 10.20.193.4:0/2950285835 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f7cf8038920 con 0x5601e9e934e0 2026-02-24T09:10:13.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 10 client.15660 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:13.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 10 client.15660 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:10:13.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 20 client.15660 populate_metadata read hostname 'trial004' 2026-02-24T09:10:13.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5601e9ed53a0 0x5601e9ed5840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 4 client.15660 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:13.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/2950285835 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601e9da8f00 con 0x5601e9ed53a0 2026-02-24T09:10:13.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.719+0000 7f7d0a126640 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5601e9ed53a0 0x5601e9ed5840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0a126640 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5601e9ed53a0 0x5601e9ed5840 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=1307420635641197227 s_cookie=16864605707479525491 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1224e4241f68b2ab server_cookie=ea0b1d89d757a873 in_seq=0 out_seq=0 2026-02-24T09:10:13.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7cb7fff640 10 client.15660 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:13.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7cb7fff640 1 -- 10.20.193.4:0/2950285835 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5601e9da8f00 con 0x5601e9ed53a0 2026-02-24T09:10:13.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7cb7fff640 10 client.15660 handle_command_reply: tid=0 2026-02-24T09:10:13.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 client.15660 shutdown 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/2950285835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e934e0 msgr2=0x5601e9eab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e934e0 0x5601e9eab000 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=9146575861565595698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf80386a0 tx=0x7f7cf80386d0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/2950285835 shutdown_connections 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5601e9ed53a0 0x5601e9ed5840 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=1307420635641197227 s_cookie=16864605707479525491 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9ed8180 0x5601e9eafff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e934e0 0x5601e9eab000 unknown :-1 s=CLOSED pgs=483 gs=1 cs=0 l=1 c_cookie=9146575861565595698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7cb7fff640 0 client.15660 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/2950285835 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9e92bd0 0x5601e9eaaac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/2950285835 >> 10.20.193.4:0/2950285835 conn(0x5601e9db0880 msgr2=0x5601e9e91bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/2950285835 shutdown_connections 2026-02-24T09:10:13.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.720+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/2950285835 wait complete. 2026-02-24T09:10:13.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.721+0000 7f7d0e3abe00 20 client.15660 trim_cache size 0 max 16384 2026-02-24T09:10:13.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0e3abe00 1 Processor -- start 2026-02-24T09:10:13.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0e3abe00 1 -- start start 2026-02-24T09:10:13.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9ed01c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9ed0700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9ed53a0 0x5601e9ea7090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5601e9d959e0 con 0x5601e9e92bd0 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5601e9a4dec0 con 0x5601e9e934e0 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5601e9e06290 con 0x5601e9ed53a0 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0a126640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9ed01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0a126640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9ed01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58648/0 (socket says 10.20.193.4:58648) 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0a126640 1 -- 10.20.193.4:0/3507657675 learned_addr learned my addr 10.20.193.4:0/3507657675 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d09925640 1 --2- 10.20.193.4:0/3507657675 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9ed0700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.730+0000 7f7d0a126640 1 -- 10.20.193.4:0/3507657675 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9ed53a0 msgr2=0x5601e9ea7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0a126640 1 --2- 10.20.193.4:0/3507657675 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9ed53a0 0x5601e9ea7090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0a126640 1 -- 10.20.193.4:0/3507657675 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 msgr2=0x5601e9ed0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0a126640 1 --2- 10.20.193.4:0/3507657675 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9ed0700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0a126640 1 -- 10.20.193.4:0/3507657675 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e9d2d500 con 0x5601e9e92bd0 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0a126640 1 --2- 10.20.193.4:0/3507657675 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9ed01c0 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=8113064746865442946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf400ff10 tx=0x7f7cf40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7097656704a8c082 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7cd24e6640 1 -- 10.20.193.4:0/3507657675 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cf401e650 con 0x5601e9e92bd0 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7cd24e6640 1 -- 10.20.193.4:0/3507657675 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7cf4011e30 con 0x5601e9e92bd0 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7cd24e6640 1 -- 10.20.193.4:0/3507657675 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cf4010cc0 con 0x5601e9e92bd0 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/3507657675 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 msgr2=0x5601e9ed01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/3507657675 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9ed01c0 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=8113064746865442946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf400ff10 tx=0x7f7cf40047e0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/3507657675 shutdown_connections 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/3507657675 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9ed53a0 0x5601e9ea7090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/3507657675 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9ed0700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/3507657675 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9ed01c0 unknown :-1 s=CLOSED pgs=484 gs=1 cs=0 l=1 c_cookie=8113064746865442946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/3507657675 >> 10.20.193.4:0/3507657675 conn(0x5601e9db0880 msgr2=0x5601e9eaf640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/3507657675 shutdown_connections 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.731+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/3507657675 wait complete. 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0e3abe00 1 -- start start 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0e3abe00 1 Processor -- start 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9eb0da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9eb12e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0e3abe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9ed53a0 0x5601e9eb5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5601e9eb09a0 con 0x5601e9e92bd0 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5601e9ea3d80 con 0x5601e9e934e0 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0e3abe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5601e9eb1af0 con 0x5601e9ed53a0 2026-02-24T09:10:13.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0a126640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9eb0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0a126640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9eb0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58656/0 (socket says 10.20.193.4:58656) 2026-02-24T09:10:13.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0a126640 1 -- 10.20.193.4:0/717638170 learned_addr learned my addr 10.20.193.4:0/717638170 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:13.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d09925640 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9eb12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0a927640 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9ed53a0 0x5601e9eb5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0a126640 1 -- 10.20.193.4:0/717638170 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9ed53a0 msgr2=0x5601e9eb5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:13.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0a126640 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9ed53a0 0x5601e9eb5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0a126640 1 -- 10.20.193.4:0/717638170 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 msgr2=0x5601e9eb12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:13.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0a126640 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9eb12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0a126640 1 -- 10.20.193.4:0/717638170 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e9d27f80 con 0x5601e9e92bd0 2026-02-24T09:10:13.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d09925640 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9eb12e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0a126640 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9eb0da0 secure :-1 s=READY pgs=485 gs=1 cs=0 l=1 c_cookie=2770325947720313939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf400f950 tx=0x7f7cf4010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26722cc589eaac53 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7cb7fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7cb7fff640 1 -- 10.20.193.4:0/717638170 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cf401e650 con 0x5601e9e92bd0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7cb7fff640 1 -- 10.20.193.4:0/717638170 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7cf4010c30 con 0x5601e9e92bd0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7cb7fff640 1 -- 10.20.193.4:0/717638170 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cf4027b40 con 0x5601e9e92bd0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/717638170 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf400fc40 con 0x5601e9e92bd0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7cb7fff640 1 -- 10.20.193.4:0/717638170 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f7cf4027cd0 con 0x5601e9e92bd0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.732+0000 7f7cb7fff640 10 client.15666 inactive, discarding osd_map(77..77 src has 1..77) 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d0e3abe00 10 client.15666 _ll_register_callbacks cb 0x5601e9d18a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/717638170 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5601e9a23700 con 0x5601e9e92bd0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7cb7fff640 1 -- 10.20.193.4:0/717638170 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7cf4027e90 con 0x5601e9e92bd0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d0e3abe00 10 client.15666 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/717638170 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5601e9d1b8f0 con 0x5601e9e92bd0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7cb7fff640 1 -- 10.20.193.4:0/717638170 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f7cf4039020 con 0x5601e9e92bd0 2026-02-24T09:10:13.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d0e3abe00 10 client.15666 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d0e3abe00 10 client.15666 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d0e3abe00 20 client.15666 populate_metadata read hostname 'trial004' 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5601e9ed8180 0x5601e9fa5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d0e3abe00 4 client.15666 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.5, "await_for": 45.0}] 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/717638170 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.5, "await_for": 45.0}) -- 0x5601e9daab70 con 0x5601e9ed8180 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d09925640 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5601e9ed8180 0x5601e9fa5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7d09925640 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5601e9ed8180 0x5601e9fa5b40 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=11917491598810355169 s_cookie=10185260332774850654 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5636f77b0cb15e1 server_cookie=8d59504f0fec005e in_seq=0 out_seq=0 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.733+0000 7f7cb7fff640 10 client.15666 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7cb7fff640 1 -- 10.20.193.4:0/717638170 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5601e9daab70 con 0x5601e9ed8180 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7cb7fff640 10 client.15666 handle_command_reply: tid=0 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 client.15666 shutdown 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/717638170 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 msgr2=0x5601e9eb0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9eb0da0 secure :-1 s=READY pgs=485 gs=1 cs=0 l=1 c_cookie=2770325947720313939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf400f950 tx=0x7f7cf4010680 comp rx=0 tx=0).stop 2026-02-24T09:10:13.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/717638170 shutdown_connections 2026-02-24T09:10:13.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5601e9ed8180 0x5601e9fa5b40 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=11917491598810355169 s_cookie=10185260332774850654 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601e9ed53a0 0x5601e9eb5df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601e9e934e0 0x5601e9eb12e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 --2- 10.20.193.4:0/717638170 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601e9e92bd0 0x5601e9eb0da0 unknown :-1 s=CLOSED pgs=485 gs=1 cs=0 l=1 c_cookie=2770325947720313939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7cb7fff640 0 client.15666 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:13.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/717638170 >> 10.20.193.4:0/717638170 conn(0x5601e9db0880 msgr2=0x5601e9ea7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:13.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/717638170 shutdown_connections 2026-02-24T09:10:13.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 1 -- 10.20.193.4:0/717638170 wait complete. 2026-02-24T09:10:13.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.739+0000 7f7d0e3abe00 20 client.15666 trim_cache size 0 max 16384 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 2, 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "1fa71175": { 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "version": 2, 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:10:13.753 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 138.5, 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:13.754 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:10:13.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/1185156868 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7ce00b5760 msgr2=0x7f7ce00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7ce00b5760 0x7f7ce00d5c10 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf4004740 tx=0x7f7cf40043a0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/1185156868 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d041158b0 msgr2=0x7f7d040f6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:13.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d041158b0 0x7f7d040f6130 secure :-1 s=READY pgs=481 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d00006e90 tx=0x7f7d0000edf0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/1185156868 shutdown_connections 2026-02-24T09:10:13.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7ce00b5760 0x7f7ce00d5c10 unknown :-1 s=CLOSED pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d041158b0 0x7f7d040f6130 unknown :-1 s=CLOSED pgs=481 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d041100b0 0x7f7d04176180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 --2- 10.20.193.4:0/1185156868 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d0410f6c0 0x7f7d040f5a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:13.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/1185156868 >> 10.20.193.4:0/1185156868 conn(0x7f7d040ecfd0 msgr2=0x7f7d04111ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:13.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/1185156868 shutdown_connections 2026-02-24T09:10:13.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:13.740+0000 7f7d0c3b1640 1 -- 10.20.193.4:0/1185156868 wait complete. 2026-02-24T09:10:13.787 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1fa71175', quiesce took 1.0 seconds. Will release after: 17.5 2026-02-24T09:10:13.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:13 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1808078854' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:14.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:13 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1808078854' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:14.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:13 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1808078854' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:15.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:14 trial090 ceph-mon[47278]: pgmap v163: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s; 108 B/s, 1 objects/s recovering 2026-02-24T09:10:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:14 trial014 ceph-mon[46941]: pgmap v163: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s; 108 B/s, 1 objects/s recovering 2026-02-24T09:10:15.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:14 trial004 ceph-mon[41596]: pgmap v163: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s; 108 B/s, 1 objects/s recovering 2026-02-24T09:10:17.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:16 trial090 ceph-mon[47278]: pgmap v164: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s; 98 B/s, 0 objects/s recovering 2026-02-24T09:10:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:16 trial014 ceph-mon[46941]: pgmap v164: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s; 98 B/s, 0 objects/s recovering 2026-02-24T09:10:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:16 trial004 ceph-mon[41596]: pgmap v164: 97 pgs: 97 active+clean; 661 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s; 98 B/s, 0 objects/s recovering 2026-02-24T09:10:19.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:18 trial090 ceph-mon[47278]: pgmap v165: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:10:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:18 trial014 ceph-mon[46941]: pgmap v165: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:10:19.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:18 trial004 ceph-mon[41596]: pgmap v165: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2026-02-24T09:10:21.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:20 trial090 ceph-mon[47278]: pgmap v166: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2026-02-24T09:10:21.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:20 trial014 ceph-mon[46941]: pgmap v166: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2026-02-24T09:10:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:20 trial004 ceph-mon[41596]: pgmap v166: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2026-02-24T09:10:22.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:22 trial004 ceph-mon[41596]: pgmap v167: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2026-02-24T09:10:22.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:10:23.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:22 trial090 ceph-mon[47278]: pgmap v167: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2026-02-24T09:10:23.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:10:23.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:22 trial014 ceph-mon[46941]: pgmap v167: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2026-02-24T09:10:23.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:10:24.102 INFO:tasks.workunit.client.0.trial004.stderr:Note: switching to '5bc9a1ffc19df681248ece8c3c8c7191a571745b'. 2026-02-24T09:10:24.102 INFO:tasks.workunit.client.0.trial004.stderr: 2026-02-24T09:10:24.102 INFO:tasks.workunit.client.0.trial004.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-24T09:10:24.102 INFO:tasks.workunit.client.0.trial004.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-24T09:10:24.102 INFO:tasks.workunit.client.0.trial004.stderr:state without impacting any branches by switching back to a branch. 2026-02-24T09:10:24.102 INFO:tasks.workunit.client.0.trial004.stderr: 2026-02-24T09:10:24.102 INFO:tasks.workunit.client.0.trial004.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr: 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr: git switch -c 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr: 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr:Or undo this operation with: 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr: 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr: git switch - 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr: 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr: 2026-02-24T09:10:24.103 INFO:tasks.workunit.client.0.trial004.stderr:HEAD is now at 5bc9a1ffc19 Merge PR #62351 into wip-vshankar-testing-20260223.155722 2026-02-24T09:10:24.111 DEBUG:teuthology.orchestra.run.trial004:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-24T09:10:24.128 INFO:tasks.workunit.client.0.trial004.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-24T09:10:24.130 INFO:tasks.workunit.client.0.trial004.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T09:10:24.130 INFO:tasks.workunit.client.0.trial004.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-24T09:10:24.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:10:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:10:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:10:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:23 trial004 ceph-mon[41596]: pgmap v168: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:10:24.229 INFO:tasks.workunit.client.0.trial004.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-24T09:10:24.262 INFO:tasks.workunit.client.0.trial004.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-24T09:10:24.287 INFO:tasks.workunit.client.0.trial004.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T09:10:24.289 INFO:tasks.workunit.client.0.trial004.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T09:10:24.289 INFO:tasks.workunit.client.0.trial004.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-24T09:10:24.301 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:10:24.315 INFO:tasks.workunit.client.0.trial004.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T09:10:24.318 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:10:24.318 DEBUG:teuthology.orchestra.run.trial004:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-24T09:10:24.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:10:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:10:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:10:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:23 trial090 ceph-mon[47278]: pgmap v168: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:10:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:23 trial014 ceph-mon[46941]: pgmap v168: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-24T09:10:24.374 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2026-02-24T09:10:24.375 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2026-02-24T09:10:24.375 DEBUG:teuthology.orchestra.run.trial004:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5bc9a1ffc19df681248ece8c3c8c7191a571745b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2026-02-24T09:10:24.417 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:24.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 -- 10.20.193.4:0/840863605 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255010f650 msgr2=0x7f255010fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 --2- 10.20.193.4:0/840863605 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255010f650 0x7f255010fa20 secure :-1 s=READY pgs=486 gs=1 cs=0 l=1 c_cookie=17470567761485050431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2540009950 tx=0x7f254002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 -- 10.20.193.4:0/840863605 shutdown_connections 2026-02-24T09:10:24.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 --2- 10.20.193.4:0/840863605 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2550115840 0x7f2550176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 --2- 10.20.193.4:0/840863605 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2550110040 0x7f2550115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 --2- 10.20.193.4:0/840863605 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255010f650 0x7f255010fa20 unknown :-1 s=CLOSED pgs=486 gs=1 cs=0 l=1 c_cookie=17470567761485050431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 -- 10.20.193.4:0/840863605 >> 10.20.193.4:0/840863605 conn(0x7f25500ecf20 msgr2=0x7f255010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:24.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 -- 10.20.193.4:0/840863605 shutdown_connections 2026-02-24T09:10:24.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 -- 10.20.193.4:0/840863605 wait complete. 2026-02-24T09:10:24.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 Processor -- start 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 -- start start 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255010f650 0x7f255011df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2550110040 0x7f255011e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2550115840 0x7f2550123810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2550123e30 con 0x7f2550110040 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2550123fa0 con 0x7f2550115840 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f2558234640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2550124160 con 0x7f255010f650 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f25557a8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2550110040 0x7f255011e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f25557a8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2550110040 0x7f255011e440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57874/0 (socket says 10.20.193.4:57874) 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.528+0000 7f25557a8640 1 -- 10.20.193.4:0/3483323564 learned_addr learned my addr 10.20.193.4:0/3483323564 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f2555fa9640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255010f650 0x7f255011df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f25557a8640 1 -- 10.20.193.4:0/3483323564 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255010f650 msgr2=0x7f255011df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f25557a8640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255010f650 0x7f255011df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f25557a8640 1 -- 10.20.193.4:0/3483323564 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2550115840 msgr2=0x7f2550123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f25557a8640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2550115840 0x7f2550123810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f25557a8640 1 -- 10.20.193.4:0/3483323564 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2540009570 con 0x7f2550110040 2026-02-24T09:10:24.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f2555fa9640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255010f650 0x7f255011df00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:24.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f25557a8640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2550110040 0x7f255011e440 secure :-1 s=READY pgs=487 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25440072a0 tx=0x7f254400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:24.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f253effd640 1 -- 10.20.193.4:0/3483323564 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2544004500 con 0x7f2550110040 2026-02-24T09:10:24.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f2558234640 1 -- 10.20.193.4:0/3483323564 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2550124440 con 0x7f2550110040 2026-02-24T09:10:24.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f253effd640 1 -- 10.20.193.4:0/3483323564 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f254400bd20 con 0x7f2550110040 2026-02-24T09:10:24.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f253effd640 1 -- 10.20.193.4:0/3483323564 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2544002ea0 con 0x7f2550110040 2026-02-24T09:10:24.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.529+0000 7f2558234640 1 -- 10.20.193.4:0/3483323564 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2550164b40 con 0x7f2550110040 2026-02-24T09:10:24.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.531+0000 7f253effd640 1 -- 10.20.193.4:0/3483323564 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f254400b840 con 0x7f2550110040 2026-02-24T09:10:24.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.531+0000 7f253effd640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f252c0b5770 0x7f252c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.531+0000 7f253effd640 1 -- 10.20.193.4:0/3483323564 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f25440e6e60 con 0x7f2550110040 2026-02-24T09:10:24.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.531+0000 7f2555fa9640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f252c0b5770 0x7f252c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.532+0000 7f2555fa9640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f252c0b5770 0x7f252c0d5c20 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25400098a0 tx=0x7f2540031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:24.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f255a22ee00 1 Processor -- start 2026-02-24T09:10:24.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f255a22ee00 1 -- start start 2026-02-24T09:10:24.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e10820 0x55d8a7e10bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e55890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e55dd0 0x55d8a7e761b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f255a22ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7d20de0 con 0x55d8a7e11130 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f255a22ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7d1cb10 con 0x55d8a7e10820 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f255a22ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7d16ab0 con 0x55d8a7e55dd0 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f25557a8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e55890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f25557a8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e55890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57878/0 (socket says 10.20.193.4:57878) 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f25557a8640 1 -- 10.20.193.4:0/1466701920 learned_addr learned my addr 10.20.193.4:0/1466701920 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f25567aa640 1 --2- 10.20.193.4:0/1466701920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e55dd0 0x55d8a7e761b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f2555fa9640 1 --2- 10.20.193.4:0/1466701920 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e10820 0x55d8a7e10bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f25557a8640 1 -- 10.20.193.4:0/1466701920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e55dd0 msgr2=0x55d8a7e761b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f25557a8640 1 --2- 10.20.193.4:0/1466701920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e55dd0 0x55d8a7e761b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f25557a8640 1 -- 10.20.193.4:0/1466701920 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e10820 msgr2=0x55d8a7e10bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f25557a8640 1 --2- 10.20.193.4:0/1466701920 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e10820 0x55d8a7e10bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f25557a8640 1 -- 10.20.193.4:0/1466701920 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a7cc2310 con 0x55d8a7e11130 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f2555fa9640 1 --2- 10.20.193.4:0/1466701920 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e10820 0x55d8a7e10bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f25557a8640 1 --2- 10.20.193.4:0/1466701920 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e55890 secure :-1 s=READY pgs=488 gs=1 cs=0 l=1 c_cookie=10148456721266637651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25440ad2f0 tx=0x7f25440026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd68f9e8185fb53 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f251e4e6640 1 -- 10.20.193.4:0/1466701920 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25440ac880 con 0x55d8a7e11130 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f251e4e6640 1 -- 10.20.193.4:0/1466701920 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f25440ada80 con 0x55d8a7e11130 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.533+0000 7f251e4e6640 1 -- 10.20.193.4:0/1466701920 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25440722d0 con 0x55d8a7e11130 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.534+0000 7f255a22ee00 1 -- 10.20.193.4:0/1466701920 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 msgr2=0x55d8a7e55890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.534+0000 7f255a22ee00 1 --2- 10.20.193.4:0/1466701920 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e55890 secure :-1 s=READY pgs=488 gs=1 cs=0 l=1 c_cookie=10148456721266637651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25440ad2f0 tx=0x7f25440026a0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.534+0000 7f255a22ee00 1 -- 10.20.193.4:0/1466701920 shutdown_connections 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.534+0000 7f255a22ee00 1 --2- 10.20.193.4:0/1466701920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e55dd0 0x55d8a7e761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.534+0000 7f255a22ee00 1 --2- 10.20.193.4:0/1466701920 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e55890 unknown :-1 s=CLOSED pgs=488 gs=1 cs=0 l=1 c_cookie=10148456721266637651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.534+0000 7f255a22ee00 1 --2- 10.20.193.4:0/1466701920 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e10820 0x55d8a7e10bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.534+0000 7f255a22ee00 1 -- 10.20.193.4:0/1466701920 >> 10.20.193.4:0/1466701920 conn(0x55d8a7d2f6b0 msgr2=0x55d8a7e0f100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.534+0000 7f255a22ee00 1 -- 10.20.193.4:0/1466701920 shutdown_connections 2026-02-24T09:10:24.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.534+0000 7f255a22ee00 1 -- 10.20.193.4:0/1466701920 wait complete. 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 1 -- start start 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 1 Processor -- start 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e28e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e29360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e55dd0 0x55d8a7e2e350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7e2e890 con 0x55d8a7e11130 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7e2ea00 con 0x55d8a7e55dd0 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7e2ebc0 con 0x55d8a7e10820 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f25557a8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e29360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f25557a8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e29360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57886/0 (socket says 10.20.193.4:57886) 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f25557a8640 1 -- 10.20.193.4:0/530856541 learned_addr learned my addr 10.20.193.4:0/530856541 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f2555fa9640 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e28e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f25567aa640 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e55dd0 0x55d8a7e2e350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f25557a8640 1 -- 10.20.193.4:0/530856541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 msgr2=0x55d8a7e28e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f25557a8640 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e28e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f25557a8640 1 -- 10.20.193.4:0/530856541 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e55dd0 msgr2=0x55d8a7e2e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:24.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f25557a8640 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e55dd0 0x55d8a7e2e350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f25557a8640 1 -- 10.20.193.4:0/530856541 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a7c9a8c0 con 0x55d8a7e11130 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f25557a8640 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e29360 secure :-1 s=READY pgs=489 gs=1 cs=0 l=1 c_cookie=10102608477804969044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2544002c10 tx=0x7f25440a8900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c33ace2786a3c54 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f250b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f250b7fe640 1 -- 10.20.193.4:0/530856541 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25440ac880 con 0x55d8a7e11130 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f250b7fe640 1 -- 10.20.193.4:0/530856541 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f254400be90 con 0x55d8a7e11130 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 1 -- 10.20.193.4:0/530856541 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2550164b40 con 0x55d8a7e11130 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f250b7fe640 1 -- 10.20.193.4:0/530856541 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25440b7d30 con 0x55d8a7e11130 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 10 client.15678 _ll_register_callbacks cb 0x55d8a7cb2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f255a22ee00 1 -- 10.20.193.4:0/530856541 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d8a7a664a0 con 0x55d8a7e11130 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.535+0000 7f250b7fe640 1 -- 10.20.193.4:0/530856541 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f25440b7ec0 con 0x55d8a7e11130 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f250b7fe640 1 -- 10.20.193.4:0/530856541 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f25440722d0 con 0x55d8a7e11130 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f255a22ee00 10 client.15678 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f255a22ee00 1 -- 10.20.193.4:0/530856541 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d8a7cac6e0 con 0x55d8a7e11130 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f250b7fe640 1 -- 10.20.193.4:0/530856541 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f25440092b0 con 0x55d8a7e11130 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f255a22ee00 10 client.15678 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f255a22ee00 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:24.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f255a22ee00 20 client.15678 populate_metadata read hostname 'trial004' 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f255a22ee00 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8a7e53250 0x55d8a7e536f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f255a22ee00 4 client.15678 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f255a22ee00 1 -- 10.20.193.4:0/530856541 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8a7d0c4f0 con 0x55d8a7e53250 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f2555fa9640 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8a7e53250 0x55d8a7e536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f2555fa9640 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8a7e53250 0x55d8a7e536f0 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=2012047555692909718 s_cookie=15597043816276201578 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bec3a977444d496 server_cookie=d873d4b6d758906a in_seq=0 out_seq=0 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.536+0000 7f250b7fe640 10 client.15678 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f250b7fe640 1 -- 10.20.193.4:0/530856541 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d8a7d0c4f0 con 0x55d8a7e53250 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f250b7fe640 10 client.15678 handle_command_reply: tid=0 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 client.15678 shutdown 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 -- 10.20.193.4:0/530856541 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 msgr2=0x55d8a7e29360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e29360 secure :-1 s=READY pgs=489 gs=1 cs=0 l=1 c_cookie=10102608477804969044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2544002c10 tx=0x7f25440a8900 comp rx=0 tx=0).stop 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 -- 10.20.193.4:0/530856541 shutdown_connections 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8a7e53250 0x55d8a7e536f0 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=2012047555692909718 s_cookie=15597043816276201578 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e55dd0 0x55d8a7e2e350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e29360 unknown :-1 s=CLOSED pgs=489 gs=1 cs=0 l=1 c_cookie=10102608477804969044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f250b7fe640 0 client.15678 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:24.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 --2- 10.20.193.4:0/530856541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e28e20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 -- 10.20.193.4:0/530856541 >> 10.20.193.4:0/530856541 conn(0x55d8a7d2f6b0 msgr2=0x55d8a7e0f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:24.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 -- 10.20.193.4:0/530856541 shutdown_connections 2026-02-24T09:10:24.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 1 -- 10.20.193.4:0/530856541 wait complete. 2026-02-24T09:10:24.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.537+0000 7f255a22ee00 20 client.15678 trim_cache size 0 max 16384 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f255a22ee00 1 Processor -- start 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f255a22ee00 1 -- start start 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e136e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e11130 0x55d8a7e54fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e53250 0x55d8a7e55520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f255a22ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7e2e750 con 0x55d8a7e53250 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f255a22ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7e29760 con 0x55d8a7e11130 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f255a22ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7d146e0 con 0x55d8a7e10820 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f25567aa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e53250 0x55d8a7e55520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f25567aa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e53250 0x55d8a7e55520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57890/0 (socket says 10.20.193.4:57890) 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f25567aa640 1 -- 10.20.193.4:0/4130940898 learned_addr learned my addr 10.20.193.4:0/4130940898 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f25557a8640 1 --2- 10.20.193.4:0/4130940898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e11130 0x55d8a7e54fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f2555fa9640 1 --2- 10.20.193.4:0/4130940898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f25567aa640 1 -- 10.20.193.4:0/4130940898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 msgr2=0x55d8a7e136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f25567aa640 1 --2- 10.20.193.4:0/4130940898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f25567aa640 1 -- 10.20.193.4:0/4130940898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e11130 msgr2=0x55d8a7e54fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f25567aa640 1 --2- 10.20.193.4:0/4130940898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e11130 0x55d8a7e54fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f25567aa640 1 -- 10.20.193.4:0/4130940898 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a7ca7160 con 0x55d8a7e53250 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f25567aa640 1 --2- 10.20.193.4:0/4130940898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e53250 0x55d8a7e55520 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=1997822708113905029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f254c005160 tx=0x7f254c005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb9b12b09569585 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f251dce5640 1 -- 10.20.193.4:0/4130940898 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f254c012ca0 con 0x55d8a7e53250 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f251dce5640 1 -- 10.20.193.4:0/4130940898 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f254c005e10 con 0x55d8a7e53250 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.546+0000 7f251dce5640 1 -- 10.20.193.4:0/4130940898 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f254c0136d0 con 0x55d8a7e53250 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 -- 10.20.193.4:0/4130940898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e53250 msgr2=0x55d8a7e55520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 --2- 10.20.193.4:0/4130940898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e53250 0x55d8a7e55520 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=1997822708113905029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f254c005160 tx=0x7f254c005630 comp rx=0 tx=0).stop 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 -- 10.20.193.4:0/4130940898 shutdown_connections 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 --2- 10.20.193.4:0/4130940898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e53250 0x55d8a7e55520 unknown :-1 s=CLOSED pgs=490 gs=1 cs=0 l=1 c_cookie=1997822708113905029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 --2- 10.20.193.4:0/4130940898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e11130 0x55d8a7e54fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 --2- 10.20.193.4:0/4130940898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e136e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 -- 10.20.193.4:0/4130940898 >> 10.20.193.4:0/4130940898 conn(0x55d8a7d2f6b0 msgr2=0x55d8a7e259d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:24.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 -- 10.20.193.4:0/4130940898 shutdown_connections 2026-02-24T09:10:24.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 -- 10.20.193.4:0/4130940898 wait complete. 2026-02-24T09:10:24.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 -- start start 2026-02-24T09:10:24.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.547+0000 7f255a22ee00 1 Processor -- start 2026-02-24T09:10:24.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e329a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e32ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e53250 0x55d8a7ebb300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7e2ea00 con 0x55d8a7e11130 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7e16260 con 0x55d8a7e53250 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d8a7e33820 con 0x55d8a7e10820 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f25557a8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e32ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f25557a8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e32ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57892/0 (socket says 10.20.193.4:57892) 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f25557a8640 1 -- 10.20.193.4:0/2532975436 learned_addr learned my addr 10.20.193.4:0/2532975436 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f25557a8640 1 -- 10.20.193.4:0/2532975436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 msgr2=0x55d8a7e329a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f2555fa9640 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e329a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f25557a8640 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e329a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f25557a8640 1 -- 10.20.193.4:0/2532975436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e53250 msgr2=0x55d8a7ebb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f25557a8640 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e53250 0x55d8a7ebb300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f25557a8640 1 -- 10.20.193.4:0/2532975436 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8a7c9abf0 con 0x55d8a7e11130 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f2555fa9640 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e329a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f25557a8640 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e32ee0 secure :-1 s=READY pgs=491 gs=1 cs=0 l=1 c_cookie=11363073945170932495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25440a9650 tx=0x7f25440e4cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db1bf8c8a68f30f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f250b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f250b7fe640 1 -- 10.20.193.4:0/2532975436 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f254400be90 con 0x55d8a7e11130 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 -- 10.20.193.4:0/2532975436 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f254c003d10 con 0x55d8a7e11130 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f250b7fe640 1 -- 10.20.193.4:0/2532975436 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d8a7a664a0 con 0x55d8a7e11130 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f250b7fe640 1 -- 10.20.193.4:0/2532975436 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25440b81c0 con 0x55d8a7e11130 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 10 client.15684 _ll_register_callbacks cb 0x55d8a7cb2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 -- 10.20.193.4:0/2532975436 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25440ada80 con 0x55d8a7e11130 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f250b7fe640 1 -- 10.20.193.4:0/2532975436 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f25440a89d0 con 0x55d8a7e11130 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f250b7fe640 1 -- 10.20.193.4:0/2532975436 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f25440abfd0 con 0x55d8a7e11130 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 10 client.15684 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 -- 10.20.193.4:0/2532975436 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d8a7cac940 con 0x55d8a7e11130 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f250b7fe640 1 -- 10.20.193.4:0/2532975436 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f25440add10 con 0x55d8a7e11130 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 10 client.15684 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:24.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 20 client.15684 populate_metadata read hostname 'trial004' 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8a7e55dd0 0x55d8a7f231f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 4 client.15684 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.548+0000 7f255a22ee00 1 -- 10.20.193.4:0/2532975436 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d8a7a4b160 con 0x55d8a7e55dd0 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f2555fa9640 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8a7e55dd0 0x55d8a7f231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f2555fa9640 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8a7e55dd0 0x55d8a7f231f0 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=6511369671686122362 s_cookie=5994861901528323341 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a5d0837ba1a6b7a server_cookie=53320723261e550d in_seq=0 out_seq=0 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f250b7fe640 10 client.15684 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f250b7fe640 1 -- 10.20.193.4:0/2532975436 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55d8a7a4b160 con 0x55d8a7e55dd0 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f250b7fe640 10 client.15684 handle_command_reply: tid=0 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 client.15684 shutdown 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 -- 10.20.193.4:0/2532975436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 msgr2=0x55d8a7e32ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e32ee0 secure :-1 s=READY pgs=491 gs=1 cs=0 l=1 c_cookie=11363073945170932495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25440a9650 tx=0x7f25440e4cc0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 -- 10.20.193.4:0/2532975436 shutdown_connections 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8a7e55dd0 0x55d8a7f231f0 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=6511369671686122362 s_cookie=5994861901528323341 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8a7e53250 0x55d8a7ebb300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8a7e11130 0x55d8a7e32ee0 unknown :-1 s=CLOSED pgs=491 gs=1 cs=0 l=1 c_cookie=11363073945170932495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f250b7fe640 0 client.15684 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 --2- 10.20.193.4:0/2532975436 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8a7e10820 0x55d8a7e329a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 -- 10.20.193.4:0/2532975436 >> 10.20.193.4:0/2532975436 conn(0x55d8a7d2f6b0 msgr2=0x55d8a7e260e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 -- 10.20.193.4:0/2532975436 shutdown_connections 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 1 -- 10.20.193.4:0/2532975436 wait complete. 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.549+0000 7f255a22ee00 20 client.15684 trim_cache size 0 max 16384 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:10:24.559 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:10:24.560 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:10:24.560 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:10:24.560 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:24.560 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:24.560 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:10:24.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 -- 10.20.193.4:0/3483323564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f252c0b5770 msgr2=0x7f252c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f252c0b5770 0x7f252c0d5c20 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25400098a0 tx=0x7f2540031040 comp rx=0 tx=0).stop 2026-02-24T09:10:24.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 -- 10.20.193.4:0/3483323564 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2550110040 msgr2=0x7f255011e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2550110040 0x7f255011e440 secure :-1 s=READY pgs=487 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25440072a0 tx=0x7f254400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 -- 10.20.193.4:0/3483323564 shutdown_connections 2026-02-24T09:10:24.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f252c0b5770 0x7f252c0d5c20 unknown :-1 s=CLOSED pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2550115840 0x7f2550123810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2550110040 0x7f255011e440 unknown :-1 s=CLOSED pgs=487 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 --2- 10.20.193.4:0/3483323564 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255010f650 0x7f255011df00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 -- 10.20.193.4:0/3483323564 >> 10.20.193.4:0/3483323564 conn(0x7f25500ecf20 msgr2=0x7f255010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:24.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 -- 10.20.193.4:0/3483323564 shutdown_connections 2026-02-24T09:10:24.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.550+0000 7f2558234640 1 -- 10.20.193.4:0/3483323564 wait complete. 2026-02-24T09:10:24.590 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:10:24.590 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:10:24.707 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.800+0000 7f8880885640 1 -- 10.20.193.4:0/1042528172 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8878114020 msgr2=0x7f88781143f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.800+0000 7f8880885640 1 --2- 10.20.193.4:0/1042528172 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8878114020 0x7f88781143f0 secure :-1 s=READY pgs=492 gs=1 cs=0 l=1 c_cookie=2650717242052377799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8870009950 tx=0x7f887002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.800+0000 7f8880885640 1 -- 10.20.193.4:0/1042528172 shutdown_connections 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.800+0000 7f8880885640 1 --2- 10.20.193.4:0/1042528172 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8878119d10 0x7f887817a6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.800+0000 7f8880885640 1 --2- 10.20.193.4:0/1042528172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8878114a10 0x7f8878119560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.800+0000 7f8880885640 1 --2- 10.20.193.4:0/1042528172 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8878114020 0x7f88781143f0 unknown :-1 s=CLOSED pgs=492 gs=1 cs=0 l=1 c_cookie=2650717242052377799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.800+0000 7f8880885640 1 -- 10.20.193.4:0/1042528172 >> 10.20.193.4:0/1042528172 conn(0x7f8878064c40 msgr2=0x7f8878065040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.800+0000 7f8880885640 1 -- 10.20.193.4:0/1042528172 shutdown_connections 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.800+0000 7f8880885640 1 -- 10.20.193.4:0/1042528172 wait complete. 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f8880885640 1 Processor -- start 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f8880885640 1 -- start start 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f8880885640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8878114020 0x7f8878122450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f8880885640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8878114a10 0x7f8878122990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f8880885640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8878119d10 0x7f8878127d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f8880885640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f88781282f0 con 0x7f8878119d10 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f8880885640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f8878128460 con 0x7f8878114a10 2026-02-24T09:10:24.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f8880885640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8878128620 con 0x7f8878114020 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f887edfb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8878119d10 0x7f8878127d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f887edfb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8878119d10 0x7f8878127d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57912/0 (socket says 10.20.193.4:57912) 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f887edfb640 1 -- 10.20.193.4:0/699851297 learned_addr learned my addr 10.20.193.4:0/699851297 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f887e5fa640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8878114020 0x7f8878122450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f887edfb640 1 -- 10.20.193.4:0/699851297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8878114020 msgr2=0x7f8878122450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f887edfb640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8878114020 0x7f8878122450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f887edfb640 1 -- 10.20.193.4:0/699851297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8878114a10 msgr2=0x7f8878122990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f887edfb640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8878114a10 0x7f8878122990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f887edfb640 1 -- 10.20.193.4:0/699851297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8870009570 con 0x7f8878119d10 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f887edfb640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8878119d10 0x7f8878127d60 secure :-1 s=READY pgs=493 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f886c00b270 tx=0x7f886c00de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f88637fe640 1 -- 10.20.193.4:0/699851297 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f886c008cf0 con 0x7f8878119d10 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f8880885640 1 -- 10.20.193.4:0/699851297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8878128900 con 0x7f8878119d10 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f88637fe640 1 -- 10.20.193.4:0/699851297 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f886c008e50 con 0x7f8878119d10 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f88637fe640 1 -- 10.20.193.4:0/699851297 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f886c0106d0 con 0x7f8878119d10 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.801+0000 7f8880885640 1 -- 10.20.193.4:0/699851297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8878169090 con 0x7f8878119d10 2026-02-24T09:10:24.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.802+0000 7f8880885640 1 -- 10.20.193.4:0/699851297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8878114e00 con 0x7f8878119d10 2026-02-24T09:10:24.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.803+0000 7f88637fe640 1 -- 10.20.193.4:0/699851297 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f886c003780 con 0x7f8878119d10 2026-02-24T09:10:24.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.804+0000 7f88637fe640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88540b5770 0x7f88540d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:24.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.804+0000 7f887e5fa640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88540b5770 0x7f88540d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:24.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.804+0000 7f88637fe640 1 -- 10.20.193.4:0/699851297 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f886c0e80a0 con 0x7f8878119d10 2026-02-24T09:10:24.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.804+0000 7f887e5fa640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88540b5770 0x7f88540d5c20 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8870005b30 tx=0x7f887003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:24.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.805+0000 7f88637fe640 1 -- 10.20.193.4:0/699851297 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f886c0aa8d0 con 0x7f8878119d10 2026-02-24T09:10:24.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.939+0000 7f8880885640 1 -- 10.20.193.4:0/699851297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88781235b0 con 0x7f8878119d10 2026-02-24T09:10:24.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.939+0000 7f88637fe640 1 -- 10.20.193.4:0/699851297 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f886c0ada80 con 0x7f8878119d10 2026-02-24T09:10:24.943 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:10:24.943 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:10:24.944 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:10:24.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 -- 10.20.193.4:0/699851297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88540b5770 msgr2=0x7f88540d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88540b5770 0x7f88540d5c20 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8870005b30 tx=0x7f887003a040 comp rx=0 tx=0).stop 2026-02-24T09:10:24.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 -- 10.20.193.4:0/699851297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8878119d10 msgr2=0x7f8878127d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:24.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8878119d10 0x7f8878127d60 secure :-1 s=READY pgs=493 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f886c00b270 tx=0x7f886c00de70 comp rx=0 tx=0).stop 2026-02-24T09:10:24.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 -- 10.20.193.4:0/699851297 shutdown_connections 2026-02-24T09:10:24.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88540b5770 0x7f88540d5c20 unknown :-1 s=CLOSED pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8878119d10 0x7f8878127d60 unknown :-1 s=CLOSED pgs=493 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8878114a10 0x7f8878122990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 --2- 10.20.193.4:0/699851297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8878114020 0x7f8878122450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:24.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 -- 10.20.193.4:0/699851297 >> 10.20.193.4:0/699851297 conn(0x7f8878064c40 msgr2=0x7f88781181a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:24.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 -- 10.20.193.4:0/699851297 shutdown_connections 2026-02-24T09:10:24.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:24.940+0000 7f8880885640 1 -- 10.20.193.4:0/699851297 wait complete. 2026-02-24T09:10:24.980 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:10:25.096 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:25.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 -- 10.20.193.4:0/438159426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5568115840 msgr2=0x7f5568176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 --2- 10.20.193.4:0/438159426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5568115840 0x7f5568176210 secure :-1 s=READY pgs=494 gs=1 cs=0 l=1 c_cookie=10761319271905676792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f555c00aa30 tx=0x7f555c030280 comp rx=0 tx=0).stop 2026-02-24T09:10:25.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 -- 10.20.193.4:0/438159426 shutdown_connections 2026-02-24T09:10:25.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 --2- 10.20.193.4:0/438159426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5568115840 0x7f5568176210 unknown :-1 s=CLOSED pgs=494 gs=1 cs=0 l=1 c_cookie=10761319271905676792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 --2- 10.20.193.4:0/438159426 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5568110040 0x7f5568115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 --2- 10.20.193.4:0/438159426 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f556810f650 0x7f556810fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 -- 10.20.193.4:0/438159426 >> 10.20.193.4:0/438159426 conn(0x7f55680ecf20 msgr2=0x7f556810d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 -- 10.20.193.4:0/438159426 shutdown_connections 2026-02-24T09:10:25.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 -- 10.20.193.4:0/438159426 wait complete. 2026-02-24T09:10:25.196 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:25 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/699851297' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:25.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 Processor -- start 2026-02-24T09:10:25.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 -- start start 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f556810f650 0x7f55680f5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5568110040 0x7f5568176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5568115840 0x7f55680f5f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f55680fb1a0 con 0x7f5568115840 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f55680fb310 con 0x7f5568110040 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556e2d8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55680fb4d0 con 0x7f556810f650 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556c84e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5568115840 0x7f55680f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556c84e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5568115840 0x7f55680f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57930/0 (socket says 10.20.193.4:57930) 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f556c84e640 1 -- 10.20.193.4:0/3745877578 learned_addr learned my addr 10.20.193.4:0/3745877578 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f5567fff640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f556810f650 0x7f55680f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.192+0000 7f55677fe640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5568110040 0x7f5568176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f556c84e640 1 -- 10.20.193.4:0/3745877578 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f556810f650 msgr2=0x7f55680f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f556c84e640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f556810f650 0x7f55680f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f556c84e640 1 -- 10.20.193.4:0/3745877578 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5568110040 msgr2=0x7f5568176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f556c84e640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5568110040 0x7f5568176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f556c84e640 1 -- 10.20.193.4:0/3745877578 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555c00a650 con 0x7f5568115840 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f55677fe640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5568110040 0x7f5568176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f556c84e640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5568115840 0x7f55680f5f90 secure :-1 s=READY pgs=495 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f555c00a330 tx=0x7f555c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f55657fa640 1 -- 10.20.193.4:0/3745877578 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f555c03e070 con 0x7f5568115840 2026-02-24T09:10:25.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f556e2d8640 1 -- 10.20.193.4:0/3745877578 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55680fb750 con 0x7f5568115840 2026-02-24T09:10:25.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f55657fa640 1 -- 10.20.193.4:0/3745877578 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f555c0055a0 con 0x7f5568115840 2026-02-24T09:10:25.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f55657fa640 1 -- 10.20.193.4:0/3745877578 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f555c042a70 con 0x7f5568115840 2026-02-24T09:10:25.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.193+0000 7f556e2d8640 1 -- 10.20.193.4:0/3745877578 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55680fbbc0 con 0x7f5568115840 2026-02-24T09:10:25.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.195+0000 7f55657fa640 1 -- 10.20.193.4:0/3745877578 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f555c0050c0 con 0x7f5568115840 2026-02-24T09:10:25.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.195+0000 7f55657fa640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f553c0b5760 0x7f553c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.195+0000 7f5567fff640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f553c0b5760 0x7f553c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.195+0000 7f55657fa640 1 -- 10.20.193.4:0/3745877578 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f555c10ceb0 con 0x7f5568115840 2026-02-24T09:10:25.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.196+0000 7f5567fff640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f553c0b5760 0x7f553c0d5c10 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5554004740 tx=0x7f5554004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55702d2e00 1 Processor -- start 2026-02-24T09:10:25.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55702d2e00 1 -- start start 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942406f50 0x55e942407320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942407860 0x55e94244bfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 0x55e94246c8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55702d2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e942317ee0 con 0x55e942407860 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55702d2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e942313c10 con 0x55e94244c500 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55702d2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e94230dd70 con 0x55e942406f50 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55677fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942407860 0x55e94244bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55677fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942407860 0x55e94244bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57934/0 (socket says 10.20.193.4:57934) 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f55677fe640 1 -- 10.20.193.4:0/2489229010 learned_addr learned my addr 10.20.193.4:0/2489229010 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f5567fff640 1 --2- 10.20.193.4:0/2489229010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942406f50 0x55e942407320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.197+0000 7f556c84e640 1 --2- 10.20.193.4:0/2489229010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 0x55e94246c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55677fe640 1 -- 10.20.193.4:0/2489229010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942406f50 msgr2=0x55e942407320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55677fe640 1 --2- 10.20.193.4:0/2489229010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942406f50 0x55e942407320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55677fe640 1 -- 10.20.193.4:0/2489229010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 msgr2=0x55e94246c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55677fe640 1 --2- 10.20.193.4:0/2489229010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 0x55e94246c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55677fe640 1 -- 10.20.193.4:0/2489229010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9422b9340 con 0x55e942407860 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55677fe640 1 --2- 10.20.193.4:0/2489229010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942407860 0x55e94244bfc0 secure :-1 s=READY pgs=496 gs=1 cs=0 l=1 c_cookie=11143183477415618402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5558006ec0 tx=0x7f5558007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa48a55665c2762 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f5538ce3640 1 -- 10.20.193.4:0/2489229010 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5558004500 con 0x55e942407860 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f5538ce3640 1 -- 10.20.193.4:0/2489229010 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f555800dc20 con 0x55e942407860 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f5538ce3640 1 -- 10.20.193.4:0/2489229010 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5558013700 con 0x55e942407860 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55702d2e00 1 -- 10.20.193.4:0/2489229010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942407860 msgr2=0x55e94244bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55702d2e00 1 --2- 10.20.193.4:0/2489229010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942407860 0x55e94244bfc0 secure :-1 s=READY pgs=496 gs=1 cs=0 l=1 c_cookie=11143183477415618402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5558006ec0 tx=0x7f5558007d10 comp rx=0 tx=0).stop 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55702d2e00 1 -- 10.20.193.4:0/2489229010 shutdown_connections 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55702d2e00 1 --2- 10.20.193.4:0/2489229010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 0x55e94246c8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55702d2e00 1 --2- 10.20.193.4:0/2489229010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942407860 0x55e94244bfc0 unknown :-1 s=CLOSED pgs=496 gs=1 cs=0 l=1 c_cookie=11143183477415618402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55702d2e00 1 --2- 10.20.193.4:0/2489229010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942406f50 0x55e942407320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55702d2e00 1 -- 10.20.193.4:0/2489229010 >> 10.20.193.4:0/2489229010 conn(0x55e942325db0 msgr2=0x55e942405830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55702d2e00 1 -- 10.20.193.4:0/2489229010 shutdown_connections 2026-02-24T09:10:25.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.198+0000 7f55702d2e00 1 -- 10.20.193.4:0/2489229010 wait complete. 2026-02-24T09:10:25.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f55702d2e00 1 -- start start 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f55702d2e00 1 Processor -- start 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942463cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942407860 0x55e942464230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 0x55e942469220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f55702d2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e942469760 con 0x55e942406f50 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f55702d2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e9424698d0 con 0x55e94244c500 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f55702d2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e942469a90 con 0x55e942407860 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f5567fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942463cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f5567fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942463cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57938/0 (socket says 10.20.193.4:57938) 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f5567fff640 1 -- 10.20.193.4:0/3402992041 learned_addr learned my addr 10.20.193.4:0/3402992041 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f55677fe640 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942407860 0x55e942464230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f556c84e640 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 0x55e942469220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f5567fff640 1 -- 10.20.193.4:0/3402992041 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942407860 msgr2=0x55e942464230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f5567fff640 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942407860 0x55e942464230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f5567fff640 1 -- 10.20.193.4:0/3402992041 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 msgr2=0x55e942469220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f5567fff640 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 0x55e942469220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f5567fff640 1 -- 10.20.193.4:0/3402992041 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9422919d0 con 0x55e942406f50 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f556c84e640 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 0x55e942469220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.199+0000 7f55677fe640 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942407860 0x55e942464230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:10:25.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f5567fff640 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942463cf0 secure :-1 s=READY pgs=497 gs=1 cs=0 l=1 c_cookie=17412635700478646694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5554005d30 tx=0x7f5554004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a61be9da5099a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f5529ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f5529ffb640 1 -- 10.20.193.4:0/3402992041 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f555401f870 con 0x55e942406f50 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f5529ffb640 1 -- 10.20.193.4:0/3402992041 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f555401e3d0 con 0x55e942406f50 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f5529ffb640 1 -- 10.20.193.4:0/3402992041 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5554010650 con 0x55e942406f50 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 1 -- 10.20.193.4:0/3402992041 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555800e040 con 0x55e942406f50 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f5529ffb640 1 -- 10.20.193.4:0/3402992041 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f55540107e0 con 0x55e942406f50 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f5529ffb640 10 client.15702 inactive, discarding osd_map(77..77 src has 1..77) 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 10 client.15702 _ll_register_callbacks cb 0x55e9422b8080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 1 -- 10.20.193.4:0/3402992041 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e94205d4a0 con 0x55e942406f50 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f5529ffb640 1 -- 10.20.193.4:0/3402992041 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f55540109a0 con 0x55e942406f50 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 10 client.15702 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 1 -- 10.20.193.4:0/3402992041 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e9422a3710 con 0x55e942406f50 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f5529ffb640 1 -- 10.20.193.4:0/3402992041 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f5554030020 con 0x55e942406f50 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 10 client.15702 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 10 client.15702 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 20 client.15702 populate_metadata read hostname 'trial004' 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e942449760 0x55e942449c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 4 client.15702 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.200+0000 7f55702d2e00 1 -- 10.20.193.4:0/3402992041 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9423037b0 con 0x55e942449760 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55677fe640 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e942449760 0x55e942449c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55677fe640 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e942449760 0x55e942449c00 crc :-1 s=READY pgs=22 gs=4 cs=0 l=0 c_cookie=15917235380065455177 s_cookie=13209985686804478632 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dce5613ebb14cc49 server_cookie=b7534bfe1df9baa8 in_seq=0 out_seq=0 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f5529ffb640 10 client.15702 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f5529ffb640 1 -- 10.20.193.4:0/3402992041 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e9423037b0 con 0x55e942449760 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f5529ffb640 10 client.15702 handle_command_reply: tid=0 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55702d2e00 1 client.15702 shutdown 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55702d2e00 1 -- 10.20.193.4:0/3402992041 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 msgr2=0x55e942463cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55702d2e00 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942463cf0 secure :-1 s=READY pgs=497 gs=1 cs=0 l=1 c_cookie=17412635700478646694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5554005d30 tx=0x7f5554004770 comp rx=0 tx=0).stop 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55702d2e00 1 -- 10.20.193.4:0/3402992041 shutdown_connections 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55702d2e00 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e942449760 0x55e942449c00 crc :-1 s=READY pgs=22 gs=4 cs=0 l=0 c_cookie=15917235380065455177 s_cookie=13209985686804478632 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55702d2e00 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e94244c500 0x55e942469220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f5529ffb640 0 client.15702 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55702d2e00 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942407860 0x55e942464230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55702d2e00 1 --2- 10.20.193.4:0/3402992041 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942463cf0 unknown :-1 s=CLOSED pgs=497 gs=1 cs=0 l=1 c_cookie=17412635700478646694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.201+0000 7f55702d2e00 1 -- 10.20.193.4:0/3402992041 >> 10.20.193.4:0/3402992041 conn(0x55e942325db0 msgr2=0x55e942405040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.202+0000 7f55702d2e00 1 -- 10.20.193.4:0/3402992041 shutdown_connections 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.202+0000 7f55702d2e00 1 -- 10.20.193.4:0/3402992041 wait complete. 2026-02-24T09:10:25.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.202+0000 7f55702d2e00 20 client.15702 trim_cache size 0 max 16384 2026-02-24T09:10:25.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f55702d2e00 1 Processor -- start 2026-02-24T09:10:25.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f55702d2e00 1 -- start start 2026-02-24T09:10:25.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942468790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e942407860 0x55e942447160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942449760 0x55e9424476a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f55702d2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e94230b9a0 con 0x55e942406f50 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f55702d2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e9420e7df0 con 0x55e942407860 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f55702d2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e9423e22a0 con 0x55e942449760 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f5567fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942468790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f5567fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942468790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57944/0 (socket says 10.20.193.4:57944) 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f5567fff640 1 -- 10.20.193.4:0/644508719 learned_addr learned my addr 10.20.193.4:0/644508719 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f55677fe640 1 --2- 10.20.193.4:0/644508719 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e942407860 0x55e942447160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f556c84e640 1 --2- 10.20.193.4:0/644508719 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942449760 0x55e9424476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f5567fff640 1 -- 10.20.193.4:0/644508719 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942449760 msgr2=0x55e9424476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f5567fff640 1 --2- 10.20.193.4:0/644508719 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942449760 0x55e9424476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f5567fff640 1 -- 10.20.193.4:0/644508719 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e942407860 msgr2=0x55e942447160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f5567fff640 1 --2- 10.20.193.4:0/644508719 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e942407860 0x55e942447160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f5567fff640 1 -- 10.20.193.4:0/644508719 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e942456350 con 0x55e942406f50 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.208+0000 7f5567fff640 1 --2- 10.20.193.4:0/644508719 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942468790 secure :-1 s=READY pgs=498 gs=1 cs=0 l=1 c_cookie=14705955945247944956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55540046f0 tx=0x7f555402b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc160d04470c30fc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f552bfff640 1 -- 10.20.193.4:0/644508719 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5554029990 con 0x55e942406f50 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f552bfff640 1 -- 10.20.193.4:0/644508719 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55e94205d4a0 con 0x55e942406f50 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f552bfff640 1 -- 10.20.193.4:0/644508719 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5554010650 con 0x55e942406f50 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f55702d2e00 1 -- 10.20.193.4:0/644508719 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 msgr2=0x55e942468790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f55702d2e00 1 --2- 10.20.193.4:0/644508719 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942468790 secure :-1 s=READY pgs=498 gs=1 cs=0 l=1 c_cookie=14705955945247944956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55540046f0 tx=0x7f555402b000 comp rx=0 tx=0).stop 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f55702d2e00 1 -- 10.20.193.4:0/644508719 shutdown_connections 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f55702d2e00 1 --2- 10.20.193.4:0/644508719 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942449760 0x55e9424476a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f55702d2e00 1 --2- 10.20.193.4:0/644508719 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e942407860 0x55e942447160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f55702d2e00 1 --2- 10.20.193.4:0/644508719 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e942468790 unknown :-1 s=CLOSED pgs=498 gs=1 cs=0 l=1 c_cookie=14705955945247944956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f55702d2e00 1 -- 10.20.193.4:0/644508719 >> 10.20.193.4:0/644508719 conn(0x55e942325db0 msgr2=0x55e942468080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f55702d2e00 1 -- 10.20.193.4:0/644508719 shutdown_connections 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f55702d2e00 1 -- 10.20.193.4:0/644508719 wait complete. 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.209+0000 7f55702d2e00 1 -- start start 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 Processor -- start 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e9423e5030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e942407860 0x55e9423e5570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942449760 0x55e9423e5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e9424b3180 con 0x55e942406f50 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e9424b32f0 con 0x55e942407860 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e9423ea100 con 0x55e942449760 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5567fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e9423e5030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5567fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e9423e5030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57950/0 (socket says 10.20.193.4:57950) 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5567fff640 1 -- 10.20.193.4:0/1549301898 learned_addr learned my addr 10.20.193.4:0/1549301898 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f556c84e640 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942449760 0x55e9423e5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55677fe640 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e942407860 0x55e9423e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5567fff640 1 -- 10.20.193.4:0/1549301898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942449760 msgr2=0x55e9423e5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5567fff640 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942449760 0x55e9423e5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5567fff640 1 -- 10.20.193.4:0/1549301898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e942407860 msgr2=0x55e9423e5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5567fff640 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e942407860 0x55e9423e5570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5567fff640 1 -- 10.20.193.4:0/1549301898 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e94229e190 con 0x55e942406f50 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5567fff640 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e9423e5030 secure :-1 s=READY pgs=499 gs=1 cs=0 l=1 c_cookie=18297914228443593839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5554011fd0 tx=0x7f5554004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdef400b54f23c6f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5529ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5529ffb640 1 -- 10.20.193.4:0/1549301898 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5554029bf0 con 0x55e942406f50 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5529ffb640 1 -- 10.20.193.4:0/1549301898 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5554029990 con 0x55e942406f50 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 -- 10.20.193.4:0/1549301898 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9422a3710 con 0x55e942406f50 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5529ffb640 1 -- 10.20.193.4:0/1549301898 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5554028ca0 con 0x55e942406f50 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 10 client.15708 _ll_register_callbacks cb 0x55e9422b8080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 -- 10.20.193.4:0/1549301898 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f555800dc20 con 0x55e942406f50 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5529ffb640 1 -- 10.20.193.4:0/1549301898 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f5554028e30 con 0x55e942406f50 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5529ffb640 1 -- 10.20.193.4:0/1549301898 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f555401f650 con 0x55e942406f50 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 10 client.15708 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:25.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 -- 10.20.193.4:0/1549301898 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e942291d00 con 0x55e942406f50 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f5529ffb640 1 -- 10.20.193.4:0/1549301898 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f5554030070 con 0x55e942406f50 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 10 client.15708 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 10 client.15708 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 20 client.15708 populate_metadata read hostname 'trial004' 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e94244c500 0x55e94251a0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 4 client.15708 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.210+0000 7f55702d2e00 1 -- 10.20.193.4:0/1549301898 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e942042160 con 0x55e94244c500 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55677fe640 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e94244c500 0x55e94251a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55677fe640 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e94244c500 0x55e94251a0f0 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=5354258588580869600 s_cookie=1850834428238777971 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a4e25d177f275e0 server_cookie=19af7c1b393c4e73 in_seq=0 out_seq=0 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f5529ffb640 10 client.15708 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f5529ffb640 1 -- 10.20.193.4:0/1549301898 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e942042160 con 0x55e94244c500 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f5529ffb640 10 client.15708 handle_command_reply: tid=0 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 client.15708 shutdown 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 -- 10.20.193.4:0/1549301898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 msgr2=0x55e9423e5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e9423e5030 secure :-1 s=READY pgs=499 gs=1 cs=0 l=1 c_cookie=18297914228443593839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5554011fd0 tx=0x7f5554004390 comp rx=0 tx=0).stop 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 -- 10.20.193.4:0/1549301898 shutdown_connections 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e94244c500 0x55e94251a0f0 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=5354258588580869600 s_cookie=1850834428238777971 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e942449760 0x55e9423e5ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e942407860 0x55e9423e5570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 --2- 10.20.193.4:0/1549301898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e942406f50 0x55e9423e5030 unknown :-1 s=CLOSED pgs=499 gs=1 cs=0 l=1 c_cookie=18297914228443593839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f5529ffb640 0 client.15708 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 -- 10.20.193.4:0/1549301898 >> 10.20.193.4:0/1549301898 conn(0x55e942325db0 msgr2=0x55e942405c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 -- 10.20.193.4:0/1549301898 shutdown_connections 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 1 -- 10.20.193.4:0/1549301898 wait complete. 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.211+0000 7f55702d2e00 20 client.15708 trim_cache size 0 max 16384 2026-02-24T09:10:25.223 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:10:25.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 -- 10.20.193.4:0/3745877578 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f553c0b5760 msgr2=0x7f553c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f553c0b5760 0x7f553c0d5c10 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5554004740 tx=0x7f5554004420 comp rx=0 tx=0).stop 2026-02-24T09:10:25.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 -- 10.20.193.4:0/3745877578 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5568115840 msgr2=0x7f55680f5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5568115840 0x7f55680f5f90 secure :-1 s=READY pgs=495 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f555c00a330 tx=0x7f555c0039b0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 -- 10.20.193.4:0/3745877578 shutdown_connections 2026-02-24T09:10:25.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f553c0b5760 0x7f553c0d5c10 unknown :-1 s=CLOSED pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5568115840 0x7f55680f5f90 unknown :-1 s=CLOSED pgs=495 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5568110040 0x7f5568176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 --2- 10.20.193.4:0/3745877578 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f556810f650 0x7f55680f5890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 -- 10.20.193.4:0/3745877578 >> 10.20.193.4:0/3745877578 conn(0x7f55680ecf20 msgr2=0x7f5568111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 -- 10.20.193.4:0/3745877578 shutdown_connections 2026-02-24T09:10:25.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.212+0000 7f556e2d8640 1 -- 10.20.193.4:0/3745877578 wait complete. 2026-02-24T09:10:25.250 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:10:25.363 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.461+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/431286814 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d4115930 msgr2=0x7fd5d4176300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.461+0000 7fd5d8a5b640 1 --2- 10.20.193.4:0/431286814 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d4115930 0x7fd5d4176300 secure :-1 s=READY pgs=500 gs=1 cs=0 l=1 c_cookie=16695063765807985236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c400aa30 tx=0x7fd5c4030270 comp rx=0 tx=0).stop 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.461+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/431286814 shutdown_connections 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.461+0000 7fd5d8a5b640 1 --2- 10.20.193.4:0/431286814 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d4115930 0x7fd5d4176300 unknown :-1 s=CLOSED pgs=500 gs=1 cs=0 l=1 c_cookie=16695063765807985236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.461+0000 7fd5d8a5b640 1 --2- 10.20.193.4:0/431286814 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d4110130 0x7fd5d4115180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.461+0000 7fd5d8a5b640 1 --2- 10.20.193.4:0/431286814 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d410f740 0x7fd5d410fb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.461+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/431286814 >> 10.20.193.4:0/431286814 conn(0x7fd5d40ed050 msgr2=0x7fd5d410d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.461+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/431286814 shutdown_connections 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.461+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/431286814 wait complete. 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.461+0000 7fd5d8a5b640 1 Processor -- start 2026-02-24T09:10:25.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d8a5b640 1 -- start start 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d8a5b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d410f740 0x7fd5d411e050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d8a5b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d4110130 0x7fd5d411e590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d8a5b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d4115930 0x7fd5d4123960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d8a5b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d4123f80 con 0x7fd5d4115930 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d8a5b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d41240f0 con 0x7fd5d4110130 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d8a5b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d41242b0 con 0x7fd5d410f740 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d4115930 0x7fd5d4123960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d4115930 0x7fd5d4123960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57964/0 (socket says 10.20.193.4:57964) 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1110909270 learned_addr learned my addr 10.20.193.4:0/1110909270 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d1d74640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d4110130 0x7fd5d411e590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d2575640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d410f740 0x7fd5d411e050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1110909270 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d410f740 msgr2=0x7fd5d411e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d410f740 0x7fd5d411e050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1110909270 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d4110130 msgr2=0x7fd5d411e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d4110130 0x7fd5d411e590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1110909270 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c400a650 con 0x7fd5d4115930 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d4115930 0x7fd5d4123960 secure :-1 s=READY pgs=501 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c4032fe0 tx=0x7fd5c40039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5bb7fe640 1 -- 10.20.193.4:0/1110909270 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c403e070 con 0x7fd5d4115930 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/1110909270 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d4124530 con 0x7fd5d4115930 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5bb7fe640 1 -- 10.20.193.4:0/1110909270 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5c40055a0 con 0x7fd5d4115930 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5bb7fe640 1 -- 10.20.193.4:0/1110909270 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c4042b70 con 0x7fd5d4115930 2026-02-24T09:10:25.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.462+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/1110909270 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d4164c90 con 0x7fd5d4115930 2026-02-24T09:10:25.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.464+0000 7fd5bb7fe640 1 -- 10.20.193.4:0/1110909270 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fd5c40050c0 con 0x7fd5d4115930 2026-02-24T09:10:25.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.465+0000 7fd5bb7fe640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5ac0b57f0 0x7fd5ac0d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.465+0000 7fd5d2575640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5ac0b57f0 0x7fd5ac0d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.465+0000 7fd5bb7fe640 1 -- 10.20.193.4:0/1110909270 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fd5c410cac0 con 0x7fd5d4115930 2026-02-24T09:10:25.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.465+0000 7fd5d2575640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5ac0b57f0 0x7fd5ac0d5ca0 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c8005970 tx=0x7fd5c8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5daa55e00 1 Processor -- start 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5daa55e00 1 -- start start 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f10df50 0x55fd5f10e320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f152fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f153500 0x55fd5f1738e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f01eee0 con 0x55fd5f10df50 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f01ac10 con 0x55fd5f10e860 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f014d70 con 0x55fd5f153500 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5d2575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f10df50 0x55fd5f10e320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5d2575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f10df50 0x55fd5f10e320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57980/0 (socket says 10.20.193.4:57980) 2026-02-24T09:10:25.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5d2575640 1 -- 10.20.193.4:0/3861624454 learned_addr learned my addr 10.20.193.4:0/3861624454 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5d2575640 1 -- 10.20.193.4:0/3861624454 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f153500 msgr2=0x55fd5f1738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5d2575640 1 --2- 10.20.193.4:0/3861624454 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f153500 0x55fd5f1738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5d2575640 1 -- 10.20.193.4:0/3861624454 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 msgr2=0x55fd5f152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5d2575640 1 --2- 10.20.193.4:0/3861624454 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5d2575640 1 -- 10.20.193.4:0/3861624454 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd5efc0340 con 0x55fd5f10df50 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5d2575640 1 --2- 10.20.193.4:0/3861624454 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f10df50 0x55fd5f10e320 secure :-1 s=READY pgs=502 gs=1 cs=0 l=1 c_cookie=15150355290938062932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c80041c0 tx=0x7fd5c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d240dfddf952b854 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5b8ff9640 1 -- 10.20.193.4:0/3861624454 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c801e680 con 0x55fd5f10df50 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5b8ff9640 1 -- 10.20.193.4:0/3861624454 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5c800fe60 con 0x55fd5f10df50 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.466+0000 7fd5b8ff9640 1 -- 10.20.193.4:0/3861624454 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c8010c10 con 0x55fd5f10df50 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.467+0000 7fd5daa55e00 1 -- 10.20.193.4:0/3861624454 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f10df50 msgr2=0x55fd5f10e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.467+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/3861624454 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f10df50 0x55fd5f10e320 secure :-1 s=READY pgs=502 gs=1 cs=0 l=1 c_cookie=15150355290938062932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c80041c0 tx=0x7fd5c8012000 comp rx=0 tx=0).stop 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.467+0000 7fd5daa55e00 1 -- 10.20.193.4:0/3861624454 shutdown_connections 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.467+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/3861624454 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f153500 0x55fd5f1738e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.467+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/3861624454 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f152fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.467+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/3861624454 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f10df50 0x55fd5f10e320 unknown :-1 s=CLOSED pgs=502 gs=1 cs=0 l=1 c_cookie=15150355290938062932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.467+0000 7fd5daa55e00 1 -- 10.20.193.4:0/3861624454 >> 10.20.193.4:0/3861624454 conn(0x55fd5f02cdb0 msgr2=0x55fd5f10c830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.467+0000 7fd5daa55e00 1 -- 10.20.193.4:0/3861624454 shutdown_connections 2026-02-24T09:10:25.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.467+0000 7fd5daa55e00 1 -- 10.20.193.4:0/3861624454 wait complete. 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.467+0000 7fd5daa55e00 1 -- start start 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 1 Processor -- start 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f16ad60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f16b2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f170290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f1707d0 con 0x55fd5f153500 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f170940 con 0x55fd5f10e860 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f170b00 con 0x55fd5f10df50 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f170290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f170290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57982/0 (socket says 10.20.193.4:57982) 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1489549219 learned_addr learned my addr 10.20.193.4:0/1489549219 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d2575640 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f16ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d1d74640 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f16b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1489549219 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 msgr2=0x55fd5f16ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f16ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1489549219 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 msgr2=0x55fd5f16b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f16b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1489549219 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd5ef989d0 con 0x55fd5f153500 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f170290 secure :-1 s=READY pgs=503 gs=1 cs=0 l=1 c_cookie=4364623291863681831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c40cf3c0 tx=0x7fd5c40cf510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9241c259ee4b27 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd583fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd583fff640 1 -- 10.20.193.4:0/1489549219 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c40d25f0 con 0x55fd5f153500 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1489549219 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c800fa30 con 0x55fd5f153500 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd583fff640 1 -- 10.20.193.4:0/1489549219 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5c40d37f0 con 0x55fd5f153500 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd583fff640 1 -- 10.20.193.4:0/1489549219 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c40d3a80 con 0x55fd5f153500 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 10 client.15720 _ll_register_callbacks cb 0x55fd5efbf080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1489549219 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd5ed644a0 con 0x55fd5f153500 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd583fff640 1 -- 10.20.193.4:0/1489549219 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fd5c40d3be0 con 0x55fd5f153500 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd583fff640 1 -- 10.20.193.4:0/1489549219 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd5c40ddaa0 con 0x55fd5f153500 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 10 client.15720 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.468+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1489549219 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55fd5efaa710 con 0x55fd5f153500 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.469+0000 7fd583fff640 1 -- 10.20.193.4:0/1489549219 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd5c4097f80 con 0x55fd5f153500 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.469+0000 7fd5daa55e00 10 client.15720 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.469+0000 7fd5daa55e00 10 client.15720 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.469+0000 7fd5daa55e00 20 client.15720 populate_metadata read hostname 'trial004' 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.469+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55fd5f1503f0 0x55fd5f150890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.469+0000 7fd5daa55e00 4 client.15720 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.469+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1489549219 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd5f00a7b0 con 0x55fd5f1503f0 2026-02-24T09:10:25.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.469+0000 7fd5d2575640 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55fd5f1503f0 0x55fd5f150890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.469+0000 7fd5d2575640 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55fd5f1503f0 0x55fd5f150890 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=6452998556359569616 s_cookie=17465852127517535166 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=598da7ff5febb0d0 server_cookie=f2632bf8d02eebbe in_seq=0 out_seq=0 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.469+0000 7fd583fff640 10 client.15720 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd583fff640 1 -- 10.20.193.4:0/1489549219 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55fd5f00a7b0 con 0x55fd5f1503f0 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd583fff640 10 client.15720 handle_command_reply: tid=0 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 client.15720 shutdown 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1489549219 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 msgr2=0x55fd5f170290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f170290 secure :-1 s=READY pgs=503 gs=1 cs=0 l=1 c_cookie=4364623291863681831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c40cf3c0 tx=0x7fd5c40cf510 comp rx=0 tx=0).stop 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1489549219 shutdown_connections 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55fd5f1503f0 0x55fd5f150890 crc :-1 s=READY pgs=23 gs=4 cs=0 l=0 c_cookie=6452998556359569616 s_cookie=17465852127517535166 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f170290 unknown :-1 s=CLOSED pgs=503 gs=1 cs=0 l=1 c_cookie=4364623291863681831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f16b2a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/1489549219 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f16ad60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd583fff640 0 client.15720 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1489549219 >> 10.20.193.4:0/1489549219 conn(0x55fd5f02cdb0 msgr2=0x55fd5f10c040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1489549219 shutdown_connections 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1489549219 wait complete. 2026-02-24T09:10:25.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.470+0000 7fd5daa55e00 20 client.15720 trim_cache size 0 max 16384 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.476+0000 7fd5daa55e00 1 Processor -- start 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.476+0000 7fd5daa55e00 1 -- start start 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f152180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f1526c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f152c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f0129a0 con 0x55fd5f153500 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fd5edeedf0 con 0x55fd5f10e860 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f07e270 con 0x55fd5f10df50 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:57988/0 (socket says 10.20.193.4:57988) 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1556895415 learned_addr learned my addr 10.20.193.4:0/1556895415 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1556895415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 msgr2=0x55fd5f152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2575640 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f152180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d1d74640 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f152180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1556895415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 msgr2=0x55fd5f1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f1526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2d76640 1 -- 10.20.193.4:0/1556895415 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd5f15d3c0 con 0x55fd5f153500 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2575640 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f152180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d1d74640 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f1526c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f152c00 secure :-1 s=READY pgs=504 gs=1 cs=0 l=1 c_cookie=12064375976171064728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c4003fd0 tx=0x7fd5c40d6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76d4607d06ecd98 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd59e4e6640 1 -- 10.20.193.4:0/1556895415 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c40d37f0 con 0x55fd5f153500 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd59e4e6640 1 -- 10.20.193.4:0/1556895415 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5c4095070 con 0x55fd5f153500 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd59e4e6640 1 -- 10.20.193.4:0/1556895415 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c40ce740 con 0x55fd5f153500 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1556895415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 msgr2=0x55fd5f152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f152c00 secure :-1 s=READY pgs=504 gs=1 cs=0 l=1 c_cookie=12064375976171064728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c4003fd0 tx=0x7fd5c40d6000 comp rx=0 tx=0).stop 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1556895415 shutdown_connections 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f152c00 unknown :-1 s=CLOSED pgs=504 gs=1 cs=0 l=1 c_cookie=12064375976171064728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f1526c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/1556895415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f152180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1556895415 >> 10.20.193.4:0/1556895415 conn(0x55fd5f02cdb0 msgr2=0x55fd5f10c450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1556895415 shutdown_connections 2026-02-24T09:10:25.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.477+0000 7fd5daa55e00 1 -- 10.20.193.4:0/1556895415 wait complete. 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5daa55e00 1 -- start start 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5daa55e00 1 Processor -- start 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f0ed640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f0edb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5daa55e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f0ee0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f1585a0 con 0x55fd5f153500 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f1b9160 con 0x55fd5f10e860 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5daa55e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fd5f1b9320 con 0x55fd5f10df50 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f0ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f0ee0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58004/0 (socket says 10.20.193.4:58004) 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d2d76640 1 -- 10.20.193.4:0/2451165841 learned_addr learned my addr 10.20.193.4:0/2451165841 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d2575640 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f0ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d1d74640 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f0edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d2d76640 1 -- 10.20.193.4:0/2451165841 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 msgr2=0x55fd5f0ed640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f0ed640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d2d76640 1 -- 10.20.193.4:0/2451165841 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 msgr2=0x55fd5f0edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f0edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d2d76640 1 -- 10.20.193.4:0/2451165841 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd5f1716c0 con 0x55fd5f153500 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d1d74640 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f0edb80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5d2d76640 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f0ee0c0 secure :-1 s=READY pgs=505 gs=1 cs=0 l=1 c_cookie=3230321773151339911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c4042cd0 tx=0x7fd5c4042580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd46889a6e54587 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd583fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd583fff640 1 -- 10.20.193.4:0/2451165841 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c40db0f0 con 0x55fd5f153500 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd583fff640 1 -- 10.20.193.4:0/2451165841 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55fd5ed644a0 con 0x55fd5f153500 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.478+0000 7fd5daa55e00 1 -- 10.20.193.4:0/2451165841 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd5efaa710 con 0x55fd5f153500 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd583fff640 1 -- 10.20.193.4:0/2451165841 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c40980a0 con 0x55fd5f153500 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd583fff640 1 -- 10.20.193.4:0/2451165841 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fd5c40ddaa0 con 0x55fd5f153500 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd583fff640 10 client.15726 inactive, discarding osd_map(77..77 src has 1..77) 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5daa55e00 10 client.15726 _ll_register_callbacks cb 0x55fd5efbf080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5daa55e00 1 -- 10.20.193.4:0/2451165841 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5c800fe60 con 0x55fd5f153500 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd583fff640 1 -- 10.20.193.4:0/2451165841 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd5c40ddd20 con 0x55fd5f153500 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5daa55e00 10 client.15726 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5daa55e00 1 -- 10.20.193.4:0/2451165841 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55fd5efa5190 con 0x55fd5f153500 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd583fff640 1 -- 10.20.193.4:0/2451165841 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd5c40d3a80 con 0x55fd5f153500 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5daa55e00 10 client.15726 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5daa55e00 10 client.15726 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5daa55e00 20 client.15726 populate_metadata read hostname 'trial004' 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55fd5f2009a0 0x55fd5f220e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5daa55e00 4 client.15726 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5daa55e00 1 -- 10.20.193.4:0/2451165841 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd5ed49160 con 0x55fd5f2009a0 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.479+0000 7fd5d2575640 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55fd5f2009a0 0x55fd5f220e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d2575640 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55fd5f2009a0 0x55fd5f220e20 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=13477001114958359751 s_cookie=9342886269682918021 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb07ed1c1ea2ecc7 server_cookie=81a8998fc1532285 in_seq=0 out_seq=0 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd583fff640 10 client.15726 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd583fff640 1 -- 10.20.193.4:0/2451165841 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd5ed49160 con 0x55fd5f2009a0 2026-02-24T09:10:25.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd583fff640 10 client.15726 handle_command_reply: tid=0 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 client.15726 shutdown 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 -- 10.20.193.4:0/2451165841 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 msgr2=0x55fd5f0ee0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f0ee0c0 secure :-1 s=READY pgs=505 gs=1 cs=0 l=1 c_cookie=3230321773151339911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c4042cd0 tx=0x7fd5c4042580 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 -- 10.20.193.4:0/2451165841 shutdown_connections 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55fd5f2009a0 0x55fd5f220e20 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=13477001114958359751 s_cookie=9342886269682918021 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fd5f153500 0x55fd5f0ee0c0 unknown :-1 s=CLOSED pgs=505 gs=1 cs=0 l=1 c_cookie=3230321773151339911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fd5f10e860 0x55fd5f0edb80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 --2- 10.20.193.4:0/2451165841 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fd5f10df50 0x55fd5f0ed640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd583fff640 0 client.15726 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 -- 10.20.193.4:0/2451165841 >> 10.20.193.4:0/2451165841 conn(0x55fd5f02cdb0 msgr2=0x55fd5f10cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 -- 10.20.193.4:0/2451165841 shutdown_connections 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 1 -- 10.20.193.4:0/2451165841 wait complete. 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5daa55e00 20 client.15726 trim_cache size 0 max 16384 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/1110909270 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5ac0b57f0 msgr2=0x7fd5ac0d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5ac0b57f0 0x7fd5ac0d5ca0 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c8005970 tx=0x7fd5c8005900 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/1110909270 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d4115930 msgr2=0x7fd5d4123960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d4115930 0x7fd5d4123960 secure :-1 s=READY pgs=501 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c4032fe0 tx=0x7fd5c40039b0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/1110909270 shutdown_connections 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5ac0b57f0 0x7fd5ac0d5ca0 unknown :-1 s=CLOSED pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d4115930 0x7fd5d4123960 unknown :-1 s=CLOSED pgs=501 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d4110130 0x7fd5d411e590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 --2- 10.20.193.4:0/1110909270 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d410f740 0x7fd5d411e050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/1110909270 >> 10.20.193.4:0/1110909270 conn(0x7fd5d40ed050 msgr2=0x7fd5d410d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/1110909270 shutdown_connections 2026-02-24T09:10:25.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.480+0000 7fd5d8a5b640 1 -- 10.20.193.4:0/1110909270 wait complete. 2026-02-24T09:10:25.518 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:10:25.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:25 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/699851297' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:25.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:25 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/699851297' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:25.636 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:25.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 -- 10.20.193.4:0/620145055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb864110040 msgr2=0x7fb864115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 --2- 10.20.193.4:0/620145055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb864110040 0x7fb864115090 secure :-1 s=READY pgs=506 gs=1 cs=0 l=1 c_cookie=16280568080457664318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb854009950 tx=0x7fb85402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 -- 10.20.193.4:0/620145055 shutdown_connections 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 --2- 10.20.193.4:0/620145055 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb864115840 0x7fb864176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 --2- 10.20.193.4:0/620145055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb864110040 0x7fb864115090 unknown :-1 s=CLOSED pgs=506 gs=1 cs=0 l=1 c_cookie=16280568080457664318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 --2- 10.20.193.4:0/620145055 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb86410f650 0x7fb86410fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 -- 10.20.193.4:0/620145055 >> 10.20.193.4:0/620145055 conn(0x7fb8640ecf20 msgr2=0x7fb86410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 -- 10.20.193.4:0/620145055 shutdown_connections 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 -- 10.20.193.4:0/620145055 wait complete. 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 Processor -- start 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 -- start start 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86410f650 0x7fb8640f5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb864110040 0x7fb864176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb864115840 0x7fb8640f5f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb8640fb1a0 con 0x7fb86410f650 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb8640fb310 con 0x7fb864110040 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb869f83640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb8640fb4d0 con 0x7fb864115840 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86410f650 0x7fb8640f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86410f650 0x7fb8640f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58028/0 (socket says 10.20.193.4:58028) 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb8637fe640 1 -- 10.20.193.4:0/671958359 learned_addr learned my addr 10.20.193.4:0/671958359 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb863fff640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb864115840 0x7fb8640f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb862ffd640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb864110040 0x7fb864176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb8637fe640 1 -- 10.20.193.4:0/671958359 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb864115840 msgr2=0x7fb8640f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb8637fe640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb864115840 0x7fb8640f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb8637fe640 1 -- 10.20.193.4:0/671958359 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb864110040 msgr2=0x7fb864176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb8637fe640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb864110040 0x7fb864176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb8637fe640 1 -- 10.20.193.4:0/671958359 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb854009570 con 0x7fb86410f650 2026-02-24T09:10:25.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb863fff640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb864115840 0x7fb8640f5f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:25.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb862ffd640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb864110040 0x7fb864176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:25.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.733+0000 7fb8637fe640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86410f650 0x7fb8640f5890 secure :-1 s=READY pgs=507 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb850009480 tx=0x7fb85000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.734+0000 7fb860ff9640 1 -- 10.20.193.4:0/671958359 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb85000cd40 con 0x7fb86410f650 2026-02-24T09:10:25.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.734+0000 7fb869f83640 1 -- 10.20.193.4:0/671958359 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8640fb7b0 con 0x7fb86410f650 2026-02-24T09:10:25.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.734+0000 7fb860ff9640 1 -- 10.20.193.4:0/671958359 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb850004d30 con 0x7fb86410f650 2026-02-24T09:10:25.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.734+0000 7fb860ff9640 1 -- 10.20.193.4:0/671958359 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8500106b0 con 0x7fb86410f650 2026-02-24T09:10:25.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.734+0000 7fb869f83640 1 -- 10.20.193.4:0/671958359 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8640fbcd0 con 0x7fb86410f650 2026-02-24T09:10:25.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.735+0000 7fb860ff9640 1 -- 10.20.193.4:0/671958359 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fb85001f060 con 0x7fb86410f650 2026-02-24T09:10:25.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.736+0000 7fb860ff9640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8380b57e0 0x7fb8380d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.736+0000 7fb860ff9640 1 -- 10.20.193.4:0/671958359 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fb850014070 con 0x7fb86410f650 2026-02-24T09:10:25.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.736+0000 7fb862ffd640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8380b57e0 0x7fb8380d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.736+0000 7fb862ffd640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8380b57e0 0x7fb8380d5c90 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8540023d0 tx=0x7fb854031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb86bf7de00 1 Processor -- start 2026-02-24T09:10:25.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb86bf7de00 1 -- start start 2026-02-24T09:10:25.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547cf50 0x55f3f547d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547d860 0x55f3f54c1fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 0x55f3f54e28e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f3f538dee0 con 0x55f3f547cf50 2026-02-24T09:10:25.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f3f5389c10 con 0x55f3f54c2500 2026-02-24T09:10:25.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f3f5383d70 con 0x55f3f547d860 2026-02-24T09:10:25.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547cf50 0x55f3f547d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547cf50 0x55f3f547d320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58030/0 (socket says 10.20.193.4:58030) 2026-02-24T09:10:25.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb8637fe640 1 -- 10.20.193.4:0/283480997 learned_addr learned my addr 10.20.193.4:0/283480997 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb862ffd640 1 --2- 10.20.193.4:0/283480997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547d860 0x55f3f54c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb863fff640 1 --2- 10.20.193.4:0/283480997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 0x55f3f54e28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb8637fe640 1 -- 10.20.193.4:0/283480997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547d860 msgr2=0x55f3f54c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb8637fe640 1 --2- 10.20.193.4:0/283480997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547d860 0x55f3f54c1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb8637fe640 1 -- 10.20.193.4:0/283480997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 msgr2=0x55f3f54e28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb8637fe640 1 --2- 10.20.193.4:0/283480997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 0x55f3f54e28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb8637fe640 1 -- 10.20.193.4:0/283480997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f532f340 con 0x55f3f547cf50 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb8637fe640 1 --2- 10.20.193.4:0/283480997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547cf50 0x55f3f547d320 secure :-1 s=READY pgs=508 gs=1 cs=0 l=1 c_cookie=5157479864302242497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8500e4910 tx=0x7fb8500ad210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47930c9c6ff70ac1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb827fff640 1 -- 10.20.193.4:0/283480997 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8500adb60 con 0x55f3f547cf50 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb827fff640 1 -- 10.20.193.4:0/283480997 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8500b2e80 con 0x55f3f547cf50 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.738+0000 7fb827fff640 1 -- 10.20.193.4:0/283480997 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8500ae070 con 0x55f3f547cf50 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.739+0000 7fb86bf7de00 1 -- 10.20.193.4:0/283480997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547cf50 msgr2=0x55f3f547d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.739+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/283480997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547cf50 0x55f3f547d320 secure :-1 s=READY pgs=508 gs=1 cs=0 l=1 c_cookie=5157479864302242497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8500e4910 tx=0x7fb8500ad210 comp rx=0 tx=0).stop 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.739+0000 7fb86bf7de00 1 -- 10.20.193.4:0/283480997 shutdown_connections 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.739+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/283480997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 0x55f3f54e28e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.739+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/283480997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547d860 0x55f3f54c1fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.739+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/283480997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547cf50 0x55f3f547d320 unknown :-1 s=CLOSED pgs=508 gs=1 cs=0 l=1 c_cookie=5157479864302242497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.739+0000 7fb86bf7de00 1 -- 10.20.193.4:0/283480997 >> 10.20.193.4:0/283480997 conn(0x55f3f539bdb0 msgr2=0x55f3f547b830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.739+0000 7fb86bf7de00 1 -- 10.20.193.4:0/283480997 shutdown_connections 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.739+0000 7fb86bf7de00 1 -- 10.20.193.4:0/283480997 wait complete. 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb86bf7de00 1 -- start start 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb86bf7de00 1 Processor -- start 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547cf50 0x55f3f54d9dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f54da300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f54c2500 0x55f3f54df2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f3f54df830 con 0x55f3f547d860 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f3f54df9a0 con 0x55f3f547cf50 2026-02-24T09:10:25.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f3f54dfb60 con 0x55f3f54c2500 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb862ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f54da300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb862ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f54da300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58032/0 (socket says 10.20.193.4:58032) 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb862ffd640 1 -- 10.20.193.4:0/3356825328 learned_addr learned my addr 10.20.193.4:0/3356825328 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb863fff640 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f54c2500 0x55f3f54df2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb8637fe640 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547cf50 0x55f3f54d9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb862ffd640 1 -- 10.20.193.4:0/3356825328 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f54c2500 msgr2=0x55f3f54df2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb862ffd640 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f54c2500 0x55f3f54df2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb862ffd640 1 -- 10.20.193.4:0/3356825328 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547cf50 msgr2=0x55f3f54d9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb862ffd640 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547cf50 0x55f3f54d9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb862ffd640 1 -- 10.20.193.4:0/3356825328 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f53079d0 con 0x55f3f547d860 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb8637fe640 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547cf50 0x55f3f54d9dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb862ffd640 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f54da300 secure :-1 s=READY pgs=509 gs=1 cs=0 l=1 c_cookie=13964268737991358737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb854009950 tx=0x7fb85403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1cb0c6e6c113911 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb8257fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb8257fa640 1 -- 10.20.193.4:0/3356825328 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb85404d040 con 0x55f3f547d860 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb86bf7de00 1 -- 10.20.193.4:0/3356825328 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8640fbcd0 con 0x55f3f547d860 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb8257fa640 1 -- 10.20.193.4:0/3356825328 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8540043a0 con 0x55f3f547d860 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb8257fa640 1 -- 10.20.193.4:0/3356825328 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb85403f070 con 0x55f3f547d860 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.740+0000 7fb86bf7de00 10 client.15738 _ll_register_callbacks cb 0x55f3f532e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb86bf7de00 1 -- 10.20.193.4:0/3356825328 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f3f50d34a0 con 0x55f3f547d860 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb8257fa640 1 -- 10.20.193.4:0/3356825328 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fb8540446a0 con 0x55f3f547d860 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb8257fa640 1 -- 10.20.193.4:0/3356825328 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb854044860 con 0x55f3f547d860 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb86bf7de00 10 client.15738 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb86bf7de00 1 -- 10.20.193.4:0/3356825328 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f3f5319710 con 0x55f3f547d860 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb8257fa640 1 -- 10.20.193.4:0/3356825328 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb8540449c0 con 0x55f3f547d860 2026-02-24T09:10:25.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb86bf7de00 10 client.15738 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb86bf7de00 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb86bf7de00 20 client.15738 populate_metadata read hostname 'trial004' 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f3f54bf7b0 0x55f3f54bfc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb86bf7de00 4 client.15738 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb86bf7de00 1 -- 10.20.193.4:0/3356825328 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3f53797b0 con 0x55f3f54bf7b0 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.741+0000 7fb8637fe640 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f3f54bf7b0 0x55f3f54bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb8637fe640 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f3f54bf7b0 0x55f3f54bfc50 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=16393857654372237864 s_cookie=6983666850015287811 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e382aeada32d0228 server_cookie=60eaf7ffc0d51a03 in_seq=0 out_seq=0 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb8257fa640 10 client.15738 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb8257fa640 1 -- 10.20.193.4:0/3356825328 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f3f53797b0 con 0x55f3f54bf7b0 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb8257fa640 10 client.15738 handle_command_reply: tid=0 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 client.15738 shutdown 2026-02-24T09:10:25.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 -- 10.20.193.4:0/3356825328 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 msgr2=0x55f3f54da300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f54da300 secure :-1 s=READY pgs=509 gs=1 cs=0 l=1 c_cookie=13964268737991358737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb854009950 tx=0x7fb85403f000 comp rx=0 tx=0).stop 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 -- 10.20.193.4:0/3356825328 shutdown_connections 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f3f54bf7b0 0x55f3f54bfc50 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=16393857654372237864 s_cookie=6983666850015287811 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f54c2500 0x55f3f54df2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f54da300 unknown :-1 s=CLOSED pgs=509 gs=1 cs=0 l=1 c_cookie=13964268737991358737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/3356825328 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547cf50 0x55f3f54d9dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb8257fa640 0 client.15738 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 -- 10.20.193.4:0/3356825328 >> 10.20.193.4:0/3356825328 conn(0x55f3f539bdb0 msgr2=0x55f3f547b040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 -- 10.20.193.4:0/3356825328 shutdown_connections 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 1 -- 10.20.193.4:0/3356825328 wait complete. 2026-02-24T09:10:25.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.742+0000 7fb86bf7de00 20 client.15738 trim_cache size 0 max 16384 2026-02-24T09:10:25.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb86bf7de00 1 Processor -- start 2026-02-24T09:10:25.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb86bf7de00 1 -- start start 2026-02-24T09:10:25.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547cf50 0x55f3f54c1540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547d860 0x55f3f54c1a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f54c2500 0x55f3f54c1fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f3f53819a0 con 0x55f3f54c2500 2026-02-24T09:10:25.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f3f515ddf0 con 0x55f3f547d860 2026-02-24T09:10:25.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f3f54e2cc0 con 0x55f3f547cf50 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb863fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f54c2500 0x55f3f54c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb863fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f54c2500 0x55f3f54c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58040/0 (socket says 10.20.193.4:58040) 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb8637fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547cf50 0x55f3f54c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb863fff640 1 -- 10.20.193.4:0/2157528402 learned_addr learned my addr 10.20.193.4:0/2157528402 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.749+0000 7fb862ffd640 1 --2- 10.20.193.4:0/2157528402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547d860 0x55f3f54c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb863fff640 1 -- 10.20.193.4:0/2157528402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547cf50 msgr2=0x55f3f54c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb863fff640 1 --2- 10.20.193.4:0/2157528402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547cf50 0x55f3f54c1540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb863fff640 1 -- 10.20.193.4:0/2157528402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547d860 msgr2=0x55f3f54c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb863fff640 1 --2- 10.20.193.4:0/2157528402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547d860 0x55f3f54c1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb863fff640 1 -- 10.20.193.4:0/2157528402 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f54cc420 con 0x55f3f54c2500 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb863fff640 1 --2- 10.20.193.4:0/2157528402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f54c2500 0x55f3f54c1fc0 secure :-1 s=READY pgs=510 gs=1 cs=0 l=1 c_cookie=6371890638250454574 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb858004b70 tx=0x7fb8580137c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586d80c6988e2e2e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb8277fe640 1 -- 10.20.193.4:0/2157528402 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb858004c70 con 0x55f3f54c2500 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb8277fe640 1 -- 10.20.193.4:0/2157528402 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb858004dd0 con 0x55f3f54c2500 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb8277fe640 1 -- 10.20.193.4:0/2157528402 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8580119f0 con 0x55f3f54c2500 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb86bf7de00 1 -- 10.20.193.4:0/2157528402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f54c2500 msgr2=0x55f3f54c1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/2157528402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f54c2500 0x55f3f54c1fc0 secure :-1 s=READY pgs=510 gs=1 cs=0 l=1 c_cookie=6371890638250454574 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb858004b70 tx=0x7fb8580137c0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb86bf7de00 1 -- 10.20.193.4:0/2157528402 shutdown_connections 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/2157528402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f54c2500 0x55f3f54c1fc0 unknown :-1 s=CLOSED pgs=510 gs=1 cs=0 l=1 c_cookie=6371890638250454574 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/2157528402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f547d860 0x55f3f54c1a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/2157528402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547cf50 0x55f3f54c1540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb86bf7de00 1 -- 10.20.193.4:0/2157528402 >> 10.20.193.4:0/2157528402 conn(0x55f3f539bdb0 msgr2=0x55f3f547b450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb86bf7de00 1 -- 10.20.193.4:0/2157528402 shutdown_connections 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.750+0000 7fb86bf7de00 1 -- 10.20.193.4:0/2157528402 wait complete. 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb86bf7de00 1 -- start start 2026-02-24T09:10:25.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb86bf7de00 1 Processor -- start 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547cf50 0x55f3f545caf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f545d030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb86bf7de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 0x55f3f5528100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f3f5528640 con 0x55f3f547d860 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f3f55287b0 con 0x55f3f54c2500 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb86bf7de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f3f5528970 con 0x55f3f547cf50 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb862ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f545d030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb862ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f545d030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58056/0 (socket says 10.20.193.4:58056) 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb862ffd640 1 -- 10.20.193.4:0/56879612 learned_addr learned my addr 10.20.193.4:0/56879612 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb8637fe640 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547cf50 0x55f3f545caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb863fff640 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 0x55f3f5528100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb862ffd640 1 -- 10.20.193.4:0/56879612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547cf50 msgr2=0x55f3f545caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb862ffd640 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547cf50 0x55f3f545caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb862ffd640 1 -- 10.20.193.4:0/56879612 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 msgr2=0x55f3f5528100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb862ffd640 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 0x55f3f5528100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb862ffd640 1 -- 10.20.193.4:0/56879612 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3f5314190 con 0x55f3f547d860 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb863fff640 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 0x55f3f5528100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb862ffd640 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f545d030 secure :-1 s=READY pgs=511 gs=1 cs=0 l=1 c_cookie=10978776769825121888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8540517d0 tx=0x7fb854048040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985c734dd9bca660 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb8257fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb8257fa640 1 -- 10.20.193.4:0/56879612 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb854009290 con 0x55f3f547d860 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb8257fa640 1 -- 10.20.193.4:0/56879612 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f3f50d34a0 con 0x55f3f547d860 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb8257fa640 1 -- 10.20.193.4:0/56879612 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb854042860 con 0x55f3f547d860 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb86bf7de00 1 -- 10.20.193.4:0/56879612 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb858004790 con 0x55f3f547d860 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb8257fa640 1 -- 10.20.193.4:0/56879612 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fb8540429f0 con 0x55f3f547d860 2026-02-24T09:10:25.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.751+0000 7fb8257fa640 10 client.15744 inactive, discarding osd_map(77..77 src has 1..77) 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb86bf7de00 10 client.15744 _ll_register_callbacks cb 0x55f3f532e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb86bf7de00 1 -- 10.20.193.4:0/56879612 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8500b2e80 con 0x55f3f547d860 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb8257fa640 1 -- 10.20.193.4:0/56879612 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb85403f070 con 0x55f3f547d860 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb86bf7de00 10 client.15744 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb86bf7de00 1 -- 10.20.193.4:0/56879612 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f3f5307d00 con 0x55f3f547d860 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb8257fa640 1 -- 10.20.193.4:0/56879612 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb854051830 con 0x55f3f547d860 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb86bf7de00 10 client.15744 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb86bf7de00 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb86bf7de00 20 client.15744 populate_metadata read hostname 'trial004' 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f3f55706a0 0x55f3f5590b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb86bf7de00 4 client.15744 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb86bf7de00 1 -- 10.20.193.4:0/56879612 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3f50b8160 con 0x55f3f55706a0 2026-02-24T09:10:25.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.752+0000 7fb8637fe640 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f3f55706a0 0x55f3f5590b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb8637fe640 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f3f55706a0 0x55f3f5590b20 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=16492092803430262856 s_cookie=11718321862559709783 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4dfaf069f3ca848 server_cookie=a29fd7a5cd90ba57 in_seq=0 out_seq=0 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb8257fa640 10 client.15744 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb8257fa640 1 -- 10.20.193.4:0/56879612 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3f50b8160 con 0x55f3f55706a0 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb8257fa640 10 client.15744 handle_command_reply: tid=0 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 client.15744 shutdown 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 -- 10.20.193.4:0/56879612 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 msgr2=0x55f3f545d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f545d030 secure :-1 s=READY pgs=511 gs=1 cs=0 l=1 c_cookie=10978776769825121888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8540517d0 tx=0x7fb854048040 comp rx=0 tx=0).stop 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 -- 10.20.193.4:0/56879612 shutdown_connections 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f3f55706a0 0x55f3f5590b20 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=16492092803430262856 s_cookie=11718321862559709783 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f3f54c2500 0x55f3f5528100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f3f547d860 0x55f3f545d030 unknown :-1 s=CLOSED pgs=511 gs=1 cs=0 l=1 c_cookie=10978776769825121888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 --2- 10.20.193.4:0/56879612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f3f547cf50 0x55f3f545caf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb8257fa640 0 client.15744 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:25.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 -- 10.20.193.4:0/56879612 >> 10.20.193.4:0/56879612 conn(0x55f3f539bdb0 msgr2=0x55f3f547bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 -- 10.20.193.4:0/56879612 shutdown_connections 2026-02-24T09:10:25.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 1 -- 10.20.193.4:0/56879612 wait complete. 2026-02-24T09:10:25.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb86bf7de00 20 client.15744 trim_cache size 0 max 16384 2026-02-24T09:10:25.770 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:10:25.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 -- 10.20.193.4:0/671958359 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8380b57e0 msgr2=0x7fb8380d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8380b57e0 0x7fb8380d5c90 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8540023d0 tx=0x7fb854031040 comp rx=0 tx=0).stop 2026-02-24T09:10:25.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 -- 10.20.193.4:0/671958359 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86410f650 msgr2=0x7fb8640f5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:25.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86410f650 0x7fb8640f5890 secure :-1 s=READY pgs=507 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb850009480 tx=0x7fb85000ee60 comp rx=0 tx=0).stop 2026-02-24T09:10:25.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 -- 10.20.193.4:0/671958359 shutdown_connections 2026-02-24T09:10:25.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8380b57e0 0x7fb8380d5c90 unknown :-1 s=CLOSED pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb864115840 0x7fb8640f5f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb864110040 0x7fb864176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 --2- 10.20.193.4:0/671958359 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86410f650 0x7fb8640f5890 unknown :-1 s=CLOSED pgs=507 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:25.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 -- 10.20.193.4:0/671958359 >> 10.20.193.4:0/671958359 conn(0x7fb8640ecf20 msgr2=0x7fb864111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:25.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 -- 10.20.193.4:0/671958359 shutdown_connections 2026-02-24T09:10:25.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:25.753+0000 7fb869f83640 1 -- 10.20.193.4:0/671958359 wait complete. 2026-02-24T09:10:26.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:26 trial004 ceph-mon[41596]: pgmap v169: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2026-02-24T09:10:26.582 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:26 trial090 ceph-mon[47278]: pgmap v169: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2026-02-24T09:10:26.593 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:26 trial014 ceph-mon[46941]: pgmap v169: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2026-02-24T09:10:26.793 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:10:26.794 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:10:26.911 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:27.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 -- 10.20.193.4:0/2144371650 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce7c10f280 msgr2=0x7fce7c10f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 --2- 10.20.193.4:0/2144371650 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce7c10f280 0x7fce7c10f650 secure :-1 s=READY pgs=512 gs=1 cs=0 l=1 c_cookie=6368461694211941460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce6c009950 tx=0x7fce6c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 -- 10.20.193.4:0/2144371650 shutdown_connections 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 --2- 10.20.193.4:0/2144371650 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce7c115470 0x7fce7c175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 --2- 10.20.193.4:0/2144371650 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce7c10fc70 0x7fce7c114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 --2- 10.20.193.4:0/2144371650 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce7c10f280 0x7fce7c10f650 unknown :-1 s=CLOSED pgs=512 gs=1 cs=0 l=1 c_cookie=6368461694211941460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 -- 10.20.193.4:0/2144371650 >> 10.20.193.4:0/2144371650 conn(0x7fce7c05f830 msgr2=0x7fce7c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 -- 10.20.193.4:0/2144371650 shutdown_connections 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 -- 10.20.193.4:0/2144371650 wait complete. 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 Processor -- start 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 -- start start 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce7c10f280 0x7fce7c11dbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce7c10fc70 0x7fce7c11e130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce7c115470 0x7fce7c1234b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c123ad0 con 0x7fce7c10f280 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c123c40 con 0x7fce7c10fc70 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce84045640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c123e00 con 0x7fce7c115470 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce81dba640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce7c10f280 0x7fce7c11dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce81dba640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce7c10f280 0x7fce7c11dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58064/0 (socket says 10.20.193.4:58064) 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce81dba640 1 -- 10.20.193.4:0/2351570686 learned_addr learned my addr 10.20.193.4:0/2351570686 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.015+0000 7fce825bb640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce7c115470 0x7fce7c1234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce81dba640 1 -- 10.20.193.4:0/2351570686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce7c115470 msgr2=0x7fce7c1234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce81dba640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce7c115470 0x7fce7c1234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce81dba640 1 -- 10.20.193.4:0/2351570686 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce7c10fc70 msgr2=0x7fce7c11e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce81dba640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce7c10fc70 0x7fce7c11e130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce81dba640 1 -- 10.20.193.4:0/2351570686 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c009570 con 0x7fce7c10f280 2026-02-24T09:10:27.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce81dba640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce7c10f280 0x7fce7c11dbf0 secure :-1 s=READY pgs=513 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce6c038820 tx=0x7fce6c004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce6affd640 1 -- 10.20.193.4:0/2351570686 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce6c03d070 con 0x7fce7c10f280 2026-02-24T09:10:27.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce6affd640 1 -- 10.20.193.4:0/2351570686 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce6c002ad0 con 0x7fce7c10f280 2026-02-24T09:10:27.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce84045640 1 -- 10.20.193.4:0/2351570686 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7c124080 con 0x7fce7c10f280 2026-02-24T09:10:27.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce6affd640 1 -- 10.20.193.4:0/2351570686 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce6c041940 con 0x7fce7c10f280 2026-02-24T09:10:27.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.016+0000 7fce84045640 1 -- 10.20.193.4:0/2351570686 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7c1647e0 con 0x7fce7c10f280 2026-02-24T09:10:27.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.017+0000 7fce6affd640 1 -- 10.20.193.4:0/2351570686 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fce6c041ad0 con 0x7fce7c10f280 2026-02-24T09:10:27.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.018+0000 7fce6affd640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce580b5770 0x7fce580d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.018+0000 7fce6affd640 1 -- 10.20.193.4:0/2351570686 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fce6c10b330 con 0x7fce7c10f280 2026-02-24T09:10:27.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.018+0000 7fce815b9640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce580b5770 0x7fce580d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.018+0000 7fce815b9640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce580b5770 0x7fce580d5c20 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce70005970 tx=0x7fce70005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce8603fe00 1 Processor -- start 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce8603fe00 1 -- start start 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab578d9300 0x55ab578d96d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9c10 0x55ab5791e370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab5791e8b0 0x55ab5793ec90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce8603fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ab577e9520 con 0x55ab5791e8b0 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce8603fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ab577e5250 con 0x55ab578d9300 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce8603fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ab577df3b0 con 0x55ab578d9c10 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce825bb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab5791e8b0 0x55ab5793ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce825bb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab5791e8b0 0x55ab5793ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58072/0 (socket says 10.20.193.4:58072) 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce825bb640 1 -- 10.20.193.4:0/3174756536 learned_addr learned my addr 10.20.193.4:0/3174756536 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce815b9640 1 --2- 10.20.193.4:0/3174756536 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9c10 0x55ab5791e370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce825bb640 1 -- 10.20.193.4:0/3174756536 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9c10 msgr2=0x55ab5791e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce825bb640 1 --2- 10.20.193.4:0/3174756536 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9c10 0x55ab5791e370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce825bb640 1 -- 10.20.193.4:0/3174756536 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab578d9300 msgr2=0x55ab578d96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce825bb640 1 --2- 10.20.193.4:0/3174756536 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab578d9300 0x55ab578d96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce825bb640 1 -- 10.20.193.4:0/3174756536 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab5778a6e0 con 0x55ab5791e8b0 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce825bb640 1 --2- 10.20.193.4:0/3174756536 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab5791e8b0 0x55ab5793ec90 secure :-1 s=READY pgs=514 gs=1 cs=0 l=1 c_cookie=5917670974853221970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce78006a50 tx=0x7fce78003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521fca6601c40e52 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce4a4e6640 1 -- 10.20.193.4:0/3174756536 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce7800ae30 con 0x55ab5791e8b0 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce4a4e6640 1 -- 10.20.193.4:0/3174756536 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce78003e90 con 0x55ab5791e8b0 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.020+0000 7fce4a4e6640 1 -- 10.20.193.4:0/3174756536 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce78012a30 con 0x55ab5791e8b0 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.021+0000 7fce8603fe00 1 -- 10.20.193.4:0/3174756536 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab5791e8b0 msgr2=0x55ab5793ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.021+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3174756536 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab5791e8b0 0x55ab5793ec90 secure :-1 s=READY pgs=514 gs=1 cs=0 l=1 c_cookie=5917670974853221970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce78006a50 tx=0x7fce78003c30 comp rx=0 tx=0).stop 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.021+0000 7fce8603fe00 1 -- 10.20.193.4:0/3174756536 shutdown_connections 2026-02-24T09:10:27.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.021+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3174756536 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab5791e8b0 0x55ab5793ec90 unknown :-1 s=CLOSED pgs=514 gs=1 cs=0 l=1 c_cookie=5917670974853221970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.021+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3174756536 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9c10 0x55ab5791e370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.021+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3174756536 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab578d9300 0x55ab578d96d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.021+0000 7fce8603fe00 1 -- 10.20.193.4:0/3174756536 >> 10.20.193.4:0/3174756536 conn(0x55ab577f74f0 msgr2=0x55ab578d7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.021+0000 7fce8603fe00 1 -- 10.20.193.4:0/3174756536 shutdown_connections 2026-02-24T09:10:27.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.021+0000 7fce8603fe00 1 -- 10.20.193.4:0/3174756536 wait complete. 2026-02-24T09:10:27.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.021+0000 7fce8603fe00 1 -- start start 2026-02-24T09:10:27.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce8603fe00 1 Processor -- start 2026-02-24T09:10:27.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9300 0x55ab578f1400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9c10 0x55ab578f1940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 0x55ab578f6930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce8603fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ab578f6e70 con 0x55ab578d9c10 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce8603fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ab578f6fe0 con 0x55ab5791e8b0 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce8603fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ab578f71a0 con 0x55ab578d9300 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce815b9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9c10 0x55ab578f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce815b9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9c10 0x55ab578f1940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58088/0 (socket says 10.20.193.4:58088) 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce815b9640 1 -- 10.20.193.4:0/3691555279 learned_addr learned my addr 10.20.193.4:0/3691555279 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce825bb640 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 0x55ab578f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce81dba640 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9300 0x55ab578f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce815b9640 1 -- 10.20.193.4:0/3691555279 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9300 msgr2=0x55ab578f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce815b9640 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9300 0x55ab578f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce815b9640 1 -- 10.20.193.4:0/3691555279 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 msgr2=0x55ab578f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce815b9640 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 0x55ab578f6930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce815b9640 1 -- 10.20.193.4:0/3691555279 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab57762cd0 con 0x55ab578d9c10 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce825bb640 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 0x55ab578f6930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce81dba640 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9300 0x55ab578f1400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce815b9640 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9c10 0x55ab578f1940 secure :-1 s=READY pgs=515 gs=1 cs=0 l=1 c_cookie=13456457361113540033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce70009690 tx=0x7fce70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babef0acb05ce5c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce377fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce377fe640 1 -- 10.20.193.4:0/3691555279 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce70023030 con 0x55ab578d9c10 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce377fe640 1 -- 10.20.193.4:0/3691555279 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce70002e30 con 0x55ab578d9c10 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce377fe640 1 -- 10.20.193.4:0/3691555279 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce70015040 con 0x55ab578d9c10 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce8603fe00 1 -- 10.20.193.4:0/3691555279 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce78005350 con 0x55ab578d9c10 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce377fe640 1 -- 10.20.193.4:0/3691555279 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fce70024070 con 0x55ab578d9c10 2026-02-24T09:10:27.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce377fe640 10 client.15756 inactive, discarding osd_map(77..77 src has 1..77) 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce8603fe00 10 client.15756 _ll_register_callbacks cb 0x55ab5775b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.022+0000 7fce8603fe00 1 -- 10.20.193.4:0/3691555279 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab5746c9d0 con 0x55ab578d9c10 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce377fe640 1 -- 10.20.193.4:0/3691555279 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fce7001e440 con 0x55ab578d9c10 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce8603fe00 10 client.15756 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce8603fe00 1 -- 10.20.193.4:0/3691555279 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55ab57774ab0 con 0x55ab578d9c10 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce377fe640 1 -- 10.20.193.4:0/3691555279 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fce7001b050 con 0x55ab578d9c10 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce8603fe00 10 client.15756 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce8603fe00 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce8603fe00 20 client.15756 populate_metadata read hostname 'trial004' 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ab5791bd50 0x55ab5791c1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce8603fe00 4 client.15756 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:27.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce8603fe00 1 -- 10.20.193.4:0/3691555279 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab577efb70 con 0x55ab5791bd50 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce81dba640 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ab5791bd50 0x55ab5791c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce81dba640 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ab5791bd50 0x55ab5791c1c0 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=16604200212705383120 s_cookie=3706302569745273809 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e66df81ee1c512d0 server_cookie=336f6e8ce3c8d3d1 in_seq=0 out_seq=0 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.023+0000 7fce377fe640 10 client.15756 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce377fe640 1 -- 10.20.193.4:0/3691555279 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ab577efb70 con 0x55ab5791bd50 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce377fe640 10 client.15756 handle_command_reply: tid=0 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 client.15756 shutdown 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 -- 10.20.193.4:0/3691555279 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9c10 msgr2=0x55ab578f1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9c10 0x55ab578f1940 secure :-1 s=READY pgs=515 gs=1 cs=0 l=1 c_cookie=13456457361113540033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce70009690 tx=0x7fce70004770 comp rx=0 tx=0).stop 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 -- 10.20.193.4:0/3691555279 shutdown_connections 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ab5791bd50 0x55ab5791c1c0 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=16604200212705383120 s_cookie=3706302569745273809 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 0x55ab578f6930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9c10 0x55ab578f1940 unknown :-1 s=CLOSED pgs=515 gs=1 cs=0 l=1 c_cookie=13456457361113540033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3691555279 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9300 0x55ab578f1400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce377fe640 0 client.15756 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:27.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 -- 10.20.193.4:0/3691555279 >> 10.20.193.4:0/3691555279 conn(0x55ab577f74f0 msgr2=0x55ab578d82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 -- 10.20.193.4:0/3691555279 shutdown_connections 2026-02-24T09:10:27.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 1 -- 10.20.193.4:0/3691555279 wait complete. 2026-02-24T09:10:27.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.024+0000 7fce8603fe00 20 client.15756 trim_cache size 0 max 16384 2026-02-24T09:10:27.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce8603fe00 1 Processor -- start 2026-02-24T09:10:27.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce8603fe00 1 -- start start 2026-02-24T09:10:27.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578ee9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9c10 0x55ab57916e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 0x55ab57917350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce8603fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ab577dcfe0 con 0x55ab578d9300 2026-02-24T09:10:27.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce8603fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ab574a7fe0 con 0x55ab5791e8b0 2026-02-24T09:10:27.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce8603fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ab578a2b10 con 0x55ab578d9c10 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce81dba640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578ee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce81dba640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578ee9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58100/0 (socket says 10.20.193.4:58100) 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce81dba640 1 -- 10.20.193.4:0/3699587799 learned_addr learned my addr 10.20.193.4:0/3699587799 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce825bb640 1 --2- 10.20.193.4:0/3699587799 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 0x55ab57917350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce81dba640 1 -- 10.20.193.4:0/3699587799 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9c10 msgr2=0x55ab57916e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce81dba640 1 --2- 10.20.193.4:0/3699587799 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9c10 0x55ab57916e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce81dba640 1 -- 10.20.193.4:0/3699587799 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 msgr2=0x55ab57917350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce81dba640 1 --2- 10.20.193.4:0/3699587799 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 0x55ab57917350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce81dba640 1 -- 10.20.193.4:0/3699587799 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab5776f530 con 0x55ab578d9300 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.033+0000 7fce81dba640 1 --2- 10.20.193.4:0/3699587799 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578ee9d0 secure :-1 s=READY pgs=516 gs=1 cs=0 l=1 c_cookie=16034197190492379466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce6c0d1890 tx=0x7fce6c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de84e96455dd594a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce49ce5640 1 -- 10.20.193.4:0/3699587799 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce6c0cdc70 con 0x55ab578d9300 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce49ce5640 1 -- 10.20.193.4:0/3699587799 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce6c0d2020 con 0x55ab578d9300 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce49ce5640 1 -- 10.20.193.4:0/3699587799 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce6c0d11c0 con 0x55ab578d9300 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce8603fe00 1 -- 10.20.193.4:0/3699587799 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 msgr2=0x55ab578ee9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3699587799 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578ee9d0 secure :-1 s=READY pgs=516 gs=1 cs=0 l=1 c_cookie=16034197190492379466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce6c0d1890 tx=0x7fce6c009310 comp rx=0 tx=0).stop 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce8603fe00 1 -- 10.20.193.4:0/3699587799 shutdown_connections 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3699587799 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab5791e8b0 0x55ab57917350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3699587799 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab578d9c10 0x55ab57916e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce8603fe00 1 --2- 10.20.193.4:0/3699587799 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578ee9d0 unknown :-1 s=CLOSED pgs=516 gs=1 cs=0 l=1 c_cookie=16034197190492379466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce8603fe00 1 -- 10.20.193.4:0/3699587799 >> 10.20.193.4:0/3699587799 conn(0x55ab577f74f0 msgr2=0x55ab578f0080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce8603fe00 1 -- 10.20.193.4:0/3699587799 shutdown_connections 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce8603fe00 1 -- 10.20.193.4:0/3699587799 wait complete. 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.034+0000 7fce8603fe00 1 -- start start 2026-02-24T09:10:27.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 Processor -- start 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578f9370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab578d9c10 0x55ab578f98d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab5791e8b0 0x55ab57983dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ab578b4650 con 0x55ab578d9300 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ab578fa1b0 con 0x55ab578d9c10 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ab57984310 con 0x55ab5791e8b0 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce81dba640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce81dba640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578f9370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58116/0 (socket says 10.20.193.4:58116) 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce81dba640 1 -- 10.20.193.4:0/2674667309 learned_addr learned my addr 10.20.193.4:0/2674667309 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce825bb640 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab5791e8b0 0x55ab57983dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce815b9640 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab578d9c10 0x55ab578f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce81dba640 1 -- 10.20.193.4:0/2674667309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab5791e8b0 msgr2=0x55ab57983dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce81dba640 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab5791e8b0 0x55ab57983dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce81dba640 1 -- 10.20.193.4:0/2674667309 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab578d9c10 msgr2=0x55ab578f98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce81dba640 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab578d9c10 0x55ab578f98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce81dba640 1 -- 10.20.193.4:0/2674667309 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab57763000 con 0x55ab578d9300 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce825bb640 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab5791e8b0 0x55ab57983dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce815b9640 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab578d9c10 0x55ab578f98d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce81dba640 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578f9370 secure :-1 s=READY pgs=517 gs=1 cs=0 l=1 c_cookie=17999813507890608336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce6c0023d0 tx=0x7fce6c038de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cc2f04b118f8d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce377fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce377fe640 1 -- 10.20.193.4:0/2674667309 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce6c0ed070 con 0x55ab578d9300 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 -- 10.20.193.4:0/2674667309 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7c1647e0 con 0x55ab578d9300 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce377fe640 1 -- 10.20.193.4:0/2674667309 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce6c0d7340 con 0x55ab578d9300 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce377fe640 1 -- 10.20.193.4:0/2674667309 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce6c0dc530 con 0x55ab578d9300 2026-02-24T09:10:27.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 10 client.15762 _ll_register_callbacks cb 0x55ab5775b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 -- 10.20.193.4:0/2674667309 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab577f17e0 con 0x55ab578d9300 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce377fe640 1 -- 10.20.193.4:0/2674667309 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fce6c0d24e0 con 0x55ab578d9300 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce377fe640 1 -- 10.20.193.4:0/2674667309 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fce6c0f5100 con 0x55ab578d9300 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 10 client.15762 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 -- 10.20.193.4:0/2674667309 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55ab57774d10 con 0x55ab578d9300 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce377fe640 1 -- 10.20.193.4:0/2674667309 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fce6c0967b0 con 0x55ab578d9300 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 10 client.15762 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 20 client.15762 populate_metadata read hostname 'trial004' 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ab579cc000 0x55ab579ec4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 4 client.15762 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.035+0000 7fce8603fe00 1 -- 10.20.193.4:0/2674667309 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ab5746a220 con 0x55ab579cc000 2026-02-24T09:10:27.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.036+0000 7fce815b9640 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ab579cc000 0x55ab579ec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.036+0000 7fce815b9640 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ab579cc000 0x55ab579ec4b0 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=15074427225526920418 s_cookie=4842164801591937940 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1331fb1a20264e2 server_cookie=4332d33b6ec98b94 in_seq=0 out_seq=0 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.036+0000 7fce377fe640 10 client.15762 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce377fe640 1 -- 10.20.193.4:0/2674667309 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ab5746a220 con 0x55ab579cc000 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce377fe640 10 client.15762 handle_command_reply: tid=0 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 client.15762 shutdown 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 -- 10.20.193.4:0/2674667309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 msgr2=0x55ab578f9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578f9370 secure :-1 s=READY pgs=517 gs=1 cs=0 l=1 c_cookie=17999813507890608336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce6c0023d0 tx=0x7fce6c038de0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 -- 10.20.193.4:0/2674667309 shutdown_connections 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ab579cc000 0x55ab579ec4b0 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=15074427225526920418 s_cookie=4842164801591937940 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ab5791e8b0 0x55ab57983dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ab578d9c10 0x55ab578f98d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 --2- 10.20.193.4:0/2674667309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ab578d9300 0x55ab578f9370 unknown :-1 s=CLOSED pgs=517 gs=1 cs=0 l=1 c_cookie=17999813507890608336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce377fe640 0 client.15762 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:27.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 -- 10.20.193.4:0/2674667309 >> 10.20.193.4:0/2674667309 conn(0x55ab577f74f0 msgr2=0x55ab578ed9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 -- 10.20.193.4:0/2674667309 shutdown_connections 2026-02-24T09:10:27.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 1 -- 10.20.193.4:0/2674667309 wait complete. 2026-02-24T09:10:27.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce8603fe00 20 client.15762 trim_cache size 0 max 16384 2026-02-24T09:10:27.050 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:10:27.050 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:10:27.050 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "2f927036-df4b-4f13-8dfb-f86e239bd88a", 2026-02-24T09:10:27.051 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:10:27.051 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:10:27.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 -- 10.20.193.4:0/2351570686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce580b5770 msgr2=0x7fce580d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce580b5770 0x7fce580d5c20 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce70005970 tx=0x7fce70005900 comp rx=0 tx=0).stop 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 -- 10.20.193.4:0/2351570686 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce7c10f280 msgr2=0x7fce7c11dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce7c10f280 0x7fce7c11dbf0 secure :-1 s=READY pgs=513 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce6c038820 tx=0x7fce6c004300 comp rx=0 tx=0).stop 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 -- 10.20.193.4:0/2351570686 shutdown_connections 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce580b5770 0x7fce580d5c20 unknown :-1 s=CLOSED pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce7c115470 0x7fce7c1234b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce7c10fc70 0x7fce7c11e130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 --2- 10.20.193.4:0/2351570686 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce7c10f280 0x7fce7c11dbf0 unknown :-1 s=CLOSED pgs=513 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 -- 10.20.193.4:0/2351570686 >> 10.20.193.4:0/2351570686 conn(0x7fce7c05f830 msgr2=0x7fce7c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 -- 10.20.193.4:0/2351570686 shutdown_connections 2026-02-24T09:10:27.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.037+0000 7fce84045640 1 -- 10.20.193.4:0/2351570686 wait complete. 2026-02-24T09:10:27.078 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:10:27.196 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:27.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.292+0000 7fdce5022640 1 -- 10.20.193.4:0/4168538726 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdce010f650 msgr2=0x7fdce010fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.292+0000 7fdce5022640 1 --2- 10.20.193.4:0/4168538726 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdce010f650 0x7fdce010fa20 secure :-1 s=READY pgs=518 gs=1 cs=0 l=1 c_cookie=5618228014977016565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd4009950 tx=0x7fdcd402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.292+0000 7fdce5022640 1 -- 10.20.193.4:0/4168538726 shutdown_connections 2026-02-24T09:10:27.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.292+0000 7fdce5022640 1 --2- 10.20.193.4:0/4168538726 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce0115840 0x7fdce0176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.292+0000 7fdce5022640 1 --2- 10.20.193.4:0/4168538726 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdce0110040 0x7fdce0115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.292+0000 7fdce5022640 1 --2- 10.20.193.4:0/4168538726 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdce010f650 0x7fdce010fa20 unknown :-1 s=CLOSED pgs=518 gs=1 cs=0 l=1 c_cookie=5618228014977016565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.292+0000 7fdce5022640 1 -- 10.20.193.4:0/4168538726 >> 10.20.193.4:0/4168538726 conn(0x7fdce00ecf20 msgr2=0x7fdce010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.292+0000 7fdce5022640 1 -- 10.20.193.4:0/4168538726 shutdown_connections 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.292+0000 7fdce5022640 1 -- 10.20.193.4:0/4168538726 wait complete. 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdce5022640 1 Processor -- start 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdce5022640 1 -- start start 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdce5022640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce010f650 0x7fdce011df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdce5022640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdce0110040 0x7fdce011e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdce5022640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdce0115840 0x7fdce0123810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdce5022640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fdce0123e30 con 0x7fdce0110040 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdce5022640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fdce0123fa0 con 0x7fdce0115840 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdce5022640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdce0124160 con 0x7fdce010f650 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcde575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdce0110040 0x7fdce011e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcde575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdce0110040 0x7fdce011e440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58130/0 (socket says 10.20.193.4:58130) 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcde575640 1 -- 10.20.193.4:0/4026289965 learned_addr learned my addr 10.20.193.4:0/4026289965 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcded76640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce010f650 0x7fdce011df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcde575640 1 -- 10.20.193.4:0/4026289965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce010f650 msgr2=0x7fdce011df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcde575640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce010f650 0x7fdce011df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcde575640 1 -- 10.20.193.4:0/4026289965 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdce0115840 msgr2=0x7fdce0123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcde575640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdce0115840 0x7fdce0123810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcde575640 1 -- 10.20.193.4:0/4026289965 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd4009570 con 0x7fdce0110040 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcde575640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdce0110040 0x7fdce011e440 secure :-1 s=READY pgs=519 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc800d950 tx=0x7fdcc800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcbffff640 1 -- 10.20.193.4:0/4026289965 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcc8004540 con 0x7fdce0110040 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcbffff640 1 -- 10.20.193.4:0/4026289965 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcc8009d00 con 0x7fdce0110040 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdce5022640 1 -- 10.20.193.4:0/4026289965 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce0124440 con 0x7fdce0110040 2026-02-24T09:10:27.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdcbffff640 1 -- 10.20.193.4:0/4026289965 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcc80106e0 con 0x7fdce0110040 2026-02-24T09:10:27.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.293+0000 7fdce5022640 1 -- 10.20.193.4:0/4026289965 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce0164b40 con 0x7fdce0110040 2026-02-24T09:10:27.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.295+0000 7fdcbffff640 1 -- 10.20.193.4:0/4026289965 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fdcc80097c0 con 0x7fdce0110040 2026-02-24T09:10:27.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.296+0000 7fdcbffff640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcb40b5770 0x7fdcb40d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.296+0000 7fdcded76640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcb40b5770 0x7fdcb40d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.296+0000 7fdcbffff640 1 -- 10.20.193.4:0/4026289965 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fdcc80e6fe0 con 0x7fdce0110040 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.296+0000 7fdcded76640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcb40b5770 0x7fdcb40d5c20 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd40023d0 tx=0x7fdcd4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdce701ce00 1 Processor -- start 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdce701ce00 1 -- start start 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f62077fbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f6207c4890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f6207e51b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdce701ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f62068fde0 con 0x55f620780130 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdce701ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f62068bb10 con 0x55f6207c4dd0 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdce701ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f620685ab0 con 0x55f62077f820 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdcde575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f6207c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdcde575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f6207c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58146/0 (socket says 10.20.193.4:58146) 2026-02-24T09:10:27.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdcde575640 1 -- 10.20.193.4:0/181333139 learned_addr learned my addr 10.20.193.4:0/181333139 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.297+0000 7fdcded76640 1 --2- 10.20.193.4:0/181333139 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f62077fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcde575640 1 -- 10.20.193.4:0/181333139 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 msgr2=0x55f62077fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcde575640 1 --2- 10.20.193.4:0/181333139 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f62077fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcdf577640 1 --2- 10.20.193.4:0/181333139 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f6207e51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcde575640 1 -- 10.20.193.4:0/181333139 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 msgr2=0x55f6207e51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcde575640 1 --2- 10.20.193.4:0/181333139 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f6207e51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcde575640 1 -- 10.20.193.4:0/181333139 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f620631310 con 0x55f620780130 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcdf577640 1 --2- 10.20.193.4:0/181333139 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f6207e51b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcde575640 1 --2- 10.20.193.4:0/181333139 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f6207c4890 secure :-1 s=READY pgs=520 gs=1 cs=0 l=1 c_cookie=10756752601454601131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc80e4970 tx=0x7fdcc8002c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9547a97fd275e3ab server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcab7fe640 1 -- 10.20.193.4:0/181333139 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcc80acba0 con 0x55f620780130 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcab7fe640 1 -- 10.20.193.4:0/181333139 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcc80ac9c0 con 0x55f620780130 2026-02-24T09:10:27.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdcab7fe640 1 -- 10.20.193.4:0/181333139 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcc80ade50 con 0x55f620780130 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdce701ce00 1 -- 10.20.193.4:0/181333139 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 msgr2=0x55f6207c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdce701ce00 1 --2- 10.20.193.4:0/181333139 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f6207c4890 secure :-1 s=READY pgs=520 gs=1 cs=0 l=1 c_cookie=10756752601454601131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc80e4970 tx=0x7fdcc8002c20 comp rx=0 tx=0).stop 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdce701ce00 1 -- 10.20.193.4:0/181333139 shutdown_connections 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdce701ce00 1 --2- 10.20.193.4:0/181333139 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f6207e51b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdce701ce00 1 --2- 10.20.193.4:0/181333139 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f6207c4890 unknown :-1 s=CLOSED pgs=520 gs=1 cs=0 l=1 c_cookie=10756752601454601131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdce701ce00 1 --2- 10.20.193.4:0/181333139 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f62077fbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdce701ce00 1 -- 10.20.193.4:0/181333139 >> 10.20.193.4:0/181333139 conn(0x55f62069e6b0 msgr2=0x55f62077e100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdce701ce00 1 -- 10.20.193.4:0/181333139 shutdown_connections 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.298+0000 7fdce701ce00 1 -- 10.20.193.4:0/181333139 wait complete. 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 1 -- start start 2026-02-24T09:10:27.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 1 Processor -- start 2026-02-24T09:10:27.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f620797e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620798370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f62079d360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f62079d8a0 con 0x55f620780130 2026-02-24T09:10:27.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f62079da10 con 0x55f6207c4dd0 2026-02-24T09:10:27.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f62079dbd0 con 0x55f62077f820 2026-02-24T09:10:27.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcde575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620798370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcde575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620798370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58160/0 (socket says 10.20.193.4:58160) 2026-02-24T09:10:27.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcde575640 1 -- 10.20.193.4:0/730696848 learned_addr learned my addr 10.20.193.4:0/730696848 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:27.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcded76640 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f620797e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcdf577640 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f62079d360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcde575640 1 -- 10.20.193.4:0/730696848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 msgr2=0x55f620797e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcde575640 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f620797e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcde575640 1 -- 10.20.193.4:0/730696848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 msgr2=0x55f62079d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcde575640 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f62079d360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcde575640 1 -- 10.20.193.4:0/730696848 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6206098c0 con 0x55f620780130 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdcde575640 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620798370 secure :-1 s=READY pgs=521 gs=1 cs=0 l=1 c_cookie=10883110909636721427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc80ad430 tx=0x7fdcc8002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970893b60c133b13 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdca8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdca8ff9640 1 -- 10.20.193.4:0/730696848 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcc80b8090 con 0x55f620780130 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 1 -- 10.20.193.4:0/730696848 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce0164b40 con 0x55f620780130 2026-02-24T09:10:27.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdca8ff9640 1 -- 10.20.193.4:0/730696848 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcc805b110 con 0x55f620780130 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdca8ff9640 1 -- 10.20.193.4:0/730696848 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcc8072350 con 0x55f620780130 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 10 client.15774 _ll_register_callbacks cb 0x55f620621160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdce701ce00 1 -- 10.20.193.4:0/730696848 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f6203d54a0 con 0x55f620780130 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.299+0000 7fdca8ff9640 1 -- 10.20.193.4:0/730696848 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fdcc80724e0 con 0x55f620780130 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdca8ff9640 1 -- 10.20.193.4:0/730696848 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdcc80ab1a0 con 0x55f620780130 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdce701ce00 10 client.15774 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdce701ce00 1 -- 10.20.193.4:0/730696848 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f62061b6e0 con 0x55f620780130 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdca8ff9640 1 -- 10.20.193.4:0/730696848 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fdcc80aebb0 con 0x55f620780130 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdce701ce00 10 client.15774 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdce701ce00 10 client.15774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdce701ce00 20 client.15774 populate_metadata read hostname 'trial004' 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdce701ce00 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f6207c22a0 0x55f6207c2740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdce701ce00 4 client.15774 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdce701ce00 1 -- 10.20.193.4:0/730696848 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f62067b4f0 con 0x55f6207c22a0 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.300+0000 7fdcded76640 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f6207c22a0 0x55f6207c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdcded76640 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f6207c22a0 0x55f6207c2740 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=2890193884610449874 s_cookie=18107278616043682379 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281c0806703651d2 server_cookie=fb49f9f6fe4f7a4b in_seq=0 out_seq=0 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdca8ff9640 10 client.15774 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdca8ff9640 1 -- 10.20.193.4:0/730696848 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f62067b4f0 con 0x55f6207c22a0 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdca8ff9640 10 client.15774 handle_command_reply: tid=0 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 client.15774 shutdown 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 -- 10.20.193.4:0/730696848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 msgr2=0x55f620798370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620798370 secure :-1 s=READY pgs=521 gs=1 cs=0 l=1 c_cookie=10883110909636721427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc80ad430 tx=0x7fdcc8002390 comp rx=0 tx=0).stop 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 -- 10.20.193.4:0/730696848 shutdown_connections 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f6207c22a0 0x55f6207c2740 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=2890193884610449874 s_cookie=18107278616043682379 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f62079d360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620798370 unknown :-1 s=CLOSED pgs=521 gs=1 cs=0 l=1 c_cookie=10883110909636721427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 --2- 10.20.193.4:0/730696848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f620797e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdca8ff9640 0 client.15774 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:27.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 -- 10.20.193.4:0/730696848 >> 10.20.193.4:0/730696848 conn(0x55f62069e6b0 msgr2=0x55f62077e810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 -- 10.20.193.4:0/730696848 shutdown_connections 2026-02-24T09:10:27.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 1 -- 10.20.193.4:0/730696848 wait complete. 2026-02-24T09:10:27.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.301+0000 7fdce701ce00 20 client.15774 trim_cache size 0 max 16384 2026-02-24T09:10:27.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdce701ce00 1 Processor -- start 2026-02-24T09:10:27.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdce701ce00 1 -- start start 2026-02-24T09:10:27.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f620789bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620795200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f620795740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdce701ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f62079d760 con 0x55f620780130 2026-02-24T09:10:27.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdce701ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f620798770 con 0x55f6207c4dd0 2026-02-24T09:10:27.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdce701ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f6206836e0 con 0x55f62077f820 2026-02-24T09:10:27.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdcde575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620795200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdcde575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620795200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58162/0 (socket says 10.20.193.4:58162) 2026-02-24T09:10:27.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.310+0000 7fdcde575640 1 -- 10.20.193.4:0/1083040215 learned_addr learned my addr 10.20.193.4:0/1083040215 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:27.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcded76640 1 --2- 10.20.193.4:0/1083040215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f620789bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcdf577640 1 --2- 10.20.193.4:0/1083040215 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f620795740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcde575640 1 -- 10.20.193.4:0/1083040215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 msgr2=0x55f620789bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcde575640 1 --2- 10.20.193.4:0/1083040215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f620789bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcde575640 1 -- 10.20.193.4:0/1083040215 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 msgr2=0x55f620795740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcde575640 1 --2- 10.20.193.4:0/1083040215 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f620795740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcde575640 1 -- 10.20.193.4:0/1083040215 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f620616160 con 0x55f620780130 2026-02-24T09:10:27.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcde575640 1 --2- 10.20.193.4:0/1083040215 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620795200 secure :-1 s=READY pgs=522 gs=1 cs=0 l=1 c_cookie=17143610327865664395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc80ad1a0 tx=0x7fdcc80c8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edea56c33026a38b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcaaffd640 1 -- 10.20.193.4:0/1083040215 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcc8072350 con 0x55f620780130 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcaaffd640 1 -- 10.20.193.4:0/1083040215 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f6203d54a0 con 0x55f620780130 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdcaaffd640 1 -- 10.20.193.4:0/1083040215 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcc8005b20 con 0x55f620780130 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdce701ce00 1 -- 10.20.193.4:0/1083040215 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 msgr2=0x55f620795200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdce701ce00 1 --2- 10.20.193.4:0/1083040215 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620795200 secure :-1 s=READY pgs=522 gs=1 cs=0 l=1 c_cookie=17143610327865664395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc80ad1a0 tx=0x7fdcc80c8000 comp rx=0 tx=0).stop 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdce701ce00 1 -- 10.20.193.4:0/1083040215 shutdown_connections 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdce701ce00 1 --2- 10.20.193.4:0/1083040215 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f6207c4dd0 0x55f620795740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdce701ce00 1 --2- 10.20.193.4:0/1083040215 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f620780130 0x55f620795200 unknown :-1 s=CLOSED pgs=522 gs=1 cs=0 l=1 c_cookie=17143610327865664395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdce701ce00 1 --2- 10.20.193.4:0/1083040215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f620789bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdce701ce00 1 -- 10.20.193.4:0/1083040215 >> 10.20.193.4:0/1083040215 conn(0x55f62069e6b0 msgr2=0x55f6207c3810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdce701ce00 1 -- 10.20.193.4:0/1083040215 shutdown_connections 2026-02-24T09:10:27.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.311+0000 7fdce701ce00 1 -- 10.20.193.4:0/1083040215 wait complete. 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 -- start start 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 Processor -- start 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f6207a1c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f620780130 0x55f6207a2180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f6207c4dd0 0x55f62082a300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f6206f2150 con 0x55f6207c4dd0 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f620798770 con 0x55f620780130 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f6206836e0 con 0x55f62077f820 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcdf577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f6207c4dd0 0x55f62082a300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcdf577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f6207c4dd0 0x55f62082a300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58178/0 (socket says 10.20.193.4:58178) 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcdf577640 1 -- 10.20.193.4:0/153805200 learned_addr learned my addr 10.20.193.4:0/153805200 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:27.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcded76640 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f6207a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcde575640 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f620780130 0x55f6207a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcdf577640 1 -- 10.20.193.4:0/153805200 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 msgr2=0x55f6207a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcdf577640 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f6207a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcdf577640 1 -- 10.20.193.4:0/153805200 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f620780130 msgr2=0x55f6207a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcdf577640 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f620780130 0x55f6207a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcdf577640 1 -- 10.20.193.4:0/153805200 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f620609bf0 con 0x55f6207c4dd0 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcde575640 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f620780130 0x55f6207a2180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdcdf577640 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f6207c4dd0 0x55f62082a300 secure :-1 s=READY pgs=523 gs=1 cs=0 l=1 c_cookie=8822277179537222526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd0003ca0 tx=0x7fdcd000aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6f065a3459eb7e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdca8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdca8ff9640 1 -- 10.20.193.4:0/153805200 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcd0011890 con 0x55f6207c4dd0 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 -- 10.20.193.4:0/153805200 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f62061b6e0 con 0x55f6207c4dd0 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdca8ff9640 1 -- 10.20.193.4:0/153805200 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcd0013450 con 0x55f6207c4dd0 2026-02-24T09:10:27.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdca8ff9640 1 -- 10.20.193.4:0/153805200 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcd0010640 con 0x55f6207c4dd0 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 10 client.15780 _ll_register_callbacks cb 0x55f620621160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 -- 10.20.193.4:0/153805200 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcc80ac9c0 con 0x55f6207c4dd0 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdca8ff9640 1 -- 10.20.193.4:0/153805200 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fdcd00107d0 con 0x55f6207c4dd0 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdca8ff9640 1 -- 10.20.193.4:0/153805200 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdcd0010a10 con 0x55f6207c4dd0 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 10 client.15780 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdce701ce00 1 -- 10.20.193.4:0/153805200 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f62061b940 con 0x55f6207c4dd0 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.312+0000 7fdca8ff9640 1 -- 10.20.193.4:0/153805200 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fdcd0010c30 con 0x55f6207c4dd0 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 10 client.15780 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 20 client.15780 populate_metadata read hostname 'trial004' 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f620872850 0x55f620892cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 4 client.15780 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:10:27.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 -- 10.20.193.4:0/153805200 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f6203ba160 con 0x55f620872850 2026-02-24T09:10:27.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdcded76640 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f620872850 0x55f620892cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:27.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdcded76640 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f620872850 0x55f620892cd0 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=4671055919034761775 s_cookie=12572318528819070836 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40d2ec9c2c0d822f server_cookie=ae79d91749528774 in_seq=0 out_seq=0 2026-02-24T09:10:27.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdca8ff9640 10 client.15780 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:27.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdca8ff9640 1 -- 10.20.193.4:0/153805200 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55f6203ba160 con 0x55f620872850 2026-02-24T09:10:27.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdca8ff9640 10 client.15780 handle_command_reply: tid=0 2026-02-24T09:10:27.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 client.15780 shutdown 2026-02-24T09:10:27.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 -- 10.20.193.4:0/153805200 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f6207c4dd0 msgr2=0x55f62082a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f6207c4dd0 0x55f62082a300 secure :-1 s=READY pgs=523 gs=1 cs=0 l=1 c_cookie=8822277179537222526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd0003ca0 tx=0x7fdcd000aa00 comp rx=0 tx=0).stop 2026-02-24T09:10:27.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 -- 10.20.193.4:0/153805200 shutdown_connections 2026-02-24T09:10:27.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f620872850 0x55f620892cd0 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=4671055919034761775 s_cookie=12572318528819070836 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f6207c4dd0 0x55f62082a300 unknown :-1 s=CLOSED pgs=523 gs=1 cs=0 l=1 c_cookie=8822277179537222526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f620780130 0x55f6207a2180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 --2- 10.20.193.4:0/153805200 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f62077f820 0x55f6207a1c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdca8ff9640 0 client.15780 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:27.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 -- 10.20.193.4:0/153805200 >> 10.20.193.4:0/153805200 conn(0x55f62069e6b0 msgr2=0x55f6207c3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 -- 10.20.193.4:0/153805200 shutdown_connections 2026-02-24T09:10:27.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 1 -- 10.20.193.4:0/153805200 wait complete. 2026-02-24T09:10:27.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.313+0000 7fdce701ce00 20 client.15780 trim_cache size 0 max 16384 2026-02-24T09:10:27.330 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:10:27.330 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:10:27.330 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:10:27.330 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:10:27.330 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:10:27.330 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "2f927036-df4b-4f13-8dfb-f86e239bd88a", 2026-02-24T09:10:27.330 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:10:27.330 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:27.330 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:10:27.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:10:27.332 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:10:27.332 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:10:27.332 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:27.332 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:27.332 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:10:27.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 -- 10.20.193.4:0/4026289965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcb40b5770 msgr2=0x7fdcb40d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcb40b5770 0x7fdcb40d5c20 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd40023d0 tx=0x7fdcd4031040 comp rx=0 tx=0).stop 2026-02-24T09:10:27.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 -- 10.20.193.4:0/4026289965 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdce0110040 msgr2=0x7fdce011e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:27.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdce0110040 0x7fdce011e440 secure :-1 s=READY pgs=519 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcc800d950 tx=0x7fdcc800de20 comp rx=0 tx=0).stop 2026-02-24T09:10:27.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 -- 10.20.193.4:0/4026289965 shutdown_connections 2026-02-24T09:10:27.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcb40b5770 0x7fdcb40d5c20 unknown :-1 s=CLOSED pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdce0115840 0x7fdce0123810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdce0110040 0x7fdce011e440 unknown :-1 s=CLOSED pgs=519 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 --2- 10.20.193.4:0/4026289965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce010f650 0x7fdce011df00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:27.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 -- 10.20.193.4:0/4026289965 >> 10.20.193.4:0/4026289965 conn(0x7fdce00ecf20 msgr2=0x7fdce010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:27.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 -- 10.20.193.4:0/4026289965 shutdown_connections 2026-02-24T09:10:27.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:27.314+0000 7fdce5022640 1 -- 10.20.193.4:0/4026289965 wait complete. 2026-02-24T09:10:27.352 INFO:tasks.cephfs.filesystem:scrub status for tag:2f927036-df4b-4f13-8dfb-f86e239bd88a - {'path': '/', 'tag': '2f927036-df4b-4f13-8dfb-f86e239bd88a', 'options': 'recursive,force'} 2026-02-24T09:10:27.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:27 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:10:27.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:27 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:10:27.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:27 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:10:27.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:27 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:10:28.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:27 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:10:28.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:27 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:10:28.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:27 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:10:28.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:27 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:10:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:27 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:10:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:27 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:10:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:27 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:10:28.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:27 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:10:28.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:28 trial004 ceph-mon[41596]: pgmap v170: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2026-02-24T09:10:29.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:28 trial090 ceph-mon[47278]: pgmap v170: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2026-02-24T09:10:29.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:28 trial014 ceph-mon[46941]: pgmap v170: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2026-02-24T09:10:31.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:30 trial090 ceph-mon[47278]: pgmap v171: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:10:31.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:30 trial014 ceph-mon[46941]: pgmap v171: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:10:31.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:30 trial004 ceph-mon[41596]: pgmap v171: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:10:31.289 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:10:31.406 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:31.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 -- 10.20.193.4:0/1850661921 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0d94115470 msgr2=0x7f0d94175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 --2- 10.20.193.4:0/1850661921 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0d94115470 0x7f0d94175e40 secure :-1 s=READY pgs=524 gs=1 cs=0 l=1 c_cookie=9092794729955053187 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d9000aa30 tx=0x7f0d90030280 comp rx=0 tx=0).stop 2026-02-24T09:10:31.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 -- 10.20.193.4:0/1850661921 shutdown_connections 2026-02-24T09:10:31.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 --2- 10.20.193.4:0/1850661921 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0d94115470 0x7f0d94175e40 unknown :-1 s=CLOSED pgs=524 gs=1 cs=0 l=1 c_cookie=9092794729955053187 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 --2- 10.20.193.4:0/1850661921 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d9410fc70 0x7f0d94114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 --2- 10.20.193.4:0/1850661921 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0d9410f280 0x7f0d9410f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 -- 10.20.193.4:0/1850661921 >> 10.20.193.4:0/1850661921 conn(0x7f0d9405f830 msgr2=0x7f0d9410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 -- 10.20.193.4:0/1850661921 shutdown_connections 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 -- 10.20.193.4:0/1850661921 wait complete. 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 Processor -- start 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 -- start start 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d9410f280 0x7f0d9411dbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0d9410fc70 0x7f0d9411e130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0d94115470 0x7f0d941234b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94123ad0 con 0x7f0d9410fc70 2026-02-24T09:10:31.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94123c40 con 0x7f0d94115470 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d9ae50640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94123e00 con 0x7f0d9410f280 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d8bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0d9410fc70 0x7f0d9411e130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d8bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0d9410fc70 0x7f0d9411e130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58194/0 (socket says 10.20.193.4:58194) 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.507+0000 7f0d8bfff640 1 -- 10.20.193.4:0/3393181983 learned_addr learned my addr 10.20.193.4:0/3393181983 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d98bc5640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d9410f280 0x7f0d9411dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d993c6640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0d94115470 0x7f0d941234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d8bfff640 1 -- 10.20.193.4:0/3393181983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d9410f280 msgr2=0x7f0d9411dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d8bfff640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d9410f280 0x7f0d9411dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d8bfff640 1 -- 10.20.193.4:0/3393181983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0d94115470 msgr2=0x7f0d941234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d8bfff640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0d94115470 0x7f0d941234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d8bfff640 1 -- 10.20.193.4:0/3393181983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9000a650 con 0x7f0d9410fc70 2026-02-24T09:10:31.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d98bc5640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d9410f280 0x7f0d9411dbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:10:31.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d8bfff640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0d9410fc70 0x7f0d9411e130 secure :-1 s=READY pgs=525 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d7c005db0 tx=0x7f0d7c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:31.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d89ffb640 1 -- 10.20.193.4:0/3393181983 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d7c004500 con 0x7f0d9410fc70 2026-02-24T09:10:31.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d89ffb640 1 -- 10.20.193.4:0/3393181983 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0d7c004d30 con 0x7f0d9410fc70 2026-02-24T09:10:31.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d9ae50640 1 -- 10.20.193.4:0/3393181983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d941240e0 con 0x7f0d9410fc70 2026-02-24T09:10:31.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d89ffb640 1 -- 10.20.193.4:0/3393181983 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d7c005310 con 0x7f0d9410fc70 2026-02-24T09:10:31.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d9ae50640 1 -- 10.20.193.4:0/3393181983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d941647e0 con 0x7f0d9410fc70 2026-02-24T09:10:31.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.508+0000 7f0d9ae50640 1 -- 10.20.193.4:0/3393181983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d94124300 con 0x7f0d9410fc70 2026-02-24T09:10:31.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.510+0000 7f0d89ffb640 1 -- 10.20.193.4:0/3393181983 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f0d7c0054a0 con 0x7f0d9410fc70 2026-02-24T09:10:31.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.510+0000 7f0d89ffb640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0d700b5770 0x7f0d700d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.510+0000 7f0d89ffb640 1 -- 10.20.193.4:0/3393181983 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f0d7c0e7210 con 0x7f0d9410fc70 2026-02-24T09:10:31.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.510+0000 7f0d98bc5640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0d700b5770 0x7f0d700d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.511+0000 7f0d98bc5640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0d700b5770 0x7f0d700d5c20 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d84005970 tx=0x7f0d84005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:31.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.511+0000 7f0d89ffb640 1 -- 10.20.193.4:0/3393181983 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f0d7c0a9a80 con 0x7f0d9410fc70 2026-02-24T09:10:31.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.642+0000 7f0d9ae50640 1 -- 10.20.193.4:0/3393181983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d9411ed00 con 0x7f0d9410fc70 2026-02-24T09:10:31.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.642+0000 7f0d89ffb640 1 -- 10.20.193.4:0/3393181983 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f0d7c0acc30 con 0x7f0d9410fc70 2026-02-24T09:10:31.647 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:10:31.647 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:10:31.648 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:10:31.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 -- 10.20.193.4:0/3393181983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0d700b5770 msgr2=0x7f0d700d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0d700b5770 0x7f0d700d5c20 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d84005970 tx=0x7f0d84005900 comp rx=0 tx=0).stop 2026-02-24T09:10:31.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 -- 10.20.193.4:0/3393181983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0d9410fc70 msgr2=0x7f0d9411e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0d9410fc70 0x7f0d9411e130 secure :-1 s=READY pgs=525 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d7c005db0 tx=0x7f0d7c00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 -- 10.20.193.4:0/3393181983 shutdown_connections 2026-02-24T09:10:31.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0d700b5770 0x7f0d700d5c20 unknown :-1 s=CLOSED pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0d94115470 0x7f0d941234b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0d9410fc70 0x7f0d9411e130 unknown :-1 s=CLOSED pgs=525 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 --2- 10.20.193.4:0/3393181983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d9410f280 0x7f0d9411dbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 -- 10.20.193.4:0/3393181983 >> 10.20.193.4:0/3393181983 conn(0x7f0d9405f830 msgr2=0x7f0d9410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:31.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 -- 10.20.193.4:0/3393181983 shutdown_connections 2026-02-24T09:10:31.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.643+0000 7f0d9ae50640 1 -- 10.20.193.4:0/3393181983 wait complete. 2026-02-24T09:10:31.684 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id 1fa71175 --release --await' 2026-02-24T09:10:31.684 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id 1fa71175 --release --await 2026-02-24T09:10:31.800 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:31.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.902+0000 7fb871f5d640 1 -- 10.20.193.4:0/3931010618 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86c115470 msgr2=0x7fb86c175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.902+0000 7fb871f5d640 1 --2- 10.20.193.4:0/3931010618 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86c115470 0x7fb86c175e40 secure :-1 s=READY pgs=526 gs=1 cs=0 l=1 c_cookie=6241676538102247007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb86000aa30 tx=0x7fb860030280 comp rx=0 tx=0).stop 2026-02-24T09:10:31.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.902+0000 7fb871f5d640 1 -- 10.20.193.4:0/3931010618 shutdown_connections 2026-02-24T09:10:31.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.902+0000 7fb871f5d640 1 --2- 10.20.193.4:0/3931010618 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86c115470 0x7fb86c175e40 unknown :-1 s=CLOSED pgs=526 gs=1 cs=0 l=1 c_cookie=6241676538102247007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.902+0000 7fb871f5d640 1 --2- 10.20.193.4:0/3931010618 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb86c10fc70 0x7fb86c114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.902+0000 7fb871f5d640 1 --2- 10.20.193.4:0/3931010618 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb86c10f280 0x7fb86c10f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.902+0000 7fb871f5d640 1 -- 10.20.193.4:0/3931010618 >> 10.20.193.4:0/3931010618 conn(0x7fb86c05f830 msgr2=0x7fb86c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:31.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.902+0000 7fb871f5d640 1 -- 10.20.193.4:0/3931010618 shutdown_connections 2026-02-24T09:10:31.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.902+0000 7fb871f5d640 1 -- 10.20.193.4:0/3931010618 wait complete. 2026-02-24T09:10:31.908 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:31 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3393181983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:31.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb871f5d640 1 Processor -- start 2026-02-24T09:10:31.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb871f5d640 1 -- start start 2026-02-24T09:10:31.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb871f5d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb86c10f280 0x7fb86c11db90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb871f5d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb86c10fc70 0x7fb86c11e0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb871f5d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86c115470 0x7fb86c1234a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb871f5d640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c123ac0 con 0x7fb86c115470 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb871f5d640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c123c30 con 0x7fb86c10f280 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb871f5d640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb86c123df0 con 0x7fb86c10fc70 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86c115470 0x7fb86c1234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86c115470 0x7fb86c1234a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58218/0 (socket says 10.20.193.4:58218) 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86bfff640 1 -- 10.20.193.4:0/2693649169 learned_addr learned my addr 10.20.193.4:0/2693649169 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86affd640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb86c10fc70 0x7fb86c11e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb86c10f280 0x7fb86c11db90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86bfff640 1 -- 10.20.193.4:0/2693649169 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb86c10fc70 msgr2=0x7fb86c11e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86bfff640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb86c10fc70 0x7fb86c11e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86bfff640 1 -- 10.20.193.4:0/2693649169 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb86c10f280 msgr2=0x7fb86c11db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86bfff640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb86c10f280 0x7fb86c11db90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86bfff640 1 -- 10.20.193.4:0/2693649169 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86000a650 con 0x7fb86c115470 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb86bfff640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86c115470 0x7fb86c1234a0 secure :-1 s=READY pgs=527 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb860039820 tx=0x7fb8600039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb868ff9640 1 -- 10.20.193.4:0/2693649169 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb86003e070 con 0x7fb86c115470 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb868ff9640 1 -- 10.20.193.4:0/2693649169 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8600055a0 con 0x7fb86c115470 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb871f5d640 1 -- 10.20.193.4:0/2693649169 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86c124070 con 0x7fb86c115470 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.903+0000 7fb868ff9640 1 -- 10.20.193.4:0/2693649169 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb860042a00 con 0x7fb86c115470 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.904+0000 7fb871f5d640 1 -- 10.20.193.4:0/2693649169 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86c164630 con 0x7fb86c115470 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.905+0000 7fb868ff9640 1 -- 10.20.193.4:0/2693649169 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fb86004c440 con 0x7fb86c115470 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.906+0000 7fb868ff9640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8400b5770 0x7fb8400d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.906+0000 7fb868ff9640 1 -- 10.20.193.4:0/2693649169 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fb86010c860 con 0x7fb86c115470 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.906+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8400b5770 0x7fb8400d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.906+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8400b5770 0x7fb8400d5c20 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb858005970 tx=0x7fb858005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb873f57e00 1 Processor -- start 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb873f57e00 1 -- start start 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73af4fb0 0x557f73af5380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b3a020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73b3a560 0x557f73b5a940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb873f57e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557f73a06050 con 0x557f73b3a560 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb873f57e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557f73a01d80 con 0x557f73af58c0 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb873f57e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557f739fbee0 con 0x557f73af4fb0 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb86bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73b3a560 0x557f73b5a940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb86bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73b3a560 0x557f73b5a940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58222/0 (socket says 10.20.193.4:58222) 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb86bfff640 1 -- 10.20.193.4:0/4225825415 learned_addr learned my addr 10.20.193.4:0/4225825415 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:31.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.907+0000 7fb86affd640 1 --2- 10.20.193.4:0/4225825415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b3a020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/4225825415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73af4fb0 0x557f73af5380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb86bfff640 1 -- 10.20.193.4:0/4225825415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73af4fb0 msgr2=0x557f73af5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb86bfff640 1 --2- 10.20.193.4:0/4225825415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73af4fb0 0x557f73af5380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb86bfff640 1 -- 10.20.193.4:0/4225825415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 msgr2=0x557f73b3a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb86bfff640 1 --2- 10.20.193.4:0/4225825415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b3a020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb86bfff640 1 -- 10.20.193.4:0/4225825415 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f739a7540 con 0x557f73b3a560 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb86bfff640 1 --2- 10.20.193.4:0/4225825415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73b3a560 0x557f73b5a940 secure :-1 s=READY pgs=528 gs=2 cs=0 l=1 c_cookie=4127927020289777369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb86010a2e0 tx=0x7fb860042410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394957c1171bded9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb82ffff640 1 -- 10.20.193.4:0/4225825415 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb86010a0c0 con 0x557f73b3a560 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb82ffff640 1 -- 10.20.193.4:0/4225825415 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8600daf70 con 0x557f73b3a560 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb82ffff640 1 -- 10.20.193.4:0/4225825415 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb860099010 con 0x557f73b3a560 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb873f57e00 1 -- 10.20.193.4:0/4225825415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73b3a560 msgr2=0x557f73b5a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb873f57e00 1 --2- 10.20.193.4:0/4225825415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73b3a560 0x557f73b5a940 secure :-1 s=READY pgs=528 gs=2 cs=0 l=1 c_cookie=4127927020289777369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb86010a2e0 tx=0x7fb860042410 comp rx=0 tx=0).stop 2026-02-24T09:10:31.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb873f57e00 1 -- 10.20.193.4:0/4225825415 shutdown_connections 2026-02-24T09:10:31.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb873f57e00 1 --2- 10.20.193.4:0/4225825415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73b3a560 0x557f73b5a940 unknown :-1 s=CLOSED pgs=528 gs=2 cs=0 l=1 c_cookie=4127927020289777369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb873f57e00 1 --2- 10.20.193.4:0/4225825415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b3a020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb873f57e00 1 --2- 10.20.193.4:0/4225825415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73af4fb0 0x557f73af5380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb873f57e00 1 -- 10.20.193.4:0/4225825415 >> 10.20.193.4:0/4225825415 conn(0x557f73ad34b0 msgr2=0x557f73af3890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:31.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb873f57e00 1 -- 10.20.193.4:0/4225825415 shutdown_connections 2026-02-24T09:10:31.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.908+0000 7fb873f57e00 1 -- 10.20.193.4:0/4225825415 wait complete. 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.909+0000 7fb873f57e00 1 -- start start 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.909+0000 7fb873f57e00 1 Processor -- start 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.909+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b51e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.909+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b52370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.909+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73b3a560 0x557f73b57360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.909+0000 7fb873f57e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557f73b578a0 con 0x557f73af4fb0 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.909+0000 7fb873f57e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557f73b57a10 con 0x557f73af58c0 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.909+0000 7fb873f57e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557f73b57bd0 con 0x557f73b3a560 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.909+0000 7fb86b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b51e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b51e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58236/0 (socket says 10.20.193.4:58236) 2026-02-24T09:10:31.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86b7fe640 1 -- 10.20.193.4:0/2092119445 learned_addr learned my addr 10.20.193.4:0/2092119445 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86affd640 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b52370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86bfff640 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73b3a560 0x557f73b57360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86b7fe640 1 -- 10.20.193.4:0/2092119445 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73b3a560 msgr2=0x557f73b57360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73b3a560 0x557f73b57360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86b7fe640 1 -- 10.20.193.4:0/2092119445 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 msgr2=0x557f73b52370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b52370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86b7fe640 1 -- 10.20.193.4:0/2092119445 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f7397fbd0 con 0x557f73af4fb0 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b51e30 secure :-1 s=READY pgs=529 gs=1 cs=0 l=1 c_cookie=8426637422198085593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb858005d70 tx=0x7fb858004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f16e16d92157d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb82d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2092119445 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb85801f870 con 0x557f73af4fb0 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2092119445 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb85801e3d0 con 0x557f73af4fb0 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 1 -- 10.20.193.4:0/2092119445 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86c164630 con 0x557f73af4fb0 2026-02-24T09:10:31.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2092119445 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb858010650 con 0x557f73af4fb0 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 10 client.15798 _ll_register_callbacks cb 0x557f739ea290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 1 -- 10.20.193.4:0/2092119445 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f7374b700 con 0x557f73af4fb0 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2092119445 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fb8580107e0 con 0x557f73af4fb0 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2092119445 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb8580109a0 con 0x557f73af4fb0 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 10 client.15798 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 1 -- 10.20.193.4:0/2092119445 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557f73991910 con 0x557f73af4fb0 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2092119445 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb858010b80 con 0x557f73af4fb0 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 10 client.15798 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 10 client.15798 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 20 client.15798 populate_metadata read hostname 'trial004' 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557f73b378e0 0x557f73b37d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 4 client.15798 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb873f57e00 1 -- 10.20.193.4:0/2092119445 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f739f1920 con 0x557f73b378e0 2026-02-24T09:10:31.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.910+0000 7fb86affd640 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557f73b378e0 0x557f73b37d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb86affd640 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557f73b378e0 0x557f73b37d80 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=6093662390818136460 s_cookie=14530234102867411909 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=549109a8a9df618c server_cookie=c9a5c2ee9cadc3c5 in_seq=0 out_seq=0 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb82d7fa640 10 client.15798 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2092119445 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557f739f1920 con 0x557f73b378e0 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb82d7fa640 10 client.15798 handle_command_reply: tid=0 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 client.15798 shutdown 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 -- 10.20.193.4:0/2092119445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 msgr2=0x557f73b51e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b51e30 secure :-1 s=READY pgs=529 gs=1 cs=0 l=1 c_cookie=8426637422198085593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb858005d70 tx=0x7fb858004770 comp rx=0 tx=0).stop 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 -- 10.20.193.4:0/2092119445 shutdown_connections 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557f73b378e0 0x557f73b37d80 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=6093662390818136460 s_cookie=14530234102867411909 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73b3a560 0x557f73b57360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b52370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2092119445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b51e30 unknown :-1 s=CLOSED pgs=529 gs=1 cs=0 l=1 c_cookie=8426637422198085593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb82d7fa640 0 client.15798 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 -- 10.20.193.4:0/2092119445 >> 10.20.193.4:0/2092119445 conn(0x557f73ad34b0 msgr2=0x557f73af3890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:31.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 -- 10.20.193.4:0/2092119445 shutdown_connections 2026-02-24T09:10:31.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.911+0000 7fb873f57e00 1 -- 10.20.193.4:0/2092119445 wait complete. 2026-02-24T09:10:31.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.912+0000 7fb873f57e00 20 client.15798 trim_cache size 0 max 16384 2026-02-24T09:10:31.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb873f57e00 1 Processor -- start 2026-02-24T09:10:31.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb873f57e00 1 -- start start 2026-02-24T09:10:31.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b351a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b356e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73b3a560 0x557f73b39670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb873f57e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557f739f9b10 con 0x557f73af4fb0 2026-02-24T09:10:31.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb873f57e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557f736c51b0 con 0x557f73af58c0 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb873f57e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557f73a01d80 con 0x557f73b3a560 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb86b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb86b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58250/0 (socket says 10.20.193.4:58250) 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb86b7fe640 1 -- 10.20.193.4:0/1666634508 learned_addr learned my addr 10.20.193.4:0/1666634508 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb86bfff640 1 --2- 10.20.193.4:0/1666634508 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73b3a560 0x557f73b39670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb86affd640 1 --2- 10.20.193.4:0/1666634508 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b356e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb86b7fe640 1 -- 10.20.193.4:0/1666634508 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73b3a560 msgr2=0x557f73b39670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/1666634508 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73b3a560 0x557f73b39670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb86b7fe640 1 -- 10.20.193.4:0/1666634508 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 msgr2=0x557f73b356e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.920+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/1666634508 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b356e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb86b7fe640 1 -- 10.20.193.4:0/1666634508 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f7398c390 con 0x557f73af4fb0 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb86affd640 1 --2- 10.20.193.4:0/1666634508 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b356e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/1666634508 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b351a0 secure :-1 s=READY pgs=530 gs=1 cs=0 l=1 c_cookie=11645492599499939334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb858029d40 tx=0x7fb85802b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19d19d19ba25e06 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb82f7fe640 1 -- 10.20.193.4:0/1666634508 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb858029ad0 con 0x557f73af4fb0 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb82f7fe640 1 -- 10.20.193.4:0/1666634508 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x557f7374b700 con 0x557f73af4fb0 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb82f7fe640 1 -- 10.20.193.4:0/1666634508 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb858029720 con 0x557f73af4fb0 2026-02-24T09:10:31.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb873f57e00 1 -- 10.20.193.4:0/1666634508 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 msgr2=0x557f73b351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb873f57e00 1 --2- 10.20.193.4:0/1666634508 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b351a0 secure :-1 s=READY pgs=530 gs=1 cs=0 l=1 c_cookie=11645492599499939334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb858029d40 tx=0x7fb85802b000 comp rx=0 tx=0).stop 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb873f57e00 1 -- 10.20.193.4:0/1666634508 shutdown_connections 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb873f57e00 1 --2- 10.20.193.4:0/1666634508 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73b3a560 0x557f73b39670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb873f57e00 1 --2- 10.20.193.4:0/1666634508 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73af58c0 0x557f73b356e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb873f57e00 1 --2- 10.20.193.4:0/1666634508 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af4fb0 0x557f73b351a0 unknown :-1 s=CLOSED pgs=530 gs=1 cs=0 l=1 c_cookie=11645492599499939334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb873f57e00 1 -- 10.20.193.4:0/1666634508 >> 10.20.193.4:0/1666634508 conn(0x557f73ad34b0 msgr2=0x557f73b569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb873f57e00 1 -- 10.20.193.4:0/1666634508 shutdown_connections 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.921+0000 7fb873f57e00 1 -- 10.20.193.4:0/1666634508 wait complete. 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 1 -- start start 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 1 Processor -- start 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73af4fb0 0x557f73ad3880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af58c0 0x557f73ad3dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73b3a560 0x557f73ad4300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557f73b35c50 con 0x557f73af58c0 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557f73b35dc0 con 0x557f73b3a560 2026-02-24T09:10:31.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557f73ad88d0 con 0x557f73af4fb0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af58c0 0x557f73ad3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af58c0 0x557f73ad3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:58266/0 (socket says 10.20.193.4:58266) 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86affd640 1 -- 10.20.193.4:0/2286255871 learned_addr learned my addr 10.20.193.4:0/2286255871 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86bfff640 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73b3a560 0x557f73ad4300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73af4fb0 0x557f73ad3880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86affd640 1 -- 10.20.193.4:0/2286255871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73af4fb0 msgr2=0x557f73ad3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86affd640 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73af4fb0 0x557f73ad3880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86affd640 1 -- 10.20.193.4:0/2286255871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73b3a560 msgr2=0x557f73ad4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86affd640 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73b3a560 0x557f73ad4300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86affd640 1 -- 10.20.193.4:0/2286255871 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f7397ff00 con 0x557f73af58c0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86bfff640 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73b3a560 0x557f73ad4300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb86affd640 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af58c0 0x557f73ad3dc0 secure :-1 s=READY pgs=531 gs=1 cs=0 l=1 c_cookie=14271343867233003550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85c004510 tx=0x7fb85c002dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60dffa269df681e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb82d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2286255871 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb85c018070 con 0x557f73af58c0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 1 -- 10.20.193.4:0/2286255871 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f73991910 con 0x557f73af58c0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2286255871 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb85c019040 con 0x557f73af58c0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2286255871 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb85c00f770 con 0x557f73af58c0 2026-02-24T09:10:31.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 10 client.15804 _ll_register_callbacks cb 0x557f739ea290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.922+0000 7fb873f57e00 1 -- 10.20.193.4:0/2286255871 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8600daf70 con 0x557f73af58c0 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2286255871 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fb85c00f900 con 0x557f73af58c0 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2286255871 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb85c00fae0 con 0x557f73af58c0 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb873f57e00 10 client.15804 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb873f57e00 1 -- 10.20.193.4:0/2286255871 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557f73991b70 con 0x557f73af58c0 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2286255871 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb85c00fc80 con 0x557f73af58c0 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb873f57e00 10 client.15804 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb873f57e00 10 client.15804 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb873f57e00 20 client.15804 populate_metadata read hostname 'trial004' 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557f73be8600 0x557f73c08a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb873f57e00 4 client.15804 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1fa71175", "release": true, "await": true}] 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb873f57e00 1 -- 10.20.193.4:0/2286255871 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1fa71175", "release": true, "await": true}) -- 0x557f737303c0 con 0x557f73be8600 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557f73be8600 0x557f73c08a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb86b7fe640 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557f73be8600 0x557f73c08a80 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=955489013007170485 s_cookie=15054416322379535390 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d429431e714bbb5 server_cookie=d0ec07e22c46541e in_seq=0 out_seq=0 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.923+0000 7fb82d7fa640 10 client.15804 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb82d7fa640 1 -- 10.20.193.4:0/2286255871 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557f737303c0 con 0x557f73be8600 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb82d7fa640 10 client.15804 handle_command_reply: tid=0 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 client.15804 shutdown 2026-02-24T09:10:31.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 -- 10.20.193.4:0/2286255871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af58c0 msgr2=0x557f73ad3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af58c0 0x557f73ad3dc0 secure :-1 s=READY pgs=531 gs=1 cs=0 l=1 c_cookie=14271343867233003550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85c004510 tx=0x7fb85c002dd0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 -- 10.20.193.4:0/2286255871 shutdown_connections 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557f73be8600 0x557f73c08a80 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=955489013007170485 s_cookie=15054416322379535390 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557f73b3a560 0x557f73ad4300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557f73af58c0 0x557f73ad3dc0 unknown :-1 s=CLOSED pgs=531 gs=1 cs=0 l=1 c_cookie=14271343867233003550 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 --2- 10.20.193.4:0/2286255871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557f73af4fb0 0x557f73ad3880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb82d7fa640 0 client.15804 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 -- 10.20.193.4:0/2286255871 >> 10.20.193.4:0/2286255871 conn(0x557f73ad34b0 msgr2=0x557f73b55090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 -- 10.20.193.4:0/2286255871 shutdown_connections 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 1 -- 10.20.193.4:0/2286255871 wait complete. 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.925+0000 7fb873f57e00 20 client.15804 trim_cache size 0 max 16384 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:10:31.934 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 4, 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "1fa71175": { 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "version": 4, 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 138.5, 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:31.935 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:31.936 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:31.936 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:10:31.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 -- 10.20.193.4:0/2693649169 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8400b5770 msgr2=0x7fb8400d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8400b5770 0x7fb8400d5c20 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb858005970 tx=0x7fb858005900 comp rx=0 tx=0).stop 2026-02-24T09:10:31.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 -- 10.20.193.4:0/2693649169 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86c115470 msgr2=0x7fb86c1234a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:31.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86c115470 0x7fb86c1234a0 secure :-1 s=READY pgs=527 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb860039820 tx=0x7fb8600039b0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 -- 10.20.193.4:0/2693649169 shutdown_connections 2026-02-24T09:10:31.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb8400b5770 0x7fb8400d5c20 unknown :-1 s=CLOSED pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb86c115470 0x7fb86c1234a0 unknown :-1 s=CLOSED pgs=527 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb86c10fc70 0x7fb86c11e0d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 --2- 10.20.193.4:0/2693649169 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb86c10f280 0x7fb86c11db90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:31.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 -- 10.20.193.4:0/2693649169 >> 10.20.193.4:0/2693649169 conn(0x7fb86c05f830 msgr2=0x7fb86c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:31.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 -- 10.20.193.4:0/2693649169 shutdown_connections 2026-02-24T09:10:31.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:31.926+0000 7fb871f5d640 1 -- 10.20.193.4:0/2693649169 wait complete. 2026-02-24T09:10:31.937 INFO:tasks.workunit.client.0.trial004.stdout:getting iogen 2026-02-24T09:10:31.937 INFO:tasks.workunit.client.0.trial004.stderr:+ echo 'getting iogen' 2026-02-24T09:10:31.937 INFO:tasks.workunit.client.0.trial004.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2026-02-24T09:10:31.938 INFO:tasks.workunit.client.0.trial004.stderr:--2026-02-24 09:10:31-- http://download.ceph.com/qa/iogen_3.1p0.tar 2026-02-24T09:10:31.946 INFO:tasks.workunit.client.0.trial004.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2026-02-24T09:10:31.958 INFO:tasks.workunit.client.0.trial004.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2026-02-24T09:10:31.965 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1fa71175', total seconds elapsed: 19.2 2026-02-24T09:10:31.972 INFO:tasks.workunit.client.0.trial004.stderr:HTTP request sent, awaiting response... 200 OK 2026-02-24T09:10:31.973 INFO:tasks.workunit.client.0.trial004.stderr:Length: 8071 (7.9K) [application/octet-stream] 2026-02-24T09:10:31.973 INFO:tasks.workunit.client.0.trial004.stderr:Saving to: ‘iogen_3.1p0.tar’ 2026-02-24T09:10:31.975 INFO:tasks.workunit.client.0.trial004.stderr: 2026-02-24T09:10:31.975 INFO:tasks.workunit.client.0.trial004.stderr: 0K ....... 100% 5.54M=0.001s 2026-02-24T09:10:31.975 INFO:tasks.workunit.client.0.trial004.stderr: 2026-02-24T09:10:31.975 INFO:tasks.workunit.client.0.trial004.stderr:2026-02-24 09:10:31 (5.54 MB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2026-02-24T09:10:31.975 INFO:tasks.workunit.client.0.trial004.stderr: 2026-02-24T09:10:31.975 INFO:tasks.workunit.client.0.trial004.stderr:+ tar -xvzf iogen_3.1p0.tar 2026-02-24T09:10:31.978 INFO:tasks.workunit.client.0.trial004.stdout:iogen_3.1p0 2026-02-24T09:10:31.978 INFO:tasks.workunit.client.0.trial004.stdout:iogen_3.1p0/src 2026-02-24T09:10:31.979 INFO:tasks.workunit.client.0.trial004.stdout:iogen_3.1p0/src/iogen.8 2026-02-24T09:10:31.979 INFO:tasks.workunit.client.0.trial004.stdout:iogen_3.1p0/src/iogen.c 2026-02-24T09:10:31.980 INFO:tasks.workunit.client.0.trial004.stdout:iogen_3.1p0/README 2026-02-24T09:10:31.980 INFO:tasks.workunit.client.0.trial004.stdout:iogen_3.1p0/Makefile.bsd 2026-02-24T09:10:31.980 INFO:tasks.workunit.client.0.trial004.stdout:iogen_3.1p0/Makefile 2026-02-24T09:10:31.981 INFO:tasks.workunit.client.0.trial004.stderr:+ cd iogen_3.1p0 2026-02-24T09:10:31.981 INFO:tasks.workunit.client.0.trial004.stdout:making iogen 2026-02-24T09:10:31.981 INFO:tasks.workunit.client.0.trial004.stderr:+ echo 'making iogen' 2026-02-24T09:10:31.982 INFO:tasks.workunit.client.0.trial004.stderr:+ make 2026-02-24T09:10:31.986 INFO:tasks.workunit.client.0.trial004.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2026-02-24T09:10:32.080 INFO:tasks.workunit.client.0.trial004.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2026-02-24T09:10:32.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:31 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3393181983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:32.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:31 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3393181983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:32.099 INFO:tasks.workunit.client.0.trial004.stdout:running iogen 2026-02-24T09:10:32.100 INFO:tasks.workunit.client.0.trial004.stderr:+ echo 'running iogen' 2026-02-24T09:10:32.100 INFO:tasks.workunit.client.0.trial004.stderr:+ ./iogen -n 5 -s 2g 2026-02-24T09:10:32.101 INFO:tasks.workunit.client.0.trial004.stderr:child spawned 124724 2026-02-24T09:10:32.101 INFO:tasks.workunit.client.0.trial004.stderr:child spawned 124725 2026-02-24T09:10:32.101 INFO:tasks.workunit.client.0.trial004.stderr:child spawned 124726 2026-02-24T09:10:32.101 INFO:tasks.workunit.client.0.trial004.stderr:child spawned 124727 2026-02-24T09:10:32.101 INFO:tasks.workunit.client.0.trial004.stderr:child spawned 124728 2026-02-24T09:10:32.101 INFO:tasks.workunit.client.0.trial004.stderr:+ echo 'sleep for 10 min' 2026-02-24T09:10:32.102 INFO:tasks.workunit.client.0.trial004.stdout:sleep for 10 min 2026-02-24T09:10:32.102 INFO:tasks.workunit.client.0.trial004.stderr:+ sleep 600 2026-02-24T09:10:33.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:32 trial090 ceph-mon[47278]: pgmap v172: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:10:33.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:32 trial014 ceph-mon[46941]: pgmap v172: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:10:33.138 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:32 trial004 ceph-mon[41596]: pgmap v172: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:10:34.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:33 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:10:34.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:33 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:10:34.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:33 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:10:35.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:34 trial090 ceph-mon[47278]: pgmap v173: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2026-02-24T09:10:35.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:34 trial014 ceph-mon[46941]: pgmap v173: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2026-02-24T09:10:35.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:34 trial004 ceph-mon[41596]: pgmap v173: 97 pgs: 97 active+clean; 666 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2026-02-24T09:10:37.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:36 trial090 ceph-mon[47278]: pgmap v174: 97 pgs: 97 active+clean; 666 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2026-02-24T09:10:37.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:36 trial014 ceph-mon[46941]: pgmap v174: 97 pgs: 97 active+clean; 666 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2026-02-24T09:10:37.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:36 trial004 ceph-mon[41596]: pgmap v174: 97 pgs: 97 active+clean; 666 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2026-02-24T09:10:39.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:38 trial090 ceph-mon[47278]: pgmap v175: 97 pgs: 97 active+clean; 13 MiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2026-02-24T09:10:39.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:38 trial014 ceph-mon[46941]: pgmap v175: 97 pgs: 97 active+clean; 13 MiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2026-02-24T09:10:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:38 trial004 ceph-mon[41596]: pgmap v175: 97 pgs: 97 active+clean; 13 MiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 1.0 MiB/s wr, 14 op/s 2026-02-24T09:10:41.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:40 trial090 ceph-mon[47278]: pgmap v176: 97 pgs: 97 active+clean; 29 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 2.4 MiB/s wr, 14 op/s 2026-02-24T09:10:41.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:40 trial014 ceph-mon[46941]: pgmap v176: 97 pgs: 97 active+clean; 29 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 2.4 MiB/s wr, 14 op/s 2026-02-24T09:10:41.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:40 trial004 ceph-mon[41596]: pgmap v176: 97 pgs: 97 active+clean; 29 MiB data, 336 MiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 2.4 MiB/s wr, 14 op/s 2026-02-24T09:10:43.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:42 trial090 ceph-mon[47278]: pgmap v177: 97 pgs: 97 active+clean; 141 MiB data, 352 MiB used, 8.2 TiB / 8.2 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 18 op/s 2026-02-24T09:10:43.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:42 trial014 ceph-mon[46941]: pgmap v177: 97 pgs: 97 active+clean; 141 MiB data, 352 MiB used, 8.2 TiB / 8.2 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 18 op/s 2026-02-24T09:10:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:42 trial004 ceph-mon[41596]: pgmap v177: 97 pgs: 97 active+clean; 141 MiB data, 352 MiB used, 8.2 TiB / 8.2 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 18 op/s 2026-02-24T09:10:45.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:44 trial090 ceph-mon[47278]: pgmap v178: 97 pgs: 97 active+clean; 393 MiB data, 362 MiB used, 8.2 TiB / 8.2 TiB avail; 26 KiB/s rd, 33 MiB/s wr, 24 op/s 2026-02-24T09:10:45.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:44 trial014 ceph-mon[46941]: pgmap v178: 97 pgs: 97 active+clean; 393 MiB data, 362 MiB used, 8.2 TiB / 8.2 TiB avail; 26 KiB/s rd, 33 MiB/s wr, 24 op/s 2026-02-24T09:10:45.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:44 trial004 ceph-mon[41596]: pgmap v178: 97 pgs: 97 active+clean; 393 MiB data, 362 MiB used, 8.2 TiB / 8.2 TiB avail; 26 KiB/s rd, 33 MiB/s wr, 24 op/s 2026-02-24T09:10:47.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:46 trial090 ceph-mon[47278]: pgmap v179: 97 pgs: 97 active+clean; 1.4 GiB data, 525 MiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 118 MiB/s wr, 44 op/s 2026-02-24T09:10:47.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:46 trial014 ceph-mon[46941]: pgmap v179: 97 pgs: 97 active+clean; 1.4 GiB data, 525 MiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 118 MiB/s wr, 44 op/s 2026-02-24T09:10:47.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:46 trial004 ceph-mon[41596]: pgmap v179: 97 pgs: 97 active+clean; 1.4 GiB data, 525 MiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 118 MiB/s wr, 44 op/s 2026-02-24T09:10:49.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:48 trial090 ceph-mon[47278]: pgmap v180: 97 pgs: 97 active+clean; 4.5 GiB data, 1024 MiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 380 MiB/s wr, 110 op/s 2026-02-24T09:10:49.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:48 trial014 ceph-mon[46941]: pgmap v180: 97 pgs: 97 active+clean; 4.5 GiB data, 1024 MiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 380 MiB/s wr, 110 op/s 2026-02-24T09:10:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:48 trial004 ceph-mon[41596]: pgmap v180: 97 pgs: 97 active+clean; 4.5 GiB data, 1024 MiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 380 MiB/s wr, 110 op/s 2026-02-24T09:10:51.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:50 trial090 ceph-mon[47278]: pgmap v181: 97 pgs: 97 active+clean; 6.1 GiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 522 MiB/s wr, 137 op/s 2026-02-24T09:10:51.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:50 trial014 ceph-mon[46941]: pgmap v181: 97 pgs: 97 active+clean; 6.1 GiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 522 MiB/s wr, 137 op/s 2026-02-24T09:10:51.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:50 trial004 ceph-mon[41596]: pgmap v181: 97 pgs: 97 active+clean; 6.1 GiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 522 MiB/s wr, 137 op/s 2026-02-24T09:10:53.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:52 trial090 ceph-mon[47278]: pgmap v182: 97 pgs: 97 active+clean; 8.9 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 805 MiB/s wr, 226 op/s 2026-02-24T09:10:53.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:52 trial014 ceph-mon[46941]: pgmap v182: 97 pgs: 97 active+clean; 8.9 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 805 MiB/s wr, 226 op/s 2026-02-24T09:10:53.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:52 trial004 ceph-mon[41596]: pgmap v182: 97 pgs: 97 active+clean; 8.9 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 805 MiB/s wr, 226 op/s 2026-02-24T09:10:55.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:54 trial090 ceph-mon[47278]: pgmap v183: 97 pgs: 97 active+clean; 9.9 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 42 KiB/s rd, 913 MiB/s wr, 261 op/s 2026-02-24T09:10:55.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:54 trial014 ceph-mon[46941]: pgmap v183: 97 pgs: 97 active+clean; 9.9 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 42 KiB/s rd, 913 MiB/s wr, 261 op/s 2026-02-24T09:10:55.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:54 trial004 ceph-mon[41596]: pgmap v183: 97 pgs: 97 active+clean; 9.9 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 42 KiB/s rd, 913 MiB/s wr, 261 op/s 2026-02-24T09:10:57.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:56 trial090 ceph-mon[47278]: pgmap v184: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 42 KiB/s rd, 907 MiB/s wr, 264 op/s 2026-02-24T09:10:57.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:56 trial014 ceph-mon[46941]: pgmap v184: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 42 KiB/s rd, 907 MiB/s wr, 264 op/s 2026-02-24T09:10:57.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:56 trial004 ceph-mon[41596]: pgmap v184: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 42 KiB/s rd, 907 MiB/s wr, 264 op/s 2026-02-24T09:10:57.353 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:10:57.557 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:57.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.704+0000 7f9ab742b640 1 -- 10.20.193.4:0/3284971891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ab010f740 msgr2=0x7f9ab010fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:57.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.704+0000 7f9ab742b640 1 --2- 10.20.193.4:0/3284971891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ab010f740 0x7f9ab010fb10 secure :-1 s=READY pgs=532 gs=3 cs=0 l=1 c_cookie=7691568343182949964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa0009950 tx=0x7f9aa002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.704+0000 7f9ab742b640 1 -- 10.20.193.4:0/3284971891 shutdown_connections 2026-02-24T09:10:57.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.704+0000 7f9ab742b640 1 --2- 10.20.193.4:0/3284971891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ab0115930 0x7f9ab0176300 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.704+0000 7f9ab742b640 1 --2- 10.20.193.4:0/3284971891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ab0110130 0x7f9ab0115180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.704+0000 7f9ab742b640 1 --2- 10.20.193.4:0/3284971891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ab010f740 0x7f9ab010fb10 unknown :-1 s=CLOSED pgs=532 gs=3 cs=0 l=1 c_cookie=7691568343182949964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.704+0000 7f9ab742b640 1 -- 10.20.193.4:0/3284971891 >> 10.20.193.4:0/3284971891 conn(0x7f9ab00ed050 msgr2=0x7f9ab010d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:57.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.704+0000 7f9ab742b640 1 -- 10.20.193.4:0/3284971891 shutdown_connections 2026-02-24T09:10:57.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.704+0000 7f9ab742b640 1 -- 10.20.193.4:0/3284971891 wait complete. 2026-02-24T09:10:57.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab742b640 1 Processor -- start 2026-02-24T09:10:57.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab742b640 1 -- start start 2026-02-24T09:10:57.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab742b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ab010f740 0x7f9ab011e090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab742b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ab0110130 0x7f9ab011e5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab742b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ab0115930 0x7f9ab01239a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab742b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab0123fc0 con 0x7f9ab010f740 2026-02-24T09:10:57.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab742b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab0124130 con 0x7f9ab0115930 2026-02-24T09:10:57.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab742b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab01242f0 con 0x7f9ab0110130 2026-02-24T09:10:57.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab51a0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ab010f740 0x7f9ab011e090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab51a0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ab010f740 0x7f9ab011e090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46368/0 (socket says 10.20.193.4:46368) 2026-02-24T09:10:57.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab51a0640 1 -- 10.20.193.4:0/2171100424 learned_addr learned my addr 10.20.193.4:0/2171100424 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:57.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.705+0000 7f9ab499f640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ab0110130 0x7f9ab011e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9ab59a1640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ab0115930 0x7f9ab01239a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9ab51a0640 1 -- 10.20.193.4:0/2171100424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ab0110130 msgr2=0x7f9ab011e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:57.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9ab51a0640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ab0110130 0x7f9ab011e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9ab51a0640 1 -- 10.20.193.4:0/2171100424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ab0115930 msgr2=0x7f9ab01239a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:57.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9ab51a0640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ab0115930 0x7f9ab01239a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9ab51a0640 1 -- 10.20.193.4:0/2171100424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa0009570 con 0x7f9ab010f740 2026-02-24T09:10:57.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9ab51a0640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ab010f740 0x7f9ab011e090 secure :-1 s=READY pgs=533 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa00023d0 tx=0x7f9aa0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:57.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9a9e7fc640 1 -- 10.20.193.4:0/2171100424 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa003d070 con 0x7f9ab010f740 2026-02-24T09:10:57.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9ab742b640 1 -- 10.20.193.4:0/2171100424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab0124570 con 0x7f9ab010f740 2026-02-24T09:10:57.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9a9e7fc640 1 -- 10.20.193.4:0/2171100424 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9aa0002ad0 con 0x7f9ab010f740 2026-02-24T09:10:57.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9a9e7fc640 1 -- 10.20.193.4:0/2171100424 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa00418a0 con 0x7f9ab010f740 2026-02-24T09:10:57.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.706+0000 7f9ab742b640 1 -- 10.20.193.4:0/2171100424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab0164cd0 con 0x7f9ab010f740 2026-02-24T09:10:57.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.712+0000 7f9a9e7fc640 1 -- 10.20.193.4:0/2171100424 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f9aa002f9f0 con 0x7f9ab010f740 2026-02-24T09:10:57.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.713+0000 7f9a9e7fc640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a8c0b5770 0x7f9a8c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.713+0000 7f9ab499f640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a8c0b5770 0x7f9a8c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.714+0000 7f9a9e7fc640 1 -- 10.20.193.4:0/2171100424 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f9aa010b1b0 con 0x7f9ab010f740 2026-02-24T09:10:57.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.714+0000 7f9ab499f640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a8c0b5770 0x7f9a8c0d5c20 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab0124a30 tx=0x7f9aa4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:57.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.716+0000 7f9ab9425e00 1 Processor -- start 2026-02-24T09:10:57.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.716+0000 7f9ab9425e00 1 -- start start 2026-02-24T09:10:57.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.716+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db007820 0x55d1db007bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.716+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db008130 0x55d1db04c890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.716+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 0x55d1db06d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.716+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d1daf17de0 con 0x55d1db007820 2026-02-24T09:10:57.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.716+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d1daf13b10 con 0x55d1db04cdd0 2026-02-24T09:10:57.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.716+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d1daf0dab0 con 0x55d1db008130 2026-02-24T09:10:57.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.716+0000 7f9ab499f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db008130 0x55d1db04c890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.716+0000 7f9ab51a0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db007820 0x55d1db007bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.717+0000 7f9ab59a1640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 0x55d1db06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.717+0000 7f9ab51a0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db007820 0x55d1db007bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46372/0 (socket says 10.20.193.4:46372) 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.717+0000 7f9ab499f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db008130 0x55d1db04c890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:56514/0 (socket says 10.20.193.4:56514) 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.717+0000 7f9ab51a0640 1 -- 10.20.193.4:0/167286760 learned_addr learned my addr 10.20.193.4:0/167286760 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.717+0000 7f9ab59a1640 1 -- 10.20.193.4:0/167286760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db008130 msgr2=0x55d1db04c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.717+0000 7f9ab59a1640 1 --2- 10.20.193.4:0/167286760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db008130 0x55d1db04c890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.717+0000 7f9ab59a1640 1 -- 10.20.193.4:0/167286760 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db007820 msgr2=0x55d1db007bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.717+0000 7f9ab59a1640 1 --2- 10.20.193.4:0/167286760 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db007820 0x55d1db007bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.717+0000 7f9ab59a1640 1 -- 10.20.193.4:0/167286760 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1daeb9310 con 0x55d1db04cdd0 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.717+0000 7f9ab59a1640 1 --2- 10.20.193.4:0/167286760 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 0x55d1db06d1b0 secure :-1 s=READY pgs=73 gs=2 cs=0 l=1 c_cookie=1958862546585648636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aac0055c0 tx=0x7f9aac003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b2f471b8d0dfdfc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.718+0000 7f9a7dce5640 1 -- 10.20.193.4:0/167286760 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aac00ac10 con 0x55d1db04cdd0 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.718+0000 7f9a7dce5640 1 -- 10.20.193.4:0/167286760 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9aac00ad70 con 0x55d1db04cdd0 2026-02-24T09:10:57.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.718+0000 7f9a7dce5640 1 -- 10.20.193.4:0/167286760 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aac012970 con 0x55d1db04cdd0 2026-02-24T09:10:57.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.719+0000 7f9ab9425e00 1 -- 10.20.193.4:0/167286760 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 msgr2=0x55d1db06d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:57.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.719+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/167286760 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 0x55d1db06d1b0 secure :-1 s=READY pgs=73 gs=2 cs=0 l=1 c_cookie=1958862546585648636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aac0055c0 tx=0x7f9aac003c30 comp rx=0 tx=0).stop 2026-02-24T09:10:57.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.719+0000 7f9ab9425e00 1 -- 10.20.193.4:0/167286760 shutdown_connections 2026-02-24T09:10:57.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.719+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/167286760 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 0x55d1db06d1b0 unknown :-1 s=CLOSED pgs=73 gs=2 cs=0 l=1 c_cookie=1958862546585648636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.719+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/167286760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db008130 0x55d1db04c890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.719+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/167286760 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db007820 0x55d1db007bf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.719+0000 7f9ab9425e00 1 -- 10.20.193.4:0/167286760 >> 10.20.193.4:0/167286760 conn(0x55d1daf266b0 msgr2=0x55d1db006100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:57.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.719+0000 7f9ab9425e00 1 -- 10.20.193.4:0/167286760 shutdown_connections 2026-02-24T09:10:57.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.719+0000 7f9ab9425e00 1 -- 10.20.193.4:0/167286760 wait complete. 2026-02-24T09:10:57.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.720+0000 7f9ab9425e00 1 -- start start 2026-02-24T09:10:57.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.720+0000 7f9ab9425e00 1 Processor -- start 2026-02-24T09:10:57.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 0x55d1db01fe30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db020370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 0x55d1db025360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d1db0258a0 con 0x55d1db008130 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d1db025a10 con 0x55d1db007820 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d1db025bd0 con 0x55d1db04cdd0 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab499f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db020370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab499f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db020370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46374/0 (socket says 10.20.193.4:46374) 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab499f640 1 -- 10.20.193.4:0/3602516681 learned_addr learned my addr 10.20.193.4:0/3602516681 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab51a0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 0x55d1db01fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab59a1640 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 0x55d1db025360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab499f640 1 -- 10.20.193.4:0/3602516681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 msgr2=0x55d1db025360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab499f640 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 0x55d1db025360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab499f640 1 -- 10.20.193.4:0/3602516681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 msgr2=0x55d1db01fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab499f640 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 0x55d1db01fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab499f640 1 -- 10.20.193.4:0/3602516681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1dae918c0 con 0x55d1db008130 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab499f640 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db020370 secure :-1 s=READY pgs=534 gs=1 cs=0 l=1 c_cookie=9276450136947119640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa40098d0 tx=0x7f9aa40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bc9240355b5618 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9a6affd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9a6affd640 1 -- 10.20.193.4:0/3602516681 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa4022070 con 0x55d1db008130 2026-02-24T09:10:57.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab9425e00 1 -- 10.20.193.4:0/3602516681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac005260 con 0x55d1db008130 2026-02-24T09:10:57.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab9425e00 10 client.15816 _ll_register_callbacks cb 0x55d1daea9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:57.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9a6affd640 1 -- 10.20.193.4:0/3602516681 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9aa401bd70 con 0x55d1db008130 2026-02-24T09:10:57.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9ab9425e00 1 -- 10.20.193.4:0/3602516681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d1dac5d4a0 con 0x55d1db008130 2026-02-24T09:10:57.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9a6affd640 1 -- 10.20.193.4:0/3602516681 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa401d460 con 0x55d1db008130 2026-02-24T09:10:57.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.721+0000 7f9a6affd640 1 -- 10.20.193.4:0/3602516681 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f9aa401d5f0 con 0x55d1db008130 2026-02-24T09:10:57.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.722+0000 7f9a6affd640 1 -- 10.20.193.4:0/3602516681 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9aa401d7e0 con 0x55d1db008130 2026-02-24T09:10:57.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.722+0000 7f9ab9425e00 10 client.15816 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:57.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.722+0000 7f9ab9425e00 1 -- 10.20.193.4:0/3602516681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d1daea36e0 con 0x55d1db008130 2026-02-24T09:10:57.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.723+0000 7f9a6affd640 1 -- 10.20.193.4:0/3602516681 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9aa401d980 con 0x55d1db008130 2026-02-24T09:10:57.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.723+0000 7f9ab9425e00 10 client.15816 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:57.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.723+0000 7f9ab9425e00 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:57.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.723+0000 7f9ab9425e00 20 client.15816 populate_metadata read hostname 'trial004' 2026-02-24T09:10:57.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.723+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d1db04a780 0x55d1db04ac20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.723+0000 7f9ab9425e00 4 client.15816 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:57.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.723+0000 7f9ab9425e00 1 -- 10.20.193.4:0/3602516681 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1daf034f0 con 0x55d1db04a780 2026-02-24T09:10:57.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.724+0000 7f9ab51a0640 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d1db04a780 0x55d1db04ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.725+0000 7f9ab51a0640 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d1db04a780 0x55d1db04ac20 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=13006511174225519100 s_cookie=5863607882875685112 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b480690062dc61fc server_cookie=515fb84d80fc48f8 in_seq=0 out_seq=0 2026-02-24T09:10:57.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.725+0000 7f9a6affd640 10 client.15816 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:57.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.725+0000 7f9a6affd640 1 -- 10.20.193.4:0/3602516681 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d1daf034f0 con 0x55d1db04a780 2026-02-24T09:10:57.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.725+0000 7f9a6affd640 10 client.15816 handle_command_reply: tid=0 2026-02-24T09:10:57.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.725+0000 7f9ab9425e00 1 client.15816 shutdown 2026-02-24T09:10:57.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 1 -- 10.20.193.4:0/3602516681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 msgr2=0x55d1db020370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:57.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db020370 secure :-1 s=READY pgs=534 gs=1 cs=0 l=1 c_cookie=9276450136947119640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa40098d0 tx=0x7f9aa40047e0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 1 -- 10.20.193.4:0/3602516681 shutdown_connections 2026-02-24T09:10:57.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d1db04a780 0x55d1db04ac20 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=13006511174225519100 s_cookie=5863607882875685112 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 0x55d1db025360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db020370 unknown :-1 s=CLOSED pgs=534 gs=1 cs=0 l=1 c_cookie=9276450136947119640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/3602516681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 0x55d1db01fe30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 1 -- 10.20.193.4:0/3602516681 >> 10.20.193.4:0/3602516681 conn(0x55d1daf266b0 msgr2=0x55d1db006810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:57.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9a6affd640 0 client.15816 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:57.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 1 -- 10.20.193.4:0/3602516681 shutdown_connections 2026-02-24T09:10:57.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 1 -- 10.20.193.4:0/3602516681 wait complete. 2026-02-24T09:10:57.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.726+0000 7f9ab9425e00 20 client.15816 trim_cache size 0 max 16384 2026-02-24T09:10:57.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab9425e00 1 Processor -- start 2026-02-24T09:10:57.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab9425e00 1 -- start start 2026-02-24T09:10:57.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 0x55d1db011b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db045590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 0x55d1db045ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d1daf0b6e0 con 0x55d1db008130 2026-02-24T09:10:57.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d1dabd6f50 con 0x55d1db007820 2026-02-24T09:10:57.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d1daf7b410 con 0x55d1db04cdd0 2026-02-24T09:10:57.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab51a0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 0x55d1db011b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab499f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db045590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab59a1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 0x55d1db045ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab51a0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 0x55d1db011b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:38590/0 (socket says 10.20.193.4:38590) 2026-02-24T09:10:57.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab499f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db045590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46382/0 (socket says 10.20.193.4:46382) 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab59a1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 0x55d1db045ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:56530/0 (socket says 10.20.193.4:56530) 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.742+0000 7f9ab51a0640 1 -- 10.20.193.4:0/891515305 learned_addr learned my addr 10.20.193.4:0/891515305 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.743+0000 7f9ab499f640 1 -- 10.20.193.4:0/891515305 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 msgr2=0x55d1db045ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.743+0000 7f9ab499f640 1 --2- 10.20.193.4:0/891515305 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 0x55d1db045ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.743+0000 7f9ab499f640 1 -- 10.20.193.4:0/891515305 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 msgr2=0x55d1db011b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.743+0000 7f9ab499f640 1 --2- 10.20.193.4:0/891515305 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 0x55d1db011b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.743+0000 7f9ab499f640 1 -- 10.20.193.4:0/891515305 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1db012330 con 0x55d1db008130 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.743+0000 7f9ab499f640 1 --2- 10.20.193.4:0/891515305 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db045590 secure :-1 s=READY pgs=535 gs=3 cs=0 l=1 c_cookie=17799364967332624215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa401aaa0 tx=0x7f9aa4034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7040c21f964b757 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.743+0000 7f9a7d4e4640 1 -- 10.20.193.4:0/891515305 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa4022070 con 0x55d1db008130 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.743+0000 7f9a7d4e4640 1 -- 10.20.193.4:0/891515305 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9aa4036060 con 0x55d1db008130 2026-02-24T09:10:57.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.743+0000 7f9a7d4e4640 1 -- 10.20.193.4:0/891515305 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa401d900 con 0x55d1db008130 2026-02-24T09:10:57.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.744+0000 7f9ab9425e00 1 -- 10.20.193.4:0/891515305 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 msgr2=0x55d1db045590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:57.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.744+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/891515305 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db045590 secure :-1 s=READY pgs=535 gs=3 cs=0 l=1 c_cookie=17799364967332624215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa401aaa0 tx=0x7f9aa4034000 comp rx=0 tx=0).stop 2026-02-24T09:10:57.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.744+0000 7f9ab9425e00 1 -- 10.20.193.4:0/891515305 shutdown_connections 2026-02-24T09:10:57.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.744+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/891515305 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db04cdd0 0x55d1db045ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.744+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/891515305 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db045590 unknown :-1 s=CLOSED pgs=535 gs=3 cs=0 l=1 c_cookie=17799364967332624215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.744+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/891515305 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db007820 0x55d1db011b60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.744+0000 7f9ab9425e00 1 -- 10.20.193.4:0/891515305 >> 10.20.193.4:0/891515305 conn(0x55d1daf266b0 msgr2=0x55d1db005a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:57.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.744+0000 7f9ab9425e00 1 -- 10.20.193.4:0/891515305 shutdown_connections 2026-02-24T09:10:57.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.744+0000 7f9ab9425e00 1 -- 10.20.193.4:0/891515305 wait complete. 2026-02-24T09:10:57.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab9425e00 1 -- start start 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab9425e00 1 Processor -- start 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db007820 0x55d1db027e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db028370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab9425e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 0x55d1db0922e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d1daf7a150 con 0x55d1db008130 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d1db092820 con 0x55d1db04cdd0 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab9425e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d1db0929e0 con 0x55d1db007820 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab499f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db028370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab51a0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db007820 0x55d1db027e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab499f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db028370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46392/0 (socket says 10.20.193.4:46392) 2026-02-24T09:10:57.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab499f640 1 -- 10.20.193.4:0/492940636 learned_addr learned my addr 10.20.193.4:0/492940636 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:57.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab59a1640 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 0x55d1db0922e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab499f640 1 -- 10.20.193.4:0/492940636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db007820 msgr2=0x55d1db027e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:57.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab499f640 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db007820 0x55d1db027e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab499f640 1 -- 10.20.193.4:0/492940636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 msgr2=0x55d1db0922e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:57.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab499f640 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 0x55d1db0922e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab499f640 1 -- 10.20.193.4:0/492940636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1dae9e160 con 0x55d1db008130 2026-02-24T09:10:57.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab499f640 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db028370 secure :-1 s=READY pgs=536 gs=2 cs=0 l=1 c_cookie=693872909950074847 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa4009230 tx=0x7f9aa401d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a121bc3cd73fdf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:57.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9a6affd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:57.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9a6affd640 1 -- 10.20.193.4:0/492940636 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa4022040 con 0x55d1db008130 2026-02-24T09:10:57.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab9425e00 1 -- 10.20.193.4:0/492940636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1daea36e0 con 0x55d1db008130 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9a6affd640 1 -- 10.20.193.4:0/492940636 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d1dac5d4a0 con 0x55d1db008130 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9a6affd640 1 -- 10.20.193.4:0/492940636 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa4010db0 con 0x55d1db008130 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.745+0000 7f9ab9425e00 10 client.15822 _ll_register_callbacks cb 0x55d1daea9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9ab9425e00 1 -- 10.20.193.4:0/492940636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d1dab98f40 con 0x55d1db008130 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9a6affd640 1 -- 10.20.193.4:0/492940636 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f9aa401b670 con 0x55d1db008130 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9a6affd640 1 -- 10.20.193.4:0/492940636 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9aa401b830 con 0x55d1db008130 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9ab9425e00 10 client.15822 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9ab9425e00 1 -- 10.20.193.4:0/492940636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d1dae91bf0 con 0x55d1db008130 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9a6affd640 1 -- 10.20.193.4:0/492940636 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9aa401ba10 con 0x55d1db008130 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9ab9425e00 10 client.15822 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:57.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9ab9425e00 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9ab9425e00 20 client.15822 populate_metadata read hostname 'trial004' 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d1db0fa900 0x55d1db11ad80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9ab9425e00 4 client.15822 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9ab9425e00 1 -- 10.20.193.4:0/492940636 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f9aac00ad70 con 0x55d1db0fa900 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.746+0000 7f9ab51a0640 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d1db0fa900 0x55d1db11ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab51a0640 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d1db0fa900 0x55d1db11ad80 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=4451250404249867908 s_cookie=10973500251689258471 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dc604a8afa09684 server_cookie=9849b456bc990de7 in_seq=0 out_seq=0 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9a6affd640 10 client.15822 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9a6affd640 1 -- 10.20.193.4:0/492940636 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x7f9aac00ad70 con 0x55d1db0fa900 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9a6affd640 10 client.15822 handle_command_reply: tid=0 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 client.15822 shutdown 2026-02-24T09:10:57.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 -- 10.20.193.4:0/492940636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 msgr2=0x55d1db028370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db028370 secure :-1 s=READY pgs=536 gs=2 cs=0 l=1 c_cookie=693872909950074847 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa4009230 tx=0x7f9aa401d460 comp rx=0 tx=0).stop 2026-02-24T09:10:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 -- 10.20.193.4:0/492940636 shutdown_connections 2026-02-24T09:10:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d1db0fa900 0x55d1db11ad80 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=4451250404249867908 s_cookie=10973500251689258471 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d1db04cdd0 0x55d1db0922e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d1db008130 0x55d1db028370 unknown :-1 s=CLOSED pgs=536 gs=2 cs=0 l=1 c_cookie=693872909950074847 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9a6affd640 0 client.15822 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 --2- 10.20.193.4:0/492940636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d1db007820 0x55d1db027e30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 -- 10.20.193.4:0/492940636 >> 10.20.193.4:0/492940636 conn(0x55d1daf266b0 msgr2=0x55d1db0061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 -- 10.20.193.4:0/492940636 shutdown_connections 2026-02-24T09:10:57.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 1 -- 10.20.193.4:0/492940636 wait complete. 2026-02-24T09:10:57.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.747+0000 7f9ab9425e00 20 client.15822 trim_cache size 0 max 16384 2026-02-24T09:10:57.761 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:10:57.761 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:10:57.761 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:10:57.761 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:10:57.762 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:10:57.762 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:10:57.762 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:10:57.762 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:10:57.762 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:10:57.762 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:10:57.762 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:10:57.762 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:10:57.762 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:10:57.762 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:10:57.763 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:10:57.763 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:10:57.763 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:10:57.763 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:10:57.763 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:10:57.763 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:57.763 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:10:57.763 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:10:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 -- 10.20.193.4:0/2171100424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a8c0b5770 msgr2=0x7f9a8c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a8c0b5770 0x7f9a8c0d5c20 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab0124a30 tx=0x7f9aa4005f90 comp rx=0 tx=0).stop 2026-02-24T09:10:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 -- 10.20.193.4:0/2171100424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ab010f740 msgr2=0x7f9ab011e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:57.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ab010f740 0x7f9ab011e090 secure :-1 s=READY pgs=533 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa00023d0 tx=0x7f9aa0004290 comp rx=0 tx=0).stop 2026-02-24T09:10:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 -- 10.20.193.4:0/2171100424 shutdown_connections 2026-02-24T09:10:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a8c0b5770 0x7f9a8c0d5c20 unknown :-1 s=CLOSED pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9ab0115930 0x7f9ab01239a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ab0110130 0x7f9ab011e5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 --2- 10.20.193.4:0/2171100424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9ab010f740 0x7f9ab011e090 unknown :-1 s=CLOSED pgs=533 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 -- 10.20.193.4:0/2171100424 >> 10.20.193.4:0/2171100424 conn(0x7f9ab00ed050 msgr2=0x7f9ab010d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 -- 10.20.193.4:0/2171100424 shutdown_connections 2026-02-24T09:10:57.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:57.748+0000 7f9ab742b640 1 -- 10.20.193.4:0/2171100424 wait complete. 2026-02-24T09:10:57.863 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:10:57.863 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:10:58.057 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:58.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.226+0000 7fdf25447640 1 -- 10.20.193.4:0/4106082038 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf20155830 msgr2=0x7fdf20175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.226+0000 7fdf25447640 1 --2- 10.20.193.4:0/4106082038 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf20155830 0x7fdf20175c10 secure :-1 s=READY pgs=537 gs=1 cs=0 l=1 c_cookie=10271980051823071450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf1000aa30 tx=0x7fdf10030280 comp rx=0 tx=0).stop 2026-02-24T09:10:58.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.226+0000 7fdf25447640 1 -- 10.20.193.4:0/4106082038 shutdown_connections 2026-02-24T09:10:58.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.226+0000 7fdf25447640 1 --2- 10.20.193.4:0/4106082038 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf20155830 0x7fdf20175c10 unknown :-1 s=CLOSED pgs=537 gs=1 cs=0 l=1 c_cookie=10271980051823071450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.226+0000 7fdf25447640 1 --2- 10.20.193.4:0/4106082038 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf2010c410 0x7fdf201552f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.226+0000 7fdf25447640 1 --2- 10.20.193.4:0/4106082038 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf2010bb00 0x7fdf2010bed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.226+0000 7fdf25447640 1 -- 10.20.193.4:0/4106082038 >> 10.20.193.4:0/4106082038 conn(0x7fdf200e97e0 msgr2=0x7fdf20109bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.226+0000 7fdf25447640 1 -- 10.20.193.4:0/4106082038 shutdown_connections 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.226+0000 7fdf25447640 1 -- 10.20.193.4:0/4106082038 wait complete. 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf25447640 1 Processor -- start 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf25447640 1 -- start start 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf25447640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf2010bb00 0x7fdf20160eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf25447640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf2010c410 0x7fdf201613f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf25447640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf20155830 0x7fdf201667c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf25447640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20166d50 con 0x7fdf2010c410 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf25447640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20166ec0 con 0x7fdf20155830 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf25447640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20167080 con 0x7fdf2010bb00 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf1e7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf2010c410 0x7fdf201613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf1e7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf2010c410 0x7fdf201613f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46414/0 (socket says 10.20.193.4:46414) 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf1e7fc640 1 -- 10.20.193.4:0/461633404 learned_addr learned my addr 10.20.193.4:0/461633404 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf1effd640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf2010bb00 0x7fdf20160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf1e7fc640 1 -- 10.20.193.4:0/461633404 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf2010bb00 msgr2=0x7fdf20160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf1e7fc640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf2010bb00 0x7fdf20160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf1e7fc640 1 -- 10.20.193.4:0/461633404 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf20155830 msgr2=0x7fdf201667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf1e7fc640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf20155830 0x7fdf201667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.227+0000 7fdf1e7fc640 1 -- 10.20.193.4:0/461633404 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1000a650 con 0x7fdf2010c410 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.228+0000 7fdf1e7fc640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf2010c410 0x7fdf201613f0 secure :-1 s=READY pgs=538 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf0800c9b0 tx=0x7fdf0800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:58.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.228+0000 7fdefffff640 1 -- 10.20.193.4:0/461633404 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf080044a0 con 0x7fdf2010c410 2026-02-24T09:10:58.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.228+0000 7fdefffff640 1 -- 10.20.193.4:0/461633404 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdf08007da0 con 0x7fdf2010c410 2026-02-24T09:10:58.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.228+0000 7fdf25447640 1 -- 10.20.193.4:0/461633404 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf20167360 con 0x7fdf2010c410 2026-02-24T09:10:58.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.228+0000 7fdefffff640 1 -- 10.20.193.4:0/461633404 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf0800f6d0 con 0x7fdf2010c410 2026-02-24T09:10:58.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.228+0000 7fdf25447640 1 -- 10.20.193.4:0/461633404 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf20152460 con 0x7fdf2010c410 2026-02-24T09:10:58.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.229+0000 7fdf25447640 1 -- 10.20.193.4:0/461633404 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2005fbb0 con 0x7fdf2010c410 2026-02-24T09:10:58.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.230+0000 7fdefffff640 1 -- 10.20.193.4:0/461633404 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fdf08002880 con 0x7fdf2010c410 2026-02-24T09:10:58.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.231+0000 7fdefffff640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdef40b57f0 0x7fdef40d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.231+0000 7fdefffff640 1 -- 10.20.193.4:0/461633404 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fdf080e7090 con 0x7fdf2010c410 2026-02-24T09:10:58.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.231+0000 7fdf1effd640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdef40b57f0 0x7fdef40d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.231+0000 7fdf1effd640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdef40b57f0 0x7fdef40d5ca0 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf14004740 tx=0x7fdf14004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:58.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.234+0000 7fdefffff640 1 -- 10.20.193.4:0/461633404 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fdf080a98c0 con 0x7fdf2010c410 2026-02-24T09:10:58.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.395+0000 7fdf25447640 1 -- 10.20.193.4:0/461633404 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf2010bed0 con 0x7fdf2010c410 2026-02-24T09:10:58.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.397+0000 7fdefffff640 1 -- 10.20.193.4:0/461633404 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fdf080aca70 con 0x7fdf2010c410 2026-02-24T09:10:58.401 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:10:58.401 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:10:58.401 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 -- 10.20.193.4:0/461633404 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdef40b57f0 msgr2=0x7fdef40d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdef40b57f0 0x7fdef40d5ca0 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf14004740 tx=0x7fdf14004420 comp rx=0 tx=0).stop 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 -- 10.20.193.4:0/461633404 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf2010c410 msgr2=0x7fdf201613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf2010c410 0x7fdf201613f0 secure :-1 s=READY pgs=538 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf0800c9b0 tx=0x7fdf0800ce80 comp rx=0 tx=0).stop 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 -- 10.20.193.4:0/461633404 shutdown_connections 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdef40b57f0 0x7fdef40d5ca0 unknown :-1 s=CLOSED pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdf20155830 0x7fdf201667c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdf2010c410 0x7fdf201613f0 unknown :-1 s=CLOSED pgs=538 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 --2- 10.20.193.4:0/461633404 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf2010bb00 0x7fdf20160eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 -- 10.20.193.4:0/461633404 >> 10.20.193.4:0/461633404 conn(0x7fdf200e97e0 msgr2=0x7fdf20109bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 -- 10.20.193.4:0/461633404 shutdown_connections 2026-02-24T09:10:58.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.403+0000 7fdf25447640 1 -- 10.20.193.4:0/461633404 wait complete. 2026-02-24T09:10:58.514 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:10:58.725 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:58.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.917+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2194923433 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe3f4115840 msgr2=0x7fe3f4176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.917+0000 7fe3fbafe640 1 --2- 10.20.193.4:0/2194923433 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe3f4115840 0x7fe3f4176210 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=5039764002041205900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3f000a970 tx=0x7fe3f00301b0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.917+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2194923433 shutdown_connections 2026-02-24T09:10:58.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.917+0000 7fe3fbafe640 1 --2- 10.20.193.4:0/2194923433 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe3f4115840 0x7fe3f4176210 unknown :-1 s=CLOSED pgs=74 gs=2 cs=0 l=1 c_cookie=5039764002041205900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.917+0000 7fe3fbafe640 1 --2- 10.20.193.4:0/2194923433 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3f4110040 0x7fe3f4115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.917+0000 7fe3fbafe640 1 --2- 10.20.193.4:0/2194923433 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe3f410f650 0x7fe3f410fa20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.917+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2194923433 >> 10.20.193.4:0/2194923433 conn(0x7fe3f40ecf20 msgr2=0x7fe3f410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:58.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.917+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2194923433 shutdown_connections 2026-02-24T09:10:58.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.917+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2194923433 wait complete. 2026-02-24T09:10:58.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3fbafe640 1 Processor -- start 2026-02-24T09:10:58.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3fbafe640 1 -- start start 2026-02-24T09:10:58.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3fbafe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe3f410f650 0x7fe3f411df80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3fbafe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe3f4110040 0x7fe3f411e4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3fbafe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3f4115840 0x7fe3f4123890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3fbafe640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f4123eb0 con 0x7fe3f4110040 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3fbafe640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f4124020 con 0x7fe3f410f650 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3fbafe640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41241e0 con 0x7fe3f4115840 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3fa074640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3f4115840 0x7fe3f4123890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3f9072640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe3f4110040 0x7fe3f411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3f9873640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe3f410f650 0x7fe3f411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3f9072640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe3f4110040 0x7fe3f411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46432/0 (socket says 10.20.193.4:46432) 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3fa074640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3f4115840 0x7fe3f4123890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:56568/0 (socket says 10.20.193.4:56568) 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3f9072640 1 -- 10.20.193.4:0/2639987989 learned_addr learned my addr 10.20.193.4:0/2639987989 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3f9072640 1 -- 10.20.193.4:0/2639987989 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3f4115840 msgr2=0x7fe3f4123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3f9072640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3f4115840 0x7fe3f4123890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3f9072640 1 -- 10.20.193.4:0/2639987989 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe3f410f650 msgr2=0x7fe3f411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3f9072640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe3f410f650 0x7fe3f411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3f9072640 1 -- 10.20.193.4:0/2639987989 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f000a590 con 0x7fe3f4110040 2026-02-24T09:10:58.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.918+0000 7fe3f9873640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe3f410f650 0x7fe3f411df80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:10:58.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.919+0000 7fe3f9072640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe3f4110040 0x7fe3f411e4c0 secure :-1 s=READY pgs=539 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e8009480 tx=0x7fe3e800ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:58.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.919+0000 7fe3e2ffd640 1 -- 10.20.193.4:0/2639987989 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e800cce0 con 0x7fe3f4110040 2026-02-24T09:10:58.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.919+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2639987989 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f41244c0 con 0x7fe3f4110040 2026-02-24T09:10:58.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.919+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2639987989 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f4164bc0 con 0x7fe3f4110040 2026-02-24T09:10:58.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.919+0000 7fe3e2ffd640 1 -- 10.20.193.4:0/2639987989 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3e800ce40 con 0x7fe3f4110040 2026-02-24T09:10:58.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.919+0000 7fe3e2ffd640 1 -- 10.20.193.4:0/2639987989 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e8010950 con 0x7fe3f4110040 2026-02-24T09:10:58.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.923+0000 7fe3e2ffd640 1 -- 10.20.193.4:0/2639987989 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fe3e801f060 con 0x7fe3f4110040 2026-02-24T09:10:58.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.924+0000 7fe3e2ffd640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3d00b57f0 0x7fe3d00d5ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.924+0000 7fe3e2ffd640 1 -- 10.20.193.4:0/2639987989 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fe3e8014070 con 0x7fe3f4110040 2026-02-24T09:10:58.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.925+0000 7fe3f9873640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3d00b57f0 0x7fe3d00d5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.925+0000 7fe3f9873640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3d00b57f0 0x7fe3d00d5ca0 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e4005b30 tx=0x7fe3e4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:58.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.926+0000 7fe3fdaf8e00 1 Processor -- start 2026-02-24T09:10:58.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.926+0000 7fe3fdaf8e00 1 -- start start 2026-02-24T09:10:58.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 0x5601a76ca320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 0x5601a770efc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a770f500 0x5601a772f8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5601a75daee0 con 0x5601a770f500 2026-02-24T09:10:58.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5601a75d6c10 con 0x5601a76c9f50 2026-02-24T09:10:58.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5601a75d0d70 con 0x5601a76ca860 2026-02-24T09:10:58.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3fa074640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a770f500 0x5601a772f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3f9072640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 0x5601a770efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3fa074640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a770f500 0x5601a772f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46444/0 (socket says 10.20.193.4:46444) 2026-02-24T09:10:58.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3fa074640 1 -- 10.20.193.4:0/860381887 learned_addr learned my addr 10.20.193.4:0/860381887 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3f9072640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 0x5601a770efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:56578/0 (socket says 10.20.193.4:56578) 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3f9873640 1 --2- 10.20.193.4:0/860381887 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 0x5601a76ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3f9072640 1 -- 10.20.193.4:0/860381887 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 msgr2=0x5601a76ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3f9072640 1 --2- 10.20.193.4:0/860381887 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 0x5601a76ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3f9072640 1 -- 10.20.193.4:0/860381887 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a770f500 msgr2=0x5601a772f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3f9072640 1 --2- 10.20.193.4:0/860381887 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a770f500 0x5601a772f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3f9072640 1 -- 10.20.193.4:0/860381887 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a757c340 con 0x5601a76ca860 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3fa074640 1 --2- 10.20.193.4:0/860381887 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a770f500 0x5601a772f8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3f9873640 1 --2- 10.20.193.4:0/860381887 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 0x5601a76ca320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3f9072640 1 --2- 10.20.193.4:0/860381887 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 0x5601a770efc0 secure :-1 s=READY pgs=91 gs=3 cs=0 l=1 c_cookie=17530389768920242614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e80095d0 tx=0x7fe3e80ac950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f348749d66a219b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.927+0000 7fe3c24e6640 1 -- 10.20.193.4:0/860381887 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e80b51a0 con 0x5601a76ca860 2026-02-24T09:10:58.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.928+0000 7fe3c24e6640 1 -- 10.20.193.4:0/860381887 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3e80b7fe0 con 0x5601a76ca860 2026-02-24T09:10:58.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.928+0000 7fe3c24e6640 1 -- 10.20.193.4:0/860381887 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e80accc0 con 0x5601a76ca860 2026-02-24T09:10:58.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.929+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/860381887 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 msgr2=0x5601a770efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.929+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/860381887 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 0x5601a770efc0 secure :-1 s=READY pgs=91 gs=3 cs=0 l=1 c_cookie=17530389768920242614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e80095d0 tx=0x7fe3e80ac950 comp rx=0 tx=0).stop 2026-02-24T09:10:58.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.929+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/860381887 shutdown_connections 2026-02-24T09:10:58.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.929+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/860381887 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a770f500 0x5601a772f8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.929+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/860381887 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 0x5601a770efc0 unknown :-1 s=CLOSED pgs=91 gs=3 cs=0 l=1 c_cookie=17530389768920242614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.929+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/860381887 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 0x5601a76ca320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.929+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/860381887 >> 10.20.193.4:0/860381887 conn(0x5601a75e8db0 msgr2=0x5601a76c8830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:58.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.929+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/860381887 shutdown_connections 2026-02-24T09:10:58.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.929+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/860381887 wait complete. 2026-02-24T09:10:58.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.931+0000 7fe3fdaf8e00 1 -- start start 2026-02-24T09:10:58.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.932+0000 7fe3fdaf8e00 1 Processor -- start 2026-02-24T09:10:58.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.932+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7726dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.932+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76ca860 0x5601a7727310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.932+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 0x5601a772c300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.932+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5601a772c840 con 0x5601a76c9f50 2026-02-24T09:10:58.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.932+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5601a772c9b0 con 0x5601a76ca860 2026-02-24T09:10:58.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.932+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5601a772cb70 con 0x5601a770f500 2026-02-24T09:10:58.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.932+0000 7fe3f9873640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7726dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.932+0000 7fe3f9873640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7726dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46456/0 (socket says 10.20.193.4:46456) 2026-02-24T09:10:58.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.932+0000 7fe3f9873640 1 -- 10.20.193.4:0/867097502 learned_addr learned my addr 10.20.193.4:0/867097502 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:58.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3fa074640 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 0x5601a772c300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3f9873640 1 -- 10.20.193.4:0/867097502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 msgr2=0x5601a772c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:58.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3f9873640 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 0x5601a772c300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3f9873640 1 -- 10.20.193.4:0/867097502 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76ca860 msgr2=0x5601a7727310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:58.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3f9873640 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76ca860 0x5601a7727310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3f9873640 1 -- 10.20.193.4:0/867097502 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f4164bc0 con 0x5601a76c9f50 2026-02-24T09:10:58.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3fa074640 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 0x5601a772c300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:58.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3f9873640 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7726dd0 secure :-1 s=READY pgs=540 gs=1 cs=0 l=1 c_cookie=14394694951073086319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e4011c80 tx=0x7fe3e40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c43acaa8d1fb6f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:58.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3af7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:58.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3af7fe640 1 -- 10.20.193.4:0/867097502 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e4021070 con 0x5601a76c9f50 2026-02-24T09:10:58.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.933+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/867097502 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f4176a80 con 0x5601a76c9f50 2026-02-24T09:10:58.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.934+0000 7fe3af7fe640 1 -- 10.20.193.4:0/867097502 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3e4005020 con 0x5601a76c9f50 2026-02-24T09:10:58.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.934+0000 7fe3fdaf8e00 10 client.15840 _ll_register_callbacks cb 0x5601a757b080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:58.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.935+0000 7fe3af7fe640 1 -- 10.20.193.4:0/867097502 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e4026a40 con 0x5601a76c9f50 2026-02-24T09:10:58.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.935+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/867097502 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5601a73204a0 con 0x5601a76c9f50 2026-02-24T09:10:58.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.935+0000 7fe3af7fe640 1 -- 10.20.193.4:0/867097502 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fe3e4026bd0 con 0x5601a76c9f50 2026-02-24T09:10:58.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.935+0000 7fe3af7fe640 1 -- 10.20.193.4:0/867097502 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe3e4026d90 con 0x5601a76c9f50 2026-02-24T09:10:58.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.935+0000 7fe3fdaf8e00 10 client.15840 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:58.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.935+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/867097502 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5601a75549d0 con 0x5601a76c9f50 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.936+0000 7fe3af7fe640 1 -- 10.20.193.4:0/867097502 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fe3e401a470 con 0x5601a76c9f50 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.936+0000 7fe3fdaf8e00 10 client.15840 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.936+0000 7fe3fdaf8e00 10 client.15840 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.936+0000 7fe3fdaf8e00 20 client.15840 populate_metadata read hostname 'trial004' 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.936+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5601a772f420 0x5601a772f8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.936+0000 7fe3fdaf8e00 4 client.15840 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.936+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/867097502 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601a73204a0 con 0x5601a772f420 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.936+0000 7fe3f9072640 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5601a772f420 0x5601a772f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.937+0000 7fe3f9072640 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5601a772f420 0x5601a772f8c0 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=2243025445880209230 s_cookie=17910670978831161686 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f20d3c24bda1f4e server_cookie=f88f7c5c46211956 in_seq=0 out_seq=0 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.937+0000 7fe3af7fe640 10 client.15840 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:10:58.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.938+0000 7fe3af7fe640 1 -- 10.20.193.4:0/867097502 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5601a73204a0 con 0x5601a772f420 2026-02-24T09:10:58.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.938+0000 7fe3af7fe640 10 client.15840 handle_command_reply: tid=0 2026-02-24T09:10:58.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.938+0000 7fe3fdaf8e00 1 client.15840 shutdown 2026-02-24T09:10:58.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/867097502 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 msgr2=0x5601a7726dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7726dd0 secure :-1 s=READY pgs=540 gs=1 cs=0 l=1 c_cookie=14394694951073086319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e4011c80 tx=0x7fe3e40047e0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/867097502 shutdown_connections 2026-02-24T09:10:58.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5601a772f420 0x5601a772f8c0 crc :-1 s=READY pgs=24 gs=4 cs=0 l=0 c_cookie=2243025445880209230 s_cookie=17910670978831161686 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 0x5601a772c300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76ca860 0x5601a7727310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/867097502 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7726dd0 unknown :-1 s=CLOSED pgs=540 gs=1 cs=0 l=1 c_cookie=14394694951073086319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/867097502 >> 10.20.193.4:0/867097502 conn(0x5601a75e8db0 msgr2=0x5601a76c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:58.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3af7fe640 0 client.15840 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:10:58.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/867097502 shutdown_connections 2026-02-24T09:10:58.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.939+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/867097502 wait complete. 2026-02-24T09:10:58.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.940+0000 7fe3fdaf8e00 20 client.15840 trim_cache size 0 max 16384 2026-02-24T09:10:58.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.956+0000 7fe3fdaf8e00 1 Processor -- start 2026-02-24T09:10:58.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.956+0000 7fe3fdaf8e00 1 -- start start 2026-02-24T09:10:58.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.956+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7711ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.956+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 0x5601a76c9460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.956+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a770f500 0x5601a76c99a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.956+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5601a75ce9a0 con 0x5601a76c9f50 2026-02-24T09:10:58.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.956+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5601a73aadf0 con 0x5601a770f500 2026-02-24T09:10:58.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.956+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5601a7718e90 con 0x5601a76ca860 2026-02-24T09:10:58.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3fa074640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a770f500 0x5601a76c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3f9873640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7711ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3fa074640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a770f500 0x5601a76c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:38700/0 (socket says 10.20.193.4:38700) 2026-02-24T09:10:58.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3fa074640 1 -- 10.20.193.4:0/3425648429 learned_addr learned my addr 10.20.193.4:0/3425648429 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:58.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3f9873640 1 -- 10.20.193.4:0/3425648429 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 msgr2=0x5601a76c9460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:10:58.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3f9873640 1 --2- 10.20.193.4:0/3425648429 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 0x5601a76c9460 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3f9873640 1 -- 10.20.193.4:0/3425648429 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a770f500 msgr2=0x5601a76c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:58.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3f9873640 1 --2- 10.20.193.4:0/3425648429 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a770f500 0x5601a76c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3f9873640 1 -- 10.20.193.4:0/3425648429 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a7566710 con 0x5601a76c9f50 2026-02-24T09:10:58.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3fa074640 1 --2- 10.20.193.4:0/3425648429 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a770f500 0x5601a76c99a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:10:58.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.957+0000 7fe3f9873640 1 --2- 10.20.193.4:0/3425648429 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7711ff0 secure :-1 s=READY pgs=541 gs=1 cs=0 l=1 c_cookie=3025649968939736165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e4030fb0 tx=0x7fe3e4011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fd449dbd531c65 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:58.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.958+0000 7fe3c1ce5640 1 -- 10.20.193.4:0/3425648429 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e4021040 con 0x5601a76c9f50 2026-02-24T09:10:58.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.958+0000 7fe3c1ce5640 1 -- 10.20.193.4:0/3425648429 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3e4035060 con 0x5601a76c9f50 2026-02-24T09:10:58.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.958+0000 7fe3c1ce5640 1 -- 10.20.193.4:0/3425648429 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e4026bd0 con 0x5601a76c9f50 2026-02-24T09:10:58.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.959+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3425648429 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 msgr2=0x5601a7711ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.959+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/3425648429 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7711ff0 secure :-1 s=READY pgs=541 gs=1 cs=0 l=1 c_cookie=3025649968939736165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e4030fb0 tx=0x7fe3e4011f90 comp rx=0 tx=0).stop 2026-02-24T09:10:58.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.959+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3425648429 shutdown_connections 2026-02-24T09:10:58.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.959+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/3425648429 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a770f500 0x5601a76c99a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.959+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/3425648429 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a76ca860 0x5601a76c9460 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.959+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/3425648429 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76c9f50 0x5601a7711ff0 unknown :-1 s=CLOSED pgs=541 gs=1 cs=0 l=1 c_cookie=3025649968939736165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.959+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3425648429 >> 10.20.193.4:0/3425648429 conn(0x5601a75e8db0 msgr2=0x5601a77118e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:58.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.959+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3425648429 shutdown_connections 2026-02-24T09:10:58.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.959+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3425648429 wait complete. 2026-02-24T09:10:58.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.960+0000 7fe3fdaf8e00 1 -- start start 2026-02-24T09:10:58.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.960+0000 7fe3fdaf8e00 1 Processor -- start 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 0x5601a76ada00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76ca860 0x5601a7709ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3fdaf8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 0x5601a770a3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5601a76adf40 con 0x5601a76ca860 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5601a76ae0b0 con 0x5601a76c9f50 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3fdaf8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5601a770a920 con 0x5601a770f500 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9072640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76ca860 0x5601a7709ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9072640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76ca860 0x5601a7709ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46474/0 (socket says 10.20.193.4:46474) 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9072640 1 -- 10.20.193.4:0/3028475419 learned_addr learned my addr 10.20.193.4:0/3028475419 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3fa074640 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 0x5601a770a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9873640 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 0x5601a76ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9072640 1 -- 10.20.193.4:0/3028475419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 msgr2=0x5601a770a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9072640 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 0x5601a770a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9072640 1 -- 10.20.193.4:0/3028475419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 msgr2=0x5601a76ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9072640 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 0x5601a76ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9072640 1 -- 10.20.193.4:0/3028475419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a75549d0 con 0x5601a76ca860 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9873640 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 0x5601a76ada00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3f9072640 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76ca860 0x5601a7709ea0 secure :-1 s=READY pgs=542 gs=1 cs=0 l=1 c_cookie=14885724855312447143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e80af130 tx=0x7fe3e80a8f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce94b7e35119f6a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3af7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3af7fe640 1 -- 10.20.193.4:0/3028475419 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e80a9110 con 0x5601a76ca860 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3028475419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f0006e20 con 0x5601a76ca860 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3fdaf8e00 10 client.15846 _ll_register_callbacks cb 0x5601a757b080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:58.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3028475419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e80b7fe0 con 0x5601a76ca860 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3af7fe640 1 -- 10.20.193.4:0/3028475419 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe3e80a9270 con 0x5601a76ca860 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.961+0000 7fe3af7fe640 1 -- 10.20.193.4:0/3028475419 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3e80b7dd0 con 0x5601a76ca860 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3af7fe640 1 -- 10.20.193.4:0/3028475419 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fe3e80acc70 con 0x5601a76ca860 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3af7fe640 1 -- 10.20.193.4:0/3028475419 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe3e80adb30 con 0x5601a76ca860 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3fdaf8e00 10 client.15846 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3028475419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5601a7561190 con 0x5601a76ca860 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3af7fe640 1 -- 10.20.193.4:0/3028475419 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fe3e80cb020 con 0x5601a76ca860 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3fdaf8e00 10 client.15846 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3fdaf8e00 10 client.15846 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3fdaf8e00 20 client.15846 populate_metadata read hostname 'trial004' 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5601a77bca60 0x5601a77dcee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:58.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3fdaf8e00 4 client.15846 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.962+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3028475419 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601a75c67b0 con 0x5601a77bca60 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.963+0000 7fe3f9873640 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5601a77bca60 0x5601a77dcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.963+0000 7fe3af7fe640 10 client.15846 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.963+0000 7fe3f9873640 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5601a77bca60 0x5601a77dcee0 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=16055715946050436109 s_cookie=7347056669624545846 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ded15c960ae93c0d server_cookie=65f5fd1d59a2b236 in_seq=0 out_seq=0 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3af7fe640 1 -- 10.20.193.4:0/3028475419 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601a75c67b0 con 0x5601a77bca60 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3af7fe640 10 client.15846 handle_command_reply: tid=0 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 client.15846 shutdown 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3028475419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76ca860 msgr2=0x5601a7709ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76ca860 0x5601a7709ea0 secure :-1 s=READY pgs=542 gs=1 cs=0 l=1 c_cookie=14885724855312447143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e80af130 tx=0x7fe3e80a8f00 comp rx=0 tx=0).stop 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3028475419 shutdown_connections 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5601a77bca60 0x5601a77dcee0 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=16055715946050436109 s_cookie=7347056669624545846 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5601a770f500 0x5601a770a3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5601a76ca860 0x5601a7709ea0 unknown :-1 s=CLOSED pgs=542 gs=1 cs=0 l=1 c_cookie=14885724855312447143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 --2- 10.20.193.4:0/3028475419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5601a76c9f50 0x5601a76ada00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3af7fe640 0 client.15846 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:10:58.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3028475419 >> 10.20.193.4:0/3028475419 conn(0x5601a75e8db0 msgr2=0x5601a76c8450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:58.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3028475419 shutdown_connections 2026-02-24T09:10:58.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 1 -- 10.20.193.4:0/3028475419 wait complete. 2026-02-24T09:10:58.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.964+0000 7fe3fdaf8e00 20 client.15846 trim_cache size 0 max 16384 2026-02-24T09:10:58.974 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:10:58.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2639987989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3d00b57f0 msgr2=0x7fe3d00d5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3d00b57f0 0x7fe3d00d5ca0 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e4005b30 tx=0x7fe3e4009310 comp rx=0 tx=0).stop 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2639987989 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe3f4110040 msgr2=0x7fe3f411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe3f4110040 0x7fe3f411e4c0 secure :-1 s=READY pgs=539 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3e8009480 tx=0x7fe3e800ede0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2639987989 shutdown_connections 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe3d00b57f0 0x7fe3d00d5ca0 unknown :-1 s=CLOSED pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3f4115840 0x7fe3f4123890 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe3f4110040 0x7fe3f411e4c0 unknown :-1 s=CLOSED pgs=539 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 --2- 10.20.193.4:0/2639987989 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe3f410f650 0x7fe3f411df80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2639987989 >> 10.20.193.4:0/2639987989 conn(0x7fe3f40ecf20 msgr2=0x7fe3f410d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2639987989 shutdown_connections 2026-02-24T09:10:58.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:58.965+0000 7fe3fbafe640 1 -- 10.20.193.4:0/2639987989 wait complete. 2026-02-24T09:10:59.015 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:58 trial004 ceph-mon[41596]: pgmap v185: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 873 MiB/s wr, 256 op/s 2026-02-24T09:10:59.016 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:10:58 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/461633404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:59.043 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:10:59.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:58 trial090 ceph-mon[47278]: pgmap v185: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 873 MiB/s wr, 256 op/s 2026-02-24T09:10:59.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:10:58 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/461633404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:59.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:58 trial014 ceph-mon[46941]: pgmap v185: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 873 MiB/s wr, 256 op/s 2026-02-24T09:10:59.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:10:58 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/461633404' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:10:59.241 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:59.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 -- 10.20.193.4:0/690366367 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f73b4110040 msgr2=0x7f73b4115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 --2- 10.20.193.4:0/690366367 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f73b4110040 0x7f73b4115090 secure :-1 s=READY pgs=543 gs=1 cs=0 l=1 c_cookie=4192508618879274080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a8009950 tx=0x7f73a802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 -- 10.20.193.4:0/690366367 shutdown_connections 2026-02-24T09:10:59.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 --2- 10.20.193.4:0/690366367 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f73b4115840 0x7f73b4176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 --2- 10.20.193.4:0/690366367 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f73b4110040 0x7f73b4115090 unknown :-1 s=CLOSED pgs=543 gs=1 cs=0 l=1 c_cookie=4192508618879274080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 --2- 10.20.193.4:0/690366367 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73b410f650 0x7f73b410fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 -- 10.20.193.4:0/690366367 >> 10.20.193.4:0/690366367 conn(0x7f73b40ecf20 msgr2=0x7f73b410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 -- 10.20.193.4:0/690366367 shutdown_connections 2026-02-24T09:10:59.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 -- 10.20.193.4:0/690366367 wait complete. 2026-02-24T09:10:59.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 Processor -- start 2026-02-24T09:10:59.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 -- start start 2026-02-24T09:10:59.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f73b410f650 0x7f73b40f58c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f73b4110040 0x7f73b4176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73b4115840 0x7f73b40f5fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40fb1d0 con 0x7f73b410f650 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40fb340 con 0x7f73b4110040 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73bc3af640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40fb500 con 0x7f73b4115840 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73ba124640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f73b410f650 0x7f73b40f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73ba124640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f73b410f650 0x7f73b40f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46494/0 (socket says 10.20.193.4:46494) 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73ba124640 1 -- 10.20.193.4:0/1365837455 learned_addr learned my addr 10.20.193.4:0/1365837455 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73ba925640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73b4115840 0x7f73b40f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.411+0000 7f73b9923640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f73b4110040 0x7f73b4176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f73ba124640 1 -- 10.20.193.4:0/1365837455 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73b4115840 msgr2=0x7f73b40f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f73ba124640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73b4115840 0x7f73b40f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f73ba124640 1 -- 10.20.193.4:0/1365837455 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f73b4110040 msgr2=0x7f73b4176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f73ba124640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f73b4110040 0x7f73b4176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f73ba124640 1 -- 10.20.193.4:0/1365837455 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a8009570 con 0x7f73b410f650 2026-02-24T09:10:59.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f73ba124640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f73b410f650 0x7f73b40f58c0 secure :-1 s=READY pgs=544 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a4005db0 tx=0x7f73a400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f739b7fe640 1 -- 10.20.193.4:0/1365837455 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73a4004500 con 0x7f73b410f650 2026-02-24T09:10:59.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f73bc3af640 1 -- 10.20.193.4:0/1365837455 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b40fb7e0 con 0x7f73b410f650 2026-02-24T09:10:59.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f739b7fe640 1 -- 10.20.193.4:0/1365837455 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f73a4004d30 con 0x7f73b410f650 2026-02-24T09:10:59.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f739b7fe640 1 -- 10.20.193.4:0/1365837455 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73a4005310 con 0x7f73b410f650 2026-02-24T09:10:59.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.412+0000 7f73bc3af640 1 -- 10.20.193.4:0/1365837455 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b40fbcb0 con 0x7f73b410f650 2026-02-24T09:10:59.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.414+0000 7f739b7fe640 1 -- 10.20.193.4:0/1365837455 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f73a40054a0 con 0x7f73b410f650 2026-02-24T09:10:59.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.415+0000 7f739b7fe640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f73900b5760 0x7f73900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.415+0000 7f739b7fe640 1 -- 10.20.193.4:0/1365837455 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f73a40e6ef0 con 0x7f73b410f650 2026-02-24T09:10:59.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.415+0000 7f73b9923640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f73900b5760 0x7f73900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.415+0000 7f73b9923640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f73900b5760 0x7f73900d5c10 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a80023d0 tx=0x7f73a8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.417+0000 7f73be3a9e00 1 Processor -- start 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.417+0000 7f73be3a9e00 1 -- start start 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.417+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2046f50 0x563cc2047320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.417+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2047860 0x563cc208bfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.417+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc208c500 0x563cc20ac8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.417+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563cc1f57ee0 con 0x563cc2046f50 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.417+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563cc1f53c10 con 0x563cc208c500 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.417+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563cc1f4dd70 con 0x563cc2047860 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba124640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2046f50 0x563cc2047320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba124640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2046f50 0x563cc2047320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46502/0 (socket says 10.20.193.4:46502) 2026-02-24T09:10:59.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba124640 1 -- 10.20.193.4:0/1789931087 learned_addr learned my addr 10.20.193.4:0/1789931087 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:59.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba925640 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc208c500 0x563cc20ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73b9923640 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2047860 0x563cc208bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba124640 1 -- 10.20.193.4:0/1789931087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2047860 msgr2=0x563cc208bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba124640 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2047860 0x563cc208bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba124640 1 -- 10.20.193.4:0/1789931087 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc208c500 msgr2=0x563cc20ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba124640 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc208c500 0x563cc20ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba124640 1 -- 10.20.193.4:0/1789931087 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc1ef9340 con 0x563cc2046f50 2026-02-24T09:10:59.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba925640 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc208c500 0x563cc20ac8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:59.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73b9923640 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2047860 0x563cc208bfc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73ba124640 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2046f50 0x563cc2047320 secure :-1 s=READY pgs=545 gs=1 cs=0 l=1 c_cookie=11693146648175130588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a40040a0 tx=0x7f73a40a8f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24666ec6f0737dc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f7398884640 1 -- 10.20.193.4:0/1789931087 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73a40ac8d0 con 0x563cc2046f50 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f7398884640 1 -- 10.20.193.4:0/1789931087 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f73a400e350 con 0x563cc2046f50 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f7398884640 1 -- 10.20.193.4:0/1789931087 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73a4009a40 con 0x563cc2046f50 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73be3a9e00 1 -- 10.20.193.4:0/1789931087 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2046f50 msgr2=0x563cc2047320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.418+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2046f50 0x563cc2047320 secure :-1 s=READY pgs=545 gs=1 cs=0 l=1 c_cookie=11693146648175130588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a40040a0 tx=0x7f73a40a8f70 comp rx=0 tx=0).stop 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.419+0000 7f73be3a9e00 1 -- 10.20.193.4:0/1789931087 shutdown_connections 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.419+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc208c500 0x563cc20ac8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.419+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2047860 0x563cc208bfc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.419+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/1789931087 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2046f50 0x563cc2047320 unknown :-1 s=CLOSED pgs=545 gs=1 cs=0 l=1 c_cookie=11693146648175130588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.419+0000 7f73be3a9e00 1 -- 10.20.193.4:0/1789931087 >> 10.20.193.4:0/1789931087 conn(0x563cc1f65db0 msgr2=0x563cc2045830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.419+0000 7f73be3a9e00 1 -- 10.20.193.4:0/1789931087 shutdown_connections 2026-02-24T09:10:59.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.419+0000 7f73be3a9e00 1 -- 10.20.193.4:0/1789931087 wait complete. 2026-02-24T09:10:59.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.419+0000 7f73be3a9e00 1 -- start start 2026-02-24T09:10:59.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 1 Processor -- start 2026-02-24T09:10:59.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2046f50 0x563cc20a3fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2047860 0x563cc20a44e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20a94d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563cc20a9a10 con 0x563cc208c500 2026-02-24T09:10:59.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563cc20a9b80 con 0x563cc2047860 2026-02-24T09:10:59.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563cc20a9d40 con 0x563cc2046f50 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73ba925640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73ba925640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46506/0 (socket says 10.20.193.4:46506) 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73ba925640 1 -- 10.20.193.4:0/308137775 learned_addr learned my addr 10.20.193.4:0/308137775 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73ba124640 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2046f50 0x563cc20a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73b9923640 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2047860 0x563cc20a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73ba925640 1 -- 10.20.193.4:0/308137775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2046f50 msgr2=0x563cc20a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73ba925640 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2046f50 0x563cc20a3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73ba925640 1 -- 10.20.193.4:0/308137775 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2047860 msgr2=0x563cc20a44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73ba925640 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2047860 0x563cc20a44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73ba925640 1 -- 10.20.193.4:0/308137775 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc1ed19d0 con 0x563cc208c500 2026-02-24T09:10:59.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73ba925640 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20a94d0 secure :-1 s=READY pgs=546 gs=1 cs=0 l=1 c_cookie=10784496630111204744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73b0011670 tx=0x7f73b0011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95aa3a8bdf2cf588 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f7367fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:59.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f7367fff640 1 -- 10.20.193.4:0/308137775 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73b000faf0 con 0x563cc208c500 2026-02-24T09:10:59.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f7367fff640 1 -- 10.20.193.4:0/308137775 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f73b0011e90 con 0x563cc208c500 2026-02-24T09:10:59.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 1 -- 10.20.193.4:0/308137775 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b40fbcb0 con 0x563cc208c500 2026-02-24T09:10:59.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f7367fff640 1 -- 10.20.193.4:0/308137775 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73b0012660 con 0x563cc208c500 2026-02-24T09:10:59.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 10 client.15858 _ll_register_callbacks cb 0x563cc1ef8080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:59.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 1 -- 10.20.193.4:0/308137775 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563cc1c9d4a0 con 0x563cc208c500 2026-02-24T09:10:59.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f7367fff640 1 -- 10.20.193.4:0/308137775 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f73b0013e40 con 0x563cc208c500 2026-02-24T09:10:59.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f7367fff640 1 -- 10.20.193.4:0/308137775 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f73b00127f0 con 0x563cc208c500 2026-02-24T09:10:59.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 10 client.15858 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:59.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 1 -- 10.20.193.4:0/308137775 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563cc1ee3710 con 0x563cc208c500 2026-02-24T09:10:59.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f7367fff640 1 -- 10.20.193.4:0/308137775 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f73b0022060 con 0x563cc208c500 2026-02-24T09:10:59.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 10 client.15858 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:59.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 10 client.15858 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:10:59.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.420+0000 7f73be3a9e00 20 client.15858 populate_metadata read hostname 'trial004' 2026-02-24T09:10:59.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.421+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x563cc20ac590 0x563cc208a280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.421+0000 7f73be3a9e00 4 client.15858 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:59.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.421+0000 7f73be3a9e00 1 -- 10.20.193.4:0/308137775 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cc1f437b0 con 0x563cc20ac590 2026-02-24T09:10:59.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.421+0000 7f73ba124640 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x563cc20ac590 0x563cc208a280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.421+0000 7f73ba124640 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x563cc20ac590 0x563cc208a280 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=7711335099151317069 s_cookie=13341477279137264957 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6b042a6a90ea784d server_cookie=b92672e631ebf53d in_seq=0 out_seq=0 2026-02-24T09:10:59.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.421+0000 7f7367fff640 10 client.15858 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:10:59.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f7367fff640 1 -- 10.20.193.4:0/308137775 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563cc1f437b0 con 0x563cc20ac590 2026-02-24T09:10:59.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f7367fff640 10 client.15858 handle_command_reply: tid=0 2026-02-24T09:10:59.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 client.15858 shutdown 2026-02-24T09:10:59.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 -- 10.20.193.4:0/308137775 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 msgr2=0x563cc20a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20a94d0 secure :-1 s=READY pgs=546 gs=1 cs=0 l=1 c_cookie=10784496630111204744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73b0011670 tx=0x7f73b0011b40 comp rx=0 tx=0).stop 2026-02-24T09:10:59.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 -- 10.20.193.4:0/308137775 shutdown_connections 2026-02-24T09:10:59.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x563cc20ac590 0x563cc208a280 crc :-1 s=READY pgs=25 gs=4 cs=0 l=0 c_cookie=7711335099151317069 s_cookie=13341477279137264957 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20a94d0 unknown :-1 s=CLOSED pgs=546 gs=1 cs=0 l=1 c_cookie=10784496630111204744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f7367fff640 0 client.15858 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:10:59.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2047860 0x563cc20a44e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/308137775 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2046f50 0x563cc20a3fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 -- 10.20.193.4:0/308137775 >> 10.20.193.4:0/308137775 conn(0x563cc1f65db0 msgr2=0x563cc2045040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 -- 10.20.193.4:0/308137775 shutdown_connections 2026-02-24T09:10:59.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.422+0000 7f73be3a9e00 1 -- 10.20.193.4:0/308137775 wait complete. 2026-02-24T09:10:59.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.423+0000 7f73be3a9e00 20 client.15858 trim_cache size 0 max 16384 2026-02-24T09:10:59.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.430+0000 7f73be3a9e00 1 Processor -- start 2026-02-24T09:10:59.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73be3a9e00 1 -- start start 2026-02-24T09:10:59.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2046f50 0x563cc20a44d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2047860 0x563cc2046460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc208c500 0x563cc20469a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563cc1f4b9a0 con 0x563cc2047860 2026-02-24T09:10:59.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563cc1d27df0 con 0x563cc2046f50 2026-02-24T09:10:59.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563cc209cd20 con 0x563cc208c500 2026-02-24T09:10:59.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73b9923640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2047860 0x563cc2046460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73b9923640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2047860 0x563cc2046460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46512/0 (socket says 10.20.193.4:46512) 2026-02-24T09:10:59.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73b9923640 1 -- 10.20.193.4:0/2584029354 learned_addr learned my addr 10.20.193.4:0/2584029354 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:59.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73ba925640 1 --2- 10.20.193.4:0/2584029354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc208c500 0x563cc20469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73ba124640 1 --2- 10.20.193.4:0/2584029354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2046f50 0x563cc20a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73b9923640 1 -- 10.20.193.4:0/2584029354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc208c500 msgr2=0x563cc20469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73b9923640 1 --2- 10.20.193.4:0/2584029354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc208c500 0x563cc20469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73b9923640 1 -- 10.20.193.4:0/2584029354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2046f50 msgr2=0x563cc20a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73b9923640 1 --2- 10.20.193.4:0/2584029354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2046f50 0x563cc20a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73b9923640 1 -- 10.20.193.4:0/2584029354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc1ede190 con 0x563cc2047860 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.431+0000 7f73b9923640 1 --2- 10.20.193.4:0/2584029354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2047860 0x563cc2046460 secure :-1 s=READY pgs=547 gs=1 cs=0 l=1 c_cookie=12985545271184133195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a802f6e0 tx=0x7f73a803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b435ec9fafaf0c4b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.432+0000 7f73824e6640 1 -- 10.20.193.4:0/2584029354 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73a8002b00 con 0x563cc2047860 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.432+0000 7f73824e6640 1 -- 10.20.193.4:0/2584029354 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f73a804a070 con 0x563cc2047860 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.432+0000 7f73824e6640 1 -- 10.20.193.4:0/2584029354 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73a80438b0 con 0x563cc2047860 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.433+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2584029354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2047860 msgr2=0x563cc2046460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.433+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/2584029354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2047860 0x563cc2046460 secure :-1 s=READY pgs=547 gs=1 cs=0 l=1 c_cookie=12985545271184133195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a802f6e0 tx=0x7f73a803b000 comp rx=0 tx=0).stop 2026-02-24T09:10:59.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.433+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2584029354 shutdown_connections 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.433+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/2584029354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc208c500 0x563cc20469a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.433+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/2584029354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc2047860 0x563cc2046460 unknown :-1 s=CLOSED pgs=547 gs=1 cs=0 l=1 c_cookie=12985545271184133195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.433+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/2584029354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2046f50 0x563cc20a44d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.433+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2584029354 >> 10.20.193.4:0/2584029354 conn(0x563cc1f65db0 msgr2=0x563cc20a3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.433+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2584029354 shutdown_connections 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.433+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2584029354 wait complete. 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73be3a9e00 1 -- start start 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73be3a9e00 1 Processor -- start 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2046f50 0x563cc2028db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2047860 0x563cc20292f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73be3a9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20d2170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563cc20d26b0 con 0x563cc208c500 2026-02-24T09:10:59.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563cc20d2820 con 0x563cc2047860 2026-02-24T09:10:59.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73be3a9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563cc20d29e0 con 0x563cc2046f50 2026-02-24T09:10:59.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73ba925640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73ba925640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20d2170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46524/0 (socket says 10.20.193.4:46524) 2026-02-24T09:10:59.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73ba925640 1 -- 10.20.193.4:0/2794641411 learned_addr learned my addr 10.20.193.4:0/2794641411 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:59.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73b9923640 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2047860 0x563cc20292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73ba925640 1 -- 10.20.193.4:0/2794641411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2046f50 msgr2=0x563cc2028db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:10:59.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73ba925640 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2046f50 0x563cc2028db0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73ba925640 1 -- 10.20.193.4:0/2794641411 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2047860 msgr2=0x563cc20292f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73ba925640 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2047860 0x563cc20292f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73ba925640 1 -- 10.20.193.4:0/2794641411 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cc1ed1d00 con 0x563cc208c500 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73ba925640 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20d2170 secure :-1 s=READY pgs=548 gs=1 cs=0 l=1 c_cookie=4518633621192997408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73b0012c30 tx=0x7f73b00067d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb5695675587a20 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f7367fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f7367fff640 1 -- 10.20.193.4:0/2794641411 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73b00113f0 con 0x563cc208c500 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2794641411 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b4176a80 con 0x563cc208c500 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f73be3a9e00 10 client.15864 _ll_register_callbacks cb 0x563cc1ef8080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.434+0000 7f7367fff640 1 -- 10.20.193.4:0/2794641411 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f73b0029070 con 0x563cc208c500 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2794641411 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73a400e350 con 0x563cc208c500 2026-02-24T09:10:59.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f7367fff640 1 -- 10.20.193.4:0/2794641411 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73b0023a30 con 0x563cc208c500 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f7367fff640 1 -- 10.20.193.4:0/2794641411 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7f73b0023bc0 con 0x563cc208c500 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f7367fff640 1 -- 10.20.193.4:0/2794641411 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f73b0023e20 con 0x563cc208c500 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f73be3a9e00 10 client.15864 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2794641411 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563cc1ee3970 con 0x563cc208c500 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f7367fff640 1 -- 10.20.193.4:0/2794641411 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f73b0022040 con 0x563cc208c500 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f73be3a9e00 10 client.15864 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f73be3a9e00 10 client.15864 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f73be3a9e00 20 client.15864 populate_metadata read hostname 'trial004' 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x563cc213ae30 0x563cc215b2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f73be3a9e00 4 client.15864 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:10:59.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2794641411 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563cc1c82160 con 0x563cc213ae30 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.435+0000 7f73ba124640 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x563cc213ae30 0x563cc215b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73ba124640 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x563cc213ae30 0x563cc215b2b0 crc :-1 s=READY pgs=26 gs=3 cs=0 l=0 c_cookie=12204363043788932338 s_cookie=7517910695417961783 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a95e9b86def1c4f2 server_cookie=6854fbf2257f5d37 in_seq=0 out_seq=0 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f7367fff640 10 client.15864 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f7367fff640 1 -- 10.20.193.4:0/2794641411 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563cc1c82160 con 0x563cc213ae30 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f7367fff640 10 client.15864 handle_command_reply: tid=0 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 client.15864 shutdown 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2794641411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 msgr2=0x563cc20d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20d2170 secure :-1 s=READY pgs=548 gs=1 cs=0 l=1 c_cookie=4518633621192997408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73b0012c30 tx=0x7f73b00067d0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2794641411 shutdown_connections 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x563cc213ae30 0x563cc215b2b0 crc :-1 s=READY pgs=26 gs=3 cs=0 l=0 c_cookie=12204363043788932338 s_cookie=7517910695417961783 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563cc208c500 0x563cc20d2170 unknown :-1 s=CLOSED pgs=548 gs=1 cs=0 l=1 c_cookie=4518633621192997408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f7367fff640 0 client.15864 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:10:59.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563cc2047860 0x563cc20292f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 --2- 10.20.193.4:0/2794641411 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563cc2046f50 0x563cc2028db0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2794641411 >> 10.20.193.4:0/2794641411 conn(0x563cc1f65db0 msgr2=0x563cc2045450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2794641411 shutdown_connections 2026-02-24T09:10:59.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 1 -- 10.20.193.4:0/2794641411 wait complete. 2026-02-24T09:10:59.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.436+0000 7f73be3a9e00 20 client.15864 trim_cache size 0 max 16384 2026-02-24T09:10:59.451 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:10:59.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 -- 10.20.193.4:0/1365837455 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f73900b5760 msgr2=0x7f73900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f73900b5760 0x7f73900d5c10 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a80023d0 tx=0x7f73a8031040 comp rx=0 tx=0).stop 2026-02-24T09:10:59.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 -- 10.20.193.4:0/1365837455 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f73b410f650 msgr2=0x7f73b40f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f73b410f650 0x7f73b40f58c0 secure :-1 s=READY pgs=544 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a4005db0 tx=0x7f73a400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 -- 10.20.193.4:0/1365837455 shutdown_connections 2026-02-24T09:10:59.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f73900b5760 0x7f73900d5c10 unknown :-1 s=CLOSED pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73b4115840 0x7f73b40f5fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f73b4110040 0x7f73b4176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 --2- 10.20.193.4:0/1365837455 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f73b410f650 0x7f73b40f58c0 unknown :-1 s=CLOSED pgs=544 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 -- 10.20.193.4:0/1365837455 >> 10.20.193.4:0/1365837455 conn(0x7f73b40ecf20 msgr2=0x7f73b4111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 -- 10.20.193.4:0/1365837455 shutdown_connections 2026-02-24T09:10:59.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.437+0000 7f73bc3af640 1 -- 10.20.193.4:0/1365837455 wait complete. 2026-02-24T09:10:59.523 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:10:59.726 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:10:59.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.911+0000 7fb299c59640 1 -- 10.20.193.4:0/3358342855 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb294110040 msgr2=0x7fb294115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.911+0000 7fb299c59640 1 --2- 10.20.193.4:0/3358342855 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb294110040 0x7fb294115090 secure :-1 s=READY pgs=549 gs=1 cs=0 l=1 c_cookie=5100021548338288725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb284009950 tx=0x7fb28402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.912+0000 7fb299c59640 1 -- 10.20.193.4:0/3358342855 shutdown_connections 2026-02-24T09:10:59.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.912+0000 7fb299c59640 1 --2- 10.20.193.4:0/3358342855 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb294115840 0x7fb294176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.912+0000 7fb299c59640 1 --2- 10.20.193.4:0/3358342855 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb294110040 0x7fb294115090 unknown :-1 s=CLOSED pgs=549 gs=1 cs=0 l=1 c_cookie=5100021548338288725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.912+0000 7fb299c59640 1 --2- 10.20.193.4:0/3358342855 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb29410f650 0x7fb29410fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.912+0000 7fb299c59640 1 -- 10.20.193.4:0/3358342855 >> 10.20.193.4:0/3358342855 conn(0x7fb2940ecf20 msgr2=0x7fb29410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.912+0000 7fb299c59640 1 -- 10.20.193.4:0/3358342855 shutdown_connections 2026-02-24T09:10:59.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.912+0000 7fb299c59640 1 -- 10.20.193.4:0/3358342855 wait complete. 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb299c59640 1 Processor -- start 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb299c59640 1 -- start start 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb299c59640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb29410f650 0x7fb2940f5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb299c59640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb294110040 0x7fb294176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb299c59640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb294115840 0x7fb2940f5f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb299c59640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb2940fb1a0 con 0x7fb294115840 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb299c59640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb2940fb310 con 0x7fb294110040 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb299c59640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2940fb4d0 con 0x7fb29410f650 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb293fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb294115840 0x7fb2940f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb293fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb294115840 0x7fb2940f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46528/0 (socket says 10.20.193.4:46528) 2026-02-24T09:10:59.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb293fff640 1 -- 10.20.193.4:0/3708375246 learned_addr learned my addr 10.20.193.4:0/3708375246 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb2937fe640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb29410f650 0x7fb2940f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb293fff640 1 -- 10.20.193.4:0/3708375246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb29410f650 msgr2=0x7fb2940f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb293fff640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb29410f650 0x7fb2940f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb293fff640 1 -- 10.20.193.4:0/3708375246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb294110040 msgr2=0x7fb294176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb293fff640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb294110040 0x7fb294176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb293fff640 1 -- 10.20.193.4:0/3708375246 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb284009570 con 0x7fb294115840 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.913+0000 7fb293fff640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb294115840 0x7fb2940f5f90 secure :-1 s=READY pgs=550 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb28800f8d0 tx=0x7fb28800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.914+0000 7fb290ff9640 1 -- 10.20.193.4:0/3708375246 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb28800dce0 con 0x7fb294115840 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.914+0000 7fb290ff9640 1 -- 10.20.193.4:0/3708375246 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb28800de40 con 0x7fb294115840 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.914+0000 7fb299c59640 1 -- 10.20.193.4:0/3708375246 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2940fb7b0 con 0x7fb294115840 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.914+0000 7fb290ff9640 1 -- 10.20.193.4:0/3708375246 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2880116b0 con 0x7fb294115840 2026-02-24T09:10:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.914+0000 7fb299c59640 1 -- 10.20.193.4:0/3708375246 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2940fbc80 con 0x7fb294115840 2026-02-24T09:10:59.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.919+0000 7fb290ff9640 1 -- 10.20.193.4:0/3708375246 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fb288020060 con 0x7fb294115840 2026-02-24T09:10:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.921+0000 7fb290ff9640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2680b56f0 0x7fb2680d5ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.922+0000 7fb2937fe640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2680b56f0 0x7fb2680d5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.923+0000 7fb290ff9640 1 -- 10.20.193.4:0/3708375246 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fb288015070 con 0x7fb294115840 2026-02-24T09:10:59.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.923+0000 7fb2937fe640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2680b56f0 0x7fb2680d5ba0 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb280004740 tx=0x7fb280004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb29bc53e00 1 Processor -- start 2026-02-24T09:10:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb29bc53e00 1 -- start start 2026-02-24T09:10:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660cd5320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660cd5860 0x557660d19fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660d1a500 0x557660d3a8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557660be5ee0 con 0x557660cd4f50 2026-02-24T09:10:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557660be1c10 con 0x557660cd5860 2026-02-24T09:10:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557660bdbd70 con 0x557660d1a500 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb2937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660cd5320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb2937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660cd5320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46536/0 (socket says 10.20.193.4:46536) 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb2937fe640 1 -- 10.20.193.4:0/1519275985 learned_addr learned my addr 10.20.193.4:0/1519275985 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb293fff640 1 --2- 10.20.193.4:0/1519275985 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660d1a500 0x557660d3a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb292ffd640 1 --2- 10.20.193.4:0/1519275985 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660cd5860 0x557660d19fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb2937fe640 1 -- 10.20.193.4:0/1519275985 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660d1a500 msgr2=0x557660d3a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb2937fe640 1 --2- 10.20.193.4:0/1519275985 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660d1a500 0x557660d3a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb2937fe640 1 -- 10.20.193.4:0/1519275985 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660cd5860 msgr2=0x557660d19fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb2937fe640 1 --2- 10.20.193.4:0/1519275985 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660cd5860 0x557660d19fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.925+0000 7fb2937fe640 1 -- 10.20.193.4:0/1519275985 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557660b87340 con 0x557660cd4f50 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.926+0000 7fb2937fe640 1 --2- 10.20.193.4:0/1519275985 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660cd5320 secure :-1 s=READY pgs=551 gs=1 cs=0 l=1 c_cookie=9572866691007241322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb280005db0 tx=0x7fb280012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d9a78947a7dc6a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.926+0000 7fb257fff640 1 -- 10.20.193.4:0/1519275985 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb28001e680 con 0x557660cd4f50 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.926+0000 7fb257fff640 1 -- 10.20.193.4:0/1519275985 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb28000fec0 con 0x557660cd4f50 2026-02-24T09:10:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.926+0000 7fb257fff640 1 -- 10.20.193.4:0/1519275985 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb280010b60 con 0x557660cd4f50 2026-02-24T09:10:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.927+0000 7fb29bc53e00 1 -- 10.20.193.4:0/1519275985 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 msgr2=0x557660cd5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.927+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/1519275985 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660cd5320 secure :-1 s=READY pgs=551 gs=1 cs=0 l=1 c_cookie=9572866691007241322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb280005db0 tx=0x7fb280012000 comp rx=0 tx=0).stop 2026-02-24T09:10:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.927+0000 7fb29bc53e00 1 -- 10.20.193.4:0/1519275985 shutdown_connections 2026-02-24T09:10:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.927+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/1519275985 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660d1a500 0x557660d3a8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.927+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/1519275985 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660cd5860 0x557660d19fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.927+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/1519275985 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660cd5320 unknown :-1 s=CLOSED pgs=551 gs=1 cs=0 l=1 c_cookie=9572866691007241322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.927+0000 7fb29bc53e00 1 -- 10.20.193.4:0/1519275985 >> 10.20.193.4:0/1519275985 conn(0x557660bf3db0 msgr2=0x557660cd3830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.927+0000 7fb29bc53e00 1 -- 10.20.193.4:0/1519275985 shutdown_connections 2026-02-24T09:10:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.927+0000 7fb29bc53e00 1 -- 10.20.193.4:0/1519275985 wait complete. 2026-02-24T09:10:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb29bc53e00 1 -- start start 2026-02-24T09:10:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb29bc53e00 1 Processor -- start 2026-02-24T09:10:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d31d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660cd5860 0x557660d32270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660d1a500 0x557660d37260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557660d377a0 con 0x557660cd4f50 2026-02-24T09:10:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557660d37910 con 0x557660d1a500 2026-02-24T09:10:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557660d37ad0 con 0x557660cd5860 2026-02-24T09:10:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb2937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d31d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb2937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d31d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46546/0 (socket says 10.20.193.4:46546) 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb2937fe640 1 -- 10.20.193.4:0/3994027995 learned_addr learned my addr 10.20.193.4:0/3994027995 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb293fff640 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660d1a500 0x557660d37260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb292ffd640 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660cd5860 0x557660d32270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb2937fe640 1 -- 10.20.193.4:0/3994027995 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660cd5860 msgr2=0x557660d32270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb2937fe640 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660cd5860 0x557660d32270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb2937fe640 1 -- 10.20.193.4:0/3994027995 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660d1a500 msgr2=0x557660d37260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb2937fe640 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660d1a500 0x557660d37260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.928+0000 7fb2937fe640 1 -- 10.20.193.4:0/3994027995 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557660b5f9d0 con 0x557660cd4f50 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb2937fe640 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d31d30 secure :-1 s=READY pgs=552 gs=1 cs=0 l=1 c_cookie=16480538245962205000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb280010650 tx=0x7fb2800041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b6a23791d10748 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb2557fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb2557fa640 1 -- 10.20.193.4:0/3994027995 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb280010750 con 0x557660cd4f50 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 1 -- 10.20.193.4:0/3994027995 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28000fa90 con 0x557660cd4f50 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb2557fa640 1 -- 10.20.193.4:0/3994027995 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb2800108b0 con 0x557660cd4f50 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb2557fa640 1 -- 10.20.193.4:0/3994027995 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2800347e0 con 0x557660cd4f50 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 10 client.15876 _ll_register_callbacks cb 0x557660b86080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 1 -- 10.20.193.4:0/3994027995 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557660866f40 con 0x557660cd4f50 2026-02-24T09:10:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb2557fa640 1 -- 10.20.193.4:0/3994027995 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fb28002a420 con 0x557660cd4f50 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb2557fa640 1 -- 10.20.193.4:0/3994027995 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb28002a640 con 0x557660cd4f50 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 10 client.15876 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 1 -- 10.20.193.4:0/3994027995 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557660b71710 con 0x557660cd4f50 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb2557fa640 1 -- 10.20.193.4:0/3994027995 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb28002a820 con 0x557660cd4f50 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 10 client.15876 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 20 client.15876 populate_metadata read hostname 'trial004' 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557660d17710 0x557660d17bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 4 client.15876 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.929+0000 7fb29bc53e00 1 -- 10.20.193.4:0/3994027995 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576608696f0 con 0x557660d17710 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.930+0000 7fb292ffd640 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557660d17710 0x557660d17bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.930+0000 7fb292ffd640 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557660d17710 0x557660d17bb0 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=15749803239476580149 s_cookie=7739995599396294286 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da928a99ab4c4f35 server_cookie=6b69fcfd491a4e8e in_seq=0 out_seq=0 2026-02-24T09:10:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.930+0000 7fb2557fa640 10 client.15876 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:59.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb2557fa640 1 -- 10.20.193.4:0/3994027995 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5576608696f0 con 0x557660d17710 2026-02-24T09:10:59.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb2557fa640 10 client.15876 handle_command_reply: tid=0 2026-02-24T09:10:59.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 client.15876 shutdown 2026-02-24T09:10:59.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 -- 10.20.193.4:0/3994027995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 msgr2=0x557660d31d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d31d30 secure :-1 s=READY pgs=552 gs=1 cs=0 l=1 c_cookie=16480538245962205000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb280010650 tx=0x7fb2800041d0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 -- 10.20.193.4:0/3994027995 shutdown_connections 2026-02-24T09:10:59.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557660d17710 0x557660d17bb0 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=15749803239476580149 s_cookie=7739995599396294286 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660d1a500 0x557660d37260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660cd5860 0x557660d32270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb2557fa640 0 client.15876 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:59.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/3994027995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d31d30 unknown :-1 s=CLOSED pgs=552 gs=1 cs=0 l=1 c_cookie=16480538245962205000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 -- 10.20.193.4:0/3994027995 >> 10.20.193.4:0/3994027995 conn(0x557660bf3db0 msgr2=0x557660cd3040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 -- 10.20.193.4:0/3994027995 shutdown_connections 2026-02-24T09:10:59.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.931+0000 7fb29bc53e00 1 -- 10.20.193.4:0/3994027995 wait complete. 2026-02-24T09:10:59.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.932+0000 7fb29bc53e00 20 client.15876 trim_cache size 0 max 16384 2026-02-24T09:10:59.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb29bc53e00 1 Processor -- start 2026-02-24T09:10:59.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb29bc53e00 1 -- start start 2026-02-24T09:10:59.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d367d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660cd5860 0x557660d15160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660d17710 0x557660d156a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557660bd99a0 con 0x557660cd4f50 2026-02-24T09:10:59.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5576609b5df0 con 0x557660d17710 2026-02-24T09:10:59.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557660d37c10 con 0x557660cd5860 2026-02-24T09:10:59.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb2937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb2937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d367d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46556/0 (socket says 10.20.193.4:46556) 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb2937fe640 1 -- 10.20.193.4:0/2041599165 learned_addr learned my addr 10.20.193.4:0/2041599165 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb293fff640 1 --2- 10.20.193.4:0/2041599165 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660d17710 0x557660d156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb292ffd640 1 --2- 10.20.193.4:0/2041599165 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660cd5860 0x557660d15160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb2937fe640 1 -- 10.20.193.4:0/2041599165 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660cd5860 msgr2=0x557660d15160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb2937fe640 1 --2- 10.20.193.4:0/2041599165 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660cd5860 0x557660d15160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb2937fe640 1 -- 10.20.193.4:0/2041599165 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660d17710 msgr2=0x557660d156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb2937fe640 1 --2- 10.20.193.4:0/2041599165 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660d17710 0x557660d156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.941+0000 7fb2937fe640 1 -- 10.20.193.4:0/2041599165 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557660d24390 con 0x557660cd4f50 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.942+0000 7fb2937fe640 1 --2- 10.20.193.4:0/2041599165 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d367d0 secure :-1 s=READY pgs=553 gs=1 cs=0 l=1 c_cookie=15185595998861491665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb280011cb0 tx=0x7fb280038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2be131aaebb7dd1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.942+0000 7fb2577fe640 1 -- 10.20.193.4:0/2041599165 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2800026a0 con 0x557660cd4f50 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.942+0000 7fb2577fe640 1 -- 10.20.193.4:0/2041599165 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x557660866f40 con 0x557660cd4f50 2026-02-24T09:10:59.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.942+0000 7fb2577fe640 1 -- 10.20.193.4:0/2041599165 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb280034970 con 0x557660cd4f50 2026-02-24T09:10:59.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.943+0000 7fb29bc53e00 1 -- 10.20.193.4:0/2041599165 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 msgr2=0x557660d367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.943+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/2041599165 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d367d0 secure :-1 s=READY pgs=553 gs=1 cs=0 l=1 c_cookie=15185595998861491665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb280011cb0 tx=0x7fb280038000 comp rx=0 tx=0).stop 2026-02-24T09:10:59.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.943+0000 7fb29bc53e00 1 -- 10.20.193.4:0/2041599165 shutdown_connections 2026-02-24T09:10:59.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.943+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/2041599165 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660d17710 0x557660d156a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.943+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/2041599165 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660cd5860 0x557660d15160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.943+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/2041599165 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d367d0 unknown :-1 s=CLOSED pgs=553 gs=1 cs=0 l=1 c_cookie=15185595998861491665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.943+0000 7fb29bc53e00 1 -- 10.20.193.4:0/2041599165 >> 10.20.193.4:0/2041599165 conn(0x557660bf3db0 msgr2=0x557660d360c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.943+0000 7fb29bc53e00 1 -- 10.20.193.4:0/2041599165 shutdown_connections 2026-02-24T09:10:59.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.943+0000 7fb29bc53e00 1 -- 10.20.193.4:0/2041599165 wait complete. 2026-02-24T09:10:59.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb29bc53e00 1 -- start start 2026-02-24T09:10:59.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb29bc53e00 1 Processor -- start 2026-02-24T09:10:59.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d156e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660cd5860 0x557660cb3030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb29bc53e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660d17710 0x557660cb3570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557660bd99a0 con 0x557660cd4f50 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb2937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557660d15c20 con 0x557660cd5860 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb29bc53e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557660d15de0 con 0x557660d17710 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb2937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d156e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46568/0 (socket says 10.20.193.4:46568) 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb2937fe640 1 -- 10.20.193.4:0/707174679 learned_addr learned my addr 10.20.193.4:0/707174679 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb293fff640 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660d17710 0x557660cb3570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb292ffd640 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660cd5860 0x557660cb3030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb2937fe640 1 -- 10.20.193.4:0/707174679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660d17710 msgr2=0x557660cb3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb2937fe640 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660d17710 0x557660cb3570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb2937fe640 1 -- 10.20.193.4:0/707174679 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660cd5860 msgr2=0x557660cb3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb2937fe640 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660cd5860 0x557660cb3030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.944+0000 7fb2937fe640 1 -- 10.20.193.4:0/707174679 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557660b6c190 con 0x557660cd4f50 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb2937fe640 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d156e0 secure :-1 s=READY pgs=554 gs=1 cs=0 l=1 c_cookie=10640212497839149711 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb280014020 tx=0x7fb28002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a9a0e47c5fd28f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb2557fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb2557fa640 1 -- 10.20.193.4:0/707174679 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb280010650 con 0x557660cd4f50 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 1 -- 10.20.193.4:0/707174679 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557660b71710 con 0x557660cd4f50 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb2557fa640 1 -- 10.20.193.4:0/707174679 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb28002a420 con 0x557660cd4f50 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb2557fa640 1 -- 10.20.193.4:0/707174679 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb28003c770 con 0x557660cd4f50 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 10 client.15882 _ll_register_callbacks cb 0x557660b86080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:10:59.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 1 -- 10.20.193.4:0/707174679 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557660bd17b0 con 0x557660cd4f50 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb2557fa640 1 -- 10.20.193.4:0/707174679 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fb28003c900 con 0x557660cd4f50 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb2557fa640 1 -- 10.20.193.4:0/707174679 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb28003cb20 con 0x557660cd4f50 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 10 client.15882 fetch_fsmap learned FSMap version 19 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 1 -- 10.20.193.4:0/707174679 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557660b5fd00 con 0x557660cd4f50 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb2557fa640 1 -- 10.20.193.4:0/707174679 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb28003cd40 con 0x557660cd4f50 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 10 client.15882 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 20 client.15882 populate_metadata read hostname 'trial004' 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557660d1a500 0x557660de7890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 4 client.15882 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:10:59.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.945+0000 7fb29bc53e00 1 -- 10.20.193.4:0/707174679 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557660de8080 con 0x557660d1a500 2026-02-24T09:10:59.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.947+0000 7fb292ffd640 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557660d1a500 0x557660de7890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.948+0000 7fb292ffd640 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557660d1a500 0x557660de7890 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=10964824064241040430 s_cookie=13736329479340221876 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=982ae1646dbdfc2e server_cookie=bea13ee21dcce5b4 in_seq=0 out_seq=0 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.948+0000 7fb2557fa640 10 client.15882 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb2557fa640 1 -- 10.20.193.4:0/707174679 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557660de8080 con 0x557660d1a500 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb2557fa640 10 client.15882 handle_command_reply: tid=0 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 client.15882 shutdown 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 -- 10.20.193.4:0/707174679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 msgr2=0x557660d156e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d156e0 secure :-1 s=READY pgs=554 gs=1 cs=0 l=1 c_cookie=10640212497839149711 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb280014020 tx=0x7fb28002bf60 comp rx=0 tx=0).stop 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 -- 10.20.193.4:0/707174679 shutdown_connections 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557660d1a500 0x557660de7890 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=10964824064241040430 s_cookie=13736329479340221876 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557660d17710 0x557660cb3570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557660cd5860 0x557660cb3030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 --2- 10.20.193.4:0/707174679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557660cd4f50 0x557660d156e0 unknown :-1 s=CLOSED pgs=554 gs=1 cs=0 l=1 c_cookie=10640212497839149711 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb2557fa640 0 client.15882 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:10:59.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 -- 10.20.193.4:0/707174679 >> 10.20.193.4:0/707174679 conn(0x557660bf3db0 msgr2=0x557660d2e900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 -- 10.20.193.4:0/707174679 shutdown_connections 2026-02-24T09:10:59.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 1 -- 10.20.193.4:0/707174679 wait complete. 2026-02-24T09:10:59.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.949+0000 7fb29bc53e00 20 client.15882 trim_cache size 0 max 16384 2026-02-24T09:10:59.953 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:10:59.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.950+0000 7fb299c59640 1 -- 10.20.193.4:0/3708375246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2680b56f0 msgr2=0x7fb2680d5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.950+0000 7fb299c59640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2680b56f0 0x7fb2680d5ba0 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb280004740 tx=0x7fb280004420 comp rx=0 tx=0).stop 2026-02-24T09:10:59.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.950+0000 7fb299c59640 1 -- 10.20.193.4:0/3708375246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb294115840 msgr2=0x7fb2940f5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:10:59.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.950+0000 7fb299c59640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb294115840 0x7fb2940f5f90 secure :-1 s=READY pgs=550 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb28800f8d0 tx=0x7fb28800fda0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.950+0000 7fb299c59640 1 -- 10.20.193.4:0/3708375246 shutdown_connections 2026-02-24T09:10:59.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.950+0000 7fb299c59640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2680b56f0 0x7fb2680d5ba0 unknown :-1 s=CLOSED pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.950+0000 7fb299c59640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb294115840 0x7fb2940f5f90 unknown :-1 s=CLOSED pgs=550 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.950+0000 7fb299c59640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb294110040 0x7fb294176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.950+0000 7fb299c59640 1 --2- 10.20.193.4:0/3708375246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb29410f650 0x7fb2940f5890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:10:59.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.950+0000 7fb299c59640 1 -- 10.20.193.4:0/3708375246 >> 10.20.193.4:0/3708375246 conn(0x7fb2940ecf20 msgr2=0x7fb294111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:10:59.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.951+0000 7fb299c59640 1 -- 10.20.193.4:0/3708375246 shutdown_connections 2026-02-24T09:10:59.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:10:59.951+0000 7fb299c59640 1 -- 10.20.193.4:0/3708375246 wait complete. 2026-02-24T09:11:01.064 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:11:01.064 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:11:01.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:00 trial090 ceph-mon[47278]: pgmap v186: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 43 KiB/s rd, 686 MiB/s wr, 208 op/s 2026-02-24T09:11:01.088 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:00 trial004 ceph-mon[41596]: pgmap v186: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 43 KiB/s rd, 686 MiB/s wr, 208 op/s 2026-02-24T09:11:01.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:00 trial014 ceph-mon[46941]: pgmap v186: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 43 KiB/s rd, 686 MiB/s wr, 208 op/s 2026-02-24T09:11:01.220 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:01.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.362+0000 7fa057690640 1 -- 10.20.193.4:0/1830616539 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa05010f280 msgr2=0x7fa05010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.362+0000 7fa057690640 1 --2- 10.20.193.4:0/1830616539 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa05010f280 0x7fa05010f650 secure :-1 s=READY pgs=555 gs=1 cs=0 l=1 c_cookie=821578667291530829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa038009950 tx=0x7fa03802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.362+0000 7fa057690640 1 -- 10.20.193.4:0/1830616539 shutdown_connections 2026-02-24T09:11:01.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.362+0000 7fa057690640 1 --2- 10.20.193.4:0/1830616539 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa050115470 0x7fa050175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.362+0000 7fa057690640 1 --2- 10.20.193.4:0/1830616539 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa05010fc70 0x7fa050114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.362+0000 7fa057690640 1 --2- 10.20.193.4:0/1830616539 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa05010f280 0x7fa05010f650 unknown :-1 s=CLOSED pgs=555 gs=1 cs=0 l=1 c_cookie=821578667291530829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.362+0000 7fa057690640 1 -- 10.20.193.4:0/1830616539 >> 10.20.193.4:0/1830616539 conn(0x7fa05005f830 msgr2=0x7fa05010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.362+0000 7fa057690640 1 -- 10.20.193.4:0/1830616539 shutdown_connections 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.362+0000 7fa057690640 1 -- 10.20.193.4:0/1830616539 wait complete. 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa057690640 1 Processor -- start 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa057690640 1 -- start start 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa057690640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa05010f280 0x7fa050066f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa057690640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa05010fc70 0x7fa0500631d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa057690640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa050115470 0x7fa050063830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa057690640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fa050063fc0 con 0x7fa050115470 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa057690640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fa050168380 con 0x7fa05010fc70 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa057690640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa050168540 con 0x7fa05010f280 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa055c06640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa050115470 0x7fa050063830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa055405640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa05010f280 0x7fa050066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa055c06640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa050115470 0x7fa050063830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46576/0 (socket says 10.20.193.4:46576) 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa055c06640 1 -- 10.20.193.4:0/3076424467 learned_addr learned my addr 10.20.193.4:0/3076424467 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.363+0000 7fa054c04640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa05010fc70 0x7fa0500631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa055c06640 1 -- 10.20.193.4:0/3076424467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa05010f280 msgr2=0x7fa050066f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa055c06640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa05010f280 0x7fa050066f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa055c06640 1 -- 10.20.193.4:0/3076424467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa05010fc70 msgr2=0x7fa0500631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa055c06640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa05010fc70 0x7fa0500631d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa055c06640 1 -- 10.20.193.4:0/3076424467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa038009570 con 0x7fa050115470 2026-02-24T09:11:01.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa055c06640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa050115470 0x7fa050063830 secure :-1 s=READY pgs=556 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa04c00f8d0 tx=0x7fa04c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa0467fc640 1 -- 10.20.193.4:0/3076424467 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa04c00dce0 con 0x7fa050115470 2026-02-24T09:11:01.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa057690640 1 -- 10.20.193.4:0/3076424467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa050168820 con 0x7fa050115470 2026-02-24T09:11:01.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa0467fc640 1 -- 10.20.193.4:0/3076424467 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa04c00de40 con 0x7fa050115470 2026-02-24T09:11:01.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa0467fc640 1 -- 10.20.193.4:0/3076424467 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa04c011740 con 0x7fa050115470 2026-02-24T09:11:01.371 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.364+0000 7fa057690640 1 -- 10.20.193.4:0/3076424467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa050168d70 con 0x7fa050115470 2026-02-24T09:11:01.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.367+0000 7fa0467fc640 1 -- 10.20.193.4:0/3076424467 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7fa04c020060 con 0x7fa050115470 2026-02-24T09:11:01.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.368+0000 7fa0467fc640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa02c0b5770 0x7fa02c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.368+0000 7fa0467fc640 1 -- 10.20.193.4:0/3076424467 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fa04c015070 con 0x7fa050115470 2026-02-24T09:11:01.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.368+0000 7fa055405640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa02c0b5770 0x7fa02c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.372 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.369+0000 7fa055405640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa02c0b5770 0x7fa02c0d5c20 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa038005b30 tx=0x7fa03803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.370+0000 7fa05968ae00 1 Processor -- start 2026-02-24T09:11:01.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.370+0000 7fa05968ae00 1 -- start start 2026-02-24T09:11:01.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e54300 0x55d696e546d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e99370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e998b0 0x55d696eb9c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa05968ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d696d64520 con 0x55d696e54c10 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa05968ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d696d60250 con 0x55d696e54300 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa05968ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d696d5a3b0 con 0x55d696e998b0 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa054c04640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e99370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa054c04640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e99370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46590/0 (socket says 10.20.193.4:46590) 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa054c04640 1 -- 10.20.193.4:0/3025666964 learned_addr learned my addr 10.20.193.4:0/3025666964 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa054c04640 1 -- 10.20.193.4:0/3025666964 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e998b0 msgr2=0x55d696eb9c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa054c04640 1 --2- 10.20.193.4:0/3025666964 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e998b0 0x55d696eb9c90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa054c04640 1 -- 10.20.193.4:0/3025666964 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e54300 msgr2=0x55d696e546d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:11:01.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa054c04640 1 --2- 10.20.193.4:0/3025666964 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e54300 0x55d696e546d0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.371+0000 7fa054c04640 1 -- 10.20.193.4:0/3025666964 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d696d056e0 con 0x55d696e54c10 2026-02-24T09:11:01.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa054c04640 1 --2- 10.20.193.4:0/3025666964 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e99370 secure :-1 s=READY pgs=557 gs=1 cs=0 l=1 c_cookie=66588218717896648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa040002780 tx=0x7fa040002c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec91a1d2e7ffc8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa01dce5640 1 -- 10.20.193.4:0/3025666964 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa040009d30 con 0x55d696e54c10 2026-02-24T09:11:01.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa01dce5640 1 -- 10.20.193.4:0/3025666964 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa040009e90 con 0x55d696e54c10 2026-02-24T09:11:01.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa01dce5640 1 -- 10.20.193.4:0/3025666964 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa0400118a0 con 0x55d696e54c10 2026-02-24T09:11:01.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa05968ae00 1 -- 10.20.193.4:0/3025666964 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 msgr2=0x55d696e99370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa05968ae00 1 --2- 10.20.193.4:0/3025666964 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e99370 secure :-1 s=READY pgs=557 gs=1 cs=0 l=1 c_cookie=66588218717896648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa040002780 tx=0x7fa040002c50 comp rx=0 tx=0).stop 2026-02-24T09:11:01.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa05968ae00 1 -- 10.20.193.4:0/3025666964 shutdown_connections 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa05968ae00 1 --2- 10.20.193.4:0/3025666964 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e998b0 0x55d696eb9c90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa05968ae00 1 --2- 10.20.193.4:0/3025666964 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e99370 unknown :-1 s=CLOSED pgs=557 gs=1 cs=0 l=1 c_cookie=66588218717896648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa05968ae00 1 --2- 10.20.193.4:0/3025666964 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e54300 0x55d696e546d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa05968ae00 1 -- 10.20.193.4:0/3025666964 >> 10.20.193.4:0/3025666964 conn(0x55d696d724f0 msgr2=0x55d696e52be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.372+0000 7fa05968ae00 1 -- 10.20.193.4:0/3025666964 shutdown_connections 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.373+0000 7fa05968ae00 1 -- 10.20.193.4:0/3025666964 wait complete. 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa05968ae00 1 -- start start 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa05968ae00 1 Processor -- start 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54300 0x55d696e6c4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e6ca10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e998b0 0x55d696e71a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa05968ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d696e71f40 con 0x55d696e54c10 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa05968ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d696e720b0 con 0x55d696e998b0 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa05968ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d696e72270 con 0x55d696e54300 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa054c04640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e6ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa054c04640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e6ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46592/0 (socket says 10.20.193.4:46592) 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa054c04640 1 -- 10.20.193.4:0/3601066702 learned_addr learned my addr 10.20.193.4:0/3601066702 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa055405640 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54300 0x55d696e6c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.374+0000 7fa055c06640 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e998b0 0x55d696e71a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa054c04640 1 -- 10.20.193.4:0/3601066702 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54300 msgr2=0x55d696e6c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa054c04640 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54300 0x55d696e6c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa054c04640 1 -- 10.20.193.4:0/3601066702 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e998b0 msgr2=0x55d696e71a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa054c04640 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e998b0 0x55d696e71a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa054c04640 1 -- 10.20.193.4:0/3601066702 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d696cddcd0 con 0x55d696e54c10 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa054c04640 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e6ca10 secure :-1 s=READY pgs=558 gs=1 cs=0 l=1 c_cookie=12565546392582616545 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0400045f0 tx=0x7fa0400116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae61c9de7293f5e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa00affd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa00affd640 1 -- 10.20.193.4:0/3601066702 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa040011e60 con 0x55d696e54c10 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa05968ae00 1 -- 10.20.193.4:0/3601066702 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa040004350 con 0x55d696e54c10 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa05968ae00 10 client.15894 _ll_register_callbacks cb 0x55d696cd6790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa00affd640 1 -- 10.20.193.4:0/3601066702 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa040012e20 con 0x55d696e54c10 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa00affd640 1 -- 10.20.193.4:0/3601066702 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa040025b30 con 0x55d696e54c10 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa05968ae00 1 -- 10.20.193.4:0/3601066702 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d6969e79d0 con 0x55d696e54c10 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa00affd640 1 -- 10.20.193.4:0/3601066702 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fa04001b420 con 0x55d696e54c10 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa00affd640 1 -- 10.20.193.4:0/3601066702 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa04001b640 con 0x55d696e54c10 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa05968ae00 10 client.15894 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:01.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.375+0000 7fa05968ae00 1 -- 10.20.193.4:0/3601066702 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d696cefab0 con 0x55d696e54c10 2026-02-24T09:11:01.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.376+0000 7fa00affd640 1 -- 10.20.193.4:0/3601066702 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa040011070 con 0x55d696e54c10 2026-02-24T09:11:01.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.376+0000 7fa05968ae00 10 client.15894 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:01.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.376+0000 7fa05968ae00 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:01.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.376+0000 7fa05968ae00 20 client.15894 populate_metadata read hostname 'trial004' 2026-02-24T09:11:01.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.376+0000 7fa05968ae00 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d696e96b60 0x55d696e97000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.376+0000 7fa05968ae00 4 client.15894 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:01.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.376+0000 7fa05968ae00 1 -- 10.20.193.4:0/3601066702 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d696d6ab70 con 0x55d696e96b60 2026-02-24T09:11:01.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.376+0000 7fa055405640 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d696e96b60 0x55d696e97000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.376+0000 7fa055405640 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d696e96b60 0x55d696e97000 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=4848227740836258540 s_cookie=7188073214580882139 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43485d717abd62ec server_cookie=63c12a812e97fadb in_seq=0 out_seq=0 2026-02-24T09:11:01.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.376+0000 7fa00affd640 10 client.15894 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:01.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa00affd640 1 -- 10.20.193.4:0/3601066702 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d696d6ab70 con 0x55d696e96b60 2026-02-24T09:11:01.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa00affd640 10 client.15894 handle_command_reply: tid=0 2026-02-24T09:11:01.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 client.15894 shutdown 2026-02-24T09:11:01.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 -- 10.20.193.4:0/3601066702 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 msgr2=0x55d696e6ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e6ca10 secure :-1 s=READY pgs=558 gs=1 cs=0 l=1 c_cookie=12565546392582616545 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0400045f0 tx=0x7fa0400116c0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 -- 10.20.193.4:0/3601066702 shutdown_connections 2026-02-24T09:11:01.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d696e96b60 0x55d696e97000 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=4848227740836258540 s_cookie=7188073214580882139 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e998b0 0x55d696e71a00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54c10 0x55d696e6ca10 unknown :-1 s=CLOSED pgs=558 gs=1 cs=0 l=1 c_cookie=12565546392582616545 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 --2- 10.20.193.4:0/3601066702 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54300 0x55d696e6c4d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa00affd640 0 client.15894 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:01.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 -- 10.20.193.4:0/3601066702 >> 10.20.193.4:0/3601066702 conn(0x55d696d724f0 msgr2=0x55d696e532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 -- 10.20.193.4:0/3601066702 shutdown_connections 2026-02-24T09:11:01.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.377+0000 7fa05968ae00 1 -- 10.20.193.4:0/3601066702 wait complete. 2026-02-24T09:11:01.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.378+0000 7fa05968ae00 20 client.15894 trim_cache size 0 max 16384 2026-02-24T09:11:01.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.396+0000 7fa05968ae00 1 Processor -- start 2026-02-24T09:11:01.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.396+0000 7fa05968ae00 1 -- start start 2026-02-24T09:11:01.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.396+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54300 0x55d696e988f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.396+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 0x55d696e98e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.396+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e998b0 0x55d696e99370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.396+0000 7fa05968ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d696d57fe0 con 0x55d696e54300 2026-02-24T09:11:01.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.396+0000 7fa05968ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d696a22fe0 con 0x55d696e998b0 2026-02-24T09:11:01.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.396+0000 7fa05968ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d696e71b10 con 0x55d696e54c10 2026-02-24T09:11:01.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa054c04640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 0x55d696e98e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa054c04640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 0x55d696e98e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:56764/0 (socket says 10.20.193.4:56764) 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa054c04640 1 -- 10.20.193.4:0/2360739653 learned_addr learned my addr 10.20.193.4:0/2360739653 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa055405640 1 --2- 10.20.193.4:0/2360739653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54300 0x55d696e988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa055c06640 1 --2- 10.20.193.4:0/2360739653 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e998b0 0x55d696e99370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa054c04640 1 -- 10.20.193.4:0/2360739653 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e998b0 msgr2=0x55d696e99370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa054c04640 1 --2- 10.20.193.4:0/2360739653 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e998b0 0x55d696e99370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa054c04640 1 -- 10.20.193.4:0/2360739653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54300 msgr2=0x55d696e988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa054c04640 1 --2- 10.20.193.4:0/2360739653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54300 0x55d696e988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa054c04640 1 -- 10.20.193.4:0/2360739653 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d696cea530 con 0x55d696e54c10 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa054c04640 1 --2- 10.20.193.4:0/2360739653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 0x55d696e98e30 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=12235810409059447040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa04002eea0 tx=0x7fa04002d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9ce54bd2b03f100 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa01d4e4640 1 -- 10.20.193.4:0/2360739653 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa040009190 con 0x55d696e54c10 2026-02-24T09:11:01.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa01d4e4640 1 -- 10.20.193.4:0/2360739653 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d6969e79d0 con 0x55d696e54c10 2026-02-24T09:11:01.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.397+0000 7fa01d4e4640 1 -- 10.20.193.4:0/2360739653 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa040024c50 con 0x55d696e54c10 2026-02-24T09:11:01.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.399+0000 7fa05968ae00 1 -- 10.20.193.4:0/2360739653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 msgr2=0x55d696e98e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.399+0000 7fa05968ae00 1 --2- 10.20.193.4:0/2360739653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 0x55d696e98e30 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=12235810409059447040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa04002eea0 tx=0x7fa04002d000 comp rx=0 tx=0).stop 2026-02-24T09:11:01.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.399+0000 7fa05968ae00 1 -- 10.20.193.4:0/2360739653 shutdown_connections 2026-02-24T09:11:01.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.399+0000 7fa05968ae00 1 --2- 10.20.193.4:0/2360739653 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e998b0 0x55d696e99370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.399+0000 7fa05968ae00 1 --2- 10.20.193.4:0/2360739653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 0x55d696e98e30 unknown :-1 s=CLOSED pgs=92 gs=2 cs=0 l=1 c_cookie=12235810409059447040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.399+0000 7fa05968ae00 1 --2- 10.20.193.4:0/2360739653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e54300 0x55d696e988f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.399+0000 7fa05968ae00 1 -- 10.20.193.4:0/2360739653 >> 10.20.193.4:0/2360739653 conn(0x55d696d724f0 msgr2=0x55d696e68a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.399+0000 7fa05968ae00 1 -- 10.20.193.4:0/2360739653 shutdown_connections 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.399+0000 7fa05968ae00 1 -- 10.20.193.4:0/2360739653 wait complete. 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa05968ae00 1 -- start start 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa05968ae00 1 Processor -- start 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e54300 0x55d696e78090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 0x55d696e74580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa05968ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e998b0 0x55d696e74ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa05968ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d696e786d0 con 0x55d696e998b0 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa05968ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d696e78840 con 0x55d696e54300 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa05968ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d696e75000 con 0x55d696e54c10 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa055c06640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e998b0 0x55d696e74ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa055405640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e54300 0x55d696e78090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa055c06640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e998b0 0x55d696e74ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46602/0 (socket says 10.20.193.4:46602) 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa055c06640 1 -- 10.20.193.4:0/1170768208 learned_addr learned my addr 10.20.193.4:0/1170768208 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa054c04640 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 0x55d696e74580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa055c06640 1 -- 10.20.193.4:0/1170768208 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 msgr2=0x55d696e74580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa055c06640 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 0x55d696e74580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa055c06640 1 -- 10.20.193.4:0/1170768208 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e54300 msgr2=0x55d696e78090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa055c06640 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e54300 0x55d696e78090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa055c06640 1 -- 10.20.193.4:0/1170768208 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d696cde000 con 0x55d696e998b0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.400+0000 7fa055405640 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e54300 0x55d696e78090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa055c06640 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e998b0 0x55d696e74ac0 secure :-1 s=READY pgs=559 gs=1 cs=0 l=1 c_cookie=931938120720331360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa04c00a4e0 tx=0x7fa04c0aa5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceee8c87e2e3260 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa00affd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa00affd640 1 -- 10.20.193.4:0/1170768208 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa04c0add60 con 0x55d696e998b0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 1 -- 10.20.193.4:0/1170768208 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d696cefab0 con 0x55d696e998b0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 10 client.15900 _ll_register_callbacks cb 0x55d696cd6790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa00affd640 1 -- 10.20.193.4:0/1170768208 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa04c06ce90 con 0x55d696e998b0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa00affd640 1 -- 10.20.193.4:0/1170768208 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa04c0aeeb0 con 0x55d696e998b0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 1 -- 10.20.193.4:0/1170768208 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d696d6c7e0 con 0x55d696e998b0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa00affd640 1 -- 10.20.193.4:0/1170768208 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(77..77 src has 1..77) ==== 8246+0+0 (secure 0 0 0) 0x7fa04c0732c0 con 0x55d696e998b0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa00affd640 1 -- 10.20.193.4:0/1170768208 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa04c0abf80 con 0x55d696e998b0 2026-02-24T09:11:01.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 10 client.15900 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 1 -- 10.20.193.4:0/1170768208 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d696cefd10 con 0x55d696e998b0 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa00affd640 1 -- 10.20.193.4:0/1170768208 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa04c0af990 con 0x55d696e998b0 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 10 client.15900 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 20 client.15900 populate_metadata read hostname 'trial004' 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d696f47950 0x55d696f67e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 4 client.15900 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.401+0000 7fa05968ae00 1 -- 10.20.193.4:0/1170768208 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d6969e5220 con 0x55d696f47950 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.402+0000 7fa055405640 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d696f47950 0x55d696f67e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.402+0000 7fa00affd640 10 client.15900 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:01.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.402+0000 7fa055405640 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d696f47950 0x55d696f67e00 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=10695939958502874183 s_cookie=13750530672201719964 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=946f9cb905785c47 server_cookie=bed3b2cafdb2609c in_seq=0 out_seq=0 2026-02-24T09:11:01.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa00affd640 1 -- 10.20.193.4:0/1170768208 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d6969e5220 con 0x55d696f47950 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa00affd640 10 client.15900 handle_command_reply: tid=0 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 client.15900 shutdown 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 -- 10.20.193.4:0/1170768208 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e998b0 msgr2=0x55d696e74ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e998b0 0x55d696e74ac0 secure :-1 s=READY pgs=559 gs=1 cs=0 l=1 c_cookie=931938120720331360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa04c00a4e0 tx=0x7fa04c0aa5f0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 -- 10.20.193.4:0/1170768208 shutdown_connections 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d696f47950 0x55d696f67e00 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=10695939958502874183 s_cookie=13750530672201719964 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d696e998b0 0x55d696e74ac0 unknown :-1 s=CLOSED pgs=559 gs=1 cs=0 l=1 c_cookie=931938120720331360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d696e54c10 0x55d696e74580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 --2- 10.20.193.4:0/1170768208 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d696e54300 0x55d696e78090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa00affd640 0 client.15900 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:01.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 -- 10.20.193.4:0/1170768208 >> 10.20.193.4:0/1170768208 conn(0x55d696d724f0 msgr2=0x55d696e69280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 -- 10.20.193.4:0/1170768208 shutdown_connections 2026-02-24T09:11:01.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 1 -- 10.20.193.4:0/1170768208 wait complete. 2026-02-24T09:11:01.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.404+0000 7fa05968ae00 20 client.15900 trim_cache size 0 max 16384 2026-02-24T09:11:01.413 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:11:01.413 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:11:01.413 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "7814ad38-6799-499f-8516-f4981ab6b146", 2026-02-24T09:11:01.413 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:11:01.414 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:11:01.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 -- 10.20.193.4:0/3076424467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa02c0b5770 msgr2=0x7fa02c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa02c0b5770 0x7fa02c0d5c20 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa038005b30 tx=0x7fa03803a040 comp rx=0 tx=0).stop 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 -- 10.20.193.4:0/3076424467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa050115470 msgr2=0x7fa050063830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa050115470 0x7fa050063830 secure :-1 s=READY pgs=556 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa04c00f8d0 tx=0x7fa04c00fda0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 -- 10.20.193.4:0/3076424467 shutdown_connections 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa02c0b5770 0x7fa02c0d5c20 unknown :-1 s=CLOSED pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa050115470 0x7fa050063830 unknown :-1 s=CLOSED pgs=556 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa05010fc70 0x7fa0500631d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 --2- 10.20.193.4:0/3076424467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa05010f280 0x7fa050066f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 -- 10.20.193.4:0/3076424467 >> 10.20.193.4:0/3076424467 conn(0x7fa05005f830 msgr2=0x7fa05010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 -- 10.20.193.4:0/3076424467 shutdown_connections 2026-02-24T09:11:01.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.405+0000 7fa057690640 1 -- 10.20.193.4:0/3076424467 wait complete. 2026-02-24T09:11:01.479 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:11:01.720 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:01.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 -- 10.20.193.4:0/280196662 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f268810f650 msgr2=0x7f268810fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 --2- 10.20.193.4:0/280196662 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f268810f650 0x7f268810fa20 secure :-1 s=READY pgs=560 gs=1 cs=0 l=1 c_cookie=9177975496491042022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2674009950 tx=0x7f267402f1b0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 -- 10.20.193.4:0/280196662 shutdown_connections 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 --2- 10.20.193.4:0/280196662 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2688115840 0x7f2688176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 --2- 10.20.193.4:0/280196662 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2688110040 0x7f2688115090 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 --2- 10.20.193.4:0/280196662 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f268810f650 0x7f268810fa20 unknown :-1 s=CLOSED pgs=560 gs=1 cs=0 l=1 c_cookie=9177975496491042022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 -- 10.20.193.4:0/280196662 >> 10.20.193.4:0/280196662 conn(0x7f26880ecf20 msgr2=0x7f268810d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 -- 10.20.193.4:0/280196662 shutdown_connections 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 -- 10.20.193.4:0/280196662 wait complete. 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 Processor -- start 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.904+0000 7f268e968640 1 -- start start 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268e968640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f268810f650 0x7f268811df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268e968640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2688110040 0x7f268811e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268e968640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2688115840 0x7f2688123810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268e968640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2688123e30 con 0x7f2688115840 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268e968640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2688123fa0 con 0x7f268810f650 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268e968640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2688124160 con 0x7f2688110040 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268cede640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2688115840 0x7f2688123810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268cede640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2688115840 0x7f2688123810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46626/0 (socket says 10.20.193.4:46626) 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268cede640 1 -- 10.20.193.4:0/1894113117 learned_addr learned my addr 10.20.193.4:0/1894113117 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f26877fe640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2688110040 0x7f268811e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f2687fff640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f268810f650 0x7f268811df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268cede640 1 -- 10.20.193.4:0/1894113117 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2688110040 msgr2=0x7f268811e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268cede640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2688110040 0x7f268811e440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268cede640 1 -- 10.20.193.4:0/1894113117 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f268810f650 msgr2=0x7f268811df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268cede640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f268810f650 0x7f268811df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268cede640 1 -- 10.20.193.4:0/1894113117 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2674009570 con 0x7f2688115840 2026-02-24T09:11:01.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268cede640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2688115840 0x7f2688123810 secure :-1 s=READY pgs=561 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267c006e90 tx=0x7f267c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f26857fa640 1 -- 10.20.193.4:0/1894113117 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f267c005500 con 0x7f2688115840 2026-02-24T09:11:01.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f26857fa640 1 -- 10.20.193.4:0/1894113117 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f267c005e10 con 0x7f2688115840 2026-02-24T09:11:01.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268e968640 1 -- 10.20.193.4:0/1894113117 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2688124440 con 0x7f2688115840 2026-02-24T09:11:01.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f26857fa640 1 -- 10.20.193.4:0/1894113117 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f267c003a90 con 0x7f2688115840 2026-02-24T09:11:01.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.905+0000 7f268e968640 1 -- 10.20.193.4:0/1894113117 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2688063320 con 0x7f2688115840 2026-02-24T09:11:01.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.912+0000 7f2690962e00 1 Processor -- start 2026-02-24T09:11:01.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.913+0000 7f26857fa640 1 -- 10.20.193.4:0/1894113117 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 17) ==== 157172+0+0 (secure 0 0 0) 0x7f267c00c840 con 0x7f2688115840 2026-02-24T09:11:01.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f2690962e00 1 -- start start 2026-02-24T09:11:01.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f2690962e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 0x55f9b5421bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f2690962e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5466890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f2690962e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 0x55f9b54871b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f2690962e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f9b5331de0 con 0x55f9b5466dd0 2026-02-24T09:11:01.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f2690962e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f9b532db10 con 0x55f9b5422130 2026-02-24T09:11:01.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f2690962e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f9b5327ab0 con 0x55f9b5421820 2026-02-24T09:11:01.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26877fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 0x55f9b5421bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26877fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 0x55f9b5421bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:56786/0 (socket says 10.20.193.4:56786) 2026-02-24T09:11:01.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26877fe640 1 -- 10.20.193.4:0/1909960957 learned_addr learned my addr 10.20.193.4:0/1909960957 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:01.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f2687fff640 1 --2- 10.20.193.4:0/1909960957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5466890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26877fe640 1 --2- 10.20.193.4:0/1909960957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 0x55f9b54871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26857fa640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f265c0b5770 0x7f265c0d5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26877fe640 1 -- 10.20.193.4:0/1909960957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 msgr2=0x55f9b5466890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26877fe640 1 --2- 10.20.193.4:0/1909960957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5466890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26877fe640 1 -- 10.20.193.4:0/1909960957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 msgr2=0x55f9b54871b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26877fe640 1 --2- 10.20.193.4:0/1909960957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 0x55f9b54871b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26877fe640 1 -- 10.20.193.4:0/1909960957 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b52d3310 con 0x55f9b5421820 2026-02-24T09:11:01.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f26857fa640 1 -- 10.20.193.4:0/1894113117 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8304+0+0 (secure 0 0 0) 0x7f267c0e7b20 con 0x7f2688115840 2026-02-24T09:11:01.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.914+0000 7f268cede640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f265c0b5770 0x7f265c0d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.915+0000 7f26877fe640 1 --2- 10.20.193.4:0/1909960957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 0x55f9b5421bf0 secure :-1 s=READY pgs=93 gs=3 cs=0 l=1 c_cookie=8795510061721741749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2678016520 tx=0x7f267800a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a0fedccef4c69b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.915+0000 7f2658ce3640 1 -- 10.20.193.4:0/1909960957 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26780042f0 con 0x55f9b5421820 2026-02-24T09:11:01.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.915+0000 7f2658ce3640 1 -- 10.20.193.4:0/1909960957 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f267800c070 con 0x55f9b5421820 2026-02-24T09:11:01.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.915+0000 7f2658ce3640 1 -- 10.20.193.4:0/1909960957 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26780176f0 con 0x55f9b5421820 2026-02-24T09:11:01.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.916+0000 7f2690962e00 1 -- 10.20.193.4:0/1909960957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 msgr2=0x55f9b5421bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.916+0000 7f268cede640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f265c0b5770 0x7f265c0d5c20 secure :-1 s=READY pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267c00cb80 tx=0x7f267c006b00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.916+0000 7f2690962e00 1 --2- 10.20.193.4:0/1909960957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 0x55f9b5421bf0 secure :-1 s=READY pgs=93 gs=3 cs=0 l=1 c_cookie=8795510061721741749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2678016520 tx=0x7f267800a340 comp rx=0 tx=0).stop 2026-02-24T09:11:01.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.916+0000 7f2690962e00 1 -- 10.20.193.4:0/1909960957 shutdown_connections 2026-02-24T09:11:01.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.916+0000 7f2690962e00 1 --2- 10.20.193.4:0/1909960957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 0x55f9b54871b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.916+0000 7f2690962e00 1 --2- 10.20.193.4:0/1909960957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5466890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.916+0000 7f2690962e00 1 --2- 10.20.193.4:0/1909960957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 0x55f9b5421bf0 unknown :-1 s=CLOSED pgs=93 gs=3 cs=0 l=1 c_cookie=8795510061721741749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.916+0000 7f2690962e00 1 -- 10.20.193.4:0/1909960957 >> 10.20.193.4:0/1909960957 conn(0x55f9b53406b0 msgr2=0x55f9b5420100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.916+0000 7f2690962e00 1 -- 10.20.193.4:0/1909960957 shutdown_connections 2026-02-24T09:11:01.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.916+0000 7f2690962e00 1 -- 10.20.193.4:0/1909960957 wait complete. 2026-02-24T09:11:01.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2690962e00 1 -- start start 2026-02-24T09:11:01.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2690962e00 1 Processor -- start 2026-02-24T09:11:01.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2690962e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5421820 0x55f9b5439de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2690962e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5422130 0x55f9b543a320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2690962e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5466dd0 0x55f9b543f310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2690962e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f9b543f850 con 0x55f9b5422130 2026-02-24T09:11:01.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2690962e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f9b543f9c0 con 0x55f9b5421820 2026-02-24T09:11:01.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2690962e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f9b543fb80 con 0x55f9b5466dd0 2026-02-24T09:11:01.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2687fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5422130 0x55f9b543a320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2687fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5422130 0x55f9b543a320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46652/0 (socket says 10.20.193.4:46652) 2026-02-24T09:11:01.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.918+0000 7f2687fff640 1 -- 10.20.193.4:0/4256871924 learned_addr learned my addr 10.20.193.4:0/4256871924 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:01.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f26877fe640 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5466dd0 0x55f9b543f310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f26877fe640 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5421820 0x55f9b5439de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f2687fff640 1 -- 10.20.193.4:0/4256871924 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5466dd0 msgr2=0x55f9b543f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f2687fff640 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5466dd0 0x55f9b543f310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f2687fff640 1 -- 10.20.193.4:0/4256871924 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5421820 msgr2=0x55f9b5439de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f2687fff640 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5421820 0x55f9b5439de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f2687fff640 1 -- 10.20.193.4:0/4256871924 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b52ab8c0 con 0x55f9b5422130 2026-02-24T09:11:01.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f2687fff640 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5422130 0x55f9b543a320 secure :-1 s=READY pgs=562 gs=1 cs=0 l=1 c_cookie=13103053858848929879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2674004820 tx=0x7f26740386a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d7660fc9807857 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f2649ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:01.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f2649ffb640 1 -- 10.20.193.4:0/4256871924 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26740028c0 con 0x55f9b5422130 2026-02-24T09:11:01.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f2649ffb640 1 -- 10.20.193.4:0/4256871924 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26740043b0 con 0x55f9b5422130 2026-02-24T09:11:01.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.919+0000 7f2649ffb640 1 -- 10.20.193.4:0/4256871924 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2674044770 con 0x55f9b5422130 2026-02-24T09:11:01.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.920+0000 7f2690962e00 1 -- 10.20.193.4:0/4256871924 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267800e040 con 0x55f9b5422130 2026-02-24T09:11:01.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.920+0000 7f2690962e00 10 client.15912 _ll_register_callbacks cb 0x55f9b52c3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:01.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.920+0000 7f2690962e00 1 -- 10.20.193.4:0/4256871924 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f9b50774a0 con 0x55f9b5422130 2026-02-24T09:11:01.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.920+0000 7f2649ffb640 1 -- 10.20.193.4:0/4256871924 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 8304+0+0 (secure 0 0 0) 0x7f2674002a20 con 0x55f9b5422130 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.920+0000 7f2649ffb640 1 -- 10.20.193.4:0/4256871924 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f267402fa10 con 0x55f9b5422130 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.920+0000 7f2690962e00 10 client.15912 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.920+0000 7f2690962e00 1 -- 10.20.193.4:0/4256871924 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f9b52bd6e0 con 0x55f9b5422130 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.921+0000 7f2649ffb640 1 -- 10.20.193.4:0/4256871924 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2674043070 con 0x55f9b5422130 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.921+0000 7f2690962e00 10 client.15912 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.921+0000 7f2690962e00 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.921+0000 7f2690962e00 20 client.15912 populate_metadata read hostname 'trial004' 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.921+0000 7f2690962e00 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f9b54646b0 0x55f9b5464b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.921+0000 7f2690962e00 4 client.15912 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.921+0000 7f2690962e00 1 -- 10.20.193.4:0/4256871924 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9b531d4f0 con 0x55f9b54646b0 2026-02-24T09:11:01.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.921+0000 7f26877fe640 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f9b54646b0 0x55f9b5464b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.922+0000 7f2649ffb640 10 client.15912 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.922+0000 7f26877fe640 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f9b54646b0 0x55f9b5464b50 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=6257638258277733496 s_cookie=13816832444424175947 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56d798d76d89d478 server_cookie=bfbf3fe74afec14b in_seq=0 out_seq=0 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.922+0000 7f2649ffb640 1 -- 10.20.193.4:0/4256871924 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f9b531d4f0 con 0x55f9b54646b0 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.922+0000 7f2649ffb640 10 client.15912 handle_command_reply: tid=0 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.922+0000 7f2690962e00 1 client.15912 shutdown 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 1 -- 10.20.193.4:0/4256871924 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5422130 msgr2=0x55f9b543a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5422130 0x55f9b543a320 secure :-1 s=READY pgs=562 gs=1 cs=0 l=1 c_cookie=13103053858848929879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2674004820 tx=0x7f26740386a0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 1 -- 10.20.193.4:0/4256871924 shutdown_connections 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f9b54646b0 0x55f9b5464b50 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=6257638258277733496 s_cookie=13816832444424175947 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5466dd0 0x55f9b543f310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5422130 0x55f9b543a320 unknown :-1 s=CLOSED pgs=562 gs=1 cs=0 l=1 c_cookie=13103053858848929879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 1 --2- 10.20.193.4:0/4256871924 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5421820 0x55f9b5439de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2649ffb640 0 client.15912 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:01.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 1 -- 10.20.193.4:0/4256871924 >> 10.20.193.4:0/4256871924 conn(0x55f9b53406b0 msgr2=0x55f9b5420810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 1 -- 10.20.193.4:0/4256871924 shutdown_connections 2026-02-24T09:11:01.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 1 -- 10.20.193.4:0/4256871924 wait complete. 2026-02-24T09:11:01.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.923+0000 7f2690962e00 20 client.15912 trim_cache size 0 max 16384 2026-02-24T09:11:01.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.937+0000 7f2690962e00 1 Processor -- start 2026-02-24T09:11:01.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.937+0000 7f2690962e00 1 -- start start 2026-02-24T09:11:01.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f2690962e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 0x55f9b542bb10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f2690962e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5466440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f2690962e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 0x55f9b5420a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f2690962e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f9b53256e0 con 0x55f9b5466dd0 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f2690962e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f9b4ff0f50 con 0x55f9b5422130 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f2690962e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f9b53e2620 con 0x55f9b5421820 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f26877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 0x55f9b5420a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f26877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 0x55f9b5420a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46668/0 (socket says 10.20.193.4:46668) 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f26877fe640 1 -- 10.20.193.4:0/1405720705 learned_addr learned my addr 10.20.193.4:0/1405720705 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f2687fff640 1 --2- 10.20.193.4:0/1405720705 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5466440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f26877fe640 1 --2- 10.20.193.4:0/1405720705 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 0x55f9b542bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f26877fe640 1 -- 10.20.193.4:0/1405720705 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 msgr2=0x55f9b542bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f26877fe640 1 --2- 10.20.193.4:0/1405720705 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 0x55f9b542bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f26877fe640 1 -- 10.20.193.4:0/1405720705 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 msgr2=0x55f9b5466440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f26877fe640 1 --2- 10.20.193.4:0/1405720705 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5466440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f26877fe640 1 -- 10.20.193.4:0/1405720705 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b542c2e0 con 0x55f9b5466dd0 2026-02-24T09:11:01.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f26877fe640 1 --2- 10.20.193.4:0/1405720705 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 0x55f9b5420a10 secure :-1 s=READY pgs=563 gs=1 cs=0 l=1 c_cookie=3598173218227031918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55f9b5465400 tx=0x7f267800aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ef477a60bf0f6e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f264bfff640 1 -- 10.20.193.4:0/1405720705 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2678002740 con 0x55f9b5466dd0 2026-02-24T09:11:01.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f264bfff640 1 -- 10.20.193.4:0/1405720705 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2678030070 con 0x55f9b5466dd0 2026-02-24T09:11:01.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.938+0000 7f264bfff640 1 -- 10.20.193.4:0/1405720705 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2678018740 con 0x55f9b5466dd0 2026-02-24T09:11:01.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.939+0000 7f2690962e00 1 -- 10.20.193.4:0/1405720705 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 msgr2=0x55f9b5420a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.939+0000 7f2690962e00 1 --2- 10.20.193.4:0/1405720705 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 0x55f9b5420a10 secure :-1 s=READY pgs=563 gs=1 cs=0 l=1 c_cookie=3598173218227031918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55f9b5465400 tx=0x7f267800aab0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.939+0000 7f2690962e00 1 -- 10.20.193.4:0/1405720705 shutdown_connections 2026-02-24T09:11:01.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.939+0000 7f2690962e00 1 --2- 10.20.193.4:0/1405720705 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5466dd0 0x55f9b5420a10 unknown :-1 s=CLOSED pgs=563 gs=1 cs=0 l=1 c_cookie=3598173218227031918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.939+0000 7f2690962e00 1 --2- 10.20.193.4:0/1405720705 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5466440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.939+0000 7f2690962e00 1 --2- 10.20.193.4:0/1405720705 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5421820 0x55f9b542bb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.939+0000 7f2690962e00 1 -- 10.20.193.4:0/1405720705 >> 10.20.193.4:0/1405720705 conn(0x55f9b53406b0 msgr2=0x55f9b54387b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.939+0000 7f2690962e00 1 -- 10.20.193.4:0/1405720705 shutdown_connections 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.939+0000 7f2690962e00 1 -- 10.20.193.4:0/1405720705 wait complete. 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f2690962e00 1 -- start start 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f2690962e00 1 Processor -- start 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f2690962e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5421820 0x55f9b54455d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f2690962e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5445b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f2690962e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5466dd0 0x55f9b54442f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f2690962e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f9b5460ed0 con 0x55f9b5421820 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f2690962e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f9b5446180 con 0x55f9b5422130 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f2690962e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f9b5444830 con 0x55f9b5466dd0 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f26877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5421820 0x55f9b54455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f26877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5421820 0x55f9b54455d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46672/0 (socket says 10.20.193.4:46672) 2026-02-24T09:11:01.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f26877fe640 1 -- 10.20.193.4:0/1536518713 learned_addr learned my addr 10.20.193.4:0/1536518713 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.940+0000 7f2687fff640 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5445b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f26877fe640 1 -- 10.20.193.4:0/1536518713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5466dd0 msgr2=0x55f9b54442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f26877fe640 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5466dd0 0x55f9b54442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f26877fe640 1 -- 10.20.193.4:0/1536518713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 msgr2=0x55f9b5445b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f26877fe640 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5445b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f26877fe640 1 -- 10.20.193.4:0/1536518713 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b52b8160 con 0x55f9b5421820 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f26877fe640 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5421820 0x55f9b54455d0 secure :-1 s=READY pgs=564 gs=1 cs=0 l=1 c_cookie=14216705163528995060 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2678004610 tx=0x7f267800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54be205dc9b80f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2649ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2649ffb640 1 -- 10.20.193.4:0/1536518713 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2678004430 con 0x55f9b5421820 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2649ffb640 1 -- 10.20.193.4:0/1536518713 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2678002c20 con 0x55f9b5421820 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2690962e00 1 -- 10.20.193.4:0/1536518713 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b52d3310 con 0x55f9b5421820 2026-02-24T09:11:01.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2649ffb640 1 -- 10.20.193.4:0/1536518713 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2678018dc0 con 0x55f9b5421820 2026-02-24T09:11:01.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2690962e00 10 client.15918 _ll_register_callbacks cb 0x55f9b52c3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:01.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2690962e00 1 -- 10.20.193.4:0/1536518713 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f9b4fb2f40 con 0x55f9b5421820 2026-02-24T09:11:01.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2649ffb640 1 -- 10.20.193.4:0/1536518713 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(78..78 src has 1..78) ==== 8304+0+0 (secure 0 0 0) 0x7f267802a600 con 0x55f9b5421820 2026-02-24T09:11:01.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2649ffb640 1 -- 10.20.193.4:0/1536518713 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f267802a7c0 con 0x55f9b5421820 2026-02-24T09:11:01.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2690962e00 10 client.15918 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:01.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.941+0000 7f2690962e00 1 -- 10.20.193.4:0/1536518713 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f9b52abbf0 con 0x55f9b5421820 2026-02-24T09:11:01.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2649ffb640 1 -- 10.20.193.4:0/1536518713 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2678024040 con 0x55f9b5421820 2026-02-24T09:11:01.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2690962e00 10 client.15918 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:01.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2690962e00 10 client.15918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:01.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2690962e00 20 client.15918 populate_metadata read hostname 'trial004' 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2690962e00 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f9b5514580 0x55f9b5534a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2690962e00 4 client.15918 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2690962e00 1 -- 10.20.193.4:0/1536518713 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f267800c070 con 0x55f9b5514580 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2687fff640 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f9b5514580 0x55f9b5534a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2687fff640 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f9b5514580 0x55f9b5534a30 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=4296317362695845503 s_cookie=6506152153977704667 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b9f95e0e5d4367f server_cookie=5a4a7ee9b87bd0db in_seq=0 out_seq=0 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2649ffb640 10 client.15918 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2649ffb640 1 -- 10.20.193.4:0/1536518713 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x7f267800c070 con 0x55f9b5514580 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2649ffb640 10 client.15918 handle_command_reply: tid=0 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2690962e00 1 client.15918 shutdown 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2690962e00 1 -- 10.20.193.4:0/1536518713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5421820 msgr2=0x55f9b54455d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.942+0000 7f2690962e00 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5421820 0x55f9b54455d0 secure :-1 s=READY pgs=564 gs=1 cs=0 l=1 c_cookie=14216705163528995060 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2678004610 tx=0x7f267800a900 comp rx=0 tx=0).stop 2026-02-24T09:11:01.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f2690962e00 1 -- 10.20.193.4:0/1536518713 shutdown_connections 2026-02-24T09:11:01.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f2690962e00 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f9b5514580 0x55f9b5534a30 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=4296317362695845503 s_cookie=6506152153977704667 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f2690962e00 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f9b5466dd0 0x55f9b54442f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f2690962e00 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f9b5422130 0x55f9b5445b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f2649ffb640 0 client.15918 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:01.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f2690962e00 1 --2- 10.20.193.4:0/1536518713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f9b5421820 0x55f9b54455d0 unknown :-1 s=CLOSED pgs=564 gs=1 cs=0 l=1 c_cookie=14216705163528995060 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f2690962e00 1 -- 10.20.193.4:0/1536518713 >> 10.20.193.4:0/1536518713 conn(0x55f9b53406b0 msgr2=0x55f9b5465430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f2690962e00 1 -- 10.20.193.4:0/1536518713 shutdown_connections 2026-02-24T09:11:01.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f2690962e00 1 -- 10.20.193.4:0/1536518713 wait complete. 2026-02-24T09:11:01.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f2690962e00 20 client.15918 trim_cache size 0 max 16384 2026-02-24T09:11:01.955 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:11:01.955 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:11:01.955 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:11:01.955 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:11:01.955 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:01.955 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "7814ad38-6799-499f-8516-f4981ab6b146", 2026-02-24T09:11:01.955 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:11:01.955 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:01.956 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:11:01.957 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:11:01.958 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:11:01.958 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:11:01.958 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:01.958 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:01.958 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:11:01.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f268e968640 1 -- 10.20.193.4:0/1894113117 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f265c0b5770 msgr2=0x7f265c0d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f268e968640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f265c0b5770 0x7f265c0d5c20 secure :-1 s=READY pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267c00cb80 tx=0x7f267c006b00 comp rx=0 tx=0).stop 2026-02-24T09:11:01.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f268e968640 1 -- 10.20.193.4:0/1894113117 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2688115840 msgr2=0x7f2688123810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:01.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f268e968640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2688115840 0x7f2688123810 secure :-1 s=READY pgs=561 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267c006e90 tx=0x7f267c00edf0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f268e968640 1 -- 10.20.193.4:0/1894113117 shutdown_connections 2026-02-24T09:11:01.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f268e968640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f265c0b5770 0x7f265c0d5c20 unknown :-1 s=CLOSED pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f268e968640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2688115840 0x7f2688123810 unknown :-1 s=CLOSED pgs=561 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f268e968640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2688110040 0x7f268811e440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f268e968640 1 --2- 10.20.193.4:0/1894113117 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f268810f650 0x7f268811df00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:01.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.943+0000 7f268e968640 1 -- 10.20.193.4:0/1894113117 >> 10.20.193.4:0/1894113117 conn(0x7f26880ecf20 msgr2=0x7f268810d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:01.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.944+0000 7f268e968640 1 -- 10.20.193.4:0/1894113117 shutdown_connections 2026-02-24T09:11:01.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:01.944+0000 7f268e968640 1 -- 10.20.193.4:0/1894113117 wait complete. 2026-02-24T09:11:01.993 INFO:tasks.cephfs.filesystem:scrub status for tag:7814ad38-6799-499f-8516-f4981ab6b146 - {'path': '/', 'tag': '7814ad38-6799-499f-8516-f4981ab6b146', 'options': 'recursive,force'} 2026-02-24T09:11:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:01 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:11:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:01 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:01 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:11:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:01 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:02.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2026-02-24T09:11:02.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:01 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]} : dispatch 2026-02-24T09:11:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:01 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:11:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:01 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:01 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:11:02.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:01 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:02.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2026-02-24T09:11:02.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:01 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]} : dispatch 2026-02-24T09:11:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:01 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:11:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:01 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:01 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:11:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:01 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2026-02-24T09:11:02.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:01 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]} : dispatch 2026-02-24T09:11:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:02 trial090 ceph-mon[47278]: pgmap v187: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 62 KiB/s rd, 824 MiB/s wr, 245 op/s 2026-02-24T09:11:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2026-02-24T09:11:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:02 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2026-02-24T09:11:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:02 trial090 ceph-mon[47278]: osdmap e78: 12 total, 12 up, 12 in 2026-02-24T09:11:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:02 trial014 ceph-mon[46941]: pgmap v187: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 62 KiB/s rd, 824 MiB/s wr, 245 op/s 2026-02-24T09:11:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2026-02-24T09:11:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:02 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2026-02-24T09:11:03.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:02 trial014 ceph-mon[46941]: osdmap e78: 12 total, 12 up, 12 in 2026-02-24T09:11:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:02 trial004 ceph-mon[41596]: pgmap v187: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 62 KiB/s rd, 824 MiB/s wr, 245 op/s 2026-02-24T09:11:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2026-02-24T09:11:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:02 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2026-02-24T09:11:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:02 trial004 ceph-mon[41596]: osdmap e78: 12 total, 12 up, 12 in 2026-02-24T09:11:04.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:03 trial090 ceph-mon[47278]: osdmap e79: 12 total, 12 up, 12 in 2026-02-24T09:11:04.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:03 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:11:04.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:03 trial014 ceph-mon[46941]: osdmap e79: 12 total, 12 up, 12 in 2026-02-24T09:11:04.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:03 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:11:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:03 trial004 ceph-mon[41596]: osdmap e79: 12 total, 12 up, 12 in 2026-02-24T09:11:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:03 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:11:05.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:04 trial090 ceph-mon[47278]: pgmap v190: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 882 MiB/s wr, 229 op/s 2026-02-24T09:11:05.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:04 trial090 ceph-mon[47278]: mgrmap e18: x(active, since 4m), standbys: z, y 2026-02-24T09:11:05.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:04 trial014 ceph-mon[46941]: pgmap v190: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 882 MiB/s wr, 229 op/s 2026-02-24T09:11:05.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:04 trial014 ceph-mon[46941]: mgrmap e18: x(active, since 4m), standbys: z, y 2026-02-24T09:11:05.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:04 trial004 ceph-mon[41596]: pgmap v190: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 882 MiB/s wr, 229 op/s 2026-02-24T09:11:05.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:04 trial004 ceph-mon[41596]: mgrmap e18: x(active, since 4m), standbys: z, y 2026-02-24T09:11:06.323 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-24T09:11:06.323 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.0 2026-02-24T09:11:06.323 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:11:06.492 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 -- 10.20.193.4:0/1056751137 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fadc410d010 msgr2=0x7fadc410d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 --2- 10.20.193.4:0/1056751137 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fadc410d010 0x7fadc410d3e0 secure :-1 s=READY pgs=565 gs=1 cs=0 l=1 c_cookie=13715257818344010274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadb8009950 tx=0x7fadb802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 -- 10.20.193.4:0/1056751137 shutdown_connections 2026-02-24T09:11:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 --2- 10.20.193.4:0/1056751137 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fadc4113200 0x7fadc4173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 --2- 10.20.193.4:0/1056751137 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadc410da00 0x7fadc4112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 --2- 10.20.193.4:0/1056751137 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fadc410d010 0x7fadc410d3e0 unknown :-1 s=CLOSED pgs=565 gs=1 cs=0 l=1 c_cookie=13715257818344010274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 -- 10.20.193.4:0/1056751137 >> 10.20.193.4:0/1056751137 conn(0x7fadc405f830 msgr2=0x7fadc410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 -- 10.20.193.4:0/1056751137 shutdown_connections 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 -- 10.20.193.4:0/1056751137 wait complete. 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 Processor -- start 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.637+0000 7fadc9915640 1 -- start start 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc9915640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fadc410d010 0x7fadc40f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc9915640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fadc410da00 0x7fadc4173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc9915640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadc4113200 0x7fadc40f5cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc9915640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40faec0 con 0x7fadc410da00 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc9915640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40fb030 con 0x7fadc410d010 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc9915640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40fb1f0 con 0x7fadc4113200 2026-02-24T09:11:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc27fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fadc410da00 0x7fadc4173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc27fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fadc410da00 0x7fadc4173ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60794/0 (socket says 10.20.193.4:60794) 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc27fc640 1 -- 10.20.193.4:0/1807412554 learned_addr learned my addr 10.20.193.4:0/1807412554 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc2ffd640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fadc410d010 0x7fadc40f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc37fe640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadc4113200 0x7fadc40f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc27fc640 1 -- 10.20.193.4:0/1807412554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadc4113200 msgr2=0x7fadc40f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc27fc640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadc4113200 0x7fadc40f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc27fc640 1 -- 10.20.193.4:0/1807412554 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fadc410d010 msgr2=0x7fadc40f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc27fc640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fadc410d010 0x7fadc40f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc27fc640 1 -- 10.20.193.4:0/1807412554 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb8009570 con 0x7fadc410da00 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc37fe640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadc4113200 0x7fadc40f5cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc27fc640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fadc410da00 0x7fadc4173ad0 secure :-1 s=READY pgs=566 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadac005db0 tx=0x7fadac00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc8913640 1 -- 10.20.193.4:0/1807412554 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fadac004500 con 0x7fadc410da00 2026-02-24T09:11:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc9915640 1 -- 10.20.193.4:0/1807412554 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc40fb4d0 con 0x7fadc410da00 2026-02-24T09:11:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc8913640 1 -- 10.20.193.4:0/1807412554 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fadac004d30 con 0x7fadc410da00 2026-02-24T09:11:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc8913640 1 -- 10.20.193.4:0/1807412554 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fadac005310 con 0x7fadc410da00 2026-02-24T09:11:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.638+0000 7fadc9915640 1 -- 10.20.193.4:0/1807412554 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc40fb9a0 con 0x7fadc410da00 2026-02-24T09:11:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.639+0000 7fadc9915640 1 -- 10.20.193.4:0/1807412554 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc410e2f0 con 0x7fadc410da00 2026-02-24T09:11:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.640+0000 7fadc8913640 1 -- 10.20.193.4:0/1807412554 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fadac0054a0 con 0x7fadc410da00 2026-02-24T09:11:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.641+0000 7fadc8913640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fad980b56d0 0x7fad980d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.641+0000 7fadc8913640 1 -- 10.20.193.4:0/1807412554 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fadac0e7120 con 0x7fadc410da00 2026-02-24T09:11:06.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.641+0000 7fadc2ffd640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fad980b56d0 0x7fad980d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:06.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.641+0000 7fadc2ffd640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fad980b56d0 0x7fad980d5b80 secure :-1 s=READY pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadb80023d0 tx=0x7fadb8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:06.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.642+0000 7fadc8913640 1 -- 10.20.193.4:0/1807412554 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fadac0a9ae0 con 0x7fadc410da00 2026-02-24T09:11:06.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.802+0000 7fadc9915640 1 -- 10.20.193.4:0/1807412554 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadc410d3e0 con 0x7fadc410da00 2026-02-24T09:11:06.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.804+0000 7fadc8913640 1 -- 10.20.193.4:0/1807412554 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fadac0acc90 con 0x7fadc410da00 2026-02-24T09:11:06.808 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:11:06.809 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:11:06.809 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:11:06.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 -- 10.20.193.4:0/1807412554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fad980b56d0 msgr2=0x7fad980d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:06.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fad980b56d0 0x7fad980d5b80 secure :-1 s=READY pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadb80023d0 tx=0x7fadb8031040 comp rx=0 tx=0).stop 2026-02-24T09:11:06.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 -- 10.20.193.4:0/1807412554 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fadc410da00 msgr2=0x7fadc4173ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:06.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fadc410da00 0x7fadc4173ad0 secure :-1 s=READY pgs=566 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadac005db0 tx=0x7fadac00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 -- 10.20.193.4:0/1807412554 shutdown_connections 2026-02-24T09:11:06.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fad980b56d0 0x7fad980d5b80 unknown :-1 s=CLOSED pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fadc4113200 0x7fadc40f5cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fadc410da00 0x7fadc4173ad0 unknown :-1 s=CLOSED pgs=566 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 --2- 10.20.193.4:0/1807412554 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fadc410d010 0x7fadc40f55b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:06.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 -- 10.20.193.4:0/1807412554 >> 10.20.193.4:0/1807412554 conn(0x7fadc405f830 msgr2=0x7fadc40617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:06.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 -- 10.20.193.4:0/1807412554 shutdown_connections 2026-02-24T09:11:06.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:06.809+0000 7fadc9915640 1 -- 10.20.193.4:0/1807412554 wait complete. 2026-02-24T09:11:06.880 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:06 trial004 ceph-mon[41596]: pgmap v191: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 1021 MiB/s wr, 272 op/s; 47 MiB/s, 11 objects/s recovering 2026-02-24T09:11:06.884 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 142.0 --await-for 45.0' 2026-02-24T09:11:06.884 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 142.0 --await-for 45.0 2026-02-24T09:11:07.032 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:07.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:06 trial090 ceph-mon[47278]: pgmap v191: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 1021 MiB/s wr, 272 op/s; 47 MiB/s, 11 objects/s recovering 2026-02-24T09:11:07.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:06 trial014 ceph-mon[46941]: pgmap v191: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 1021 MiB/s wr, 272 op/s; 47 MiB/s, 11 objects/s recovering 2026-02-24T09:11:07.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 -- 10.20.193.4:0/1457454717 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1ae4113200 msgr2=0x7f1ae4173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:07.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 --2- 10.20.193.4:0/1457454717 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1ae4113200 0x7f1ae4173bd0 secure :-1 s=READY pgs=567 gs=1 cs=0 l=1 c_cookie=8886222250402397807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ae000aa30 tx=0x7f1ae0030280 comp rx=0 tx=0).stop 2026-02-24T09:11:07.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 -- 10.20.193.4:0/1457454717 shutdown_connections 2026-02-24T09:11:07.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 --2- 10.20.193.4:0/1457454717 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1ae4113200 0x7f1ae4173bd0 unknown :-1 s=CLOSED pgs=567 gs=1 cs=0 l=1 c_cookie=8886222250402397807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 --2- 10.20.193.4:0/1457454717 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ae410da00 0x7f1ae4112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 --2- 10.20.193.4:0/1457454717 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1ae410d010 0x7f1ae410d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 -- 10.20.193.4:0/1457454717 >> 10.20.193.4:0/1457454717 conn(0x7f1ae405f830 msgr2=0x7f1ae410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:07.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 -- 10.20.193.4:0/1457454717 shutdown_connections 2026-02-24T09:11:07.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 -- 10.20.193.4:0/1457454717 wait complete. 2026-02-24T09:11:07.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 Processor -- start 2026-02-24T09:11:07.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 -- start start 2026-02-24T09:11:07.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1ae410d010 0x7f1ae40f3360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ae410da00 0x7f1ae4173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.187+0000 7f1aeb184640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1ae4113200 0x7f1ae40f3a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1aeb184640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae40f8c70 con 0x7f1ae4113200 2026-02-24T09:11:07.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1aeb184640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae40f8de0 con 0x7f1ae410d010 2026-02-24T09:11:07.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1aeb184640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae40f8fa0 con 0x7f1ae410da00 2026-02-24T09:11:07.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ae96fa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1ae4113200 0x7f1ae40f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ae96fa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1ae4113200 0x7f1ae40f3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60812/0 (socket says 10.20.193.4:60812) 2026-02-24T09:11:07.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ae96fa640 1 -- 10.20.193.4:0/955590410 learned_addr learned my addr 10.20.193.4:0/955590410 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:07.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1ae410d010 0x7f1ae40f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ae96fa640 1 -- 10.20.193.4:0/955590410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ae410da00 msgr2=0x7f1ae4173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:07.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ae410da00 0x7f1ae4173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ae96fa640 1 -- 10.20.193.4:0/955590410 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1ae410d010 msgr2=0x7f1ae40f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:07.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1ae410d010 0x7f1ae40f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ae96fa640 1 -- 10.20.193.4:0/955590410 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae000a650 con 0x7f1ae4113200 2026-02-24T09:11:07.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1ae4113200 0x7f1ae40f3a60 secure :-1 s=READY pgs=568 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ae0005900 tx=0x7f1ae00039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:07.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ad9ffb640 1 -- 10.20.193.4:0/955590410 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ae003e070 con 0x7f1ae4113200 2026-02-24T09:11:07.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1aeb184640 1 -- 10.20.193.4:0/955590410 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae40f9220 con 0x7f1ae4113200 2026-02-24T09:11:07.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1aeb184640 1 -- 10.20.193.4:0/955590410 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae40f9690 con 0x7f1ae4113200 2026-02-24T09:11:07.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ad9ffb640 1 -- 10.20.193.4:0/955590410 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ae00055a0 con 0x7f1ae4113200 2026-02-24T09:11:07.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.188+0000 7f1ad9ffb640 1 -- 10.20.193.4:0/955590410 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ae0042880 con 0x7f1ae4113200 2026-02-24T09:11:07.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.191+0000 7f1ad9ffb640 1 -- 10.20.193.4:0/955590410 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f1ae0039b80 con 0x7f1ae4113200 2026-02-24T09:11:07.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.191+0000 7f1ad9ffb640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1ac00b5750 0x7f1ac00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.191+0000 7f1ad9ffb640 1 -- 10.20.193.4:0/955590410 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1ae010c560 con 0x7f1ae4113200 2026-02-24T09:11:07.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.192+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1ac00b5750 0x7f1ac00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.192+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1ac00b5750 0x7f1ac00d5c00 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ad4004740 tx=0x7f1ad4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:07.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1aed17ee00 1 Processor -- start 2026-02-24T09:11:07.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1aed17ee00 1 -- start start 2026-02-24T09:11:07.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c4586bd0 0x5638c4586fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c45cbc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45ec560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5638c4495f20 con 0x5638c45cc180 2026-02-24T09:11:07.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5638c4491c50 con 0x5638c45874e0 2026-02-24T09:11:07.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5638c448bdb0 con 0x5638c4586bd0 2026-02-24T09:11:07.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1ae96fa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45ec560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1ae96fa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45ec560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60824/0 (socket says 10.20.193.4:60824) 2026-02-24T09:11:07.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1ae96fa640 1 -- 10.20.193.4:0/51970787 learned_addr learned my addr 10.20.193.4:0/51970787 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:07.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/51970787 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c4586bd0 0x5638c4586fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.198+0000 7f1adbfff640 1 --2- 10.20.193.4:0/51970787 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c45cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.199+0000 7f1ae96fa640 1 -- 10.20.193.4:0/51970787 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c4586bd0 msgr2=0x5638c4586fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:07.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.199+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/51970787 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c4586bd0 0x5638c4586fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.199+0000 7f1ae96fa640 1 -- 10.20.193.4:0/51970787 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 msgr2=0x5638c45cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:07.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.199+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/51970787 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c45cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.199+0000 7f1ae96fa640 1 -- 10.20.193.4:0/51970787 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c442c690 con 0x5638c45cc180 2026-02-24T09:11:07.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.199+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/51970787 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45ec560 secure :-1 s=READY pgs=569 gs=2 cs=0 l=1 c_cookie=10663193516520744426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ae010a0f0 tx=0x7f1ae0006b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fb4601db77a5ea server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:07.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.199+0000 7f1ab14e4640 1 -- 10.20.193.4:0/51970787 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ae00d20d0 con 0x5638c45cc180 2026-02-24T09:11:07.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.199+0000 7f1ab14e4640 1 -- 10.20.193.4:0/51970787 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ae00d32d0 con 0x5638c45cc180 2026-02-24T09:11:07.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.199+0000 7f1ab14e4640 1 -- 10.20.193.4:0/51970787 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ae00dd800 con 0x5638c45cc180 2026-02-24T09:11:07.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.200+0000 7f1aed17ee00 1 -- 10.20.193.4:0/51970787 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 msgr2=0x5638c45ec560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:07.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.200+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/51970787 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45ec560 secure :-1 s=READY pgs=569 gs=2 cs=0 l=1 c_cookie=10663193516520744426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ae010a0f0 tx=0x7f1ae0006b90 comp rx=0 tx=0).stop 2026-02-24T09:11:07.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.200+0000 7f1aed17ee00 1 -- 10.20.193.4:0/51970787 shutdown_connections 2026-02-24T09:11:07.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.200+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/51970787 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45ec560 unknown :-1 s=CLOSED pgs=569 gs=2 cs=0 l=1 c_cookie=10663193516520744426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.200+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/51970787 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c45cbc40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.200+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/51970787 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c4586bd0 0x5638c4586fa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.200+0000 7f1aed17ee00 1 -- 10.20.193.4:0/51970787 >> 10.20.193.4:0/51970787 conn(0x5638c44a4880 msgr2=0x5638c45854b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:07.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.200+0000 7f1aed17ee00 1 -- 10.20.193.4:0/51970787 shutdown_connections 2026-02-24T09:11:07.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.200+0000 7f1aed17ee00 1 -- 10.20.193.4:0/51970787 wait complete. 2026-02-24T09:11:07.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.201+0000 7f1aed17ee00 1 -- start start 2026-02-24T09:11:07.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aed17ee00 1 Processor -- start 2026-02-24T09:11:07.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c4586bd0 0x5638c459e880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c459edc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45a3db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5638c45a42f0 con 0x5638c45cc180 2026-02-24T09:11:07.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5638c45a4460 con 0x5638c45874e0 2026-02-24T09:11:07.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5638c45a4620 con 0x5638c4586bd0 2026-02-24T09:11:07.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1ae96fa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1ae96fa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45a3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60830/0 (socket says 10.20.193.4:60830) 2026-02-24T09:11:07.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1ae96fa640 1 -- 10.20.193.4:0/977999592 learned_addr learned my addr 10.20.193.4:0/977999592 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:07.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1adbfff640 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c459edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c4586bd0 0x5638c459e880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1ae96fa640 1 -- 10.20.193.4:0/977999592 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c4586bd0 msgr2=0x5638c459e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:07.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c4586bd0 0x5638c459e880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1ae96fa640 1 -- 10.20.193.4:0/977999592 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 msgr2=0x5638c459edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:07.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c459edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1ae96fa640 1 -- 10.20.193.4:0/977999592 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c44373d0 con 0x5638c45cc180 2026-02-24T09:11:07.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45a3db0 secure :-1 s=READY pgs=570 gs=1 cs=0 l=1 c_cookie=17615626860098129539 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ae0032040 tx=0x7f1ae0003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f477474c33fa8e83 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aa27fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aa27fc640 1 -- 10.20.193.4:0/977999592 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ae00d20d0 con 0x5638c45cc180 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aa27fc640 1 -- 10.20.193.4:0/977999592 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ae00d85f0 con 0x5638c45cc180 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aed17ee00 1 -- 10.20.193.4:0/977999592 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae40f9690 con 0x5638c45cc180 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.202+0000 7f1aa27fc640 1 -- 10.20.193.4:0/977999592 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ae00d08b0 con 0x5638c45cc180 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aa27fc640 1 -- 10.20.193.4:0/977999592 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1ae00d0a40 con 0x5638c45cc180 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aa27fc640 10 client.15936 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aed17ee00 10 client.15936 _ll_register_callbacks cb 0x5638c440ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aed17ee00 1 -- 10.20.193.4:0/977999592 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638c4119eb0 con 0x5638c45cc180 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aa27fc640 1 -- 10.20.193.4:0/977999592 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1ae00dabd0 con 0x5638c45cc180 2026-02-24T09:11:07.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aed17ee00 10 client.15936 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aed17ee00 1 -- 10.20.193.4:0/977999592 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5638c440f5c0 con 0x5638c45cc180 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aa27fc640 1 -- 10.20.193.4:0/977999592 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f1ae00d42c0 con 0x5638c45cc180 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aed17ee00 10 client.15936 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aed17ee00 10 client.15936 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aed17ee00 20 client.15936 populate_metadata read hostname 'trial004' 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5638c45c89f0 0x5638c45c8e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aed17ee00 4 client.15936 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.203+0000 7f1aed17ee00 1 -- 10.20.193.4:0/977999592 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638c449cf00 con 0x5638c45c89f0 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.204+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5638c45c89f0 0x5638c45c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.204+0000 7f1aa27fc640 10 client.15936 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:07.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.204+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5638c45c89f0 0x5638c45c8e90 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=10212619396205231775 s_cookie=1538425311601647008 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dba833b6913be9f server_cookie=155995ab837c5da0 in_seq=0 out_seq=0 2026-02-24T09:11:07.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aa27fc640 1 -- 10.20.193.4:0/977999592 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5638c449cf00 con 0x5638c45c89f0 2026-02-24T09:11:07.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aa27fc640 10 client.15936 handle_command_reply: tid=0 2026-02-24T09:11:07.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 client.15936 shutdown 2026-02-24T09:11:07.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 -- 10.20.193.4:0/977999592 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 msgr2=0x5638c45a3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:07.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45a3db0 secure :-1 s=READY pgs=570 gs=1 cs=0 l=1 c_cookie=17615626860098129539 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ae0032040 tx=0x7f1ae0003c30 comp rx=0 tx=0).stop 2026-02-24T09:11:07.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 -- 10.20.193.4:0/977999592 shutdown_connections 2026-02-24T09:11:07.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5638c45c89f0 0x5638c45c8e90 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=10212619396205231775 s_cookie=1538425311601647008 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c45cc180 0x5638c45a3db0 unknown :-1 s=CLOSED pgs=570 gs=1 cs=0 l=1 c_cookie=17615626860098129539 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aa27fc640 0 client.15936 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:07.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c459edc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/977999592 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c4586bd0 0x5638c459e880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 -- 10.20.193.4:0/977999592 >> 10.20.193.4:0/977999592 conn(0x5638c44a4880 msgr2=0x5638c4585bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:07.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 -- 10.20.193.4:0/977999592 shutdown_connections 2026-02-24T09:11:07.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 1 -- 10.20.193.4:0/977999592 wait complete. 2026-02-24T09:11:07.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.205+0000 7f1aed17ee00 20 client.15936 trim_cache size 0 max 16384 2026-02-24T09:11:07.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.222+0000 7f1aed17ee00 1 Processor -- start 2026-02-24T09:11:07.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.222+0000 7f1aed17ee00 1 -- start start 2026-02-24T09:11:07.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.222+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c459be80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.222+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c45874e0 0x5638c45c4290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.222+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45c89f0 0x5638c45c47d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.222+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5638c44899e0 con 0x5638c4586bd0 2026-02-24T09:11:07.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.222+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5638c4141ec0 con 0x5638c45c89f0 2026-02-24T09:11:07.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.222+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5638c44f5580 con 0x5638c45874e0 2026-02-24T09:11:07.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.222+0000 7f1ae8ef9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c459be80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ae8ef9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c459be80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60834/0 (socket says 10.20.193.4:60834) 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ae8ef9640 1 -- 10.20.193.4:0/566329713 learned_addr learned my addr 10.20.193.4:0/566329713 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ae8ef9640 1 -- 10.20.193.4:0/566329713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c45874e0 msgr2=0x5638c45c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1adbfff640 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c45874e0 0x5638c45c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c45874e0 0x5638c45c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45c89f0 0x5638c45c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ae8ef9640 1 -- 10.20.193.4:0/566329713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45c89f0 msgr2=0x5638c45c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45c89f0 0x5638c45c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ae8ef9640 1 -- 10.20.193.4:0/566329713 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c4591250 con 0x5638c4586bd0 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1adbfff640 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c45874e0 0x5638c45c4290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ae96fa640 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45c89f0 0x5638c45c47d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c459be80 secure :-1 s=READY pgs=571 gs=1 cs=0 l=1 c_cookie=16428167049331662310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ad40042a0 tx=0x7f1ad4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fc92e42630dde6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:07.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ab0ce3640 1 -- 10.20.193.4:0/566329713 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ad4022040 con 0x5638c4586bd0 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ab0ce3640 1 -- 10.20.193.4:0/566329713 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ad402ac60 con 0x5638c4586bd0 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.223+0000 7f1ab0ce3640 1 -- 10.20.193.4:0/566329713 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ad4011e90 con 0x5638c4586bd0 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.224+0000 7f1aed17ee00 1 -- 10.20.193.4:0/566329713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 msgr2=0x5638c459be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.224+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c459be80 secure :-1 s=READY pgs=571 gs=1 cs=0 l=1 c_cookie=16428167049331662310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ad40042a0 tx=0x7f1ad4013000 comp rx=0 tx=0).stop 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.224+0000 7f1aed17ee00 1 -- 10.20.193.4:0/566329713 shutdown_connections 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.224+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45c89f0 0x5638c45c47d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.224+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c45874e0 0x5638c45c4290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.224+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/566329713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c459be80 unknown :-1 s=CLOSED pgs=571 gs=1 cs=0 l=1 c_cookie=16428167049331662310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.224+0000 7f1aed17ee00 1 -- 10.20.193.4:0/566329713 >> 10.20.193.4:0/566329713 conn(0x5638c44a4880 msgr2=0x5638c459e720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.224+0000 7f1aed17ee00 1 -- 10.20.193.4:0/566329713 shutdown_connections 2026-02-24T09:11:07.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.224+0000 7f1aed17ee00 1 -- 10.20.193.4:0/566329713 wait complete. 2026-02-24T09:11:07.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1aed17ee00 1 -- start start 2026-02-24T09:11:07.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1aed17ee00 1 Processor -- start 2026-02-24T09:11:07.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c4610680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c4610bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1aed17ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c45c89f0 0x5638c4611100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5638c45a40f0 con 0x5638c4586bd0 2026-02-24T09:11:07.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5638c46156d0 con 0x5638c45874e0 2026-02-24T09:11:07.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1aed17ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5638c4615890 con 0x5638c45c89f0 2026-02-24T09:11:07.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1ae8ef9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c4610680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1ae8ef9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c4610680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60840/0 (socket says 10.20.193.4:60840) 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1ae8ef9640 1 -- 10.20.193.4:0/1511683483 learned_addr learned my addr 10.20.193.4:0/1511683483 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1ae8ef9640 1 -- 10.20.193.4:0/1511683483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c45c89f0 msgr2=0x5638c4611100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c45c89f0 0x5638c4611100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1ae8ef9640 1 -- 10.20.193.4:0/1511683483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 msgr2=0x5638c4610bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c4610bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.225+0000 7f1ae8ef9640 1 -- 10.20.193.4:0/1511683483 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c4421500 con 0x5638c4586bd0 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1ae8ef9640 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c4610680 secure :-1 s=READY pgs=572 gs=1 cs=0 l=1 c_cookie=16127974165117215263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ad4009fd0 tx=0x7f1ad4011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd2130db27d221f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aa27fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aa27fc640 1 -- 10.20.193.4:0/1511683483 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ad4011bf0 con 0x5638c4586bd0 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aa27fc640 1 -- 10.20.193.4:0/1511683483 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ad402aa40 con 0x5638c4586bd0 2026-02-24T09:11:07.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aa27fc640 1 -- 10.20.193.4:0/1511683483 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ad4035b50 con 0x5638c4586bd0 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 1 -- 10.20.193.4:0/1511683483 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad4009e40 con 0x5638c4586bd0 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aa27fc640 1 -- 10.20.193.4:0/1511683483 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1ad4035ce0 con 0x5638c4586bd0 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aa27fc640 10 client.15942 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 10 client.15942 _ll_register_callbacks cb 0x5638c440ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 1 -- 10.20.193.4:0/1511683483 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638c4117700 con 0x5638c4586bd0 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aa27fc640 1 -- 10.20.193.4:0/1511683483 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1ad4035ea0 con 0x5638c4586bd0 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 10 client.15942 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 1 -- 10.20.193.4:0/1511683483 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5638c441bf80 con 0x5638c4586bd0 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aa27fc640 1 -- 10.20.193.4:0/1511683483 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f1ad4025070 con 0x5638c4586bd0 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 10 client.15942 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:07.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 10 client.15942 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:11:07.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 20 client.15942 populate_metadata read hostname 'trial004' 2026-02-24T09:11:07.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5638c45cc180 0x5638c4617600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:07.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 4 client.15942 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.0, "await_for": 45.0}] 2026-02-24T09:11:07.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.226+0000 7f1aed17ee00 1 -- 10.20.193.4:0/1511683483 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.0, "await_for": 45.0}) -- 0x5638c449eb70 con 0x5638c45cc180 2026-02-24T09:11:07.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.227+0000 7f1adbfff640 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5638c45cc180 0x5638c4617600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:07.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.227+0000 7f1adbfff640 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5638c45cc180 0x5638c4617600 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=9396462596322741569 s_cookie=1699336953614682538 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8266f0f25f0fcd41 server_cookie=179541f4b1e5c9aa in_seq=0 out_seq=0 2026-02-24T09:11:07.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.227+0000 7f1aa27fc640 10 client.15942 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:07.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aa27fc640 1 -- 10.20.193.4:0/1511683483 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5638c449eb70 con 0x5638c45cc180 2026-02-24T09:11:07.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aa27fc640 10 client.15942 handle_command_reply: tid=0 2026-02-24T09:11:07.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 client.15942 shutdown 2026-02-24T09:11:07.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 -- 10.20.193.4:0/1511683483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 msgr2=0x5638c4610680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:07.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c4610680 secure :-1 s=READY pgs=572 gs=1 cs=0 l=1 c_cookie=16127974165117215263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ad4009fd0 tx=0x7f1ad4011890 comp rx=0 tx=0).stop 2026-02-24T09:11:07.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 -- 10.20.193.4:0/1511683483 shutdown_connections 2026-02-24T09:11:07.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5638c45cc180 0x5638c4617600 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=9396462596322741569 s_cookie=1699336953614682538 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5638c45c89f0 0x5638c4611100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5638c45874e0 0x5638c4610bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aa27fc640 0 client.15942 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:07.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 --2- 10.20.193.4:0/1511683483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5638c4586bd0 0x5638c4610680 unknown :-1 s=CLOSED pgs=572 gs=1 cs=0 l=1 c_cookie=16127974165117215263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 -- 10.20.193.4:0/1511683483 >> 10.20.193.4:0/1511683483 conn(0x5638c44a4880 msgr2=0x5638c459ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:07.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 -- 10.20.193.4:0/1511683483 shutdown_connections 2026-02-24T09:11:07.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 1 -- 10.20.193.4:0/1511683483 wait complete. 2026-02-24T09:11:07.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.248+0000 7f1aed17ee00 20 client.15942 trim_cache size 0 max 16384 2026-02-24T09:11:07.254 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:11:07.254 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:11:07.254 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:11:07.255 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 6, 2026-02-24T09:11:07.255 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:11:07.255 INFO:teuthology.orchestra.run.trial004.stdout: "734c5603": { 2026-02-24T09:11:07.255 INFO:teuthology.orchestra.run.trial004.stdout: "version": 6, 2026-02-24T09:11:07.255 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:11:07.255 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:11:07.255 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:11:07.255 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:11:07.255 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:07.255 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 142.0, 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:07.256 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:07.257 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:07.257 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:11:07.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 -- 10.20.193.4:0/955590410 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1ac00b5750 msgr2=0x7f1ac00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:07.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1ac00b5750 0x7f1ac00d5c00 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ad4004740 tx=0x7f1ad4005f90 comp rx=0 tx=0).stop 2026-02-24T09:11:07.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 -- 10.20.193.4:0/955590410 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1ae4113200 msgr2=0x7f1ae40f3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:07.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1ae4113200 0x7f1ae40f3a60 secure :-1 s=READY pgs=568 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ae0005900 tx=0x7f1ae00039b0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 -- 10.20.193.4:0/955590410 shutdown_connections 2026-02-24T09:11:07.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1ac00b5750 0x7f1ac00d5c00 unknown :-1 s=CLOSED pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1ae4113200 0x7f1ae40f3a60 unknown :-1 s=CLOSED pgs=568 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ae410da00 0x7f1ae4173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 --2- 10.20.193.4:0/955590410 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1ae410d010 0x7f1ae40f3360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:07.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 -- 10.20.193.4:0/955590410 >> 10.20.193.4:0/955590410 conn(0x7f1ae405f830 msgr2=0x7f1ae410f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:07.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 -- 10.20.193.4:0/955590410 shutdown_connections 2026-02-24T09:11:07.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:07.249+0000 7f1aeb184640 1 -- 10.20.193.4:0/955590410 wait complete. 2026-02-24T09:11:07.291 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '734c5603', quiesce took 1.0 seconds. Will release after: 21.0 2026-02-24T09:11:08.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:07 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1807412554' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:08.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:07 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1807412554' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:08.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:07 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1807412554' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:09.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:08 trial090 ceph-mon[47278]: pgmap v192: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 68 KiB/s rd, 1.1 GiB/s wr, 319 op/s; 47 MiB/s, 11 objects/s recovering 2026-02-24T09:11:09.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:08 trial014 ceph-mon[46941]: pgmap v192: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 68 KiB/s rd, 1.1 GiB/s wr, 319 op/s; 47 MiB/s, 11 objects/s recovering 2026-02-24T09:11:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:08 trial004 ceph-mon[41596]: pgmap v192: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 68 KiB/s rd, 1.1 GiB/s wr, 319 op/s; 47 MiB/s, 11 objects/s recovering 2026-02-24T09:11:11.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:10 trial090 ceph-mon[47278]: pgmap v193: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 748 MiB/s wr, 224 op/s; 47 MiB/s, 11 objects/s recovering 2026-02-24T09:11:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:10 trial014 ceph-mon[46941]: pgmap v193: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 748 MiB/s wr, 224 op/s; 47 MiB/s, 11 objects/s recovering 2026-02-24T09:11:11.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:10 trial004 ceph-mon[41596]: pgmap v193: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 748 MiB/s wr, 224 op/s; 47 MiB/s, 11 objects/s recovering 2026-02-24T09:11:13.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:12 trial090 ceph-mon[47278]: pgmap v194: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 41 KiB/s rd, 734 MiB/s wr, 219 op/s; 38 MiB/s, 9 objects/s recovering 2026-02-24T09:11:13.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:12 trial014 ceph-mon[46941]: pgmap v194: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 41 KiB/s rd, 734 MiB/s wr, 219 op/s; 38 MiB/s, 9 objects/s recovering 2026-02-24T09:11:13.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:12 trial004 ceph-mon[41596]: pgmap v194: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 41 KiB/s rd, 734 MiB/s wr, 219 op/s; 38 MiB/s, 9 objects/s recovering 2026-02-24T09:11:15.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:14 trial090 ceph-mon[47278]: pgmap v195: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 37 KiB/s rd, 698 MiB/s wr, 210 op/s; 35 MiB/s, 8 objects/s recovering 2026-02-24T09:11:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:14 trial014 ceph-mon[46941]: pgmap v195: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 37 KiB/s rd, 698 MiB/s wr, 210 op/s; 35 MiB/s, 8 objects/s recovering 2026-02-24T09:11:15.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:14 trial004 ceph-mon[41596]: pgmap v195: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 37 KiB/s rd, 698 MiB/s wr, 210 op/s; 35 MiB/s, 8 objects/s recovering 2026-02-24T09:11:17.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:16 trial090 ceph-mon[47278]: pgmap v196: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 620 MiB/s wr, 190 op/s; 32 MiB/s, 7 objects/s recovering 2026-02-24T09:11:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:16 trial014 ceph-mon[46941]: pgmap v196: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 620 MiB/s wr, 190 op/s; 32 MiB/s, 7 objects/s recovering 2026-02-24T09:11:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:16 trial004 ceph-mon[41596]: pgmap v196: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 620 MiB/s wr, 190 op/s; 32 MiB/s, 7 objects/s recovering 2026-02-24T09:11:19.085 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:18 trial090 ceph-mon[47278]: pgmap v197: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 503 MiB/s wr, 157 op/s 2026-02-24T09:11:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:18 trial014 ceph-mon[46941]: pgmap v197: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 503 MiB/s wr, 157 op/s 2026-02-24T09:11:19.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:18 trial004 ceph-mon[41596]: pgmap v197: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 503 MiB/s wr, 157 op/s 2026-02-24T09:11:21.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:20 trial090 ceph-mon[47278]: pgmap v198: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 410 MiB/s wr, 128 op/s 2026-02-24T09:11:21.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:20 trial014 ceph-mon[46941]: pgmap v198: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 410 MiB/s wr, 128 op/s 2026-02-24T09:11:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:20 trial004 ceph-mon[41596]: pgmap v198: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 410 MiB/s wr, 128 op/s 2026-02-24T09:11:23.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:22 trial090 ceph-mon[47278]: pgmap v199: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 645 MiB/s wr, 236 op/s 2026-02-24T09:11:23.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:22 trial014 ceph-mon[46941]: pgmap v199: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 645 MiB/s wr, 236 op/s 2026-02-24T09:11:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:22 trial004 ceph-mon[41596]: pgmap v199: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 645 MiB/s wr, 236 op/s 2026-02-24T09:11:24.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:11:24.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:23 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:11:24.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:23 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:11:24.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:24.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:23 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:25.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:24 trial090 ceph-mon[47278]: pgmap v200: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 694 MiB/s wr, 282 op/s 2026-02-24T09:11:25.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:11:25.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:11:25.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:25.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:11:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:24 trial014 ceph-mon[46941]: pgmap v200: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 694 MiB/s wr, 282 op/s 2026-02-24T09:11:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:11:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:11:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:11:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:24 trial004 ceph-mon[41596]: pgmap v200: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 694 MiB/s wr, 282 op/s 2026-02-24T09:11:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:11:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:11:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:11:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:11:27.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:26 trial090 ceph-mon[47278]: pgmap v201: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 621 MiB/s wr, 279 op/s 2026-02-24T09:11:27.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:26 trial014 ceph-mon[46941]: pgmap v201: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 621 MiB/s wr, 279 op/s 2026-02-24T09:11:27.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:26 trial004 ceph-mon[41596]: pgmap v201: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 621 MiB/s wr, 279 op/s 2026-02-24T09:11:28.292 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:11:28.409 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:28.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.510+0000 7f6d00720640 1 -- 10.20.193.4:0/3114485648 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6cf810fc70 msgr2=0x7f6cf8114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.510+0000 7f6d00720640 1 --2- 10.20.193.4:0/3114485648 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6cf810fc70 0x7f6cf8114cc0 secure :-1 s=READY pgs=573 gs=1 cs=0 l=1 c_cookie=13336876070436386891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cec009950 tx=0x7f6cec02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.510+0000 7f6d00720640 1 -- 10.20.193.4:0/3114485648 shutdown_connections 2026-02-24T09:11:28.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.510+0000 7f6d00720640 1 --2- 10.20.193.4:0/3114485648 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6cf8115470 0x7f6cf8175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.510+0000 7f6d00720640 1 --2- 10.20.193.4:0/3114485648 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6cf810fc70 0x7f6cf8114cc0 unknown :-1 s=CLOSED pgs=573 gs=1 cs=0 l=1 c_cookie=13336876070436386891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.510+0000 7f6d00720640 1 --2- 10.20.193.4:0/3114485648 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6cf810f280 0x7f6cf810f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.510+0000 7f6d00720640 1 -- 10.20.193.4:0/3114485648 >> 10.20.193.4:0/3114485648 conn(0x7f6cf805f830 msgr2=0x7f6cf810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:28.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.510+0000 7f6d00720640 1 -- 10.20.193.4:0/3114485648 shutdown_connections 2026-02-24T09:11:28.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.510+0000 7f6d00720640 1 -- 10.20.193.4:0/3114485648 wait complete. 2026-02-24T09:11:28.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6d00720640 1 Processor -- start 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6d00720640 1 -- start start 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6d00720640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6cf810f280 0x7f6cf80f5550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6d00720640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6cf810fc70 0x7f6cf8175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6d00720640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6cf8115470 0x7f6cf80f5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6d00720640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80fae60 con 0x7f6cf810fc70 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6d00720640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80fafd0 con 0x7f6cf8115470 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6d00720640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80fb190 con 0x7f6cf810f280 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfdc94640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6cf810fc70 0x7f6cf8175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfdc94640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6cf810fc70 0x7f6cf8175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47602/0 (socket says 10.20.193.4:47602) 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfdc94640 1 -- 10.20.193.4:0/514557685 learned_addr learned my addr 10.20.193.4:0/514557685 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:28.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfe495640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6cf810f280 0x7f6cf80f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfec96640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6cf8115470 0x7f6cf80f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfdc94640 1 -- 10.20.193.4:0/514557685 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6cf810f280 msgr2=0x7f6cf80f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfdc94640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6cf810f280 0x7f6cf80f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfdc94640 1 -- 10.20.193.4:0/514557685 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6cf8115470 msgr2=0x7f6cf80f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfdc94640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6cf8115470 0x7f6cf80f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfdc94640 1 -- 10.20.193.4:0/514557685 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec009570 con 0x7f6cf810fc70 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cfdc94640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6cf810fc70 0x7f6cf8175d40 secure :-1 s=READY pgs=574 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cec0023d0 tx=0x7f6cec0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cdf7fe640 1 -- 10.20.193.4:0/514557685 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cec03d070 con 0x7f6cf810fc70 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cdf7fe640 1 -- 10.20.193.4:0/514557685 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6cec038920 con 0x7f6cf810fc70 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6d00720640 1 -- 10.20.193.4:0/514557685 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf80fb410 con 0x7f6cf810fc70 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6cdf7fe640 1 -- 10.20.193.4:0/514557685 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cec0419d0 con 0x7f6cf810fc70 2026-02-24T09:11:28.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.511+0000 7f6d00720640 1 -- 10.20.193.4:0/514557685 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf80fb8d0 con 0x7f6cf810fc70 2026-02-24T09:11:28.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.512+0000 7f6d00720640 1 -- 10.20.193.4:0/514557685 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf8110560 con 0x7f6cf810fc70 2026-02-24T09:11:28.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.513+0000 7f6cdf7fe640 1 -- 10.20.193.4:0/514557685 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f6cec038a90 con 0x7f6cf810fc70 2026-02-24T09:11:28.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.513+0000 7f6cdf7fe640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6cd40b5750 0x7f6cd40d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.514+0000 7f6cfe495640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6cd40b5750 0x7f6cd40d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.514+0000 7f6cdf7fe640 1 -- 10.20.193.4:0/514557685 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6cec10b8c0 con 0x7f6cf810fc70 2026-02-24T09:11:28.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.514+0000 7f6cfe495640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6cd40b5750 0x7f6cd40d5c00 secure :-1 s=READY pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce8004740 tx=0x7f6ce800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:28.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.515+0000 7f6cdf7fe640 1 -- 10.20.193.4:0/514557685 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f6cec0ce240 con 0x7f6cf810fc70 2026-02-24T09:11:28.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.645+0000 7f6d00720640 1 -- 10.20.193.4:0/514557685 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cf810f650 con 0x7f6cf810fc70 2026-02-24T09:11:28.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.646+0000 7f6cdf7fe640 1 -- 10.20.193.4:0/514557685 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f6cec0d13f0 con 0x7f6cf810fc70 2026-02-24T09:11:28.649 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:11:28.649 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:11:28.650 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:11:28.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 -- 10.20.193.4:0/514557685 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6cd40b5750 msgr2=0x7f6cd40d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6cd40b5750 0x7f6cd40d5c00 secure :-1 s=READY pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ce8004740 tx=0x7f6ce800b410 comp rx=0 tx=0).stop 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 -- 10.20.193.4:0/514557685 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6cf810fc70 msgr2=0x7f6cf8175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6cf810fc70 0x7f6cf8175d40 secure :-1 s=READY pgs=574 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cec0023d0 tx=0x7f6cec0043d0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 -- 10.20.193.4:0/514557685 shutdown_connections 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6cd40b5750 0x7f6cd40d5c00 unknown :-1 s=CLOSED pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6cf8115470 0x7f6cf80f5c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6cf810fc70 0x7f6cf8175d40 unknown :-1 s=CLOSED pgs=574 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 --2- 10.20.193.4:0/514557685 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6cf810f280 0x7f6cf80f5550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 -- 10.20.193.4:0/514557685 >> 10.20.193.4:0/514557685 conn(0x7f6cf805f830 msgr2=0x7f6cf8111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 -- 10.20.193.4:0/514557685 shutdown_connections 2026-02-24T09:11:28.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.647+0000 7f6d00720640 1 -- 10.20.193.4:0/514557685 wait complete. 2026-02-24T09:11:28.702 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id 734c5603 --release --await' 2026-02-24T09:11:28.702 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id 734c5603 --release --await 2026-02-24T09:11:28.817 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:28.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.919+0000 7fa3ad855640 1 -- 10.20.193.4:0/1716681149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa3a810fc70 msgr2=0x7fa3a8114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.919+0000 7fa3ad855640 1 --2- 10.20.193.4:0/1716681149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa3a810fc70 0x7fa3a8114cc0 secure :-1 s=READY pgs=575 gs=1 cs=0 l=1 c_cookie=1020882220737904004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa390009950 tx=0x7fa39002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.919+0000 7fa3ad855640 1 -- 10.20.193.4:0/1716681149 shutdown_connections 2026-02-24T09:11:28.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.919+0000 7fa3ad855640 1 --2- 10.20.193.4:0/1716681149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa3a8115470 0x7fa3a8175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.919+0000 7fa3ad855640 1 --2- 10.20.193.4:0/1716681149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa3a810fc70 0x7fa3a8114cc0 unknown :-1 s=CLOSED pgs=575 gs=1 cs=0 l=1 c_cookie=1020882220737904004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.919+0000 7fa3ad855640 1 --2- 10.20.193.4:0/1716681149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a810f280 0x7fa3a810f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.919+0000 7fa3ad855640 1 -- 10.20.193.4:0/1716681149 >> 10.20.193.4:0/1716681149 conn(0x7fa3a805f830 msgr2=0x7fa3a810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:28.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.919+0000 7fa3ad855640 1 -- 10.20.193.4:0/1716681149 shutdown_connections 2026-02-24T09:11:28.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.919+0000 7fa3ad855640 1 -- 10.20.193.4:0/1716681149 wait complete. 2026-02-24T09:11:28.924 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:28 trial004 ceph-mon[41596]: pgmap v202: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 543 MiB/s wr, 258 op/s 2026-02-24T09:11:28.924 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:28 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/514557685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:28.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ad855640 1 Processor -- start 2026-02-24T09:11:28.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ad855640 1 -- start start 2026-02-24T09:11:28.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ad855640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa3a810f280 0x7fa3a80f5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ad855640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa3a810fc70 0x7fa3a8175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ad855640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8115470 0x7fa3a80f5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ad855640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a80fae90 con 0x7fa3a810f280 2026-02-24T09:11:28.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ad855640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a80fb000 con 0x7fa3a810fc70 2026-02-24T09:11:28.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ad855640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a80fb1c0 con 0x7fa3a8115470 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa3a810f280 0x7fa3a80f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa3a810f280 0x7fa3a80f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47620/0 (socket says 10.20.193.4:47620) 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/2400479423 learned_addr learned my addr 10.20.193.4:0/2400479423 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa3a810fc70 0x7fa3a8175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/2400479423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8115470 msgr2=0x7fa3a80f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8115470 0x7fa3a80f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/2400479423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa3a810fc70 msgr2=0x7fa3a8175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa3a810fc70 0x7fa3a8175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/2400479423 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa390009570 con 0x7fa3a810f280 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa3a810fc70 0x7fa3a8175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa3a810f280 0x7fa3a80f5580 secure :-1 s=READY pgs=576 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39c00c8c0 tx=0x7fa39c00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:28.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ac853640 1 -- 10.20.193.4:0/2400479423 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa39c0044a0 con 0x7fa3a810f280 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ac853640 1 -- 10.20.193.4:0/2400479423 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa39c007c80 con 0x7fa3a810f280 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ad855640 1 -- 10.20.193.4:0/2400479423 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a80fb4a0 con 0x7fa3a810f280 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ac853640 1 -- 10.20.193.4:0/2400479423 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa39c00f6d0 con 0x7fa3a810f280 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.920+0000 7fa3ad855640 1 -- 10.20.193.4:0/2400479423 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a80fb920 con 0x7fa3a810f280 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.922+0000 7fa3ac853640 1 -- 10.20.193.4:0/2400479423 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fa39c0026a0 con 0x7fa3a810f280 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.923+0000 7fa3ac853640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa37c0b56d0 0x7fa37c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.923+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa37c0b56d0 0x7fa37c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.923+0000 7fa3ac853640 1 -- 10.20.193.4:0/2400479423 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa39c0e6c30 con 0x7fa3a810f280 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.923+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa37c0b56d0 0x7fa37c0d5b80 secure :-1 s=READY pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3900098a0 tx=0x7fa390031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3af84fe00 1 Processor -- start 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3af84fe00 1 -- start start 2026-02-24T09:11:28.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da16fb0 0x559e4da17380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da5c020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4da7c940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559e4d928050 con 0x559e4da5c560 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559e4d923d80 con 0x559e4da178c0 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559e4d91dee0 con 0x559e4da16fb0 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3a77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4da7c940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3a77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4da7c940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47622/0 (socket says 10.20.193.4:47622) 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3a77fe640 1 -- 10.20.193.4:0/540715976 learned_addr learned my addr 10.20.193.4:0/540715976 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/540715976 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da5c020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/540715976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da16fb0 0x559e4da17380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3a77fe640 1 -- 10.20.193.4:0/540715976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da16fb0 msgr2=0x559e4da17380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3a77fe640 1 --2- 10.20.193.4:0/540715976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da16fb0 0x559e4da17380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3a77fe640 1 -- 10.20.193.4:0/540715976 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 msgr2=0x559e4da5c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3a77fe640 1 --2- 10.20.193.4:0/540715976 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da5c020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.924+0000 7fa3a77fe640 1 -- 10.20.193.4:0/540715976 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4d8c9540 con 0x559e4da5c560 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa3a77fe640 1 --2- 10.20.193.4:0/540715976 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4da7c940 secure :-1 s=READY pgs=577 gs=1 cs=0 l=1 c_cookie=11352620555067708508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa398008b00 tx=0x7fa39800e2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8c9c3efe9bd45c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa36bfff640 1 -- 10.20.193.4:0/540715976 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa39800ed10 con 0x559e4da5c560 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa36bfff640 1 -- 10.20.193.4:0/540715976 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa39800ee70 con 0x559e4da5c560 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa36bfff640 1 -- 10.20.193.4:0/540715976 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa398011800 con 0x559e4da5c560 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa3af84fe00 1 -- 10.20.193.4:0/540715976 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 msgr2=0x559e4da7c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/540715976 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4da7c940 secure :-1 s=READY pgs=577 gs=1 cs=0 l=1 c_cookie=11352620555067708508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa398008b00 tx=0x7fa39800e2e0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa3af84fe00 1 -- 10.20.193.4:0/540715976 shutdown_connections 2026-02-24T09:11:28.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/540715976 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4da7c940 unknown :-1 s=CLOSED pgs=577 gs=1 cs=0 l=1 c_cookie=11352620555067708508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/540715976 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da5c020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/540715976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da16fb0 0x559e4da17380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa3af84fe00 1 -- 10.20.193.4:0/540715976 >> 10.20.193.4:0/540715976 conn(0x559e4d9f54b0 msgr2=0x559e4da15890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa3af84fe00 1 -- 10.20.193.4:0/540715976 shutdown_connections 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.925+0000 7fa3af84fe00 1 -- 10.20.193.4:0/540715976 wait complete. 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 1 -- start start 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 1 Processor -- start 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da73e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da74360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da5c560 0x559e4da79350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559e4da79890 con 0x559e4da16fb0 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559e4da79a00 con 0x559e4da178c0 2026-02-24T09:11:28.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559e4da79bc0 con 0x559e4da5c560 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da73e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da73e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47638/0 (socket says 10.20.193.4:47638) 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/3710529456 learned_addr learned my addr 10.20.193.4:0/3710529456 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da74360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/3710529456 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da5c560 msgr2=0x559e4da79350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da5c560 0x559e4da79350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/3710529456 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 msgr2=0x559e4da74360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da74360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/3710529456 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4d8a1bd0 con 0x559e4da16fb0 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da74360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:28.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da73e20 secure :-1 s=READY pgs=578 gs=1 cs=0 l=1 c_cookie=13859091063568437075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39c0e4790 tx=0x7fa39c0a9700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05561e4c9c98f53 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3697fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3697fa640 1 -- 10.20.193.4:0/3710529456 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa39c0b7e70 con 0x559e4da16fb0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 1 -- 10.20.193.4:0/3710529456 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa398008720 con 0x559e4da16fb0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3697fa640 1 -- 10.20.193.4:0/3710529456 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa39c007df0 con 0x559e4da16fb0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3697fa640 1 -- 10.20.193.4:0/3710529456 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa39c072320 con 0x559e4da16fb0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 10 client.15960 _ll_register_callbacks cb 0x559e4d90c290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.926+0000 7fa3af84fe00 1 -- 10.20.193.4:0/3710529456 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559e4d66d700 con 0x559e4da16fb0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3697fa640 1 -- 10.20.193.4:0/3710529456 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa39c01e260 con 0x559e4da16fb0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3697fa640 1 -- 10.20.193.4:0/3710529456 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa39c0aaf80 con 0x559e4da16fb0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3af84fe00 10 client.15960 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3af84fe00 1 -- 10.20.193.4:0/3710529456 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559e4d8b3910 con 0x559e4da16fb0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3697fa640 1 -- 10.20.193.4:0/3710529456 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa39c0ab0e0 con 0x559e4da16fb0 2026-02-24T09:11:28.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3af84fe00 10 client.15960 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3af84fe00 10 client.15960 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3af84fe00 20 client.15960 populate_metadata read hostname 'trial004' 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559e4da59900 0x559e4da59da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3af84fe00 4 client.15960 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3af84fe00 1 -- 10.20.193.4:0/3710529456 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e4d913920 con 0x559e4da59900 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.927+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559e4da59900 0x559e4da59da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559e4da59900 0x559e4da59da0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=9086738881757245199 s_cookie=1019541733775053750 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1a94de8ddeef0f server_cookie=e2623ce1b5913b6 in_seq=0 out_seq=0 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3697fa640 10 client.15960 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3697fa640 1 -- 10.20.193.4:0/3710529456 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559e4d913920 con 0x559e4da59900 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3697fa640 10 client.15960 handle_command_reply: tid=0 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3af84fe00 1 client.15960 shutdown 2026-02-24T09:11:28.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3af84fe00 1 -- 10.20.193.4:0/3710529456 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 msgr2=0x559e4da73e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da73e20 secure :-1 s=READY pgs=578 gs=1 cs=0 l=1 c_cookie=13859091063568437075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39c0e4790 tx=0x7fa39c0a9700 comp rx=0 tx=0).stop 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3af84fe00 1 -- 10.20.193.4:0/3710529456 shutdown_connections 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559e4da59900 0x559e4da59da0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=9086738881757245199 s_cookie=1019541733775053750 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da5c560 0x559e4da79350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da74360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3697fa640 0 client.15960 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/3710529456 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da73e20 unknown :-1 s=CLOSED pgs=578 gs=1 cs=0 l=1 c_cookie=13859091063568437075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.928+0000 7fa3af84fe00 1 -- 10.20.193.4:0/3710529456 >> 10.20.193.4:0/3710529456 conn(0x559e4d9f54b0 msgr2=0x559e4da15890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.929+0000 7fa3af84fe00 1 -- 10.20.193.4:0/3710529456 shutdown_connections 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.929+0000 7fa3af84fe00 1 -- 10.20.193.4:0/3710529456 wait complete. 2026-02-24T09:11:28.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.929+0000 7fa3af84fe00 20 client.15960 trim_cache size 0 max 16384 2026-02-24T09:11:28.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3af84fe00 1 Processor -- start 2026-02-24T09:11:28.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3af84fe00 1 -- start start 2026-02-24T09:11:28.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da788c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da571a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da5c560 0x559e4da576e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559e4d91bb10 con 0x559e4da16fb0 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559e4d5e71b0 con 0x559e4da178c0 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559e4da17dd0 con 0x559e4da5c560 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3a6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3a6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da788c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47644/0 (socket says 10.20.193.4:47644) 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/1773400827 learned_addr learned my addr 10.20.193.4:0/1773400827 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/1773400827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/1773400827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da5c560 msgr2=0x559e4da576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/1773400827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da5c560 0x559e4da576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/1773400827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 msgr2=0x559e4da571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/1773400827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.937+0000 7fa3a6ffd640 1 -- 10.20.193.4:0/1773400827 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4d8ae390 con 0x559e4da16fb0 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/1773400827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da788c0 secure :-1 s=READY pgs=579 gs=1 cs=0 l=1 c_cookie=13234759410946849500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39c00f830 tx=0x7fa39c075000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ab4f90413ebadc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa36b7fe640 1 -- 10.20.193.4:0/1773400827 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa39c007df0 con 0x559e4da16fb0 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa36b7fe640 1 -- 10.20.193.4:0/1773400827 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559e4d66d700 con 0x559e4da16fb0 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa36b7fe640 1 -- 10.20.193.4:0/1773400827 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa39c0b41e0 con 0x559e4da16fb0 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1773400827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 msgr2=0x559e4da788c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/1773400827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da788c0 secure :-1 s=READY pgs=579 gs=1 cs=0 l=1 c_cookie=13234759410946849500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39c00f830 tx=0x7fa39c075000 comp rx=0 tx=0).stop 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1773400827 shutdown_connections 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/1773400827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da5c560 0x559e4da576e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/1773400827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4da571a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/1773400827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da16fb0 0x559e4da788c0 unknown :-1 s=CLOSED pgs=579 gs=1 cs=0 l=1 c_cookie=13234759410946849500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1773400827 >> 10.20.193.4:0/1773400827 conn(0x559e4d9f54b0 msgr2=0x559e4da781b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:28.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1773400827 shutdown_connections 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1773400827 wait complete. 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 -- start start 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.938+0000 7fa3af84fe00 1 Processor -- start 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da16fb0 0x559e4da78a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4d9f5880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4d9f5dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559e4dac35a0 con 0x559e4da5c560 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559e4d9f6300 con 0x559e4da178c0 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559e4d9f64c0 con 0x559e4da16fb0 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4d9f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4d9f5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47646/0 (socket says 10.20.193.4:47646) 2026-02-24T09:11:28.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a77fe640 1 -- 10.20.193.4:0/1775849843 learned_addr learned my addr 10.20.193.4:0/1775849843 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4d9f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a77fe640 1 -- 10.20.193.4:0/1775849843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da16fb0 msgr2=0x559e4da78a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a77fe640 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da16fb0 0x559e4da78a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a77fe640 1 -- 10.20.193.4:0/1775849843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 msgr2=0x559e4d9f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a77fe640 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4d9f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a77fe640 1 -- 10.20.193.4:0/1775849843 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4d8a1f00 con 0x559e4da5c560 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a67fc640 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4d9f5880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3a77fe640 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4d9f5dc0 secure :-1 s=READY pgs=580 gs=1 cs=0 l=1 c_cookie=16499191207263057790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa398008360 tx=0x7fa398005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f8e6fc8e29b77e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3697fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3697fa640 1 -- 10.20.193.4:0/1775849843 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa39800eca0 con 0x559e4da5c560 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1775849843 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e4d8b3910 con 0x559e4da5c560 2026-02-24T09:11:28.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3697fa640 1 -- 10.20.193.4:0/1775849843 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa398005680 con 0x559e4da5c560 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3697fa640 1 -- 10.20.193.4:0/1775849843 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa398011c60 con 0x559e4da5c560 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 10 client.15966 _ll_register_callbacks cb 0x559e4d90c290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1775849843 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa39800ee70 con 0x559e4da5c560 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3697fa640 1 -- 10.20.193.4:0/1775849843 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa398011df0 con 0x559e4da5c560 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3697fa640 1 -- 10.20.193.4:0/1775849843 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa39801c440 con 0x559e4da5c560 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 10 client.15966 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1775849843 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559e4d8b3b70 con 0x559e4da5c560 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3697fa640 1 -- 10.20.193.4:0/1775849843 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa398011460 con 0x559e4da5c560 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 10 client.15966 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 10 client.15966 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 20 client.15966 populate_metadata read hostname 'trial004' 2026-02-24T09:11:28.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559e4db0a450 0x559e4db2a900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 4 client.15966 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "734c5603", "release": true, "await": true}] 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.939+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1775849843 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "734c5603", "release": true, "await": true}) -- 0x559e4d6523c0 con 0x559e4db0a450 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.940+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559e4db0a450 0x559e4db2a900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.940+0000 7fa3a6ffd640 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559e4db0a450 0x559e4db2a900 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=12078026917138974273 s_cookie=8192470504575381674 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a79dc57d2facc641 server_cookie=71b18084b214b0aa in_seq=0 out_seq=0 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.940+0000 7fa3697fa640 10 client.15966 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3697fa640 1 -- 10.20.193.4:0/1775849843 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559e4d6523c0 con 0x559e4db0a450 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3697fa640 10 client.15966 handle_command_reply: tid=0 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 client.15966 shutdown 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1775849843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 msgr2=0x559e4d9f5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4d9f5dc0 secure :-1 s=READY pgs=580 gs=1 cs=0 l=1 c_cookie=16499191207263057790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa398008360 tx=0x7fa398005300 comp rx=0 tx=0).stop 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1775849843 shutdown_connections 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559e4db0a450 0x559e4db2a900 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=12078026917138974273 s_cookie=8192470504575381674 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559e4da5c560 0x559e4d9f5dc0 unknown :-1 s=CLOSED pgs=580 gs=1 cs=0 l=1 c_cookie=16499191207263057790 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3697fa640 0 client.15966 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:28.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559e4da178c0 0x559e4d9f5880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 --2- 10.20.193.4:0/1775849843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559e4da16fb0 0x559e4da78a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1775849843 >> 10.20.193.4:0/1775849843 conn(0x559e4d9f54b0 msgr2=0x559e4da709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:28.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1775849843 shutdown_connections 2026-02-24T09:11:28.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 1 -- 10.20.193.4:0/1775849843 wait complete. 2026-02-24T09:11:28.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3af84fe00 20 client.15966 trim_cache size 0 max 16384 2026-02-24T09:11:28.958 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:11:28.958 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 8, 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "734c5603": { 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "version": 8, 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 142.0, 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:11:28.959 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:11:28.960 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:11:28.960 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:11:28.960 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:11:28.960 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:11:28.960 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:28.960 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:28.960 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:28.960 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:28.960 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:28.960 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:11:28.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 -- 10.20.193.4:0/2400479423 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa37c0b56d0 msgr2=0x7fa37c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa37c0b56d0 0x7fa37c0d5b80 secure :-1 s=READY pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3900098a0 tx=0x7fa390031040 comp rx=0 tx=0).stop 2026-02-24T09:11:28.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 -- 10.20.193.4:0/2400479423 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa3a810f280 msgr2=0x7fa3a80f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:28.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa3a810f280 0x7fa3a80f5580 secure :-1 s=READY pgs=576 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39c00c8c0 tx=0x7fa39c00cd90 comp rx=0 tx=0).stop 2026-02-24T09:11:28.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 -- 10.20.193.4:0/2400479423 shutdown_connections 2026-02-24T09:11:28.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa37c0b56d0 0x7fa37c0d5b80 unknown :-1 s=CLOSED pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8115470 0x7fa3a80f5c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa3a810fc70 0x7fa3a8175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 --2- 10.20.193.4:0/2400479423 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa3a810f280 0x7fa3a80f5580 unknown :-1 s=CLOSED pgs=576 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:28.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 -- 10.20.193.4:0/2400479423 >> 10.20.193.4:0/2400479423 conn(0x7fa3a805f830 msgr2=0x7fa3a8111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:28.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.942+0000 7fa3ad855640 1 -- 10.20.193.4:0/2400479423 shutdown_connections 2026-02-24T09:11:28.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:28.943+0000 7fa3ad855640 1 -- 10.20.193.4:0/2400479423 wait complete. 2026-02-24T09:11:29.003 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '734c5603', total seconds elapsed: 22.7 2026-02-24T09:11:29.003 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.0 2026-02-24T09:11:29.003 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:11:29.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:28 trial090 ceph-mon[47278]: pgmap v202: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 543 MiB/s wr, 258 op/s 2026-02-24T09:11:29.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:28 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/514557685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:29.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:28 trial014 ceph-mon[46941]: pgmap v202: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 543 MiB/s wr, 258 op/s 2026-02-24T09:11:29.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:28 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/514557685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:29.160 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:29.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 -- 10.20.193.4:0/3033116351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f88c8115470 msgr2=0x7f88c8175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 --2- 10.20.193.4:0/3033116351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f88c8115470 0x7f88c8175e40 secure :-1 s=READY pgs=581 gs=1 cs=0 l=1 c_cookie=6035432342648857637 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88c400aa30 tx=0x7f88c4030280 comp rx=0 tx=0).stop 2026-02-24T09:11:29.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 -- 10.20.193.4:0/3033116351 shutdown_connections 2026-02-24T09:11:29.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 --2- 10.20.193.4:0/3033116351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f88c8115470 0x7f88c8175e40 unknown :-1 s=CLOSED pgs=581 gs=1 cs=0 l=1 c_cookie=6035432342648857637 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 --2- 10.20.193.4:0/3033116351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f88c810fc70 0x7f88c8114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 --2- 10.20.193.4:0/3033116351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88c810f280 0x7f88c810f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 -- 10.20.193.4:0/3033116351 >> 10.20.193.4:0/3033116351 conn(0x7f88c805f830 msgr2=0x7f88c810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:29.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 -- 10.20.193.4:0/3033116351 shutdown_connections 2026-02-24T09:11:29.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 -- 10.20.193.4:0/3033116351 wait complete. 2026-02-24T09:11:29.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 Processor -- start 2026-02-24T09:11:29.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 -- start start 2026-02-24T09:11:29.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88c810f280 0x7f88c811db80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f88c810fc70 0x7f88c811e0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f88c8115470 0x7f88c8123490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8123ab0 con 0x7f88c810fc70 2026-02-24T09:11:29.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8123c20 con 0x7f88c8115470 2026-02-24T09:11:29.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cfef3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8123de0 con 0x7f88c810f280 2026-02-24T09:11:29.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cd467640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f88c810fc70 0x7f88c811e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cd467640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f88c810fc70 0x7f88c811e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47676/0 (socket says 10.20.193.4:47676) 2026-02-24T09:11:29.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.295+0000 7f88cd467640 1 -- 10.20.193.4:0/3500306451 learned_addr learned my addr 10.20.193.4:0/3500306451 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:29.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88ce469640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f88c8115470 0x7f88c8123490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88cdc68640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88c810f280 0x7f88c811db80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88cd467640 1 -- 10.20.193.4:0/3500306451 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88c810f280 msgr2=0x7f88c811db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88cd467640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88c810f280 0x7f88c811db80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88cd467640 1 -- 10.20.193.4:0/3500306451 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f88c8115470 msgr2=0x7f88c8123490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88cd467640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f88c8115470 0x7f88c8123490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88cd467640 1 -- 10.20.193.4:0/3500306451 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c400a650 con 0x7f88c810fc70 2026-02-24T09:11:29.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88cdc68640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88c810f280 0x7f88c811db80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:29.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88cd467640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f88c810fc70 0x7f88c811e0c0 secure :-1 s=READY pgs=582 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88bc00d950 tx=0x7f88bc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:29.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88b6ffd640 1 -- 10.20.193.4:0/3500306451 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88bc004540 con 0x7f88c810fc70 2026-02-24T09:11:29.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88cfef3640 1 -- 10.20.193.4:0/3500306451 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c81240c0 con 0x7f88c810fc70 2026-02-24T09:11:29.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88b6ffd640 1 -- 10.20.193.4:0/3500306451 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f88bc009d00 con 0x7f88c810fc70 2026-02-24T09:11:29.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88b6ffd640 1 -- 10.20.193.4:0/3500306451 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88bc010680 con 0x7f88c810fc70 2026-02-24T09:11:29.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.296+0000 7f88cfef3640 1 -- 10.20.193.4:0/3500306451 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c81647c0 con 0x7f88c810fc70 2026-02-24T09:11:29.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.297+0000 7f88cfef3640 1 -- 10.20.193.4:0/3500306451 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c8110560 con 0x7f88c810fc70 2026-02-24T09:11:29.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.299+0000 7f88b6ffd640 1 -- 10.20.193.4:0/3500306451 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f88bc021020 con 0x7f88c810fc70 2026-02-24T09:11:29.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.299+0000 7f88b6ffd640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88a40b56e0 0x7f88a40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.299+0000 7f88b6ffd640 1 -- 10.20.193.4:0/3500306451 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f88bc0e67b0 con 0x7f88c810fc70 2026-02-24T09:11:29.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.299+0000 7f88cdc68640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88a40b56e0 0x7f88a40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.300+0000 7f88b6ffd640 1 -- 10.20.193.4:0/3500306451 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f88bc0a9130 con 0x7f88c810fc70 2026-02-24T09:11:29.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.300+0000 7f88cdc68640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88a40b56e0 0x7f88a40d5b90 secure :-1 s=READY pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b8004740 tx=0x7f88b8005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:29.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.457+0000 7f88cfef3640 1 -- 10.20.193.4:0/3500306451 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88c811ed40 con 0x7f88c810fc70 2026-02-24T09:11:29.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.458+0000 7f88b6ffd640 1 -- 10.20.193.4:0/3500306451 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f88bc0ac2e0 con 0x7f88c810fc70 2026-02-24T09:11:29.462 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:11:29.462 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:11:29.462 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:11:29.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 -- 10.20.193.4:0/3500306451 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88a40b56e0 msgr2=0x7f88a40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88a40b56e0 0x7f88a40d5b90 secure :-1 s=READY pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b8004740 tx=0x7f88b8005f00 comp rx=0 tx=0).stop 2026-02-24T09:11:29.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 -- 10.20.193.4:0/3500306451 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f88c810fc70 msgr2=0x7f88c811e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f88c810fc70 0x7f88c811e0c0 secure :-1 s=READY pgs=582 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88bc00d950 tx=0x7f88bc00de20 comp rx=0 tx=0).stop 2026-02-24T09:11:29.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 -- 10.20.193.4:0/3500306451 shutdown_connections 2026-02-24T09:11:29.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f88a40b56e0 0x7f88a40d5b90 unknown :-1 s=CLOSED pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f88c8115470 0x7f88c8123490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f88c810fc70 0x7f88c811e0c0 unknown :-1 s=CLOSED pgs=582 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 --2- 10.20.193.4:0/3500306451 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88c810f280 0x7f88c811db80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 -- 10.20.193.4:0/3500306451 >> 10.20.193.4:0/3500306451 conn(0x7f88c805f830 msgr2=0x7f88c810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:29.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 -- 10.20.193.4:0/3500306451 shutdown_connections 2026-02-24T09:11:29.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.463+0000 7f88cfef3640 1 -- 10.20.193.4:0/3500306451 wait complete. 2026-02-24T09:11:29.574 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 142.0 --await-for 45.0' 2026-02-24T09:11:29.574 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 142.0 --await-for 45.0 2026-02-24T09:11:29.721 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:29.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.868+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2403425601 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6fcc060090 msgr2=0x7f6fcc060460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.868+0000 7f6fd19d7640 1 --2- 10.20.193.4:0/2403425601 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6fcc060090 0x7f6fcc060460 secure :-1 s=READY pgs=583 gs=1 cs=0 l=1 c_cookie=2210648371828511826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fc0009950 tx=0x7f6fc002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2403425601 shutdown_connections 2026-02-24T09:11:29.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 --2- 10.20.193.4:0/2403425601 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6fcc113630 0x7f6fcc174000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 --2- 10.20.193.4:0/2403425601 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6fcc060a80 0x7f6fcc112e80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 --2- 10.20.193.4:0/2403425601 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6fcc060090 0x7f6fcc060460 unknown :-1 s=CLOSED pgs=583 gs=1 cs=0 l=1 c_cookie=2210648371828511826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2403425601 >> 10.20.193.4:0/2403425601 conn(0x7f6fcc0e9bf0 msgr2=0x7f6fcc10a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:29.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2403425601 shutdown_connections 2026-02-24T09:11:29.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2403425601 wait complete. 2026-02-24T09:11:29.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 Processor -- start 2026-02-24T09:11:29.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 -- start start 2026-02-24T09:11:29.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6fcc060090 0x7f6fcc11bdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6fcc060a80 0x7f6fcc11c2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6fcc113630 0x7f6fcc1216c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc121ce0 con 0x7f6fcc060090 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc121e50 con 0x7f6fcc113630 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fd19d7640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc122010 con 0x7f6fcc060a80 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fcaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6fcc060090 0x7f6fcc11bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fcaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6fcc060090 0x7f6fcc11bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47692/0 (socket says 10.20.193.4:47692) 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fcaffd640 1 -- 10.20.193.4:0/2816878301 learned_addr learned my addr 10.20.193.4:0/2816878301 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6fcc113630 0x7f6fcc1216c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fca7fc640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6fcc060a80 0x7f6fcc11c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fcaffd640 1 -- 10.20.193.4:0/2816878301 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6fcc060a80 msgr2=0x7f6fcc11c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6fcc060a80 0x7f6fcc11c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fcaffd640 1 -- 10.20.193.4:0/2816878301 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6fcc113630 msgr2=0x7f6fcc1216c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6fcc113630 0x7f6fcc1216c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.869+0000 7f6fcaffd640 1 -- 10.20.193.4:0/2816878301 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc0009570 con 0x7f6fcc060090 2026-02-24T09:11:29.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.870+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6fcc060090 0x7f6fcc11bdb0 secure :-1 s=READY pgs=584 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fc00023d0 tx=0x7f6fc00043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:29.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.870+0000 7f6fd09d5640 1 -- 10.20.193.4:0/2816878301 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fc003d070 con 0x7f6fcc060090 2026-02-24T09:11:29.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.870+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2816878301 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fcc122290 con 0x7f6fcc060090 2026-02-24T09:11:29.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.870+0000 7f6fd09d5640 1 -- 10.20.193.4:0/2816878301 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6fc0038920 con 0x7f6fcc060090 2026-02-24T09:11:29.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.870+0000 7f6fd09d5640 1 -- 10.20.193.4:0/2816878301 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fc00419d0 con 0x7f6fcc060090 2026-02-24T09:11:29.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.870+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2816878301 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fcc1629f0 con 0x7f6fcc060090 2026-02-24T09:11:29.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.872+0000 7f6fd09d5640 1 -- 10.20.193.4:0/2816878301 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f6fc0038a90 con 0x7f6fcc060090 2026-02-24T09:11:29.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.873+0000 7f6fd09d5640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6fa00b56e0 0x7f6fa00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.873+0000 7f6fd09d5640 1 -- 10.20.193.4:0/2816878301 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6fc010b370 con 0x7f6fcc060090 2026-02-24T09:11:29.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.873+0000 7f6fca7fc640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6fa00b56e0 0x7f6fa00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.874+0000 7f6fca7fc640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6fa00b56e0 0x7f6fa00d5b90 secure :-1 s=READY pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fb4005970 tx=0x7f6fb4005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:29.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.879+0000 7f6fd39d1e00 1 Processor -- start 2026-02-24T09:11:29.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.879+0000 7f6fd39d1e00 1 -- start start 2026-02-24T09:11:29.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd972f8bd0 0x55dd972f8fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd9733dc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd9733e180 0x55dd9735e560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55dd97207f20 con 0x55dd972f8bd0 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55dd97203c50 con 0x55dd972f94e0 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55dd971fddb0 con 0x55dd9733e180 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fcaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd972f8bd0 0x55dd972f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fcaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd972f8bd0 0x55dd972f8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47708/0 (socket says 10.20.193.4:47708) 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fcaffd640 1 -- 10.20.193.4:0/3929448111 learned_addr learned my addr 10.20.193.4:0/3929448111 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/3929448111 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd9733e180 0x55dd9735e560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fcaffd640 1 -- 10.20.193.4:0/3929448111 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd9733e180 msgr2=0x55dd9735e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/3929448111 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd9733e180 0x55dd9735e560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fcaffd640 1 -- 10.20.193.4:0/3929448111 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 msgr2=0x55dd9733dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:29.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/3929448111 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd9733dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fcaffd640 1 -- 10.20.193.4:0/3929448111 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd9719e690 con 0x55dd972f8bd0 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/3929448111 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd972f8bd0 0x55dd972f8fa0 secure :-1 s=READY pgs=585 gs=1 cs=0 l=1 c_cookie=13846872230522721382 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fc0009480 tx=0x7f6fc0002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c029f8ee06871466 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6f8ffff640 1 -- 10.20.193.4:0/3929448111 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fc00d1080 con 0x55dd972f8bd0 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6f8ffff640 1 -- 10.20.193.4:0/3929448111 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6fc00d0ea0 con 0x55dd972f8bd0 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.880+0000 7f6f8ffff640 1 -- 10.20.193.4:0/3929448111 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fc00dc350 con 0x55dd972f8bd0 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.881+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/3929448111 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd972f8bd0 msgr2=0x55dd972f8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.881+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/3929448111 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd972f8bd0 0x55dd972f8fa0 secure :-1 s=READY pgs=585 gs=1 cs=0 l=1 c_cookie=13846872230522721382 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fc0009480 tx=0x7f6fc0002b90 comp rx=0 tx=0).stop 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.881+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/3929448111 shutdown_connections 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.881+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/3929448111 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd9733e180 0x55dd9735e560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.881+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/3929448111 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd9733dc40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.881+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/3929448111 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd972f8bd0 0x55dd972f8fa0 unknown :-1 s=CLOSED pgs=585 gs=1 cs=0 l=1 c_cookie=13846872230522721382 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.881+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/3929448111 >> 10.20.193.4:0/3929448111 conn(0x55dd97216880 msgr2=0x55dd972f74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:29.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.881+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/3929448111 shutdown_connections 2026-02-24T09:11:29.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.881+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/3929448111 wait complete. 2026-02-24T09:11:29.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fd39d1e00 1 -- start start 2026-02-24T09:11:29.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fd39d1e00 1 Processor -- start 2026-02-24T09:11:29.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f8bd0 0x55dd97314c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd97315140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9731a130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55dd9731a670 con 0x55dd9733e180 2026-02-24T09:11:29.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55dd9731a7e0 con 0x55dd972f94e0 2026-02-24T09:11:29.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55dd9731a9a0 con 0x55dd972f8bd0 2026-02-24T09:11:29.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fcb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9731a130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fcb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9731a130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47716/0 (socket says 10.20.193.4:47716) 2026-02-24T09:11:29.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fcaffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f8bd0 0x55dd97314c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/1442212294 learned_addr learned my addr 10.20.193.4:0/1442212294 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:29.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.883+0000 7f6fca7fc640 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd97315140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/1442212294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f8bd0 msgr2=0x55dd97314c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:29.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f8bd0 0x55dd97314c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/1442212294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 msgr2=0x55dd97315140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:29.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd97315140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/1442212294 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd971a93d0 con 0x55dd9733e180 2026-02-24T09:11:29.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9731a130 secure :-1 s=READY pgs=586 gs=2 cs=0 l=1 c_cookie=3372919838392630218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fbc005170 tx=0x7f6fbc011740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecf04b8f742bbca server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:29.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6f8d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:29.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/1442212294 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fbc013880 con 0x55dd9733e180 2026-02-24T09:11:29.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1442212294 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fcc1629f0 con 0x55dd9733e180 2026-02-24T09:11:29.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/1442212294 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6fbc01b400 con 0x55dd9733e180 2026-02-24T09:11:29.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/1442212294 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fbc012660 con 0x55dd9733e180 2026-02-24T09:11:29.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 10 client.15984 _ll_register_callbacks cb 0x55dd9717ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:29.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/1442212294 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6fbc0127f0 con 0x55dd9733e180 2026-02-24T09:11:29.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1442212294 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dd96e8beb0 con 0x55dd9733e180 2026-02-24T09:11:29.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/1442212294 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6fbc0129b0 con 0x55dd9733e180 2026-02-24T09:11:29.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 10 client.15984 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:29.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1442212294 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55dd971815c0 con 0x55dd9733e180 2026-02-24T09:11:29.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/1442212294 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6fbc019020 con 0x55dd9733e180 2026-02-24T09:11:29.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 10 client.15984 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:29.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 10 client.15984 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:11:29.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 20 client.15984 populate_metadata read hostname 'trial004' 2026-02-24T09:11:29.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55dd9737f8b0 0x55dd9739fd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 4 client.15984 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:29.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.884+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1442212294 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd9720ef00 con 0x55dd9737f8b0 2026-02-24T09:11:29.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.885+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55dd9737f8b0 0x55dd9739fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.885+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55dd9737f8b0 0x55dd9739fd40 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=17478158653744265920 s_cookie=17886586993179336682 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f28ee4b13c58bac0 server_cookie=f839ec1a64939fea in_seq=0 out_seq=0 2026-02-24T09:11:29.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.885+0000 7f6f8d7fa640 10 client.15984 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:29.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.885+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/1442212294 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55dd9720ef00 con 0x55dd9737f8b0 2026-02-24T09:11:29.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.885+0000 7f6f8d7fa640 10 client.15984 handle_command_reply: tid=0 2026-02-24T09:11:29.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.885+0000 7f6fd39d1e00 1 client.15984 shutdown 2026-02-24T09:11:29.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.885+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1442212294 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 msgr2=0x55dd9731a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.885+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9731a130 secure :-1 s=READY pgs=586 gs=2 cs=0 l=1 c_cookie=3372919838392630218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fbc005170 tx=0x7f6fbc011740 comp rx=0 tx=0).stop 2026-02-24T09:11:29.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.886+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1442212294 shutdown_connections 2026-02-24T09:11:29.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.886+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55dd9737f8b0 0x55dd9739fd40 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=17478158653744265920 s_cookie=17886586993179336682 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.886+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9731a130 unknown :-1 s=CLOSED pgs=586 gs=2 cs=0 l=1 c_cookie=3372919838392630218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.886+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd97315140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.886+0000 7f6f8d7fa640 0 client.15984 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:29.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.886+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/1442212294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f8bd0 0x55dd97314c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.886+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1442212294 >> 10.20.193.4:0/1442212294 conn(0x55dd97216880 msgr2=0x55dd972f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:29.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.886+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1442212294 shutdown_connections 2026-02-24T09:11:29.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.886+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1442212294 wait complete. 2026-02-24T09:11:29.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.886+0000 7f6fd39d1e00 20 client.15984 trim_cache size 0 max 16384 2026-02-24T09:11:29.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fd39d1e00 1 Processor -- start 2026-02-24T09:11:29.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fd39d1e00 1 -- start start 2026-02-24T09:11:29.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f8bd0 0x55dd97315130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f94e0 0x55dd9733a2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9733a830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55dd971fb9e0 con 0x55dd9733e180 2026-02-24T09:11:29.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55dd96eb3ec0 con 0x55dd972f8bd0 2026-02-24T09:11:29.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55dd97267580 con 0x55dd972f94e0 2026-02-24T09:11:29.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fcb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9733a830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fcb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9733a830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47728/0 (socket says 10.20.193.4:47728) 2026-02-24T09:11:29.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/1224704226 learned_addr learned my addr 10.20.193.4:0/1224704226 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:29.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/1224704226 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f8bd0 0x55dd97315130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/1224704226 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f94e0 msgr2=0x55dd9733a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:29.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/1224704226 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f94e0 0x55dd9733a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/1224704226 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f8bd0 msgr2=0x55dd97315130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:29.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/1224704226 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f8bd0 0x55dd97315130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.900+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/1224704226 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd97193500 con 0x55dd9733e180 2026-02-24T09:11:29.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.901+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/1224704226 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f8bd0 0x55dd97315130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:29.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.901+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/1224704226 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9733a830 secure :-1 s=READY pgs=587 gs=1 cs=0 l=1 c_cookie=15734978996603603659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fbc0034b0 tx=0x7f6fbc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5de007a8ca4acb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:29.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.901+0000 7f6f8f7fe640 1 -- 10.20.193.4:0/1224704226 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fbc006d20 con 0x55dd9733e180 2026-02-24T09:11:29.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.901+0000 7f6f8f7fe640 1 -- 10.20.193.4:0/1224704226 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6fbc029020 con 0x55dd9733e180 2026-02-24T09:11:29.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.901+0000 7f6f8f7fe640 1 -- 10.20.193.4:0/1224704226 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fbc00f3d0 con 0x55dd9733e180 2026-02-24T09:11:29.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.902+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1224704226 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 msgr2=0x55dd9733a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.902+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/1224704226 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9733a830 secure :-1 s=READY pgs=587 gs=1 cs=0 l=1 c_cookie=15734978996603603659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fbc0034b0 tx=0x7f6fbc01f000 comp rx=0 tx=0).stop 2026-02-24T09:11:29.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.902+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1224704226 shutdown_connections 2026-02-24T09:11:29.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.902+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/1224704226 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd9733a830 unknown :-1 s=CLOSED pgs=587 gs=1 cs=0 l=1 c_cookie=15734978996603603659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.902+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/1224704226 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f94e0 0x55dd9733a2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.902+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/1224704226 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f8bd0 0x55dd97315130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.902+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1224704226 >> 10.20.193.4:0/1224704226 conn(0x55dd97216880 msgr2=0x55dd9730cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:29.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.902+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1224704226 shutdown_connections 2026-02-24T09:11:29.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.902+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/1224704226 wait complete. 2026-02-24T09:11:29.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fd39d1e00 1 -- start start 2026-02-24T09:11:29.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fd39d1e00 1 Processor -- start 2026-02-24T09:11:29.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f8bd0 0x55dd97312e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd97313380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fd39d1e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd973a3430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55dd973a3970 con 0x55dd9733e180 2026-02-24T09:11:29.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55dd973a3ae0 con 0x55dd972f94e0 2026-02-24T09:11:29.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fd39d1e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55dd973a3c50 con 0x55dd972f8bd0 2026-02-24T09:11:29.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fcb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd973a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fcb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd973a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47742/0 (socket says 10.20.193.4:47742) 2026-02-24T09:11:29.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/4227730115 learned_addr learned my addr 10.20.193.4:0/4227730115 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:29.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f8bd0 0x55dd97312e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fca7fc640 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd97313380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/4227730115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f8bd0 msgr2=0x55dd97312e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:29.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f8bd0 0x55dd97312e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/4227730115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 msgr2=0x55dd97313380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:29.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd97313380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.903+0000 7f6fcb7fe640 1 -- 10.20.193.4:0/4227730115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd9718df80 con 0x55dd9733e180 2026-02-24T09:11:29.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fcb7fe640 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd973a3430 secure :-1 s=READY pgs=588 gs=1 cs=0 l=1 c_cookie=2756298412482947696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fbc003750 tx=0x7f6fbc011740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264056cd7b04ea70 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:29.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6f8d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:29.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/4227730115 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fbc00fe00 con 0x55dd9733e180 2026-02-24T09:11:29.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/4227730115 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6fbc029040 con 0x55dd9733e180 2026-02-24T09:11:29.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/4227730115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd971815c0 con 0x55dd9733e180 2026-02-24T09:11:29.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/4227730115 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fbc005c30 con 0x55dd9733e180 2026-02-24T09:11:29.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 10 client.15990 _ll_register_callbacks cb 0x55dd9717ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:29.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/4227730115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dd96e89700 con 0x55dd9733e180 2026-02-24T09:11:29.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/4227730115 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6fbc02a060 con 0x55dd9733e180 2026-02-24T09:11:29.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/4227730115 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6fbc005e40 con 0x55dd9733e180 2026-02-24T09:11:29.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 10 client.15990 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:29.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/4227730115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55dd971818f0 con 0x55dd9733e180 2026-02-24T09:11:29.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/4227730115 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6fbc019070 con 0x55dd9733e180 2026-02-24T09:11:29.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 10 client.15990 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:29.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 10 client.15990 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:11:29.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 20 client.15990 populate_metadata read hostname 'trial004' 2026-02-24T09:11:29.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55dd9737f8b0 0x55dd973a5480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:29.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 4 client.15990 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.0, "await_for": 45.0}] 2026-02-24T09:11:29.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/4227730115 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.0, "await_for": 45.0}) -- 0x55dd97210b70 con 0x55dd9737f8b0 2026-02-24T09:11:29.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.904+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55dd9737f8b0 0x55dd973a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:29.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.905+0000 7f6fcaffd640 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55dd9737f8b0 0x55dd973a5480 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=8525338140764352785 s_cookie=6498212919964992148 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=765015deae593111 server_cookie=5a2e4a38c15e0294 in_seq=0 out_seq=0 2026-02-24T09:11:29.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.905+0000 7f6f8d7fa640 10 client.15990 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:29.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.917+0000 7f6f8d7fa640 1 -- 10.20.193.4:0/4227730115 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55dd97210b70 con 0x55dd9737f8b0 2026-02-24T09:11:29.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.917+0000 7f6f8d7fa640 10 client.15990 handle_command_reply: tid=0 2026-02-24T09:11:29.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.917+0000 7f6fd39d1e00 1 client.15990 shutdown 2026-02-24T09:11:29.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/4227730115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 msgr2=0x55dd973a3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd973a3430 secure :-1 s=READY pgs=588 gs=1 cs=0 l=1 c_cookie=2756298412482947696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fbc003750 tx=0x7f6fbc011740 comp rx=0 tx=0).stop 2026-02-24T09:11:29.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/4227730115 shutdown_connections 2026-02-24T09:11:29.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55dd9737f8b0 0x55dd973a5480 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=8525338140764352785 s_cookie=6498212919964992148 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55dd9733e180 0x55dd973a3430 unknown :-1 s=CLOSED pgs=588 gs=1 cs=0 l=1 c_cookie=2756298412482947696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6f8d7fa640 0 client.15990 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:29.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55dd972f94e0 0x55dd97313380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 1 --2- 10.20.193.4:0/4227730115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55dd972f8bd0 0x55dd97312e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/4227730115 >> 10.20.193.4:0/4227730115 conn(0x55dd97216880 msgr2=0x55dd9730dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:29.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/4227730115 shutdown_connections 2026-02-24T09:11:29.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 1 -- 10.20.193.4:0/4227730115 wait complete. 2026-02-24T09:11:29.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd39d1e00 20 client.15990 trim_cache size 0 max 16384 2026-02-24T09:11:29.923 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:11:29.923 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:11:29.923 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:11:29.923 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 10, 2026-02-24T09:11:29.923 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:11:29.923 INFO:teuthology.orchestra.run.trial004.stdout: "c5e5130": { 2026-02-24T09:11:29.923 INFO:teuthology.orchestra.run.trial004.stdout: "version": 10, 2026-02-24T09:11:29.923 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:11:29.923 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:11:29.923 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 142.0, 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:29.924 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:29.925 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:29.925 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:29.925 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:29.925 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:11:29.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2816878301 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6fa00b56e0 msgr2=0x7f6fa00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6fa00b56e0 0x7f6fa00d5b90 secure :-1 s=READY pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fb4005970 tx=0x7f6fb4005900 comp rx=0 tx=0).stop 2026-02-24T09:11:29.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2816878301 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6fcc060090 msgr2=0x7f6fcc11bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:29.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6fcc060090 0x7f6fcc11bdb0 secure :-1 s=READY pgs=584 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fc00023d0 tx=0x7f6fc00043d0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2816878301 shutdown_connections 2026-02-24T09:11:29.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6fa00b56e0 0x7f6fa00d5b90 unknown :-1 s=CLOSED pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6fcc113630 0x7f6fcc1216c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6fcc060a80 0x7f6fcc11c2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 --2- 10.20.193.4:0/2816878301 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6fcc060090 0x7f6fcc11bdb0 unknown :-1 s=CLOSED pgs=584 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:29.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2816878301 >> 10.20.193.4:0/2816878301 conn(0x7f6fcc0e9bf0 msgr2=0x7f6fcc109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:29.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2816878301 shutdown_connections 2026-02-24T09:11:29.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:29.918+0000 7f6fd19d7640 1 -- 10.20.193.4:0/2816878301 wait complete. 2026-02-24T09:11:29.963 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c5e5130', quiesce took 1.0 seconds. Will release after: 21.0 2026-02-24T09:11:30.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:29 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3500306451' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:30.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:29 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3500306451' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:30.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:29 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3500306451' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:31.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:30 trial014 ceph-mon[46941]: pgmap v203: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 517 MiB/s wr, 249 op/s 2026-02-24T09:11:31.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:30 trial004 ceph-mon[41596]: pgmap v203: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 517 MiB/s wr, 249 op/s 2026-02-24T09:11:31.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:30 trial090 ceph-mon[47278]: pgmap v203: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 517 MiB/s wr, 249 op/s 2026-02-24T09:11:31.994 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:11:32.113 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:32.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 -- 10.20.193.4:0/528960641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff664115930 msgr2=0x7ff664176300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 --2- 10.20.193.4:0/528960641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff664115930 0x7ff664176300 secure :-1 s=READY pgs=589 gs=1 cs=0 l=1 c_cookie=17250582878872320193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff66000aa30 tx=0x7ff660030280 comp rx=0 tx=0).stop 2026-02-24T09:11:32.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 -- 10.20.193.4:0/528960641 shutdown_connections 2026-02-24T09:11:32.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 --2- 10.20.193.4:0/528960641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff664115930 0x7ff664176300 unknown :-1 s=CLOSED pgs=589 gs=1 cs=0 l=1 c_cookie=17250582878872320193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 --2- 10.20.193.4:0/528960641 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff664110130 0x7ff664115180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 --2- 10.20.193.4:0/528960641 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff66410f740 0x7ff66410fb10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 -- 10.20.193.4:0/528960641 >> 10.20.193.4:0/528960641 conn(0x7ff6640ed050 msgr2=0x7ff66410d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 -- 10.20.193.4:0/528960641 shutdown_connections 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 -- 10.20.193.4:0/528960641 wait complete. 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 Processor -- start 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 -- start start 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff66410f740 0x7ff66411e060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.213+0000 7ff66be3e640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff664110130 0x7ff66411e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66be3e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff664115930 0x7ff664123970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66be3e640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff664123f90 con 0x7ff664115930 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66be3e640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff664124100 con 0x7ff664110130 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66be3e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641242c0 con 0x7ff66410f740 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66a3b4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff664115930 0x7ff664123970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66a3b4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff664115930 0x7ff664123970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47748/0 (socket says 10.20.193.4:47748) 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66a3b4640 1 -- 10.20.193.4:0/1607235003 learned_addr learned my addr 10.20.193.4:0/1607235003 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff669bb3640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff66410f740 0x7ff66411e060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff6693b2640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff664110130 0x7ff66411e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66a3b4640 1 -- 10.20.193.4:0/1607235003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff66410f740 msgr2=0x7ff66411e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66a3b4640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff66410f740 0x7ff66411e060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66a3b4640 1 -- 10.20.193.4:0/1607235003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff664110130 msgr2=0x7ff66411e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66a3b4640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff664110130 0x7ff66411e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66a3b4640 1 -- 10.20.193.4:0/1607235003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66000a650 con 0x7ff664115930 2026-02-24T09:11:32.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff6693b2640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff664110130 0x7ff66411e5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:32.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66a3b4640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff664115930 0x7ff664123970 secure :-1 s=READY pgs=590 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff66000a330 tx=0x7ff6600039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff652ffd640 1 -- 10.20.193.4:0/1607235003 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff66003e070 con 0x7ff664115930 2026-02-24T09:11:32.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66be3e640 1 -- 10.20.193.4:0/1607235003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff664124540 con 0x7ff664115930 2026-02-24T09:11:32.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff652ffd640 1 -- 10.20.193.4:0/1607235003 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6600055a0 con 0x7ff664115930 2026-02-24T09:11:32.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff652ffd640 1 -- 10.20.193.4:0/1607235003 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff660042a70 con 0x7ff664115930 2026-02-24T09:11:32.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.214+0000 7ff66be3e640 1 -- 10.20.193.4:0/1607235003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff664164b00 con 0x7ff664115930 2026-02-24T09:11:32.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.216+0000 7ff652ffd640 1 -- 10.20.193.4:0/1607235003 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff6600050c0 con 0x7ff664115930 2026-02-24T09:11:32.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.217+0000 7ff652ffd640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6400b56e0 0x7ff6400d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.217+0000 7ff669bb3640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6400b56e0 0x7ff6400d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.217+0000 7ff652ffd640 1 -- 10.20.193.4:0/1607235003 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff66010cde0 con 0x7ff664115930 2026-02-24T09:11:32.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.217+0000 7ff669bb3640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6400b56e0 0x7ff6400d5b90 secure :-1 s=READY pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff654005970 tx=0x7ff654005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.218+0000 7ff66de38e00 1 Processor -- start 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.218+0000 7ff66de38e00 1 -- start start 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.218+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e1bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.218+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e2130 0x559f80226890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.218+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f80226dd0 0x559f802471b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.218+0000 7ff66de38e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559f800f1de0 con 0x559f801e1820 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.218+0000 7ff66de38e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559f800edb10 con 0x559f801e2130 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.218+0000 7ff66de38e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559f800e7ab0 con 0x559f80226dd0 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff669bb3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff669bb3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47764/0 (socket says 10.20.193.4:47764) 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff669bb3640 1 -- 10.20.193.4:0/357483953 learned_addr learned my addr 10.20.193.4:0/357483953 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff6693b2640 1 --2- 10.20.193.4:0/357483953 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e2130 0x559f80226890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff66a3b4640 1 --2- 10.20.193.4:0/357483953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f80226dd0 0x559f802471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff669bb3640 1 -- 10.20.193.4:0/357483953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f80226dd0 msgr2=0x559f802471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff669bb3640 1 --2- 10.20.193.4:0/357483953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f80226dd0 0x559f802471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff669bb3640 1 -- 10.20.193.4:0/357483953 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e2130 msgr2=0x559f80226890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff669bb3640 1 --2- 10.20.193.4:0/357483953 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e2130 0x559f80226890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff669bb3640 1 -- 10.20.193.4:0/357483953 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f80093310 con 0x559f801e1820 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff669bb3640 1 --2- 10.20.193.4:0/357483953 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e1bf0 secure :-1 s=READY pgs=591 gs=1 cs=0 l=1 c_cookie=13713807368620464155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6540041c0 tx=0x7ff654012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be513b2494c1d81b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff6324e6640 1 -- 10.20.193.4:0/357483953 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff65401e680 con 0x559f801e1820 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff6324e6640 1 -- 10.20.193.4:0/357483953 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff65400fe60 con 0x559f801e1820 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff6324e6640 1 -- 10.20.193.4:0/357483953 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff654010c10 con 0x559f801e1820 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff66de38e00 1 -- 10.20.193.4:0/357483953 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 msgr2=0x559f801e1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff66de38e00 1 --2- 10.20.193.4:0/357483953 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e1bf0 secure :-1 s=READY pgs=591 gs=1 cs=0 l=1 c_cookie=13713807368620464155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6540041c0 tx=0x7ff654012000 comp rx=0 tx=0).stop 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff66de38e00 1 -- 10.20.193.4:0/357483953 shutdown_connections 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff66de38e00 1 --2- 10.20.193.4:0/357483953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f80226dd0 0x559f802471b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff66de38e00 1 --2- 10.20.193.4:0/357483953 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e2130 0x559f80226890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff66de38e00 1 --2- 10.20.193.4:0/357483953 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e1bf0 unknown :-1 s=CLOSED pgs=591 gs=1 cs=0 l=1 c_cookie=13713807368620464155 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff66de38e00 1 -- 10.20.193.4:0/357483953 >> 10.20.193.4:0/357483953 conn(0x559f801006b0 msgr2=0x559f801e0100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff66de38e00 1 -- 10.20.193.4:0/357483953 shutdown_connections 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.219+0000 7ff66de38e00 1 -- 10.20.193.4:0/357483953 wait complete. 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.220+0000 7ff66de38e00 1 -- start start 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.220+0000 7ff66de38e00 1 Processor -- start 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.220+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f801e1820 0x559f801f9e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.220+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e2130 0x559f801fa390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.220+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f80226dd0 0x559f801ff380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.220+0000 7ff66de38e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559f801ff8c0 con 0x559f80226dd0 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.220+0000 7ff66de38e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559f801ffa30 con 0x559f801e2130 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.220+0000 7ff66de38e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559f801ffbf0 con 0x559f801e1820 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.220+0000 7ff66a3b4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f80226dd0 0x559f801ff380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66a3b4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f80226dd0 0x559f801ff380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47778/0 (socket says 10.20.193.4:47778) 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66a3b4640 1 -- 10.20.193.4:0/4241083661 learned_addr learned my addr 10.20.193.4:0/4241083661 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff669bb3640 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f801e1820 0x559f801f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff6693b2640 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e2130 0x559f801fa390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66a3b4640 1 -- 10.20.193.4:0/4241083661 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f801e1820 msgr2=0x559f801f9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66a3b4640 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f801e1820 0x559f801f9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66a3b4640 1 -- 10.20.193.4:0/4241083661 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e2130 msgr2=0x559f801fa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66a3b4640 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e2130 0x559f801fa390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66a3b4640 1 -- 10.20.193.4:0/4241083661 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f8006b8c0 con 0x559f80226dd0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66a3b4640 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f80226dd0 0x559f801ff380 secure :-1 s=READY pgs=592 gs=1 cs=0 l=1 c_cookie=10022491925362542787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff660003fd0 tx=0x7ff660030280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b170b4dff7488c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff61f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff61f7fe640 1 -- 10.20.193.4:0/4241083661 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6600d3b10 con 0x559f80226dd0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff61f7fe640 1 -- 10.20.193.4:0/4241083661 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6600d8e30 con 0x559f80226dd0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff61f7fe640 1 -- 10.20.193.4:0/4241083661 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6600dddc0 con 0x559f80226dd0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 1 -- 10.20.193.4:0/4241083661 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff65400fa30 con 0x559f80226dd0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff61f7fe640 1 -- 10.20.193.4:0/4241083661 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff6600ddf20 con 0x559f80226dd0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff61f7fe640 10 client.16002 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 10 client.16002 _ll_register_callbacks cb 0x559f80083160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 1 -- 10.20.193.4:0/4241083661 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f7fe374a0 con 0x559f80226dd0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff61f7fe640 1 -- 10.20.193.4:0/4241083661 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff6600db410 con 0x559f80226dd0 2026-02-24T09:11:32.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 10 client.16002 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:32.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 1 -- 10.20.193.4:0/4241083661 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559f8007d6e0 con 0x559f80226dd0 2026-02-24T09:11:32.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff61f7fe640 1 -- 10.20.193.4:0/4241083661 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff66010ad20 con 0x559f80226dd0 2026-02-24T09:11:32.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 10 client.16002 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:32.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:32.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 20 client.16002 populate_metadata read hostname 'trial004' 2026-02-24T09:11:32.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559f802244a0 0x559f80224910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 4 client.16002 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:32.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.221+0000 7ff66de38e00 1 -- 10.20.193.4:0/4241083661 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f800dd4f0 con 0x559f802244a0 2026-02-24T09:11:32.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.222+0000 7ff669bb3640 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559f802244a0 0x559f80224910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.222+0000 7ff61f7fe640 10 client.16002 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.222+0000 7ff669bb3640 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559f802244a0 0x559f80224910 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=16192612455571153915 s_cookie=18405560342967366699 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0b7b73c77e263fb server_cookie=ff6daf9d7696342b in_seq=0 out_seq=0 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.222+0000 7ff61f7fe640 1 -- 10.20.193.4:0/4241083661 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559f800dd4f0 con 0x559f802244a0 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.222+0000 7ff61f7fe640 10 client.16002 handle_command_reply: tid=0 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.222+0000 7ff66de38e00 1 client.16002 shutdown 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 1 -- 10.20.193.4:0/4241083661 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f80226dd0 msgr2=0x559f801ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f80226dd0 0x559f801ff380 secure :-1 s=READY pgs=592 gs=1 cs=0 l=1 c_cookie=10022491925362542787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff660003fd0 tx=0x7ff660030280 comp rx=0 tx=0).stop 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 1 -- 10.20.193.4:0/4241083661 shutdown_connections 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559f802244a0 0x559f80224910 crc :-1 s=READY pgs=59 gs=4 cs=0 l=0 c_cookie=16192612455571153915 s_cookie=18405560342967366699 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f80226dd0 0x559f801ff380 unknown :-1 s=CLOSED pgs=592 gs=1 cs=0 l=1 c_cookie=10022491925362542787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e2130 0x559f801fa390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 1 --2- 10.20.193.4:0/4241083661 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f801e1820 0x559f801f9e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff61f7fe640 0 client.16002 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:32.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 1 -- 10.20.193.4:0/4241083661 >> 10.20.193.4:0/4241083661 conn(0x559f801006b0 msgr2=0x559f801e0810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 1 -- 10.20.193.4:0/4241083661 shutdown_connections 2026-02-24T09:11:32.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 1 -- 10.20.193.4:0/4241083661 wait complete. 2026-02-24T09:11:32.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.223+0000 7ff66de38e00 20 client.16002 trim_cache size 0 max 16384 2026-02-24T09:11:32.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.231+0000 7ff66de38e00 1 Processor -- start 2026-02-24T09:11:32.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.231+0000 7ff66de38e00 1 -- start start 2026-02-24T09:11:32.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e0900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f801e2130 0x559f801e0e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f802244a0 0x559f80226130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559f800e56e0 con 0x559f801e1820 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559f7fdb0f50 con 0x559f802244a0 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559f801513d0 con 0x559f801e2130 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff669bb3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e0900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff669bb3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e0900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47790/0 (socket says 10.20.193.4:47790) 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff669bb3640 1 -- 10.20.193.4:0/2225460761 learned_addr learned my addr 10.20.193.4:0/2225460761 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66a3b4640 1 --2- 10.20.193.4:0/2225460761 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f802244a0 0x559f80226130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff6693b2640 1 --2- 10.20.193.4:0/2225460761 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f801e2130 0x559f801e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff669bb3640 1 -- 10.20.193.4:0/2225460761 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f801e2130 msgr2=0x559f801e0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff669bb3640 1 --2- 10.20.193.4:0/2225460761 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f801e2130 0x559f801e0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff669bb3640 1 -- 10.20.193.4:0/2225460761 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f802244a0 msgr2=0x559f80226130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff669bb3640 1 --2- 10.20.193.4:0/2225460761 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f802244a0 0x559f80226130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff669bb3640 1 -- 10.20.193.4:0/2225460761 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f801ec350 con 0x559f801e1820 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff669bb3640 1 --2- 10.20.193.4:0/2225460761 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e0900 secure :-1 s=READY pgs=593 gs=1 cs=0 l=1 c_cookie=12128803966200641996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6540041c0 tx=0x7ff65400ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8522af233bcf9cc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff631ce5640 1 -- 10.20.193.4:0/2225460761 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff654030040 con 0x559f801e1820 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff631ce5640 1 -- 10.20.193.4:0/2225460761 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff654010cb0 con 0x559f801e1820 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff631ce5640 1 -- 10.20.193.4:0/2225460761 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff654036320 con 0x559f801e1820 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 -- 10.20.193.4:0/2225460761 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 msgr2=0x559f801e0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 --2- 10.20.193.4:0/2225460761 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e0900 secure :-1 s=READY pgs=593 gs=1 cs=0 l=1 c_cookie=12128803966200641996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6540041c0 tx=0x7ff65400ffd0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 -- 10.20.193.4:0/2225460761 shutdown_connections 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 --2- 10.20.193.4:0/2225460761 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f802244a0 0x559f80226130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 --2- 10.20.193.4:0/2225460761 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f801e2130 0x559f801e0e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 --2- 10.20.193.4:0/2225460761 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e1820 0x559f801e0900 unknown :-1 s=CLOSED pgs=593 gs=1 cs=0 l=1 c_cookie=12128803966200641996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 -- 10.20.193.4:0/2225460761 >> 10.20.193.4:0/2225460761 conn(0x559f801006b0 msgr2=0x559f801e01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 -- 10.20.193.4:0/2225460761 shutdown_connections 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.232+0000 7ff66de38e00 1 -- 10.20.193.4:0/2225460761 wait complete. 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff66de38e00 1 -- start start 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff66de38e00 1 Processor -- start 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e1820 0x559f802054c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e2130 0x559f80205a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff66de38e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f802244a0 0x559f8028c300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff66de38e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559f80152450 con 0x559f801e2130 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff66de38e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559f8028c840 con 0x559f801e1820 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff66de38e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559f8028ca00 con 0x559f802244a0 2026-02-24T09:11:32.245 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff6693b2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e2130 0x559f80205a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff6693b2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e2130 0x559f80205a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47802/0 (socket says 10.20.193.4:47802) 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff6693b2640 1 -- 10.20.193.4:0/2273265166 learned_addr learned my addr 10.20.193.4:0/2273265166 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff66a3b4640 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f802244a0 0x559f8028c300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff669bb3640 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e1820 0x559f802054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff6693b2640 1 -- 10.20.193.4:0/2273265166 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f802244a0 msgr2=0x559f8028c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff6693b2640 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f802244a0 0x559f8028c300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff6693b2640 1 -- 10.20.193.4:0/2273265166 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e1820 msgr2=0x559f802054c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff6693b2640 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e1820 0x559f802054c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff6693b2640 1 -- 10.20.193.4:0/2273265166 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f80078160 con 0x559f801e2130 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff6693b2640 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e2130 0x559f80205a00 secure :-1 s=READY pgs=594 gs=1 cs=0 l=1 c_cookie=12646423617603051709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff658002f50 tx=0x7ff6580128f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af811f46ce5720bd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff61f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff61f7fe640 1 -- 10.20.193.4:0/2273265166 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6580106a0 con 0x559f801e2130 2026-02-24T09:11:32.246 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff61f7fe640 1 -- 10.20.193.4:0/2273265166 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff658010ce0 con 0x559f801e2130 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff61f7fe640 1 -- 10.20.193.4:0/2273265166 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff65800e3e0 con 0x559f801e2130 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.233+0000 7ff66de38e00 1 -- 10.20.193.4:0/2273265166 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f80093310 con 0x559f801e2130 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff61f7fe640 1 -- 10.20.193.4:0/2273265166 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff65800e570 con 0x559f801e2130 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff61f7fe640 10 client.16008 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff66de38e00 10 client.16008 _ll_register_callbacks cb 0x559f80083160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff66de38e00 1 -- 10.20.193.4:0/2273265166 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff65400fe60 con 0x559f801e2130 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff61f7fe640 1 -- 10.20.193.4:0/2273265166 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff658010e50 con 0x559f801e2130 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff66de38e00 10 client.16008 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff66de38e00 1 -- 10.20.193.4:0/2273265166 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559f8006bbf0 con 0x559f801e2130 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff61f7fe640 1 -- 10.20.193.4:0/2273265166 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff658022060 con 0x559f801e2130 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff66de38e00 10 client.16008 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:32.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff66de38e00 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff66de38e00 20 client.16008 populate_metadata read hostname 'trial004' 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff66de38e00 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559f80226dd0 0x559f802f4c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff66de38e00 4 client.16008 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff66de38e00 1 -- 10.20.193.4:0/2273265166 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559f7fe1c160 con 0x559f80226dd0 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.234+0000 7ff669bb3640 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559f80226dd0 0x559f802f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff669bb3640 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559f80226dd0 0x559f802f4c20 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=15532030548620630531 s_cookie=10414909766296837618 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d78cdb7de30c5a03 server_cookie=908931407bde9df2 in_seq=0 out_seq=0 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff61f7fe640 10 client.16008 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff61f7fe640 1 -- 10.20.193.4:0/2273265166 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x559f7fe1c160 con 0x559f80226dd0 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff61f7fe640 10 client.16008 handle_command_reply: tid=0 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 client.16008 shutdown 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 -- 10.20.193.4:0/2273265166 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e2130 msgr2=0x559f80205a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e2130 0x559f80205a00 secure :-1 s=READY pgs=594 gs=1 cs=0 l=1 c_cookie=12646423617603051709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff658002f50 tx=0x7ff6580128f0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 -- 10.20.193.4:0/2273265166 shutdown_connections 2026-02-24T09:11:32.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559f80226dd0 0x559f802f4c20 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=15532030548620630531 s_cookie=10414909766296837618 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559f802244a0 0x559f8028c300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559f801e2130 0x559f80205a00 unknown :-1 s=CLOSED pgs=594 gs=1 cs=0 l=1 c_cookie=12646423617603051709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 --2- 10.20.193.4:0/2273265166 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559f801e1820 0x559f802054c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff61f7fe640 0 client.16008 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:32.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 -- 10.20.193.4:0/2273265166 >> 10.20.193.4:0/2273265166 conn(0x559f801006b0 msgr2=0x559f801e0900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 -- 10.20.193.4:0/2273265166 shutdown_connections 2026-02-24T09:11:32.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 1 -- 10.20.193.4:0/2273265166 wait complete. 2026-02-24T09:11:32.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66de38e00 20 client.16008 trim_cache size 0 max 16384 2026-02-24T09:11:32.250 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:11:32.250 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:11:32.250 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:11:32.250 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:11:32.250 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:11:32.250 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:11:32.250 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:32.250 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:11:32.250 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:11:32.251 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:11:32.252 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:32.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:11:32.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:11:32.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:11:32.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:11:32.252 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:32.252 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:32.252 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:11:32.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 -- 10.20.193.4:0/1607235003 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6400b56e0 msgr2=0x7ff6400d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6400b56e0 0x7ff6400d5b90 secure :-1 s=READY pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff654005970 tx=0x7ff654005900 comp rx=0 tx=0).stop 2026-02-24T09:11:32.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 -- 10.20.193.4:0/1607235003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff664115930 msgr2=0x7ff664123970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff664115930 0x7ff664123970 secure :-1 s=READY pgs=590 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff66000a330 tx=0x7ff6600039b0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 -- 10.20.193.4:0/1607235003 shutdown_connections 2026-02-24T09:11:32.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff6400b56e0 0x7ff6400d5b90 unknown :-1 s=CLOSED pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff664115930 0x7ff664123970 unknown :-1 s=CLOSED pgs=590 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff664110130 0x7ff66411e5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 --2- 10.20.193.4:0/1607235003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff66410f740 0x7ff66411e060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 -- 10.20.193.4:0/1607235003 >> 10.20.193.4:0/1607235003 conn(0x7ff6640ed050 msgr2=0x7ff66410d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 -- 10.20.193.4:0/1607235003 shutdown_connections 2026-02-24T09:11:32.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.235+0000 7ff66be3e640 1 -- 10.20.193.4:0/1607235003 wait complete. 2026-02-24T09:11:32.272 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:11:32.272 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:11:32.388 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:32.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.483+0000 7f8f38ccc640 1 -- 10.20.193.4:0/490572858 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8f340618e0 msgr2=0x7f8f34155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.483+0000 7f8f38ccc640 1 --2- 10.20.193.4:0/490572858 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8f340618e0 0x7f8f34155620 secure :-1 s=READY pgs=595 gs=1 cs=0 l=1 c_cookie=2009611194953825434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f1c009950 tx=0x7f8f1c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.483+0000 7f8f38ccc640 1 -- 10.20.193.4:0/490572858 shutdown_connections 2026-02-24T09:11:32.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.483+0000 7f8f38ccc640 1 --2- 10.20.193.4:0/490572858 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8f34155b60 0x7f8f34175f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.483+0000 7f8f38ccc640 1 --2- 10.20.193.4:0/490572858 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8f340618e0 0x7f8f34155620 unknown :-1 s=CLOSED pgs=595 gs=1 cs=0 l=1 c_cookie=2009611194953825434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.483+0000 7f8f38ccc640 1 --2- 10.20.193.4:0/490572858 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8f34060fd0 0x7f8f340613a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.483+0000 7f8f38ccc640 1 -- 10.20.193.4:0/490572858 >> 10.20.193.4:0/490572858 conn(0x7f8f340ead50 msgr2=0x7f8f3410b160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.483+0000 7f8f38ccc640 1 -- 10.20.193.4:0/490572858 shutdown_connections 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.483+0000 7f8f38ccc640 1 -- 10.20.193.4:0/490572858 wait complete. 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f38ccc640 1 Processor -- start 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f38ccc640 1 -- start start 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f38ccc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8f34060fd0 0x7f8f34162310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f38ccc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8f340618e0 0x7f8f34162850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f38ccc640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8f34155b60 0x7f8f34167c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f38ccc640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f8f34168240 con 0x7f8f34060fd0 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f38ccc640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f8f341683b0 con 0x7f8f34155b60 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f38ccc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f34168570 con 0x7f8f340618e0 2026-02-24T09:11:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8f34060fd0 0x7f8f34162310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8f34060fd0 0x7f8f34162310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47818/0 (socket says 10.20.193.4:47818) 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32575640 1 -- 10.20.193.4:0/2101055066 learned_addr learned my addr 10.20.193.4:0/2101055066 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32d76640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8f34155b60 0x7f8f34167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32575640 1 -- 10.20.193.4:0/2101055066 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8f340618e0 msgr2=0x7f8f34162850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32575640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8f340618e0 0x7f8f34162850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32575640 1 -- 10.20.193.4:0/2101055066 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8f34155b60 msgr2=0x7f8f34167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32575640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8f34155b60 0x7f8f34167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32575640 1 -- 10.20.193.4:0/2101055066 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c009570 con 0x7f8f34060fd0 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32d76640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8f34155b60 0x7f8f34167c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f32575640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8f34060fd0 0x7f8f34162310 secure :-1 s=READY pgs=596 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f2800d950 tx=0x7f8f2800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f1b7fe640 1 -- 10.20.193.4:0/2101055066 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f28004540 con 0x7f8f34060fd0 2026-02-24T09:11:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f1b7fe640 1 -- 10.20.193.4:0/2101055066 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8f28009d00 con 0x7f8f34060fd0 2026-02-24T09:11:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f38ccc640 1 -- 10.20.193.4:0/2101055066 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f34168850 con 0x7f8f34060fd0 2026-02-24T09:11:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f1b7fe640 1 -- 10.20.193.4:0/2101055066 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f280106e0 con 0x7f8f34060fd0 2026-02-24T09:11:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.484+0000 7f8f38ccc640 1 -- 10.20.193.4:0/2101055066 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f34151780 con 0x7f8f34060fd0 2026-02-24T09:11:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.485+0000 7f8f38ccc640 1 -- 10.20.193.4:0/2101055066 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f340624e0 con 0x7f8f34060fd0 2026-02-24T09:11:32.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.487+0000 7f8f1b7fe640 1 -- 10.20.193.4:0/2101055066 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f8f280097c0 con 0x7f8f34060fd0 2026-02-24T09:11:32.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.488+0000 7f8f1b7fe640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8f0c0b56e0 0x7f8f0c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.488+0000 7f8f31d74640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8f0c0b56e0 0x7f8f0c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.488+0000 7f8f1b7fe640 1 -- 10.20.193.4:0/2101055066 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8f280e7250 con 0x7f8f34060fd0 2026-02-24T09:11:32.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.488+0000 7f8f1b7fe640 1 -- 10.20.193.4:0/2101055066 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8f280a9c10 con 0x7f8f34060fd0 2026-02-24T09:11:32.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.488+0000 7f8f31d74640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8f0c0b56e0 0x7f8f0c0d5b90 secure :-1 s=READY pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f1c02f6e0 tx=0x7f8f1c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.624+0000 7f8f38ccc640 1 -- 10.20.193.4:0/2101055066 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f340613a0 con 0x7f8f34060fd0 2026-02-24T09:11:32.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.625+0000 7f8f1b7fe640 1 -- 10.20.193.4:0/2101055066 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f8f280acdc0 con 0x7f8f34060fd0 2026-02-24T09:11:32.628 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:11:32.628 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:11:32.629 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:11:32.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 -- 10.20.193.4:0/2101055066 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8f0c0b56e0 msgr2=0x7f8f0c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8f0c0b56e0 0x7f8f0c0d5b90 secure :-1 s=READY pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f1c02f6e0 tx=0x7f8f1c005900 comp rx=0 tx=0).stop 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 -- 10.20.193.4:0/2101055066 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8f34060fd0 msgr2=0x7f8f34162310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8f34060fd0 0x7f8f34162310 secure :-1 s=READY pgs=596 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f2800d950 tx=0x7f8f2800de20 comp rx=0 tx=0).stop 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 -- 10.20.193.4:0/2101055066 shutdown_connections 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8f0c0b56e0 0x7f8f0c0d5b90 unknown :-1 s=CLOSED pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8f34155b60 0x7f8f34167c20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8f340618e0 0x7f8f34162850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 --2- 10.20.193.4:0/2101055066 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8f34060fd0 0x7f8f34162310 unknown :-1 s=CLOSED pgs=596 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 -- 10.20.193.4:0/2101055066 >> 10.20.193.4:0/2101055066 conn(0x7f8f340ead50 msgr2=0x7f8f3410b130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 -- 10.20.193.4:0/2101055066 shutdown_connections 2026-02-24T09:11:32.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.626+0000 7f8f38ccc640 1 -- 10.20.193.4:0/2101055066 wait complete. 2026-02-24T09:11:32.666 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:11:32.782 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:32.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.886+0000 7f26cdbee640 1 -- 10.20.193.4:0/893533273 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26c8110040 msgr2=0x7f26c8115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.886+0000 7f26cdbee640 1 --2- 10.20.193.4:0/893533273 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26c8110040 0x7f26c8115090 secure :-1 s=READY pgs=597 gs=1 cs=0 l=1 c_cookie=6560985704692814753 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b8009950 tx=0x7f26b802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.886+0000 7f26cdbee640 1 -- 10.20.193.4:0/893533273 shutdown_connections 2026-02-24T09:11:32.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.886+0000 7f26cdbee640 1 --2- 10.20.193.4:0/893533273 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26c8115840 0x7f26c8176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.886+0000 7f26cdbee640 1 --2- 10.20.193.4:0/893533273 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26c8110040 0x7f26c8115090 unknown :-1 s=CLOSED pgs=597 gs=1 cs=0 l=1 c_cookie=6560985704692814753 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.886+0000 7f26cdbee640 1 --2- 10.20.193.4:0/893533273 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26c810f650 0x7f26c810fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.886+0000 7f26cdbee640 1 -- 10.20.193.4:0/893533273 >> 10.20.193.4:0/893533273 conn(0x7f26c80ecf20 msgr2=0x7f26c810d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.886+0000 7f26cdbee640 1 -- 10.20.193.4:0/893533273 shutdown_connections 2026-02-24T09:11:32.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.886+0000 7f26cdbee640 1 -- 10.20.193.4:0/893533273 wait complete. 2026-02-24T09:11:32.891 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:32 trial004 ceph-mon[41596]: pgmap v204: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 458 MiB/s wr, 229 op/s 2026-02-24T09:11:32.891 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:32 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2101055066' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:32.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26cdbee640 1 Processor -- start 2026-02-24T09:11:32.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26cdbee640 1 -- start start 2026-02-24T09:11:32.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26cdbee640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26c810f650 0x7f26c80f58c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26cdbee640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26c8110040 0x7f26c8176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26cdbee640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26c8115840 0x7f26c80f5fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26cdbee640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f26c80fb1d0 con 0x7f26c8110040 2026-02-24T09:11:32.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26cdbee640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f26c80fb340 con 0x7f26c8115840 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26cdbee640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26c80fb500 con 0x7f26c810f650 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26c8110040 0x7f26c8176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26c8110040 0x7f26c8176110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47842/0 (socket says 10.20.193.4:47842) 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c6ffd640 1 -- 10.20.193.4:0/270447519 learned_addr learned my addr 10.20.193.4:0/270447519 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c77fe640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26c810f650 0x7f26c80f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c7fff640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26c8115840 0x7f26c80f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c6ffd640 1 -- 10.20.193.4:0/270447519 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26c810f650 msgr2=0x7f26c80f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26c810f650 0x7f26c80f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c6ffd640 1 -- 10.20.193.4:0/270447519 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26c8115840 msgr2=0x7f26c80f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26c8115840 0x7f26c80f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c6ffd640 1 -- 10.20.193.4:0/270447519 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b8009570 con 0x7f26c8110040 2026-02-24T09:11:32.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26c8110040 0x7f26c8176110 secure :-1 s=READY pgs=598 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b80023d0 tx=0x7f26b8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c4ff9640 1 -- 10.20.193.4:0/270447519 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b803d070 con 0x7f26c8110040 2026-02-24T09:11:32.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c4ff9640 1 -- 10.20.193.4:0/270447519 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26b8002ad0 con 0x7f26c8110040 2026-02-24T09:11:32.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26cdbee640 1 -- 10.20.193.4:0/270447519 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c80fb780 con 0x7f26c8110040 2026-02-24T09:11:32.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26c4ff9640 1 -- 10.20.193.4:0/270447519 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b80418a0 con 0x7f26c8110040 2026-02-24T09:11:32.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.887+0000 7f26cdbee640 1 -- 10.20.193.4:0/270447519 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c80fbc40 con 0x7f26c8110040 2026-02-24T09:11:32.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.889+0000 7f26c4ff9640 1 -- 10.20.193.4:0/270447519 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f26b8041a30 con 0x7f26c8110040 2026-02-24T09:11:32.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.890+0000 7f26c4ff9640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f269c0b5750 0x7f269c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.890+0000 7f26c77fe640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f269c0b5750 0x7f269c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.890+0000 7f26c4ff9640 1 -- 10.20.193.4:0/270447519 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f26b8038920 con 0x7f26c8110040 2026-02-24T09:11:32.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.890+0000 7f26c77fe640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f269c0b5750 0x7f269c0d5c00 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b4004740 tx=0x7f26b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26cfbe8e00 1 Processor -- start 2026-02-24T09:11:32.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26cfbe8e00 1 -- start start 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb55f50 0x561f5cb56320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cb9afc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb9b500 0x561f5cbbb8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561f5ca66ee0 con 0x561f5cb56860 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561f5ca62c10 con 0x561f5cb9b500 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561f5ca5cd70 con 0x561f5cb55f50 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26c6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cb9afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26c6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cb9afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47848/0 (socket says 10.20.193.4:47848) 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26c6ffd640 1 -- 10.20.193.4:0/4139937828 learned_addr learned my addr 10.20.193.4:0/4139937828 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.891+0000 7f26c77fe640 1 --2- 10.20.193.4:0/4139937828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb55f50 0x561f5cb56320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26c6ffd640 1 -- 10.20.193.4:0/4139937828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb55f50 msgr2=0x561f5cb56320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/4139937828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb55f50 0x561f5cb56320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26c6ffd640 1 -- 10.20.193.4:0/4139937828 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb9b500 msgr2=0x561f5cbbb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/4139937828 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb9b500 0x561f5cbbb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26c6ffd640 1 -- 10.20.193.4:0/4139937828 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5ca08340 con 0x561f5cb56860 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/4139937828 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cb9afc0 secure :-1 s=READY pgs=599 gs=1 cs=0 l=1 c_cookie=8716347454750610752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b8038ea0 tx=0x7f26b8038ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f6afd4334a5540 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f268bfff640 1 -- 10.20.193.4:0/4139937828 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b80d2ed0 con 0x561f5cb56860 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f268bfff640 1 -- 10.20.193.4:0/4139937828 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26b80d81f0 con 0x561f5cb56860 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f268bfff640 1 -- 10.20.193.4:0/4139937828 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b80d3160 con 0x561f5cb56860 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/4139937828 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 msgr2=0x561f5cb9afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/4139937828 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cb9afc0 secure :-1 s=READY pgs=599 gs=1 cs=0 l=1 c_cookie=8716347454750610752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b8038ea0 tx=0x7f26b8038ef0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/4139937828 shutdown_connections 2026-02-24T09:11:32.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/4139937828 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb9b500 0x561f5cbbb8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/4139937828 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cb9afc0 unknown :-1 s=CLOSED pgs=599 gs=1 cs=0 l=1 c_cookie=8716347454750610752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/4139937828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb55f50 0x561f5cb56320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/4139937828 >> 10.20.193.4:0/4139937828 conn(0x561f5ca74db0 msgr2=0x561f5cb54830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/4139937828 shutdown_connections 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.892+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/4139937828 wait complete. 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26cfbe8e00 1 -- start start 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26cfbe8e00 1 Processor -- start 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb55f50 0x561f5cbb2d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cbb3270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb9b500 0x561f5cbb8260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561f5cbb87a0 con 0x561f5cb56860 2026-02-24T09:11:32.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561f5cbb8910 con 0x561f5cb55f50 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561f5cbb8ad0 con 0x561f5cb9b500 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26c6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cbb3270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26c6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cbb3270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47864/0 (socket says 10.20.193.4:47864) 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26c6ffd640 1 -- 10.20.193.4:0/2419204937 learned_addr learned my addr 10.20.193.4:0/2419204937 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26c77fe640 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb55f50 0x561f5cbb2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26c6ffd640 1 -- 10.20.193.4:0/2419204937 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb9b500 msgr2=0x561f5cbb8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb9b500 0x561f5cbb8260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26c6ffd640 1 -- 10.20.193.4:0/2419204937 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb55f50 msgr2=0x561f5cbb2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb55f50 0x561f5cbb2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26c6ffd640 1 -- 10.20.193.4:0/2419204937 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5c9e09d0 con 0x561f5cb56860 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cbb3270 secure :-1 s=READY pgs=600 gs=1 cs=0 l=1 c_cookie=1152049317162206605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b80d4760 tx=0x7f26b80d3520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffce6c0092f458d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.893+0000 7f26897fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26897fa640 1 -- 10.20.193.4:0/2419204937 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b80d3160 con 0x561f5cb56860 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26897fa640 1 -- 10.20.193.4:0/2419204937 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26b80ce740 con 0x561f5cb56860 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26897fa640 1 -- 10.20.193.4:0/2419204937 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b80d17c0 con 0x561f5cb56860 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/2419204937 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c80fbc40 con 0x561f5cb56860 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26897fa640 1 -- 10.20.193.4:0/2419204937 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f26b80f7040 con 0x561f5cb56860 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26897fa640 10 client.16026 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 10 client.16026 _ll_register_callbacks cb 0x561f5ca07080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/2419204937 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561f5c7ac4a0 con 0x561f5cb56860 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26897fa640 1 -- 10.20.193.4:0/2419204937 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f26b80dd610 con 0x561f5cb56860 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 10 client.16026 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/2419204937 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561f5c9f2710 con 0x561f5cb56860 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26897fa640 1 -- 10.20.193.4:0/2419204937 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f26b80d1920 con 0x561f5cb56860 2026-02-24T09:11:32.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 10 client.16026 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 10 client.16026 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 20 client.16026 populate_metadata read hostname 'trial004' 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561f5cb98250 0x561f5cb986c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 4 client.16026 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.894+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/2419204937 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f5ca527b0 con 0x561f5cb98250 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.895+0000 7f26c77fe640 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561f5cb98250 0x561f5cb986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.895+0000 7f26c77fe640 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561f5cb98250 0x561f5cb986c0 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=4400752472264594760 s_cookie=4765941901548602150 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d129d0eadc0d548 server_cookie=422406e88df44326 in_seq=0 out_seq=0 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.895+0000 7f26897fa640 10 client.16026 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26897fa640 1 -- 10.20.193.4:0/2419204937 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561f5ca527b0 con 0x561f5cb98250 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26897fa640 10 client.16026 handle_command_reply: tid=0 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 client.16026 shutdown 2026-02-24T09:11:32.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/2419204937 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 msgr2=0x561f5cbb3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cbb3270 secure :-1 s=READY pgs=600 gs=1 cs=0 l=1 c_cookie=1152049317162206605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b80d4760 tx=0x7f26b80d3520 comp rx=0 tx=0).stop 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/2419204937 shutdown_connections 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561f5cb98250 0x561f5cb986c0 crc :-1 s=READY pgs=26 gs=4 cs=0 l=0 c_cookie=4400752472264594760 s_cookie=4765941901548602150 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb9b500 0x561f5cbb8260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb56860 0x561f5cbb3270 unknown :-1 s=CLOSED pgs=600 gs=1 cs=0 l=1 c_cookie=1152049317162206605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/2419204937 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb55f50 0x561f5cbb2d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26897fa640 0 client.16026 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/2419204937 >> 10.20.193.4:0/2419204937 conn(0x561f5ca74db0 msgr2=0x561f5cb54040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/2419204937 shutdown_connections 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/2419204937 wait complete. 2026-02-24T09:11:32.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.896+0000 7f26cfbe8e00 20 client.16026 trim_cache size 0 max 16384 2026-02-24T09:11:32.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26cfbe8e00 1 Processor -- start 2026-02-24T09:11:32.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26cfbe8e00 1 -- start start 2026-02-24T09:11:32.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb55f50 0x561f5cbb0120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb56860 0x561f5cbb0660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb9b500 0x561f5cb95fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561f5ca5a9a0 con 0x561f5cb55f50 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561f5c836df0 con 0x561f5cb56860 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561f5ca62c10 con 0x561f5cb9b500 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb55f50 0x561f5cbb0120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb55f50 0x561f5cbb0120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47870/0 (socket says 10.20.193.4:47870) 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c77fe640 1 -- 10.20.193.4:0/3459347263 learned_addr learned my addr 10.20.193.4:0/3459347263 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/3459347263 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb56860 0x561f5cbb0660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c77fe640 1 -- 10.20.193.4:0/3459347263 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb9b500 msgr2=0x561f5cb95fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c7fff640 1 --2- 10.20.193.4:0/3459347263 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb9b500 0x561f5cb95fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c77fe640 1 --2- 10.20.193.4:0/3459347263 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb9b500 0x561f5cb95fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c77fe640 1 -- 10.20.193.4:0/3459347263 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb56860 msgr2=0x561f5cbb0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c77fe640 1 --2- 10.20.193.4:0/3459347263 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb56860 0x561f5cbb0660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c77fe640 1 -- 10.20.193.4:0/3459347263 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5cba5390 con 0x561f5cb55f50 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c7fff640 1 --2- 10.20.193.4:0/3459347263 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb9b500 0x561f5cb95fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f26c77fe640 1 --2- 10.20.193.4:0/3459347263 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb55f50 0x561f5cbb0120 secure :-1 s=READY pgs=601 gs=1 cs=0 l=1 c_cookie=867413645642901255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x561f5cb98ef0 tx=0x7f26b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09ac1d6ddf2707 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f268b7fe640 1 -- 10.20.193.4:0/3459347263 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b402aa60 con 0x561f5cb55f50 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f268b7fe640 1 -- 10.20.193.4:0/3459347263 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26b4022040 con 0x561f5cb55f50 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.904+0000 7f268b7fe640 1 -- 10.20.193.4:0/3459347263 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b40286d0 con 0x561f5cb55f50 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/3459347263 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb55f50 msgr2=0x561f5cbb0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/3459347263 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb55f50 0x561f5cbb0120 secure :-1 s=READY pgs=601 gs=1 cs=0 l=1 c_cookie=867413645642901255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x561f5cb98ef0 tx=0x7f26b4014000 comp rx=0 tx=0).stop 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/3459347263 shutdown_connections 2026-02-24T09:11:32.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/3459347263 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb9b500 0x561f5cb95fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/3459347263 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb56860 0x561f5cbb0660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/3459347263 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb55f50 0x561f5cbb0120 unknown :-1 s=CLOSED pgs=601 gs=1 cs=0 l=1 c_cookie=867413645642901255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/3459347263 >> 10.20.193.4:0/3459347263 conn(0x561f5ca74db0 msgr2=0x561f5cb99710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/3459347263 shutdown_connections 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/3459347263 wait complete. 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 -- start start 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 Processor -- start 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb55f50 0x561f5cb353b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb56860 0x561f5cb358f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb9b500 0x561f5cb35e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561f5cac54a0 con 0x561f5cb9b500 2026-02-24T09:11:32.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561f5cb3a240 con 0x561f5cb55f50 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26cfbe8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561f5cc00f80 con 0x561f5cb56860 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.905+0000 7f26c7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb9b500 0x561f5cb35e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26c7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb9b500 0x561f5cb35e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47882/0 (socket says 10.20.193.4:47882) 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26c7fff640 1 -- 10.20.193.4:0/1953225533 learned_addr learned my addr 10.20.193.4:0/1953225533 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26c77fe640 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb55f50 0x561f5cb353b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26c6ffd640 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb56860 0x561f5cb358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26c7fff640 1 -- 10.20.193.4:0/1953225533 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb56860 msgr2=0x561f5cb358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26c7fff640 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb56860 0x561f5cb358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26c7fff640 1 -- 10.20.193.4:0/1953225533 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb55f50 msgr2=0x561f5cb353b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26c7fff640 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb55f50 0x561f5cb353b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26c7fff640 1 -- 10.20.193.4:0/1953225533 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5c9e0d00 con 0x561f5cb9b500 2026-02-24T09:11:32.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26c7fff640 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb9b500 0x561f5cb35e30 secure :-1 s=READY pgs=602 gs=1 cs=0 l=1 c_cookie=14683881663535187202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26bc006950 tx=0x7f26bc00aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc7a0930ee30502 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26897fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26897fa640 1 -- 10.20.193.4:0/1953225533 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26bc005cf0 con 0x561f5cb9b500 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/1953225533 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f5c9ed190 con 0x561f5cb9b500 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26897fa640 1 -- 10.20.193.4:0/1953225533 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26bc005e50 con 0x561f5cb9b500 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26897fa640 1 -- 10.20.193.4:0/1953225533 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26bc011e30 con 0x561f5cb9b500 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 10 client.16032 _ll_register_callbacks cb 0x561f5ca07080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/1953225533 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b80d81f0 con 0x561f5cb9b500 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26897fa640 1 -- 10.20.193.4:0/1953225533 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f26bc010450 con 0x561f5cb9b500 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26897fa640 1 -- 10.20.193.4:0/1953225533 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f26bc010630 con 0x561f5cb9b500 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 10 client.16032 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/1953225533 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561f5c9f2970 con 0x561f5cb9b500 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26897fa640 1 -- 10.20.193.4:0/1953225533 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f26bc01a030 con 0x561f5cb9b500 2026-02-24T09:11:32.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 10 client.16032 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 10 client.16032 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 20 client.16032 populate_metadata read hostname 'trial004' 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561f5cc49150 0x561f5cc695d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 4 client.16032 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.906+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/1953225533 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f5c791160 con 0x561f5cc49150 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26c77fe640 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561f5cc49150 0x561f5cc695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26897fa640 10 client.16032 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26c77fe640 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561f5cc49150 0x561f5cc695d0 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=6604491074552619525 s_cookie=11009850577391820434 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ba7dda3e4f26205 server_cookie=98cad8c477919e92 in_seq=0 out_seq=0 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26897fa640 1 -- 10.20.193.4:0/1953225533 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f5c791160 con 0x561f5cc49150 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26897fa640 10 client.16032 handle_command_reply: tid=0 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 client.16032 shutdown 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/1953225533 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb9b500 msgr2=0x561f5cb35e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb9b500 0x561f5cb35e30 secure :-1 s=READY pgs=602 gs=1 cs=0 l=1 c_cookie=14683881663535187202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26bc006950 tx=0x7f26bc00aa00 comp rx=0 tx=0).stop 2026-02-24T09:11:32.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/1953225533 shutdown_connections 2026-02-24T09:11:32.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561f5cc49150 0x561f5cc695d0 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=6604491074552619525 s_cookie=11009850577391820434 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561f5cb9b500 0x561f5cb35e30 unknown :-1 s=CLOSED pgs=602 gs=1 cs=0 l=1 c_cookie=14683881663535187202 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561f5cb56860 0x561f5cb358f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26897fa640 0 client.16032 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:11:32.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 --2- 10.20.193.4:0/1953225533 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561f5cb55f50 0x561f5cb353b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/1953225533 >> 10.20.193.4:0/1953225533 conn(0x561f5ca74db0 msgr2=0x561f5cb54450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/1953225533 shutdown_connections 2026-02-24T09:11:32.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 1 -- 10.20.193.4:0/1953225533 wait complete. 2026-02-24T09:11:32.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cfbe8e00 20 client.16032 trim_cache size 0 max 16384 2026-02-24T09:11:32.922 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:11:32.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cdbee640 1 -- 10.20.193.4:0/270447519 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f269c0b5750 msgr2=0x7f269c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cdbee640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f269c0b5750 0x7f269c0d5c00 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b4004740 tx=0x7f26b4005f90 comp rx=0 tx=0).stop 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.907+0000 7f26cdbee640 1 -- 10.20.193.4:0/270447519 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26c8110040 msgr2=0x7f26c8176110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.908+0000 7f26cdbee640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26c8110040 0x7f26c8176110 secure :-1 s=READY pgs=598 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b80023d0 tx=0x7f26b8004290 comp rx=0 tx=0).stop 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.908+0000 7f26cdbee640 1 -- 10.20.193.4:0/270447519 shutdown_connections 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.908+0000 7f26cdbee640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f269c0b5750 0x7f269c0d5c00 unknown :-1 s=CLOSED pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.908+0000 7f26cdbee640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26c8115840 0x7f26c80f5fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.908+0000 7f26cdbee640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26c8110040 0x7f26c8176110 unknown :-1 s=CLOSED pgs=598 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.908+0000 7f26cdbee640 1 --2- 10.20.193.4:0/270447519 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26c810f650 0x7f26c80f58c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.908+0000 7f26cdbee640 1 -- 10.20.193.4:0/270447519 >> 10.20.193.4:0/270447519 conn(0x7f26c80ecf20 msgr2=0x7f26c8111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.908+0000 7f26cdbee640 1 -- 10.20.193.4:0/270447519 shutdown_connections 2026-02-24T09:11:32.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:32.908+0000 7f26cdbee640 1 -- 10.20.193.4:0/270447519 wait complete. 2026-02-24T09:11:32.944 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:11:33.059 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:33.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:32 trial014 ceph-mon[46941]: pgmap v204: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 458 MiB/s wr, 229 op/s 2026-02-24T09:11:33.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:32 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2101055066' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:33.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.164+0000 7f6c26b8f640 1 -- 10.20.193.4:0/57606589 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c2010f650 msgr2=0x7f6c2010fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.164+0000 7f6c26b8f640 1 --2- 10.20.193.4:0/57606589 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c2010f650 0x7f6c2010fa20 secure :-1 s=READY pgs=603 gs=1 cs=0 l=1 c_cookie=8998487202458267410 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c10009950 tx=0x7f6c1002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.164+0000 7f6c26b8f640 1 -- 10.20.193.4:0/57606589 shutdown_connections 2026-02-24T09:11:33.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.164+0000 7f6c26b8f640 1 --2- 10.20.193.4:0/57606589 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c20115840 0x7f6c20176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.164+0000 7f6c26b8f640 1 --2- 10.20.193.4:0/57606589 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c20110040 0x7f6c20115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.164+0000 7f6c26b8f640 1 --2- 10.20.193.4:0/57606589 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c2010f650 0x7f6c2010fa20 unknown :-1 s=CLOSED pgs=603 gs=1 cs=0 l=1 c_cookie=8998487202458267410 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.164+0000 7f6c26b8f640 1 -- 10.20.193.4:0/57606589 >> 10.20.193.4:0/57606589 conn(0x7f6c200ecf20 msgr2=0x7f6c2010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.164+0000 7f6c26b8f640 1 -- 10.20.193.4:0/57606589 shutdown_connections 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.164+0000 7f6c26b8f640 1 -- 10.20.193.4:0/57606589 wait complete. 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.164+0000 7f6c26b8f640 1 Processor -- start 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c26b8f640 1 -- start start 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c26b8f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c2010f650 0x7f6c2011df20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c26b8f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c20110040 0x7f6c2011e460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c26b8f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c20115840 0x7f6c20123830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c26b8f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f6c20123e50 con 0x7f6c20110040 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c26b8f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f6c20123fc0 con 0x7f6c2010f650 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c26b8f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6c20124180 con 0x7f6c20115840 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c17fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c20110040 0x7f6c2011e460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c17fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c20110040 0x7f6c2011e460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54236/0 (socket says 10.20.193.4:54236) 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c17fff640 1 -- 10.20.193.4:0/2704434885 learned_addr learned my addr 10.20.193.4:0/2704434885 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c25105640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c20115840 0x7f6c20123830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c24904640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c2010f650 0x7f6c2011df20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c17fff640 1 -- 10.20.193.4:0/2704434885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c20115840 msgr2=0x7f6c20123830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c17fff640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c20115840 0x7f6c20123830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c17fff640 1 -- 10.20.193.4:0/2704434885 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c2010f650 msgr2=0x7f6c2011df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c17fff640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c2010f650 0x7f6c2011df20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c17fff640 1 -- 10.20.193.4:0/2704434885 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c10009570 con 0x7f6c20110040 2026-02-24T09:11:33.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c17fff640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c20110040 0x7f6c2011e460 secure :-1 s=READY pgs=604 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c08009480 tx=0x7f6c0800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c15ffb640 1 -- 10.20.193.4:0/2704434885 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c0800cd40 con 0x7f6c20110040 2026-02-24T09:11:33.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c26b8f640 1 -- 10.20.193.4:0/2704434885 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c20124460 con 0x7f6c20110040 2026-02-24T09:11:33.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c15ffb640 1 -- 10.20.193.4:0/2704434885 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c08004d30 con 0x7f6c20110040 2026-02-24T09:11:33.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c15ffb640 1 -- 10.20.193.4:0/2704434885 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c08010740 con 0x7f6c20110040 2026-02-24T09:11:33.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.165+0000 7f6c26b8f640 1 -- 10.20.193.4:0/2704434885 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c20164b60 con 0x7f6c20110040 2026-02-24T09:11:33.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.167+0000 7f6c15ffb640 1 -- 10.20.193.4:0/2704434885 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f6c0801f060 con 0x7f6c20110040 2026-02-24T09:11:33.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.168+0000 7f6c15ffb640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6bfc0b56e0 0x7f6bfc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.168+0000 7f6c24904640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6bfc0b56e0 0x7f6bfc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.168+0000 7f6c15ffb640 1 -- 10.20.193.4:0/2704434885 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6c08014070 con 0x7f6c20110040 2026-02-24T09:11:33.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.168+0000 7f6c24904640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6bfc0b56e0 0x7f6bfc0d5b90 secure :-1 s=READY pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c100023d0 tx=0x7f6c10031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.169+0000 7f6c28b89e00 1 Processor -- start 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.169+0000 7f6c28b89e00 1 -- start start 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.169+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b5375320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.169+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.169+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 0x5620b53da8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.169+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5620b5285ee0 con 0x5620b5375860 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.169+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5620b5281c10 con 0x5620b53ba500 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.169+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5620b527bd70 con 0x5620b5374f50 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c25105640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 0x5620b53da8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c17fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c25105640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 0x5620b53da8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:53414/0 (socket says 10.20.193.4:53414) 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c25105640 1 -- 10.20.193.4:0/3757980413 learned_addr learned my addr 10.20.193.4:0/3757980413 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:33.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c24904640 1 --2- 10.20.193.4:0/3757980413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b5375320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c17fff640 1 -- 10.20.193.4:0/3757980413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 msgr2=0x5620b5375320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c17fff640 1 --2- 10.20.193.4:0/3757980413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b5375320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c17fff640 1 -- 10.20.193.4:0/3757980413 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 msgr2=0x5620b53da8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c17fff640 1 --2- 10.20.193.4:0/3757980413 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 0x5620b53da8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c17fff640 1 -- 10.20.193.4:0/3757980413 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620b5227340 con 0x5620b5375860 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c17fff640 1 --2- 10.20.193.4:0/3757980413 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9fc0 secure :-1 s=READY pgs=605 gs=1 cs=0 l=1 c_cookie=15635867942240745427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c080ad1c0 tx=0x7f6c080a9830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fdc30d142d77d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6bed4e4640 1 -- 10.20.193.4:0/3757980413 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c080d0ea0 con 0x5620b5375860 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6bed4e4640 1 -- 10.20.193.4:0/3757980413 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c080acbc0 con 0x5620b5375860 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6bed4e4640 1 -- 10.20.193.4:0/3757980413 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c080e4ac0 con 0x5620b5375860 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3757980413 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 msgr2=0x5620b53b9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/3757980413 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9fc0 secure :-1 s=READY pgs=605 gs=1 cs=0 l=1 c_cookie=15635867942240745427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c080ad1c0 tx=0x7f6c080a9830 comp rx=0 tx=0).stop 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3757980413 shutdown_connections 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/3757980413 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 0x5620b53da8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/3757980413 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9fc0 unknown :-1 s=CLOSED pgs=605 gs=1 cs=0 l=1 c_cookie=15635867942240745427 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/3757980413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b5375320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3757980413 >> 10.20.193.4:0/3757980413 conn(0x5620b5293db0 msgr2=0x5620b5373830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3757980413 shutdown_connections 2026-02-24T09:11:33.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.170+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3757980413 wait complete. 2026-02-24T09:11:33.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c28b89e00 1 -- start start 2026-02-24T09:11:33.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c28b89e00 1 Processor -- start 2026-02-24T09:11:33.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b53d1cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b5375860 0x5620b53d2230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b53d7220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5620b53d7760 con 0x5620b53ba500 2026-02-24T09:11:33.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5620b53d78d0 con 0x5620b5375860 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5620b53d7a90 con 0x5620b5374f50 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c25105640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b53d7220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c25105640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b53d7220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54254/0 (socket says 10.20.193.4:54254) 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c25105640 1 -- 10.20.193.4:0/3603056407 learned_addr learned my addr 10.20.193.4:0/3603056407 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.171+0000 7f6c17fff640 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b5375860 0x5620b53d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c24904640 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b53d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c25105640 1 -- 10.20.193.4:0/3603056407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 msgr2=0x5620b53d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c25105640 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b53d1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c25105640 1 -- 10.20.193.4:0/3603056407 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b5375860 msgr2=0x5620b53d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c25105640 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b5375860 0x5620b53d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c25105640 1 -- 10.20.193.4:0/3603056407 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620b51ff9d0 con 0x5620b53ba500 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c25105640 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b53d7220 secure :-1 s=READY pgs=606 gs=2 cs=0 l=1 c_cookie=17926510980828472588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c1c006d20 tx=0x7f6c1c012810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c7c2c2226ba50c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6bde7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6bde7fc640 1 -- 10.20.193.4:0/3603056407 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c1c017070 con 0x5620b53ba500 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3603056407 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c20164b60 con 0x5620b53ba500 2026-02-24T09:11:33.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6bde7fc640 1 -- 10.20.193.4:0/3603056407 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c1c011d50 con 0x5620b53ba500 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6bde7fc640 1 -- 10.20.193.4:0/3603056407 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c1c01bea0 con 0x5620b53ba500 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 10 client.16044 _ll_register_callbacks cb 0x5620b5226080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3603056407 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5620b4fcb4a0 con 0x5620b53ba500 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6bde7fc640 1 -- 10.20.193.4:0/3603056407 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6c1c025440 con 0x5620b53ba500 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6bde7fc640 1 -- 10.20.193.4:0/3603056407 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6c1c025640 con 0x5620b53ba500 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 10 client.16044 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3603056407 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5620b5211710 con 0x5620b53ba500 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6bde7fc640 1 -- 10.20.193.4:0/3603056407 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6c1c023060 con 0x5620b53ba500 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 10 client.16044 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 10 client.16044 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 20 client.16044 populate_metadata read hostname 'trial004' 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5620b53b77e0 0x5620b53b7c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 4 client.16044 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.172+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3603056407 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620b52717b0 con 0x5620b53b77e0 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.173+0000 7f6c24904640 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5620b53b77e0 0x5620b53b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.173+0000 7f6c24904640 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5620b53b77e0 0x5620b53b7c80 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=10590813025220656005 s_cookie=16424288730085823069 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92fa20557adb7b85 server_cookie=e3eecb949537925d in_seq=0 out_seq=0 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.173+0000 7f6bde7fc640 10 client.16044 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:11:33.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6bde7fc640 1 -- 10.20.193.4:0/3603056407 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5620b52717b0 con 0x5620b53b77e0 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6bde7fc640 10 client.16044 handle_command_reply: tid=0 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 client.16044 shutdown 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3603056407 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 msgr2=0x5620b53d7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b53d7220 secure :-1 s=READY pgs=606 gs=2 cs=0 l=1 c_cookie=17926510980828472588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c1c006d20 tx=0x7f6c1c012810 comp rx=0 tx=0).stop 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3603056407 shutdown_connections 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5620b53b77e0 0x5620b53b7c80 crc :-1 s=READY pgs=27 gs=4 cs=0 l=0 c_cookie=10590813025220656005 s_cookie=16424288730085823069 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b53d7220 unknown :-1 s=CLOSED pgs=606 gs=2 cs=0 l=1 c_cookie=17926510980828472588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b5375860 0x5620b53d2230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6bde7fc640 0 client.16044 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/3603056407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b53d1cf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3603056407 >> 10.20.193.4:0/3603056407 conn(0x5620b5293db0 msgr2=0x5620b5373040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3603056407 shutdown_connections 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 1 -- 10.20.193.4:0/3603056407 wait complete. 2026-02-24T09:11:33.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.174+0000 7f6c28b89e00 20 client.16044 trim_cache size 0 max 16384 2026-02-24T09:11:33.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c28b89e00 1 Processor -- start 2026-02-24T09:11:33.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c28b89e00 1 -- start start 2026-02-24T09:11:33.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b53b9530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 0x5620b53b9fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5620b52799a0 con 0x5620b5375860 2026-02-24T09:11:33.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5620b5055df0 con 0x5620b53ba500 2026-02-24T09:11:33.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5620b53daca0 con 0x5620b5374f50 2026-02-24T09:11:33.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c17fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c17fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54262/0 (socket says 10.20.193.4:54262) 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c17fff640 1 -- 10.20.193.4:0/2070247132 learned_addr learned my addr 10.20.193.4:0/2070247132 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c25105640 1 --2- 10.20.193.4:0/2070247132 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 0x5620b53b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c24904640 1 --2- 10.20.193.4:0/2070247132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b53b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c17fff640 1 -- 10.20.193.4:0/2070247132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 msgr2=0x5620b53b9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c17fff640 1 --2- 10.20.193.4:0/2070247132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b53b9530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c17fff640 1 -- 10.20.193.4:0/2070247132 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 msgr2=0x5620b53b9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c17fff640 1 --2- 10.20.193.4:0/2070247132 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 0x5620b53b9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c17fff640 1 -- 10.20.193.4:0/2070247132 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620b53c4350 con 0x5620b5375860 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c24904640 1 --2- 10.20.193.4:0/2070247132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b53b9530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.181+0000 7f6c17fff640 1 --2- 10.20.193.4:0/2070247132 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9a70 secure :-1 s=READY pgs=607 gs=1 cs=0 l=1 c_cookie=15586073744006470344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c080acd30 tx=0x7f6c08005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84cdb7dda8c5ac8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6becce3640 1 -- 10.20.193.4:0/2070247132 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c08072070 con 0x5620b5375860 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6becce3640 1 -- 10.20.193.4:0/2070247132 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c080adbe0 con 0x5620b5375860 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6becce3640 1 -- 10.20.193.4:0/2070247132 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c080d0ea0 con 0x5620b5375860 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6c28b89e00 1 -- 10.20.193.4:0/2070247132 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 msgr2=0x5620b53b9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/2070247132 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9a70 secure :-1 s=READY pgs=607 gs=1 cs=0 l=1 c_cookie=15586073744006470344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c080acd30 tx=0x7f6c08005850 comp rx=0 tx=0).stop 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6c28b89e00 1 -- 10.20.193.4:0/2070247132 shutdown_connections 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/2070247132 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b53ba500 0x5620b53b9fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/2070247132 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b5375860 0x5620b53b9a70 unknown :-1 s=CLOSED pgs=607 gs=1 cs=0 l=1 c_cookie=15586073744006470344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/2070247132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5374f50 0x5620b53b9530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6c28b89e00 1 -- 10.20.193.4:0/2070247132 >> 10.20.193.4:0/2070247132 conn(0x5620b5293db0 msgr2=0x5620b5373450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6c28b89e00 1 -- 10.20.193.4:0/2070247132 shutdown_connections 2026-02-24T09:11:33.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.182+0000 7f6c28b89e00 1 -- 10.20.193.4:0/2070247132 wait complete. 2026-02-24T09:11:33.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c28b89e00 1 -- start start 2026-02-24T09:11:33.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c28b89e00 1 Processor -- start 2026-02-24T09:11:33.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b5374f50 0x5620b5358bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5375860 0x5620b5354360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c28b89e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b5354920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5620b5355020 con 0x5620b53ba500 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5620b5355190 con 0x5620b5374f50 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c28b89e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5620b5420150 con 0x5620b5375860 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c25105640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b5354920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c25105640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b5354920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54268/0 (socket says 10.20.193.4:54268) 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c25105640 1 -- 10.20.193.4:0/4051324417 learned_addr learned my addr 10.20.193.4:0/4051324417 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c24904640 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b5374f50 0x5620b5358bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c25105640 1 -- 10.20.193.4:0/4051324417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5375860 msgr2=0x5620b5354360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c25105640 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5375860 0x5620b5354360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c25105640 1 -- 10.20.193.4:0/4051324417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b5374f50 msgr2=0x5620b5358bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c25105640 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b5374f50 0x5620b5358bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c25105640 1 -- 10.20.193.4:0/4051324417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620b520c190 con 0x5620b53ba500 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c25105640 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b5354920 secure :-1 s=READY pgs=608 gs=1 cs=0 l=1 c_cookie=6852087671876542687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c1c005490 tx=0x7f6c1c010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f17816f0408e0df server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6bde7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:33.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6bde7fc640 1 -- 10.20.193.4:0/4051324417 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c1c017070 con 0x5620b53ba500 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6bde7fc640 1 -- 10.20.193.4:0/4051324417 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5620b4fcb4a0 con 0x5620b53ba500 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6bde7fc640 1 -- 10.20.193.4:0/4051324417 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c1c010740 con 0x5620b53ba500 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6c28b89e00 1 -- 10.20.193.4:0/4051324417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620b5227340 con 0x5620b53ba500 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6bde7fc640 1 -- 10.20.193.4:0/4051324417 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6c1c0108d0 con 0x5620b53ba500 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.183+0000 7f6bde7fc640 10 client.16050 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 10 client.16050 _ll_register_callbacks cb 0x5620b5226080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 1 -- 10.20.193.4:0/4051324417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c080acbc0 con 0x5620b53ba500 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6bde7fc640 1 -- 10.20.193.4:0/4051324417 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6c1c01abe0 con 0x5620b53ba500 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 10 client.16050 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 1 -- 10.20.193.4:0/4051324417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5620b51ffd00 con 0x5620b53ba500 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6bde7fc640 1 -- 10.20.193.4:0/4051324417 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6c1c01a370 con 0x5620b53ba500 2026-02-24T09:11:33.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 10 client.16050 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 10 client.16050 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 20 client.16050 populate_metadata read hostname 'trial004' 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5620b54681c0 0x5620b5488670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 4 client.16050 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 1 -- 10.20.193.4:0/4051324417 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5620b4fb0160 con 0x5620b54681c0 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c24904640 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5620b54681c0 0x5620b5488670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6bde7fc640 10 client.16050 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c24904640 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5620b54681c0 0x5620b5488670 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=10627091957270657983 s_cookie=11350823047795936253 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=937b03d494873bbf server_cookie=9d86396c38318bfd in_seq=0 out_seq=0 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6bde7fc640 1 -- 10.20.193.4:0/4051324417 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5620b4fb0160 con 0x5620b54681c0 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6bde7fc640 10 client.16050 handle_command_reply: tid=0 2026-02-24T09:11:33.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.184+0000 7f6c28b89e00 1 client.16050 shutdown 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 1 -- 10.20.193.4:0/4051324417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 msgr2=0x5620b5354920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b5354920 secure :-1 s=READY pgs=608 gs=1 cs=0 l=1 c_cookie=6852087671876542687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c1c005490 tx=0x7f6c1c010b80 comp rx=0 tx=0).stop 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 1 -- 10.20.193.4:0/4051324417 shutdown_connections 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5620b54681c0 0x5620b5488670 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=10627091957270657983 s_cookie=11350823047795936253 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5620b53ba500 0x5620b5354920 unknown :-1 s=CLOSED pgs=608 gs=1 cs=0 l=1 c_cookie=6852087671876542687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5620b5375860 0x5620b5354360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6bde7fc640 0 client.16050 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 1 --2- 10.20.193.4:0/4051324417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5620b5374f50 0x5620b5358bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 1 -- 10.20.193.4:0/4051324417 >> 10.20.193.4:0/4051324417 conn(0x5620b5293db0 msgr2=0x5620b5373c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 1 -- 10.20.193.4:0/4051324417 shutdown_connections 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 1 -- 10.20.193.4:0/4051324417 wait complete. 2026-02-24T09:11:33.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c28b89e00 20 client.16050 trim_cache size 0 max 16384 2026-02-24T09:11:33.194 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 -- 10.20.193.4:0/2704434885 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6bfc0b56e0 msgr2=0x7f6bfc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6bfc0b56e0 0x7f6bfc0d5b90 secure :-1 s=READY pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c100023d0 tx=0x7f6c10031040 comp rx=0 tx=0).stop 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 -- 10.20.193.4:0/2704434885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c20110040 msgr2=0x7f6c2011e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c20110040 0x7f6c2011e460 secure :-1 s=READY pgs=604 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c08009480 tx=0x7f6c0800ee60 comp rx=0 tx=0).stop 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 -- 10.20.193.4:0/2704434885 shutdown_connections 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6bfc0b56e0 0x7f6bfc0d5b90 unknown :-1 s=CLOSED pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c20115840 0x7f6c20123830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c20110040 0x7f6c2011e460 unknown :-1 s=CLOSED pgs=604 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 --2- 10.20.193.4:0/2704434885 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c2010f650 0x7f6c2011df20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 -- 10.20.193.4:0/2704434885 >> 10.20.193.4:0/2704434885 conn(0x7f6c200ecf20 msgr2=0x7f6c2010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 -- 10.20.193.4:0/2704434885 shutdown_connections 2026-02-24T09:11:33.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.185+0000 7f6c26b8f640 1 -- 10.20.193.4:0/2704434885 wait complete. 2026-02-24T09:11:33.222 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:11:33.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:32 trial090 ceph-mon[47278]: pgmap v204: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 458 MiB/s wr, 229 op/s 2026-02-24T09:11:33.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:32 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2101055066' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:33.339 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:33.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.442+0000 7f35f2b74640 1 -- 10.20.193.4:0/2831621236 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35ec110040 msgr2=0x7f35ec115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.442+0000 7f35f2b74640 1 --2- 10.20.193.4:0/2831621236 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35ec110040 0x7f35ec115090 secure :-1 s=READY pgs=609 gs=1 cs=0 l=1 c_cookie=7329379957734693174 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d4009950 tx=0x7f35d402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.442+0000 7f35f2b74640 1 -- 10.20.193.4:0/2831621236 shutdown_connections 2026-02-24T09:11:33.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.442+0000 7f35f2b74640 1 --2- 10.20.193.4:0/2831621236 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35ec115840 0x7f35ec176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.442+0000 7f35f2b74640 1 --2- 10.20.193.4:0/2831621236 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35ec110040 0x7f35ec115090 unknown :-1 s=CLOSED pgs=609 gs=1 cs=0 l=1 c_cookie=7329379957734693174 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.442+0000 7f35f2b74640 1 --2- 10.20.193.4:0/2831621236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35ec10f650 0x7f35ec10fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.442+0000 7f35f2b74640 1 -- 10.20.193.4:0/2831621236 >> 10.20.193.4:0/2831621236 conn(0x7f35ec0ecf20 msgr2=0x7f35ec10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.442+0000 7f35f2b74640 1 -- 10.20.193.4:0/2831621236 shutdown_connections 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.442+0000 7f35f2b74640 1 -- 10.20.193.4:0/2831621236 wait complete. 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.442+0000 7f35f2b74640 1 Processor -- start 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f2b74640 1 -- start start 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f2b74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35ec10f650 0x7f35ec0f5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f2b74640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35ec110040 0x7f35ec176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f2b74640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35ec115840 0x7f35ec0f5f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f2b74640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec0fb1a0 con 0x7f35ec10f650 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f2b74640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec0fb310 con 0x7f35ec115840 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f2b74640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec0fb4d0 con 0x7f35ec110040 2026-02-24T09:11:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f08e9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35ec10f650 0x7f35ec0f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f08e9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35ec10f650 0x7f35ec0f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54282/0 (socket says 10.20.193.4:54282) 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f08e9640 1 -- 10.20.193.4:0/2780592664 learned_addr learned my addr 10.20.193.4:0/2780592664 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35e3fff640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35ec110040 0x7f35ec176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f10ea640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35ec115840 0x7f35ec0f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f08e9640 1 -- 10.20.193.4:0/2780592664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35ec110040 msgr2=0x7f35ec176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f08e9640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35ec110040 0x7f35ec176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f08e9640 1 -- 10.20.193.4:0/2780592664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35ec115840 msgr2=0x7f35ec0f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f08e9640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35ec115840 0x7f35ec0f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f08e9640 1 -- 10.20.193.4:0/2780592664 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d4009570 con 0x7f35ec10f650 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f08e9640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35ec10f650 0x7f35ec0f5890 secure :-1 s=READY pgs=610 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35dc009480 tx=0x7f35dc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35e1ffb640 1 -- 10.20.193.4:0/2780592664 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35dc00cd40 con 0x7f35ec10f650 2026-02-24T09:11:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35e1ffb640 1 -- 10.20.193.4:0/2780592664 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f35dc004d30 con 0x7f35ec10f650 2026-02-24T09:11:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f2b74640 1 -- 10.20.193.4:0/2780592664 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ec0fb7b0 con 0x7f35ec10f650 2026-02-24T09:11:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35e1ffb640 1 -- 10.20.193.4:0/2780592664 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35dc0106b0 con 0x7f35ec10f650 2026-02-24T09:11:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.443+0000 7f35f2b74640 1 -- 10.20.193.4:0/2780592664 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec0fbc80 con 0x7f35ec10f650 2026-02-24T09:11:33.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.445+0000 7f35e1ffb640 1 -- 10.20.193.4:0/2780592664 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f35dc01f060 con 0x7f35ec10f650 2026-02-24T09:11:33.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.446+0000 7f35e1ffb640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35c80b56d0 0x7f35c80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.446+0000 7f35e1ffb640 1 -- 10.20.193.4:0/2780592664 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f35dc014070 con 0x7f35ec10f650 2026-02-24T09:11:33.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.446+0000 7f35e3fff640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35c80b56d0 0x7f35c80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.446+0000 7f35e3fff640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35c80b56d0 0x7f35c80d5b80 secure :-1 s=READY pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d40023d0 tx=0x7f35d4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f4b6ee00 1 Processor -- start 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f4b6ee00 1 -- start start 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a3f50 0x556ca10a4320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 0x556ca10e8fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10e9500 0x556ca11098e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556ca0fb4ee0 con 0x556ca10a3f50 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556ca0fb0c10 con 0x556ca10e9500 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556ca0faad70 con 0x556ca10a4860 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f08e9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a3f50 0x556ca10a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f08e9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a3f50 0x556ca10a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54298/0 (socket says 10.20.193.4:54298) 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f08e9640 1 -- 10.20.193.4:0/1087994144 learned_addr learned my addr 10.20.193.4:0/1087994144 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:33.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f10ea640 1 --2- 10.20.193.4:0/1087994144 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10e9500 0x556ca11098e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35e3fff640 1 --2- 10.20.193.4:0/1087994144 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 0x556ca10e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f08e9640 1 -- 10.20.193.4:0/1087994144 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 msgr2=0x556ca10e8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f08e9640 1 --2- 10.20.193.4:0/1087994144 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 0x556ca10e8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f08e9640 1 -- 10.20.193.4:0/1087994144 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10e9500 msgr2=0x556ca11098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f08e9640 1 --2- 10.20.193.4:0/1087994144 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10e9500 0x556ca11098e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.447+0000 7f35f08e9640 1 -- 10.20.193.4:0/1087994144 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca0f56340 con 0x556ca10a3f50 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35f08e9640 1 --2- 10.20.193.4:0/1087994144 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a3f50 0x556ca10a4320 secure :-1 s=READY pgs=611 gs=1 cs=0 l=1 c_cookie=14185278169447777516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35dc005490 tx=0x7f35dc0a9900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4dc3b569a09c4ec server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35b94e4640 1 -- 10.20.193.4:0/1087994144 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35dc0d0ea0 con 0x556ca10a3f50 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35b94e4640 1 -- 10.20.193.4:0/1087994144 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f35dc0ac9e0 con 0x556ca10a3f50 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35b94e4640 1 -- 10.20.193.4:0/1087994144 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35dc0e4ac0 con 0x556ca10a3f50 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1087994144 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a3f50 msgr2=0x556ca10a4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/1087994144 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a3f50 0x556ca10a4320 secure :-1 s=READY pgs=611 gs=1 cs=0 l=1 c_cookie=14185278169447777516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35dc005490 tx=0x7f35dc0a9900 comp rx=0 tx=0).stop 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1087994144 shutdown_connections 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/1087994144 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10e9500 0x556ca11098e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/1087994144 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 0x556ca10e8fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/1087994144 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a3f50 0x556ca10a4320 unknown :-1 s=CLOSED pgs=611 gs=1 cs=0 l=1 c_cookie=14185278169447777516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1087994144 >> 10.20.193.4:0/1087994144 conn(0x556ca0fc2db0 msgr2=0x556ca10a2830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1087994144 shutdown_connections 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.448+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1087994144 wait complete. 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f4b6ee00 1 -- start start 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f4b6ee00 1 Processor -- start 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca1100d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 0x556ca11012b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10e9500 0x556ca11062a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556ca11067e0 con 0x556ca10e9500 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556ca1106950 con 0x556ca10a3f50 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556ca1106b10 con 0x556ca10a4860 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f10ea640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10e9500 0x556ca11062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f10ea640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10e9500 0x556ca11062a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54312/0 (socket says 10.20.193.4:54312) 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f10ea640 1 -- 10.20.193.4:0/2603219912 learned_addr learned my addr 10.20.193.4:0/2603219912 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f08e9640 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca1100d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35f10ea640 1 -- 10.20.193.4:0/2603219912 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 msgr2=0x556ca11012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.449+0000 7f35e3fff640 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 0x556ca11012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f10ea640 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 0x556ca11012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f10ea640 1 -- 10.20.193.4:0/2603219912 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 msgr2=0x556ca1100d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f10ea640 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca1100d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f10ea640 1 -- 10.20.193.4:0/2603219912 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca0f2e9d0 con 0x556ca10e9500 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35e3fff640 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 0x556ca11012b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f08e9640 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca1100d70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f10ea640 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10e9500 0x556ca11062a0 secure :-1 s=READY pgs=612 gs=1 cs=0 l=1 c_cookie=5543494208927861823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35e8003c30 tx=0x7f35e80127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cee729cc1948c3f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35aa7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35aa7fc640 1 -- 10.20.193.4:0/2603219912 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35e801c690 con 0x556ca10e9500 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/2603219912 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec0fbc80 con 0x556ca10e9500 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35aa7fc640 1 -- 10.20.193.4:0/2603219912 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f35e801ccd0 con 0x556ca10e9500 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35aa7fc640 1 -- 10.20.193.4:0/2603219912 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35e80103d0 con 0x556ca10e9500 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 10 client.16062 _ll_register_callbacks cb 0x556ca0f55080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/2603219912 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ca0cfa4a0 con 0x556ca10e9500 2026-02-24T09:11:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35aa7fc640 1 -- 10.20.193.4:0/2603219912 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f35e8010550 con 0x556ca10e9500 2026-02-24T09:11:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35aa7fc640 1 -- 10.20.193.4:0/2603219912 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f35e8010710 con 0x556ca10e9500 2026-02-24T09:11:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 10 client.16062 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/2603219912 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556ca0f40710 con 0x556ca10e9500 2026-02-24T09:11:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35aa7fc640 1 -- 10.20.193.4:0/2603219912 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f35e801c7f0 con 0x556ca10e9500 2026-02-24T09:11:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 10 client.16062 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 20 client.16062 populate_metadata read hostname 'trial004' 2026-02-24T09:11:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556ca10e6860 0x556ca10e6d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 4 client.16062 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/2603219912 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ca0fa07b0 con 0x556ca10e6860 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.450+0000 7f35f08e9640 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556ca10e6860 0x556ca10e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.451+0000 7f35f08e9640 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556ca10e6860 0x556ca10e6d00 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=16841197340502767876 s_cookie=15435734654749295318 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9b7f3c0b0ebb904 server_cookie=d636bee2ef84c2d6 in_seq=0 out_seq=0 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.451+0000 7f35aa7fc640 10 client.16062 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35aa7fc640 1 -- 10.20.193.4:0/2603219912 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556ca0fa07b0 con 0x556ca10e6860 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35aa7fc640 10 client.16062 handle_command_reply: tid=0 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 client.16062 shutdown 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/2603219912 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10e9500 msgr2=0x556ca11062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10e9500 0x556ca11062a0 secure :-1 s=READY pgs=612 gs=1 cs=0 l=1 c_cookie=5543494208927861823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35e8003c30 tx=0x7f35e80127b0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/2603219912 shutdown_connections 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556ca10e6860 0x556ca10e6d00 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=16841197340502767876 s_cookie=15435734654749295318 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10e9500 0x556ca11062a0 unknown :-1 s=CLOSED pgs=612 gs=1 cs=0 l=1 c_cookie=5543494208927861823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10a4860 0x556ca11012b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35aa7fc640 0 client.16062 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/2603219912 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca1100d70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/2603219912 >> 10.20.193.4:0/2603219912 conn(0x556ca0fc2db0 msgr2=0x556ca10a2040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/2603219912 shutdown_connections 2026-02-24T09:11:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/2603219912 wait complete. 2026-02-24T09:11:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.452+0000 7f35f4b6ee00 20 client.16062 trim_cache size 0 max 16384 2026-02-24T09:11:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35f4b6ee00 1 Processor -- start 2026-02-24T09:11:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35f4b6ee00 1 -- start start 2026-02-24T09:11:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca10e3150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca10e3690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10e9500 0x556ca10e3bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556ca0fa89a0 con 0x556ca10a4860 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556ca0d84df0 con 0x556ca10a3f50 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556ca10ee5a0 con 0x556ca10e9500 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35e3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca10e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35e3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca10e3690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54314/0 (socket says 10.20.193.4:54314) 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35e3fff640 1 -- 10.20.193.4:0/350511442 learned_addr learned my addr 10.20.193.4:0/350511442 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35f08e9640 1 --2- 10.20.193.4:0/350511442 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca10e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35e3fff640 1 -- 10.20.193.4:0/350511442 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10e9500 msgr2=0x556ca10e3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35e3fff640 1 --2- 10.20.193.4:0/350511442 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10e9500 0x556ca10e3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35e3fff640 1 -- 10.20.193.4:0/350511442 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 msgr2=0x556ca10e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35e3fff640 1 --2- 10.20.193.4:0/350511442 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca10e3150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35e3fff640 1 -- 10.20.193.4:0/350511442 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca10f33d0 con 0x556ca10a4860 2026-02-24T09:11:33.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35e3fff640 1 --2- 10.20.193.4:0/350511442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca10e3690 secure :-1 s=READY pgs=613 gs=1 cs=0 l=1 c_cookie=16138167215887988901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d402f6e0 tx=0x7f35d403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff6499444dbb8a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35b8ce3640 1 -- 10.20.193.4:0/350511442 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35d404a070 con 0x556ca10a4860 2026-02-24T09:11:33.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35b8ce3640 1 -- 10.20.193.4:0/350511442 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f35d4002980 con 0x556ca10a4860 2026-02-24T09:11:33.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.459+0000 7f35b8ce3640 1 -- 10.20.193.4:0/350511442 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35d4043710 con 0x556ca10a4860 2026-02-24T09:11:33.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/350511442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 msgr2=0x556ca10e3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/350511442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca10e3690 secure :-1 s=READY pgs=613 gs=1 cs=0 l=1 c_cookie=16138167215887988901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d402f6e0 tx=0x7f35d403b000 comp rx=0 tx=0).stop 2026-02-24T09:11:33.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/350511442 shutdown_connections 2026-02-24T09:11:33.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/350511442 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10e9500 0x556ca10e3bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/350511442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca10e3690 unknown :-1 s=CLOSED pgs=613 gs=1 cs=0 l=1 c_cookie=16138167215887988901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/350511442 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca10e3150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/350511442 >> 10.20.193.4:0/350511442 conn(0x556ca0fc2db0 msgr2=0x556ca10a2450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/350511442 shutdown_connections 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/350511442 wait complete. 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 -- start start 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 Processor -- start 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca1083450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca1083990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10e9500 0x556ca1083ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556ca114f100 con 0x556ca10a4860 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556ca114f240 con 0x556ca10a3f50 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35f4b6ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556ca114f400 con 0x556ca10e9500 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35e3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca1083990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35e3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca1083990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54324/0 (socket says 10.20.193.4:54324) 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.460+0000 7f35e3fff640 1 -- 10.20.193.4:0/1618767079 learned_addr learned my addr 10.20.193.4:0/1618767079 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35e3fff640 1 -- 10.20.193.4:0/1618767079 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10e9500 msgr2=0x556ca1083ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35e3fff640 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10e9500 0x556ca1083ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35e3fff640 1 -- 10.20.193.4:0/1618767079 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 msgr2=0x556ca1083450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f08e9640 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca1083450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35e3fff640 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca1083450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35e3fff640 1 -- 10.20.193.4:0/1618767079 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca0f3b190 con 0x556ca10a4860 2026-02-24T09:11:33.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f08e9640 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca1083450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:33.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35e3fff640 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca1083990 secure :-1 s=READY pgs=614 gs=1 cs=0 l=1 c_cookie=12085714549998596506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d4043840 tx=0x7f35d4038ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b91559b16fb19a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:33.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35aa7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:33.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35aa7fc640 1 -- 10.20.193.4:0/1618767079 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35d404a040 con 0x556ca10a4860 2026-02-24T09:11:33.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35aa7fc640 1 -- 10.20.193.4:0/1618767079 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f35d4038be0 con 0x556ca10a4860 2026-02-24T09:11:33.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1618767079 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec176a80 con 0x556ca10a4860 2026-02-24T09:11:33.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35aa7fc640 1 -- 10.20.193.4:0/1618767079 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35d405ba80 con 0x556ca10a4860 2026-02-24T09:11:33.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 10 client.16068 _ll_register_callbacks cb 0x556ca0f55080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:33.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1618767079 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35dc0ac9e0 con 0x556ca10a4860 2026-02-24T09:11:33.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35aa7fc640 1 -- 10.20.193.4:0/1618767079 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f35d405be20 con 0x556ca10a4860 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35aa7fc640 1 -- 10.20.193.4:0/1618767079 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f35d40513f0 con 0x556ca10a4860 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 10 client.16068 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1618767079 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556ca0f2ed00 con 0x556ca10a4860 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35aa7fc640 1 -- 10.20.193.4:0/1618767079 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f35d4062030 con 0x556ca10a4860 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 10 client.16068 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 20 client.16068 populate_metadata read hostname 'trial004' 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556ca1197260 0x556ca11b7710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 4 client.16068 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1618767079 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ca0cdf160 con 0x556ca1197260 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.461+0000 7f35f08e9640 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556ca1197260 0x556ca11b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35aa7fc640 10 client.16068 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:33.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f08e9640 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556ca1197260 0x556ca11b7710 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=12400333397356988951 s_cookie=3918172767558264622 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac16d5866de04a17 server_cookie=3660255f6aeb672e in_seq=0 out_seq=0 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35aa7fc640 1 -- 10.20.193.4:0/1618767079 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ca0cdf160 con 0x556ca1197260 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35aa7fc640 10 client.16068 handle_command_reply: tid=0 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 client.16068 shutdown 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1618767079 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 msgr2=0x556ca1083990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca1083990 secure :-1 s=READY pgs=614 gs=1 cs=0 l=1 c_cookie=12085714549998596506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d4043840 tx=0x7f35d4038ad0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1618767079 shutdown_connections 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556ca1197260 0x556ca11b7710 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=12400333397356988951 s_cookie=3918172767558264622 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556ca10e9500 0x556ca1083ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556ca10a4860 0x556ca1083990 unknown :-1 s=CLOSED pgs=614 gs=1 cs=0 l=1 c_cookie=12085714549998596506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35aa7fc640 0 client.16068 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:33.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 --2- 10.20.193.4:0/1618767079 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556ca10a3f50 0x556ca1083450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1618767079 >> 10.20.193.4:0/1618767079 conn(0x556ca0fc2db0 msgr2=0x556ca10a2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1618767079 shutdown_connections 2026-02-24T09:11:33.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 1 -- 10.20.193.4:0/1618767079 wait complete. 2026-02-24T09:11:33.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.462+0000 7f35f4b6ee00 20 client.16068 trim_cache size 0 max 16384 2026-02-24T09:11:33.479 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:11:33.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 -- 10.20.193.4:0/2780592664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35c80b56d0 msgr2=0x7f35c80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35c80b56d0 0x7f35c80d5b80 secure :-1 s=READY pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d40023d0 tx=0x7f35d4031040 comp rx=0 tx=0).stop 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 -- 10.20.193.4:0/2780592664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35ec10f650 msgr2=0x7f35ec0f5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35ec10f650 0x7f35ec0f5890 secure :-1 s=READY pgs=610 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35dc009480 tx=0x7f35dc00ee60 comp rx=0 tx=0).stop 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 -- 10.20.193.4:0/2780592664 shutdown_connections 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35c80b56d0 0x7f35c80d5b80 unknown :-1 s=CLOSED pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35ec115840 0x7f35ec0f5f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35ec110040 0x7f35ec176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 --2- 10.20.193.4:0/2780592664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35ec10f650 0x7f35ec0f5890 unknown :-1 s=CLOSED pgs=610 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 -- 10.20.193.4:0/2780592664 >> 10.20.193.4:0/2780592664 conn(0x7f35ec0ecf20 msgr2=0x7f35ec111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 -- 10.20.193.4:0/2780592664 shutdown_connections 2026-02-24T09:11:33.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:33.463+0000 7f35f2b74640 1 -- 10.20.193.4:0/2780592664 wait complete. 2026-02-24T09:11:34.501 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:11:34.501 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:11:34.619 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:34.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 -- 10.20.193.4:0/3080443396 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db8115470 msgr2=0x7f4db8175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:34.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 --2- 10.20.193.4:0/3080443396 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db8115470 0x7f4db8175e40 secure :-1 s=READY pgs=615 gs=1 cs=0 l=1 c_cookie=5333864025887520698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac00aa30 tx=0x7f4dac030280 comp rx=0 tx=0).stop 2026-02-24T09:11:34.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 -- 10.20.193.4:0/3080443396 shutdown_connections 2026-02-24T09:11:34.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 --2- 10.20.193.4:0/3080443396 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db8115470 0x7f4db8175e40 unknown :-1 s=CLOSED pgs=615 gs=1 cs=0 l=1 c_cookie=5333864025887520698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 --2- 10.20.193.4:0/3080443396 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db810fc70 0x7f4db8114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 --2- 10.20.193.4:0/3080443396 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db810f280 0x7f4db810f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 -- 10.20.193.4:0/3080443396 >> 10.20.193.4:0/3080443396 conn(0x7f4db805f830 msgr2=0x7f4db810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:34.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 -- 10.20.193.4:0/3080443396 shutdown_connections 2026-02-24T09:11:34.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 -- 10.20.193.4:0/3080443396 wait complete. 2026-02-24T09:11:34.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 Processor -- start 2026-02-24T09:11:34.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.720+0000 7f4dbe646640 1 -- start start 2026-02-24T09:11:34.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4dbe646640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db810f280 0x7f4db811dc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4dbe646640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db810fc70 0x7f4db811e150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4dbe646640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db8115470 0x7f4db8123520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4dbe646640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4db8123b40 con 0x7f4db810fc70 2026-02-24T09:11:34.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4dbe646640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4db8123cb0 con 0x7f4db810f280 2026-02-24T09:11:34.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4dbe646640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4db8123e70 con 0x7f4db8115470 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db810fc70 0x7f4db811e150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db810fc70 0x7f4db811e150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54340/0 (socket says 10.20.193.4:54340) 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db77fe640 1 -- 10.20.193.4:0/3588184190 learned_addr learned my addr 10.20.193.4:0/3588184190 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db77fe640 1 -- 10.20.193.4:0/3588184190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db8115470 msgr2=0x7f4db8123520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db77fe640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db8115470 0x7f4db8123520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db77fe640 1 -- 10.20.193.4:0/3588184190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db810f280 msgr2=0x7f4db811dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db7fff640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db810f280 0x7f4db811dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db77fe640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db810f280 0x7f4db811dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db77fe640 1 -- 10.20.193.4:0/3588184190 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac00a650 con 0x7f4db810fc70 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db7fff640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db810f280 0x7f4db811dc10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db77fe640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db810fc70 0x7f4db811e150 secure :-1 s=READY pgs=616 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da8009480 tx=0x7f4da800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:34.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db57fa640 1 -- 10.20.193.4:0/3588184190 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da800cd40 con 0x7f4db810fc70 2026-02-24T09:11:34.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db57fa640 1 -- 10.20.193.4:0/3588184190 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4da8004d30 con 0x7f4db810fc70 2026-02-24T09:11:34.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4db57fa640 1 -- 10.20.193.4:0/3588184190 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da80106b0 con 0x7f4db810fc70 2026-02-24T09:11:34.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4dbe646640 1 -- 10.20.193.4:0/3588184190 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db8124150 con 0x7f4db810fc70 2026-02-24T09:11:34.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.721+0000 7f4dbe646640 1 -- 10.20.193.4:0/3588184190 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db8164850 con 0x7f4db810fc70 2026-02-24T09:11:34.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.723+0000 7f4db57fa640 1 -- 10.20.193.4:0/3588184190 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f4da801f060 con 0x7f4db810fc70 2026-02-24T09:11:34.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.723+0000 7f4db57fa640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b56e0 0x7f4d8c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.723+0000 7f4db57fa640 1 -- 10.20.193.4:0/3588184190 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4da8014070 con 0x7f4db810fc70 2026-02-24T09:11:34.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.723+0000 7f4db7fff640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b56e0 0x7f4d8c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.724+0000 7f4db7fff640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b56e0 0x7f4d8c0d5b90 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da4005db0 tx=0x7f4da400a5a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dc0640e00 1 Processor -- start 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dc0640e00 1 -- start start 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac8e4300 0x55ddac8e46d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4c10 0x55ddac929370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac949c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ddac7f4520 con 0x55ddac9298b0 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ddac7f0250 con 0x55ddac8e4300 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ddac7ea3b0 con 0x55ddac8e4c10 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dbcbbc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac949c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dbcbbc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac949c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54356/0 (socket says 10.20.193.4:54356) 2026-02-24T09:11:34.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4dbcbbc640 1 -- 10.20.193.4:0/1450473406 learned_addr learned my addr 10.20.193.4:0/1450473406 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.725+0000 7f4db77fe640 1 --2- 10.20.193.4:0/1450473406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4c10 0x55ddac929370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4db7fff640 1 --2- 10.20.193.4:0/1450473406 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac8e4300 0x55ddac8e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dbcbbc640 1 -- 10.20.193.4:0/1450473406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4c10 msgr2=0x55ddac929370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dbcbbc640 1 --2- 10.20.193.4:0/1450473406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4c10 0x55ddac929370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dbcbbc640 1 -- 10.20.193.4:0/1450473406 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac8e4300 msgr2=0x55ddac8e46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dbcbbc640 1 --2- 10.20.193.4:0/1450473406 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac8e4300 0x55ddac8e46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dbcbbc640 1 -- 10.20.193.4:0/1450473406 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddac7956e0 con 0x55ddac9298b0 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dbcbbc640 1 --2- 10.20.193.4:0/1450473406 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac949c90 secure :-1 s=READY pgs=617 gs=1 cs=0 l=1 c_cookie=1435123418694525804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac0058d0 tx=0x7f4dac0069e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ea95254c21a36c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4d88ce3640 1 -- 10.20.193.4:0/1450473406 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dac03e070 con 0x55ddac9298b0 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4d88ce3640 1 -- 10.20.193.4:0/1450473406 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4dac006eb0 con 0x55ddac9298b0 2026-02-24T09:11:34.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4d88ce3640 1 -- 10.20.193.4:0/1450473406 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dac0050c0 con 0x55ddac9298b0 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dc0640e00 1 -- 10.20.193.4:0/1450473406 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 msgr2=0x55ddac949c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/1450473406 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac949c90 secure :-1 s=READY pgs=617 gs=1 cs=0 l=1 c_cookie=1435123418694525804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac0058d0 tx=0x7f4dac0069e0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dc0640e00 1 -- 10.20.193.4:0/1450473406 shutdown_connections 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/1450473406 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac949c90 unknown :-1 s=CLOSED pgs=617 gs=1 cs=0 l=1 c_cookie=1435123418694525804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/1450473406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4c10 0x55ddac929370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/1450473406 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac8e4300 0x55ddac8e46d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dc0640e00 1 -- 10.20.193.4:0/1450473406 >> 10.20.193.4:0/1450473406 conn(0x55ddac8024f0 msgr2=0x55ddac8e2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dc0640e00 1 -- 10.20.193.4:0/1450473406 shutdown_connections 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.726+0000 7f4dc0640e00 1 -- 10.20.193.4:0/1450473406 wait complete. 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dc0640e00 1 -- start start 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dc0640e00 1 Processor -- start 2026-02-24T09:11:34.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac8e4300 0x55ddac8fc2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4c10 0x55ddac8fc800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac9017f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ddac901d30 con 0x55ddac9298b0 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ddac901ea0 con 0x55ddac8e4300 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ddac902060 con 0x55ddac8e4c10 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dbcbbc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac9017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dbcbbc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac9017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54360/0 (socket says 10.20.193.4:54360) 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dbcbbc640 1 -- 10.20.193.4:0/2070815693 learned_addr learned my addr 10.20.193.4:0/2070815693 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4db7fff640 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac8e4300 0x55ddac8fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dbcbbc640 1 -- 10.20.193.4:0/2070815693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4c10 msgr2=0x55ddac8fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dbcbbc640 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4c10 0x55ddac8fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dbcbbc640 1 -- 10.20.193.4:0/2070815693 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac8e4300 msgr2=0x55ddac8fc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dbcbbc640 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac8e4300 0x55ddac8fc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dbcbbc640 1 -- 10.20.193.4:0/2070815693 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddac76dcd0 con 0x55ddac9298b0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4dbcbbc640 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac9017f0 secure :-1 s=READY pgs=618 gs=1 cs=0 l=1 c_cookie=17354920552050499128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac00aa30 tx=0x7f4dac006fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d9104ab2189e38 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.727+0000 7f4d79ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4d79ffb640 1 -- 10.20.193.4:0/2070815693 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dac03e040 con 0x55ddac9298b0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4d79ffb640 1 -- 10.20.193.4:0/2070815693 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4dac039cc0 con 0x55ddac9298b0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2070815693 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db81766b0 con 0x55ddac9298b0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4d79ffb640 1 -- 10.20.193.4:0/2070815693 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dac042690 con 0x55ddac9298b0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 10 client.16080 _ll_register_callbacks cb 0x55ddac766790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2070815693 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ddac4779d0 con 0x55ddac9298b0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4d79ffb640 1 -- 10.20.193.4:0/2070815693 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4dac042820 con 0x55ddac9298b0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4d79ffb640 1 -- 10.20.193.4:0/2070815693 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4dac042a00 con 0x55ddac9298b0 2026-02-24T09:11:34.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 10 client.16080 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2070815693 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55ddac77fab0 con 0x55ddac9298b0 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4d79ffb640 1 -- 10.20.193.4:0/2070815693 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4dac049070 con 0x55ddac9298b0 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 10 client.16080 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 10 client.16080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 20 client.16080 populate_metadata read hostname 'trial004' 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddac9268a0 0x55ddac926d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 4 client.16080 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2070815693 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddac7fab70 con 0x55ddac9268a0 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.728+0000 7f4db7fff640 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddac9268a0 0x55ddac926d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4d79ffb640 10 client.16080 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4db7fff640 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddac9268a0 0x55ddac926d40 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=8055627199378386943 s_cookie=121077909512955115 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fcb5641ddec6fff server_cookie=1ae27b79aaaa4eb in_seq=0 out_seq=0 2026-02-24T09:11:34.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4d79ffb640 1 -- 10.20.193.4:0/2070815693 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ddac7fab70 con 0x55ddac9268a0 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4d79ffb640 10 client.16080 handle_command_reply: tid=0 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 client.16080 shutdown 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2070815693 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 msgr2=0x55ddac9017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac9017f0 secure :-1 s=READY pgs=618 gs=1 cs=0 l=1 c_cookie=17354920552050499128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac00aa30 tx=0x7f4dac006fc0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2070815693 shutdown_connections 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddac9268a0 0x55ddac926d40 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=8055627199378386943 s_cookie=121077909512955115 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac9298b0 0x55ddac9017f0 unknown :-1 s=CLOSED pgs=618 gs=1 cs=0 l=1 c_cookie=17354920552050499128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4c10 0x55ddac8fc800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/2070815693 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac8e4300 0x55ddac8fc2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4d79ffb640 0 client.16080 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2070815693 >> 10.20.193.4:0/2070815693 conn(0x55ddac8024f0 msgr2=0x55ddac8e32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:34.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2070815693 shutdown_connections 2026-02-24T09:11:34.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.729+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2070815693 wait complete. 2026-02-24T09:11:34.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.730+0000 7f4dc0640e00 20 client.16080 trim_cache size 0 max 16384 2026-02-24T09:11:34.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.738+0000 7f4dc0640e00 1 Processor -- start 2026-02-24T09:11:34.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.738+0000 7f4dc0640e00 1 -- start start 2026-02-24T09:11:34.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 0x55ddac8fd510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac8fda50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac9298b0 0x55ddac8fdf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ddac7e7fe0 con 0x55ddac8e4c10 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ddac4b2fe0 con 0x55ddac9298b0 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ddac8b9250 con 0x55ddac8e4300 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac8fda50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db7fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 0x55ddac8fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac8fda50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54366/0 (socket says 10.20.193.4:54366) 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db7fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 0x55ddac8fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:52422/0 (socket says 10.20.193.4:52422) 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db77fe640 1 -- 10.20.193.4:0/2920025415 learned_addr learned my addr 10.20.193.4:0/2920025415 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dbcbbc640 1 --2- 10.20.193.4:0/2920025415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac9298b0 0x55ddac8fdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db77fe640 1 -- 10.20.193.4:0/2920025415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 msgr2=0x55ddac8fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db77fe640 1 --2- 10.20.193.4:0/2920025415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 0x55ddac8fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db77fe640 1 -- 10.20.193.4:0/2920025415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac9298b0 msgr2=0x55ddac8fdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db77fe640 1 --2- 10.20.193.4:0/2920025415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac9298b0 0x55ddac8fdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db77fe640 1 -- 10.20.193.4:0/2920025415 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddac77a530 con 0x55ddac8e4c10 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4db77fe640 1 --2- 10.20.193.4:0/2920025415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac8fda50 secure :-1 s=READY pgs=619 gs=1 cs=0 l=1 c_cookie=7684217090499301551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da80e4810 tx=0x7f4da80a9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa3d2bb283250af server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4d7bfff640 1 -- 10.20.193.4:0/2920025415 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da80ac8d0 con 0x55ddac8e4c10 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4d7bfff640 1 -- 10.20.193.4:0/2920025415 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4da8016ea0 con 0x55ddac8e4c10 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4d7bfff640 1 -- 10.20.193.4:0/2920025415 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da80add60 con 0x55ddac8e4c10 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2920025415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 msgr2=0x55ddac8fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/2920025415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac8fda50 secure :-1 s=READY pgs=619 gs=1 cs=0 l=1 c_cookie=7684217090499301551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da80e4810 tx=0x7f4da80a9040 comp rx=0 tx=0).stop 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2920025415 shutdown_connections 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/2920025415 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac9298b0 0x55ddac8fdf90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/2920025415 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac8fda50 unknown :-1 s=CLOSED pgs=619 gs=1 cs=0 l=1 c_cookie=7684217090499301551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/2920025415 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 0x55ddac8fd510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2920025415 >> 10.20.193.4:0/2920025415 conn(0x55ddac8024f0 msgr2=0x55ddac8e24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2920025415 shutdown_connections 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.739+0000 7f4dc0640e00 1 -- 10.20.193.4:0/2920025415 wait complete. 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4dc0640e00 1 -- start start 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4dc0640e00 1 Processor -- start 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 0x55ddac905e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac9063d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4dc0640e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac9298b0 0x55ddac906910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ddac98ee60 con 0x55ddac8e4c10 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ddac98efd0 con 0x55ddac9298b0 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4dc0640e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ddac98f190 con 0x55ddac8e4300 2026-02-24T09:11:34.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4db77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac9063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4db77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac9063d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54374/0 (socket says 10.20.193.4:54374) 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4db77fe640 1 -- 10.20.193.4:0/4263031375 learned_addr learned my addr 10.20.193.4:0/4263031375 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4dbcbbc640 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac9298b0 0x55ddac906910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4db77fe640 1 -- 10.20.193.4:0/4263031375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 msgr2=0x55ddac905e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.740+0000 7f4db7fff640 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 0x55ddac905e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4db77fe640 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 0x55ddac905e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4db77fe640 1 -- 10.20.193.4:0/4263031375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac9298b0 msgr2=0x55ddac906910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4db77fe640 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac9298b0 0x55ddac906910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4db77fe640 1 -- 10.20.193.4:0/4263031375 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddac76e000 con 0x55ddac8e4c10 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4db7fff640 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 0x55ddac905e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4db77fe640 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac9063d0 secure :-1 s=READY pgs=620 gs=1 cs=0 l=1 c_cookie=15221198150438697987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da80e4840 tx=0x7f4da80052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33c8f128cbb3c03 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:34.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4d79ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4d79ffb640 1 -- 10.20.193.4:0/4263031375 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da80ac8d0 con 0x55ddac8e4c10 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4d79ffb640 1 -- 10.20.193.4:0/4263031375 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4da80b53d0 con 0x55ddac8e4c10 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4d79ffb640 1 -- 10.20.193.4:0/4263031375 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4da80724e0 con 0x55ddac8e4c10 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 1 -- 10.20.193.4:0/4263031375 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db8164850 con 0x55ddac8e4c10 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4d79ffb640 1 -- 10.20.193.4:0/4263031375 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4da80ab0b0 con 0x55ddac8e4c10 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4d79ffb640 10 client.16086 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 10 client.16086 _ll_register_callbacks cb 0x55ddac766790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 1 -- 10.20.193.4:0/4263031375 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ddac7fc7e0 con 0x55ddac8e4c10 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4d79ffb640 1 -- 10.20.193.4:0/4263031375 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4da80b8210 con 0x55ddac8e4c10 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 10 client.16086 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 1 -- 10.20.193.4:0/4263031375 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55ddac77fd10 con 0x55ddac8e4c10 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4d79ffb640 1 -- 10.20.193.4:0/4263031375 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4da80aeac0 con 0x55ddac8e4c10 2026-02-24T09:11:34.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 10 client.16086 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 20 client.16086 populate_metadata read hostname 'trial004' 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddac9d7070 0x55ddac9f74d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 4 client.16086 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4dc0640e00 1 -- 10.20.193.4:0/4263031375 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ddac475220 con 0x55ddac9d7070 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.741+0000 7f4db7fff640 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddac9d7070 0x55ddac9f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.742+0000 7f4db7fff640 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddac9d7070 0x55ddac9f74d0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=6514230350597230363 s_cookie=15827284903353027278 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a6731fd706a8f1b server_cookie=dba5cfc357428ace in_seq=0 out_seq=0 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.742+0000 7f4d79ffb640 10 client.16086 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4d79ffb640 1 -- 10.20.193.4:0/4263031375 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ddac475220 con 0x55ddac9d7070 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4d79ffb640 10 client.16086 handle_command_reply: tid=0 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 client.16086 shutdown 2026-02-24T09:11:34.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 -- 10.20.193.4:0/4263031375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 msgr2=0x55ddac9063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac9063d0 secure :-1 s=READY pgs=620 gs=1 cs=0 l=1 c_cookie=15221198150438697987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da80e4840 tx=0x7f4da80052e0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 -- 10.20.193.4:0/4263031375 shutdown_connections 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddac9d7070 0x55ddac9f74d0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=6514230350597230363 s_cookie=15827284903353027278 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddac9298b0 0x55ddac906910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4d79ffb640 0 client.16086 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddac8e4c10 0x55ddac9063d0 unknown :-1 s=CLOSED pgs=620 gs=1 cs=0 l=1 c_cookie=15221198150438697987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 --2- 10.20.193.4:0/4263031375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddac8e4300 0x55ddac905e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 -- 10.20.193.4:0/4263031375 >> 10.20.193.4:0/4263031375 conn(0x55ddac8024f0 msgr2=0x55ddac8fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 -- 10.20.193.4:0/4263031375 shutdown_connections 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 1 -- 10.20.193.4:0/4263031375 wait complete. 2026-02-24T09:11:34.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dc0640e00 20 client.16086 trim_cache size 0 max 16384 2026-02-24T09:11:34.755 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:11:34.755 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:11:34.755 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "b89351e3-8bfb-4aeb-abff-026d3e31e37b", 2026-02-24T09:11:34.755 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:11:34.755 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:11:34.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 -- 10.20.193.4:0/3588184190 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b56e0 msgr2=0x7f4d8c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:34.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b56e0 0x7f4d8c0d5b90 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da4005db0 tx=0x7f4da400a5a0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 -- 10.20.193.4:0/3588184190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db810fc70 msgr2=0x7f4db811e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:34.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db810fc70 0x7f4db811e150 secure :-1 s=READY pgs=616 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da8009480 tx=0x7f4da800ee60 comp rx=0 tx=0).stop 2026-02-24T09:11:34.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 -- 10.20.193.4:0/3588184190 shutdown_connections 2026-02-24T09:11:34.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4d8c0b56e0 0x7f4d8c0d5b90 unknown :-1 s=CLOSED pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4db8115470 0x7f4db8123520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4db810fc70 0x7f4db811e150 unknown :-1 s=CLOSED pgs=616 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 --2- 10.20.193.4:0/3588184190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4db810f280 0x7f4db811dc10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:34.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 -- 10.20.193.4:0/3588184190 >> 10.20.193.4:0/3588184190 conn(0x7f4db805f830 msgr2=0x7f4db810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:34.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 -- 10.20.193.4:0/3588184190 shutdown_connections 2026-02-24T09:11:34.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:34.743+0000 7f4dbe646640 1 -- 10.20.193.4:0/3588184190 wait complete. 2026-02-24T09:11:34.781 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:11:34.898 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:35.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.016+0000 7fd6484ec640 1 -- 10.20.193.4:0/3055816846 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd640110130 msgr2=0x7fd640115180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:35.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.016+0000 7fd6484ec640 1 --2- 10.20.193.4:0/3055816846 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd640110130 0x7fd640115180 secure :-1 s=READY pgs=621 gs=1 cs=0 l=1 c_cookie=15698481208487418739 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd634009950 tx=0x7fd63402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.016+0000 7fd6484ec640 1 -- 10.20.193.4:0/3055816846 shutdown_connections 2026-02-24T09:11:35.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.016+0000 7fd6484ec640 1 --2- 10.20.193.4:0/3055816846 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd640115930 0x7fd640176300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.016+0000 7fd6484ec640 1 --2- 10.20.193.4:0/3055816846 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd640110130 0x7fd640115180 unknown :-1 s=CLOSED pgs=621 gs=1 cs=0 l=1 c_cookie=15698481208487418739 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.016+0000 7fd6484ec640 1 --2- 10.20.193.4:0/3055816846 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd64010f740 0x7fd64010fb10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.016+0000 7fd6484ec640 1 -- 10.20.193.4:0/3055816846 >> 10.20.193.4:0/3055816846 conn(0x7fd6400ed050 msgr2=0x7fd64010d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.016+0000 7fd6484ec640 1 -- 10.20.193.4:0/3055816846 shutdown_connections 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.016+0000 7fd6484ec640 1 -- 10.20.193.4:0/3055816846 wait complete. 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6484ec640 1 Processor -- start 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6484ec640 1 -- start start 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6484ec640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd64010f740 0x7fd6400f5a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6484ec640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd640110130 0x7fd640176200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6484ec640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd640115930 0x7fd6400f6150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6484ec640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd6400fb310 con 0x7fd640110130 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6484ec640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd6400fb480 con 0x7fd64010f740 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6484ec640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd6400fb640 con 0x7fd640115930 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd645a60640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd640110130 0x7fd640176200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd645a60640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd640110130 0x7fd640176200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54378/0 (socket says 10.20.193.4:54378) 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd645a60640 1 -- 10.20.193.4:0/4203072829 learned_addr learned my addr 10.20.193.4:0/4203072829 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd646261640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd64010f740 0x7fd6400f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd645a60640 1 -- 10.20.193.4:0/4203072829 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd640115930 msgr2=0x7fd6400f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd645a60640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd640115930 0x7fd6400f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd645a60640 1 -- 10.20.193.4:0/4203072829 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd64010f740 msgr2=0x7fd6400f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd645a60640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd64010f740 0x7fd6400f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd645a60640 1 -- 10.20.193.4:0/4203072829 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd634009570 con 0x7fd640110130 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd645a60640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd640110130 0x7fd640176200 secure :-1 s=READY pgs=622 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6340023d0 tx=0x7fd6340043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6277fe640 1 -- 10.20.193.4:0/4203072829 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd63403d070 con 0x7fd640110130 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6277fe640 1 -- 10.20.193.4:0/4203072829 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd634038920 con 0x7fd640110130 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6484ec640 1 -- 10.20.193.4:0/4203072829 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6400fb8c0 con 0x7fd640110130 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6277fe640 1 -- 10.20.193.4:0/4203072829 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6340419d0 con 0x7fd640110130 2026-02-24T09:11:35.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.017+0000 7fd6484ec640 1 -- 10.20.193.4:0/4203072829 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6400fbd80 con 0x7fd640110130 2026-02-24T09:11:35.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.019+0000 7fd6277fe640 1 -- 10.20.193.4:0/4203072829 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fd634041b60 con 0x7fd640110130 2026-02-24T09:11:35.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.019+0000 7fd6277fe640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd61c0b5750 0x7fd61c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.020+0000 7fd646261640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd61c0b5750 0x7fd61c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.020+0000 7fd6277fe640 1 -- 10.20.193.4:0/4203072829 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd63410b3e0 con 0x7fd640110130 2026-02-24T09:11:35.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.020+0000 7fd646261640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd61c0b5750 0x7fd61c0d5c00 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd630004740 tx=0x7fd630004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:35.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd64a4e6e00 1 Processor -- start 2026-02-24T09:11:35.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd64a4e6e00 1 -- start start 2026-02-24T09:11:35.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3d4bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d5130 0x56222b419890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b419dd0 0x56222b43a1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56222b2e4de0 con 0x56222b3d4820 2026-02-24T09:11:35.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56222b2e0b10 con 0x56222b419dd0 2026-02-24T09:11:35.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56222b2daab0 con 0x56222b3d5130 2026-02-24T09:11:35.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646261640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646261640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3d4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54394/0 (socket says 10.20.193.4:54394) 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646261640 1 -- 10.20.193.4:0/2344631407 learned_addr learned my addr 10.20.193.4:0/2344631407 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646a62640 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b419dd0 0x56222b43a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646261640 1 -- 10.20.193.4:0/2344631407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d5130 msgr2=0x56222b419890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd645a60640 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d5130 0x56222b419890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646261640 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d5130 0x56222b419890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646261640 1 -- 10.20.193.4:0/2344631407 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b419dd0 msgr2=0x56222b43a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646261640 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b419dd0 0x56222b43a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646261640 1 -- 10.20.193.4:0/2344631407 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222b286310 con 0x56222b3d4820 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646a62640 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b419dd0 0x56222b43a1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd645a60640 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d5130 0x56222b419890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.021+0000 7fd646261640 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3d4bf0 secure :-1 s=READY pgs=623 gs=1 cs=0 l=1 c_cookie=201698731569287085 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd630005db0 tx=0x7fd630012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc93ed7ed58fad server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd624a6d640 1 -- 10.20.193.4:0/2344631407 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd63001e680 con 0x56222b3d4820 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd624a6d640 1 -- 10.20.193.4:0/2344631407 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd63000fec0 con 0x56222b3d4820 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd624a6d640 1 -- 10.20.193.4:0/2344631407 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd630010b60 con 0x56222b3d4820 2026-02-24T09:11:35.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2344631407 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 msgr2=0x56222b3d4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:35.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3d4bf0 secure :-1 s=READY pgs=623 gs=1 cs=0 l=1 c_cookie=201698731569287085 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd630005db0 tx=0x7fd630012000 comp rx=0 tx=0).stop 2026-02-24T09:11:35.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2344631407 shutdown_connections 2026-02-24T09:11:35.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b419dd0 0x56222b43a1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d5130 0x56222b419890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2344631407 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3d4bf0 unknown :-1 s=CLOSED pgs=623 gs=1 cs=0 l=1 c_cookie=201698731569287085 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2344631407 >> 10.20.193.4:0/2344631407 conn(0x56222b2f36b0 msgr2=0x56222b3d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:35.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2344631407 shutdown_connections 2026-02-24T09:11:35.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.022+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2344631407 wait complete. 2026-02-24T09:11:35.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd64a4e6e00 1 -- start start 2026-02-24T09:11:35.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd64a4e6e00 1 Processor -- start 2026-02-24T09:11:35.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d4820 0x56222b3ed0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d5130 0x56222b3ed5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b419dd0 0x56222b3f25e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56222b3f2b20 con 0x56222b419dd0 2026-02-24T09:11:35.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56222b3f2c90 con 0x56222b3d5130 2026-02-24T09:11:35.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56222b3f2e50 con 0x56222b3d4820 2026-02-24T09:11:35.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd646a62640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b419dd0 0x56222b3f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd646a62640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b419dd0 0x56222b3f25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54404/0 (socket says 10.20.193.4:54404) 2026-02-24T09:11:35.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd646a62640 1 -- 10.20.193.4:0/2707104875 learned_addr learned my addr 10.20.193.4:0/2707104875 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:35.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd645a60640 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d5130 0x56222b3ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd646261640 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d4820 0x56222b3ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd646a62640 1 -- 10.20.193.4:0/2707104875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d4820 msgr2=0x56222b3ed0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:35.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd646a62640 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d4820 0x56222b3ed0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd646a62640 1 -- 10.20.193.4:0/2707104875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d5130 msgr2=0x56222b3ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd646a62640 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d5130 0x56222b3ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd646a62640 1 -- 10.20.193.4:0/2707104875 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222b25e8c0 con 0x56222b419dd0 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd645a60640 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d5130 0x56222b3ed5f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd646a62640 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b419dd0 0x56222b3f25e0 secure :-1 s=READY pgs=624 gs=1 cs=0 l=1 c_cookie=4262996614667536344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd63c004ee0 tx=0x7fd63c00f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2934d5aff387d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd5f3fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd5f3fff640 1 -- 10.20.193.4:0/2707104875 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd63c0128a0 con 0x56222b419dd0 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2707104875 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd63000fa90 con 0x56222b419dd0 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.023+0000 7fd5f3fff640 1 -- 10.20.193.4:0/2707104875 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd63c0113d0 con 0x56222b419dd0 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd5f3fff640 1 -- 10.20.193.4:0/2707104875 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd63c0195c0 con 0x56222b419dd0 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd64a4e6e00 10 client.16098 _ll_register_callbacks cb 0x56222b276160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:35.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2707104875 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56222af65f40 con 0x56222b419dd0 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd5f3fff640 1 -- 10.20.193.4:0/2707104875 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd63c019750 con 0x56222b419dd0 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd5f3fff640 1 -- 10.20.193.4:0/2707104875 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd63c019950 con 0x56222b419dd0 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd64a4e6e00 10 client.16098 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2707104875 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56222b2706e0 con 0x56222b419dd0 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd5f3fff640 1 -- 10.20.193.4:0/2707104875 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd63c00d070 con 0x56222b419dd0 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd64a4e6e00 10 client.16098 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd64a4e6e00 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd64a4e6e00 20 client.16098 populate_metadata read hostname 'trial004' 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56222b4179d0 0x56222b417e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd64a4e6e00 4 client.16098 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2707104875 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56222af686f0 con 0x56222b4179d0 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd646261640 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56222b4179d0 0x56222b417e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd646261640 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56222b4179d0 0x56222b417e40 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=1444740630103796598 s_cookie=17686447651884109566 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=140cbff2d1e92b76 server_cookie=f572e26ebd180efe in_seq=0 out_seq=0 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.024+0000 7fd5f3fff640 10 client.16098 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd5f3fff640 1 -- 10.20.193.4:0/2707104875 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56222af686f0 con 0x56222b4179d0 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd5f3fff640 10 client.16098 handle_command_reply: tid=0 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 client.16098 shutdown 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2707104875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b419dd0 msgr2=0x56222b3f25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b419dd0 0x56222b3f25e0 secure :-1 s=READY pgs=624 gs=1 cs=0 l=1 c_cookie=4262996614667536344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd63c004ee0 tx=0x7fd63c00f6c0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2707104875 shutdown_connections 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56222b4179d0 0x56222b417e40 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=1444740630103796598 s_cookie=17686447651884109566 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b419dd0 0x56222b3f25e0 unknown :-1 s=CLOSED pgs=624 gs=1 cs=0 l=1 c_cookie=4262996614667536344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d5130 0x56222b3ed5f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2707104875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b3d4820 0x56222b3ed0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd5f3fff640 0 client.16098 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:35.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2707104875 >> 10.20.193.4:0/2707104875 conn(0x56222b2f36b0 msgr2=0x56222b3d3810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:35.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2707104875 shutdown_connections 2026-02-24T09:11:35.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2707104875 wait complete. 2026-02-24T09:11:35.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.025+0000 7fd64a4e6e00 20 client.16098 trim_cache size 0 max 16384 2026-02-24T09:11:35.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd64a4e6e00 1 Processor -- start 2026-02-24T09:11:35.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd64a4e6e00 1 -- start start 2026-02-24T09:11:35.037 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:34 trial004 ceph-mon[41596]: pgmap v205: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 201 MiB/s wr, 112 op/s 2026-02-24T09:11:35.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d4820 0x56222b3eacb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d5130 0x56222b3d76e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b419dd0 0x56222b3ed390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56222b2d86e0 con 0x56222b3d5130 2026-02-24T09:11:35.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56222afa3f50 con 0x56222b3d4820 2026-02-24T09:11:35.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56222b348410 con 0x56222b419dd0 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd645a60640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d5130 0x56222b3d76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd645a60640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d5130 0x56222b3d76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54412/0 (socket says 10.20.193.4:54412) 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd645a60640 1 -- 10.20.193.4:0/2393348812 learned_addr learned my addr 10.20.193.4:0/2393348812 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd646261640 1 --2- 10.20.193.4:0/2393348812 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d4820 0x56222b3eacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd646a62640 1 --2- 10.20.193.4:0/2393348812 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b419dd0 0x56222b3ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd645a60640 1 -- 10.20.193.4:0/2393348812 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b419dd0 msgr2=0x56222b3ed390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd645a60640 1 --2- 10.20.193.4:0/2393348812 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b419dd0 0x56222b3ed390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd645a60640 1 -- 10.20.193.4:0/2393348812 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d4820 msgr2=0x56222b3eacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd645a60640 1 --2- 10.20.193.4:0/2393348812 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d4820 0x56222b3eacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd645a60640 1 -- 10.20.193.4:0/2393348812 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222b26b160 con 0x56222b3d5130 2026-02-24T09:11:35.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd645a60640 1 --2- 10.20.193.4:0/2393348812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d5130 0x56222b3d76e0 secure :-1 s=READY pgs=625 gs=1 cs=0 l=1 c_cookie=5863444636333732605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6340cf970 tx=0x7fd63402f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515f23d4b4d772fd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd60e4e6640 1 -- 10.20.193.4:0/2393348812 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6340d3100 con 0x56222b3d5130 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd60e4e6640 1 -- 10.20.193.4:0/2393348812 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd6340d8420 con 0x56222b3d5130 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.034+0000 7fd60e4e6640 1 -- 10.20.193.4:0/2393348812 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6340d3390 con 0x56222b3d5130 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2393348812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d5130 msgr2=0x56222b3d76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2393348812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d5130 0x56222b3d76e0 secure :-1 s=READY pgs=625 gs=1 cs=0 l=1 c_cookie=5863444636333732605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6340cf970 tx=0x7fd63402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2393348812 shutdown_connections 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2393348812 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b419dd0 0x56222b3ed390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2393348812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d5130 0x56222b3d76e0 unknown :-1 s=CLOSED pgs=625 gs=1 cs=0 l=1 c_cookie=5863444636333732605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/2393348812 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d4820 0x56222b3eacb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2393348812 >> 10.20.193.4:0/2393348812 conn(0x56222b2f36b0 msgr2=0x56222b3ecc80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2393348812 shutdown_connections 2026-02-24T09:11:35.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/2393348812 wait complete. 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 -- start start 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.035+0000 7fd64a4e6e00 1 Processor -- start 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3f4d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d5130 0x56222b3f5280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b419dd0 0x56222b3f5800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56222b416010 con 0x56222b3d4820 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56222b3e5e30 con 0x56222b3d5130 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56222b47f560 con 0x56222b419dd0 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd646261640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3f4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd646261640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3f4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:54428/0 (socket says 10.20.193.4:54428) 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd646261640 1 -- 10.20.193.4:0/1369848681 learned_addr learned my addr 10.20.193.4:0/1369848681 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:35.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd646261640 1 -- 10.20.193.4:0/1369848681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b419dd0 msgr2=0x56222b3f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd646261640 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b419dd0 0x56222b3f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd646261640 1 -- 10.20.193.4:0/1369848681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d5130 msgr2=0x56222b3f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd646261640 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d5130 0x56222b3f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd646261640 1 -- 10.20.193.4:0/1369848681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56222b25ebf0 con 0x56222b3d4820 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd646261640 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3f4d40 secure :-1 s=READY pgs=626 gs=1 cs=0 l=1 c_cookie=16632906583560053223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd630010720 tx=0x7fd63000f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d3f469af5a61e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd5f3fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd5f3fff640 1 -- 10.20.193.4:0/1369848681 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd630030040 con 0x56222b3d4820 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/1369848681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6400fbd80 con 0x56222b3d4820 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd5f3fff640 1 -- 10.20.193.4:0/1369848681 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd630010c20 con 0x56222b3d4820 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd5f3fff640 1 -- 10.20.193.4:0/1369848681 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd630036320 con 0x56222b3d4820 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 10 client.16104 _ll_register_callbacks cb 0x56222b276160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:35.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/1369848681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56222b00f160 con 0x56222b3d4820 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd5f3fff640 1 -- 10.20.193.4:0/1369848681 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd63001e710 con 0x56222b3d4820 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd5f3fff640 1 -- 10.20.193.4:0/1369848681 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd63001e910 con 0x56222b3d4820 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 10 client.16104 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/1369848681 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56222b270940 con 0x56222b3d4820 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd5f3fff640 1 -- 10.20.193.4:0/1369848681 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd63001eb30 con 0x56222b3d4820 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 10 client.16104 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 20 client.16104 populate_metadata read hostname 'trial004' 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56222b4c76b0 0x56222b4e7b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 4 client.16104 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/1369848681 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56222b2d04f0 con 0x56222b4c76b0 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.036+0000 7fd645a60640 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56222b4c76b0 0x56222b4e7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:35.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd5f3fff640 10 client.16104 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd645a60640 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56222b4c76b0 0x56222b4e7b60 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=8181665684613026049 s_cookie=5279936514203600348 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=718b1d97825cd101 server_cookie=49461a490db845dc in_seq=0 out_seq=0 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd5f3fff640 1 -- 10.20.193.4:0/1369848681 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x56222b2d04f0 con 0x56222b4c76b0 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd5f3fff640 10 client.16104 handle_command_reply: tid=0 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 client.16104 shutdown 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/1369848681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 msgr2=0x56222b3f4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3f4d40 secure :-1 s=READY pgs=626 gs=1 cs=0 l=1 c_cookie=16632906583560053223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd630010720 tx=0x7fd63000f870 comp rx=0 tx=0).stop 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/1369848681 shutdown_connections 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56222b4c76b0 0x56222b4e7b60 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=8181665684613026049 s_cookie=5279936514203600348 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56222b419dd0 0x56222b3f5800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd5f3fff640 0 client.16104 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56222b3d5130 0x56222b3f5280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 --2- 10.20.193.4:0/1369848681 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56222b3d4820 0x56222b3f4d40 unknown :-1 s=CLOSED pgs=626 gs=1 cs=0 l=1 c_cookie=16632906583560053223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/1369848681 >> 10.20.193.4:0/1369848681 conn(0x56222b2f36b0 msgr2=0x56222b418720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:35.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/1369848681 shutdown_connections 2026-02-24T09:11:35.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 1 -- 10.20.193.4:0/1369848681 wait complete. 2026-02-24T09:11:35.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.037+0000 7fd64a4e6e00 20 client.16104 trim_cache size 0 max 16384 2026-02-24T09:11:35.049 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:11:35.049 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:11:35.049 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:11:35.049 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:11:35.049 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:35.049 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "b89351e3-8bfb-4aeb-abff-026d3e31e37b", 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:35.050 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:35.051 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:11:35.052 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:11:35.052 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:11:35.052 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:11:35.052 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:11:35.052 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:11:35.052 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:11:35.052 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:35.052 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:35.052 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 -- 10.20.193.4:0/4203072829 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd61c0b5750 msgr2=0x7fd61c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd61c0b5750 0x7fd61c0d5c00 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd630004740 tx=0x7fd630004420 comp rx=0 tx=0).stop 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 -- 10.20.193.4:0/4203072829 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd640110130 msgr2=0x7fd640176200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd640110130 0x7fd640176200 secure :-1 s=READY pgs=622 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6340023d0 tx=0x7fd6340043d0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 -- 10.20.193.4:0/4203072829 shutdown_connections 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd61c0b5750 0x7fd61c0d5c00 unknown :-1 s=CLOSED pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd640115930 0x7fd6400f6150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd640110130 0x7fd640176200 unknown :-1 s=CLOSED pgs=622 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 --2- 10.20.193.4:0/4203072829 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd64010f740 0x7fd6400f5a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 -- 10.20.193.4:0/4203072829 >> 10.20.193.4:0/4203072829 conn(0x7fd6400ed050 msgr2=0x7fd640111f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:35.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 -- 10.20.193.4:0/4203072829 shutdown_connections 2026-02-24T09:11:35.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:35.038+0000 7fd6484ec640 1 -- 10.20.193.4:0/4203072829 wait complete. 2026-02-24T09:11:35.075 INFO:tasks.cephfs.filesystem:scrub status for tag:b89351e3-8bfb-4aeb-abff-026d3e31e37b - {'path': '/', 'tag': 'b89351e3-8bfb-4aeb-abff-026d3e31e37b', 'options': 'recursive,force'} 2026-02-24T09:11:35.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:34 trial014 ceph-mon[46941]: pgmap v205: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 201 MiB/s wr, 112 op/s 2026-02-24T09:11:35.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:34 trial090 ceph-mon[47278]: pgmap v205: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 201 MiB/s wr, 112 op/s 2026-02-24T09:11:36.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:35 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:11:36.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:35 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:36.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:35 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:11:36.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:35 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:36.234 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:35 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:11:36.234 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:35 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:36.234 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:35 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:11:36.234 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:35 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:36.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:35 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:11:36.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:35 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:36.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:35 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:11:36.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:35 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:11:37.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:36 trial004 ceph-mon[41596]: pgmap v206: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 44 MiB/s wr, 36 op/s 2026-02-24T09:11:37.244 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:36 trial014 ceph-mon[46941]: pgmap v206: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 44 MiB/s wr, 36 op/s 2026-02-24T09:11:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:36 trial090 ceph-mon[47278]: pgmap v206: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 44 MiB/s wr, 36 op/s 2026-02-24T09:11:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:38 trial004 ceph-mon[41596]: pgmap v207: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2026-02-24T09:11:39.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:38 trial090 ceph-mon[47278]: pgmap v207: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2026-02-24T09:11:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:38 trial014 ceph-mon[46941]: pgmap v207: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2026-02-24T09:11:41.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:40 trial004 ceph-mon[41596]: pgmap v208: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2026-02-24T09:11:41.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:40 trial090 ceph-mon[47278]: pgmap v208: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2026-02-24T09:11:41.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:40 trial014 ceph-mon[46941]: pgmap v208: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2026-02-24T09:11:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:42 trial004 ceph-mon[41596]: pgmap v209: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2026-02-24T09:11:43.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:42 trial090 ceph-mon[47278]: pgmap v209: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2026-02-24T09:11:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:42 trial014 ceph-mon[46941]: pgmap v209: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 4.1 KiB/s wr, 8 op/s 2026-02-24T09:11:45.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:44 trial004 ceph-mon[41596]: pgmap v210: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 2.4 KiB/s wr, 6 op/s 2026-02-24T09:11:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:44 trial090 ceph-mon[47278]: pgmap v210: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 2.4 KiB/s wr, 6 op/s 2026-02-24T09:11:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:44 trial014 ceph-mon[46941]: pgmap v210: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 2.4 KiB/s wr, 6 op/s 2026-02-24T09:11:47.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:46 trial004 ceph-mon[41596]: pgmap v211: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2026-02-24T09:11:47.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:46 trial090 ceph-mon[47278]: pgmap v211: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2026-02-24T09:11:47.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:46 trial014 ceph-mon[46941]: pgmap v211: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2026-02-24T09:11:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:48 trial004 ceph-mon[41596]: pgmap v212: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2026-02-24T09:11:49.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:48 trial090 ceph-mon[47278]: pgmap v212: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2026-02-24T09:11:49.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:48 trial014 ceph-mon[46941]: pgmap v212: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2026-02-24T09:11:50.964 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:11:51.080 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:51.124 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:50 trial004 ceph-mon[41596]: pgmap v213: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2026-02-24T09:11:51.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.177+0000 7f2424d41640 1 -- 10.20.193.4:0/2250307582 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f242010fc70 msgr2=0x7f2420114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.177+0000 7f2424d41640 1 --2- 10.20.193.4:0/2250307582 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f242010fc70 0x7f2420114cc0 secure :-1 s=READY pgs=627 gs=1 cs=0 l=1 c_cookie=1399192068182860494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2408009950 tx=0x7f240802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.177+0000 7f2424d41640 1 -- 10.20.193.4:0/2250307582 shutdown_connections 2026-02-24T09:11:51.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.177+0000 7f2424d41640 1 --2- 10.20.193.4:0/2250307582 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2420115470 0x7f2420175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.177+0000 7f2424d41640 1 --2- 10.20.193.4:0/2250307582 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f242010fc70 0x7f2420114cc0 unknown :-1 s=CLOSED pgs=627 gs=1 cs=0 l=1 c_cookie=1399192068182860494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.177+0000 7f2424d41640 1 --2- 10.20.193.4:0/2250307582 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f242010f280 0x7f242010f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.177+0000 7f2424d41640 1 -- 10.20.193.4:0/2250307582 >> 10.20.193.4:0/2250307582 conn(0x7f242005f830 msgr2=0x7f242010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:51.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.177+0000 7f2424d41640 1 -- 10.20.193.4:0/2250307582 shutdown_connections 2026-02-24T09:11:51.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.177+0000 7f2424d41640 1 -- 10.20.193.4:0/2250307582 wait complete. 2026-02-24T09:11:51.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f2424d41640 1 Processor -- start 2026-02-24T09:11:51.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f2424d41640 1 -- start start 2026-02-24T09:11:51.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f2424d41640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f242010f280 0x7f24200f5540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f2424d41640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f242010fc70 0x7f2420175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f2424d41640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2420115470 0x7f24200f5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f2424d41640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f24200fae50 con 0x7f242010fc70 2026-02-24T09:11:51.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f2424d41640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f24200fafc0 con 0x7f2420115470 2026-02-24T09:11:51.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f2424d41640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f24200fb180 con 0x7f242010f280 2026-02-24T09:11:51.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f242010fc70 0x7f2420175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f242010fc70 0x7f2420175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:32808/0 (socket says 10.20.193.4:32808) 2026-02-24T09:11:51.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241dd74640 1 -- 10.20.193.4:0/2627183414 learned_addr learned my addr 10.20.193.4:0/2627183414 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:51.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241e575640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f242010f280 0x7f24200f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241ed76640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2420115470 0x7f24200f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241dd74640 1 -- 10.20.193.4:0/2627183414 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f242010f280 msgr2=0x7f24200f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241dd74640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f242010f280 0x7f24200f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241dd74640 1 -- 10.20.193.4:0/2627183414 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2420115470 msgr2=0x7f24200f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241dd74640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2420115470 0x7f24200f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241dd74640 1 -- 10.20.193.4:0/2627183414 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2408009570 con 0x7f242010fc70 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f241dd74640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f242010fc70 0x7f2420175d40 secure :-1 s=READY pgs=628 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24080023d0 tx=0x7f24080043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f24077fe640 1 -- 10.20.193.4:0/2627183414 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f240803d070 con 0x7f242010fc70 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f24077fe640 1 -- 10.20.193.4:0/2627183414 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2408038920 con 0x7f242010fc70 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f2424d41640 1 -- 10.20.193.4:0/2627183414 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24200fb400 con 0x7f242010fc70 2026-02-24T09:11:51.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.178+0000 7f24077fe640 1 -- 10.20.193.4:0/2627183414 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24080419d0 con 0x7f242010fc70 2026-02-24T09:11:51.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.179+0000 7f2424d41640 1 -- 10.20.193.4:0/2627183414 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24200fb870 con 0x7f242010fc70 2026-02-24T09:11:51.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.179+0000 7f2424d41640 1 -- 10.20.193.4:0/2627183414 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2420110560 con 0x7f242010fc70 2026-02-24T09:11:51.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.180+0000 7f24077fe640 1 -- 10.20.193.4:0/2627183414 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f2408038a90 con 0x7f242010fc70 2026-02-24T09:11:51.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.181+0000 7f24077fe640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23f80b56d0 0x7f23f80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.181+0000 7f24077fe640 1 -- 10.20.193.4:0/2627183414 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f240810b930 con 0x7f242010fc70 2026-02-24T09:11:51.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.181+0000 7f241e575640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23f80b56d0 0x7f23f80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.181+0000 7f241e575640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23f80b56d0 0x7f23f80d5b80 secure :-1 s=READY pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2414004740 tx=0x7f241400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:51.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.181+0000 7f24077fe640 1 -- 10.20.193.4:0/2627183414 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f24080ce2f0 con 0x7f242010fc70 2026-02-24T09:11:51.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.312+0000 7f2424d41640 1 -- 10.20.193.4:0/2627183414 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f242010f650 con 0x7f242010fc70 2026-02-24T09:11:51.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.312+0000 7f24077fe640 1 -- 10.20.193.4:0/2627183414 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f24080d14a0 con 0x7f242010fc70 2026-02-24T09:11:51.316 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:11:51.316 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:11:51.317 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:11:51.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 -- 10.20.193.4:0/2627183414 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23f80b56d0 msgr2=0x7f23f80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23f80b56d0 0x7f23f80d5b80 secure :-1 s=READY pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2414004740 tx=0x7f241400b410 comp rx=0 tx=0).stop 2026-02-24T09:11:51.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 -- 10.20.193.4:0/2627183414 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f242010fc70 msgr2=0x7f2420175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f242010fc70 0x7f2420175d40 secure :-1 s=READY pgs=628 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24080023d0 tx=0x7f24080043d0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 -- 10.20.193.4:0/2627183414 shutdown_connections 2026-02-24T09:11:51.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f23f80b56d0 0x7f23f80d5b80 unknown :-1 s=CLOSED pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2420115470 0x7f24200f5c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f242010fc70 0x7f2420175d40 unknown :-1 s=CLOSED pgs=628 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 --2- 10.20.193.4:0/2627183414 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f242010f280 0x7f24200f5540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 -- 10.20.193.4:0/2627183414 >> 10.20.193.4:0/2627183414 conn(0x7f242005f830 msgr2=0x7f2420111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:51.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 -- 10.20.193.4:0/2627183414 shutdown_connections 2026-02-24T09:11:51.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.313+0000 7f2424d41640 1 -- 10.20.193.4:0/2627183414 wait complete. 2026-02-24T09:11:51.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:50 trial090 ceph-mon[47278]: pgmap v213: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2026-02-24T09:11:51.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:50 trial014 ceph-mon[46941]: pgmap v213: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2026-02-24T09:11:51.353 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id c5e5130 --release --await' 2026-02-24T09:11:51.353 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id c5e5130 --release --await 2026-02-24T09:11:51.469 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:11:51.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 -- 10.20.193.4:0/3011436318 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f57ac1100b0 msgr2=0x7f57ac115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 --2- 10.20.193.4:0/3011436318 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f57ac1100b0 0x7f57ac115100 secure :-1 s=READY pgs=629 gs=1 cs=0 l=1 c_cookie=13703123532391129191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5794009950 tx=0x7f579402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 -- 10.20.193.4:0/3011436318 shutdown_connections 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 --2- 10.20.193.4:0/3011436318 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f57ac1158b0 0x7f57ac176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 --2- 10.20.193.4:0/3011436318 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f57ac1100b0 0x7f57ac115100 unknown :-1 s=CLOSED pgs=629 gs=1 cs=0 l=1 c_cookie=13703123532391129191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 --2- 10.20.193.4:0/3011436318 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f57ac10f6c0 0x7f57ac10fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 -- 10.20.193.4:0/3011436318 >> 10.20.193.4:0/3011436318 conn(0x7f57ac0ecfd0 msgr2=0x7f57ac10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 -- 10.20.193.4:0/3011436318 shutdown_connections 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 -- 10.20.193.4:0/3011436318 wait complete. 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 Processor -- start 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 -- start start 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f57ac10f6c0 0x7f57ac0f5a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f57ac1100b0 0x7f57ac176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f57ac1158b0 0x7f57ac0f6130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac0fb340 con 0x7f57ac1158b0 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac0fb4b0 con 0x7f57ac1100b0 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57b19a6640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac0fb670 con 0x7f57ac10f6c0 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57ab7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f57ac1158b0 0x7f57ac0f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57ab7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f57ac1158b0 0x7f57ac0f6130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:32834/0 (socket says 10.20.193.4:32834) 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57ab7fe640 1 -- 10.20.193.4:0/140442367 learned_addr learned my addr 10.20.193.4:0/140442367 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57aaffd640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f57ac10f6c0 0x7f57ac0f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.571+0000 7f57aa7fc640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f57ac1100b0 0x7f57ac176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57ab7fe640 1 -- 10.20.193.4:0/140442367 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f57ac10f6c0 msgr2=0x7f57ac0f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57ab7fe640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f57ac10f6c0 0x7f57ac0f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57ab7fe640 1 -- 10.20.193.4:0/140442367 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f57ac1100b0 msgr2=0x7f57ac176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57ab7fe640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f57ac1100b0 0x7f57ac176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57ab7fe640 1 -- 10.20.193.4:0/140442367 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5794009570 con 0x7f57ac1158b0 2026-02-24T09:11:51.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57ab7fe640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f57ac1158b0 0x7f57ac0f6130 secure :-1 s=READY pgs=630 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f579c00f8d0 tx=0x7f579c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:51.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57b09a4640 1 -- 10.20.193.4:0/140442367 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f579c00dce0 con 0x7f57ac1158b0 2026-02-24T09:11:51.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57b19a6640 1 -- 10.20.193.4:0/140442367 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ac0fb950 con 0x7f57ac1158b0 2026-02-24T09:11:51.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57b09a4640 1 -- 10.20.193.4:0/140442367 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f579c00de40 con 0x7f57ac1158b0 2026-02-24T09:11:51.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57b09a4640 1 -- 10.20.193.4:0/140442367 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f579c011740 con 0x7f57ac1158b0 2026-02-24T09:11:51.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.572+0000 7f57b19a6640 1 -- 10.20.193.4:0/140442367 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ac0fbe20 con 0x7f57ac1158b0 2026-02-24T09:11:51.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.574+0000 7f57b09a4640 1 -- 10.20.193.4:0/140442367 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f579c020060 con 0x7f57ac1158b0 2026-02-24T09:11:51.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.574+0000 7f57b09a4640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57800b56d0 0x7f57800d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.575+0000 7f57aaffd640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57800b56d0 0x7f57800d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.575+0000 7f57b09a4640 1 -- 10.20.193.4:0/140442367 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f579c015070 con 0x7f57ac1158b0 2026-02-24T09:11:51.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.575+0000 7f57aaffd640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57800b56d0 0x7f57800d5b80 secure :-1 s=READY pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57a0004740 tx=0x7f57a000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:51.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.575+0000 7f57b39a0e00 1 Processor -- start 2026-02-24T09:11:51.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.575+0000 7f57b39a0e00 1 -- start start 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a3fb0 0x5604170a4380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a48c0 0x5604170e9020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e9560 0x560417109940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560416fb5050 con 0x5604170a48c0 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560416fb0d80 con 0x5604170a3fb0 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560416faaee0 con 0x5604170e9560 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aa7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a48c0 0x5604170e9020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aa7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a48c0 0x5604170e9020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:32840/0 (socket says 10.20.193.4:32840) 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aa7fc640 1 -- 10.20.193.4:0/1703778603 learned_addr learned my addr 10.20.193.4:0/1703778603 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aaffd640 1 --2- 10.20.193.4:0/1703778603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a3fb0 0x5604170a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aa7fc640 1 -- 10.20.193.4:0/1703778603 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e9560 msgr2=0x560417109940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:51.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aa7fc640 1 --2- 10.20.193.4:0/1703778603 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e9560 0x560417109940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aa7fc640 1 -- 10.20.193.4:0/1703778603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a3fb0 msgr2=0x5604170a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aa7fc640 1 --2- 10.20.193.4:0/1703778603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a3fb0 0x5604170a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aa7fc640 1 -- 10.20.193.4:0/1703778603 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560416f56540 con 0x5604170a48c0 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aaffd640 1 --2- 10.20.193.4:0/1703778603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a3fb0 0x5604170a4380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57aa7fc640 1 --2- 10.20.193.4:0/1703778603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a48c0 0x5604170e9020 secure :-1 s=READY pgs=631 gs=1 cs=0 l=1 c_cookie=4099367424648585263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5794005ab0 tx=0x7f57940059a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e3e0f40dfca02f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f576ffff640 1 -- 10.20.193.4:0/1703778603 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5794038470 con 0x5604170a48c0 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f576ffff640 1 -- 10.20.193.4:0/1703778603 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f57940385d0 con 0x5604170a48c0 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f576ffff640 1 -- 10.20.193.4:0/1703778603 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f579402fe00 con 0x5604170a48c0 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 -- 10.20.193.4:0/1703778603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a48c0 msgr2=0x5604170e9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/1703778603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a48c0 0x5604170e9020 secure :-1 s=READY pgs=631 gs=1 cs=0 l=1 c_cookie=4099367424648585263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5794005ab0 tx=0x7f57940059a0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 -- 10.20.193.4:0/1703778603 shutdown_connections 2026-02-24T09:11:51.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/1703778603 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e9560 0x560417109940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/1703778603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a48c0 0x5604170e9020 unknown :-1 s=CLOSED pgs=631 gs=1 cs=0 l=1 c_cookie=4099367424648585263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/1703778603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a3fb0 0x5604170a4380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.576+0000 7f57b39a0e00 1 -- 10.20.193.4:0/1703778603 >> 10.20.193.4:0/1703778603 conn(0x5604170824b0 msgr2=0x5604170a2890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.577+0000 7f57b39a0e00 1 -- 10.20.193.4:0/1703778603 shutdown_connections 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.577+0000 7f57b39a0e00 1 -- 10.20.193.4:0/1703778603 wait complete. 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.577+0000 7f57b39a0e00 1 -- start start 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.577+0000 7f57b39a0e00 1 Processor -- start 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170a3fb0 0x560417100ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x5604171013e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170e9560 0x5604171063d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560417106910 con 0x5604170e9560 2026-02-24T09:11:51.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560417106a80 con 0x5604170a48c0 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560417106c40 con 0x5604170a3fb0 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57ab7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170e9560 0x5604171063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57ab7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170e9560 0x5604171063d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:32844/0 (socket says 10.20.193.4:32844) 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57ab7fe640 1 -- 10.20.193.4:0/4154819882 learned_addr learned my addr 10.20.193.4:0/4154819882 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57ab7fe640 1 -- 10.20.193.4:0/4154819882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170a3fb0 msgr2=0x560417100ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57ab7fe640 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170a3fb0 0x560417100ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57ab7fe640 1 -- 10.20.193.4:0/4154819882 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 msgr2=0x5604171013e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57aa7fc640 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x5604171013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57ab7fe640 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x5604171013e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57ab7fe640 1 -- 10.20.193.4:0/4154819882 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560416f2ebd0 con 0x5604170e9560 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57aa7fc640 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x5604171013e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57ab7fe640 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170e9560 0x5604171063d0 secure :-1 s=READY pgs=632 gs=1 cs=0 l=1 c_cookie=7438307438533845198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f579c0aa620 tx=0x7f579c0ada30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673a2d349bf4a0ce server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:51.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f576d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f576d7fa640 1 -- 10.20.193.4:0/4154819882 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f579c0aef00 con 0x5604170e9560 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 -- 10.20.193.4:0/4154819882 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ac176af0 con 0x5604170e9560 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f576d7fa640 1 -- 10.20.193.4:0/4154819882 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f579c0b3d70 con 0x5604170e9560 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 10 client.16122 _ll_register_callbacks cb 0x560416f99290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f576d7fa640 1 -- 10.20.193.4:0/4154819882 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f579c0733d0 con 0x5604170e9560 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 -- 10.20.193.4:0/4154819882 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560416cfa700 con 0x5604170e9560 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f576d7fa640 1 -- 10.20.193.4:0/4154819882 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f579c0ac030 con 0x5604170e9560 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f576d7fa640 1 -- 10.20.193.4:0/4154819882 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f579c0ac210 con 0x5604170e9560 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 10 client.16122 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 -- 10.20.193.4:0/4154819882 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x560416f40910 con 0x5604170e9560 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f576d7fa640 1 -- 10.20.193.4:0/4154819882 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f579c0afa40 con 0x5604170e9560 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 10 client.16122 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:51.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 10 client.16122 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 20 client.16122 populate_metadata read hostname 'trial004' 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5604170e6610 0x5604170e6ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 4 client.16122 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.578+0000 7f57b39a0e00 1 -- 10.20.193.4:0/4154819882 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560416fa0920 con 0x5604170e6610 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.579+0000 7f57aaffd640 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5604170e6610 0x5604170e6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.579+0000 7f57aaffd640 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5604170e6610 0x5604170e6ab0 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=9619592647969124595 s_cookie=6418023595174715080 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=857fa88bea28b0f3 server_cookie=59116674a676dec8 in_seq=0 out_seq=0 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.579+0000 7f576d7fa640 10 client.16122 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f576d7fa640 1 -- 10.20.193.4:0/4154819882 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560416fa0920 con 0x5604170e6610 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f576d7fa640 10 client.16122 handle_command_reply: tid=0 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 client.16122 shutdown 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 -- 10.20.193.4:0/4154819882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170e9560 msgr2=0x5604171063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170e9560 0x5604171063d0 secure :-1 s=READY pgs=632 gs=1 cs=0 l=1 c_cookie=7438307438533845198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f579c0aa620 tx=0x7f579c0ada30 comp rx=0 tx=0).stop 2026-02-24T09:11:51.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 -- 10.20.193.4:0/4154819882 shutdown_connections 2026-02-24T09:11:51.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5604170e6610 0x5604170e6ab0 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=9619592647969124595 s_cookie=6418023595174715080 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170e9560 0x5604171063d0 unknown :-1 s=CLOSED pgs=632 gs=1 cs=0 l=1 c_cookie=7438307438533845198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x5604171013e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f576d7fa640 0 client.16122 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:51.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/4154819882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170a3fb0 0x560417100ea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 -- 10.20.193.4:0/4154819882 >> 10.20.193.4:0/4154819882 conn(0x5604170824b0 msgr2=0x5604170a2890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:51.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 -- 10.20.193.4:0/4154819882 shutdown_connections 2026-02-24T09:11:51.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 1 -- 10.20.193.4:0/4154819882 wait complete. 2026-02-24T09:11:51.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.580+0000 7f57b39a0e00 20 client.16122 trim_cache size 0 max 16384 2026-02-24T09:11:51.599 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57b39a0e00 1 Processor -- start 2026-02-24T09:11:51.599 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57b39a0e00 1 -- start start 2026-02-24T09:11:51.599 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e41a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.599 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x5604170e46e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 0x5604170fd250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560416fa8b10 con 0x5604170a3fb0 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560416c741b0 con 0x5604170a48c0 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5604170f9f40 con 0x5604170e6610 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:32854/0 (socket says 10.20.193.4:32854) 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57aaffd640 1 -- 10.20.193.4:0/2816860068 learned_addr learned my addr 10.20.193.4:0/2816860068 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57aa7fc640 1 --2- 10.20.193.4:0/2816860068 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x5604170e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57ab7fe640 1 --2- 10.20.193.4:0/2816860068 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 0x5604170fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57aaffd640 1 -- 10.20.193.4:0/2816860068 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 msgr2=0x5604170fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57aaffd640 1 --2- 10.20.193.4:0/2816860068 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 0x5604170fd250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57aaffd640 1 -- 10.20.193.4:0/2816860068 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 msgr2=0x5604170e46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:51.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57aaffd640 1 --2- 10.20.193.4:0/2816860068 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x5604170e46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57aaffd640 1 -- 10.20.193.4:0/2816860068 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560416f3b390 con 0x5604170a3fb0 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f57aaffd640 1 --2- 10.20.193.4:0/2816860068 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e41a0 secure :-1 s=READY pgs=633 gs=1 cs=0 l=1 c_cookie=9913671744423524908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57a000b6c0 tx=0x7f57a0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89946fed3a30fa2c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f576f7fe640 1 -- 10.20.193.4:0/2816860068 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57a0028470 con 0x5604170a3fb0 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f576f7fe640 1 -- 10.20.193.4:0/2816860068 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f57a0015070 con 0x5604170a3fb0 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.589+0000 7f576f7fe640 1 -- 10.20.193.4:0/2816860068 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57a001eaa0 con 0x5604170a3fb0 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 -- 10.20.193.4:0/2816860068 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 msgr2=0x5604170e41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/2816860068 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e41a0 secure :-1 s=READY pgs=633 gs=1 cs=0 l=1 c_cookie=9913671744423524908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57a000b6c0 tx=0x7f57a0013000 comp rx=0 tx=0).stop 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 -- 10.20.193.4:0/2816860068 shutdown_connections 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/2816860068 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 0x5604170fd250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/2816860068 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x5604170e46e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/2816860068 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e41a0 unknown :-1 s=CLOSED pgs=633 gs=1 cs=0 l=1 c_cookie=9913671744423524908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 -- 10.20.193.4:0/2816860068 >> 10.20.193.4:0/2816860068 conn(0x5604170824b0 msgr2=0x560417105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:51.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 -- 10.20.193.4:0/2816860068 shutdown_connections 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 -- 10.20.193.4:0/2816860068 wait complete. 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 -- start start 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 Processor -- start 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e8ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.590+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x560417082880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 0x560417082dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560417150610 con 0x5604170a3fb0 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560417083300 con 0x5604170a48c0 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5604170834c0 con 0x5604170e6610 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:32864/0 (socket says 10.20.193.4:32864) 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57aaffd640 1 -- 10.20.193.4:0/173386406 learned_addr learned my addr 10.20.193.4:0/173386406 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57aa7fc640 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x560417082880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57ab7fe640 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 0x560417082dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57aaffd640 1 -- 10.20.193.4:0/173386406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 msgr2=0x560417082dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57aaffd640 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 0x560417082dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57aaffd640 1 -- 10.20.193.4:0/173386406 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 msgr2=0x560417082880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57aaffd640 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x560417082880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57aaffd640 1 -- 10.20.193.4:0/173386406 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560416f2ef00 con 0x5604170a3fb0 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57ab7fe640 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 0x560417082dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57aaffd640 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e8ea0 secure :-1 s=READY pgs=634 gs=1 cs=0 l=1 c_cookie=8002077926949270289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57a0010c40 tx=0x7f57a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0d177a4cce3311 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f576d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f576d7fa640 1 -- 10.20.193.4:0/173386406 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57a0028690 con 0x5604170a3fb0 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 1 -- 10.20.193.4:0/173386406 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a0005900 con 0x5604170a3fb0 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f576d7fa640 1 -- 10.20.193.4:0/173386406 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f57a0011e50 con 0x5604170a3fb0 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f576d7fa640 1 -- 10.20.193.4:0/173386406 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57a003bcc0 con 0x5604170a3fb0 2026-02-24T09:11:51.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 10 client.16128 _ll_register_callbacks cb 0x560416f99290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 1 -- 10.20.193.4:0/173386406 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57940385d0 con 0x5604170a3fb0 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f576d7fa640 1 -- 10.20.193.4:0/173386406 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f57a0023070 con 0x5604170a3fb0 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f576d7fa640 1 -- 10.20.193.4:0/173386406 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f57a00443f0 con 0x5604170a3fb0 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 10 client.16128 fetch_fsmap learned FSMap version 19 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 1 -- 10.20.193.4:0/173386406 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x560416f40b70 con 0x5604170a3fb0 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f576d7fa640 1 -- 10.20.193.4:0/173386406 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f57a003b410 con 0x5604170a3fb0 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 10 client.16128 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 10 client.16128 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 20 client.16128 populate_metadata read hostname 'trial004' 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5604170e9560 0x5604171b75d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 4 client.16128 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c5e5130", "release": true, "await": true}] 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.591+0000 7f57b39a0e00 1 -- 10.20.193.4:0/173386406 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c5e5130", "release": true, "await": true}) -- 0x560416cdf3c0 con 0x5604170e9560 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.592+0000 7f57aa7fc640 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5604170e9560 0x5604171b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:11:51.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.592+0000 7f57aa7fc640 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5604170e9560 0x5604171b75d0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=7957252512183410564 s_cookie=15201243967073277595 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e6dd70020c6df84 server_cookie=d2f5aad93173d69b in_seq=0 out_seq=0 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.592+0000 7f576d7fa640 10 client.16128 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f576d7fa640 1 -- 10.20.193.4:0/173386406 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x560416cdf3c0 con 0x5604170e9560 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f576d7fa640 10 client.16128 handle_command_reply: tid=0 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 client.16128 shutdown 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 -- 10.20.193.4:0/173386406 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 msgr2=0x5604170e8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e8ea0 secure :-1 s=READY pgs=634 gs=1 cs=0 l=1 c_cookie=8002077926949270289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57a0010c40 tx=0x7f57a0005800 comp rx=0 tx=0).stop 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 -- 10.20.193.4:0/173386406 shutdown_connections 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5604170e9560 0x5604171b75d0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=7957252512183410564 s_cookie=15201243967073277595 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5604170e6610 0x560417082dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5604170a48c0 0x560417082880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f576d7fa640 0 client.16128 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 --2- 10.20.193.4:0/173386406 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5604170a3fb0 0x5604170e8ea0 unknown :-1 s=CLOSED pgs=634 gs=1 cs=0 l=1 c_cookie=8002077926949270289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 -- 10.20.193.4:0/173386406 >> 10.20.193.4:0/173386406 conn(0x5604170824b0 msgr2=0x560417104100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:51.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 -- 10.20.193.4:0/173386406 shutdown_connections 2026-02-24T09:11:51.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 1 -- 10.20.193.4:0/173386406 wait complete. 2026-02-24T09:11:51.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b39a0e00 20 client.16128 trim_cache size 0 max 16384 2026-02-24T09:11:51.606 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:11:51.606 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:11:51.606 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:11:51.606 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 12, 2026-02-24T09:11:51.606 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:11:51.606 INFO:teuthology.orchestra.run.trial004.stdout: "c5e5130": { 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "version": 12, 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 142.0, 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:11:51.607 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:11:51.608 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:51.608 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:51.608 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:51.608 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:51.608 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:11:51.608 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:11:51.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b19a6640 1 -- 10.20.193.4:0/140442367 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57800b56d0 msgr2=0x7f57800d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b19a6640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57800b56d0 0x7f57800d5b80 secure :-1 s=READY pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57a0004740 tx=0x7f57a000b410 comp rx=0 tx=0).stop 2026-02-24T09:11:51.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b19a6640 1 -- 10.20.193.4:0/140442367 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f57ac1158b0 msgr2=0x7f57ac0f6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:11:51.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.595+0000 7f57b19a6640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f57ac1158b0 0x7f57ac0f6130 secure :-1 s=READY pgs=630 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f579c00f8d0 tx=0x7f579c00fda0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.596+0000 7f57b19a6640 1 -- 10.20.193.4:0/140442367 shutdown_connections 2026-02-24T09:11:51.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.596+0000 7f57b19a6640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57800b56d0 0x7f57800d5b80 unknown :-1 s=CLOSED pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.596+0000 7f57b19a6640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f57ac1158b0 0x7f57ac0f6130 unknown :-1 s=CLOSED pgs=630 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.596+0000 7f57b19a6640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f57ac1100b0 0x7f57ac176180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.596+0000 7f57b19a6640 1 --2- 10.20.193.4:0/140442367 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f57ac10f6c0 0x7f57ac0f5a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:11:51.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.596+0000 7f57b19a6640 1 -- 10.20.193.4:0/140442367 >> 10.20.193.4:0/140442367 conn(0x7f57ac0ecfd0 msgr2=0x7f57ac111ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:11:51.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.596+0000 7f57b19a6640 1 -- 10.20.193.4:0/140442367 shutdown_connections 2026-02-24T09:11:51.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:11:51.596+0000 7f57b19a6640 1 -- 10.20.193.4:0/140442367 wait complete. 2026-02-24T09:11:51.666 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c5e5130', total seconds elapsed: 22.7 2026-02-24T09:11:51.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:51 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2627183414' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:52.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:51 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2627183414' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:52.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:51 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2627183414' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:11:53.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:52 trial004 ceph-mon[41596]: pgmap v214: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2026-02-24T09:11:53.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:52 trial090 ceph-mon[47278]: pgmap v214: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2026-02-24T09:11:53.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:52 trial014 ceph-mon[46941]: pgmap v214: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2026-02-24T09:11:54.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:53 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:11:54.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:53 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:11:54.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:53 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:11:55.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:54 trial004 ceph-mon[41596]: pgmap v215: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2026-02-24T09:11:55.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:54 trial090 ceph-mon[47278]: pgmap v215: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2026-02-24T09:11:55.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:54 trial014 ceph-mon[46941]: pgmap v215: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2026-02-24T09:11:57.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:56 trial004 ceph-mon[41596]: pgmap v216: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 1.0 MiB/s wr, 6 op/s 2026-02-24T09:11:57.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:56 trial090 ceph-mon[47278]: pgmap v216: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 1.0 MiB/s wr, 6 op/s 2026-02-24T09:11:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:56 trial014 ceph-mon[46941]: pgmap v216: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 1.0 MiB/s wr, 6 op/s 2026-02-24T09:11:59.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:11:58 trial004 ceph-mon[41596]: pgmap v217: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 7.0 MiB/s wr, 9 op/s 2026-02-24T09:11:59.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:11:58 trial090 ceph-mon[47278]: pgmap v217: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 7.0 MiB/s wr, 9 op/s 2026-02-24T09:11:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:11:58 trial014 ceph-mon[46941]: pgmap v217: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 7.0 MiB/s wr, 9 op/s 2026-02-24T09:12:01.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:00 trial004 ceph-mon[41596]: pgmap v218: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 12 MiB/s wr, 9 op/s 2026-02-24T09:12:01.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:00 trial090 ceph-mon[47278]: pgmap v218: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 12 MiB/s wr, 9 op/s 2026-02-24T09:12:01.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:00 trial014 ceph-mon[46941]: pgmap v218: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 12 MiB/s wr, 9 op/s 2026-02-24T09:12:03.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:02 trial004 ceph-mon[41596]: pgmap v219: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 30 MiB/s wr, 15 op/s 2026-02-24T09:12:03.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:02 trial090 ceph-mon[47278]: pgmap v219: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 30 MiB/s wr, 15 op/s 2026-02-24T09:12:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:02 trial014 ceph-mon[46941]: pgmap v219: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 30 MiB/s wr, 15 op/s 2026-02-24T09:12:05.075 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:12:05.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:04 trial004 ceph-mon[41596]: pgmap v220: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 105 MiB/s wr, 32 op/s 2026-02-24T09:12:05.268 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:05.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:04 trial090 ceph-mon[47278]: pgmap v220: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 105 MiB/s wr, 32 op/s 2026-02-24T09:12:05.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:04 trial014 ceph-mon[46941]: pgmap v220: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 105 MiB/s wr, 32 op/s 2026-02-24T09:12:05.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 -- 10.20.193.4:0/3026966606 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a981158c0 msgr2=0x7f8a98176290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 --2- 10.20.193.4:0/3026966606 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a981158c0 0x7f8a98176290 secure :-1 s=READY pgs=635 gs=1 cs=0 l=1 c_cookie=380976484657632771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8800aa30 tx=0x7f8a880302b0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 -- 10.20.193.4:0/3026966606 shutdown_connections 2026-02-24T09:12:05.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 --2- 10.20.193.4:0/3026966606 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a981158c0 0x7f8a98176290 unknown :-1 s=CLOSED pgs=635 gs=1 cs=0 l=1 c_cookie=380976484657632771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 --2- 10.20.193.4:0/3026966606 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a981100c0 0x7f8a98115110 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 --2- 10.20.193.4:0/3026966606 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a9810f6d0 0x7f8a9810faa0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 -- 10.20.193.4:0/3026966606 >> 10.20.193.4:0/3026966606 conn(0x7f8a980ecfe0 msgr2=0x7f8a9810d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 -- 10.20.193.4:0/3026966606 shutdown_connections 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 -- 10.20.193.4:0/3026966606 wait complete. 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 Processor -- start 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.465+0000 7f8a9d488640 1 -- start start 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a9d488640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a9810f6d0 0x7f8a980f5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a9d488640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a981100c0 0x7f8a98176190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a9d488640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a981158c0 0x7f8a980f6290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a9d488640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f8a980fb4a0 con 0x7f8a9810f6d0 2026-02-24T09:12:05.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a9d488640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f8a980fb610 con 0x7f8a981100c0 2026-02-24T09:12:05.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a9d488640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a980fb7d0 con 0x7f8a981158c0 2026-02-24T09:12:05.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a96ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a9810f6d0 0x7f8a980f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a96ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a9810f6d0 0x7f8a980f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47232/0 (socket says 10.20.193.4:47232) 2026-02-24T09:12:05.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a96ffd640 1 -- 10.20.193.4:0/143031583 learned_addr learned my addr 10.20.193.4:0/143031583 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:05.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a977fe640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a981158c0 0x7f8a980f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a96ffd640 1 -- 10.20.193.4:0/143031583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a981158c0 msgr2=0x7f8a980f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a981158c0 0x7f8a980f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a96ffd640 1 -- 10.20.193.4:0/143031583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a981100c0 msgr2=0x7f8a98176190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:12:05.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a967fc640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a981100c0 0x7f8a98176190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a981100c0 0x7f8a98176190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a96ffd640 1 -- 10.20.193.4:0/143031583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8800a650 con 0x7f8a9810f6d0 2026-02-24T09:12:05.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.466+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a9810f6d0 0x7f8a980f5b90 secure :-1 s=READY pgs=636 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8c00b520 tx=0x7f8a8c00b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:05.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.467+0000 7f8a77fff640 1 -- 10.20.193.4:0/143031583 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a8c0044a0 con 0x7f8a9810f6d0 2026-02-24T09:12:05.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.467+0000 7f8a9d488640 1 -- 10.20.193.4:0/143031583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a980fbab0 con 0x7f8a9810f6d0 2026-02-24T09:12:05.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.467+0000 7f8a77fff640 1 -- 10.20.193.4:0/143031583 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a8c002c20 con 0x7f8a9810f6d0 2026-02-24T09:12:05.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.467+0000 7f8a9d488640 1 -- 10.20.193.4:0/143031583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a980fbfd0 con 0x7f8a9810f6d0 2026-02-24T09:12:05.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.467+0000 7f8a77fff640 1 -- 10.20.193.4:0/143031583 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a8c018d20 con 0x7f8a9810f6d0 2026-02-24T09:12:05.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.471+0000 7f8a77fff640 1 -- 10.20.193.4:0/143031583 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f8a8c018400 con 0x7f8a9810f6d0 2026-02-24T09:12:05.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.471+0000 7f8a77fff640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a6c0c6b60 0x7f8a6c0e7010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.471+0000 7f8a77fff640 1 -- 10.20.193.4:0/143031583 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8a8c0e64d0 con 0x7f8a9810f6d0 2026-02-24T09:12:05.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.472+0000 7f8a967fc640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a6c0c6b60 0x7f8a6c0e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.472+0000 7f8a967fc640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a6c0c6b60 0x7f8a6c0e7010 secure :-1 s=READY pgs=315 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a980fc530 tx=0x7f8a80008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:05.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.474+0000 7f8a9f482e00 1 Processor -- start 2026-02-24T09:12:05.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.474+0000 7f8a9f482e00 1 -- start start 2026-02-24T09:12:05.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56db2bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db3130 0x561b56df7890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56e181b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561b56cc2de0 con 0x561b56db2820 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561b56cbeb10 con 0x561b56db3130 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561b56cb8ab0 con 0x561b56df7dd0 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a96ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56db2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a96ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56db2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47242/0 (socket says 10.20.193.4:47242) 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a977fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56e181b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a96ffd640 1 -- 10.20.193.4:0/2291674657 learned_addr learned my addr 10.20.193.4:0/2291674657 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a967fc640 1 --2- 10.20.193.4:0/2291674657 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db3130 0x561b56df7890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a96ffd640 1 -- 10.20.193.4:0/2291674657 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 msgr2=0x561b56e181b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/2291674657 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56e181b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a96ffd640 1 -- 10.20.193.4:0/2291674657 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db3130 msgr2=0x561b56df7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:05.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/2291674657 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db3130 0x561b56df7890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a96ffd640 1 -- 10.20.193.4:0/2291674657 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b56c64310 con 0x561b56db2820 2026-02-24T09:12:05.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a977fe640 1 --2- 10.20.193.4:0/2291674657 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56e181b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:12:05.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/2291674657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56db2bf0 secure :-1 s=READY pgs=637 gs=1 cs=0 l=1 c_cookie=10123635840161819356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8c0acab0 tx=0x7f8a8c018730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7e6128c8422adc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:05.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a637fe640 1 -- 10.20.193.4:0/2291674657 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a8c0ad240 con 0x561b56db2820 2026-02-24T09:12:05.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a637fe640 1 -- 10.20.193.4:0/2291674657 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a8c0b2560 con 0x561b56db2820 2026-02-24T09:12:05.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.475+0000 7f8a637fe640 1 -- 10.20.193.4:0/2291674657 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a8c0e60d0 con 0x561b56db2820 2026-02-24T09:12:05.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.476+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2291674657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 msgr2=0x561b56db2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.476+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/2291674657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56db2bf0 secure :-1 s=READY pgs=637 gs=1 cs=0 l=1 c_cookie=10123635840161819356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8c0acab0 tx=0x7f8a8c018730 comp rx=0 tx=0).stop 2026-02-24T09:12:05.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.476+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2291674657 shutdown_connections 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.476+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/2291674657 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56e181b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.476+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/2291674657 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db3130 0x561b56df7890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.476+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/2291674657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56db2bf0 unknown :-1 s=CLOSED pgs=637 gs=1 cs=0 l=1 c_cookie=10123635840161819356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.476+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2291674657 >> 10.20.193.4:0/2291674657 conn(0x561b56cd16b0 msgr2=0x561b56db1100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.476+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2291674657 shutdown_connections 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.476+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2291674657 wait complete. 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.477+0000 7f8a9f482e00 1 -- start start 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.477+0000 7f8a9f482e00 1 Processor -- start 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.477+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56dcaea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.477+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db3130 0x561b56dcb3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.477+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56dd03d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.477+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561b56dd0910 con 0x561b56db2820 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.477+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561b56dd0a80 con 0x561b56db3130 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.477+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561b56dd0c40 con 0x561b56df7dd0 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a96ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56dcaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a96ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56dcaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47254/0 (socket says 10.20.193.4:47254) 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a96ffd640 1 -- 10.20.193.4:0/2795725837 learned_addr learned my addr 10.20.193.4:0/2795725837 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a977fe640 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56dd03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a967fc640 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db3130 0x561b56dcb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a96ffd640 1 -- 10.20.193.4:0/2795725837 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 msgr2=0x561b56dd03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56dd03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a96ffd640 1 -- 10.20.193.4:0/2795725837 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db3130 msgr2=0x561b56dcb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:05.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db3130 0x561b56dcb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a96ffd640 1 -- 10.20.193.4:0/2795725837 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a980fbfd0 con 0x561b56db2820 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a977fe640 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56dd03d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56dcaea0 secure :-1 s=READY pgs=638 gs=1 cs=0 l=1 c_cookie=1677183699720249356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8c004730 tx=0x7f8a8c004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17468db054e6a00c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a60ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a60ff9640 1 -- 10.20.193.4:0/2795725837 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a8c0ad6f0 con 0x561b56db2820 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2795725837 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a98176b00 con 0x561b56db2820 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a60ff9640 1 -- 10.20.193.4:0/2795725837 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a8c0a8ab0 con 0x561b56db2820 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a60ff9640 1 -- 10.20.193.4:0/2795725837 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a8c071b60 con 0x561b56db2820 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 10 client.16140 _ll_register_callbacks cb 0x561b56c54160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2795725837 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b56a084a0 con 0x561b56db2820 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a60ff9640 1 -- 10.20.193.4:0/2795725837 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8a8c0aa820 con 0x561b56db2820 2026-02-24T09:12:05.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a60ff9640 1 -- 10.20.193.4:0/2795725837 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8a8c0aa9e0 con 0x561b56db2820 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 10 client.16140 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2795725837 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561b56c3c8c0 con 0x561b56db2820 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a60ff9640 1 -- 10.20.193.4:0/2795725837 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f8a8c0d00b0 con 0x561b56db2820 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 10 client.16140 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 10 client.16140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 20 client.16140 populate_metadata read hostname 'trial004' 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561b56df5390 0x561b56df5830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 4 client.16140 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.478+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2795725837 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b56cae4f0 con 0x561b56df5390 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.479+0000 7f8a967fc640 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561b56df5390 0x561b56df5830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.479+0000 7f8a60ff9640 10 client.16140 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:05.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.479+0000 7f8a967fc640 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561b56df5390 0x561b56df5830 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=6736607890167325882 s_cookie=7287939568475599066 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d7d3d2f1c8464ba server_cookie=6523f66ca38070da in_seq=0 out_seq=0 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a60ff9640 1 -- 10.20.193.4:0/2795725837 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561b56cae4f0 con 0x561b56df5390 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a60ff9640 10 client.16140 handle_command_reply: tid=0 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 client.16140 shutdown 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2795725837 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 msgr2=0x561b56dcaea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56dcaea0 secure :-1 s=READY pgs=638 gs=1 cs=0 l=1 c_cookie=1677183699720249356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8c004730 tx=0x7f8a8c004790 comp rx=0 tx=0).stop 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2795725837 shutdown_connections 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561b56df5390 0x561b56df5830 crc :-1 s=READY pgs=69 gs=4 cs=0 l=0 c_cookie=6736607890167325882 s_cookie=7287939568475599066 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56dd03d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db3130 0x561b56dcb3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/2795725837 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db2820 0x561b56dcaea0 unknown :-1 s=CLOSED pgs=638 gs=1 cs=0 l=1 c_cookie=1677183699720249356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a60ff9640 0 client.16140 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:05.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2795725837 >> 10.20.193.4:0/2795725837 conn(0x561b56cd16b0 msgr2=0x561b56db1810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:05.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2795725837 shutdown_connections 2026-02-24T09:12:05.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 1 -- 10.20.193.4:0/2795725837 wait complete. 2026-02-24T09:12:05.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.480+0000 7f8a9f482e00 20 client.16140 trim_cache size 0 max 16384 2026-02-24T09:12:05.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.490+0000 7f8a9f482e00 1 Processor -- start 2026-02-24T09:12:05.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.490+0000 7f8a9f482e00 1 -- start start 2026-02-24T09:12:05.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 0x561b56dcf940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56db3130 0x561b56df7120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56df7dd0 0x561b56df7660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561b56cb66e0 con 0x561b56df7dd0 2026-02-24T09:12:05.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561b56981f50 con 0x561b56db2820 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561b56d25150 con 0x561b56db3130 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a977fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56df7dd0 0x561b56df7660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a977fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56df7dd0 0x561b56df7660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47256/0 (socket says 10.20.193.4:47256) 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a977fe640 1 -- 10.20.193.4:0/1220947504 learned_addr learned my addr 10.20.193.4:0/1220947504 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a96ffd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 0x561b56dcf940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a967fc640 1 --2- 10.20.193.4:0/1220947504 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56db3130 0x561b56df7120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a977fe640 1 -- 10.20.193.4:0/1220947504 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56db3130 msgr2=0x561b56df7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a977fe640 1 --2- 10.20.193.4:0/1220947504 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56db3130 0x561b56df7120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a977fe640 1 -- 10.20.193.4:0/1220947504 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 msgr2=0x561b56dcf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a977fe640 1 --2- 10.20.193.4:0/1220947504 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 0x561b56dcf940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a977fe640 1 -- 10.20.193.4:0/1220947504 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b56dbd3a0 con 0x561b56df7dd0 2026-02-24T09:12:05.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.491+0000 7f8a977fe640 1 --2- 10.20.193.4:0/1220947504 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56df7dd0 0x561b56df7660 secure :-1 s=READY pgs=639 gs=1 cs=0 l=1 c_cookie=9331173248156416489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a880307c0 tx=0x7f8a8803b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817efca169fdb9e9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:05.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.492+0000 7f8a62ffd640 1 -- 10.20.193.4:0/1220947504 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a8803e030 con 0x561b56df7dd0 2026-02-24T09:12:05.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.492+0000 7f8a62ffd640 1 -- 10.20.193.4:0/1220947504 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a88039470 con 0x561b56df7dd0 2026-02-24T09:12:05.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.492+0000 7f8a62ffd640 1 -- 10.20.193.4:0/1220947504 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a88005340 con 0x561b56df7dd0 2026-02-24T09:12:05.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.492+0000 7f8a9f482e00 1 -- 10.20.193.4:0/1220947504 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56df7dd0 msgr2=0x561b56df7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.492+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/1220947504 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56df7dd0 0x561b56df7660 secure :-1 s=READY pgs=639 gs=1 cs=0 l=1 c_cookie=9331173248156416489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a880307c0 tx=0x7f8a8803b040 comp rx=0 tx=0).stop 2026-02-24T09:12:05.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.492+0000 7f8a9f482e00 1 -- 10.20.193.4:0/1220947504 shutdown_connections 2026-02-24T09:12:05.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.492+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/1220947504 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56df7dd0 0x561b56df7660 unknown :-1 s=CLOSED pgs=639 gs=1 cs=0 l=1 c_cookie=9331173248156416489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.492+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/1220947504 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56db3130 0x561b56df7120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.492+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/1220947504 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 0x561b56dcf940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.492+0000 7f8a9f482e00 1 -- 10.20.193.4:0/1220947504 >> 10.20.193.4:0/1220947504 conn(0x561b56cd16b0 msgr2=0x561b56dcf230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:05.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a9f482e00 1 -- 10.20.193.4:0/1220947504 shutdown_connections 2026-02-24T09:12:05.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a9f482e00 1 -- 10.20.193.4:0/1220947504 wait complete. 2026-02-24T09:12:05.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a9f482e00 1 -- start start 2026-02-24T09:12:05.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a9f482e00 1 Processor -- start 2026-02-24T09:12:05.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 0x561b56dd2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db3130 0x561b56dd3360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a9f482e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56e5d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561b56e5d830 con 0x561b56db3130 2026-02-24T09:12:05.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561b56e5d9a0 con 0x561b56db2820 2026-02-24T09:12:05.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a9f482e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561b56e5db10 con 0x561b56df7dd0 2026-02-24T09:12:05.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.493+0000 7f8a967fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db3130 0x561b56dd3360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a967fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db3130 0x561b56dd3360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47264/0 (socket says 10.20.193.4:47264) 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a967fc640 1 -- 10.20.193.4:0/3884930620 learned_addr learned my addr 10.20.193.4:0/3884930620 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 0x561b56dd2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a977fe640 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56e5d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a967fc640 1 -- 10.20.193.4:0/3884930620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 msgr2=0x561b56e5d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a967fc640 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56e5d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a967fc640 1 -- 10.20.193.4:0/3884930620 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 msgr2=0x561b56dd2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a967fc640 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 0x561b56dd2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a967fc640 1 -- 10.20.193.4:0/3884930620 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b56c4e6e0 con 0x561b56db3130 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 0x561b56dd2e20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:05.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a977fe640 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56e5d2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:05.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a967fc640 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db3130 0x561b56dd3360 secure :-1 s=READY pgs=640 gs=1 cs=0 l=1 c_cookie=3206947592234293603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a800044e0 tx=0x7f8a80004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c815dd8106b5963 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:05.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a60ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:05.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a60ff9640 1 -- 10.20.193.4:0/3884930620 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a80002b70 con 0x561b56db3130 2026-02-24T09:12:05.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 1 -- 10.20.193.4:0/3884930620 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a88006e70 con 0x561b56db3130 2026-02-24T09:12:05.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a60ff9640 1 -- 10.20.193.4:0/3884930620 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a80026190 con 0x561b56db3130 2026-02-24T09:12:05.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a60ff9640 1 -- 10.20.193.4:0/3884930620 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a800238b0 con 0x561b56db3130 2026-02-24T09:12:05.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 10 client.16146 _ll_register_callbacks cb 0x561b56c54160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:05.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 1 -- 10.20.193.4:0/3884930620 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a8c0b2560 con 0x561b56db3130 2026-02-24T09:12:05.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a60ff9640 1 -- 10.20.193.4:0/3884930620 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8a80023a40 con 0x561b56db3130 2026-02-24T09:12:05.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a60ff9640 1 -- 10.20.193.4:0/3884930620 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8a80023c00 con 0x561b56db3130 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 10 client.16146 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 1 -- 10.20.193.4:0/3884930620 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561b56c49160 con 0x561b56db3130 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a60ff9640 1 -- 10.20.193.4:0/3884930620 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f8a80039420 con 0x561b56db3130 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 10 client.16146 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 20 client.16146 populate_metadata read hostname 'trial004' 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561b56ea5b60 0x561b56ec6010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 4 client.16146 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.494+0000 7f8a9f482e00 1 -- 10.20.193.4:0/3884930620 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b569ed160 con 0x561b56ea5b60 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.495+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561b56ea5b60 0x561b56ec6010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.495+0000 7f8a60ff9640 10 client.16146 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.495+0000 7f8a96ffd640 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561b56ea5b60 0x561b56ec6010 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=17799943536167202822 s_cookie=13462265215959018775 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7061a568741b006 server_cookie=bad392e34555ad17 in_seq=0 out_seq=0 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a60ff9640 1 -- 10.20.193.4:0/3884930620 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x561b569ed160 con 0x561b56ea5b60 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a60ff9640 10 client.16146 handle_command_reply: tid=0 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 client.16146 shutdown 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 -- 10.20.193.4:0/3884930620 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db3130 msgr2=0x561b56dd3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db3130 0x561b56dd3360 secure :-1 s=READY pgs=640 gs=1 cs=0 l=1 c_cookie=3206947592234293603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a800044e0 tx=0x7f8a80004790 comp rx=0 tx=0).stop 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 -- 10.20.193.4:0/3884930620 shutdown_connections 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561b56ea5b60 0x561b56ec6010 crc :-1 s=READY pgs=70 gs=4 cs=0 l=0 c_cookie=17799943536167202822 s_cookie=13462265215959018775 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561b56df7dd0 0x561b56e5d2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a60ff9640 0 client.16146 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:05.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561b56db3130 0x561b56dd3360 unknown :-1 s=CLOSED pgs=640 gs=1 cs=0 l=1 c_cookie=3206947592234293603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 --2- 10.20.193.4:0/3884930620 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561b56db2820 0x561b56dd2e20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 -- 10.20.193.4:0/3884930620 >> 10.20.193.4:0/3884930620 conn(0x561b56cd16b0 msgr2=0x561b56dcfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:05.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 -- 10.20.193.4:0/3884930620 shutdown_connections 2026-02-24T09:12:05.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 1 -- 10.20.193.4:0/3884930620 wait complete. 2026-02-24T09:12:05.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.496+0000 7f8a9f482e00 20 client.16146 trim_cache size 0 max 16384 2026-02-24T09:12:05.508 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:12:05.509 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:12:05.509 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:12:05.509 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:12:05.509 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:12:05.509 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:12:05.509 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:05.509 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:05.509 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:05.509 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:05.509 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:05.510 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:05.510 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:12:05.510 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:12:05.510 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:05.510 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:05.510 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:05.510 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:05.510 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:05.510 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:05.510 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:05.511 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:05.512 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:05.512 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:05.512 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:05.512 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:05.512 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:05.512 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:12:05.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 -- 10.20.193.4:0/143031583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a6c0c6b60 msgr2=0x7f8a6c0e7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a6c0c6b60 0x7f8a6c0e7010 secure :-1 s=READY pgs=315 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a980fc530 tx=0x7f8a80008040 comp rx=0 tx=0).stop 2026-02-24T09:12:05.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 -- 10.20.193.4:0/143031583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a9810f6d0 msgr2=0x7f8a980f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a9810f6d0 0x7f8a980f5b90 secure :-1 s=READY pgs=636 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8c00b520 tx=0x7f8a8c00b9f0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 -- 10.20.193.4:0/143031583 shutdown_connections 2026-02-24T09:12:05.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a6c0c6b60 0x7f8a6c0e7010 unknown :-1 s=CLOSED pgs=315 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a981158c0 0x7f8a980f6290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a981100c0 0x7f8a98176190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 --2- 10.20.193.4:0/143031583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a9810f6d0 0x7f8a980f5b90 unknown :-1 s=CLOSED pgs=636 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 -- 10.20.193.4:0/143031583 >> 10.20.193.4:0/143031583 conn(0x7f8a980ecfe0 msgr2=0x7f8a98111ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:05.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 -- 10.20.193.4:0/143031583 shutdown_connections 2026-02-24T09:12:05.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.497+0000 7f8a9d488640 1 -- 10.20.193.4:0/143031583 wait complete. 2026-02-24T09:12:05.577 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:12:05.578 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:12:05.719 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:05.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 -- 10.20.193.4:0/1726888806 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcdec115470 msgr2=0x7fcdec175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 --2- 10.20.193.4:0/1726888806 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcdec115470 0x7fcdec175e40 secure :-1 s=READY pgs=641 gs=1 cs=0 l=1 c_cookie=5636696181716371446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcddc00aa30 tx=0x7fcddc030280 comp rx=0 tx=0).stop 2026-02-24T09:12:05.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 -- 10.20.193.4:0/1726888806 shutdown_connections 2026-02-24T09:12:05.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 --2- 10.20.193.4:0/1726888806 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcdec115470 0x7fcdec175e40 unknown :-1 s=CLOSED pgs=641 gs=1 cs=0 l=1 c_cookie=5636696181716371446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 --2- 10.20.193.4:0/1726888806 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcdec10fc70 0x7fcdec114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 --2- 10.20.193.4:0/1726888806 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcdec10f280 0x7fcdec10f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 -- 10.20.193.4:0/1726888806 >> 10.20.193.4:0/1726888806 conn(0x7fcdec05f830 msgr2=0x7fcdec10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 -- 10.20.193.4:0/1726888806 shutdown_connections 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 -- 10.20.193.4:0/1726888806 wait complete. 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 Processor -- start 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.887+0000 7fcdf11eb640 1 -- start start 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdf11eb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcdec10f280 0x7fcdec11dc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdf11eb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcdec10fc70 0x7fcdec11e150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdf11eb640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcdec115470 0x7fcdec123520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdf11eb640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec123b40 con 0x7fcdec10f280 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdf11eb640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec123cb0 con 0x7fcdec115470 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdf11eb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec123e70 con 0x7fcdec10fc70 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdead76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcdec10f280 0x7fcdec11dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdead76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcdec10f280 0x7fcdec11dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47280/0 (socket says 10.20.193.4:47280) 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdead76640 1 -- 10.20.193.4:0/998016309 learned_addr learned my addr 10.20.193.4:0/998016309 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdea575640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcdec10fc70 0x7fcdec11e150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdead76640 1 -- 10.20.193.4:0/998016309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcdec10fc70 msgr2=0x7fcdec11e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdead76640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcdec10fc70 0x7fcdec11e150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdead76640 1 -- 10.20.193.4:0/998016309 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcdec115470 msgr2=0x7fcdec123520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdead76640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcdec115470 0x7fcdec123520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdead76640 1 -- 10.20.193.4:0/998016309 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcddc00a650 con 0x7fcdec10f280 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdea575640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcdec10fc70 0x7fcdec11e150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdead76640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcdec10f280 0x7fcdec11dc10 secure :-1 s=READY pgs=642 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcde00072a0 tx=0x7fcde000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:05.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdcbfff640 1 -- 10.20.193.4:0/998016309 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcde0004500 con 0x7fcdec10f280 2026-02-24T09:12:05.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdcbfff640 1 -- 10.20.193.4:0/998016309 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcde000bd20 con 0x7fcdec10f280 2026-02-24T09:12:05.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdf11eb640 1 -- 10.20.193.4:0/998016309 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdec124150 con 0x7fcdec10f280 2026-02-24T09:12:05.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdcbfff640 1 -- 10.20.193.4:0/998016309 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcde0002ea0 con 0x7fcdec10f280 2026-02-24T09:12:05.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.888+0000 7fcdf11eb640 1 -- 10.20.193.4:0/998016309 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdec164850 con 0x7fcdec10f280 2026-02-24T09:12:05.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.889+0000 7fcdf11eb640 1 -- 10.20.193.4:0/998016309 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdec110560 con 0x7fcdec10f280 2026-02-24T09:12:05.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.890+0000 7fcdcbfff640 1 -- 10.20.193.4:0/998016309 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fcde000b840 con 0x7fcdec10f280 2026-02-24T09:12:05.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.890+0000 7fcdcbfff640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcdbc0b56e0 0x7fcdbc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:05.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.890+0000 7fcdcbfff640 1 -- 10.20.193.4:0/998016309 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fcde00e6bf0 con 0x7fcdec10f280 2026-02-24T09:12:05.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.891+0000 7fcdea575640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcdbc0b56e0 0x7fcdbc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:05.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.891+0000 7fcdea575640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcdbc0b56e0 0x7fcdbc0d5b90 secure :-1 s=READY pgs=316 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd4005e30 tx=0x7fcdd4005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:05.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:05.891+0000 7fcdcbfff640 1 -- 10.20.193.4:0/998016309 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fcde00a9570 con 0x7fcdec10f280 2026-02-24T09:12:06.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.033+0000 7fcdf11eb640 1 -- 10.20.193.4:0/998016309 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcdec10f650 con 0x7fcdec10f280 2026-02-24T09:12:06.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.034+0000 7fcdcbfff640 1 -- 10.20.193.4:0/998016309 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fcde00ac720 con 0x7fcdec10f280 2026-02-24T09:12:06.037 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:12:06.037 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:12:06.037 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:12:06.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 -- 10.20.193.4:0/998016309 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcdbc0b56e0 msgr2=0x7fcdbc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcdbc0b56e0 0x7fcdbc0d5b90 secure :-1 s=READY pgs=316 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcdd4005e30 tx=0x7fcdd4005da0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 -- 10.20.193.4:0/998016309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcdec10f280 msgr2=0x7fcdec11dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcdec10f280 0x7fcdec11dc10 secure :-1 s=READY pgs=642 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcde00072a0 tx=0x7fcde000ddf0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 -- 10.20.193.4:0/998016309 shutdown_connections 2026-02-24T09:12:06.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcdbc0b56e0 0x7fcdbc0d5b90 unknown :-1 s=CLOSED pgs=316 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcdec115470 0x7fcdec123520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcdec10fc70 0x7fcdec11e150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 --2- 10.20.193.4:0/998016309 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcdec10f280 0x7fcdec11dc10 unknown :-1 s=CLOSED pgs=642 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 -- 10.20.193.4:0/998016309 >> 10.20.193.4:0/998016309 conn(0x7fcdec05f830 msgr2=0x7fcdec10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 -- 10.20.193.4:0/998016309 shutdown_connections 2026-02-24T09:12:06.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.038+0000 7fcdf11eb640 1 -- 10.20.193.4:0/998016309 wait complete. 2026-02-24T09:12:06.094 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:12:06.273 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:06.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.434+0000 7fb9a9338640 1 -- 10.20.193.4:0/996459582 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9a4115840 msgr2=0x7fb9a4176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 --2- 10.20.193.4:0/996459582 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9a4115840 0x7fb9a4176210 secure :-1 s=READY pgs=643 gs=1 cs=0 l=1 c_cookie=16341866344129346321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb99400aa30 tx=0x7fb994030280 comp rx=0 tx=0).stop 2026-02-24T09:12:06.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 -- 10.20.193.4:0/996459582 shutdown_connections 2026-02-24T09:12:06.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 --2- 10.20.193.4:0/996459582 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9a4115840 0x7fb9a4176210 unknown :-1 s=CLOSED pgs=643 gs=1 cs=0 l=1 c_cookie=16341866344129346321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 --2- 10.20.193.4:0/996459582 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9a4110040 0x7fb9a4115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 --2- 10.20.193.4:0/996459582 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9a410f650 0x7fb9a410fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 -- 10.20.193.4:0/996459582 >> 10.20.193.4:0/996459582 conn(0x7fb9a40ecf20 msgr2=0x7fb9a410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 -- 10.20.193.4:0/996459582 shutdown_connections 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 -- 10.20.193.4:0/996459582 wait complete. 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 Processor -- start 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 -- start start 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9a410f650 0x7fb9a40f5820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9a4110040 0x7fb9a4176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9a4115840 0x7fb9a40f5f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a40fb130 con 0x7fb9a4115840 2026-02-24T09:12:06.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a40fb2a0 con 0x7fb9a410f650 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a9338640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a40fb460 con 0x7fb9a4110040 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a37fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9a4115840 0x7fb9a40f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a37fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9a4115840 0x7fb9a40f5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47312/0 (socket says 10.20.193.4:47312) 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.435+0000 7fb9a37fe640 1 -- 10.20.193.4:0/1623138608 learned_addr learned my addr 10.20.193.4:0/1623138608 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb9a27fc640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9a4110040 0x7fb9a4176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9a410f650 0x7fb9a40f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb9a37fe640 1 -- 10.20.193.4:0/1623138608 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9a4110040 msgr2=0x7fb9a4176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9a4110040 0x7fb9a4176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb9a37fe640 1 -- 10.20.193.4:0/1623138608 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9a410f650 msgr2=0x7fb9a40f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9a410f650 0x7fb9a40f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb9a37fe640 1 -- 10.20.193.4:0/1623138608 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99400a650 con 0x7fb9a4115840 2026-02-24T09:12:06.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9a4115840 0x7fb9a40f5f20 secure :-1 s=READY pgs=644 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb99400a330 tx=0x7fb9940039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb983fff640 1 -- 10.20.193.4:0/1623138608 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb99403e070 con 0x7fb9a4115840 2026-02-24T09:12:06.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb9a9338640 1 -- 10.20.193.4:0/1623138608 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a40fb6e0 con 0x7fb9a4115840 2026-02-24T09:12:06.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb983fff640 1 -- 10.20.193.4:0/1623138608 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9940055a0 con 0x7fb9a4115840 2026-02-24T09:12:06.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb983fff640 1 -- 10.20.193.4:0/1623138608 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb994042a70 con 0x7fb9a4115840 2026-02-24T09:12:06.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.436+0000 7fb9a9338640 1 -- 10.20.193.4:0/1623138608 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a40fbb50 con 0x7fb9a4115840 2026-02-24T09:12:06.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.439+0000 7fb983fff640 1 -- 10.20.193.4:0/1623138608 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fb9940050c0 con 0x7fb9a4115840 2026-02-24T09:12:06.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.440+0000 7fb983fff640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9780b5750 0x7fb9780d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.440+0000 7fb983fff640 1 -- 10.20.193.4:0/1623138608 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb99410cd50 con 0x7fb9a4115840 2026-02-24T09:12:06.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.440+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9780b5750 0x7fb9780d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.440+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9780b5750 0x7fb9780d5c00 secure :-1 s=READY pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb998004740 tx=0x7fb99800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9ab332e00 1 Processor -- start 2026-02-24T09:12:06.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9ab332e00 1 -- start start 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d2254320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2254860 0x5573d2298fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2299500 0x5573d22b98e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5573d2164ee0 con 0x5573d2253f50 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5573d2160c10 con 0x5573d2254860 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5573d215ad70 con 0x5573d2299500 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9a2ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d2254320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9a2ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d2254320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47318/0 (socket says 10.20.193.4:47318) 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9a2ffd640 1 -- 10.20.193.4:0/2366913212 learned_addr learned my addr 10.20.193.4:0/2366913212 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/2366913212 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2299500 0x5573d22b98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9a27fc640 1 --2- 10.20.193.4:0/2366913212 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2254860 0x5573d2298fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9a2ffd640 1 -- 10.20.193.4:0/2366913212 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2299500 msgr2=0x5573d22b98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/2366913212 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2299500 0x5573d22b98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9a2ffd640 1 -- 10.20.193.4:0/2366913212 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2254860 msgr2=0x5573d2298fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/2366913212 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2254860 0x5573d2298fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.443+0000 7fb9a2ffd640 1 -- 10.20.193.4:0/2366913212 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d2106340 con 0x5573d2253f50 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/2366913212 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d2254320 secure :-1 s=READY pgs=645 gs=1 cs=0 l=1 c_cookie=17733841758514451082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb998005db0 tx=0x7fb998013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61b431f173e128a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb96f7fe640 1 -- 10.20.193.4:0/2366913212 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb99801e640 con 0x5573d2253f50 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb96f7fe640 1 -- 10.20.193.4:0/2366913212 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb998015070 con 0x5573d2253f50 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb96f7fe640 1 -- 10.20.193.4:0/2366913212 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb998026d50 con 0x5573d2253f50 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb9ab332e00 1 -- 10.20.193.4:0/2366913212 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 msgr2=0x5573d2254320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/2366913212 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d2254320 secure :-1 s=READY pgs=645 gs=1 cs=0 l=1 c_cookie=17733841758514451082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb998005db0 tx=0x7fb998013000 comp rx=0 tx=0).stop 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb9ab332e00 1 -- 10.20.193.4:0/2366913212 shutdown_connections 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/2366913212 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2299500 0x5573d22b98e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/2366913212 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2254860 0x5573d2298fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/2366913212 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d2254320 unknown :-1 s=CLOSED pgs=645 gs=1 cs=0 l=1 c_cookie=17733841758514451082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb9ab332e00 1 -- 10.20.193.4:0/2366913212 >> 10.20.193.4:0/2366913212 conn(0x5573d2172db0 msgr2=0x5573d2252830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb9ab332e00 1 -- 10.20.193.4:0/2366913212 shutdown_connections 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.444+0000 7fb9ab332e00 1 -- 10.20.193.4:0/2366913212 wait complete. 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.445+0000 7fb9ab332e00 1 -- start start 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.445+0000 7fb9ab332e00 1 Processor -- start 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.445+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2253f50 0x5573d22b0d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.445+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2254860 0x5573d22b12d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.445+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2299500 0x5573d22b62c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.445+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5573d22b6800 con 0x5573d2299500 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.445+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5573d22b6970 con 0x5573d2253f50 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.445+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5573d22b6b30 con 0x5573d2254860 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a2ffd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2253f50 0x5573d22b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a2ffd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2253f50 0x5573d22b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:46296/0 (socket says 10.20.193.4:46296) 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a2ffd640 1 -- 10.20.193.4:0/3398320882 learned_addr learned my addr 10.20.193.4:0/3398320882 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a27fc640 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2254860 0x5573d22b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2299500 0x5573d22b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a37fe640 1 -- 10.20.193.4:0/3398320882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2254860 msgr2=0x5573d22b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2254860 0x5573d22b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a37fe640 1 -- 10.20.193.4:0/3398320882 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2253f50 msgr2=0x5573d22b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2253f50 0x5573d22b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a37fe640 1 -- 10.20.193.4:0/3398320882 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d20de9d0 con 0x5573d2299500 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2299500 0x5573d22b62c0 secure :-1 s=READY pgs=646 gs=3 cs=0 l=1 c_cookie=1510550287564910848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9940d03a0 tx=0x7fb994030280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f68d7bb9abb100 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb96cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb96cff9640 1 -- 10.20.193.4:0/3398320882 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9940810e0 con 0x5573d2299500 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb96cff9640 1 -- 10.20.193.4:0/3398320882 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9940d8da0 con 0x5573d2299500 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb96cff9640 1 -- 10.20.193.4:0/3398320882 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9940d4cf0 con 0x5573d2299500 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3398320882 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99800bd10 con 0x5573d2299500 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb96cff9640 1 -- 10.20.193.4:0/3398320882 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb9940d2420 con 0x5573d2299500 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb96cff9640 10 client.16164 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9ab332e00 10 client.16164 _ll_register_callbacks cb 0x5573d2105080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3398320882 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5573d1eaa4a0 con 0x5573d2299500 2026-02-24T09:12:06.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb96cff9640 1 -- 10.20.193.4:0/3398320882 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb9940db380 con 0x5573d2299500 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9ab332e00 10 client.16164 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.446+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3398320882 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5573d20f0710 con 0x5573d2299500 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.447+0000 7fb96cff9640 1 -- 10.20.193.4:0/3398320882 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb9940d25e0 con 0x5573d2299500 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.447+0000 7fb9ab332e00 10 client.16164 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.447+0000 7fb9ab332e00 10 client.16164 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.447+0000 7fb9ab332e00 20 client.16164 populate_metadata read hostname 'trial004' 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.447+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5573d2296430 0x5573d22968d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.447+0000 7fb9ab332e00 4 client.16164 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.447+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3398320882 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573d21507b0 con 0x5573d2296430 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.447+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5573d2296430 0x5573d22968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.447+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5573d2296430 0x5573d22968d0 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=231845368700338375 s_cookie=8647901330310684419 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=337ae226c3400c7 server_cookie=78038470fdcbdf03 in_seq=0 out_seq=0 2026-02-24T09:12:06.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.447+0000 7fb96cff9640 10 client.16164 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb96cff9640 1 -- 10.20.193.4:0/3398320882 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5573d21507b0 con 0x5573d2296430 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb96cff9640 10 client.16164 handle_command_reply: tid=0 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 client.16164 shutdown 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3398320882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2299500 msgr2=0x5573d22b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2299500 0x5573d22b62c0 secure :-1 s=READY pgs=646 gs=3 cs=0 l=1 c_cookie=1510550287564910848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9940d03a0 tx=0x7fb994030280 comp rx=0 tx=0).stop 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3398320882 shutdown_connections 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5573d2296430 0x5573d22968d0 crc :-1 s=READY pgs=28 gs=4 cs=0 l=0 c_cookie=231845368700338375 s_cookie=8647901330310684419 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2299500 0x5573d22b62c0 unknown :-1 s=CLOSED pgs=646 gs=3 cs=0 l=1 c_cookie=1510550287564910848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2254860 0x5573d22b12d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3398320882 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2253f50 0x5573d22b0d90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb96cff9640 0 client.16164 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:06.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3398320882 >> 10.20.193.4:0/3398320882 conn(0x5573d2172db0 msgr2=0x5573d2252040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3398320882 shutdown_connections 2026-02-24T09:12:06.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3398320882 wait complete. 2026-02-24T09:12:06.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.448+0000 7fb9ab332e00 20 client.16164 trim_cache size 0 max 16384 2026-02-24T09:12:06.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9ab332e00 1 Processor -- start 2026-02-24T09:12:06.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9ab332e00 1 -- start start 2026-02-24T09:12:06.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d22ae180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2254860 0x5573d22ae6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 0x5573d2294160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5573d21589a0 con 0x5573d2253f50 2026-02-24T09:12:06.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5573d1f34df0 con 0x5573d2299500 2026-02-24T09:12:06.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5573d22a2e50 con 0x5573d2254860 2026-02-24T09:12:06.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9a2ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d22ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9a2ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d22ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47330/0 (socket says 10.20.193.4:47330) 2026-02-24T09:12:06.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9a2ffd640 1 -- 10.20.193.4:0/4173201126 learned_addr learned my addr 10.20.193.4:0/4173201126 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:06.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/4173201126 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 0x5573d2294160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.458+0000 7fb9a27fc640 1 --2- 10.20.193.4:0/4173201126 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2254860 0x5573d22ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9a37fe640 1 -- 10.20.193.4:0/4173201126 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2254860 msgr2=0x5573d22ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/4173201126 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2254860 0x5573d22ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9a37fe640 1 -- 10.20.193.4:0/4173201126 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 msgr2=0x5573d22ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/4173201126 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d22ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9a37fe640 1 -- 10.20.193.4:0/4173201126 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d20eb190 con 0x5573d2299500 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/4173201126 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d22ae180 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/4173201126 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 0x5573d2294160 secure :-1 s=READY pgs=75 gs=3 cs=0 l=1 c_cookie=5232229044307123460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb99407fba0 tx=0x7fb9940f8070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=489c9c9821685d04 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb96effd640 1 -- 10.20.193.4:0/4173201126 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9940810a0 con 0x5573d2299500 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb96effd640 1 -- 10.20.193.4:0/4173201126 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5573d1eaa4a0 con 0x5573d2299500 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb96effd640 1 -- 10.20.193.4:0/4173201126 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb994039ca0 con 0x5573d2299500 2026-02-24T09:12:06.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9ab332e00 1 -- 10.20.193.4:0/4173201126 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 msgr2=0x5573d2294160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/4173201126 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 0x5573d2294160 secure :-1 s=READY pgs=75 gs=3 cs=0 l=1 c_cookie=5232229044307123460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb99407fba0 tx=0x7fb9940f8070 comp rx=0 tx=0).stop 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9ab332e00 1 -- 10.20.193.4:0/4173201126 shutdown_connections 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/4173201126 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 0x5573d2294160 unknown :-1 s=CLOSED pgs=75 gs=3 cs=0 l=1 c_cookie=5232229044307123460 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/4173201126 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2254860 0x5573d22ae6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/4173201126 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2253f50 0x5573d22ae180 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9ab332e00 1 -- 10.20.193.4:0/4173201126 >> 10.20.193.4:0/4173201126 conn(0x5573d2172db0 msgr2=0x5573d2297780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9ab332e00 1 -- 10.20.193.4:0/4173201126 shutdown_connections 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.459+0000 7fb9ab332e00 1 -- 10.20.193.4:0/4173201126 wait complete. 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.460+0000 7fb9ab332e00 1 -- start start 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.460+0000 7fb9ab332e00 1 Processor -- start 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.460+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2253f50 0x5573d2237550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.460+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2254860 0x5573d2237a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.460+0000 7fb9ab332e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 0x5573d2233360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.460+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5573d21589a0 con 0x5573d2254860 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.460+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5573d22338a0 con 0x5573d2299500 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.460+0000 7fb9ab332e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5573d2233a60 con 0x5573d2253f50 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a27fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2254860 0x5573d2237a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a27fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2254860 0x5573d2237a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47338/0 (socket says 10.20.193.4:47338) 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a27fc640 1 -- 10.20.193.4:0/3852577003 learned_addr learned my addr 10.20.193.4:0/3852577003 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a37fe640 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 0x5573d2233360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2253f50 0x5573d2237550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a27fc640 1 -- 10.20.193.4:0/3852577003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2253f50 msgr2=0x5573d2237550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a27fc640 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2253f50 0x5573d2237550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a27fc640 1 -- 10.20.193.4:0/3852577003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 msgr2=0x5573d2233360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a27fc640 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 0x5573d2233360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a27fc640 1 -- 10.20.193.4:0/3852577003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d20f0710 con 0x5573d2254860 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9a27fc640 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2254860 0x5573d2237a90 secure :-1 s=READY pgs=647 gs=1 cs=0 l=1 c_cookie=7409911297742132734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9a40fc1c0 tx=0x7fb98c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d54b10df12d5fe server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb96cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb96cff9640 1 -- 10.20.193.4:0/3852577003 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb98c011660 con 0x5573d2254860 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3852577003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d2106340 con 0x5573d2254860 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9ab332e00 10 client.16170 _ll_register_callbacks cb 0x5573d2105080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3852577003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb998015070 con 0x5573d2254860 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb96cff9640 1 -- 10.20.193.4:0/3852577003 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb98c018040 con 0x5573d2254860 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb96cff9640 1 -- 10.20.193.4:0/3852577003 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb98c01cd10 con 0x5573d2254860 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb96cff9640 1 -- 10.20.193.4:0/3852577003 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb98c010430 con 0x5573d2254860 2026-02-24T09:12:06.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb96cff9640 1 -- 10.20.193.4:0/3852577003 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb98c01cea0 con 0x5573d2254860 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9ab332e00 10 client.16170 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.461+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3852577003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5573d20ded00 con 0x5573d2254860 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.462+0000 7fb96cff9640 1 -- 10.20.193.4:0/3852577003 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb98c01c3f0 con 0x5573d2254860 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.462+0000 7fb9ab332e00 10 client.16170 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.462+0000 7fb9ab332e00 10 client.16170 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.462+0000 7fb9ab332e00 20 client.16170 populate_metadata read hostname 'trial004' 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.462+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5573d2346980 0x5573d2366e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.462+0000 7fb9ab332e00 4 client.16170 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.462+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3852577003 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5573d1e8f160 con 0x5573d2346980 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.462+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5573d2346980 0x5573d2366e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.462+0000 7fb9a2ffd640 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5573d2346980 0x5573d2366e00 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=14505186344782235523 s_cookie=3546648843302670683 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c94cc620f9978783 server_cookie=31383a55001b115b in_seq=0 out_seq=0 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.462+0000 7fb96cff9640 10 client.16170 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:06.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb96cff9640 1 -- 10.20.193.4:0/3852577003 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5573d1e8f160 con 0x5573d2346980 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb96cff9640 10 client.16170 handle_command_reply: tid=0 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 client.16170 shutdown 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3852577003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2254860 msgr2=0x5573d2237a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2254860 0x5573d2237a90 secure :-1 s=READY pgs=647 gs=1 cs=0 l=1 c_cookie=7409911297742132734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9a40fc1c0 tx=0x7fb98c00bed0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3852577003 shutdown_connections 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5573d2346980 0x5573d2366e00 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=14505186344782235523 s_cookie=3546648843302670683 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5573d2299500 0x5573d2233360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5573d2254860 0x5573d2237a90 unknown :-1 s=CLOSED pgs=647 gs=1 cs=0 l=1 c_cookie=7409911297742132734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 --2- 10.20.193.4:0/3852577003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5573d2253f50 0x5573d2237550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3852577003 >> 10.20.193.4:0/3852577003 conn(0x5573d2172db0 msgr2=0x5573d22ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb96cff9640 0 client.16170 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:06.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3852577003 shutdown_connections 2026-02-24T09:12:06.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 1 -- 10.20.193.4:0/3852577003 wait complete. 2026-02-24T09:12:06.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9ab332e00 20 client.16170 trim_cache size 0 max 16384 2026-02-24T09:12:06.474 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:12:06.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9a9338640 1 -- 10.20.193.4:0/1623138608 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9780b5750 msgr2=0x7fb9780d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9a9338640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9780b5750 0x7fb9780d5c00 secure :-1 s=READY pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb998004740 tx=0x7fb99800b410 comp rx=0 tx=0).stop 2026-02-24T09:12:06.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9a9338640 1 -- 10.20.193.4:0/1623138608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9a4115840 msgr2=0x7fb9a40f5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.463+0000 7fb9a9338640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9a4115840 0x7fb9a40f5f20 secure :-1 s=READY pgs=644 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb99400a330 tx=0x7fb9940039b0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.464+0000 7fb9a9338640 1 -- 10.20.193.4:0/1623138608 shutdown_connections 2026-02-24T09:12:06.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.464+0000 7fb9a9338640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9780b5750 0x7fb9780d5c00 unknown :-1 s=CLOSED pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.464+0000 7fb9a9338640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9a4115840 0x7fb9a40f5f20 unknown :-1 s=CLOSED pgs=644 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.464+0000 7fb9a9338640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9a4110040 0x7fb9a4176110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.464+0000 7fb9a9338640 1 --2- 10.20.193.4:0/1623138608 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9a410f650 0x7fb9a40f5820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.464+0000 7fb9a9338640 1 -- 10.20.193.4:0/1623138608 >> 10.20.193.4:0/1623138608 conn(0x7fb9a40ecf20 msgr2=0x7fb9a4111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.464+0000 7fb9a9338640 1 -- 10.20.193.4:0/1623138608 shutdown_connections 2026-02-24T09:12:06.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.464+0000 7fb9a9338640 1 -- 10.20.193.4:0/1623138608 wait complete. 2026-02-24T09:12:06.581 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:12:06.783 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:06.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.936+0000 7fa2d498f640 1 -- 10.20.193.4:0/1201513227 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2cc115840 msgr2=0x7fa2cc176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.936+0000 7fa2d498f640 1 --2- 10.20.193.4:0/1201513227 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2cc115840 0x7fa2cc176210 secure :-1 s=READY pgs=648 gs=1 cs=0 l=1 c_cookie=7987958914635090799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c000aa30 tx=0x7fa2c0030280 comp rx=0 tx=0).stop 2026-02-24T09:12:06.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.936+0000 7fa2d498f640 1 -- 10.20.193.4:0/1201513227 shutdown_connections 2026-02-24T09:12:06.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.936+0000 7fa2d498f640 1 --2- 10.20.193.4:0/1201513227 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2cc115840 0x7fa2cc176210 unknown :-1 s=CLOSED pgs=648 gs=1 cs=0 l=1 c_cookie=7987958914635090799 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.936+0000 7fa2d498f640 1 --2- 10.20.193.4:0/1201513227 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2cc110040 0x7fa2cc115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.936+0000 7fa2d498f640 1 --2- 10.20.193.4:0/1201513227 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2cc10f650 0x7fa2cc10fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.936+0000 7fa2d498f640 1 -- 10.20.193.4:0/1201513227 >> 10.20.193.4:0/1201513227 conn(0x7fa2cc0ecf20 msgr2=0x7fa2cc10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.936+0000 7fa2d498f640 1 -- 10.20.193.4:0/1201513227 shutdown_connections 2026-02-24T09:12:06.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.936+0000 7fa2d498f640 1 -- 10.20.193.4:0/1201513227 wait complete. 2026-02-24T09:12:06.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d498f640 1 Processor -- start 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d498f640 1 -- start start 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d498f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2cc10f650 0x7fa2cc11dec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d498f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2cc110040 0x7fa2cc11e400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d498f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2cc115840 0x7fa2cc1237d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d498f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc123df0 con 0x7fa2cc10f650 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d498f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc123f60 con 0x7fa2cc115840 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d498f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc124120 con 0x7fa2cc110040 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d2704640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2cc10f650 0x7fa2cc11dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d2704640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2cc10f650 0x7fa2cc11dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47360/0 (socket says 10.20.193.4:47360) 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d2704640 1 -- 10.20.193.4:0/2547044260 learned_addr learned my addr 10.20.193.4:0/2547044260 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:06.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d1f03640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2cc110040 0x7fa2cc11e400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.937+0000 7fa2d2f05640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2cc115840 0x7fa2cc1237d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2d2704640 1 -- 10.20.193.4:0/2547044260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2cc110040 msgr2=0x7fa2cc11e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2d2704640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2cc110040 0x7fa2cc11e400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2d2704640 1 -- 10.20.193.4:0/2547044260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2cc115840 msgr2=0x7fa2cc1237d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2d2704640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2cc115840 0x7fa2cc1237d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2d2704640 1 -- 10.20.193.4:0/2547044260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c000a650 con 0x7fa2cc10f650 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2d2704640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2cc10f650 0x7fa2cc11dec0 secure :-1 s=READY pgs=649 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c4009480 tx=0x7fa2c400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2b77fe640 1 -- 10.20.193.4:0/2547044260 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c400cd40 con 0x7fa2cc10f650 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2d498f640 1 -- 10.20.193.4:0/2547044260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2cc124400 con 0x7fa2cc10f650 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2b77fe640 1 -- 10.20.193.4:0/2547044260 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa2c4004d30 con 0x7fa2cc10f650 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2b77fe640 1 -- 10.20.193.4:0/2547044260 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c40106b0 con 0x7fa2cc10f650 2026-02-24T09:12:06.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.938+0000 7fa2d498f640 1 -- 10.20.193.4:0/2547044260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2cc0632a0 con 0x7fa2cc10f650 2026-02-24T09:12:06.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.944+0000 7fa2b77fe640 1 -- 10.20.193.4:0/2547044260 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fa2c401f060 con 0x7fa2cc10f650 2026-02-24T09:12:06.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.945+0000 7fa2b77fe640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa2a80b56e0 0x7fa2a80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.945+0000 7fa2b77fe640 1 -- 10.20.193.4:0/2547044260 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa2c4014070 con 0x7fa2cc10f650 2026-02-24T09:12:06.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.945+0000 7fa2d1f03640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa2a80b56e0 0x7fa2a80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.946+0000 7fa2d1f03640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa2a80b56e0 0x7fa2a80d5b90 secure :-1 s=READY pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2cc124860 tx=0x7fa2b8004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d6989e00 1 Processor -- start 2026-02-24T09:12:06.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d6989e00 1 -- start start 2026-02-24T09:12:06.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x5600951c8320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x56009520cfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 0x56009522d8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5600950d8ee0 con 0x5600951c7f50 2026-02-24T09:12:06.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5600950d4c10 con 0x56009520d500 2026-02-24T09:12:06.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5600950ced70 con 0x5600951c8860 2026-02-24T09:12:06.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d2704640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x5600951c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d2704640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x5600951c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47376/0 (socket says 10.20.193.4:47376) 2026-02-24T09:12:06.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.950+0000 7fa2d2704640 1 -- 10.20.193.4:0/1525983731 learned_addr learned my addr 10.20.193.4:0/1525983731 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:06.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.951+0000 7fa2d2f05640 1 --2- 10.20.193.4:0/1525983731 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 0x56009522d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.951+0000 7fa2d2704640 1 -- 10.20.193.4:0/1525983731 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 msgr2=0x56009520cfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:12:06.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.951+0000 7fa2d2704640 1 --2- 10.20.193.4:0/1525983731 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x56009520cfc0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.951+0000 7fa2d2704640 1 -- 10.20.193.4:0/1525983731 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 msgr2=0x56009522d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.951+0000 7fa2d2704640 1 --2- 10.20.193.4:0/1525983731 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 0x56009522d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.951+0000 7fa2d2704640 1 -- 10.20.193.4:0/1525983731 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009507a340 con 0x5600951c7f50 2026-02-24T09:12:06.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.951+0000 7fa2d2704640 1 --2- 10.20.193.4:0/1525983731 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x5600951c8320 secure :-1 s=READY pgs=650 gs=1 cs=0 l=1 c_cookie=8378127652574818846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c40e59d0 tx=0x7fa2c40054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744516b5f699721e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.951+0000 7fa2b4cf3640 1 -- 10.20.193.4:0/1525983731 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c40adb90 con 0x5600951c7f50 2026-02-24T09:12:06.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.951+0000 7fa2b4cf3640 1 -- 10.20.193.4:0/1525983731 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa2c4071070 con 0x5600951c7f50 2026-02-24T09:12:06.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.951+0000 7fa2b4cf3640 1 -- 10.20.193.4:0/1525983731 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c40aee40 con 0x5600951c7f50 2026-02-24T09:12:06.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.952+0000 7fa2d6989e00 1 -- 10.20.193.4:0/1525983731 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 msgr2=0x5600951c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.952+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/1525983731 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x5600951c8320 secure :-1 s=READY pgs=650 gs=1 cs=0 l=1 c_cookie=8378127652574818846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c40e59d0 tx=0x7fa2c40054e0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.952+0000 7fa2d6989e00 1 -- 10.20.193.4:0/1525983731 shutdown_connections 2026-02-24T09:12:06.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.952+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/1525983731 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 0x56009522d8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.952+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/1525983731 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x56009520cfc0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.952+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/1525983731 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x5600951c8320 unknown :-1 s=CLOSED pgs=650 gs=1 cs=0 l=1 c_cookie=8378127652574818846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.952+0000 7fa2d6989e00 1 -- 10.20.193.4:0/1525983731 >> 10.20.193.4:0/1525983731 conn(0x5600950e6db0 msgr2=0x5600951c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.952+0000 7fa2d6989e00 1 -- 10.20.193.4:0/1525983731 shutdown_connections 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.952+0000 7fa2d6989e00 1 -- 10.20.193.4:0/1525983731 wait complete. 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.953+0000 7fa2d6989e00 1 -- start start 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d6989e00 1 Processor -- start 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095224bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x560095225110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 0x56009522a100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56009522a640 con 0x5600951c7f50 2026-02-24T09:12:06.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56009522a7b0 con 0x56009520d500 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56009522a970 con 0x5600951c8860 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d2704640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095224bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d2704640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095224bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47386/0 (socket says 10.20.193.4:47386) 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d2704640 1 -- 10.20.193.4:0/366319251 learned_addr learned my addr 10.20.193.4:0/366319251 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d1f03640 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x560095225110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d2f05640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 0x56009522a100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d2704640 1 -- 10.20.193.4:0/366319251 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 msgr2=0x560095225110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d2704640 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x560095225110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d2704640 1 -- 10.20.193.4:0/366319251 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 msgr2=0x56009522a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d2704640 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 0x56009522a100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d2704640 1 -- 10.20.193.4:0/366319251 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600950529d0 con 0x5600951c7f50 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.954+0000 7fa2d2f05640 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 0x56009522a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:06.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa2d2704640 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095224bd0 secure :-1 s=READY pgs=651 gs=1 cs=0 l=1 c_cookie=4259055130990856208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c400c6a0 tx=0x7fa2c40aa650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1b34138183c810 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa27ffff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa27ffff640 1 -- 10.20.193.4:0/366319251 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c40adb90 con 0x5600951c7f50 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa2d6989e00 1 -- 10.20.193.4:0/366319251 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c40d1e70 con 0x5600951c7f50 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa27ffff640 1 -- 10.20.193.4:0/366319251 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa2c40b64b0 con 0x5600951c7f50 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa27ffff640 1 -- 10.20.193.4:0/366319251 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c40735a0 con 0x5600951c7f50 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa2d6989e00 10 client.16182 _ll_register_callbacks cb 0x560095079080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa2d6989e00 1 -- 10.20.193.4:0/366319251 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560094e1e4a0 con 0x5600951c7f50 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa27ffff640 1 -- 10.20.193.4:0/366319251 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa2c40ac190 con 0x5600951c7f50 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa27ffff640 1 -- 10.20.193.4:0/366319251 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa2c40ac350 con 0x5600951c7f50 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa2d6989e00 10 client.16182 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:06.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.955+0000 7fa2d6989e00 1 -- 10.20.193.4:0/366319251 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x560095064710 con 0x5600951c7f50 2026-02-24T09:12:06.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.956+0000 7fa27ffff640 1 -- 10.20.193.4:0/366319251 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa2c40afba0 con 0x5600951c7f50 2026-02-24T09:12:06.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.956+0000 7fa2d6989e00 10 client.16182 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:06.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.956+0000 7fa2d6989e00 10 client.16182 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:12:06.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.956+0000 7fa2d6989e00 20 client.16182 populate_metadata read hostname 'trial004' 2026-02-24T09:12:06.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.956+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56009520a0b0 0x56009520a520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.956+0000 7fa2d6989e00 4 client.16182 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:06.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.956+0000 7fa2d6989e00 1 -- 10.20.193.4:0/366319251 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600950c47b0 con 0x56009520a0b0 2026-02-24T09:12:06.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.956+0000 7fa2d1f03640 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56009520a0b0 0x56009520a520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.957+0000 7fa2d1f03640 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56009520a0b0 0x56009520a520 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=5950638293699460942 s_cookie=4284231255915627475 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5294ea0012caff4e server_cookie=3b74a5a0e07a03d3 in_seq=0 out_seq=0 2026-02-24T09:12:06.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.957+0000 7fa27ffff640 10 client.16182 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:06.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.957+0000 7fa27ffff640 1 -- 10.20.193.4:0/366319251 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5600950c47b0 con 0x56009520a0b0 2026-02-24T09:12:06.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa27ffff640 10 client.16182 handle_command_reply: tid=0 2026-02-24T09:12:06.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 client.16182 shutdown 2026-02-24T09:12:06.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 -- 10.20.193.4:0/366319251 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 msgr2=0x560095224bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095224bd0 secure :-1 s=READY pgs=651 gs=1 cs=0 l=1 c_cookie=4259055130990856208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c400c6a0 tx=0x7fa2c40aa650 comp rx=0 tx=0).stop 2026-02-24T09:12:06.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 -- 10.20.193.4:0/366319251 shutdown_connections 2026-02-24T09:12:06.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56009520a0b0 0x56009520a520 crc :-1 s=READY pgs=29 gs=4 cs=0 l=0 c_cookie=5950638293699460942 s_cookie=4284231255915627475 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa27ffff640 0 client.16182 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:06.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520d500 0x56009522a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x560095225110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/366319251 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095224bd0 unknown :-1 s=CLOSED pgs=651 gs=1 cs=0 l=1 c_cookie=4259055130990856208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 -- 10.20.193.4:0/366319251 >> 10.20.193.4:0/366319251 conn(0x5600950e6db0 msgr2=0x5600951c6040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 -- 10.20.193.4:0/366319251 shutdown_connections 2026-02-24T09:12:06.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 1 -- 10.20.193.4:0/366319251 wait complete. 2026-02-24T09:12:06.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.958+0000 7fa2d6989e00 20 client.16182 trim_cache size 0 max 16384 2026-02-24T09:12:06.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d6989e00 1 Processor -- start 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d6989e00 1 -- start start 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c7f50 0x560095221fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5600951c8860 0x560095222500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56009520a0b0 0x5600951c7460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5600950cc9a0 con 0x56009520a0b0 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560094ea8df0 con 0x5600951c8860 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56009522aab0 con 0x5600951c7f50 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d2f05640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56009520a0b0 0x5600951c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d2704640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c7f50 0x560095221fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d2f05640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56009520a0b0 0x5600951c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47398/0 (socket says 10.20.193.4:47398) 2026-02-24T09:12:06.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d2f05640 1 -- 10.20.193.4:0/4080372780 learned_addr learned my addr 10.20.193.4:0/4080372780 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:06.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d1f03640 1 --2- 10.20.193.4:0/4080372780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5600951c8860 0x560095222500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d2f05640 1 -- 10.20.193.4:0/4080372780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c7f50 msgr2=0x560095221fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d2f05640 1 --2- 10.20.193.4:0/4080372780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c7f50 0x560095221fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d2f05640 1 -- 10.20.193.4:0/4080372780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5600951c8860 msgr2=0x560095222500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d2f05640 1 --2- 10.20.193.4:0/4080372780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5600951c8860 0x560095222500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d2f05640 1 -- 10.20.193.4:0/4080372780 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560095217440 con 0x56009520a0b0 2026-02-24T09:12:06.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.969+0000 7fa2d2f05640 1 --2- 10.20.193.4:0/4080372780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56009520a0b0 0x5600951c7460 secure :-1 s=READY pgs=652 gs=3 cs=0 l=1 c_cookie=17306726333996329360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c000a230 tx=0x7fa2c003b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02dd7e7e2bfe990 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.970+0000 7fa29a4e6640 1 -- 10.20.193.4:0/4080372780 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c0030ae0 con 0x56009520a0b0 2026-02-24T09:12:06.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.970+0000 7fa29a4e6640 1 -- 10.20.193.4:0/4080372780 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa2c003f030 con 0x56009520a0b0 2026-02-24T09:12:06.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.970+0000 7fa29a4e6640 1 -- 10.20.193.4:0/4080372780 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c0039df0 con 0x56009520a0b0 2026-02-24T09:12:06.978 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.971+0000 7fa2d6989e00 1 -- 10.20.193.4:0/4080372780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56009520a0b0 msgr2=0x5600951c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.978 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.971+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/4080372780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56009520a0b0 0x5600951c7460 secure :-1 s=READY pgs=652 gs=3 cs=0 l=1 c_cookie=17306726333996329360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c000a230 tx=0x7fa2c003b040 comp rx=0 tx=0).stop 2026-02-24T09:12:06.978 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.971+0000 7fa2d6989e00 1 -- 10.20.193.4:0/4080372780 shutdown_connections 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.971+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/4080372780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56009520a0b0 0x5600951c7460 unknown :-1 s=CLOSED pgs=652 gs=3 cs=0 l=1 c_cookie=17306726333996329360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.971+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/4080372780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5600951c8860 0x560095222500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.971+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/4080372780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c7f50 0x560095221fc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.971+0000 7fa2d6989e00 1 -- 10.20.193.4:0/4080372780 >> 10.20.193.4:0/4080372780 conn(0x5600950e6db0 msgr2=0x560095229750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.972+0000 7fa2d6989e00 1 -- 10.20.193.4:0/4080372780 shutdown_connections 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.972+0000 7fa2d6989e00 1 -- 10.20.193.4:0/4080372780 wait complete. 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.972+0000 7fa2d6989e00 1 -- start start 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.972+0000 7fa2d6989e00 1 Processor -- start 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095229a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x5600951a6030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d6989e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520a0b0 0x5600951a6570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5600951a6ab0 con 0x5600951c7f50 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5600951a6c20 con 0x56009520a0b0 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d6989e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5600951a6de0 con 0x5600951c8860 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d2704640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095229a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d2704640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095229a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47414/0 (socket says 10.20.193.4:47414) 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d2704640 1 -- 10.20.193.4:0/2234412862 learned_addr learned my addr 10.20.193.4:0/2234412862 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d2f05640 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520a0b0 0x5600951a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d1f03640 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x5600951a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d2704640 1 -- 10.20.193.4:0/2234412862 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 msgr2=0x5600951a6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d2704640 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x5600951a6030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d2704640 1 -- 10.20.193.4:0/2234412862 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520a0b0 msgr2=0x5600951a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d2704640 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520a0b0 0x5600951a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d2704640 1 -- 10.20.193.4:0/2234412862 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009505f190 con 0x5600951c7f50 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d2704640 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095229a30 secure :-1 s=READY pgs=653 gs=1 cs=0 l=1 c_cookie=10815937280147819721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c40ae190 tx=0x7fa2c4005580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9619eda6a81d8cc9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa27ffff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa27ffff640 1 -- 10.20.193.4:0/2234412862 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c4010df0 con 0x5600951c7f50 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d6989e00 1 -- 10.20.193.4:0/2234412862 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2cc176a80 con 0x5600951c7f50 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa27ffff640 1 -- 10.20.193.4:0/2234412862 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x560094e1e4a0 con 0x5600951c7f50 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa27ffff640 1 -- 10.20.193.4:0/2234412862 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c40b64b0 con 0x5600951c7f50 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d6989e00 10 client.16188 _ll_register_callbacks cb 0x560095079080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa2d6989e00 1 -- 10.20.193.4:0/2234412862 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c4071070 con 0x5600951c7f50 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.973+0000 7fa27ffff640 1 -- 10.20.193.4:0/2234412862 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa2c40b3ed0 con 0x5600951c7f50 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa27ffff640 1 -- 10.20.193.4:0/2234412862 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa2c40ad780 con 0x5600951c7f50 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa2d6989e00 10 client.16188 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa2d6989e00 1 -- 10.20.193.4:0/2234412862 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x560095052d00 con 0x5600951c7f50 2026-02-24T09:12:06.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa27ffff640 1 -- 10.20.193.4:0/2234412862 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa2c40afba0 con 0x5600951c7f50 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa2d6989e00 10 client.16188 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa2d6989e00 10 client.16188 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa2d6989e00 20 client.16188 populate_metadata read hostname 'trial004' 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56009520d500 0x5600952da850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa2d6989e00 4 client.16188 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa2d6989e00 1 -- 10.20.193.4:0/2234412862 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560094e03160 con 0x56009520d500 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa2d1f03640 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56009520d500 0x5600952da850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa27ffff640 10 client.16188 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.974+0000 7fa2d1f03640 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56009520d500 0x5600952da850 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=11078156744932207045 s_cookie=1793571305033515534 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99bd84dd6bc829c5 server_cookie=18e40b9963db420e in_seq=0 out_seq=0 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa27ffff640 1 -- 10.20.193.4:0/2234412862 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560094e03160 con 0x56009520d500 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa27ffff640 10 client.16188 handle_command_reply: tid=0 2026-02-24T09:12:06.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 client.16188 shutdown 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 -- 10.20.193.4:0/2234412862 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 msgr2=0x560095229a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095229a30 secure :-1 s=READY pgs=653 gs=1 cs=0 l=1 c_cookie=10815937280147819721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c40ae190 tx=0x7fa2c4005580 comp rx=0 tx=0).stop 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 -- 10.20.193.4:0/2234412862 shutdown_connections 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56009520d500 0x5600952da850 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=11078156744932207045 s_cookie=1793571305033515534 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56009520a0b0 0x5600951a6570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5600951c8860 0x5600951a6030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 --2- 10.20.193.4:0/2234412862 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5600951c7f50 0x560095229a30 unknown :-1 s=CLOSED pgs=653 gs=1 cs=0 l=1 c_cookie=10815937280147819721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa27ffff640 0 client.16188 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 -- 10.20.193.4:0/2234412862 >> 10.20.193.4:0/2234412862 conn(0x5600950e6db0 msgr2=0x560095220fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 -- 10.20.193.4:0/2234412862 shutdown_connections 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 1 -- 10.20.193.4:0/2234412862 wait complete. 2026-02-24T09:12:06.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.975+0000 7fa2d6989e00 20 client.16188 trim_cache size 0 max 16384 2026-02-24T09:12:06.984 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:12:06.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 -- 10.20.193.4:0/2547044260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa2a80b56e0 msgr2=0x7fa2a80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa2a80b56e0 0x7fa2a80d5b90 secure :-1 s=READY pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2cc124860 tx=0x7fa2b8004420 comp rx=0 tx=0).stop 2026-02-24T09:12:06.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 -- 10.20.193.4:0/2547044260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2cc10f650 msgr2=0x7fa2cc11dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:06.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2cc10f650 0x7fa2cc11dec0 secure :-1 s=READY pgs=649 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c4009480 tx=0x7fa2c400ee60 comp rx=0 tx=0).stop 2026-02-24T09:12:06.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 -- 10.20.193.4:0/2547044260 shutdown_connections 2026-02-24T09:12:06.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa2a80b56e0 0x7fa2a80d5b90 unknown :-1 s=CLOSED pgs=318 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa2cc115840 0x7fa2cc1237d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa2cc110040 0x7fa2cc11e400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 --2- 10.20.193.4:0/2547044260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa2cc10f650 0x7fa2cc11dec0 unknown :-1 s=CLOSED pgs=649 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:06.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 -- 10.20.193.4:0/2547044260 >> 10.20.193.4:0/2547044260 conn(0x7fa2cc0ecf20 msgr2=0x7fa2cc10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:06.986 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 -- 10.20.193.4:0/2547044260 shutdown_connections 2026-02-24T09:12:06.986 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:06.976+0000 7fa2d498f640 1 -- 10.20.193.4:0/2547044260 wait complete. 2026-02-24T09:12:07.084 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:12:07.134 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:06 trial090 ceph-mon[47278]: pgmap v221: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 237 MiB/s wr, 66 op/s 2026-02-24T09:12:07.134 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:06 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/998016309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:12:07.145 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:06 trial014 ceph-mon[46941]: pgmap v221: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 237 MiB/s wr, 66 op/s 2026-02-24T09:12:07.145 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:06 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/998016309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:12:07.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:06 trial004 ceph-mon[41596]: pgmap v221: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 237 MiB/s wr, 66 op/s 2026-02-24T09:12:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:06 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/998016309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:12:07.253 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:07.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 -- 10.20.193.4:0/981279443 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7feb7c1135c0 msgr2=0x7feb7c173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:07.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 --2- 10.20.193.4:0/981279443 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7feb7c1135c0 0x7feb7c173f90 secure :-1 s=READY pgs=654 gs=1 cs=0 l=1 c_cookie=7918566786180561206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb7000aa30 tx=0x7feb70030280 comp rx=0 tx=0).stop 2026-02-24T09:12:07.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 -- 10.20.193.4:0/981279443 shutdown_connections 2026-02-24T09:12:07.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 --2- 10.20.193.4:0/981279443 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7feb7c1135c0 0x7feb7c173f90 unknown :-1 s=CLOSED pgs=654 gs=1 cs=0 l=1 c_cookie=7918566786180561206 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 --2- 10.20.193.4:0/981279443 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb7c10ddc0 0x7feb7c112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 --2- 10.20.193.4:0/981279443 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7feb7c10d3d0 0x7feb7c10d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 -- 10.20.193.4:0/981279443 >> 10.20.193.4:0/981279443 conn(0x7feb7c0eaca0 msgr2=0x7feb7c10b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 -- 10.20.193.4:0/981279443 shutdown_connections 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 -- 10.20.193.4:0/981279443 wait complete. 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 Processor -- start 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.413+0000 7feb82349640 1 -- start start 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb82349640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7feb7c10d3d0 0x7feb7c0f4f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb82349640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb7c10ddc0 0x7feb7c173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb82349640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7feb7c1135c0 0x7feb7c0f55e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb82349640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c0fa860 con 0x7feb7c10d3d0 2026-02-24T09:12:07.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb82349640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c0fa9d0 con 0x7feb7c1135c0 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb82349640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c0fab40 con 0x7feb7c10ddc0 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7feb7c10d3d0 0x7feb7c0f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7feb7c10d3d0 0x7feb7c0f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47426/0 (socket says 10.20.193.4:47426) 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb7bfff640 1 -- 10.20.193.4:0/4012591579 learned_addr learned my addr 10.20.193.4:0/4012591579 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb808bf640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7feb7c1135c0 0x7feb7c0f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb7b7fe640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb7c10ddc0 0x7feb7c173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb7bfff640 1 -- 10.20.193.4:0/4012591579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb7c10ddc0 msgr2=0x7feb7c173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb7bfff640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb7c10ddc0 0x7feb7c173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb7bfff640 1 -- 10.20.193.4:0/4012591579 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7feb7c1135c0 msgr2=0x7feb7c0f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb7bfff640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7feb7c1135c0 0x7feb7c0f55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb7bfff640 1 -- 10.20.193.4:0/4012591579 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7000a650 con 0x7feb7c10d3d0 2026-02-24T09:12:07.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb7bfff640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7feb7c10d3d0 0x7feb7c0f4f50 secure :-1 s=READY pgs=655 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb68009480 tx=0x7feb6800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:07.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb797fa640 1 -- 10.20.193.4:0/4012591579 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb6800cd40 con 0x7feb7c10d3d0 2026-02-24T09:12:07.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb82349640 1 -- 10.20.193.4:0/4012591579 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7c0fae20 con 0x7feb7c10d3d0 2026-02-24T09:12:07.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb797fa640 1 -- 10.20.193.4:0/4012591579 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb68004d30 con 0x7feb7c10d3d0 2026-02-24T09:12:07.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb797fa640 1 -- 10.20.193.4:0/4012591579 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb680106b0 con 0x7feb7c10d3d0 2026-02-24T09:12:07.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.414+0000 7feb82349640 1 -- 10.20.193.4:0/4012591579 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7c0fb2f0 con 0x7feb7c10d3d0 2026-02-24T09:12:07.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.416+0000 7feb797fa640 1 -- 10.20.193.4:0/4012591579 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7feb6801f060 con 0x7feb7c10d3d0 2026-02-24T09:12:07.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.417+0000 7feb797fa640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7feb500b56e0 0x7feb500d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.417+0000 7feb797fa640 1 -- 10.20.193.4:0/4012591579 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7feb68014070 con 0x7feb7c10d3d0 2026-02-24T09:12:07.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.417+0000 7feb7b7fe640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7feb500b56e0 0x7feb500d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.417+0000 7feb7b7fe640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7feb500b56e0 0x7feb500d5b90 secure :-1 s=READY pgs=319 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb6c005e20 tx=0x7feb6c005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:07.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.421+0000 7feb84343e00 1 Processor -- start 2026-02-24T09:12:07.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.421+0000 7feb84343e00 1 -- start start 2026-02-24T09:12:07.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.421+0000 7feb84343e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb325f320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.421+0000 7feb84343e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32a3fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.421+0000 7feb84343e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb32a4500 0x55fdb32c48e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.421+0000 7feb84343e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fdb316fee0 con 0x55fdb325ef50 2026-02-24T09:12:07.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.421+0000 7feb84343e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fdb316bc10 con 0x55fdb32a4500 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.421+0000 7feb84343e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fdb3165d70 con 0x55fdb325f860 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb7b7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb325f320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb325f320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47428/0 (socket says 10.20.193.4:47428) 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb7bfff640 1 -- 10.20.193.4:0/1839520682 learned_addr learned my addr 10.20.193.4:0/1839520682 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb808bf640 1 --2- 10.20.193.4:0/1839520682 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb32a4500 0x55fdb32c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb7bfff640 1 -- 10.20.193.4:0/1839520682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 msgr2=0x55fdb32a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb7bfff640 1 --2- 10.20.193.4:0/1839520682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb7bfff640 1 -- 10.20.193.4:0/1839520682 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb32a4500 msgr2=0x55fdb32c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb7bfff640 1 --2- 10.20.193.4:0/1839520682 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb32a4500 0x55fdb32c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb7bfff640 1 -- 10.20.193.4:0/1839520682 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb3111340 con 0x55fdb325ef50 2026-02-24T09:12:07.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb7bfff640 1 --2- 10.20.193.4:0/1839520682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb325f320 secure :-1 s=READY pgs=656 gs=1 cs=0 l=1 c_cookie=4716239624923717279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb68005490 tx=0x7feb680a9870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417372f37f331e9f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb4cce3640 1 -- 10.20.193.4:0/1839520682 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb680ac950 con 0x55fdb325ef50 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb4cce3640 1 -- 10.20.193.4:0/1839520682 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb68016ea0 con 0x55fdb325ef50 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.422+0000 7feb4cce3640 1 -- 10.20.193.4:0/1839520682 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb680adde0 con 0x55fdb325ef50 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.423+0000 7feb84343e00 1 -- 10.20.193.4:0/1839520682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 msgr2=0x55fdb325f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.423+0000 7feb84343e00 1 --2- 10.20.193.4:0/1839520682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb325f320 secure :-1 s=READY pgs=656 gs=1 cs=0 l=1 c_cookie=4716239624923717279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb68005490 tx=0x7feb680a9870 comp rx=0 tx=0).stop 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.423+0000 7feb84343e00 1 -- 10.20.193.4:0/1839520682 shutdown_connections 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.423+0000 7feb84343e00 1 --2- 10.20.193.4:0/1839520682 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb32a4500 0x55fdb32c48e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.423+0000 7feb84343e00 1 --2- 10.20.193.4:0/1839520682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32a3fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.423+0000 7feb84343e00 1 --2- 10.20.193.4:0/1839520682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb325f320 unknown :-1 s=CLOSED pgs=656 gs=1 cs=0 l=1 c_cookie=4716239624923717279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.423+0000 7feb84343e00 1 -- 10.20.193.4:0/1839520682 >> 10.20.193.4:0/1839520682 conn(0x55fdb317ddb0 msgr2=0x55fdb325d830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:07.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.423+0000 7feb84343e00 1 -- 10.20.193.4:0/1839520682 shutdown_connections 2026-02-24T09:12:07.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.423+0000 7feb84343e00 1 -- 10.20.193.4:0/1839520682 wait complete. 2026-02-24T09:12:07.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.424+0000 7feb84343e00 1 -- start start 2026-02-24T09:12:07.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.424+0000 7feb84343e00 1 Processor -- start 2026-02-24T09:12:07.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb84343e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb32bbd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb84343e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32bc2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb84343e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb32a4500 0x55fdb32c12b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb84343e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fdb32c17f0 con 0x55fdb32a4500 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb84343e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fdb32c1960 con 0x55fdb325ef50 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb84343e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fdb32c1b20 con 0x55fdb325f860 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb7bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb32bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb7b7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb7bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb32bbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:46402/0 (socket says 10.20.193.4:46402) 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb808bf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb32a4500 0x55fdb32c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb7b7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32bc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:45518/0 (socket says 10.20.193.4:45518) 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb7bfff640 1 -- 10.20.193.4:0/2305120398 learned_addr learned my addr 10.20.193.4:0/2305120398 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb808bf640 1 -- 10.20.193.4:0/2305120398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 msgr2=0x55fdb32bc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb808bf640 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32bc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb808bf640 1 -- 10.20.193.4:0/2305120398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 msgr2=0x55fdb32bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:07.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb808bf640 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb32bbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb808bf640 1 -- 10.20.193.4:0/2305120398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb30e99d0 con 0x55fdb32a4500 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb7bfff640 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb32bbd80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb808bf640 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb32a4500 0x55fdb32c12b0 secure :-1 s=READY pgs=657 gs=1 cs=0 l=1 c_cookie=10066723582023103030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb70005900 tx=0x7feb70003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb42fc31688f236 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb3dffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb3dffb640 1 -- 10.20.193.4:0/2305120398 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb700039a0 con 0x55fdb32a4500 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb3dffb640 1 -- 10.20.193.4:0/2305120398 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb7003f050 con 0x55fdb32a4500 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb3dffb640 1 -- 10.20.193.4:0/2305120398 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb70044690 con 0x55fdb32a4500 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.425+0000 7feb84343e00 1 -- 10.20.193.4:0/2305120398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7c0fb2f0 con 0x55fdb32a4500 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb3dffb640 1 -- 10.20.193.4:0/2305120398 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7feb70005600 con 0x55fdb32a4500 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb3dffb640 10 client.16200 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb84343e00 10 client.16200 _ll_register_callbacks cb 0x55fdb3110080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:07.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb84343e00 1 -- 10.20.193.4:0/2305120398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fdb2eb54a0 con 0x55fdb32a4500 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb3dffb640 1 -- 10.20.193.4:0/2305120398 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7feb70003b00 con 0x55fdb32a4500 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb84343e00 10 client.16200 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb84343e00 1 -- 10.20.193.4:0/2305120398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55fdb30fb710 con 0x55fdb32a4500 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb3dffb640 1 -- 10.20.193.4:0/2305120398 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7feb70005040 con 0x55fdb32a4500 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb84343e00 10 client.16200 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb84343e00 10 client.16200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb84343e00 20 client.16200 populate_metadata read hostname 'trial004' 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb84343e00 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55fdb32a16c0 0x55fdb32a1b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb84343e00 4 client.16200 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.426+0000 7feb84343e00 1 -- 10.20.193.4:0/2305120398 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdb315b7b0 con 0x55fdb32a16c0 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.427+0000 7feb7bfff640 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55fdb32a16c0 0x55fdb32a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb7bfff640 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55fdb32a16c0 0x55fdb32a1b60 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=4224622707877979845 s_cookie=16479327618351747656 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aa0dff8451da6c5 server_cookie=e4b255285d23d248 in_seq=0 out_seq=0 2026-02-24T09:12:07.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb3dffb640 10 client.16200 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb3dffb640 1 -- 10.20.193.4:0/2305120398 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55fdb315b7b0 con 0x55fdb32a16c0 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb3dffb640 10 client.16200 handle_command_reply: tid=0 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 client.16200 shutdown 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 -- 10.20.193.4:0/2305120398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb32a4500 msgr2=0x55fdb32c12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb32a4500 0x55fdb32c12b0 secure :-1 s=READY pgs=657 gs=1 cs=0 l=1 c_cookie=10066723582023103030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb70005900 tx=0x7feb70003f90 comp rx=0 tx=0).stop 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 -- 10.20.193.4:0/2305120398 shutdown_connections 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55fdb32a16c0 0x55fdb32a1b60 crc :-1 s=READY pgs=71 gs=4 cs=0 l=0 c_cookie=4224622707877979845 s_cookie=16479327618351747656 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb32a4500 0x55fdb32c12b0 unknown :-1 s=CLOSED pgs=657 gs=1 cs=0 l=1 c_cookie=10066723582023103030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32bc2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb3dffb640 0 client.16200 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 --2- 10.20.193.4:0/2305120398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb32bbd80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 -- 10.20.193.4:0/2305120398 >> 10.20.193.4:0/2305120398 conn(0x55fdb317ddb0 msgr2=0x55fdb325d040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:07.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 -- 10.20.193.4:0/2305120398 shutdown_connections 2026-02-24T09:12:07.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 1 -- 10.20.193.4:0/2305120398 wait complete. 2026-02-24T09:12:07.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.428+0000 7feb84343e00 20 client.16200 trim_cache size 0 max 16384 2026-02-24T09:12:07.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.436+0000 7feb84343e00 1 Processor -- start 2026-02-24T09:12:07.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb84343e00 1 -- start start 2026-02-24T09:12:07.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb84343e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb32a3230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb84343e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32a3770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb84343e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb32a16c0 0x55fdb32a3cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb84343e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fdb31639a0 con 0x55fdb325ef50 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb84343e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fdb2f3fdf0 con 0x55fdb32a16c0 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb84343e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fdb32a95a0 con 0x55fdb325f860 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb32a3230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb32a3230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47448/0 (socket says 10.20.193.4:47448) 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7bfff640 1 -- 10.20.193.4:0/967782227 learned_addr learned my addr 10.20.193.4:0/967782227 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb808bf640 1 --2- 10.20.193.4:0/967782227 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb32a16c0 0x55fdb32a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7bfff640 1 -- 10.20.193.4:0/967782227 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 msgr2=0x55fdb32a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7b7fe640 1 --2- 10.20.193.4:0/967782227 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7bfff640 1 --2- 10.20.193.4:0/967782227 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32a3770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7bfff640 1 -- 10.20.193.4:0/967782227 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb32a16c0 msgr2=0x55fdb32a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7bfff640 1 --2- 10.20.193.4:0/967782227 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb32a16c0 0x55fdb32a3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7bfff640 1 -- 10.20.193.4:0/967782227 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb32ae3e0 con 0x55fdb325ef50 2026-02-24T09:12:07.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7b7fe640 1 --2- 10.20.193.4:0/967782227 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32a3770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:07.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb7bfff640 1 --2- 10.20.193.4:0/967782227 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb32a3230 secure :-1 s=READY pgs=658 gs=1 cs=0 l=1 c_cookie=16607725003984131336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb680af3e0 tx=0x7feb680b1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67a7de64dd8d508 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:07.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb3ffff640 1 -- 10.20.193.4:0/967782227 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb680b2ef0 con 0x55fdb325ef50 2026-02-24T09:12:07.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb3ffff640 1 -- 10.20.193.4:0/967782227 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb680b5450 con 0x55fdb325ef50 2026-02-24T09:12:07.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.437+0000 7feb3ffff640 1 -- 10.20.193.4:0/967782227 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb680adde0 con 0x55fdb325ef50 2026-02-24T09:12:07.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.438+0000 7feb84343e00 1 -- 10.20.193.4:0/967782227 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 msgr2=0x55fdb32a3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:07.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.438+0000 7feb84343e00 1 --2- 10.20.193.4:0/967782227 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb32a3230 secure :-1 s=READY pgs=658 gs=1 cs=0 l=1 c_cookie=16607725003984131336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb680af3e0 tx=0x7feb680b1040 comp rx=0 tx=0).stop 2026-02-24T09:12:07.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.438+0000 7feb84343e00 1 -- 10.20.193.4:0/967782227 shutdown_connections 2026-02-24T09:12:07.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.438+0000 7feb84343e00 1 --2- 10.20.193.4:0/967782227 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb32a16c0 0x55fdb32a3cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.438+0000 7feb84343e00 1 --2- 10.20.193.4:0/967782227 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb325f860 0x55fdb32a3770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.438+0000 7feb84343e00 1 --2- 10.20.193.4:0/967782227 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325ef50 0x55fdb32a3230 unknown :-1 s=CLOSED pgs=658 gs=1 cs=0 l=1 c_cookie=16607725003984131336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.438+0000 7feb84343e00 1 -- 10.20.193.4:0/967782227 >> 10.20.193.4:0/967782227 conn(0x55fdb317ddb0 msgr2=0x55fdb325d450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.438+0000 7feb84343e00 1 -- 10.20.193.4:0/967782227 shutdown_connections 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.438+0000 7feb84343e00 1 -- 10.20.193.4:0/967782227 wait complete. 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.439+0000 7feb84343e00 1 -- start start 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.439+0000 7feb84343e00 1 Processor -- start 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.439+0000 7feb84343e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb323e6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.439+0000 7feb84343e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325f860 0x55fdb323ebe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.439+0000 7feb84343e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb32a16c0 0x55fdb323f120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb84343e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fdb330a1d0 con 0x55fdb325f860 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb84343e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fdb330a340 con 0x55fdb325ef50 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb84343e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fdb330a500 con 0x55fdb32a16c0 2026-02-24T09:12:07.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb7bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb323e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb7bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb323e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:46418/0 (socket says 10.20.193.4:46418) 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb7bfff640 1 -- 10.20.193.4:0/3584010998 learned_addr learned my addr 10.20.193.4:0/3584010998 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb808bf640 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb32a16c0 0x55fdb323f120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb7bfff640 1 -- 10.20.193.4:0/3584010998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb32a16c0 msgr2=0x55fdb323f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb7bfff640 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb32a16c0 0x55fdb323f120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb7bfff640 1 -- 10.20.193.4:0/3584010998 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325f860 msgr2=0x55fdb323ebe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb7bfff640 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325f860 0x55fdb323ebe0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb7bfff640 1 -- 10.20.193.4:0/3584010998 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb30f6190 con 0x55fdb325ef50 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb7bfff640 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb323e6a0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=15642810068170574645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb680af3e0 tx=0x7feb680a9870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9166ce0ba360b35 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb3dffb640 10 client.0 ms_handle_connect on v2:10.20.193.14:3300/0 2026-02-24T09:12:07.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb3dffb640 1 -- 10.20.193.4:0/3584010998 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb680adde0 con 0x55fdb325ef50 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb84343e00 1 -- 10.20.193.4:0/3584010998 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb3111340 con 0x55fdb325ef50 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb3dffb640 1 -- 10.20.193.4:0/3584010998 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb680b8290 con 0x55fdb325ef50 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb3dffb640 1 -- 10.20.193.4:0/3584010998 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb68072560 con 0x55fdb325ef50 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb84343e00 10 client.25694 _ll_register_callbacks cb 0x55fdb3110080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb84343e00 1 -- 10.20.193.4:0/3584010998 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb68016ea0 con 0x55fdb325ef50 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.440+0000 7feb3dffb640 1 -- 10.20.193.4:0/3584010998 <== mon.2 v2:10.20.193.14:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7feb680ab130 con 0x55fdb325ef50 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb3dffb640 1 -- 10.20.193.4:0/3584010998 <== mon.2 v2:10.20.193.14:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7feb680ab410 con 0x55fdb325ef50 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb84343e00 10 client.25694 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb84343e00 1 -- 10.20.193.4:0/3584010998 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55fdb30e9d00 con 0x55fdb325ef50 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb3dffb640 1 -- 10.20.193.4:0/3584010998 <== mon.2 v2:10.20.193.14:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7feb680aeb40 con 0x55fdb325ef50 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb84343e00 10 client.25694 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:07.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb84343e00 10 client.25694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb84343e00 20 client.25694 populate_metadata read hostname 'trial004' 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb84343e00 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55fdb32a4500 0x55fdb3371ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb84343e00 4 client.25694 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb84343e00 1 -- 10.20.193.4:0/3584010998 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fdb2e9a160 con 0x55fdb32a4500 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb7b7fe640 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55fdb32a4500 0x55fdb3371ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb7b7fe640 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55fdb32a4500 0x55fdb3371ff0 crc :-1 s=READY pgs=72 gs=3 cs=0 l=0 c_cookie=12350347968502358318 s_cookie=10140190158792360707 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab65400adb0ce12e server_cookie=8cb9313971bb0303 in_seq=0 out_seq=0 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.441+0000 7feb3dffb640 10 client.25694 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb3dffb640 1 -- 10.20.193.4:0/3584010998 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fdb2e9a160 con 0x55fdb32a4500 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb3dffb640 10 client.25694 handle_command_reply: tid=0 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 client.25694 shutdown 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 -- 10.20.193.4:0/3584010998 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 msgr2=0x55fdb323e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:07.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb323e6a0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=15642810068170574645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb680af3e0 tx=0x7feb680a9870 comp rx=0 tx=0).stop 2026-02-24T09:12:07.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 -- 10.20.193.4:0/3584010998 shutdown_connections 2026-02-24T09:12:07.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55fdb32a4500 0x55fdb3371ff0 crc :-1 s=READY pgs=72 gs=3 cs=0 l=0 c_cookie=12350347968502358318 s_cookie=10140190158792360707 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fdb32a16c0 0x55fdb323f120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fdb325f860 0x55fdb323ebe0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 --2- 10.20.193.4:0/3584010998 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fdb325ef50 0x55fdb323e6a0 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=15642810068170574645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb3dffb640 0 client.25694 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:07.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 -- 10.20.193.4:0/3584010998 >> 10.20.193.4:0/3584010998 conn(0x55fdb317ddb0 msgr2=0x55fdb325dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:07.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 -- 10.20.193.4:0/3584010998 shutdown_connections 2026-02-24T09:12:07.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 1 -- 10.20.193.4:0/3584010998 wait complete. 2026-02-24T09:12:07.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb84343e00 20 client.25694 trim_cache size 0 max 16384 2026-02-24T09:12:07.452 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb82349640 1 -- 10.20.193.4:0/4012591579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7feb500b56e0 msgr2=0x7feb500d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb82349640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7feb500b56e0 0x7feb500d5b90 secure :-1 s=READY pgs=319 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb6c005e20 tx=0x7feb6c005db0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb82349640 1 -- 10.20.193.4:0/4012591579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7feb7c10d3d0 msgr2=0x7feb7c0f4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.442+0000 7feb82349640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7feb7c10d3d0 0x7feb7c0f4f50 secure :-1 s=READY pgs=655 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb68009480 tx=0x7feb6800ee60 comp rx=0 tx=0).stop 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.443+0000 7feb82349640 1 -- 10.20.193.4:0/4012591579 shutdown_connections 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.443+0000 7feb82349640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7feb500b56e0 0x7feb500d5b90 unknown :-1 s=CLOSED pgs=319 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.443+0000 7feb82349640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7feb7c1135c0 0x7feb7c0f55e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.443+0000 7feb82349640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb7c10ddc0 0x7feb7c173e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.443+0000 7feb82349640 1 --2- 10.20.193.4:0/4012591579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7feb7c10d3d0 0x7feb7c0f4f50 unknown :-1 s=CLOSED pgs=655 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.443+0000 7feb82349640 1 -- 10.20.193.4:0/4012591579 >> 10.20.193.4:0/4012591579 conn(0x7feb7c0eaca0 msgr2=0x7feb7c10eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:07.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.443+0000 7feb82349640 1 -- 10.20.193.4:0/4012591579 shutdown_connections 2026-02-24T09:12:07.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:07.443+0000 7feb82349640 1 -- 10.20.193.4:0/4012591579 wait complete. 2026-02-24T09:12:08.522 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:12:08.522 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:12:08.724 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:08.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 -- 10.20.193.4:0/986471840 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33941124f0 msgr2=0x7f3394172ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:08.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 --2- 10.20.193.4:0/986471840 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33941124f0 0x7f3394172ec0 secure :-1 s=READY pgs=659 gs=1 cs=0 l=1 c_cookie=8551126603968326084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f339000aa30 tx=0x7f3390030280 comp rx=0 tx=0).stop 2026-02-24T09:12:08.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 -- 10.20.193.4:0/986471840 shutdown_connections 2026-02-24T09:12:08.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 --2- 10.20.193.4:0/986471840 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33941124f0 0x7f3394172ec0 unknown :-1 s=CLOSED pgs=659 gs=1 cs=0 l=1 c_cookie=8551126603968326084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 --2- 10.20.193.4:0/986471840 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f339410ccf0 0x7f3394111d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 --2- 10.20.193.4:0/986471840 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f339410c300 0x7f339410c6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 -- 10.20.193.4:0/986471840 >> 10.20.193.4:0/986471840 conn(0x7f33940e9bf0 msgr2=0x7f339410a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:08.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 -- 10.20.193.4:0/986471840 shutdown_connections 2026-02-24T09:12:08.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 -- 10.20.193.4:0/986471840 wait complete. 2026-02-24T09:12:08.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 Processor -- start 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.921+0000 7f339baa9640 1 -- start start 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339baa9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f339410c300 0x7f3394174a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339baa9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f339410ccf0 0x7f3394172dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339baa9640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33941124f0 0x7f3394174f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339baa9640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f33941754c0 con 0x7f339410ccf0 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339baa9640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3394175630 con 0x7f33941124f0 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339baa9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f33941757f0 con 0x7f339410c300 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339981e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f339410c300 0x7f3394174a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339981e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f339410c300 0x7f3394174a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:45544/0 (socket says 10.20.193.4:45544) 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339981e640 1 -- 10.20.193.4:0/2550928659 learned_addr learned my addr 10.20.193.4:0/2550928659 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339a01f640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33941124f0 0x7f3394174f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339901d640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f339410ccf0 0x7f3394172dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339901d640 1 -- 10.20.193.4:0/2550928659 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f339410c300 msgr2=0x7f3394174a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339901d640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f339410c300 0x7f3394174a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339901d640 1 -- 10.20.193.4:0/2550928659 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33941124f0 msgr2=0x7f3394174f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339901d640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33941124f0 0x7f3394174f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339901d640 1 -- 10.20.193.4:0/2550928659 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339000a650 con 0x7f339410ccf0 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339981e640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f339410c300 0x7f3394174a40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f339901d640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f339410ccf0 0x7f3394172dc0 secure :-1 s=READY pgs=660 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f338800d700 tx=0x7f338800dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.922+0000 7f3382ffd640 1 -- 10.20.193.4:0/2550928659 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3388004500 con 0x7f339410ccf0 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.923+0000 7f339baa9640 1 -- 10.20.193.4:0/2550928659 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33940fa940 con 0x7f339410ccf0 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.923+0000 7f339baa9640 1 -- 10.20.193.4:0/2550928659 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33940fae10 con 0x7f339410ccf0 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.924+0000 7f3382ffd640 1 -- 10.20.193.4:0/2550928659 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f338800de30 con 0x7f339410ccf0 2026-02-24T09:12:08.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.924+0000 7f3382ffd640 1 -- 10.20.193.4:0/2550928659 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f33880052a0 con 0x7f339410ccf0 2026-02-24T09:12:08.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.927+0000 7f3382ffd640 1 -- 10.20.193.4:0/2550928659 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f3388005430 con 0x7f339410ccf0 2026-02-24T09:12:08.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.929+0000 7f3382ffd640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33640b56d0 0x7f33640d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.929+0000 7f3382ffd640 1 -- 10.20.193.4:0/2550928659 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f33880e66c0 con 0x7f339410ccf0 2026-02-24T09:12:08.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.929+0000 7f339981e640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33640b56d0 0x7f33640d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.930+0000 7f339981e640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33640b56d0 0x7f33640d5b80 secure :-1 s=READY pgs=320 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33840095d0 tx=0x7f3384005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:08.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.931+0000 7f339daa3e00 1 Processor -- start 2026-02-24T09:12:08.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.931+0000 7f339daa3e00 1 -- start start 2026-02-24T09:12:08.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91300 0x563f66c916d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91c10 0x563f66cd6370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66cd68b0 0x563f66cf6c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339daa3e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563f66ba1520 con 0x563f66cd68b0 2026-02-24T09:12:08.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339daa3e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563f66b9d250 con 0x563f66c91300 2026-02-24T09:12:08.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339daa3e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563f66b973b0 con 0x563f66c91c10 2026-02-24T09:12:08.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339a01f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66cd68b0 0x563f66cf6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339901d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91c10 0x563f66cd6370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339a01f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66cd68b0 0x563f66cf6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47478/0 (socket says 10.20.193.4:47478) 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339a01f640 1 -- 10.20.193.4:0/3289998253 learned_addr learned my addr 10.20.193.4:0/3289998253 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339981e640 1 --2- 10.20.193.4:0/3289998253 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91300 0x563f66c916d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339981e640 1 -- 10.20.193.4:0/3289998253 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91c10 msgr2=0x563f66cd6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339981e640 1 --2- 10.20.193.4:0/3289998253 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91c10 0x563f66cd6370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339981e640 1 -- 10.20.193.4:0/3289998253 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66cd68b0 msgr2=0x563f66cf6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339981e640 1 --2- 10.20.193.4:0/3289998253 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66cd68b0 0x563f66cf6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339981e640 1 -- 10.20.193.4:0/3289998253 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f66b426e0 con 0x563f66c91300 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f339981e640 1 --2- 10.20.193.4:0/3289998253 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91300 0x563f66c916d0 secure :-1 s=READY pgs=77 gs=3 cs=0 l=1 c_cookie=7964353890304332903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3384011560 tx=0x7f3384014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e8711aa91171467 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f33724e6640 1 -- 10.20.193.4:0/3289998253 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3384004850 con 0x563f66c91300 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f33724e6640 1 -- 10.20.193.4:0/3289998253 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3384004e90 con 0x563f66c91300 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.932+0000 7f33724e6640 1 -- 10.20.193.4:0/3289998253 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f338401a930 con 0x563f66c91300 2026-02-24T09:12:08.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.933+0000 7f339daa3e00 1 -- 10.20.193.4:0/3289998253 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91300 msgr2=0x563f66c916d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:08.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.933+0000 7f339daa3e00 1 --2- 10.20.193.4:0/3289998253 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91300 0x563f66c916d0 secure :-1 s=READY pgs=77 gs=3 cs=0 l=1 c_cookie=7964353890304332903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3384011560 tx=0x7f3384014000 comp rx=0 tx=0).stop 2026-02-24T09:12:08.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.933+0000 7f339daa3e00 1 -- 10.20.193.4:0/3289998253 shutdown_connections 2026-02-24T09:12:08.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.933+0000 7f339daa3e00 1 --2- 10.20.193.4:0/3289998253 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66cd68b0 0x563f66cf6c90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.933+0000 7f339daa3e00 1 --2- 10.20.193.4:0/3289998253 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91c10 0x563f66cd6370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.933+0000 7f339daa3e00 1 --2- 10.20.193.4:0/3289998253 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91300 0x563f66c916d0 unknown :-1 s=CLOSED pgs=77 gs=3 cs=0 l=1 c_cookie=7964353890304332903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.933+0000 7f339daa3e00 1 -- 10.20.193.4:0/3289998253 >> 10.20.193.4:0/3289998253 conn(0x563f66baf4f0 msgr2=0x563f66c8fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:08.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.933+0000 7f339daa3e00 1 -- 10.20.193.4:0/3289998253 shutdown_connections 2026-02-24T09:12:08.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.933+0000 7f339daa3e00 1 -- 10.20.193.4:0/3289998253 wait complete. 2026-02-24T09:12:08.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339daa3e00 1 -- start start 2026-02-24T09:12:08.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339daa3e00 1 Processor -- start 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91300 0x563f66ca9230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ca9770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66cd68b0 0x563f66cae760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339daa3e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563f66caeca0 con 0x563f66c91c10 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339daa3e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563f66caee10 con 0x563f66c91300 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339daa3e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563f66caefd0 con 0x563f66cd68b0 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339901d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ca9770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339901d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ca9770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47484/0 (socket says 10.20.193.4:47484) 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339901d640 1 -- 10.20.193.4:0/3532785865 learned_addr learned my addr 10.20.193.4:0/3532785865 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.935+0000 7f339a01f640 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66cd68b0 0x563f66cae760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f339901d640 1 -- 10.20.193.4:0/3532785865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66cd68b0 msgr2=0x563f66cae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f339901d640 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66cd68b0 0x563f66cae760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f339901d640 1 -- 10.20.193.4:0/3532785865 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91300 msgr2=0x563f66ca9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f339901d640 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91300 0x563f66ca9230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f339901d640 1 -- 10.20.193.4:0/3532785865 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f66b1acd0 con 0x563f66c91c10 2026-02-24T09:12:08.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f339a01f640 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66cd68b0 0x563f66cae760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f339901d640 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ca9770 secure :-1 s=READY pgs=661 gs=1 cs=0 l=1 c_cookie=7947277439151134591 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33880e41a0 tx=0x7f3388004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4a66b97414577f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f334b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f334b7fe640 1 -- 10.20.193.4:0/3532785865 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3388009950 con 0x563f66c91c10 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f339daa3e00 1 -- 10.20.193.4:0/3532785865 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3384003d90 con 0x563f66c91c10 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f339daa3e00 10 client.16215 _ll_register_callbacks cb 0x563f66b13790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f339daa3e00 1 -- 10.20.193.4:0/3532785865 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f668249d0 con 0x563f66c91c10 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f334b7fe640 1 -- 10.20.193.4:0/3532785865 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x563f668249d0 con 0x563f66c91c10 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f334b7fe640 1 -- 10.20.193.4:0/3532785865 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3388005710 con 0x563f66c91c10 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.936+0000 7f334b7fe640 1 -- 10.20.193.4:0/3532785865 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f33880b86e0 con 0x563f66c91c10 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.937+0000 7f334b7fe640 1 -- 10.20.193.4:0/3532785865 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f33880b31c0 con 0x563f66c91c10 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.937+0000 7f339daa3e00 10 client.16215 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:08.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.937+0000 7f339daa3e00 1 -- 10.20.193.4:0/3532785865 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563f66b2cab0 con 0x563f66c91c10 2026-02-24T09:12:08.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.937+0000 7f334b7fe640 1 -- 10.20.193.4:0/3532785865 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f3388073350 con 0x563f66c91c10 2026-02-24T09:12:08.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.937+0000 7f339daa3e00 10 client.16215 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:08.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.937+0000 7f339daa3e00 10 client.16215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:08.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.937+0000 7f339daa3e00 20 client.16215 populate_metadata read hostname 'trial004' 2026-02-24T09:12:08.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.937+0000 7f339daa3e00 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563f66cd3ba0 0x563f66cd4040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.937+0000 7f339daa3e00 4 client.16215 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:08.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.937+0000 7f339daa3e00 1 -- 10.20.193.4:0/3532785865 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f66ba7b70 con 0x563f66cd3ba0 2026-02-24T09:12:08.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.938+0000 7f339981e640 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563f66cd3ba0 0x563f66cd4040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.938+0000 7f334b7fe640 10 client.16215 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:08.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.938+0000 7f339981e640 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563f66cd3ba0 0x563f66cd4040 crc :-1 s=READY pgs=73 gs=4 cs=0 l=0 c_cookie=472067909033302717 s_cookie=14115309005473992758 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68d1f431bca9abd server_cookie=c3e3a6c11e265036 in_seq=0 out_seq=0 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f334b7fe640 1 -- 10.20.193.4:0/3532785865 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563f66ba7b70 con 0x563f66cd3ba0 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f334b7fe640 10 client.16215 handle_command_reply: tid=0 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 client.16215 shutdown 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 -- 10.20.193.4:0/3532785865 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 msgr2=0x563f66ca9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ca9770 secure :-1 s=READY pgs=661 gs=1 cs=0 l=1 c_cookie=7947277439151134591 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33880e41a0 tx=0x7f3388004000 comp rx=0 tx=0).stop 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 -- 10.20.193.4:0/3532785865 shutdown_connections 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563f66cd3ba0 0x563f66cd4040 crc :-1 s=READY pgs=73 gs=4 cs=0 l=0 c_cookie=472067909033302717 s_cookie=14115309005473992758 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66cd68b0 0x563f66cae760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ca9770 unknown :-1 s=CLOSED pgs=661 gs=1 cs=0 l=1 c_cookie=7947277439151134591 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 --2- 10.20.193.4:0/3532785865 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91300 0x563f66ca9230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f334b7fe640 0 client.16215 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 -- 10.20.193.4:0/3532785865 >> 10.20.193.4:0/3532785865 conn(0x563f66baf4f0 msgr2=0x563f66c902f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 -- 10.20.193.4:0/3532785865 shutdown_connections 2026-02-24T09:12:08.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 1 -- 10.20.193.4:0/3532785865 wait complete. 2026-02-24T09:12:08.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.939+0000 7f339daa3e00 20 client.16215 trim_cache size 0 max 16384 2026-02-24T09:12:08.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.952+0000 7f339daa3e00 1 Processor -- start 2026-02-24T09:12:08.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.952+0000 7f339daa3e00 1 -- start start 2026-02-24T09:12:08.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.952+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91300 0x563f66ccebb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.952+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ccf0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.952+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66cd68b0 0x563f66ca6810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.952+0000 7f339daa3e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563f66b94fe0 con 0x563f66c91c10 2026-02-24T09:12:08.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.952+0000 7f339daa3e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563f6685ffe0 con 0x563f66cd68b0 2026-02-24T09:12:08.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.952+0000 7f339daa3e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563f66c22dd0 con 0x563f66c91300 2026-02-24T09:12:08.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339901d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ccf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339981e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91300 0x563f66ccebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339901d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ccf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47498/0 (socket says 10.20.193.4:47498) 2026-02-24T09:12:08.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339981e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91300 0x563f66ccebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:45566/0 (socket says 10.20.193.4:45566) 2026-02-24T09:12:08.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339901d640 1 -- 10.20.193.4:0/723998832 learned_addr learned my addr 10.20.193.4:0/723998832 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:08.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339a01f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66cd68b0 0x563f66ca6810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339901d640 1 -- 10.20.193.4:0/723998832 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91300 msgr2=0x563f66ccebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:08.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339901d640 1 --2- 10.20.193.4:0/723998832 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91300 0x563f66ccebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339901d640 1 -- 10.20.193.4:0/723998832 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66cd68b0 msgr2=0x563f66ca6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339901d640 1 --2- 10.20.193.4:0/723998832 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66cd68b0 0x563f66ca6810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339901d640 1 -- 10.20.193.4:0/723998832 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f66b27530 con 0x563f66c91c10 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339a01f640 1 --2- 10.20.193.4:0/723998832 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66cd68b0 0x563f66ca6810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f339901d640 1 --2- 10.20.193.4:0/723998832 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ccf0f0 secure :-1 s=READY pgs=662 gs=1 cs=0 l=1 c_cookie=1597240029654308217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33880ad850 tx=0x7f33880aa040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162a89582c945579 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f3371ce5640 1 -- 10.20.193.4:0/723998832 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3388009950 con 0x563f66c91c10 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f3371ce5640 1 -- 10.20.193.4:0/723998832 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f33880ae2c0 con 0x563f66c91c10 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.953+0000 7f3371ce5640 1 -- 10.20.193.4:0/723998832 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3388005710 con 0x563f66c91c10 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.954+0000 7f339daa3e00 1 -- 10.20.193.4:0/723998832 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 msgr2=0x563f66ccf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.954+0000 7f339daa3e00 1 --2- 10.20.193.4:0/723998832 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ccf0f0 secure :-1 s=READY pgs=662 gs=1 cs=0 l=1 c_cookie=1597240029654308217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33880ad850 tx=0x7f33880aa040 comp rx=0 tx=0).stop 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.954+0000 7f339daa3e00 1 -- 10.20.193.4:0/723998832 shutdown_connections 2026-02-24T09:12:08.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.954+0000 7f339daa3e00 1 --2- 10.20.193.4:0/723998832 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66cd68b0 0x563f66ca6810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.954+0000 7f339daa3e00 1 --2- 10.20.193.4:0/723998832 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91c10 0x563f66ccf0f0 unknown :-1 s=CLOSED pgs=662 gs=1 cs=0 l=1 c_cookie=1597240029654308217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.954+0000 7f339daa3e00 1 --2- 10.20.193.4:0/723998832 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66c91300 0x563f66ccebb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.954+0000 7f339daa3e00 1 -- 10.20.193.4:0/723998832 >> 10.20.193.4:0/723998832 conn(0x563f66baf4f0 msgr2=0x563f66ccfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:08.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.954+0000 7f339daa3e00 1 -- 10.20.193.4:0/723998832 shutdown_connections 2026-02-24T09:12:08.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.954+0000 7f339daa3e00 1 -- 10.20.193.4:0/723998832 wait complete. 2026-02-24T09:12:08.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339daa3e00 1 -- start start 2026-02-24T09:12:08.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339daa3e00 1 Processor -- start 2026-02-24T09:12:08.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91300 0x563f66cd6260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91c10 0x563f66caf730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339daa3e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66cd68b0 0x563f66cafc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339daa3e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563f66cae900 con 0x563f66c91300 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339daa3e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563f66ca24f0 con 0x563f66c91c10 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339daa3e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563f66c054c0 con 0x563f66cd68b0 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339981e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91300 0x563f66cd6260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339981e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91300 0x563f66cd6260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47508/0 (socket says 10.20.193.4:47508) 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339981e640 1 -- 10.20.193.4:0/453069848 learned_addr learned my addr 10.20.193.4:0/453069848 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339901d640 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91c10 0x563f66caf730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339981e640 1 -- 10.20.193.4:0/453069848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66cd68b0 msgr2=0x563f66cafc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339981e640 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66cd68b0 0x563f66cafc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339981e640 1 -- 10.20.193.4:0/453069848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91c10 msgr2=0x563f66caf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339981e640 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91c10 0x563f66caf730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339981e640 1 -- 10.20.193.4:0/453069848 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f66b1b000 con 0x563f66c91300 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f339981e640 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91300 0x563f66cd6260 secure :-1 s=READY pgs=663 gs=1 cs=0 l=1 c_cookie=10100116114549071426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x563f66cd48f0 tx=0x7f3384009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2ad217ede55e42 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.955+0000 7f334b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:08.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f334b7fe640 1 -- 10.20.193.4:0/453069848 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f338401ad30 con 0x563f66c91300 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f334b7fe640 1 -- 10.20.193.4:0/453069848 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f338401ae90 con 0x563f66c91300 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f339daa3e00 1 -- 10.20.193.4:0/453069848 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f66b2cab0 con 0x563f66c91300 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f334b7fe640 1 -- 10.20.193.4:0/453069848 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f338402f6a0 con 0x563f66c91300 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f339daa3e00 10 client.16221 _ll_register_callbacks cb 0x563f66b13790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f339daa3e00 1 -- 10.20.193.4:0/453069848 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f66ba97e0 con 0x563f66c91300 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f334b7fe640 1 -- 10.20.193.4:0/453069848 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f338402f830 con 0x563f66c91300 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f334b7fe640 1 -- 10.20.193.4:0/453069848 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f338402f9f0 con 0x563f66c91300 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f339daa3e00 10 client.16221 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f339daa3e00 1 -- 10.20.193.4:0/453069848 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563f66b2cd10 con 0x563f66c91300 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f334b7fe640 1 -- 10.20.193.4:0/453069848 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f338402fb50 con 0x563f66c91300 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f339daa3e00 10 client.16221 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f339daa3e00 10 client.16221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.956+0000 7f339daa3e00 20 client.16221 populate_metadata read hostname 'trial004' 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.957+0000 7f339daa3e00 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563f66d83a90 0x563f66da3f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.957+0000 7f339daa3e00 4 client.16221 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:12:08.964 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.957+0000 7f339daa3e00 1 -- 10.20.193.4:0/453069848 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563f66822220 con 0x563f66d83a90 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.957+0000 7f339901d640 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563f66d83a90 0x563f66da3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.957+0000 7f334b7fe640 10 client.16221 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.958+0000 7f339901d640 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563f66d83a90 0x563f66da3f40 crc :-1 s=READY pgs=74 gs=4 cs=0 l=0 c_cookie=13669812647832383855 s_cookie=10057447151018234253 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdb4ee2d6c30f16f server_cookie=8b933ae5afb4d18d in_seq=0 out_seq=0 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f334b7fe640 1 -- 10.20.193.4:0/453069848 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563f66822220 con 0x563f66d83a90 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f334b7fe640 10 client.16221 handle_command_reply: tid=0 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 client.16221 shutdown 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 -- 10.20.193.4:0/453069848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91300 msgr2=0x563f66cd6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91300 0x563f66cd6260 secure :-1 s=READY pgs=663 gs=1 cs=0 l=1 c_cookie=10100116114549071426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x563f66cd48f0 tx=0x7f3384009730 comp rx=0 tx=0).stop 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 -- 10.20.193.4:0/453069848 shutdown_connections 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563f66d83a90 0x563f66da3f40 crc :-1 s=READY pgs=74 gs=4 cs=0 l=0 c_cookie=13669812647832383855 s_cookie=10057447151018234253 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563f66cd68b0 0x563f66cafc70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563f66c91c10 0x563f66caf730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 --2- 10.20.193.4:0/453069848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563f66c91300 0x563f66cd6260 unknown :-1 s=CLOSED pgs=663 gs=1 cs=0 l=1 c_cookie=10100116114549071426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.965 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f334b7fe640 0 client.16221 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:08.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 -- 10.20.193.4:0/453069848 >> 10.20.193.4:0/453069848 conn(0x563f66baf4f0 msgr2=0x563f66ccdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:08.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 -- 10.20.193.4:0/453069848 shutdown_connections 2026-02-24T09:12:08.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 1 -- 10.20.193.4:0/453069848 wait complete. 2026-02-24T09:12:08.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.959+0000 7f339daa3e00 20 client.16221 trim_cache size 0 max 16384 2026-02-24T09:12:08.966 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:12:08.966 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:12:08.966 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "d858422f-a1fb-4a4f-9552-50c4ec759bed", 2026-02-24T09:12:08.966 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:12:08.966 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:12:08.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 -- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33640b56d0 msgr2=0x7f33640d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:08.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33640b56d0 0x7f33640d5b80 secure :-1 s=READY pgs=320 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33840095d0 tx=0x7f3384005f90 comp rx=0 tx=0).stop 2026-02-24T09:12:08.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 -- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f339410ccf0 msgr2=0x7f3394172dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:08.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f339410ccf0 0x7f3394172dc0 secure :-1 s=READY pgs=660 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f338800d700 tx=0x7f338800dbd0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 -- 10.20.193.4:0/2550928659 shutdown_connections 2026-02-24T09:12:08.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f33640b56d0 0x7f33640d5b80 unknown :-1 s=CLOSED pgs=320 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33941124f0 0x7f3394174f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f339410ccf0 0x7f3394172dc0 unknown :-1 s=CLOSED pgs=660 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 --2- 10.20.193.4:0/2550928659 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f339410c300 0x7f3394174a40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:08.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 -- 10.20.193.4:0/2550928659 >> 10.20.193.4:0/2550928659 conn(0x7f33940e9bf0 msgr2=0x7f339410a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:08.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 -- 10.20.193.4:0/2550928659 shutdown_connections 2026-02-24T09:12:08.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:08.960+0000 7f339baa9640 1 -- 10.20.193.4:0/2550928659 wait complete. 2026-02-24T09:12:09.051 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:12:09.091 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:08 trial004 ceph-mon[41596]: pgmap v222: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 487 MiB/s wr, 130 op/s 2026-02-24T09:12:09.225 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:09.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:08 trial090 ceph-mon[47278]: pgmap v222: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 487 MiB/s wr, 130 op/s 2026-02-24T09:12:09.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:08 trial014 ceph-mon[46941]: pgmap v222: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 487 MiB/s wr, 130 op/s 2026-02-24T09:12:09.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 -- 10.20.193.4:0/425317811 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5920110040 msgr2=0x7f5920115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:09.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 --2- 10.20.193.4:0/425317811 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5920110040 0x7f5920115090 secure :-1 s=READY pgs=664 gs=1 cs=0 l=1 c_cookie=7314652006634528751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5914009950 tx=0x7f591402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 -- 10.20.193.4:0/425317811 shutdown_connections 2026-02-24T09:12:09.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 --2- 10.20.193.4:0/425317811 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5920115840 0x7f5920176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 --2- 10.20.193.4:0/425317811 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5920110040 0x7f5920115090 unknown :-1 s=CLOSED pgs=664 gs=1 cs=0 l=1 c_cookie=7314652006634528751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 --2- 10.20.193.4:0/425317811 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f592010f650 0x7f592010fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 -- 10.20.193.4:0/425317811 >> 10.20.193.4:0/425317811 conn(0x7f59200ecf20 msgr2=0x7f592010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 -- 10.20.193.4:0/425317811 shutdown_connections 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 -- 10.20.193.4:0/425317811 wait complete. 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 Processor -- start 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.383+0000 7f59286f6640 1 -- start start 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59286f6640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f592010f650 0x7f59200f5920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59286f6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5920110040 0x7f5920176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59286f6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5920115840 0x7f59200f6020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59286f6640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f59200fb230 con 0x7f5920110040 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59286f6640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f59200fb3a0 con 0x7f592010f650 2026-02-24T09:12:09.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59286f6640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59200fb560 con 0x7f5920115840 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5925c6a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5920110040 0x7f5920176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5925c6a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5920110040 0x7f5920176110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47528/0 (socket says 10.20.193.4:47528) 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5925c6a640 1 -- 10.20.193.4:0/2324241568 learned_addr learned my addr 10.20.193.4:0/2324241568 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5926c6c640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5920115840 0x7f59200f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f592646b640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f592010f650 0x7f59200f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5925c6a640 1 -- 10.20.193.4:0/2324241568 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5920115840 msgr2=0x7f59200f6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5925c6a640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5920115840 0x7f59200f6020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5925c6a640 1 -- 10.20.193.4:0/2324241568 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f592010f650 msgr2=0x7f59200f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5925c6a640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f592010f650 0x7f59200f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5925c6a640 1 -- 10.20.193.4:0/2324241568 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5914009570 con 0x7f5920110040 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5926c6c640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5920115840 0x7f59200f6020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:09.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f5925c6a640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5920110040 0x7f5920176110 secure :-1 s=READY pgs=665 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59140023d0 tx=0x7f59140043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:09.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59077fe640 1 -- 10.20.193.4:0/2324241568 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f591403d070 con 0x7f5920110040 2026-02-24T09:12:09.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59077fe640 1 -- 10.20.193.4:0/2324241568 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5914038920 con 0x7f5920110040 2026-02-24T09:12:09.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59286f6640 1 -- 10.20.193.4:0/2324241568 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59200fb7e0 con 0x7f5920110040 2026-02-24T09:12:09.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59077fe640 1 -- 10.20.193.4:0/2324241568 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59140419d0 con 0x7f5920110040 2026-02-24T09:12:09.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.384+0000 7f59286f6640 1 -- 10.20.193.4:0/2324241568 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59200fbca0 con 0x7f5920110040 2026-02-24T09:12:09.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.386+0000 7f59077fe640 1 -- 10.20.193.4:0/2324241568 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f5914038a90 con 0x7f5920110040 2026-02-24T09:12:09.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.386+0000 7f59077fe640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58fc0b5750 0x7f58fc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.387+0000 7f59077fe640 1 -- 10.20.193.4:0/2324241568 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f591410b3c0 con 0x7f5920110040 2026-02-24T09:12:09.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.387+0000 7f592646b640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58fc0b5750 0x7f58fc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.387+0000 7f592646b640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58fc0b5750 0x7f58fc0d5c00 secure :-1 s=READY pgs=321 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5910004740 tx=0x7f5910004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:09.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f592a6f0e00 1 Processor -- start 2026-02-24T09:12:09.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f592a6f0e00 1 -- start start 2026-02-24T09:12:09.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b57bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b58130 0x5584e0b9c890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9cdd0 0x5584e0bbd1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5584e0a67de0 con 0x5584e0b9cdd0 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5584e0a63b10 con 0x5584e0b58130 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584e0a5dab0 con 0x5584e0b57820 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f5926c6c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9cdd0 0x5584e0bbd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f5926c6c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9cdd0 0x5584e0bbd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47538/0 (socket says 10.20.193.4:47538) 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f5926c6c640 1 -- 10.20.193.4:0/2483744217 learned_addr learned my addr 10.20.193.4:0/2483744217 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f592646b640 1 --2- 10.20.193.4:0/2483744217 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b57bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f5925c6a640 1 --2- 10.20.193.4:0/2483744217 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b58130 0x5584e0b9c890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f5926c6c640 1 -- 10.20.193.4:0/2483744217 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 msgr2=0x5584e0b57bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f5926c6c640 1 --2- 10.20.193.4:0/2483744217 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b57bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f5926c6c640 1 -- 10.20.193.4:0/2483744217 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b58130 msgr2=0x5584e0b9c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f5926c6c640 1 --2- 10.20.193.4:0/2483744217 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b58130 0x5584e0b9c890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.389+0000 7f5926c6c640 1 -- 10.20.193.4:0/2483744217 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e0a09310 con 0x5584e0b9cdd0 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f5926c6c640 1 --2- 10.20.193.4:0/2483744217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9cdd0 0x5584e0bbd1b0 secure :-1 s=READY pgs=666 gs=2 cs=0 l=1 c_cookie=3298644622475245426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f591c007fd0 tx=0x7f591c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc723cea2e3b772 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f5904b0a640 1 -- 10.20.193.4:0/2483744217 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f591c00eb70 con 0x5584e0b9cdd0 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f5904b0a640 1 -- 10.20.193.4:0/2483744217 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f591c00ecd0 con 0x5584e0b9cdd0 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f5904b0a640 1 -- 10.20.193.4:0/2483744217 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f591c012770 con 0x5584e0b9cdd0 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2483744217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9cdd0 msgr2=0x5584e0bbd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/2483744217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9cdd0 0x5584e0bbd1b0 secure :-1 s=READY pgs=666 gs=2 cs=0 l=1 c_cookie=3298644622475245426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f591c007fd0 tx=0x7f591c003d80 comp rx=0 tx=0).stop 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2483744217 shutdown_connections 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/2483744217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9cdd0 0x5584e0bbd1b0 unknown :-1 s=CLOSED pgs=666 gs=2 cs=0 l=1 c_cookie=3298644622475245426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/2483744217 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b58130 0x5584e0b9c890 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/2483744217 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b57bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2483744217 >> 10.20.193.4:0/2483744217 conn(0x5584e0a766b0 msgr2=0x5584e0b56100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:09.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2483744217 shutdown_connections 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.390+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2483744217 wait complete. 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 1 -- start start 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 1 Processor -- start 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b57820 0x5584e0b6fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b70390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b9cdd0 0x5584e0b75380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5584e0b758c0 con 0x5584e0b58130 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5584e0b75a30 con 0x5584e0b57820 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584e0b75bf0 con 0x5584e0b9cdd0 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f5925c6a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b70390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f5925c6a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b70390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47548/0 (socket says 10.20.193.4:47548) 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f5925c6a640 1 -- 10.20.193.4:0/3774977792 learned_addr learned my addr 10.20.193.4:0/3774977792 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:09.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f5925c6a640 1 -- 10.20.193.4:0/3774977792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b9cdd0 msgr2=0x5584e0b75380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f5925c6a640 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b9cdd0 0x5584e0b75380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f5925c6a640 1 -- 10.20.193.4:0/3774977792 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b57820 msgr2=0x5584e0b6fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592646b640 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b57820 0x5584e0b6fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f5925c6a640 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b57820 0x5584e0b6fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f5925c6a640 1 -- 10.20.193.4:0/3774977792 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e09e18c0 con 0x5584e0b58130 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592646b640 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b57820 0x5584e0b6fe50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f5925c6a640 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b70390 secure :-1 s=READY pgs=667 gs=1 cs=0 l=1 c_cookie=4793153023672759295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59140ce960 tx=0x7f591402f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4284b347a21ab3ff server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f58d3fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f58d3fff640 1 -- 10.20.193.4:0/3774977792 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59140d0ef0 con 0x5584e0b58130 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 1 -- 10.20.193.4:0/3774977792 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591c00f040 con 0x5584e0b58130 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f58d3fff640 1 -- 10.20.193.4:0/3774977792 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f59140d20f0 con 0x5584e0b58130 2026-02-24T09:12:09.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f58d3fff640 1 -- 10.20.193.4:0/3774977792 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5914096b00 con 0x5584e0b58130 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 10 client.16233 _ll_register_callbacks cb 0x5584e09f9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f592a6f0e00 1 -- 10.20.193.4:0/3774977792 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584e07ad4a0 con 0x5584e0b58130 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.392+0000 7f58d3fff640 1 -- 10.20.193.4:0/3774977792 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f59140cf6d0 con 0x5584e0b58130 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f58d3fff640 1 -- 10.20.193.4:0/3774977792 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f59140cf890 con 0x5584e0b58130 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f592a6f0e00 10 client.16233 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f592a6f0e00 1 -- 10.20.193.4:0/3774977792 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5584e09f36e0 con 0x5584e0b58130 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f58d3fff640 1 -- 10.20.193.4:0/3774977792 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f59140d30e0 con 0x5584e0b58130 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f592a6f0e00 10 client.16233 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f592a6f0e00 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f592a6f0e00 20 client.16233 populate_metadata read hostname 'trial004' 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584e0b9a510 0x5584e0b9a9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f592a6f0e00 4 client.16233 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:09.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f592a6f0e00 1 -- 10.20.193.4:0/3774977792 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584e0a534f0 con 0x5584e0b9a510 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.393+0000 7f592646b640 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584e0b9a510 0x5584e0b9a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.394+0000 7f58d3fff640 10 client.16233 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.394+0000 7f592646b640 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584e0b9a510 0x5584e0b9a9b0 crc :-1 s=READY pgs=75 gs=4 cs=0 l=0 c_cookie=5981773058066534699 s_cookie=11630318045615533607 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=530386e74d0ed12b server_cookie=a16730a475baae27 in_seq=0 out_seq=0 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.394+0000 7f58d3fff640 1 -- 10.20.193.4:0/3774977792 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5584e0a534f0 con 0x5584e0b9a510 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.394+0000 7f58d3fff640 10 client.16233 handle_command_reply: tid=0 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.394+0000 7f592a6f0e00 1 client.16233 shutdown 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.394+0000 7f592a6f0e00 1 -- 10.20.193.4:0/3774977792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 msgr2=0x5584e0b70390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.394+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b70390 secure :-1 s=READY pgs=667 gs=1 cs=0 l=1 c_cookie=4793153023672759295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59140ce960 tx=0x7f591402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.395+0000 7f592a6f0e00 1 -- 10.20.193.4:0/3774977792 shutdown_connections 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.395+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584e0b9a510 0x5584e0b9a9b0 crc :-1 s=READY pgs=75 gs=4 cs=0 l=0 c_cookie=5981773058066534699 s_cookie=11630318045615533607 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.395+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b9cdd0 0x5584e0b75380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.395+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b70390 unknown :-1 s=CLOSED pgs=667 gs=1 cs=0 l=1 c_cookie=4793153023672759295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.395+0000 7f58d3fff640 0 client.16233 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:09.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.395+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/3774977792 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b57820 0x5584e0b6fe50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.395+0000 7f592a6f0e00 1 -- 10.20.193.4:0/3774977792 >> 10.20.193.4:0/3774977792 conn(0x5584e0a766b0 msgr2=0x5584e0b56810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:09.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.395+0000 7f592a6f0e00 1 -- 10.20.193.4:0/3774977792 shutdown_connections 2026-02-24T09:12:09.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.395+0000 7f592a6f0e00 1 -- 10.20.193.4:0/3774977792 wait complete. 2026-02-24T09:12:09.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.395+0000 7f592a6f0e00 20 client.16233 trim_cache size 0 max 16384 2026-02-24T09:12:09.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f592a6f0e00 1 Processor -- start 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f592a6f0e00 1 -- start start 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b9b290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b58130 0x5584e0b9b7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9a510 0x5584e0b9bd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5584e0a5b6e0 con 0x5584e0b9a510 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5584e0726f50 con 0x5584e0b58130 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584e0b75ab0 con 0x5584e0b57820 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f5926c6c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9a510 0x5584e0b9bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f5926c6c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9a510 0x5584e0b9bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47558/0 (socket says 10.20.193.4:47558) 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f5926c6c640 1 -- 10.20.193.4:0/1580529203 learned_addr learned my addr 10.20.193.4:0/1580529203 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:09.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f5925c6a640 1 --2- 10.20.193.4:0/1580529203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b58130 0x5584e0b9b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f5926c6c640 1 -- 10.20.193.4:0/1580529203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 msgr2=0x5584e0b9b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f5926c6c640 1 --2- 10.20.193.4:0/1580529203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b9b290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f5926c6c640 1 -- 10.20.193.4:0/1580529203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b58130 msgr2=0x5584e0b9b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f5926c6c640 1 --2- 10.20.193.4:0/1580529203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b58130 0x5584e0b9b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.404+0000 7f5926c6c640 1 -- 10.20.193.4:0/1580529203 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e0b62350 con 0x5584e0b9a510 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f5926c6c640 1 --2- 10.20.193.4:0/1580529203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9a510 0x5584e0b9bd10 secure :-1 s=READY pgs=668 gs=1 cs=0 l=1 c_cookie=16930632432138945334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f591c00e530 tx=0x7f591c003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf5b07ea4598336 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f58ee4e6640 1 -- 10.20.193.4:0/1580529203 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f591c00eb70 con 0x5584e0b9a510 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f58ee4e6640 1 -- 10.20.193.4:0/1580529203 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f591c021070 con 0x5584e0b9a510 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f58ee4e6640 1 -- 10.20.193.4:0/1580529203 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f591c0136a0 con 0x5584e0b9a510 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f592a6f0e00 1 -- 10.20.193.4:0/1580529203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9a510 msgr2=0x5584e0b9bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/1580529203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9a510 0x5584e0b9bd10 secure :-1 s=READY pgs=668 gs=1 cs=0 l=1 c_cookie=16930632432138945334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f591c00e530 tx=0x7f591c003780 comp rx=0 tx=0).stop 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f592a6f0e00 1 -- 10.20.193.4:0/1580529203 shutdown_connections 2026-02-24T09:12:09.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/1580529203 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b9a510 0x5584e0b9bd10 unknown :-1 s=CLOSED pgs=668 gs=1 cs=0 l=1 c_cookie=16930632432138945334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/1580529203 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b58130 0x5584e0b9b7d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/1580529203 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b9b290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f592a6f0e00 1 -- 10.20.193.4:0/1580529203 >> 10.20.193.4:0/1580529203 conn(0x5584e0a766b0 msgr2=0x5584e0b55a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f592a6f0e00 1 -- 10.20.193.4:0/1580529203 shutdown_connections 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.405+0000 7f592a6f0e00 1 -- 10.20.193.4:0/1580529203 wait complete. 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f592a6f0e00 1 -- start start 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f592a6f0e00 1 Processor -- start 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b7b140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b7b680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f592a6f0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b9a510 0x5584e0c02300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5584e0b7bfd0 con 0x5584e0b58130 2026-02-24T09:12:09.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5584e0c02840 con 0x5584e0b9a510 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f592a6f0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584e0c02a00 con 0x5584e0b57820 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f5925c6a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b7b680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f5925c6a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b7b680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:47572/0 (socket says 10.20.193.4:47572) 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f5925c6a640 1 -- 10.20.193.4:0/2395348060 learned_addr learned my addr 10.20.193.4:0/2395348060 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f592646b640 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b7b140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f5925c6a640 1 -- 10.20.193.4:0/2395348060 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 msgr2=0x5584e0b7b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f5925c6a640 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b7b140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f5925c6a640 1 -- 10.20.193.4:0/2395348060 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b9a510 msgr2=0x5584e0c02300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f5925c6a640 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b9a510 0x5584e0c02300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f5925c6a640 1 -- 10.20.193.4:0/2395348060 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e09ee160 con 0x5584e0b58130 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f592646b640 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b7b140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:09.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f5925c6a640 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b7b680 secure :-1 s=READY pgs=669 gs=1 cs=0 l=1 c_cookie=9557271222739029883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5914005b30 tx=0x7f5914002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a23f8a5d6c4f7b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f58d3fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.406+0000 7f58d3fff640 1 -- 10.20.193.4:0/2395348060 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f591402f9f0 con 0x5584e0b58130 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f58d3fff640 1 -- 10.20.193.4:0/2395348060 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5584e07ad4a0 con 0x5584e0b58130 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f58d3fff640 1 -- 10.20.193.4:0/2395348060 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59140d70d0 con 0x5584e0b58130 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2395348060 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584e0a09310 con 0x5584e0b58130 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f58d3fff640 1 -- 10.20.193.4:0/2395348060 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f5914096880 con 0x5584e0b58130 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f58d3fff640 10 client.16239 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 10 client.16239 _ll_register_callbacks cb 0x5584e09f9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2395348060 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f591c00ecd0 con 0x5584e0b58130 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f58d3fff640 1 -- 10.20.193.4:0/2395348060 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f59140d7230 con 0x5584e0b58130 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 10 client.16239 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2395348060 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5584e09e1bf0 con 0x5584e0b58130 2026-02-24T09:12:09.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f58d3fff640 1 -- 10.20.193.4:0/2395348060 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f59140cf6d0 con 0x5584e0b58130 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 10 client.16239 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 20 client.16239 populate_metadata read hostname 'trial004' 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584e0b9cdd0 0x5584e0c6a0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 4 client.16239 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2395348060 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5584e0792160 con 0x5584e0b9cdd0 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.407+0000 7f592646b640 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584e0b9cdd0 0x5584e0c6a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f58d3fff640 10 client.16239 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592646b640 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584e0b9cdd0 0x5584e0c6a0b0 crc :-1 s=READY pgs=76 gs=4 cs=0 l=0 c_cookie=13566674121727223720 s_cookie=7437165230287837240 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc46823c010927a8 server_cookie=67361e5f87315838 in_seq=0 out_seq=0 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f58d3fff640 1 -- 10.20.193.4:0/2395348060 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x5584e0792160 con 0x5584e0b9cdd0 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f58d3fff640 10 client.16239 handle_command_reply: tid=0 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 client.16239 shutdown 2026-02-24T09:12:09.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2395348060 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 msgr2=0x5584e0b7b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b7b680 secure :-1 s=READY pgs=669 gs=1 cs=0 l=1 c_cookie=9557271222739029883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5914005b30 tx=0x7f5914002b90 comp rx=0 tx=0).stop 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2395348060 shutdown_connections 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584e0b9cdd0 0x5584e0c6a0b0 crc :-1 s=READY pgs=76 gs=4 cs=0 l=0 c_cookie=13566674121727223720 s_cookie=7437165230287837240 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584e0b9a510 0x5584e0c02300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584e0b58130 0x5584e0b7b680 unknown :-1 s=CLOSED pgs=669 gs=1 cs=0 l=1 c_cookie=9557271222739029883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f58d3fff640 0 client.16239 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 --2- 10.20.193.4:0/2395348060 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584e0b57820 0x5584e0b7b140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2395348060 >> 10.20.193.4:0/2395348060 conn(0x5584e0a766b0 msgr2=0x5584e0b561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2395348060 shutdown_connections 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 1 -- 10.20.193.4:0/2395348060 wait complete. 2026-02-24T09:12:09.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f592a6f0e00 20 client.16239 trim_cache size 0 max 16384 2026-02-24T09:12:09.420 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:12:09.420 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:12:09.420 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:12:09.420 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:12:09.420 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:09.420 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "d858422f-a1fb-4a4f-9552-50c4ec759bed", 2026-02-24T09:12:09.420 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:12:09.420 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:09.420 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:12:09.421 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:09.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:09.423 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:09.424 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:09.424 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:09.424 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:09.424 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:09.424 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:09.424 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:12:09.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f59286f6640 1 -- 10.20.193.4:0/2324241568 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58fc0b5750 msgr2=0x7f58fc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:09.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f59286f6640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58fc0b5750 0x7f58fc0d5c00 secure :-1 s=READY pgs=321 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5910004740 tx=0x7f5910004420 comp rx=0 tx=0).stop 2026-02-24T09:12:09.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f59286f6640 1 -- 10.20.193.4:0/2324241568 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5920110040 msgr2=0x7f5920176110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:09.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f59286f6640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5920110040 0x7f5920176110 secure :-1 s=READY pgs=665 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59140023d0 tx=0x7f59140043d0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f59286f6640 1 -- 10.20.193.4:0/2324241568 shutdown_connections 2026-02-24T09:12:09.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f59286f6640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58fc0b5750 0x7f58fc0d5c00 unknown :-1 s=CLOSED pgs=321 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f59286f6640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5920115840 0x7f59200f6020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f59286f6640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5920110040 0x7f5920176110 unknown :-1 s=CLOSED pgs=665 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f59286f6640 1 --2- 10.20.193.4:0/2324241568 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f592010f650 0x7f59200f5920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:09.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.408+0000 7f59286f6640 1 -- 10.20.193.4:0/2324241568 >> 10.20.193.4:0/2324241568 conn(0x7f59200ecf20 msgr2=0x7f5920111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:09.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.409+0000 7f59286f6640 1 -- 10.20.193.4:0/2324241568 shutdown_connections 2026-02-24T09:12:09.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:09.409+0000 7f59286f6640 1 -- 10.20.193.4:0/2324241568 wait complete. 2026-02-24T09:12:09.448 INFO:tasks.cephfs.filesystem:scrub status for tag:d858422f-a1fb-4a4f-9552-50c4ec759bed - {'path': '/', 'tag': 'd858422f-a1fb-4a4f-9552-50c4ec759bed', 'options': 'recursive,force'} 2026-02-24T09:12:10.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:09 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:12:10.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:09 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:10.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:09 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:12:10.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:09 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:10.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:09 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:12:10.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:09 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:10.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:09 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:12:10.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:09 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:10.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:09 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:12:10.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:09 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:10.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:09 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:12:10.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:09 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:11.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:10 trial004 ceph-mon[41596]: pgmap v223: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 624 MiB/s wr, 162 op/s 2026-02-24T09:12:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:10 trial090 ceph-mon[47278]: pgmap v223: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 624 MiB/s wr, 162 op/s 2026-02-24T09:12:11.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:10 trial014 ceph-mon[46941]: pgmap v223: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 624 MiB/s wr, 162 op/s 2026-02-24T09:12:13.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:12 trial004 ceph-mon[41596]: pgmap v224: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 820 MiB/s wr, 220 op/s 2026-02-24T09:12:13.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:12 trial090 ceph-mon[47278]: pgmap v224: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 820 MiB/s wr, 220 op/s 2026-02-24T09:12:13.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:12 trial014 ceph-mon[46941]: pgmap v224: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 820 MiB/s wr, 220 op/s 2026-02-24T09:12:14.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:13 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:12:14.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:13 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:12:14.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:13 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:12:15.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:14 trial004 ceph-mon[41596]: pgmap v225: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 877 MiB/s wr, 237 op/s 2026-02-24T09:12:15.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:14 trial090 ceph-mon[47278]: pgmap v225: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 877 MiB/s wr, 237 op/s 2026-02-24T09:12:15.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:14 trial014 ceph-mon[46941]: pgmap v225: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 877 MiB/s wr, 237 op/s 2026-02-24T09:12:16.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:15 trial004 ceph-mon[41596]: pgmap v226: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 49 KiB/s rd, 818 MiB/s wr, 224 op/s 2026-02-24T09:12:16.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:15 trial090 ceph-mon[47278]: pgmap v226: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 49 KiB/s rd, 818 MiB/s wr, 224 op/s 2026-02-24T09:12:16.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:15 trial014 ceph-mon[46941]: pgmap v226: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 49 KiB/s rd, 818 MiB/s wr, 224 op/s 2026-02-24T09:12:19.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:18 trial090 ceph-mon[47278]: pgmap v227: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 775 MiB/s wr, 214 op/s 2026-02-24T09:12:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:18 trial014 ceph-mon[46941]: pgmap v227: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 775 MiB/s wr, 214 op/s 2026-02-24T09:12:19.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:18 trial004 ceph-mon[41596]: pgmap v227: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 775 MiB/s wr, 214 op/s 2026-02-24T09:12:21.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:20 trial090 ceph-mon[47278]: pgmap v228: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 637 MiB/s wr, 178 op/s 2026-02-24T09:12:21.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:20 trial014 ceph-mon[46941]: pgmap v228: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 637 MiB/s wr, 178 op/s 2026-02-24T09:12:21.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:20 trial004 ceph-mon[41596]: pgmap v228: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 637 MiB/s wr, 178 op/s 2026-02-24T09:12:23.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:22 trial090 ceph-mon[47278]: pgmap v229: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 778 MiB/s wr, 215 op/s 2026-02-24T09:12:23.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:22 trial014 ceph-mon[46941]: pgmap v229: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 778 MiB/s wr, 215 op/s 2026-02-24T09:12:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:22 trial004 ceph-mon[41596]: pgmap v229: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 778 MiB/s wr, 215 op/s 2026-02-24T09:12:25.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:24 trial090 ceph-mon[47278]: pgmap v230: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 767 MiB/s wr, 207 op/s 2026-02-24T09:12:25.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:12:25.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:12:25.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:12:25.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:12:25.084 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:12:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:24 trial014 ceph-mon[46941]: pgmap v230: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 767 MiB/s wr, 207 op/s 2026-02-24T09:12:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:12:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:12:25.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:12:25.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:12:25.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:12:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:24 trial004 ceph-mon[41596]: pgmap v230: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 767 MiB/s wr, 207 op/s 2026-02-24T09:12:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:12:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:12:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:12:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:12:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:12:27.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:26 trial090 ceph-mon[47278]: pgmap v231: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 817 MiB/s wr, 224 op/s 2026-02-24T09:12:27.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:26 trial014 ceph-mon[46941]: pgmap v231: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 817 MiB/s wr, 224 op/s 2026-02-24T09:12:27.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:26 trial004 ceph-mon[41596]: pgmap v231: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 817 MiB/s wr, 224 op/s 2026-02-24T09:12:29.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:28 trial090 ceph-mon[47278]: pgmap v232: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 896 MiB/s wr, 253 op/s 2026-02-24T09:12:29.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:28 trial014 ceph-mon[46941]: pgmap v232: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 896 MiB/s wr, 253 op/s 2026-02-24T09:12:29.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:28 trial004 ceph-mon[41596]: pgmap v232: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 896 MiB/s wr, 253 op/s 2026-02-24T09:12:31.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:30 trial090 ceph-mon[47278]: pgmap v233: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 817 MiB/s wr, 232 op/s 2026-02-24T09:12:31.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:30 trial014 ceph-mon[46941]: pgmap v233: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 817 MiB/s wr, 232 op/s 2026-02-24T09:12:31.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:30 trial004 ceph-mon[41596]: pgmap v233: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 817 MiB/s wr, 232 op/s 2026-02-24T09:12:33.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:32 trial090 ceph-mon[47278]: pgmap v234: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 860 MiB/s wr, 245 op/s 2026-02-24T09:12:33.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:32 trial014 ceph-mon[46941]: pgmap v234: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 860 MiB/s wr, 245 op/s 2026-02-24T09:12:33.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:32 trial004 ceph-mon[41596]: pgmap v234: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 860 MiB/s wr, 245 op/s 2026-02-24T09:12:35.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:34 trial090 ceph-mon[47278]: pgmap v235: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 754 MiB/s wr, 217 op/s 2026-02-24T09:12:35.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:34 trial014 ceph-mon[46941]: pgmap v235: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 754 MiB/s wr, 217 op/s 2026-02-24T09:12:35.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:34 trial004 ceph-mon[41596]: pgmap v235: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 754 MiB/s wr, 217 op/s 2026-02-24T09:12:37.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:36 trial090 ceph-mon[47278]: pgmap v236: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 734 MiB/s wr, 210 op/s 2026-02-24T09:12:37.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:36 trial014 ceph-mon[46941]: pgmap v236: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 734 MiB/s wr, 210 op/s 2026-02-24T09:12:37.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:36 trial004 ceph-mon[41596]: pgmap v236: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 734 MiB/s wr, 210 op/s 2026-02-24T09:12:39.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:38 trial090 ceph-mon[47278]: pgmap v237: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 61 KiB/s rd, 871 MiB/s wr, 247 op/s 2026-02-24T09:12:39.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:38 trial014 ceph-mon[46941]: pgmap v237: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 61 KiB/s rd, 871 MiB/s wr, 247 op/s 2026-02-24T09:12:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:38 trial004 ceph-mon[41596]: pgmap v237: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 61 KiB/s rd, 871 MiB/s wr, 247 op/s 2026-02-24T09:12:39.449 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:12:39.615 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:39.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 -- 10.20.193.4:0/2145033276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1e4810d3d0 msgr2=0x7f1e4810d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:39.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 --2- 10.20.193.4:0/2145033276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1e4810d3d0 0x7f1e4810d7a0 secure :-1 s=READY pgs=670 gs=1 cs=0 l=1 c_cookie=3587411217276208660 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e38009950 tx=0x7f1e3802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 -- 10.20.193.4:0/2145033276 shutdown_connections 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 --2- 10.20.193.4:0/2145033276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1e481135c0 0x7f1e48173f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 --2- 10.20.193.4:0/2145033276 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1e4810ddc0 0x7f1e48112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 --2- 10.20.193.4:0/2145033276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1e4810d3d0 0x7f1e4810d7a0 unknown :-1 s=CLOSED pgs=670 gs=1 cs=0 l=1 c_cookie=3587411217276208660 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 -- 10.20.193.4:0/2145033276 >> 10.20.193.4:0/2145033276 conn(0x7f1e480eaca0 msgr2=0x7f1e4810b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 -- 10.20.193.4:0/2145033276 shutdown_connections 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 -- 10.20.193.4:0/2145033276 wait complete. 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 Processor -- start 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 -- start start 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1e4810d3d0 0x7f1e480f5940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1e4810ddc0 0x7f1e48173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1e481135c0 0x7f1e480f6040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f1e480fb200 con 0x7f1e481135c0 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f1e480fb370 con 0x7f1e4810ddc0 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e50185640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1e480fb530 con 0x7f1e4810d3d0 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e4e6fb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1e481135c0 0x7f1e480f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e4e6fb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1e481135c0 0x7f1e480f6040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49670/0 (socket says 10.20.193.4:49670) 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e4e6fb640 1 -- 10.20.193.4:0/2260383584 learned_addr learned my addr 10.20.193.4:0/2260383584 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.778+0000 7f1e4d6f9640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1e4810ddc0 0x7f1e48173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e4defa640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1e4810d3d0 0x7f1e480f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e4e6fb640 1 -- 10.20.193.4:0/2260383584 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1e4810d3d0 msgr2=0x7f1e480f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1e4810d3d0 0x7f1e480f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e4e6fb640 1 -- 10.20.193.4:0/2260383584 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1e4810ddc0 msgr2=0x7f1e48173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1e4810ddc0 0x7f1e48173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e4e6fb640 1 -- 10.20.193.4:0/2260383584 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e38009570 con 0x7f1e481135c0 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e4d6f9640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1e4810ddc0 0x7f1e48173e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1e481135c0 0x7f1e480f6040 secure :-1 s=READY pgs=671 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e4400e650 tx=0x7f1e4400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e36ffd640 1 -- 10.20.193.4:0/2260383584 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e4400aa20 con 0x7f1e481135c0 2026-02-24T09:12:39.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e50185640 1 -- 10.20.193.4:0/2260383584 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e480fb810 con 0x7f1e481135c0 2026-02-24T09:12:39.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e36ffd640 1 -- 10.20.193.4:0/2260383584 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1e4400ab80 con 0x7f1e481135c0 2026-02-24T09:12:39.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e36ffd640 1 -- 10.20.193.4:0/2260383584 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e440106d0 con 0x7f1e481135c0 2026-02-24T09:12:39.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.779+0000 7f1e50185640 1 -- 10.20.193.4:0/2260383584 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e480fbd30 con 0x7f1e481135c0 2026-02-24T09:12:39.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.781+0000 7f1e36ffd640 1 -- 10.20.193.4:0/2260383584 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f1e44011460 con 0x7f1e481135c0 2026-02-24T09:12:39.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.782+0000 7f1e36ffd640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1e240b5750 0x7f1e240d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.782+0000 7f1e36ffd640 1 -- 10.20.193.4:0/2260383584 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1e440e7ce0 con 0x7f1e481135c0 2026-02-24T09:12:39.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.782+0000 7f1e4defa640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1e240b5750 0x7f1e240d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.783+0000 7f1e4defa640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1e240b5750 0x7f1e240d5c00 secure :-1 s=READY pgs=322 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e380023d0 tx=0x7f1e38031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:39.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.785+0000 7f1e5217fe00 1 Processor -- start 2026-02-24T09:12:39.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.785+0000 7f1e5217fe00 1 -- start start 2026-02-24T09:12:39.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8a2820 0x560c1d8a2bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a3130 0x560c1d8e7890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8e7dd0 0x560c1d9081b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.789 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560c1d7b2de0 con 0x560c1d8a3130 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560c1d7aeb10 con 0x560c1d8a2820 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560c1d7a8ab0 con 0x560c1d8e7dd0 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4defa640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8a2820 0x560c1d8a2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4d6f9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a3130 0x560c1d8e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4e6fb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8e7dd0 0x560c1d9081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4d6f9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a3130 0x560c1d8e7890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49672/0 (socket says 10.20.193.4:49672) 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4e6fb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8e7dd0 0x560c1d9081b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:53516/0 (socket says 10.20.193.4:53516) 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4d6f9640 1 -- 10.20.193.4:0/2916548583 learned_addr learned my addr 10.20.193.4:0/2916548583 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4e6fb640 1 -- 10.20.193.4:0/2916548583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8a2820 msgr2=0x560c1d8a2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/2916548583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8a2820 0x560c1d8a2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4e6fb640 1 -- 10.20.193.4:0/2916548583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a3130 msgr2=0x560c1d8e7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/2916548583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a3130 0x560c1d8e7890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4e6fb640 1 -- 10.20.193.4:0/2916548583 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1d754310 con 0x560c1d8e7dd0 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4d6f9640 1 --2- 10.20.193.4:0/2916548583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a3130 0x560c1d8e7890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.786+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/2916548583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8e7dd0 0x560c1d9081b0 secure :-1 s=READY pgs=94 gs=3 cs=0 l=1 c_cookie=10604974096331207500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e440ae280 tx=0x7f1e44011d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=932c6fc0c80a734c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e164e6640 1 -- 10.20.193.4:0/2916548583 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e440aea10 con 0x560c1d8e7dd0 2026-02-24T09:12:39.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e164e6640 1 -- 10.20.193.4:0/2916548583 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1e44097040 con 0x560c1d8e7dd0 2026-02-24T09:12:39.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e164e6640 1 -- 10.20.193.4:0/2916548583 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e44011860 con 0x560c1d8e7dd0 2026-02-24T09:12:39.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e5217fe00 1 -- 10.20.193.4:0/2916548583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8e7dd0 msgr2=0x560c1d9081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:39.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/2916548583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8e7dd0 0x560c1d9081b0 secure :-1 s=READY pgs=94 gs=3 cs=0 l=1 c_cookie=10604974096331207500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e440ae280 tx=0x7f1e44011d70 comp rx=0 tx=0).stop 2026-02-24T09:12:39.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e5217fe00 1 -- 10.20.193.4:0/2916548583 shutdown_connections 2026-02-24T09:12:39.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/2916548583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8e7dd0 0x560c1d9081b0 unknown :-1 s=CLOSED pgs=94 gs=3 cs=0 l=1 c_cookie=10604974096331207500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/2916548583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a3130 0x560c1d8e7890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/2916548583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8a2820 0x560c1d8a2bf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e5217fe00 1 -- 10.20.193.4:0/2916548583 >> 10.20.193.4:0/2916548583 conn(0x560c1d7c16b0 msgr2=0x560c1d8a1100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:39.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e5217fe00 1 -- 10.20.193.4:0/2916548583 shutdown_connections 2026-02-24T09:12:39.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.787+0000 7f1e5217fe00 1 -- 10.20.193.4:0/2916548583 wait complete. 2026-02-24T09:12:39.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e5217fe00 1 -- start start 2026-02-24T09:12:39.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e5217fe00 1 Processor -- start 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8baea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8bb3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e7dd0 0x560c1d8c03d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560c1d8c0910 con 0x560c1d8a2820 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560c1d8c0a80 con 0x560c1d8e7dd0 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560c1d8c0c40 con 0x560c1d8a3130 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e4defa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e4defa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8baea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49682/0 (socket says 10.20.193.4:49682) 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e4defa640 1 -- 10.20.193.4:0/3576628549 learned_addr learned my addr 10.20.193.4:0/3576628549 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e7dd0 0x560c1d8c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.789+0000 7f1e4d6f9640 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8bb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.790+0000 7f1e4e6fb640 1 -- 10.20.193.4:0/3576628549 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 msgr2=0x560c1d8bb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.790+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8bb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.790+0000 7f1e4e6fb640 1 -- 10.20.193.4:0/3576628549 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 msgr2=0x560c1d8baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:39.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.790+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.790+0000 7f1e4e6fb640 1 -- 10.20.193.4:0/3576628549 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e480fbd30 con 0x560c1d8e7dd0 2026-02-24T09:12:39.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.790+0000 7f1e4defa640 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8baea0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:12:39.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.790+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e7dd0 0x560c1d8c03d0 secure :-1 s=READY pgs=78 gs=3 cs=0 l=1 c_cookie=10284322235147323816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e440adff0 tx=0x7f1e44005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eb940958d9b89a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:39.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.790+0000 7f1e037fe640 10 client.0 ms_handle_connect on v2:10.20.193.14:3300/0 2026-02-24T09:12:39.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.791+0000 7f1e037fe640 1 -- 10.20.193.4:0/3576628549 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e44070070 con 0x560c1d8e7dd0 2026-02-24T09:12:39.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.791+0000 7f1e037fe640 1 -- 10.20.193.4:0/3576628549 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1e440b3d30 con 0x560c1d8e7dd0 2026-02-24T09:12:39.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.791+0000 7f1e037fe640 1 -- 10.20.193.4:0/3576628549 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e440b8cc0 con 0x560c1d8e7dd0 2026-02-24T09:12:39.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.791+0000 7f1e5217fe00 1 -- 10.20.193.4:0/3576628549 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e3c004530 con 0x560c1d8e7dd0 2026-02-24T09:12:39.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.791+0000 7f1e037fe640 1 -- 10.20.193.4:0/3576628549 <== mon.2 v2:10.20.193.14:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1e440b8e90 con 0x560c1d8e7dd0 2026-02-24T09:12:39.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.791+0000 7f1e037fe640 10 client.25730 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:39.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.791+0000 7f1e5217fe00 10 client.25730 _ll_register_callbacks cb 0x560c1d744160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:39.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.791+0000 7f1e5217fe00 1 -- 10.20.193.4:0/3576628549 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c1d4f84a0 con 0x560c1d8e7dd0 2026-02-24T09:12:39.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.794+0000 7f1e037fe640 1 -- 10.20.193.4:0/3576628549 <== mon.2 v2:10.20.193.14:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1e440b9150 con 0x560c1d8e7dd0 2026-02-24T09:12:39.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.794+0000 7f1e5217fe00 10 client.25730 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:39.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.794+0000 7f1e5217fe00 1 -- 10.20.193.4:0/3576628549 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({fsmap=19}) -- 0x560c1d72c8c0 con 0x560c1d8e7dd0 2026-02-24T09:12:39.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.794+0000 7f1e037fe640 1 -- 10.20.193.4:0/3576628549 <== mon.2 v2:10.20.193.14:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f1e44073110 con 0x560c1d8e7dd0 2026-02-24T09:12:39.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.794+0000 7f1e5217fe00 10 client.25730 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:39.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.794+0000 7f1e5217fe00 10 client.25730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:39.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.794+0000 7f1e5217fe00 20 client.25730 populate_metadata read hostname 'trial004' 2026-02-24T09:12:39.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.794+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560c1d8e5070 0x560c1d8e54e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.794+0000 7f1e5217fe00 4 client.25730 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:39.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.795+0000 7f1e5217fe00 1 -- 10.20.193.4:0/3576628549 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c1d79e4f0 con 0x560c1d8e5070 2026-02-24T09:12:39.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.795+0000 7f1e4defa640 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560c1d8e5070 0x560c1d8e54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.796+0000 7f1e037fe640 10 client.25730 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:39.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.796+0000 7f1e4defa640 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560c1d8e5070 0x560c1d8e54e0 crc :-1 s=READY pgs=77 gs=4 cs=0 l=0 c_cookie=13622311636481974740 s_cookie=2257511339319296499 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd0c2c42602da1d4 server_cookie=1f544a9a308b01f3 in_seq=0 out_seq=0 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.796+0000 7f1e037fe640 1 -- 10.20.193.4:0/3576628549 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x560c1d79e4f0 con 0x560c1d8e5070 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.796+0000 7f1e037fe640 10 client.25730 handle_command_reply: tid=0 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.796+0000 7f1e5217fe00 1 client.25730 shutdown 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 1 -- 10.20.193.4:0/3576628549 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e7dd0 msgr2=0x560c1d8c03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e7dd0 0x560c1d8c03d0 secure :-1 s=READY pgs=78 gs=3 cs=0 l=1 c_cookie=10284322235147323816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e440adff0 tx=0x7f1e44005270 comp rx=0 tx=0).stop 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 1 -- 10.20.193.4:0/3576628549 shutdown_connections 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560c1d8e5070 0x560c1d8e54e0 crc :-1 s=READY pgs=77 gs=4 cs=0 l=0 c_cookie=13622311636481974740 s_cookie=2257511339319296499 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e7dd0 0x560c1d8c03d0 unknown :-1 s=CLOSED pgs=78 gs=3 cs=0 l=1 c_cookie=10284322235147323816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8bb3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e037fe640 0 client.25730 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/3576628549 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8baea0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 1 -- 10.20.193.4:0/3576628549 >> 10.20.193.4:0/3576628549 conn(0x560c1d7c16b0 msgr2=0x560c1d8a1810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 1 -- 10.20.193.4:0/3576628549 shutdown_connections 2026-02-24T09:12:39.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 1 -- 10.20.193.4:0/3576628549 wait complete. 2026-02-24T09:12:39.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.797+0000 7f1e5217fe00 20 client.25730 trim_cache size 0 max 16384 2026-02-24T09:12:39.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e5217fe00 1 Processor -- start 2026-02-24T09:12:39.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e5217fe00 1 -- start start 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8a1900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8a1e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e5070 0x560c1d8e6dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560c1d7a66e0 con 0x560c1d8a2820 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560c1d471f50 con 0x560c1d8e5070 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560c1d815150 con 0x560c1d8a3130 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4defa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4defa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49692/0 (socket says 10.20.193.4:49692) 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4defa640 1 -- 10.20.193.4:0/2398047538 learned_addr learned my addr 10.20.193.4:0/2398047538 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/2398047538 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e5070 0x560c1d8e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4d6f9640 1 --2- 10.20.193.4:0/2398047538 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4defa640 1 -- 10.20.193.4:0/2398047538 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 msgr2=0x560c1d8a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4defa640 1 --2- 10.20.193.4:0/2398047538 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4defa640 1 -- 10.20.193.4:0/2398047538 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e5070 msgr2=0x560c1d8e6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4defa640 1 --2- 10.20.193.4:0/2398047538 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e5070 0x560c1d8e6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4defa640 1 -- 10.20.193.4:0/2398047538 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1d8ad3a0 con 0x560c1d8a2820 2026-02-24T09:12:39.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.809+0000 7f1e4defa640 1 --2- 10.20.193.4:0/2398047538 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8a1900 secure :-1 s=READY pgs=672 gs=1 cs=0 l=1 c_cookie=6972413490223282276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e38002d30 tx=0x7f1e38040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c2fd20bfe67864 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.810+0000 7f1e15ce5640 1 -- 10.20.193.4:0/2398047538 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e38002820 con 0x560c1d8a2820 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.810+0000 7f1e15ce5640 1 -- 10.20.193.4:0/2398047538 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1e38002980 con 0x560c1d8a2820 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.810+0000 7f1e15ce5640 1 -- 10.20.193.4:0/2398047538 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e38058970 con 0x560c1d8a2820 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.811+0000 7f1e5217fe00 1 -- 10.20.193.4:0/2398047538 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 msgr2=0x560c1d8a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.811+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/2398047538 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8a1900 secure :-1 s=READY pgs=672 gs=1 cs=0 l=1 c_cookie=6972413490223282276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e38002d30 tx=0x7f1e38040000 comp rx=0 tx=0).stop 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.811+0000 7f1e5217fe00 1 -- 10.20.193.4:0/2398047538 shutdown_connections 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.811+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/2398047538 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e5070 0x560c1d8e6dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.811+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/2398047538 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8a1e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.811+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/2398047538 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8a1900 unknown :-1 s=CLOSED pgs=672 gs=1 cs=0 l=1 c_cookie=6972413490223282276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.811+0000 7f1e5217fe00 1 -- 10.20.193.4:0/2398047538 >> 10.20.193.4:0/2398047538 conn(0x560c1d7c16b0 msgr2=0x560c1d8a11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.811+0000 7f1e5217fe00 1 -- 10.20.193.4:0/2398047538 shutdown_connections 2026-02-24T09:12:39.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.811+0000 7f1e5217fe00 1 -- 10.20.193.4:0/2398047538 wait complete. 2026-02-24T09:12:39.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.811+0000 7f1e5217fe00 1 -- start start 2026-02-24T09:12:39.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e5217fe00 1 Processor -- start 2026-02-24T09:12:39.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8c70e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8c45e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e5217fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e5070 0x560c1d8c4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560c1d8c5310 con 0x560c1d8a2820 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560c1d8c5480 con 0x560c1d8e5070 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e5217fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560c1d94d350 con 0x560c1d8a3130 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4defa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4defa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49694/0 (socket says 10.20.193.4:49694) 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4defa640 1 -- 10.20.193.4:0/1169460696 learned_addr learned my addr 10.20.193.4:0/1169460696 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4d6f9640 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4e6fb640 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e5070 0x560c1d8c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4defa640 1 -- 10.20.193.4:0/1169460696 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 msgr2=0x560c1d8c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4defa640 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4defa640 1 -- 10.20.193.4:0/1169460696 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e5070 msgr2=0x560c1d8c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4defa640 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e5070 0x560c1d8c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4defa640 1 -- 10.20.193.4:0/1169460696 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1d73e6e0 con 0x560c1d8a2820 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e4defa640 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8c70e0 secure :-1 s=READY pgs=673 gs=1 cs=0 l=1 c_cookie=5790655168604856699 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e3802f210 tx=0x7f1e38009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505c8a321578e17b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e037fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e037fe640 1 -- 10.20.193.4:0/1169460696 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e38002820 con 0x560c1d8a2820 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e037fe640 1 -- 10.20.193.4:0/1169460696 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1e38038aa0 con 0x560c1d8a2820 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e037fe640 1 -- 10.20.193.4:0/1169460696 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e380043f0 con 0x560c1d8a2820 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e5217fe00 1 -- 10.20.193.4:0/1169460696 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e48174800 con 0x560c1d8a2820 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e037fe640 1 -- 10.20.193.4:0/1169460696 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1e380526c0 con 0x560c1d8a2820 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.812+0000 7f1e037fe640 10 client.16257 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e5217fe00 10 client.16257 _ll_register_callbacks cb 0x560c1d744160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e5217fe00 1 -- 10.20.193.4:0/1169460696 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e44097040 con 0x560c1d8a2820 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e037fe640 1 -- 10.20.193.4:0/1169460696 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1e3802f9f0 con 0x560c1d8a2820 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e5217fe00 10 client.16257 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e5217fe00 1 -- 10.20.193.4:0/1169460696 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x560c1d739160 con 0x560c1d8a2820 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e037fe640 1 -- 10.20.193.4:0/1169460696 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f1e3805f020 con 0x560c1d8a2820 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e5217fe00 10 client.16257 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e5217fe00 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e5217fe00 20 client.16257 populate_metadata read hostname 'trial004' 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560c1d8e7dd0 0x560c1d9b4ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e5217fe00 4 client.16257 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e5217fe00 1 -- 10.20.193.4:0/1169460696 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560c1d4dd160 con 0x560c1d8e7dd0 2026-02-24T09:12:39.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.813+0000 7f1e4d6f9640 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560c1d8e7dd0 0x560c1d9b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e037fe640 10 client.16257 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e4d6f9640 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560c1d8e7dd0 0x560c1d9b4ef0 crc :-1 s=READY pgs=78 gs=4 cs=0 l=0 c_cookie=3078582011083618853 s_cookie=18234105261862145598 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ab952072e8bfa25 server_cookie=fd0c8e20925fce3e in_seq=0 out_seq=0 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e037fe640 1 -- 10.20.193.4:0/1169460696 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x560c1d4dd160 con 0x560c1d8e7dd0 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e037fe640 10 client.16257 handle_command_reply: tid=0 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 client.16257 shutdown 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 -- 10.20.193.4:0/1169460696 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 msgr2=0x560c1d8c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8c70e0 secure :-1 s=READY pgs=673 gs=1 cs=0 l=1 c_cookie=5790655168604856699 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e3802f210 tx=0x7f1e38009290 comp rx=0 tx=0).stop 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 -- 10.20.193.4:0/1169460696 shutdown_connections 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x560c1d8e7dd0 0x560c1d9b4ef0 crc :-1 s=READY pgs=78 gs=4 cs=0 l=0 c_cookie=3078582011083618853 s_cookie=18234105261862145598 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560c1d8e5070 0x560c1d8c4c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e037fe640 0 client.16257 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560c1d8a3130 0x560c1d8c45e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 --2- 10.20.193.4:0/1169460696 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560c1d8a2820 0x560c1d8c70e0 unknown :-1 s=CLOSED pgs=673 gs=1 cs=0 l=1 c_cookie=5790655168604856699 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 -- 10.20.193.4:0/1169460696 >> 10.20.193.4:0/1169460696 conn(0x560c1d7c16b0 msgr2=0x560c1d8a1900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 -- 10.20.193.4:0/1169460696 shutdown_connections 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 1 -- 10.20.193.4:0/1169460696 wait complete. 2026-02-24T09:12:39.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.814+0000 7f1e5217fe00 20 client.16257 trim_cache size 0 max 16384 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:39.819 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 -- 10.20.193.4:0/2260383584 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1e240b5750 msgr2=0x7f1e240d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:39.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1e240b5750 0x7f1e240d5c00 secure :-1 s=READY pgs=322 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e380023d0 tx=0x7f1e38031040 comp rx=0 tx=0).stop 2026-02-24T09:12:39.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 -- 10.20.193.4:0/2260383584 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1e481135c0 msgr2=0x7f1e480f6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:39.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1e481135c0 0x7f1e480f6040 secure :-1 s=READY pgs=671 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e4400e650 tx=0x7f1e4400eb20 comp rx=0 tx=0).stop 2026-02-24T09:12:39.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 -- 10.20.193.4:0/2260383584 shutdown_connections 2026-02-24T09:12:39.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1e240b5750 0x7f1e240d5c00 unknown :-1 s=CLOSED pgs=322 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1e481135c0 0x7f1e480f6040 unknown :-1 s=CLOSED pgs=671 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1e4810ddc0 0x7f1e48173e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 --2- 10.20.193.4:0/2260383584 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1e4810d3d0 0x7f1e480f5940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:39.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 -- 10.20.193.4:0/2260383584 >> 10.20.193.4:0/2260383584 conn(0x7f1e480eaca0 msgr2=0x7f1e481105c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:39.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 -- 10.20.193.4:0/2260383584 shutdown_connections 2026-02-24T09:12:39.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:39.815+0000 7f1e50185640 1 -- 10.20.193.4:0/2260383584 wait complete. 2026-02-24T09:12:39.924 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:12:39.924 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:12:40.078 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:40.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 -- 10.20.193.4:0/2927132074 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33b41158b0 msgr2=0x7f33b4176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 --2- 10.20.193.4:0/2927132074 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33b41158b0 0x7f33b4176280 secure :-1 s=READY pgs=674 gs=1 cs=0 l=1 c_cookie=3662940101008113016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33a400aa30 tx=0x7f33a4030280 comp rx=0 tx=0).stop 2026-02-24T09:12:40.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 -- 10.20.193.4:0/2927132074 shutdown_connections 2026-02-24T09:12:40.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 --2- 10.20.193.4:0/2927132074 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33b41158b0 0x7f33b4176280 unknown :-1 s=CLOSED pgs=674 gs=1 cs=0 l=1 c_cookie=3662940101008113016 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 --2- 10.20.193.4:0/2927132074 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f33b41100b0 0x7f33b4115100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 --2- 10.20.193.4:0/2927132074 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33b410f6c0 0x7f33b410fa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 -- 10.20.193.4:0/2927132074 >> 10.20.193.4:0/2927132074 conn(0x7f33b40ecfd0 msgr2=0x7f33b410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 -- 10.20.193.4:0/2927132074 shutdown_connections 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 -- 10.20.193.4:0/2927132074 wait complete. 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 Processor -- start 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.220+0000 7f33b8c9a640 1 -- start start 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b8c9a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33b410f6c0 0x7f33b40f5990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b8c9a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33b41100b0 0x7f33b4176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b8c9a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f33b41158b0 0x7f33b40f6090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b8c9a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f33b40fb2a0 con 0x7f33b41100b0 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b8c9a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f33b40fb410 con 0x7f33b410f6c0 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b8c9a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f33b40fb5d0 con 0x7f33b41158b0 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b1d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33b41100b0 0x7f33b4176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b1d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33b41100b0 0x7f33b4176180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49714/0 (socket says 10.20.193.4:49714) 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b1d74640 1 -- 10.20.193.4:0/796663174 learned_addr learned my addr 10.20.193.4:0/796663174 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b2d76640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f33b41158b0 0x7f33b40f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b2575640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33b410f6c0 0x7f33b40f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b1d74640 1 -- 10.20.193.4:0/796663174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f33b41158b0 msgr2=0x7f33b40f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b1d74640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f33b41158b0 0x7f33b40f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b1d74640 1 -- 10.20.193.4:0/796663174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33b410f6c0 msgr2=0x7f33b40f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b1d74640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33b410f6c0 0x7f33b40f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b1d74640 1 -- 10.20.193.4:0/796663174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a400a650 con 0x7f33b41100b0 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b1d74640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33b41100b0 0x7f33b4176180 secure :-1 s=READY pgs=675 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f339c009480 tx=0x7f339c00ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f339b7fe640 1 -- 10.20.193.4:0/796663174 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f339c00cce0 con 0x7f33b41100b0 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b8c9a640 1 -- 10.20.193.4:0/796663174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b40fb8b0 con 0x7f33b41100b0 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f33b8c9a640 1 -- 10.20.193.4:0/796663174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b40fbd80 con 0x7f33b41100b0 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f339b7fe640 1 -- 10.20.193.4:0/796663174 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f339c00ce40 con 0x7f33b41100b0 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.221+0000 7f339b7fe640 1 -- 10.20.193.4:0/796663174 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f339c0106b0 con 0x7f33b41100b0 2026-02-24T09:12:40.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.222+0000 7f33b8c9a640 1 -- 10.20.193.4:0/796663174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b41109a0 con 0x7f33b41100b0 2026-02-24T09:12:40.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.224+0000 7f339b7fe640 1 -- 10.20.193.4:0/796663174 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f339c01f060 con 0x7f33b41100b0 2026-02-24T09:12:40.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.225+0000 7f339b7fe640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f338c0b56d0 0x7f338c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.226+0000 7f339b7fe640 1 -- 10.20.193.4:0/796663174 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f339c014070 con 0x7f33b41100b0 2026-02-24T09:12:40.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.226+0000 7f33b2575640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f338c0b56d0 0x7f338c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.226+0000 7f339b7fe640 1 -- 10.20.193.4:0/796663174 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f339c11f930 con 0x7f33b41100b0 2026-02-24T09:12:40.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.226+0000 7f33b2575640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f338c0b56d0 0x7f338c0d5b80 secure :-1 s=READY pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33a8004740 tx=0x7f33a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:40.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.387+0000 7f33b8c9a640 1 -- 10.20.193.4:0/796663174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33b410fa90 con 0x7f33b41100b0 2026-02-24T09:12:40.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.387+0000 7f339b7fe640 1 -- 10.20.193.4:0/796663174 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f339c0a96c0 con 0x7f33b41100b0 2026-02-24T09:12:40.392 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:12:40.392 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:12:40.392 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:12:40.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 -- 10.20.193.4:0/796663174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f338c0b56d0 msgr2=0x7f338c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f338c0b56d0 0x7f338c0d5b80 secure :-1 s=READY pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33a8004740 tx=0x7f33a8005f90 comp rx=0 tx=0).stop 2026-02-24T09:12:40.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 -- 10.20.193.4:0/796663174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33b41100b0 msgr2=0x7f33b4176180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33b41100b0 0x7f33b4176180 secure :-1 s=READY pgs=675 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f339c009480 tx=0x7f339c00ede0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 -- 10.20.193.4:0/796663174 shutdown_connections 2026-02-24T09:12:40.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f338c0b56d0 0x7f338c0d5b80 unknown :-1 s=CLOSED pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f33b41158b0 0x7f33b40f6090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f33b41100b0 0x7f33b4176180 unknown :-1 s=CLOSED pgs=675 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 --2- 10.20.193.4:0/796663174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f33b410f6c0 0x7f33b40f5990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 -- 10.20.193.4:0/796663174 >> 10.20.193.4:0/796663174 conn(0x7f33b40ecfd0 msgr2=0x7f33b4111ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:40.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 -- 10.20.193.4:0/796663174 shutdown_connections 2026-02-24T09:12:40.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.392+0000 7f33b8c9a640 1 -- 10.20.193.4:0/796663174 wait complete. 2026-02-24T09:12:40.467 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:12:40.634 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:40.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.799+0000 7f09702c0640 1 -- 10.20.193.4:0/1258520410 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09681100d0 msgr2=0x7f0968115120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.799+0000 7f09702c0640 1 --2- 10.20.193.4:0/1258520410 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09681100d0 0x7f0968115120 secure :-1 s=READY pgs=676 gs=1 cs=0 l=1 c_cookie=4852980204436542755 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f095c009950 tx=0x7f095c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.799+0000 7f09702c0640 1 -- 10.20.193.4:0/1258520410 shutdown_connections 2026-02-24T09:12:40.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.799+0000 7f09702c0640 1 --2- 10.20.193.4:0/1258520410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09681158d0 0x7f09681762a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.799+0000 7f09702c0640 1 --2- 10.20.193.4:0/1258520410 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09681100d0 0x7f0968115120 unknown :-1 s=CLOSED pgs=676 gs=1 cs=0 l=1 c_cookie=4852980204436542755 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.799+0000 7f09702c0640 1 --2- 10.20.193.4:0/1258520410 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f096810f6e0 0x7f096810fab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.799+0000 7f09702c0640 1 -- 10.20.193.4:0/1258520410 >> 10.20.193.4:0/1258520410 conn(0x7f09680ecf70 msgr2=0x7f096810d380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:40.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.799+0000 7f09702c0640 1 -- 10.20.193.4:0/1258520410 shutdown_connections 2026-02-24T09:12:40.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.799+0000 7f09702c0640 1 -- 10.20.193.4:0/1258520410 wait complete. 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f09702c0640 1 Processor -- start 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f09702c0640 1 -- start start 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f09702c0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f096810f6e0 0x7f09680f5910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f09702c0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09681100d0 0x7f09681761a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f09702c0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09681158d0 0x7f09680f6010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f09702c0640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f09680fb220 con 0x7f09681158d0 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f09702c0640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f09680fb390 con 0x7f096810f6e0 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f09702c0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f09680fb550 con 0x7f09681100d0 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f096e836640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09681158d0 0x7f09680f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f096e836640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09681158d0 0x7f09680f6010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49722/0 (socket says 10.20.193.4:49722) 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.800+0000 7f096e836640 1 -- 10.20.193.4:0/759013896 learned_addr learned my addr 10.20.193.4:0/759013896 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:40.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f096d834640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09681100d0 0x7f09681761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f096e836640 1 -- 10.20.193.4:0/759013896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09681100d0 msgr2=0x7f09681761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f096e836640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09681100d0 0x7f09681761a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f096e836640 1 -- 10.20.193.4:0/759013896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f096810f6e0 msgr2=0x7f09680f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f096e836640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f096810f6e0 0x7f09680f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f096e836640 1 -- 10.20.193.4:0/759013896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c009570 con 0x7f09681158d0 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f096e836640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09681158d0 0x7f09680f6010 secure :-1 s=READY pgs=677 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0964006e90 tx=0x7f096400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f094f7fe640 1 -- 10.20.193.4:0/759013896 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0964005500 con 0x7f09681158d0 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f09702c0640 1 -- 10.20.193.4:0/759013896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09680fb830 con 0x7f09681158d0 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f094f7fe640 1 -- 10.20.193.4:0/759013896 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0964005e10 con 0x7f09681158d0 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f094f7fe640 1 -- 10.20.193.4:0/759013896 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0964003a90 con 0x7f09681158d0 2026-02-24T09:12:40.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.801+0000 7f09702c0640 1 -- 10.20.193.4:0/759013896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09680fbd00 con 0x7f09681158d0 2026-02-24T09:12:40.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.805+0000 7f094f7fe640 1 -- 10.20.193.4:0/759013896 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f096400c840 con 0x7f09681158d0 2026-02-24T09:12:40.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.805+0000 7f094f7fe640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09440b56d0 0x7f09440d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.805+0000 7f096e035640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09440b56d0 0x7f09440d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.805+0000 7f094f7fe640 1 -- 10.20.193.4:0/759013896 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f09640e7a50 con 0x7f09681158d0 2026-02-24T09:12:40.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.805+0000 7f096e035640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09440b56d0 0x7f09440d5b80 secure :-1 s=READY pgs=324 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0958004740 tx=0x7f0958005ca0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:40.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f09722bae00 1 Processor -- start 2026-02-24T09:12:40.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f09722bae00 1 -- start start 2026-02-24T09:12:40.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f09722bae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9c320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f09722bae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 0x559ee2fe0fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f09722bae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 0x559ee30018e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f09722bae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559ee2eacee0 con 0x559ee2f9bf50 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f09722bae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559ee2ea8c10 con 0x559ee2fe1500 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f09722bae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559ee2ea2d70 con 0x559ee2f9c860 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096e035640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9c320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096e035640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9c320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49734/0 (socket says 10.20.193.4:49734) 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096e035640 1 -- 10.20.193.4:0/676664108 learned_addr learned my addr 10.20.193.4:0/676664108 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096e836640 1 --2- 10.20.193.4:0/676664108 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 0x559ee30018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096d834640 1 --2- 10.20.193.4:0/676664108 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 0x559ee2fe0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096e035640 1 -- 10.20.193.4:0/676664108 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 msgr2=0x559ee2fe0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096e035640 1 --2- 10.20.193.4:0/676664108 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 0x559ee2fe0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096e035640 1 -- 10.20.193.4:0/676664108 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 msgr2=0x559ee30018e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096e035640 1 --2- 10.20.193.4:0/676664108 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 0x559ee30018e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096e035640 1 -- 10.20.193.4:0/676664108 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee2e4e340 con 0x559ee2f9bf50 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.808+0000 7f096d834640 1 --2- 10.20.193.4:0/676664108 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 0x559ee2fe0fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f096e035640 1 --2- 10.20.193.4:0/676664108 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9c320 secure :-1 s=READY pgs=678 gs=1 cs=0 l=1 c_cookie=8616505580213557572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f095800a640 tx=0x7f095800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7793fa2c49ccd944 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f094c884640 1 -- 10.20.193.4:0/676664108 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0958004540 con 0x559ee2f9bf50 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f094c884640 1 -- 10.20.193.4:0/676664108 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f095800fe70 con 0x559ee2f9bf50 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f094c884640 1 -- 10.20.193.4:0/676664108 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f095800eaa0 con 0x559ee2f9bf50 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 -- 10.20.193.4:0/676664108 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 msgr2=0x559ee2f9c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 --2- 10.20.193.4:0/676664108 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9c320 secure :-1 s=READY pgs=678 gs=1 cs=0 l=1 c_cookie=8616505580213557572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f095800a640 tx=0x7f095800f000 comp rx=0 tx=0).stop 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 -- 10.20.193.4:0/676664108 shutdown_connections 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 --2- 10.20.193.4:0/676664108 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 0x559ee30018e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 --2- 10.20.193.4:0/676664108 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 0x559ee2fe0fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 --2- 10.20.193.4:0/676664108 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9c320 unknown :-1 s=CLOSED pgs=678 gs=1 cs=0 l=1 c_cookie=8616505580213557572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 -- 10.20.193.4:0/676664108 >> 10.20.193.4:0/676664108 conn(0x559ee2ebadb0 msgr2=0x559ee2f9a830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:40.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 -- 10.20.193.4:0/676664108 shutdown_connections 2026-02-24T09:12:40.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 -- 10.20.193.4:0/676664108 wait complete. 2026-02-24T09:12:40.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 -- start start 2026-02-24T09:12:40.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.809+0000 7f09722bae00 1 Processor -- start 2026-02-24T09:12:40.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2ff8d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 0x559ee2ff9260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 0x559ee2ffe250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559ee2ffe790 con 0x559ee2f9bf50 2026-02-24T09:12:40.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559ee2ffe900 con 0x559ee2fe1500 2026-02-24T09:12:40.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559ee2ffeac0 con 0x559ee2f9c860 2026-02-24T09:12:40.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e035640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2ff8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e035640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2ff8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49744/0 (socket says 10.20.193.4:49744) 2026-02-24T09:12:40.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e035640 1 -- 10.20.193.4:0/3934070044 learned_addr learned my addr 10.20.193.4:0/3934070044 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:40.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e836640 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 0x559ee2ffe250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096d834640 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 0x559ee2ff9260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e035640 1 -- 10.20.193.4:0/3934070044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 msgr2=0x559ee2ff9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e035640 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 0x559ee2ff9260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e035640 1 -- 10.20.193.4:0/3934070044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 msgr2=0x559ee2ffe250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e035640 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 0x559ee2ffe250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e035640 1 -- 10.20.193.4:0/3934070044 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee2e269d0 con 0x559ee2f9bf50 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e836640 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 0x559ee2ffe250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f096e035640 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2ff8d20 secure :-1 s=READY pgs=679 gs=1 cs=0 l=1 c_cookie=1606597971186371062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0958020040 tx=0x7f095800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164bc857b96d49f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f091bfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f091bfff640 1 -- 10.20.193.4:0/3934070044 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f095800e3b0 con 0x559ee2f9bf50 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 1 -- 10.20.193.4:0/3934070044 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095800ca10 con 0x559ee2f9bf50 2026-02-24T09:12:40.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f091bfff640 1 -- 10.20.193.4:0/3934070044 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f095800ce40 con 0x559ee2f9bf50 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f091bfff640 1 -- 10.20.193.4:0/3934070044 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0958027b50 con 0x559ee2f9bf50 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 10 client.16275 _ll_register_callbacks cb 0x559ee2e4d080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 1 -- 10.20.193.4:0/3934070044 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ee2bf24a0 con 0x559ee2f9bf50 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f091bfff640 1 -- 10.20.193.4:0/3934070044 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0958027ce0 con 0x559ee2f9bf50 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f091bfff640 1 -- 10.20.193.4:0/3934070044 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0958004890 con 0x559ee2f9bf50 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 10 client.16275 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.810+0000 7f09722bae00 1 -- 10.20.193.4:0/3934070044 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559ee2e38710 con 0x559ee2f9bf50 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.811+0000 7f091bfff640 1 -- 10.20.193.4:0/3934070044 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0958004a70 con 0x559ee2f9bf50 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.811+0000 7f09722bae00 10 client.16275 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.811+0000 7f09722bae00 10 client.16275 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.811+0000 7f09722bae00 20 client.16275 populate_metadata read hostname 'trial004' 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.811+0000 7f09722bae00 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559ee2fde540 0x559ee2fde9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.811+0000 7f09722bae00 4 client.16275 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.811+0000 7f09722bae00 1 -- 10.20.193.4:0/3934070044 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ee2e987b0 con 0x559ee2fde540 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.811+0000 7f096d834640 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559ee2fde540 0x559ee2fde9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.812+0000 7f096d834640 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559ee2fde540 0x559ee2fde9e0 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=9955265274087439705 s_cookie=932270137175384684 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a28350582c37d59 server_cookie=cf016c0190b226c in_seq=0 out_seq=0 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.812+0000 7f091bfff640 10 client.16275 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.812+0000 7f091bfff640 1 -- 10.20.193.4:0/3934070044 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559ee2e987b0 con 0x559ee2fde540 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.812+0000 7f091bfff640 10 client.16275 handle_command_reply: tid=0 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.812+0000 7f09722bae00 1 client.16275 shutdown 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.812+0000 7f09722bae00 1 -- 10.20.193.4:0/3934070044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 msgr2=0x559ee2ff8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.812+0000 7f09722bae00 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2ff8d20 secure :-1 s=READY pgs=679 gs=1 cs=0 l=1 c_cookie=1606597971186371062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0958020040 tx=0x7f095800eee0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.813+0000 7f09722bae00 1 -- 10.20.193.4:0/3934070044 shutdown_connections 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.813+0000 7f09722bae00 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559ee2fde540 0x559ee2fde9e0 crc :-1 s=READY pgs=30 gs=4 cs=0 l=0 c_cookie=9955265274087439705 s_cookie=932270137175384684 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.813+0000 7f09722bae00 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2fe1500 0x559ee2ffe250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.813+0000 7f09722bae00 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2f9c860 0x559ee2ff9260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.813+0000 7f091bfff640 0 client.16275 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:40.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.813+0000 7f09722bae00 1 --2- 10.20.193.4:0/3934070044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2ff8d20 unknown :-1 s=CLOSED pgs=679 gs=1 cs=0 l=1 c_cookie=1606597971186371062 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.813+0000 7f09722bae00 1 -- 10.20.193.4:0/3934070044 >> 10.20.193.4:0/3934070044 conn(0x559ee2ebadb0 msgr2=0x559ee2f9a040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:40.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.813+0000 7f09722bae00 1 -- 10.20.193.4:0/3934070044 shutdown_connections 2026-02-24T09:12:40.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.813+0000 7f09722bae00 1 -- 10.20.193.4:0/3934070044 wait complete. 2026-02-24T09:12:40.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.813+0000 7f09722bae00 20 client.16275 trim_cache size 0 max 16384 2026-02-24T09:12:40.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09722bae00 1 Processor -- start 2026-02-24T09:12:40.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09722bae00 1 -- start start 2026-02-24T09:12:40.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09722bae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9b460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09722bae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2f9c860 0x559ee2f9b9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09722bae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2fe1500 0x559ee2ff60f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09722bae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559ee2ea09a0 con 0x559ee2f9bf50 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09722bae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559ee2c7cdf0 con 0x559ee2f9c860 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09722bae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559ee2ff1dd0 con 0x559ee2fe1500 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096e035640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9b460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096e035640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9b460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49748/0 (socket says 10.20.193.4:49748) 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096e035640 1 -- 10.20.193.4:0/144278000 learned_addr learned my addr 10.20.193.4:0/144278000 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096e836640 1 --2- 10.20.193.4:0/144278000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2fe1500 0x559ee2ff60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096e035640 1 -- 10.20.193.4:0/144278000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2fe1500 msgr2=0x559ee2ff60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096d834640 1 --2- 10.20.193.4:0/144278000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2f9c860 0x559ee2f9b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096e035640 1 --2- 10.20.193.4:0/144278000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2fe1500 0x559ee2ff60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096e035640 1 -- 10.20.193.4:0/144278000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2f9c860 msgr2=0x559ee2f9b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096e035640 1 --2- 10.20.193.4:0/144278000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2f9c860 0x559ee2f9b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096e035640 1 -- 10.20.193.4:0/144278000 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee2e33190 con 0x559ee2f9bf50 2026-02-24T09:12:40.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096d834640 1 --2- 10.20.193.4:0/144278000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2f9c860 0x559ee2f9b9a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:40.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f096e035640 1 --2- 10.20.193.4:0/144278000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9b460 secure :-1 s=READY pgs=680 gs=1 cs=0 l=1 c_cookie=11008107676761567063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f095800e660 tx=0x7f0958031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c4a79bca9faf57 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:40.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09364e6640 1 -- 10.20.193.4:0/144278000 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f095800e3b0 con 0x559ee2f9bf50 2026-02-24T09:12:40.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09364e6640 1 -- 10.20.193.4:0/144278000 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559ee2bf24a0 con 0x559ee2f9bf50 2026-02-24T09:12:40.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.822+0000 7f09364e6640 1 -- 10.20.193.4:0/144278000 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f095800e8a0 con 0x559ee2f9bf50 2026-02-24T09:12:40.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.824+0000 7f09722bae00 1 -- 10.20.193.4:0/144278000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 msgr2=0x559ee2f9b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.824+0000 7f09722bae00 1 --2- 10.20.193.4:0/144278000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9b460 secure :-1 s=READY pgs=680 gs=1 cs=0 l=1 c_cookie=11008107676761567063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f095800e660 tx=0x7f0958031000 comp rx=0 tx=0).stop 2026-02-24T09:12:40.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.824+0000 7f09722bae00 1 -- 10.20.193.4:0/144278000 shutdown_connections 2026-02-24T09:12:40.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.824+0000 7f09722bae00 1 --2- 10.20.193.4:0/144278000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2fe1500 0x559ee2ff60f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.824+0000 7f09722bae00 1 --2- 10.20.193.4:0/144278000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2f9c860 0x559ee2f9b9a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.824+0000 7f09722bae00 1 --2- 10.20.193.4:0/144278000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9bf50 0x559ee2f9b460 unknown :-1 s=CLOSED pgs=680 gs=1 cs=0 l=1 c_cookie=11008107676761567063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.824+0000 7f09722bae00 1 -- 10.20.193.4:0/144278000 >> 10.20.193.4:0/144278000 conn(0x559ee2ebadb0 msgr2=0x559ee2ffd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.824+0000 7f09722bae00 1 -- 10.20.193.4:0/144278000 shutdown_connections 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.824+0000 7f09722bae00 1 -- 10.20.193.4:0/144278000 wait complete. 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.824+0000 7f09722bae00 1 -- start start 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 Processor -- start 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2f9bf50 0x559ee2ff5fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9c860 0x559ee2ff64e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2fe1500 0x559ee2f7c050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559ee2ff6af0 con 0x559ee2f9c860 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559ee2ff6c60 con 0x559ee2f9bf50 2026-02-24T09:12:40.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559ee2f7c590 con 0x559ee2fe1500 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f096d834640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9c860 0x559ee2ff64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f096d834640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9c860 0x559ee2ff64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49754/0 (socket says 10.20.193.4:49754) 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f096d834640 1 -- 10.20.193.4:0/2500625224 learned_addr learned my addr 10.20.193.4:0/2500625224 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f096d834640 1 -- 10.20.193.4:0/2500625224 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2fe1500 msgr2=0x559ee2f7c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f096d834640 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2fe1500 0x559ee2f7c050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f096d834640 1 -- 10.20.193.4:0/2500625224 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2f9bf50 msgr2=0x559ee2ff5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f096d834640 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2f9bf50 0x559ee2ff5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f096d834640 1 -- 10.20.193.4:0/2500625224 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee2e26d00 con 0x559ee2f9c860 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f096d834640 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9c860 0x559ee2ff64e0 secure :-1 s=READY pgs=681 gs=1 cs=0 l=1 c_cookie=10563520871461905811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f095c0023d0 tx=0x7f095c002db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92992a43c0e96593 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f091bfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f091bfff640 1 -- 10.20.193.4:0/2500625224 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f095c004270 con 0x559ee2f9c860 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f091bfff640 1 -- 10.20.193.4:0/2500625224 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f095c03e040 con 0x559ee2f9c860 2026-02-24T09:12:40.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 -- 10.20.193.4:0/2500625224 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ee2e38710 con 0x559ee2f9c860 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f091bfff640 1 -- 10.20.193.4:0/2500625224 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f095c038b80 con 0x559ee2f9c860 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 10 client.16281 _ll_register_callbacks cb 0x559ee2e4d080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 -- 10.20.193.4:0/2500625224 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f095800fe70 con 0x559ee2f9c860 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f091bfff640 1 -- 10.20.193.4:0/2500625224 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f095c038d10 con 0x559ee2f9c860 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f091bfff640 1 -- 10.20.193.4:0/2500625224 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f095c0485f0 con 0x559ee2f9c860 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 10 client.16281 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 -- 10.20.193.4:0/2500625224 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559ee2e38970 con 0x559ee2f9c860 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f091bfff640 1 -- 10.20.193.4:0/2500625224 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f095c048810 con 0x559ee2f9c860 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 10 client.16281 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 10 client.16281 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:12:40.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 20 client.16281 populate_metadata read hostname 'trial004' 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559ee308eb50 0x559ee30af000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 4 client.16281 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f09722bae00 1 -- 10.20.193.4:0/2500625224 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559ee2bd7160 con 0x559ee308eb50 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.825+0000 7f096e035640 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559ee308eb50 0x559ee30af000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f091bfff640 10 client.16281 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f096e035640 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559ee308eb50 0x559ee30af000 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=3874350624201605114 s_cookie=9524762405977042288 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35c4755d92d97ffa server_cookie=842ec0f1a241ad70 in_seq=0 out_seq=0 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f091bfff640 1 -- 10.20.193.4:0/2500625224 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559ee2bd7160 con 0x559ee308eb50 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f091bfff640 10 client.16281 handle_command_reply: tid=0 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 client.16281 shutdown 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 -- 10.20.193.4:0/2500625224 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9c860 msgr2=0x559ee2ff64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9c860 0x559ee2ff64e0 secure :-1 s=READY pgs=681 gs=1 cs=0 l=1 c_cookie=10563520871461905811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f095c0023d0 tx=0x7f095c002db0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 -- 10.20.193.4:0/2500625224 shutdown_connections 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x559ee308eb50 0x559ee30af000 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=3874350624201605114 s_cookie=9524762405977042288 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559ee2fe1500 0x559ee2f7c050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559ee2f9c860 0x559ee2ff64e0 unknown :-1 s=CLOSED pgs=681 gs=1 cs=0 l=1 c_cookie=10563520871461905811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f091bfff640 0 client.16281 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:40.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 --2- 10.20.193.4:0/2500625224 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559ee2f9bf50 0x559ee2ff5fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 -- 10.20.193.4:0/2500625224 >> 10.20.193.4:0/2500625224 conn(0x559ee2ebadb0 msgr2=0x559ee2ffbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:40.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 -- 10.20.193.4:0/2500625224 shutdown_connections 2026-02-24T09:12:40.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 1 -- 10.20.193.4:0/2500625224 wait complete. 2026-02-24T09:12:40.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09722bae00 20 client.16281 trim_cache size 0 max 16384 2026-02-24T09:12:40.837 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 -- 10.20.193.4:0/759013896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09440b56d0 msgr2=0x7f09440d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09440b56d0 0x7f09440d5b80 secure :-1 s=READY pgs=324 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0958004740 tx=0x7f0958005ca0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 -- 10.20.193.4:0/759013896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09681158d0 msgr2=0x7f09680f6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09681158d0 0x7f09680f6010 secure :-1 s=READY pgs=677 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0964006e90 tx=0x7f096400edf0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 -- 10.20.193.4:0/759013896 shutdown_connections 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09440b56d0 0x7f09440d5b80 unknown :-1 s=CLOSED pgs=324 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09681158d0 0x7f09680f6010 unknown :-1 s=CLOSED pgs=677 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09681100d0 0x7f09681761a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 --2- 10.20.193.4:0/759013896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f096810f6e0 0x7f09680f5910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 -- 10.20.193.4:0/759013896 >> 10.20.193.4:0/759013896 conn(0x7f09680ecf70 msgr2=0x7f0968111ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 -- 10.20.193.4:0/759013896 shutdown_connections 2026-02-24T09:12:40.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:40.827+0000 7f09702c0640 1 -- 10.20.193.4:0/759013896 wait complete. 2026-02-24T09:12:40.938 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:40 trial004 ceph-mon[41596]: pgmap v238: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 864 MiB/s wr, 243 op/s 2026-02-24T09:12:40.938 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:40 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/796663174' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:12:40.939 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:12:41.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:40 trial090 ceph-mon[47278]: pgmap v238: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 864 MiB/s wr, 243 op/s 2026-02-24T09:12:41.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:40 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/796663174' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:12:41.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:40 trial014 ceph-mon[46941]: pgmap v238: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 864 MiB/s wr, 243 op/s 2026-02-24T09:12:41.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:40 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/796663174' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:12:41.100 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 -- 10.20.193.4:0/2660293378 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26d8112480 msgr2=0x7f26d8172e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 --2- 10.20.193.4:0/2660293378 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26d8112480 0x7f26d8172e50 secure :-1 s=READY pgs=682 gs=1 cs=0 l=1 c_cookie=15498488221495564026 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c800aa30 tx=0x7f26c8030280 comp rx=0 tx=0).stop 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 -- 10.20.193.4:0/2660293378 shutdown_connections 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 --2- 10.20.193.4:0/2660293378 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26d8112480 0x7f26d8172e50 unknown :-1 s=CLOSED pgs=682 gs=1 cs=0 l=1 c_cookie=15498488221495564026 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 --2- 10.20.193.4:0/2660293378 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26d810cc80 0x7f26d8111cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 --2- 10.20.193.4:0/2660293378 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26d810c290 0x7f26d810c660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 -- 10.20.193.4:0/2660293378 >> 10.20.193.4:0/2660293378 conn(0x7f26d80e9b80 msgr2=0x7f26d8109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 -- 10.20.193.4:0/2660293378 shutdown_connections 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 -- 10.20.193.4:0/2660293378 wait complete. 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 Processor -- start 2026-02-24T09:12:41.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 -- start start 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26d810c290 0x7f26d80f4df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26d810cc80 0x7f26d8172d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26d8112480 0x7f26d80f54f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f26d80fa700 con 0x7f26d810cc80 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f26d80fa870 con 0x7f26d810c290 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.247+0000 7f26dd50a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26d80faa30 con 0x7f26d8112480 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d67fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26d810cc80 0x7f26d8172d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d67fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26d810cc80 0x7f26d8172d50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49766/0 (socket says 10.20.193.4:49766) 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d67fc640 1 -- 10.20.193.4:0/1562865731 learned_addr learned my addr 10.20.193.4:0/1562865731 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26d810c290 0x7f26d80f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d77fe640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26d8112480 0x7f26d80f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d67fc640 1 -- 10.20.193.4:0/1562865731 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26d8112480 msgr2=0x7f26d80f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d67fc640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26d8112480 0x7f26d80f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d67fc640 1 -- 10.20.193.4:0/1562865731 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26d810c290 msgr2=0x7f26d80f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d67fc640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26d810c290 0x7f26d80f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d67fc640 1 -- 10.20.193.4:0/1562865731 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26cc0094b0 con 0x7f26d810cc80 2026-02-24T09:12:41.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26d67fc640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26d810cc80 0x7f26d8172d50 secure :-1 s=READY pgs=683 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c0009480 tx=0x7f26c000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26b7fff640 1 -- 10.20.193.4:0/1562865731 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26c000cd40 con 0x7f26d810cc80 2026-02-24T09:12:41.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26dd50a640 1 -- 10.20.193.4:0/1562865731 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c800a650 con 0x7f26d810cc80 2026-02-24T09:12:41.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26b7fff640 1 -- 10.20.193.4:0/1562865731 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26c0004d30 con 0x7f26d810cc80 2026-02-24T09:12:41.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26b7fff640 1 -- 10.20.193.4:0/1562865731 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26c00106b0 con 0x7f26d810cc80 2026-02-24T09:12:41.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.248+0000 7f26dd50a640 1 -- 10.20.193.4:0/1562865731 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d80fb0a0 con 0x7f26d810cc80 2026-02-24T09:12:41.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.251+0000 7f26b7fff640 1 -- 10.20.193.4:0/1562865731 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f26c001f060 con 0x7f26d810cc80 2026-02-24T09:12:41.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.252+0000 7f26b7fff640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f26ac0b56d0 0x7f26ac0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.252+0000 7f26b7fff640 1 -- 10.20.193.4:0/1562865731 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f26c0014070 con 0x7f26d810cc80 2026-02-24T09:12:41.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.252+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f26ac0b56d0 0x7f26ac0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.252+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f26ac0b56d0 0x7f26ac0d5b80 secure :-1 s=READY pgs=325 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26cc004740 tx=0x7f26cc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26df504e00 1 Processor -- start 2026-02-24T09:12:41.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26df504e00 1 -- start start 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26df504e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6af50 0x55aca7f6b320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26df504e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7faffc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26df504e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7fb0500 0x55aca7fd08e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26df504e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55aca7e7bee0 con 0x55aca7f6b860 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26df504e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55aca7e77c10 con 0x55aca7fb0500 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26df504e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55aca7e71d70 con 0x55aca7f6af50 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26d67fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7faffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26d77fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7fb0500 0x55aca7fd08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26d6ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6af50 0x55aca7f6b320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26d67fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7faffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49782/0 (socket says 10.20.193.4:49782) 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.256+0000 7f26d67fc640 1 -- 10.20.193.4:0/3680044826 learned_addr learned my addr 10.20.193.4:0/3680044826 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.257+0000 7f26d67fc640 1 -- 10.20.193.4:0/3680044826 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6af50 msgr2=0x55aca7f6b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.257+0000 7f26d67fc640 1 --2- 10.20.193.4:0/3680044826 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6af50 0x55aca7f6b320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.257+0000 7f26d67fc640 1 -- 10.20.193.4:0/3680044826 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7fb0500 msgr2=0x55aca7fd08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.257+0000 7f26d67fc640 1 --2- 10.20.193.4:0/3680044826 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7fb0500 0x55aca7fd08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.257+0000 7f26d67fc640 1 -- 10.20.193.4:0/3680044826 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca7e1d340 con 0x55aca7f6b860 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.257+0000 7f26d67fc640 1 --2- 10.20.193.4:0/3680044826 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7faffc0 secure :-1 s=READY pgs=684 gs=1 cs=0 l=1 c_cookie=8558230058722169668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c00058d0 tx=0x7f26c00054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c4f0e51c349344 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.257+0000 7f26a37fe640 1 -- 10.20.193.4:0/3680044826 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26c00adc20 con 0x55aca7f6b860 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.257+0000 7f26a37fe640 1 -- 10.20.193.4:0/3680044826 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26c00ada40 con 0x55aca7f6b860 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.257+0000 7f26a37fe640 1 -- 10.20.193.4:0/3680044826 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26c00aeed0 con 0x55aca7f6b860 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.258+0000 7f26df504e00 1 -- 10.20.193.4:0/3680044826 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 msgr2=0x55aca7faffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.258+0000 7f26df504e00 1 --2- 10.20.193.4:0/3680044826 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7faffc0 secure :-1 s=READY pgs=684 gs=1 cs=0 l=1 c_cookie=8558230058722169668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c00058d0 tx=0x7f26c00054e0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.258+0000 7f26df504e00 1 -- 10.20.193.4:0/3680044826 shutdown_connections 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.258+0000 7f26df504e00 1 --2- 10.20.193.4:0/3680044826 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7fb0500 0x55aca7fd08e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.258+0000 7f26df504e00 1 --2- 10.20.193.4:0/3680044826 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7faffc0 unknown :-1 s=CLOSED pgs=684 gs=1 cs=0 l=1 c_cookie=8558230058722169668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.258+0000 7f26df504e00 1 --2- 10.20.193.4:0/3680044826 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6af50 0x55aca7f6b320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.258+0000 7f26df504e00 1 -- 10.20.193.4:0/3680044826 >> 10.20.193.4:0/3680044826 conn(0x55aca7e89db0 msgr2=0x55aca7f69830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.258+0000 7f26df504e00 1 -- 10.20.193.4:0/3680044826 shutdown_connections 2026-02-24T09:12:41.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.258+0000 7f26df504e00 1 -- 10.20.193.4:0/3680044826 wait complete. 2026-02-24T09:12:41.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.259+0000 7f26df504e00 1 -- start start 2026-02-24T09:12:41.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.259+0000 7f26df504e00 1 Processor -- start 2026-02-24T09:12:41.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26df504e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6af50 0x55aca7fc7bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26df504e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 0x55aca7fc8110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26df504e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7fb0500 0x55aca7fcd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26df504e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55aca7fcd640 con 0x55aca7f6af50 2026-02-24T09:12:41.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26df504e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55aca7fcd7b0 con 0x55aca7fb0500 2026-02-24T09:12:41.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26df504e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55aca7fcd970 con 0x55aca7f6b860 2026-02-24T09:12:41.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6af50 0x55aca7fc7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6af50 0x55aca7fc7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49796/0 (socket says 10.20.193.4:49796) 2026-02-24T09:12:41.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d6ffd640 1 -- 10.20.193.4:0/2951997870 learned_addr learned my addr 10.20.193.4:0/2951997870 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:41.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d67fc640 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 0x55aca7fc8110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d77fe640 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7fb0500 0x55aca7fcd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d6ffd640 1 -- 10.20.193.4:0/2951997870 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 msgr2=0x55aca7fc8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 0x55aca7fc8110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d6ffd640 1 -- 10.20.193.4:0/2951997870 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7fb0500 msgr2=0x55aca7fcd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7fb0500 0x55aca7fcd100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d6ffd640 1 -- 10.20.193.4:0/2951997870 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca7df59d0 con 0x55aca7f6af50 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d67fc640 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 0x55aca7fc8110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6af50 0x55aca7fc7bd0 secure :-1 s=READY pgs=685 gs=1 cs=0 l=1 c_cookie=917675790668420009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26cc0040d0 tx=0x7f26cc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc3d4501c453a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26a0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.260+0000 7f26a0ff9640 1 -- 10.20.193.4:0/2951997870 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26cc023070 con 0x55aca7f6af50 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 1 -- 10.20.193.4:0/2951997870 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d80fb0a0 con 0x55aca7f6af50 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26a0ff9640 1 -- 10.20.193.4:0/2951997870 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26cc016070 con 0x55aca7f6af50 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26a0ff9640 1 -- 10.20.193.4:0/2951997870 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26cc028c00 con 0x55aca7f6af50 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 10 client.16293 _ll_register_callbacks cb 0x55aca7e1c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 1 -- 10.20.193.4:0/2951997870 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aca7bc14a0 con 0x55aca7f6af50 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26a0ff9640 1 -- 10.20.193.4:0/2951997870 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f26cc028d90 con 0x55aca7f6af50 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26a0ff9640 1 -- 10.20.193.4:0/2951997870 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f26cc01b400 con 0x55aca7f6af50 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 10 client.16293 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 1 -- 10.20.193.4:0/2951997870 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55aca7e07710 con 0x55aca7f6af50 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26a0ff9640 1 -- 10.20.193.4:0/2951997870 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f26cc01b5a0 con 0x55aca7f6af50 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 10 client.16293 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 10 client.16293 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 20 client.16293 populate_metadata read hostname 'trial004' 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55aca7fad5e0 0x55aca7fada80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 4 client.16293 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:41.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26df504e00 1 -- 10.20.193.4:0/2951997870 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aca7e677b0 con 0x55aca7fad5e0 2026-02-24T09:12:41.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.261+0000 7f26d67fc640 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55aca7fad5e0 0x55aca7fada80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.262+0000 7f26d67fc640 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55aca7fad5e0 0x55aca7fada80 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=15019444028390243480 s_cookie=17221217261886053179 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d06fc8c4740ffc98 server_cookie=eefe0ddb968b1b3b in_seq=0 out_seq=0 2026-02-24T09:12:41.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.262+0000 7f26a0ff9640 10 client.16293 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:41.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26a0ff9640 1 -- 10.20.193.4:0/2951997870 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55aca7e677b0 con 0x55aca7fad5e0 2026-02-24T09:12:41.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26a0ff9640 10 client.16293 handle_command_reply: tid=0 2026-02-24T09:12:41.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 client.16293 shutdown 2026-02-24T09:12:41.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 -- 10.20.193.4:0/2951997870 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6af50 msgr2=0x55aca7fc7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6af50 0x55aca7fc7bd0 secure :-1 s=READY pgs=685 gs=1 cs=0 l=1 c_cookie=917675790668420009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26cc0040d0 tx=0x7f26cc0047e0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 -- 10.20.193.4:0/2951997870 shutdown_connections 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55aca7fad5e0 0x55aca7fada80 crc :-1 s=READY pgs=31 gs=4 cs=0 l=0 c_cookie=15019444028390243480 s_cookie=17221217261886053179 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7fb0500 0x55aca7fcd100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26a0ff9640 0 client.16293 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 0x55aca7fc8110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 --2- 10.20.193.4:0/2951997870 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6af50 0x55aca7fc7bd0 unknown :-1 s=CLOSED pgs=685 gs=1 cs=0 l=1 c_cookie=917675790668420009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 -- 10.20.193.4:0/2951997870 >> 10.20.193.4:0/2951997870 conn(0x55aca7e89db0 msgr2=0x55aca7f69040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 -- 10.20.193.4:0/2951997870 shutdown_connections 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 1 -- 10.20.193.4:0/2951997870 wait complete. 2026-02-24T09:12:41.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.263+0000 7f26df504e00 20 client.16293 trim_cache size 0 max 16384 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.273+0000 7f26df504e00 1 Processor -- start 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.273+0000 7f26df504e00 1 -- start start 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26df504e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 0x55aca7fcc670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26df504e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7fab100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26df504e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7fad5e0 0x55aca7fab640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26df504e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55aca7e6f9a0 con 0x55aca7f6b860 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26df504e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55aca7c4bdf0 con 0x55aca7f6af50 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26df504e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55aca7fc86f0 con 0x55aca7fad5e0 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d67fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7fab100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d67fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7fab100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49798/0 (socket says 10.20.193.4:49798) 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d67fc640 1 -- 10.20.193.4:0/2414520216 learned_addr learned my addr 10.20.193.4:0/2414520216 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d77fe640 1 --2- 10.20.193.4:0/2414520216 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7fad5e0 0x55aca7fab640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/2414520216 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 0x55aca7fcc670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d67fc640 1 -- 10.20.193.4:0/2414520216 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7fad5e0 msgr2=0x55aca7fab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d67fc640 1 --2- 10.20.193.4:0/2414520216 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7fad5e0 0x55aca7fab640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d67fc640 1 -- 10.20.193.4:0/2414520216 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 msgr2=0x55aca7fcc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d67fc640 1 --2- 10.20.193.4:0/2414520216 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 0x55aca7fcc670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d67fc640 1 -- 10.20.193.4:0/2414520216 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca7fba440 con 0x55aca7f6b860 2026-02-24T09:12:41.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/2414520216 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 0x55aca7fcc670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:41.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26d67fc640 1 --2- 10.20.193.4:0/2414520216 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7fab100 secure :-1 s=READY pgs=686 gs=1 cs=0 l=1 c_cookie=13019081701272955762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c00ab4b0 tx=0x7f26c00d3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ad11d44a29ab72 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26a2ffd640 1 -- 10.20.193.4:0/2414520216 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26c00adc20 con 0x55aca7f6b860 2026-02-24T09:12:41.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26a2ffd640 1 -- 10.20.193.4:0/2414520216 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26c00aec40 con 0x55aca7f6b860 2026-02-24T09:12:41.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.274+0000 7f26a2ffd640 1 -- 10.20.193.4:0/2414520216 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26c00b9170 con 0x55aca7f6b860 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.275+0000 7f26df504e00 1 -- 10.20.193.4:0/2414520216 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 msgr2=0x55aca7fab100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.275+0000 7f26df504e00 1 --2- 10.20.193.4:0/2414520216 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7fab100 secure :-1 s=READY pgs=686 gs=1 cs=0 l=1 c_cookie=13019081701272955762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c00ab4b0 tx=0x7f26c00d3040 comp rx=0 tx=0).stop 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.275+0000 7f26df504e00 1 -- 10.20.193.4:0/2414520216 shutdown_connections 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.275+0000 7f26df504e00 1 --2- 10.20.193.4:0/2414520216 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7fad5e0 0x55aca7fab640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.275+0000 7f26df504e00 1 --2- 10.20.193.4:0/2414520216 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7f6b860 0x55aca7fab100 unknown :-1 s=CLOSED pgs=686 gs=1 cs=0 l=1 c_cookie=13019081701272955762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.275+0000 7f26df504e00 1 --2- 10.20.193.4:0/2414520216 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 0x55aca7fcc670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.275+0000 7f26df504e00 1 -- 10.20.193.4:0/2414520216 >> 10.20.193.4:0/2414520216 conn(0x55aca7e89db0 msgr2=0x55aca7fcbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.275+0000 7f26df504e00 1 -- 10.20.193.4:0/2414520216 shutdown_connections 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.275+0000 7f26df504e00 1 -- 10.20.193.4:0/2414520216 wait complete. 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.276+0000 7f26df504e00 1 -- start start 2026-02-24T09:12:41.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.276+0000 7f26df504e00 1 Processor -- start 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.276+0000 7f26df504e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 0x55aca7f4c2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.276+0000 7f26df504e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 0x55aca7f4c800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.276+0000 7f26df504e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7fad5e0 0x55aca7faae00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.276+0000 7f26df504e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55aca7fd0b40 con 0x55aca7fad5e0 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.276+0000 7f26df504e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55aca7edc2f0 con 0x55aca7f6af50 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.276+0000 7f26df504e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55aca7f4ce90 con 0x55aca7f6b860 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.276+0000 7f26d77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7fad5e0 0x55aca7faae00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.276+0000 7f26d77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7fad5e0 0x55aca7faae00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49806/0 (socket says 10.20.193.4:49806) 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26d77fe640 1 -- 10.20.193.4:0/3152213878 learned_addr learned my addr 10.20.193.4:0/3152213878 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 0x55aca7f4c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26d67fc640 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 0x55aca7f4c800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26d77fe640 1 -- 10.20.193.4:0/3152213878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 msgr2=0x55aca7f4c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26d77fe640 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 0x55aca7f4c800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26d77fe640 1 -- 10.20.193.4:0/3152213878 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 msgr2=0x55aca7f4c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26d77fe640 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 0x55aca7f4c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26d77fe640 1 -- 10.20.193.4:0/3152213878 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca7e02190 con 0x55aca7fad5e0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26d67fc640 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 0x55aca7f4c800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26d77fe640 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7fad5e0 0x55aca7faae00 secure :-1 s=READY pgs=687 gs=1 cs=0 l=1 c_cookie=7448474182424069586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c800a230 tx=0x7f26c80396a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675e4bce220e05d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26a0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26a0ff9640 1 -- 10.20.193.4:0/3152213878 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26c803e040 con 0x55aca7fad5e0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26a0ff9640 1 -- 10.20.193.4:0/3152213878 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26c8003bb0 con 0x55aca7fad5e0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26df504e00 1 -- 10.20.193.4:0/3152213878 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aca7e1d340 con 0x55aca7fad5e0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26a0ff9640 1 -- 10.20.193.4:0/3152213878 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26c8047690 con 0x55aca7fad5e0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26df504e00 10 client.16299 _ll_register_callbacks cb 0x55aca7e1c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26df504e00 1 -- 10.20.193.4:0/3152213878 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26c00ada40 con 0x55aca7fad5e0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26a0ff9640 1 -- 10.20.193.4:0/3152213878 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f26c8047820 con 0x55aca7fad5e0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26a0ff9640 1 -- 10.20.193.4:0/3152213878 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f26c80479e0 con 0x55aca7fad5e0 2026-02-24T09:12:41.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26df504e00 10 client.16299 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26df504e00 1 -- 10.20.193.4:0/3152213878 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55aca7df5d00 con 0x55aca7fad5e0 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26a0ff9640 1 -- 10.20.193.4:0/3152213878 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f26c804d020 con 0x55aca7fad5e0 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26df504e00 10 client.16299 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.277+0000 7f26df504e00 10 client.16299 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.278+0000 7f26df504e00 20 client.16299 populate_metadata read hostname 'trial004' 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.278+0000 7f26df504e00 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55aca7fb0500 0x55aca807d8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.278+0000 7f26df504e00 4 client.16299 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.278+0000 7f26df504e00 1 -- 10.20.193.4:0/3152213878 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aca7ba6160 con 0x55aca7fb0500 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.278+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55aca7fb0500 0x55aca807d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26a0ff9640 10 client.16299 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:41.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26d6ffd640 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55aca7fb0500 0x55aca807d8b0 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=16177165652316819113 s_cookie=5123244880233514501 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e080d67352fe8ea9 server_cookie=47196c130fa84605 in_seq=0 out_seq=0 2026-02-24T09:12:41.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26a0ff9640 1 -- 10.20.193.4:0/3152213878 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aca7ba6160 con 0x55aca7fb0500 2026-02-24T09:12:41.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26a0ff9640 10 client.16299 handle_command_reply: tid=0 2026-02-24T09:12:41.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 client.16299 shutdown 2026-02-24T09:12:41.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 -- 10.20.193.4:0/3152213878 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7fad5e0 msgr2=0x55aca7faae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7fad5e0 0x55aca7faae00 secure :-1 s=READY pgs=687 gs=1 cs=0 l=1 c_cookie=7448474182424069586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c800a230 tx=0x7f26c80396a0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 -- 10.20.193.4:0/3152213878 shutdown_connections 2026-02-24T09:12:41.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55aca7fb0500 0x55aca807d8b0 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=16177165652316819113 s_cookie=5123244880233514501 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55aca7fad5e0 0x55aca7faae00 unknown :-1 s=CLOSED pgs=687 gs=1 cs=0 l=1 c_cookie=7448474182424069586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26a0ff9640 0 client.16299 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:41.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55aca7f6b860 0x55aca7f4c800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 --2- 10.20.193.4:0/3152213878 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55aca7f6af50 0x55aca7f4c2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 -- 10.20.193.4:0/3152213878 >> 10.20.193.4:0/3152213878 conn(0x55aca7e89db0 msgr2=0x55aca7fcc750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 -- 10.20.193.4:0/3152213878 shutdown_connections 2026-02-24T09:12:41.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 1 -- 10.20.193.4:0/3152213878 wait complete. 2026-02-24T09:12:41.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.279+0000 7f26df504e00 20 client.16299 trim_cache size 0 max 16384 2026-02-24T09:12:41.284 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 -- 10.20.193.4:0/1562865731 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f26ac0b56d0 msgr2=0x7f26ac0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f26ac0b56d0 0x7f26ac0d5b80 secure :-1 s=READY pgs=325 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26cc004740 tx=0x7f26cc005f90 comp rx=0 tx=0).stop 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 -- 10.20.193.4:0/1562865731 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26d810cc80 msgr2=0x7f26d8172d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26d810cc80 0x7f26d8172d50 secure :-1 s=READY pgs=683 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c0009480 tx=0x7f26c000ee60 comp rx=0 tx=0).stop 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 -- 10.20.193.4:0/1562865731 shutdown_connections 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f26ac0b56d0 0x7f26ac0d5b80 unknown :-1 s=CLOSED pgs=325 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26d8112480 0x7f26d80f54f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f26d810cc80 0x7f26d8172d50 unknown :-1 s=CLOSED pgs=683 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 --2- 10.20.193.4:0/1562865731 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f26d810c290 0x7f26d80f4df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 -- 10.20.193.4:0/1562865731 >> 10.20.193.4:0/1562865731 conn(0x7f26d80e9b80 msgr2=0x7f26d810a740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 -- 10.20.193.4:0/1562865731 shutdown_connections 2026-02-24T09:12:41.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.280+0000 7f26dd50a640 1 -- 10.20.193.4:0/1562865731 wait complete. 2026-02-24T09:12:41.386 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:12:41.561 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.716+0000 7fe8d4a46640 1 -- 10.20.193.4:0/2762170608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8d010d3d0 msgr2=0x7fe8d010d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.716+0000 7fe8d4a46640 1 --2- 10.20.193.4:0/2762170608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8d010d3d0 0x7fe8d010d7a0 secure :-1 s=READY pgs=688 gs=1 cs=0 l=1 c_cookie=17247772292556778870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8b8009950 tx=0x7fe8b802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.716+0000 7fe8d4a46640 1 -- 10.20.193.4:0/2762170608 shutdown_connections 2026-02-24T09:12:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.716+0000 7fe8d4a46640 1 --2- 10.20.193.4:0/2762170608 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe8d01135c0 0x7fe8d0173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.716+0000 7fe8d4a46640 1 --2- 10.20.193.4:0/2762170608 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8d010ddc0 0x7fe8d0112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.716+0000 7fe8d4a46640 1 --2- 10.20.193.4:0/2762170608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8d010d3d0 0x7fe8d010d7a0 unknown :-1 s=CLOSED pgs=688 gs=1 cs=0 l=1 c_cookie=17247772292556778870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.716+0000 7fe8d4a46640 1 -- 10.20.193.4:0/2762170608 >> 10.20.193.4:0/2762170608 conn(0x7fe8d00eaca0 msgr2=0x7fe8d010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.716+0000 7fe8d4a46640 1 -- 10.20.193.4:0/2762170608 shutdown_connections 2026-02-24T09:12:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.716+0000 7fe8d4a46640 1 -- 10.20.193.4:0/2762170608 wait complete. 2026-02-24T09:12:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8d4a46640 1 Processor -- start 2026-02-24T09:12:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8d4a46640 1 -- start start 2026-02-24T09:12:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8d4a46640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe8d010d3d0 0x7fe8d0060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8d4a46640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8d010ddc0 0x7fe8d00614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8d4a46640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8d01135c0 0x7fe8d0061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8d4a46640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0163ff0 con 0x7fe8d01135c0 2026-02-24T09:12:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8d4a46640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0164160 con 0x7fe8d010d3d0 2026-02-24T09:12:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8d4a46640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0164320 con 0x7fe8d010ddc0 2026-02-24T09:12:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8ced76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8d01135c0 0x7fe8d0061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8ced76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8d01135c0 0x7fe8d0061a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49830/0 (socket says 10.20.193.4:49830) 2026-02-24T09:12:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8ced76640 1 -- 10.20.193.4:0/3563615123 learned_addr learned my addr 10.20.193.4:0/3563615123 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8cdd74640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8d010ddc0 0x7fe8d00614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8ced76640 1 -- 10.20.193.4:0/3563615123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8d010ddc0 msgr2=0x7fe8d00614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8ced76640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8d010ddc0 0x7fe8d00614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8ced76640 1 -- 10.20.193.4:0/3563615123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe8d010d3d0 msgr2=0x7fe8d0060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8ced76640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe8d010d3d0 0x7fe8d0060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8ced76640 1 -- 10.20.193.4:0/3563615123 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b8009570 con 0x7fe8d01135c0 2026-02-24T09:12:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8ced76640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8d01135c0 0x7fe8d0061a10 secure :-1 s=READY pgs=689 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8c0005db0 tx=0x7fe8c000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8b77fe640 1 -- 10.20.193.4:0/3563615123 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8c0004500 con 0x7fe8d01135c0 2026-02-24T09:12:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8d4a46640 1 -- 10.20.193.4:0/3563615123 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d0164600 con 0x7fe8d01135c0 2026-02-24T09:12:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8b77fe640 1 -- 10.20.193.4:0/3563615123 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe8c0004d30 con 0x7fe8d01135c0 2026-02-24T09:12:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8b77fe640 1 -- 10.20.193.4:0/3563615123 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8c00052a0 con 0x7fe8d01135c0 2026-02-24T09:12:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.717+0000 7fe8d4a46640 1 -- 10.20.193.4:0/3563615123 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d0164b20 con 0x7fe8d01135c0 2026-02-24T09:12:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.719+0000 7fe8b77fe640 1 -- 10.20.193.4:0/3563615123 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fe8c0005430 con 0x7fe8d01135c0 2026-02-24T09:12:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.720+0000 7fe8b77fe640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8a80b56e0 0x7fe8a80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.720+0000 7fe8ce575640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8a80b56e0 0x7fe8a80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.720+0000 7fe8b77fe640 1 -- 10.20.193.4:0/3563615123 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe8c00e6c40 con 0x7fe8d01135c0 2026-02-24T09:12:41.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.720+0000 7fe8ce575640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8a80b56e0 0x7fe8a80d5b90 secure :-1 s=READY pgs=326 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8b802f6e0 tx=0x7fe8b8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.728+0000 7fe8d6a40e00 1 Processor -- start 2026-02-24T09:12:41.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8d6a40e00 1 -- start start 2026-02-24T09:12:41.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbef50 0x55b2bcbbf320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcc03fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcc04500 0x55b2bcc248e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcacfee0 con 0x55b2bcbbef50 2026-02-24T09:12:41.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcacbc10 con 0x55b2bcbbf860 2026-02-24T09:12:41.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcac5d70 con 0x55b2bcc04500 2026-02-24T09:12:41.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8ce575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbef50 0x55b2bcbbf320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8ce575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbef50 0x55b2bcbbf320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49836/0 (socket says 10.20.193.4:49836) 2026-02-24T09:12:41.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8ce575640 1 -- 10.20.193.4:0/1389932591 learned_addr learned my addr 10.20.193.4:0/1389932591 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:41.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8ced76640 1 --2- 10.20.193.4:0/1389932591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcc04500 0x55b2bcc248e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8cdd74640 1 --2- 10.20.193.4:0/1389932591 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcc03fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8ce575640 1 -- 10.20.193.4:0/1389932591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcc04500 msgr2=0x55b2bcc248e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8ce575640 1 --2- 10.20.193.4:0/1389932591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcc04500 0x55b2bcc248e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8ce575640 1 -- 10.20.193.4:0/1389932591 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 msgr2=0x55b2bcc03fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8ce575640 1 --2- 10.20.193.4:0/1389932591 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcc03fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8ce575640 1 -- 10.20.193.4:0/1389932591 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bca71340 con 0x55b2bcbbef50 2026-02-24T09:12:41.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8ce575640 1 --2- 10.20.193.4:0/1389932591 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbef50 0x55b2bcbbf320 secure :-1 s=READY pgs=690 gs=1 cs=0 l=1 c_cookie=15874027000928298493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8b8005ee0 tx=0x7fe8b803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4bdf74014a65fd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.729+0000 7fe8b4ff9640 1 -- 10.20.193.4:0/1389932591 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8b803d070 con 0x55b2bcbbef50 2026-02-24T09:12:41.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.730+0000 7fe8b4ff9640 1 -- 10.20.193.4:0/1389932591 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe8b8002820 con 0x55b2bcbbef50 2026-02-24T09:12:41.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.730+0000 7fe8b4ff9640 1 -- 10.20.193.4:0/1389932591 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8b804f6e0 con 0x55b2bcbbef50 2026-02-24T09:12:41.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.730+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/1389932591 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbef50 msgr2=0x55b2bcbbf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.730+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/1389932591 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbef50 0x55b2bcbbf320 secure :-1 s=READY pgs=690 gs=1 cs=0 l=1 c_cookie=15874027000928298493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8b8005ee0 tx=0x7fe8b803d000 comp rx=0 tx=0).stop 2026-02-24T09:12:41.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.730+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/1389932591 shutdown_connections 2026-02-24T09:12:41.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.730+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/1389932591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcc04500 0x55b2bcc248e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.730+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/1389932591 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcc03fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.730+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/1389932591 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbef50 0x55b2bcbbf320 unknown :-1 s=CLOSED pgs=690 gs=1 cs=0 l=1 c_cookie=15874027000928298493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.730+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/1389932591 >> 10.20.193.4:0/1389932591 conn(0x55b2bcadddb0 msgr2=0x55b2bcbbd830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.731+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/1389932591 shutdown_connections 2026-02-24T09:12:41.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.731+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/1389932591 wait complete. 2026-02-24T09:12:41.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.732+0000 7fe8d6a40e00 1 -- start start 2026-02-24T09:12:41.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.732+0000 7fe8d6a40e00 1 Processor -- start 2026-02-24T09:12:41.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.732+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc1bde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.732+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcc1c320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.732+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcc04500 0x55b2bcc21310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.732+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcc21850 con 0x55b2bcc04500 2026-02-24T09:12:41.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.732+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcc219c0 con 0x55b2bcbbf860 2026-02-24T09:12:41.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.732+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcc21b80 con 0x55b2bcbbef50 2026-02-24T09:12:41.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8ce575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc1bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8ce575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc1bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:53716/0 (socket says 10.20.193.4:53716) 2026-02-24T09:12:41.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8ce575640 1 -- 10.20.193.4:0/4118556902 learned_addr learned my addr 10.20.193.4:0/4118556902 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:41.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8ced76640 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcc04500 0x55b2bcc21310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8cdd74640 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcc1c320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8ce575640 1 -- 10.20.193.4:0/4118556902 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 msgr2=0x55b2bcc1c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8ce575640 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcc1c320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8ce575640 1 -- 10.20.193.4:0/4118556902 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcc04500 msgr2=0x55b2bcc21310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8ce575640 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcc04500 0x55b2bcc21310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8ce575640 1 -- 10.20.193.4:0/4118556902 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bca499d0 con 0x55b2bcbbef50 2026-02-24T09:12:41.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8cdd74640 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcc1c320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:41.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe8ce575640 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc1bde0 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=16770540516818892564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8b80059f0 tx=0x7fe8b8009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8bcedbef4493714 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.733+0000 7fe87ffff640 10 client.0 ms_handle_connect on v2:10.20.193.90:3300/0 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe87ffff640 1 -- 10.20.193.4:0/4118556902 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8b8038bb0 con 0x55b2bcbbef50 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/4118556902 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d0174800 con 0x55b2bcbbef50 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe87ffff640 1 -- 10.20.193.4:0/4118556902 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe8b8038e90 con 0x55b2bcbbef50 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe8d6a40e00 10 client.25846 _ll_register_callbacks cb 0x55b2bca70080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe87ffff640 1 -- 10.20.193.4:0/4118556902 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8b8057b00 con 0x55b2bcbbef50 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/4118556902 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b2bc8154a0 con 0x55b2bcbbef50 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe87ffff640 1 -- 10.20.193.4:0/4118556902 <== mon.1 v2:10.20.193.90:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe8b8057c60 con 0x55b2bcbbef50 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe87ffff640 1 -- 10.20.193.4:0/4118556902 <== mon.1 v2:10.20.193.90:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe8b8057e80 con 0x55b2bcbbef50 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe8d6a40e00 10 client.25846 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/4118556902 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55b2bca5b710 con 0x55b2bcbbef50 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe87ffff640 1 -- 10.20.193.4:0/4118556902 <== mon.1 v2:10.20.193.90:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fe8b80604c0 con 0x55b2bcbbef50 2026-02-24T09:12:41.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe8d6a40e00 10 client.25846 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:41.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.734+0000 7fe8d6a40e00 10 client.25846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:41.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.735+0000 7fe8d6a40e00 20 client.25846 populate_metadata read hostname 'trial004' 2026-02-24T09:12:41.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.735+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2bcc01580 0x55b2bcc01a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.735+0000 7fe8d6a40e00 4 client.25846 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:41.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.735+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/4118556902 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2bcabb7b0 con 0x55b2bcc01580 2026-02-24T09:12:41.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.735+0000 7fe8cdd74640 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2bcc01580 0x55b2bcc01a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.735+0000 7fe8cdd74640 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2bcc01580 0x55b2bcc01a20 crc :-1 s=READY pgs=79 gs=4 cs=0 l=0 c_cookie=16610209015610767237 s_cookie=18149617420707358073 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e683511854787785 server_cookie=fbe064e22280e579 in_seq=0 out_seq=0 2026-02-24T09:12:41.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.735+0000 7fe87ffff640 10 client.25846 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:41.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe87ffff640 1 -- 10.20.193.4:0/4118556902 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b2bcabb7b0 con 0x55b2bcc01580 2026-02-24T09:12:41.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe87ffff640 10 client.25846 handle_command_reply: tid=0 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 client.25846 shutdown 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/4118556902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 msgr2=0x55b2bcc1bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc1bde0 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=16770540516818892564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8b80059f0 tx=0x7fe8b8009310 comp rx=0 tx=0).stop 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/4118556902 shutdown_connections 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2bcc01580 0x55b2bcc01a20 crc :-1 s=READY pgs=79 gs=4 cs=0 l=0 c_cookie=16610209015610767237 s_cookie=18149617420707358073 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcc04500 0x55b2bcc21310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcc1c320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/4118556902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc1bde0 unknown :-1 s=CLOSED pgs=95 gs=1 cs=0 l=1 c_cookie=16770540516818892564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe87ffff640 0 client.25846 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/4118556902 >> 10.20.193.4:0/4118556902 conn(0x55b2bcadddb0 msgr2=0x55b2bcbbd040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/4118556902 shutdown_connections 2026-02-24T09:12:41.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/4118556902 wait complete. 2026-02-24T09:12:41.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.736+0000 7fe8d6a40e00 20 client.25846 trim_cache size 0 max 16384 2026-02-24T09:12:41.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.750+0000 7fe8d6a40e00 1 Processor -- start 2026-02-24T09:12:41.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.750+0000 7fe8d6a40e00 1 -- start start 2026-02-24T09:12:41.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc20880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcbff110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcc04500 0x55b2bcbff650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcac39a0 con 0x55b2bcc04500 2026-02-24T09:12:41.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8ce575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc20880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b2bc89fdf0 con 0x55b2bcbbf860 2026-02-24T09:12:41.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcc1ce80 con 0x55b2bcbbef50 2026-02-24T09:12:41.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8cdd74640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcbff110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8cdd74640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcbff110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:36752/0 (socket says 10.20.193.4:36752) 2026-02-24T09:12:41.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8cdd74640 1 -- 10.20.193.4:0/1915268948 learned_addr learned my addr 10.20.193.4:0/1915268948 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:41.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8ced76640 1 --2- 10.20.193.4:0/1915268948 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcc04500 0x55b2bcbff650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8ce575640 1 -- 10.20.193.4:0/1915268948 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 msgr2=0x55b2bcbff110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8ce575640 1 --2- 10.20.193.4:0/1915268948 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcbff110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8ce575640 1 -- 10.20.193.4:0/1915268948 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcc04500 msgr2=0x55b2bcbff650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8ce575640 1 --2- 10.20.193.4:0/1915268948 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcc04500 0x55b2bcbff650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.751+0000 7fe8ce575640 1 -- 10.20.193.4:0/1915268948 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bcc0e440 con 0x55b2bcbbef50 2026-02-24T09:12:41.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.752+0000 7fe8ce575640 1 --2- 10.20.193.4:0/1915268948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc20880 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=17988468900804338025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8b80564a0 tx=0x7fe8b8065000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a3e128859aa169 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.752+0000 7fe89a4e6640 1 -- 10.20.193.4:0/1915268948 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8b803d040 con 0x55b2bcbbef50 2026-02-24T09:12:41.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.752+0000 7fe89a4e6640 1 -- 10.20.193.4:0/1915268948 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe8b8064030 con 0x55b2bcbbef50 2026-02-24T09:12:41.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.752+0000 7fe89a4e6640 1 -- 10.20.193.4:0/1915268948 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8b804ee70 con 0x55b2bcbbef50 2026-02-24T09:12:41.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.754+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/1915268948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 msgr2=0x55b2bcc20880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.754+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/1915268948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc20880 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=17988468900804338025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8b80564a0 tx=0x7fe8b8065000 comp rx=0 tx=0).stop 2026-02-24T09:12:41.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.754+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/1915268948 shutdown_connections 2026-02-24T09:12:41.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.754+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/1915268948 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcc04500 0x55b2bcbff650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.754+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/1915268948 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcbbf860 0x55b2bcbff110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.754+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/1915268948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc20880 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=17988468900804338025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.754+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/1915268948 >> 10.20.193.4:0/1915268948 conn(0x55b2bcadddb0 msgr2=0x55b2bcc20170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.754+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/1915268948 shutdown_connections 2026-02-24T09:12:41.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.754+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/1915268948 wait complete. 2026-02-24T09:12:41.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.755+0000 7fe8d6a40e00 1 -- start start 2026-02-24T09:12:41.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.755+0000 7fe8d6a40e00 1 Processor -- start 2026-02-24T09:12:41.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc037a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbf860 0x55b2bcc03ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8d6a40e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcc04500 0x55b2bcb9d030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcc6b110 con 0x55b2bcbbf860 2026-02-24T09:12:41.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcc6b280 con 0x55b2bcc04500 2026-02-24T09:12:41.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8d6a40e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b2bcb9d5f0 con 0x55b2bcbbef50 2026-02-24T09:12:41.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8cdd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbf860 0x55b2bcc03ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8cdd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbf860 0x55b2bcc03ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:49854/0 (socket says 10.20.193.4:49854) 2026-02-24T09:12:41.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8cdd74640 1 -- 10.20.193.4:0/498267308 learned_addr learned my addr 10.20.193.4:0/498267308 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:41.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8ced76640 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcc04500 0x55b2bcb9d030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8ce575640 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8ced76640 1 -- 10.20.193.4:0/498267308 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 msgr2=0x55b2bcc037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8ced76640 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8ced76640 1 -- 10.20.193.4:0/498267308 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbf860 msgr2=0x55b2bcc03ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:41.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8ced76640 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbf860 0x55b2bcc03ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8ced76640 1 -- 10.20.193.4:0/498267308 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bca56190 con 0x55b2bcc04500 2026-02-24T09:12:41.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.756+0000 7fe8cdd74640 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbf860 0x55b2bcc03ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:12:41.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe8ced76640 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcc04500 0x55b2bcb9d030 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=7353170201832038673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8c00ad1e0 tx=0x7fe8c0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=660bb556fd2fa111 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:41.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe87ffff640 10 client.0 ms_handle_connect on v2:10.20.193.14:3300/0 2026-02-24T09:12:41.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe87ffff640 1 -- 10.20.193.4:0/498267308 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8c000e350 con 0x55b2bcc04500 2026-02-24T09:12:41.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/498267308 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2bca5b710 con 0x55b2bcc04500 2026-02-24T09:12:41.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe87ffff640 1 -- 10.20.193.4:0/498267308 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe8c00ad970 con 0x55b2bcc04500 2026-02-24T09:12:41.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe87ffff640 1 -- 10.20.193.4:0/498267308 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8c00acb10 con 0x55b2bcc04500 2026-02-24T09:12:41.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe8d6a40e00 10 client.25769 _ll_register_callbacks cb 0x55b2bca70080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:41.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/498267308 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8b8002820 con 0x55b2bcc04500 2026-02-24T09:12:41.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe87ffff640 1 -- 10.20.193.4:0/498267308 <== mon.2 v2:10.20.193.14:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe8c00acc70 con 0x55b2bcc04500 2026-02-24T09:12:41.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe87ffff640 1 -- 10.20.193.4:0/498267308 <== mon.2 v2:10.20.193.14:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe8c0072100 con 0x55b2bcc04500 2026-02-24T09:12:41.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe8d6a40e00 10 client.25769 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:41.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.757+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/498267308 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55b2bca49d00 con 0x55b2bcc04500 2026-02-24T09:12:41.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.758+0000 7fe87ffff640 1 -- 10.20.193.4:0/498267308 <== mon.2 v2:10.20.193.14:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fe8c00adc00 con 0x55b2bcc04500 2026-02-24T09:12:41.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.758+0000 7fe8d6a40e00 10 client.25769 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:41.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.758+0000 7fe8d6a40e00 10 client.25769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:41.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.758+0000 7fe8d6a40e00 20 client.25769 populate_metadata read hostname 'trial004' 2026-02-24T09:12:41.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.758+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2bccb1b90 0x55b2bccd1ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:41.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.758+0000 7fe8d6a40e00 4 client.25769 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:12:41.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.758+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/498267308 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b2bc7fa160 con 0x55b2bccb1b90 2026-02-24T09:12:41.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.758+0000 7fe8ce575640 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2bccb1b90 0x55b2bccd1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:41.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.759+0000 7fe8ce575640 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2bccb1b90 0x55b2bccd1ff0 crc :-1 s=READY pgs=80 gs=4 cs=0 l=0 c_cookie=12373616080077013244 s_cookie=16513331222131650814 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abb7ea44400d40fc server_cookie=e52b2341518630fe in_seq=0 out_seq=0 2026-02-24T09:12:41.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.759+0000 7fe87ffff640 10 client.25769 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:41.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.759+0000 7fe87ffff640 1 -- 10.20.193.4:0/498267308 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b2bc7fa160 con 0x55b2bccb1b90 2026-02-24T09:12:41.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.759+0000 7fe87ffff640 10 client.25769 handle_command_reply: tid=0 2026-02-24T09:12:41.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.759+0000 7fe8d6a40e00 1 client.25769 shutdown 2026-02-24T09:12:41.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/498267308 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcc04500 msgr2=0x55b2bcb9d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcc04500 0x55b2bcb9d030 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=7353170201832038673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8c00ad1e0 tx=0x7fe8c0009c20 comp rx=0 tx=0).stop 2026-02-24T09:12:41.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/498267308 shutdown_connections 2026-02-24T09:12:41.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2bccb1b90 0x55b2bccd1ff0 crc :-1 s=READY pgs=80 gs=4 cs=0 l=0 c_cookie=12373616080077013244 s_cookie=16513331222131650814 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe87ffff640 0 client.25769 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:41.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2bcc04500 0x55b2bcb9d030 unknown :-1 s=CLOSED pgs=79 gs=2 cs=0 l=1 c_cookie=7353170201832038673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2bcbbf860 0x55b2bcc03ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe8d6a40e00 1 --2- 10.20.193.4:0/498267308 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2bcbbef50 0x55b2bcc037a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/498267308 >> 10.20.193.4:0/498267308 conn(0x55b2bcadddb0 msgr2=0x55b2bcc189b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/498267308 shutdown_connections 2026-02-24T09:12:41.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.760+0000 7fe8d6a40e00 1 -- 10.20.193.4:0/498267308 wait complete. 2026-02-24T09:12:41.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.761+0000 7fe8d6a40e00 20 client.25769 trim_cache size 0 max 16384 2026-02-24T09:12:41.771 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:12:41.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.765+0000 7fe8d4a46640 1 -- 10.20.193.4:0/3563615123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8a80b56e0 msgr2=0x7fe8a80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.765+0000 7fe8d4a46640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8a80b56e0 0x7fe8a80d5b90 secure :-1 s=READY pgs=326 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8b802f6e0 tx=0x7fe8b8005900 comp rx=0 tx=0).stop 2026-02-24T09:12:41.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.765+0000 7fe8d4a46640 1 -- 10.20.193.4:0/3563615123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8d01135c0 msgr2=0x7fe8d0061a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.765+0000 7fe8d4a46640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8d01135c0 0x7fe8d0061a10 secure :-1 s=READY pgs=689 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8c0005db0 tx=0x7fe8c000ddf0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.766+0000 7fe8d4a46640 1 -- 10.20.193.4:0/3563615123 shutdown_connections 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.766+0000 7fe8d4a46640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe8a80b56e0 0x7fe8a80d5b90 unknown :-1 s=CLOSED pgs=326 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.766+0000 7fe8d4a46640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe8d01135c0 0x7fe8d0061a10 unknown :-1 s=CLOSED pgs=689 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.766+0000 7fe8d4a46640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8d010ddc0 0x7fe8d00614d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.766+0000 7fe8d4a46640 1 --2- 10.20.193.4:0/3563615123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe8d010d3d0 0x7fe8d0060f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.766+0000 7fe8d4a46640 1 -- 10.20.193.4:0/3563615123 >> 10.20.193.4:0/3563615123 conn(0x7fe8d00eaca0 msgr2=0x7fe8d010b080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.766+0000 7fe8d4a46640 1 -- 10.20.193.4:0/3563615123 shutdown_connections 2026-02-24T09:12:41.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:41.767+0000 7fe8d4a46640 1 -- 10.20.193.4:0/3563615123 wait complete. 2026-02-24T09:12:42.881 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:12:42.882 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:12:43.024 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:43.050 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:42 trial004 ceph-mon[41596]: pgmap v239: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 895 MiB/s wr, 264 op/s 2026-02-24T09:12:43.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:42 trial090 ceph-mon[47278]: pgmap v239: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 895 MiB/s wr, 264 op/s 2026-02-24T09:12:43.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:42 trial014 ceph-mon[46941]: pgmap v239: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 895 MiB/s wr, 264 op/s 2026-02-24T09:12:43.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 -- 10.20.193.4:0/2413580031 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff61010f280 msgr2=0x7ff61010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 --2- 10.20.193.4:0/2413580031 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff61010f280 0x7ff61010f650 secure :-1 s=READY pgs=691 gs=1 cs=0 l=1 c_cookie=3506814805857525941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff600009950 tx=0x7ff60002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 -- 10.20.193.4:0/2413580031 shutdown_connections 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 --2- 10.20.193.4:0/2413580031 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff610115470 0x7ff610175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 --2- 10.20.193.4:0/2413580031 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61010fc70 0x7ff610114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 --2- 10.20.193.4:0/2413580031 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff61010f280 0x7ff61010f650 unknown :-1 s=CLOSED pgs=691 gs=1 cs=0 l=1 c_cookie=3506814805857525941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 -- 10.20.193.4:0/2413580031 >> 10.20.193.4:0/2413580031 conn(0x7ff61005f830 msgr2=0x7ff61010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 -- 10.20.193.4:0/2413580031 shutdown_connections 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 -- 10.20.193.4:0/2413580031 wait complete. 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 Processor -- start 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 -- start start 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61010f280 0x7ff61011db90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff61010fc70 0x7ff61011e0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff610115470 0x7ff6101234a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff610123ac0 con 0x7ff61010fc70 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff610123c30 con 0x7ff61010f280 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.174+0000 7ff6184a3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff610123df0 con 0x7ff610115470 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff616218640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61010f280 0x7ff61011db90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff616218640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61010f280 0x7ff61011db90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:40198/0 (socket says 10.20.193.4:40198) 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff616218640 1 -- 10.20.193.4:0/3603511997 learned_addr learned my addr 10.20.193.4:0/3603511997 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff615a17640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff61010fc70 0x7ff61011e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff616218640 1 -- 10.20.193.4:0/3603511997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff610115470 msgr2=0x7ff6101234a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff616218640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff610115470 0x7ff6101234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff616218640 1 -- 10.20.193.4:0/3603511997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff61010fc70 msgr2=0x7ff61011e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff616218640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff61010fc70 0x7ff61011e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff616218640 1 -- 10.20.193.4:0/3603511997 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff600009570 con 0x7ff61010f280 2026-02-24T09:12:43.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff616218640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61010f280 0x7ff61011db90 secure :-1 s=READY pgs=80 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6000023d0 tx=0x7ff6000043d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff5f77fe640 1 -- 10.20.193.4:0/3603511997 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff60003d070 con 0x7ff61010f280 2026-02-24T09:12:43.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff6184a3640 1 -- 10.20.193.4:0/3603511997 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff610124070 con 0x7ff61010f280 2026-02-24T09:12:43.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff5f77fe640 1 -- 10.20.193.4:0/3603511997 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff600038920 con 0x7ff61010f280 2026-02-24T09:12:43.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.175+0000 7ff5f77fe640 1 -- 10.20.193.4:0/3603511997 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6000419d0 con 0x7ff61010f280 2026-02-24T09:12:43.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.176+0000 7ff6184a3640 1 -- 10.20.193.4:0/3603511997 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff610164850 con 0x7ff61010f280 2026-02-24T09:12:43.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.179+0000 7ff5f77fe640 1 -- 10.20.193.4:0/3603511997 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff600038a90 con 0x7ff61010f280 2026-02-24T09:12:43.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.180+0000 7ff5f77fe640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b56e0 0x7ff5ec0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.180+0000 7ff615a17640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b56e0 0x7ff5ec0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.180+0000 7ff5f77fe640 1 -- 10.20.193.4:0/3603511997 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff60010b280 con 0x7ff61010f280 2026-02-24T09:12:43.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.181+0000 7ff615a17640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b56e0 0x7ff5ec0d5b90 secure :-1 s=READY pgs=327 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff610124530 tx=0x7ff60400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.186+0000 7ff61a49de00 1 Processor -- start 2026-02-24T09:12:43.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.186+0000 7ff61a49de00 1 -- start start 2026-02-24T09:12:43.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.186+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 0x562e5743b6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.186+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e57480370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.186+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e574a0c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.186+0000 7ff61a49de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562e5734b520 con 0x562e5743b300 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.186+0000 7ff61a49de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562e57347250 con 0x562e574808b0 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.186+0000 7ff61a49de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562e573413b0 con 0x562e5743bc10 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616a19640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e574a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616a19640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e574a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:40200/0 (socket says 10.20.193.4:40200) 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616a19640 1 -- 10.20.193.4:0/2590339684 learned_addr learned my addr 10.20.193.4:0/2590339684 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616a19640 1 -- 10.20.193.4:0/2590339684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 msgr2=0x562e57480370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616a19640 1 --2- 10.20.193.4:0/2590339684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e57480370 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616218640 1 --2- 10.20.193.4:0/2590339684 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 0x562e5743b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616a19640 1 -- 10.20.193.4:0/2590339684 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 msgr2=0x562e5743b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616a19640 1 --2- 10.20.193.4:0/2590339684 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 0x562e5743b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616a19640 1 -- 10.20.193.4:0/2590339684 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e572ec6e0 con 0x562e574808b0 2026-02-24T09:12:43.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616218640 1 --2- 10.20.193.4:0/2590339684 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 0x562e5743b6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:43.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.187+0000 7ff616a19640 1 --2- 10.20.193.4:0/2590339684 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e574a0c90 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=9992214977903969845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60c00ac80 tx=0x7ff60c00ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aab7a94d54dc635 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.188+0000 7ff5f4a6d640 1 -- 10.20.193.4:0/2590339684 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff60c00f070 con 0x562e574808b0 2026-02-24T09:12:43.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.188+0000 7ff5f4a6d640 1 -- 10.20.193.4:0/2590339684 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff60c005500 con 0x562e574808b0 2026-02-24T09:12:43.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.188+0000 7ff5f4a6d640 1 -- 10.20.193.4:0/2590339684 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff60c00ce50 con 0x562e574808b0 2026-02-24T09:12:43.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.190+0000 7ff61a49de00 1 -- 10.20.193.4:0/2590339684 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 msgr2=0x562e574a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.190+0000 7ff61a49de00 1 --2- 10.20.193.4:0/2590339684 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e574a0c90 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=9992214977903969845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60c00ac80 tx=0x7ff60c00ad80 comp rx=0 tx=0).stop 2026-02-24T09:12:43.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.190+0000 7ff61a49de00 1 -- 10.20.193.4:0/2590339684 shutdown_connections 2026-02-24T09:12:43.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.190+0000 7ff61a49de00 1 --2- 10.20.193.4:0/2590339684 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e574a0c90 unknown :-1 s=CLOSED pgs=81 gs=1 cs=0 l=1 c_cookie=9992214977903969845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.190+0000 7ff61a49de00 1 --2- 10.20.193.4:0/2590339684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e57480370 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.190+0000 7ff61a49de00 1 --2- 10.20.193.4:0/2590339684 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 0x562e5743b6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.190+0000 7ff61a49de00 1 -- 10.20.193.4:0/2590339684 >> 10.20.193.4:0/2590339684 conn(0x562e573594f0 msgr2=0x562e57439be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.190+0000 7ff61a49de00 1 -- 10.20.193.4:0/2590339684 shutdown_connections 2026-02-24T09:12:43.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.190+0000 7ff61a49de00 1 -- 10.20.193.4:0/2590339684 wait complete. 2026-02-24T09:12:43.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.193+0000 7ff61a49de00 1 -- start start 2026-02-24T09:12:43.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.193+0000 7ff61a49de00 1 Processor -- start 2026-02-24T09:12:43.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743b300 0x562e57453340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e57453880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.196 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e574808b0 0x562e57458870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff616218640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743b300 0x562e57453340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff61a49de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562e57458db0 con 0x562e574808b0 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff616218640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743b300 0x562e57453340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:40214/0 (socket says 10.20.193.4:40214) 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562e57458f20 con 0x562e5743b300 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff616218640 1 -- 10.20.193.4:0/26177645 learned_addr learned my addr 10.20.193.4:0/26177645 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562e574590e0 con 0x562e5743bc10 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff615a17640 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e57453880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff616a19640 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e574808b0 0x562e57458870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff616218640 1 -- 10.20.193.4:0/26177645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 msgr2=0x562e57453880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff616218640 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e57453880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff616218640 1 -- 10.20.193.4:0/26177645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e574808b0 msgr2=0x562e57458870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff616218640 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e574808b0 0x562e57458870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.194+0000 7ff616218640 1 -- 10.20.193.4:0/26177645 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e572c4cd0 con 0x562e5743b300 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.195+0000 7ff616218640 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743b300 0x562e57453340 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=16442416077765767779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff600038f90 tx=0x7ff6000d1790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e42f324e9c667263 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.195+0000 7ff5c3fff640 10 client.0 ms_handle_connect on v2:10.20.193.14:3300/0 2026-02-24T09:12:43.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.195+0000 7ff5c3fff640 1 -- 10.20.193.4:0/26177645 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6000d7070 con 0x562e5743b300 2026-02-24T09:12:43.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.195+0000 7ff5c3fff640 1 -- 10.20.193.4:0/26177645 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6000d7310 con 0x562e5743b300 2026-02-24T09:12:43.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.195+0000 7ff5c3fff640 1 -- 10.20.193.4:0/26177645 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff600041b30 con 0x562e5743b300 2026-02-24T09:12:43.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.195+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff60c00a920 con 0x562e5743b300 2026-02-24T09:12:43.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.195+0000 7ff5c3fff640 1 -- 10.20.193.4:0/26177645 <== mon.2 v2:10.20.193.14:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff600041c90 con 0x562e5743b300 2026-02-24T09:12:43.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.195+0000 7ff5c3fff640 10 client.25781 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:43.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.196+0000 7ff61a49de00 10 client.25781 _ll_register_callbacks cb 0x562e572bd790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:43.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.196+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e56fce9d0 con 0x562e5743b300 2026-02-24T09:12:43.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.197+0000 7ff5c3fff640 1 -- 10.20.193.4:0/26177645 <== mon.2 v2:10.20.193.14:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff6000dc730 con 0x562e5743b300 2026-02-24T09:12:43.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.197+0000 7ff61a49de00 10 client.25781 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:43.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.197+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562e572d6ab0 con 0x562e5743b300 2026-02-24T09:12:43.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.197+0000 7ff5c3fff640 1 -- 10.20.193.4:0/26177645 <== mon.2 v2:10.20.193.14:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff6000f6030 con 0x562e5743b300 2026-02-24T09:12:43.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.197+0000 7ff61a49de00 10 client.25781 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:43.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.197+0000 7ff61a49de00 10 client.25781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:43.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.197+0000 7ff61a49de00 20 client.25781 populate_metadata read hostname 'trial004' 2026-02-24T09:12:43.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.197+0000 7ff61a49de00 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562e5747d800 0x562e5747dc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.197+0000 7ff61a49de00 4 client.25781 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:43.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.197+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e57351b70 con 0x562e5747d800 2026-02-24T09:12:43.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.198+0000 7ff615a17640 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562e5747d800 0x562e5747dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.198+0000 7ff615a17640 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562e5747d800 0x562e5747dc70 crc :-1 s=READY pgs=81 gs=4 cs=0 l=0 c_cookie=5905237292977168633 s_cookie=1284361913950711613 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51f39e07da4b20f9 server_cookie=11d2f85b1c12af3d in_seq=0 out_seq=0 2026-02-24T09:12:43.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.198+0000 7ff5c3fff640 10 client.25781 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.198+0000 7ff5c3fff640 1 -- 10.20.193.4:0/26177645 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562e57351b70 con 0x562e5747d800 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.198+0000 7ff5c3fff640 10 client.25781 handle_command_reply: tid=0 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.198+0000 7ff61a49de00 1 client.25781 shutdown 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743b300 msgr2=0x562e57453340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743b300 0x562e57453340 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=16442416077765767779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff600038f90 tx=0x7ff6000d1790 comp rx=0 tx=0).stop 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 shutdown_connections 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562e5747d800 0x562e5747dc70 crc :-1 s=READY pgs=81 gs=4 cs=0 l=0 c_cookie=5905237292977168633 s_cookie=1284361913950711613 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e574808b0 0x562e57458870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e57453880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 1 --2- 10.20.193.4:0/26177645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743b300 0x562e57453340 unknown :-1 s=CLOSED pgs=82 gs=1 cs=0 l=1 c_cookie=16442416077765767779 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff5c3fff640 0 client.25781 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:43.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 >> 10.20.193.4:0/26177645 conn(0x562e573594f0 msgr2=0x562e5743a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 shutdown_connections 2026-02-24T09:12:43.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 1 -- 10.20.193.4:0/26177645 wait complete. 2026-02-24T09:12:43.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.199+0000 7ff61a49de00 20 client.25781 trim_cache size 0 max 16384 2026-02-24T09:12:43.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.214+0000 7ff61a49de00 1 Processor -- start 2026-02-24T09:12:43.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.214+0000 7ff61a49de00 1 -- start start 2026-02-24T09:12:43.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.214+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 0x562e5743a4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.214+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e5743aa30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.214+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e5743bfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.214+0000 7ff61a49de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562e5733efe0 con 0x562e5743b300 2026-02-24T09:12:43.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.214+0000 7ff61a49de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562e57009fe0 con 0x562e574808b0 2026-02-24T09:12:43.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.214+0000 7ff61a49de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562e5744c600 con 0x562e5743bc10 2026-02-24T09:12:43.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.214+0000 7ff616a19640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e5743bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.215+0000 7ff616a19640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e5743bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:40224/0 (socket says 10.20.193.4:40224) 2026-02-24T09:12:43.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.215+0000 7ff616a19640 1 -- 10.20.193.4:0/180569666 learned_addr learned my addr 10.20.193.4:0/180569666 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:43.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.215+0000 7ff616218640 1 --2- 10.20.193.4:0/180569666 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 0x562e5743a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.215+0000 7ff615a17640 1 --2- 10.20.193.4:0/180569666 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e5743aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.215+0000 7ff616a19640 1 -- 10.20.193.4:0/180569666 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 msgr2=0x562e5743aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.215+0000 7ff616a19640 1 --2- 10.20.193.4:0/180569666 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e5743aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.215+0000 7ff616a19640 1 -- 10.20.193.4:0/180569666 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 msgr2=0x562e5743a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.215+0000 7ff616a19640 1 --2- 10.20.193.4:0/180569666 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 0x562e5743a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.215+0000 7ff616a19640 1 -- 10.20.193.4:0/180569666 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e572d1530 con 0x562e574808b0 2026-02-24T09:12:43.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.215+0000 7ff616a19640 1 --2- 10.20.193.4:0/180569666 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e5743bfe0 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=8996267859524978300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60c00ac80 tx=0x7ff60c00c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cd929f43740067c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.216+0000 7ff5de4e6640 1 -- 10.20.193.4:0/180569666 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff60c00f040 con 0x562e574808b0 2026-02-24T09:12:43.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.216+0000 7ff5de4e6640 1 -- 10.20.193.4:0/180569666 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff60c005580 con 0x562e574808b0 2026-02-24T09:12:43.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.216+0000 7ff5de4e6640 1 -- 10.20.193.4:0/180569666 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff60c01d690 con 0x562e574808b0 2026-02-24T09:12:43.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.217+0000 7ff61a49de00 1 -- 10.20.193.4:0/180569666 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 msgr2=0x562e5743bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.217+0000 7ff61a49de00 1 --2- 10.20.193.4:0/180569666 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e5743bfe0 secure :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=8996267859524978300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60c00ac80 tx=0x7ff60c00c9a0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.217+0000 7ff61a49de00 1 -- 10.20.193.4:0/180569666 shutdown_connections 2026-02-24T09:12:43.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.217+0000 7ff61a49de00 1 --2- 10.20.193.4:0/180569666 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e574808b0 0x562e5743bfe0 unknown :-1 s=CLOSED pgs=83 gs=1 cs=0 l=1 c_cookie=8996267859524978300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.217+0000 7ff61a49de00 1 --2- 10.20.193.4:0/180569666 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743bc10 0x562e5743aa30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.217+0000 7ff61a49de00 1 --2- 10.20.193.4:0/180569666 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e5743b300 0x562e5743a4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.217+0000 7ff61a49de00 1 -- 10.20.193.4:0/180569666 >> 10.20.193.4:0/180569666 conn(0x562e573594f0 msgr2=0x562e57457ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.217+0000 7ff61a49de00 1 -- 10.20.193.4:0/180569666 shutdown_connections 2026-02-24T09:12:43.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.217+0000 7ff61a49de00 1 -- 10.20.193.4:0/180569666 wait complete. 2026-02-24T09:12:43.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.218+0000 7ff61a49de00 1 -- start start 2026-02-24T09:12:43.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff61a49de00 1 Processor -- start 2026-02-24T09:12:43.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743b300 0x562e5745f620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743bc10 0x562e5745cb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff61a49de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e574808b0 0x562e5745d300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff61a49de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562e57458980 con 0x562e574808b0 2026-02-24T09:12:43.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff61a49de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562e5747de00 con 0x562e5743bc10 2026-02-24T09:12:43.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff61a49de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562e574e2db0 con 0x562e5743b300 2026-02-24T09:12:43.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff616218640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743b300 0x562e5745f620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff616218640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743b300 0x562e5745f620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:35210/0 (socket says 10.20.193.4:35210) 2026-02-24T09:12:43.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff615a17640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743bc10 0x562e5745cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff616218640 1 -- 10.20.193.4:0/1886678055 learned_addr learned my addr 10.20.193.4:0/1886678055 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:43.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff616a19640 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e574808b0 0x562e5745d300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff616218640 1 -- 10.20.193.4:0/1886678055 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743bc10 msgr2=0x562e5745cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff616218640 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743bc10 0x562e5745cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff616218640 1 -- 10.20.193.4:0/1886678055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e574808b0 msgr2=0x562e5745d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff616218640 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e574808b0 0x562e5745d300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff616218640 1 -- 10.20.193.4:0/1886678055 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e572c5000 con 0x562e5743b300 2026-02-24T09:12:43.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.219+0000 7ff615a17640 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743bc10 0x562e5745cb70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:43.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff616218640 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743b300 0x562e5745f620 secure :-1 s=READY pgs=97 gs=2 cs=0 l=1 c_cookie=18110332688108102101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60002fe80 tx=0x7ff60002f1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb54d3a08ed421d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff5c3fff640 10 client.0 ms_handle_connect on v2:10.20.193.90:3300/0 2026-02-24T09:12:43.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff5c3fff640 1 -- 10.20.193.4:0/1886678055 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6000d7040 con 0x562e5743b300 2026-02-24T09:12:43.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff5c3fff640 1 -- 10.20.193.4:0/1886678055 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x562e56fce9d0 con 0x562e5743b300 2026-02-24T09:12:43.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 1 -- 10.20.193.4:0/1886678055 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e572ec6e0 con 0x562e5743b300 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff5c3fff640 1 -- 10.20.193.4:0/1886678055 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff6000d2500 con 0x562e5743b300 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 10 client.25861 _ll_register_callbacks cb 0x562e572bd790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 1 -- 10.20.193.4:0/1886678055 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e573537e0 con 0x562e5743b300 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff5c3fff640 1 -- 10.20.193.4:0/1886678055 <== mon.1 v2:10.20.193.90:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff6000d3230 con 0x562e5743b300 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff5c3fff640 1 -- 10.20.193.4:0/1886678055 <== mon.1 v2:10.20.193.90:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff6000d08e0 con 0x562e5743b300 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 10 client.25861 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 1 -- 10.20.193.4:0/1886678055 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562e572d6d10 con 0x562e5743b300 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff5c3fff640 1 -- 10.20.193.4:0/1886678055 <== mon.1 v2:10.20.193.90:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff6000f6070 con 0x562e5743b300 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 10 client.25861 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 10 client.25861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 20 client.25861 populate_metadata read hostname 'trial004' 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562e574e42a0 0x562e574e4740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 4 client.25861 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.220+0000 7ff61a49de00 1 -- 10.20.193.4:0/1886678055 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562e56fcc220 con 0x562e574e42a0 2026-02-24T09:12:43.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.221+0000 7ff615a17640 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562e574e42a0 0x562e574e4740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.221+0000 7ff5c3fff640 10 client.25861 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.221+0000 7ff615a17640 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562e574e42a0 0x562e574e4740 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=6419223614132917798 s_cookie=13948296203003590940 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5915a9ddd6311626 server_cookie=c1924d7ed1f5791c in_seq=0 out_seq=0 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.222+0000 7ff5c3fff640 1 -- 10.20.193.4:0/1886678055 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562e56fcc220 con 0x562e574e42a0 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.222+0000 7ff5c3fff640 10 client.25861 handle_command_reply: tid=0 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.222+0000 7ff61a49de00 1 client.25861 shutdown 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.222+0000 7ff61a49de00 1 -- 10.20.193.4:0/1886678055 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743b300 msgr2=0x562e5745f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.222+0000 7ff61a49de00 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743b300 0x562e5745f620 secure :-1 s=READY pgs=97 gs=2 cs=0 l=1 c_cookie=18110332688108102101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60002fe80 tx=0x7ff60002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.223+0000 7ff61a49de00 1 -- 10.20.193.4:0/1886678055 shutdown_connections 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.223+0000 7ff61a49de00 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562e574e42a0 0x562e574e4740 crc :-1 s=READY pgs=82 gs=4 cs=0 l=0 c_cookie=6419223614132917798 s_cookie=13948296203003590940 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.223+0000 7ff61a49de00 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562e574808b0 0x562e5745d300 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.223+0000 7ff61a49de00 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562e5743bc10 0x562e5745cb70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.223+0000 7ff5c3fff640 0 client.25861 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.223+0000 7ff61a49de00 1 --2- 10.20.193.4:0/1886678055 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562e5743b300 0x562e5745f620 unknown :-1 s=CLOSED pgs=97 gs=2 cs=0 l=1 c_cookie=18110332688108102101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.223+0000 7ff61a49de00 1 -- 10.20.193.4:0/1886678055 >> 10.20.193.4:0/1886678055 conn(0x562e573594f0 msgr2=0x562e574565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.223+0000 7ff61a49de00 1 -- 10.20.193.4:0/1886678055 shutdown_connections 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.223+0000 7ff61a49de00 1 -- 10.20.193.4:0/1886678055 wait complete. 2026-02-24T09:12:43.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.223+0000 7ff61a49de00 20 client.25861 trim_cache size 0 max 16384 2026-02-24T09:12:43.233 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:12:43.233 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:12:43.233 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a", 2026-02-24T09:12:43.233 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:12:43.233 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.225+0000 7ff6184a3640 1 -- 10.20.193.4:0/3603511997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b56e0 msgr2=0x7ff5ec0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.225+0000 7ff6184a3640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b56e0 0x7ff5ec0d5b90 secure :-1 s=READY pgs=327 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff610124530 tx=0x7ff60400b410 comp rx=0 tx=0).stop 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.225+0000 7ff6184a3640 1 -- 10.20.193.4:0/3603511997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61010f280 msgr2=0x7ff61011db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.225+0000 7ff6184a3640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61010f280 0x7ff61011db90 secure :-1 s=READY pgs=80 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff6000023d0 tx=0x7ff6000043d0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.225+0000 7ff6184a3640 1 -- 10.20.193.4:0/3603511997 shutdown_connections 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.225+0000 7ff6184a3640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b56e0 0x7ff5ec0d5b90 unknown :-1 s=CLOSED pgs=327 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.225+0000 7ff6184a3640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff610115470 0x7ff6101234a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.225+0000 7ff6184a3640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff61010fc70 0x7ff61011e0d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.225+0000 7ff6184a3640 1 --2- 10.20.193.4:0/3603511997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61010f280 0x7ff61011db90 unknown :-1 s=CLOSED pgs=80 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.225+0000 7ff6184a3640 1 -- 10.20.193.4:0/3603511997 >> 10.20.193.4:0/3603511997 conn(0x7ff61005f830 msgr2=0x7ff61010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.226+0000 7ff6184a3640 1 -- 10.20.193.4:0/3603511997 shutdown_connections 2026-02-24T09:12:43.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.226+0000 7ff6184a3640 1 -- 10.20.193.4:0/3603511997 wait complete. 2026-02-24T09:12:43.326 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:12:43.497 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 -- 10.20.193.4:0/3206503810 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f63ec110040 msgr2=0x7f63ec115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 --2- 10.20.193.4:0/3206503810 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f63ec110040 0x7f63ec115090 secure :-1 s=READY pgs=692 gs=1 cs=0 l=1 c_cookie=8944150841048069496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63d4009950 tx=0x7f63d402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 -- 10.20.193.4:0/3206503810 shutdown_connections 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 --2- 10.20.193.4:0/3206503810 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f63ec115840 0x7f63ec176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 --2- 10.20.193.4:0/3206503810 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f63ec110040 0x7f63ec115090 unknown :-1 s=CLOSED pgs=692 gs=1 cs=0 l=1 c_cookie=8944150841048069496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 --2- 10.20.193.4:0/3206503810 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63ec10f650 0x7f63ec10fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 -- 10.20.193.4:0/3206503810 >> 10.20.193.4:0/3206503810 conn(0x7f63ec0ecf20 msgr2=0x7f63ec10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 -- 10.20.193.4:0/3206503810 shutdown_connections 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 -- 10.20.193.4:0/3206503810 wait complete. 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 Processor -- start 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.687+0000 7f63f2de8640 1 -- start start 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f2de8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63ec10f650 0x7f63ec0f5a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f2de8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f63ec110040 0x7f63ec176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f2de8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f63ec115840 0x7f63ec0f6140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f2de8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec0fb350 con 0x7f63ec115840 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f2de8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec0fb4c0 con 0x7f63ec110040 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f2de8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec0fb680 con 0x7f63ec10f650 2026-02-24T09:12:43.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f135e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f63ec115840 0x7f63ec0f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f135e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f63ec115840 0x7f63ec0f6140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56396/0 (socket says 10.20.193.4:56396) 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f135e640 1 -- 10.20.193.4:0/2545657940 learned_addr learned my addr 10.20.193.4:0/2545657940 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63e3fff640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f63ec110040 0x7f63ec176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63ec10f650 0x7f63ec0f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f135e640 1 -- 10.20.193.4:0/2545657940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63ec10f650 msgr2=0x7f63ec0f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f135e640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63ec10f650 0x7f63ec0f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f135e640 1 -- 10.20.193.4:0/2545657940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f63ec110040 msgr2=0x7f63ec176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f135e640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f63ec110040 0x7f63ec176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f135e640 1 -- 10.20.193.4:0/2545657940 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d4009570 con 0x7f63ec115840 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f135e640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f63ec115840 0x7f63ec0f6140 secure :-1 s=READY pgs=693 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63e800c750 tx=0x7f63e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63e1ffb640 1 -- 10.20.193.4:0/2545657940 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63e8005500 con 0x7f63ec115840 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f2de8640 1 -- 10.20.193.4:0/2545657940 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ec0fb960 con 0x7f63ec115840 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63e1ffb640 1 -- 10.20.193.4:0/2545657940 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f63e8003c60 con 0x7f63ec115840 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63f2de8640 1 -- 10.20.193.4:0/2545657940 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ec0fbe80 con 0x7f63ec115840 2026-02-24T09:12:43.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.688+0000 7f63e1ffb640 1 -- 10.20.193.4:0/2545657940 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63e800ddb0 con 0x7f63ec115840 2026-02-24T09:12:43.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.690+0000 7f63e1ffb640 1 -- 10.20.193.4:0/2545657940 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f63e8016470 con 0x7f63ec115840 2026-02-24T09:12:43.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.691+0000 7f63e1ffb640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63c80b5750 0x7f63c80d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.691+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63c80b5750 0x7f63c80d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.691+0000 7f63e1ffb640 1 -- 10.20.193.4:0/2545657940 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f63e80e8130 con 0x7f63ec115840 2026-02-24T09:12:43.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.691+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63c80b5750 0x7f63c80d5c00 secure :-1 s=READY pgs=328 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63dc006fd0 tx=0x7f63dc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f4de2e00 1 Processor -- start 2026-02-24T09:12:43.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f4de2e00 1 -- start start 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d345556bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d34559b890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d34559bdd0 0x55d3455bc1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d345466de0 con 0x55d345556820 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d345462b10 con 0x55d345557130 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d34545cab0 con 0x55d34559bdd0 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f0b5d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d345556bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f0b5d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d345556bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56404/0 (socket says 10.20.193.4:56404) 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f0b5d640 1 -- 10.20.193.4:0/2606680412 learned_addr learned my addr 10.20.193.4:0/2606680412 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63e3fff640 1 --2- 10.20.193.4:0/2606680412 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d34559b890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f0b5d640 1 -- 10.20.193.4:0/2606680412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d34559bdd0 msgr2=0x55d3455bc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f135e640 1 --2- 10.20.193.4:0/2606680412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d34559bdd0 0x55d3455bc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2606680412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d34559bdd0 0x55d3455bc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f0b5d640 1 -- 10.20.193.4:0/2606680412 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 msgr2=0x55d34559b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2606680412 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d34559b890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f0b5d640 1 -- 10.20.193.4:0/2606680412 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d345408310 con 0x55d345556820 2026-02-24T09:12:43.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2606680412 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d345556bf0 secure :-1 s=READY pgs=694 gs=1 cs=0 l=1 c_cookie=2240151974308902708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63dc0041d0 tx=0x7f63dc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f169e5a0f927734 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63b94e4640 1 -- 10.20.193.4:0/2606680412 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63dc0028c0 con 0x55d345556820 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63b94e4640 1 -- 10.20.193.4:0/2606680412 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f63dc020450 con 0x55d345556820 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.693+0000 7f63b94e4640 1 -- 10.20.193.4:0/2606680412 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63dc012680 con 0x55d345556820 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.694+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2606680412 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 msgr2=0x55d345556bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.694+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2606680412 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d345556bf0 secure :-1 s=READY pgs=694 gs=1 cs=0 l=1 c_cookie=2240151974308902708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63dc0041d0 tx=0x7f63dc010000 comp rx=0 tx=0).stop 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.694+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2606680412 shutdown_connections 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.694+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2606680412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d34559bdd0 0x55d3455bc1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.694+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2606680412 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d34559b890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.694+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2606680412 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d345556bf0 unknown :-1 s=CLOSED pgs=694 gs=1 cs=0 l=1 c_cookie=2240151974308902708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.694+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2606680412 >> 10.20.193.4:0/2606680412 conn(0x55d3454756b0 msgr2=0x55d345555100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.694+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2606680412 shutdown_connections 2026-02-24T09:12:43.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.694+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2606680412 wait complete. 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.695+0000 7f63f4de2e00 1 -- start start 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.695+0000 7f63f4de2e00 1 Processor -- start 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.695+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d345556820 0x55d34556ee90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.695+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d34556f3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.695+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d34559bdd0 0x55d3455743c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.695+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d345574900 con 0x55d34559bdd0 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.695+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d345574a70 con 0x55d345557130 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.695+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d345574c30 con 0x55d345556820 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.695+0000 7f63f135e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d34559bdd0 0x55d3455743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63f135e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d34559bdd0 0x55d3455743c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56418/0 (socket says 10.20.193.4:56418) 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63f135e640 1 -- 10.20.193.4:0/2795864789 learned_addr learned my addr 10.20.193.4:0/2795864789 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d345556820 0x55d34556ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63e3fff640 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d34556f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63f135e640 1 -- 10.20.193.4:0/2795864789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d345556820 msgr2=0x55d34556ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63f135e640 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d345556820 0x55d34556ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63f135e640 1 -- 10.20.193.4:0/2795864789 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 msgr2=0x55d34556f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63f135e640 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d34556f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63f135e640 1 -- 10.20.193.4:0/2795864789 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3453e08c0 con 0x55d34559bdd0 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63f135e640 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d34559bdd0 0x55d3455743c0 secure :-1 s=READY pgs=695 gs=1 cs=0 l=1 c_cookie=1742274588779694088 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63e80050a0 tx=0x7f63e800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182dcd81ed674808 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63aa7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2795864789 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63e80aeea0 con 0x55d34559bdd0 2026-02-24T09:12:43.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2795864789 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f63e80b41c0 con 0x55d34559bdd0 2026-02-24T09:12:43.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2795864789 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63e80b93d0 con 0x55d34559bdd0 2026-02-24T09:12:43.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2795864789 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63dc00e040 con 0x55d34559bdd0 2026-02-24T09:12:43.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2795864789 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f63e80af380 con 0x55d34559bdd0 2026-02-24T09:12:43.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.696+0000 7f63aa7fc640 10 client.16341 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f4de2e00 10 client.16341 _ll_register_callbacks cb 0x55d3453f8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2795864789 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d3451ac4a0 con 0x55d34559bdd0 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2795864789 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f63e80b67a0 con 0x55d34559bdd0 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f4de2e00 10 client.16341 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2795864789 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d3453f26e0 con 0x55d34559bdd0 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2795864789 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f63e80735a0 con 0x55d34559bdd0 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f4de2e00 10 client.16341 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f4de2e00 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f4de2e00 20 client.16341 populate_metadata read hostname 'trial004' 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d345599710 0x55d345599bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f4de2e00 4 client.16341 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2795864789 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3454524f0 con 0x55d345599710 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.697+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d345599710 0x55d345599bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d345599710 0x55d345599bb0 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=3640074609260904695 s_cookie=5548652412673767658 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3284249238ea40f7 server_cookie=4d00c5f8a788b8ea in_seq=0 out_seq=0 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63aa7fc640 10 client.16341 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2795864789 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d3454524f0 con 0x55d345599710 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63aa7fc640 10 client.16341 handle_command_reply: tid=0 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 client.16341 shutdown 2026-02-24T09:12:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2795864789 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d34559bdd0 msgr2=0x55d3455743c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d34559bdd0 0x55d3455743c0 secure :-1 s=READY pgs=695 gs=1 cs=0 l=1 c_cookie=1742274588779694088 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63e80050a0 tx=0x7f63e800cee0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2795864789 shutdown_connections 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d345599710 0x55d345599bb0 crc :-1 s=READY pgs=83 gs=4 cs=0 l=0 c_cookie=3640074609260904695 s_cookie=5548652412673767658 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d34559bdd0 0x55d3455743c0 unknown :-1 s=CLOSED pgs=695 gs=1 cs=0 l=1 c_cookie=1742274588779694088 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d34556f3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63aa7fc640 0 client.16341 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2795864789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d345556820 0x55d34556ee90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2795864789 >> 10.20.193.4:0/2795864789 conn(0x55d3454756b0 msgr2=0x55d345555810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2795864789 shutdown_connections 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2795864789 wait complete. 2026-02-24T09:12:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.698+0000 7f63f4de2e00 20 client.16341 trim_cache size 0 max 16384 2026-02-24T09:12:43.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.707+0000 7f63f4de2e00 1 Processor -- start 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.707+0000 7f63f4de2e00 1 -- start start 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d34556c490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d3455948a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d34559bdd0 0x55d345594de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d34545a6e0 con 0x55d345556820 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d345125f50 con 0x55d345557130 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d3454c9150 con 0x55d34559bdd0 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f0b5d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d34556c490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f0b5d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d34556c490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56420/0 (socket says 10.20.193.4:56420) 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f0b5d640 1 -- 10.20.193.4:0/798893463 learned_addr learned my addr 10.20.193.4:0/798893463 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:43.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f135e640 1 --2- 10.20.193.4:0/798893463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d34559bdd0 0x55d345594de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f0b5d640 1 -- 10.20.193.4:0/798893463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d34559bdd0 msgr2=0x55d345594de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/798893463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d34559bdd0 0x55d345594de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f0b5d640 1 -- 10.20.193.4:0/798893463 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 msgr2=0x55d3455948a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/798893463 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d3455948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f0b5d640 1 -- 10.20.193.4:0/798893463 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3453ed160 con 0x55d345556820 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/798893463 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d34556c490 secure :-1 s=READY pgs=696 gs=1 cs=0 l=1 c_cookie=9720679778561422938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63dc020eb0 tx=0x7f63dc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e6cac19879f65a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63b8ce3640 1 -- 10.20.193.4:0/798893463 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63dc005dd0 con 0x55d345556820 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63b8ce3640 1 -- 10.20.193.4:0/798893463 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f63dc018040 con 0x55d345556820 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.708+0000 7f63b8ce3640 1 -- 10.20.193.4:0/798893463 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63dc02e7d0 con 0x55d345556820 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 -- 10.20.193.4:0/798893463 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 msgr2=0x55d34556c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/798893463 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d34556c490 secure :-1 s=READY pgs=696 gs=1 cs=0 l=1 c_cookie=9720679778561422938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63dc020eb0 tx=0x7f63dc010000 comp rx=0 tx=0).stop 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 -- 10.20.193.4:0/798893463 shutdown_connections 2026-02-24T09:12:43.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/798893463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d34559bdd0 0x55d345594de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/798893463 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d345557130 0x55d3455948a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/798893463 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345556820 0x55d34556c490 unknown :-1 s=CLOSED pgs=696 gs=1 cs=0 l=1 c_cookie=9720679778561422938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 -- 10.20.193.4:0/798893463 >> 10.20.193.4:0/798893463 conn(0x55d3454756b0 msgr2=0x55d345554a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 -- 10.20.193.4:0/798893463 shutdown_connections 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 -- 10.20.193.4:0/798893463 wait complete. 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 -- start start 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 Processor -- start 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d345556820 0x55d3455770c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345557130 0x55d345577600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d34559bdd0 0x55d34557a6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d3454c5600 con 0x55d345557130 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d3454c63d0 con 0x55d34559bdd0 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f4de2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d34557ac60 con 0x55d345556820 2026-02-24T09:12:43.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63e3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345557130 0x55d345577600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63e3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345557130 0x55d345577600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56422/0 (socket says 10.20.193.4:56422) 2026-02-24T09:12:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63e3fff640 1 -- 10.20.193.4:0/2144069609 learned_addr learned my addr 10.20.193.4:0/2144069609 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.709+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d345556820 0x55d3455770c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f135e640 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d34559bdd0 0x55d34557a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63e3fff640 1 -- 10.20.193.4:0/2144069609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d345556820 msgr2=0x55d3455770c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63e3fff640 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d345556820 0x55d3455770c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63e3fff640 1 -- 10.20.193.4:0/2144069609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d34559bdd0 msgr2=0x55d34557a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63e3fff640 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d34559bdd0 0x55d34557a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63e3fff640 1 -- 10.20.193.4:0/2144069609 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3453e0bf0 con 0x55d345557130 2026-02-24T09:12:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63e3fff640 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345557130 0x55d345577600 secure :-1 s=READY pgs=697 gs=1 cs=0 l=1 c_cookie=9905382865124540388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63d4009950 tx=0x7f63d40387c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8976fd3c1ffd3fe4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63aa7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2144069609 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63d40028c0 con 0x55d345557130 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2144069609 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d345408310 con 0x55d345557130 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2144069609 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f63d4002a20 con 0x55d345557130 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2144069609 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63d4046810 con 0x55d345557130 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 10 client.16347 _ll_register_callbacks cb 0x55d3453f8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2144069609 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d3450e7f40 con 0x55d345557130 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2144069609 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f63d40469a0 con 0x55d345557130 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2144069609 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f63d4046b60 con 0x55d345557130 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 10 client.16347 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2144069609 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d3453f2940 con 0x55d345557130 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2144069609 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f63d4038920 con 0x55d345557130 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 10 client.16347 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:43.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:43.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 20 client.16347 populate_metadata read hostname 'trial004' 2026-02-24T09:12:43.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d345649c60 0x55d34566a0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:43.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 4 client.16347 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:12:43.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.710+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2144069609 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f63dc020450 con 0x55d345649c60 2026-02-24T09:12:43.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.711+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d345649c60 0x55d34566a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:43.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63aa7fc640 10 client.16347 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:43.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f0b5d640 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d345649c60 0x55d34566a0e0 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=15501919478392065021 s_cookie=13469337276403756758 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d721e1a206448bfd server_cookie=baecb2e3a7f92ed6 in_seq=0 out_seq=0 2026-02-24T09:12:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63aa7fc640 1 -- 10.20.193.4:0/2144069609 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x7f63dc020450 con 0x55d345649c60 2026-02-24T09:12:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63aa7fc640 10 client.16347 handle_command_reply: tid=0 2026-02-24T09:12:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 client.16347 shutdown 2026-02-24T09:12:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2144069609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345557130 msgr2=0x55d345577600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345557130 0x55d345577600 secure :-1 s=READY pgs=697 gs=1 cs=0 l=1 c_cookie=9905382865124540388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63d4009950 tx=0x7f63d40387c0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2144069609 shutdown_connections 2026-02-24T09:12:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d345649c60 0x55d34566a0e0 crc :-1 s=READY pgs=84 gs=4 cs=0 l=0 c_cookie=15501919478392065021 s_cookie=13469337276403756758 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d34559bdd0 0x55d34557a6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d345557130 0x55d345577600 unknown :-1 s=CLOSED pgs=697 gs=1 cs=0 l=1 c_cookie=9905382865124540388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63aa7fc640 0 client.16347 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:43.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 --2- 10.20.193.4:0/2144069609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d345556820 0x55d3455770c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2144069609 >> 10.20.193.4:0/2144069609 conn(0x55d3454756b0 msgr2=0x55d3455551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2144069609 shutdown_connections 2026-02-24T09:12:43.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.712+0000 7f63f4de2e00 1 -- 10.20.193.4:0/2144069609 wait complete. 2026-02-24T09:12:43.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f4de2e00 20 client.16347 trim_cache size 0 max 16384 2026-02-24T09:12:43.722 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:12:43.722 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:12:43.722 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:43.723 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:43.724 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:43.725 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:43.726 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:43.726 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:43.726 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:12:43.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 -- 10.20.193.4:0/2545657940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63c80b5750 msgr2=0x7f63c80d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63c80b5750 0x7f63c80d5c00 secure :-1 s=READY pgs=328 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63dc006fd0 tx=0x7f63dc008040 comp rx=0 tx=0).stop 2026-02-24T09:12:43.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 -- 10.20.193.4:0/2545657940 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f63ec115840 msgr2=0x7f63ec0f6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:43.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f63ec115840 0x7f63ec0f6140 secure :-1 s=READY pgs=693 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63e800c750 tx=0x7f63e800cc20 comp rx=0 tx=0).stop 2026-02-24T09:12:43.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 -- 10.20.193.4:0/2545657940 shutdown_connections 2026-02-24T09:12:43.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63c80b5750 0x7f63c80d5c00 unknown :-1 s=CLOSED pgs=328 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f63ec115840 0x7f63ec0f6140 unknown :-1 s=CLOSED pgs=693 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f63ec110040 0x7f63ec176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 --2- 10.20.193.4:0/2545657940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f63ec10f650 0x7f63ec0f5a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:43.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 -- 10.20.193.4:0/2545657940 >> 10.20.193.4:0/2545657940 conn(0x7f63ec0ecf20 msgr2=0x7f63ec111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:43.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 -- 10.20.193.4:0/2545657940 shutdown_connections 2026-02-24T09:12:43.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:43.713+0000 7f63f2de8640 1 -- 10.20.193.4:0/2545657940 wait complete. 2026-02-24T09:12:43.757 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:12:43.757 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:12:43.892 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:43.919 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:43 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:12:43.920 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:43 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:43.920 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:43 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:12:43.920 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:43 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:43.920 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:43 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:12:44.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.015+0000 7f346267c640 1 -- 10.20.193.4:0/1803589044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f345c10fc70 msgr2=0x7f345c114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 --2- 10.20.193.4:0/1803589044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f345c10fc70 0x7f345c114cc0 secure :-1 s=READY pgs=698 gs=1 cs=0 l=1 c_cookie=17376880189451573477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f344c009950 tx=0x7f344c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 -- 10.20.193.4:0/1803589044 shutdown_connections 2026-02-24T09:12:44.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 --2- 10.20.193.4:0/1803589044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f345c115470 0x7f345c175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 --2- 10.20.193.4:0/1803589044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f345c10fc70 0x7f345c114cc0 unknown :-1 s=CLOSED pgs=698 gs=1 cs=0 l=1 c_cookie=17376880189451573477 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 --2- 10.20.193.4:0/1803589044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f345c10f280 0x7f345c10f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 -- 10.20.193.4:0/1803589044 >> 10.20.193.4:0/1803589044 conn(0x7f345c05f830 msgr2=0x7f345c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:44.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 -- 10.20.193.4:0/1803589044 shutdown_connections 2026-02-24T09:12:44.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 -- 10.20.193.4:0/1803589044 wait complete. 2026-02-24T09:12:44.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 Processor -- start 2026-02-24T09:12:44.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 -- start start 2026-02-24T09:12:44.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f345c10f280 0x7f345c0f55e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f345c10fc70 0x7f345c175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f345c115470 0x7f345c0f5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0faef0 con 0x7f345c10fc70 2026-02-24T09:12:44.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0fb060 con 0x7f345c10f280 2026-02-24T09:12:44.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f346267c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0fb220 con 0x7f345c115470 2026-02-24T09:12:44.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f345b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f345c10fc70 0x7f345c175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f345b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f345c10fc70 0x7f345c175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56448/0 (socket says 10.20.193.4:56448) 2026-02-24T09:12:44.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f345b7fe640 1 -- 10.20.193.4:0/2406421749 learned_addr learned my addr 10.20.193.4:0/2406421749 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:44.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f3460bf2640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f345c115470 0x7f345c0f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f345b7fe640 1 -- 10.20.193.4:0/2406421749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f345c115470 msgr2=0x7f345c0f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f345b7fe640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f345c115470 0x7f345c0f5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f345b7fe640 1 -- 10.20.193.4:0/2406421749 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f345c10f280 msgr2=0x7f345c0f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f345b7fe640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f345c10f280 0x7f345c0f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.016+0000 7f345b7fe640 1 -- 10.20.193.4:0/2406421749 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c009570 con 0x7f345c10fc70 2026-02-24T09:12:44.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.017+0000 7f345b7fe640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f345c10fc70 0x7f345c175d40 secure :-1 s=READY pgs=699 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f344c038820 tx=0x7f344c004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:44.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.017+0000 7f34597fa640 1 -- 10.20.193.4:0/2406421749 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f344c03d070 con 0x7f345c10fc70 2026-02-24T09:12:44.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.017+0000 7f346267c640 1 -- 10.20.193.4:0/2406421749 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345c0fb4a0 con 0x7f345c10fc70 2026-02-24T09:12:44.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.017+0000 7f34597fa640 1 -- 10.20.193.4:0/2406421749 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f344c002ad0 con 0x7f345c10fc70 2026-02-24T09:12:44.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.017+0000 7f34597fa640 1 -- 10.20.193.4:0/2406421749 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f344c041940 con 0x7f345c10fc70 2026-02-24T09:12:44.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.017+0000 7f346267c640 1 -- 10.20.193.4:0/2406421749 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345c0fb960 con 0x7f345c10fc70 2026-02-24T09:12:44.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.017+0000 7f346267c640 1 -- 10.20.193.4:0/2406421749 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f345c110560 con 0x7f345c10fc70 2026-02-24T09:12:44.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.019+0000 7f34597fa640 1 -- 10.20.193.4:0/2406421749 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f344c041ad0 con 0x7f345c10fc70 2026-02-24T09:12:44.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.020+0000 7f34597fa640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34300b56d0 0x7f34300d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.020+0000 7f345bfff640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34300b56d0 0x7f34300d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.020+0000 7f34597fa640 1 -- 10.20.193.4:0/2406421749 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f344c10b8d0 con 0x7f345c10fc70 2026-02-24T09:12:44.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.020+0000 7f345bfff640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34300b56d0 0x7f34300d5b80 secure :-1 s=READY pgs=329 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3448004740 tx=0x7f3448009690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:44.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.021+0000 7f34597fa640 1 -- 10.20.193.4:0/2406421749 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f344c0ce290 con 0x7f345c10fc70 2026-02-24T09:12:44.078 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:43 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:12:44.078 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:43 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:44.079 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:43 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:12:44.079 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:43 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:44.079 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:43 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:12:44.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:43 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:12:44.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:43 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:44.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:43 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:12:44.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:43 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:44.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:43 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:12:44.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.176+0000 7f346267c640 1 -- 10.20.193.4:0/2406421749 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f345c10f650 con 0x7f345c10fc70 2026-02-24T09:12:44.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.177+0000 7f34597fa640 1 -- 10.20.193.4:0/2406421749 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f344c0d1440 con 0x7f345c10fc70 2026-02-24T09:12:44.180 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:12:44.180 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:12:44.180 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 -- 10.20.193.4:0/2406421749 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34300b56d0 msgr2=0x7f34300d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34300b56d0 0x7f34300d5b80 secure :-1 s=READY pgs=329 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3448004740 tx=0x7f3448009690 comp rx=0 tx=0).stop 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 -- 10.20.193.4:0/2406421749 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f345c10fc70 msgr2=0x7f345c175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f345c10fc70 0x7f345c175d40 secure :-1 s=READY pgs=699 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f344c038820 tx=0x7f344c004300 comp rx=0 tx=0).stop 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 -- 10.20.193.4:0/2406421749 shutdown_connections 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34300b56d0 0x7f34300d5b80 unknown :-1 s=CLOSED pgs=329 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f345c115470 0x7f345c0f5ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f345c10fc70 0x7f345c175d40 unknown :-1 s=CLOSED pgs=699 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 --2- 10.20.193.4:0/2406421749 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f345c10f280 0x7f345c0f55e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 -- 10.20.193.4:0/2406421749 >> 10.20.193.4:0/2406421749 conn(0x7f345c05f830 msgr2=0x7f345c112ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 -- 10.20.193.4:0/2406421749 shutdown_connections 2026-02-24T09:12:44.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.182+0000 7f346267c640 1 -- 10.20.193.4:0/2406421749 wait complete. 2026-02-24T09:12:44.280 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:12:44.442 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:44.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.603+0000 7f010441a640 1 -- 10.20.193.4:0/1777429843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f00fc115840 msgr2=0x7f00fc176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.603+0000 7f010441a640 1 --2- 10.20.193.4:0/1777429843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f00fc115840 0x7f00fc176210 secure :-1 s=READY pgs=700 gs=1 cs=0 l=1 c_cookie=8405868359048221668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00f800aa30 tx=0x7f00f8030280 comp rx=0 tx=0).stop 2026-02-24T09:12:44.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 -- 10.20.193.4:0/1777429843 shutdown_connections 2026-02-24T09:12:44.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 --2- 10.20.193.4:0/1777429843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f00fc115840 0x7f00fc176210 unknown :-1 s=CLOSED pgs=700 gs=1 cs=0 l=1 c_cookie=8405868359048221668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 --2- 10.20.193.4:0/1777429843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00fc110040 0x7f00fc115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 --2- 10.20.193.4:0/1777429843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f00fc10f650 0x7f00fc10fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 -- 10.20.193.4:0/1777429843 >> 10.20.193.4:0/1777429843 conn(0x7f00fc0ecf20 msgr2=0x7f00fc10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:44.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 -- 10.20.193.4:0/1777429843 shutdown_connections 2026-02-24T09:12:44.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 -- 10.20.193.4:0/1777429843 wait complete. 2026-02-24T09:12:44.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 Processor -- start 2026-02-24T09:12:44.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 -- start start 2026-02-24T09:12:44.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00fc10f650 0x7f00fc11dec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f00fc110040 0x7f00fc11e400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f00fc115840 0x7f00fc1237d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc123df0 con 0x7f00fc110040 2026-02-24T09:12:44.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc123f60 con 0x7f00fc115840 2026-02-24T09:12:44.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010441a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc124120 con 0x7f00fc10f650 2026-02-24T09:12:44.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010198e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f00fc110040 0x7f00fc11e400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010198e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f00fc110040 0x7f00fc11e400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56468/0 (socket says 10.20.193.4:56468) 2026-02-24T09:12:44.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f0102990640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f00fc115840 0x7f00fc1237d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010198e640 1 -- 10.20.193.4:0/1857578707 learned_addr learned my addr 10.20.193.4:0/1857578707 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:44.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.604+0000 7f010218f640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00fc10f650 0x7f00fc11dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f010198e640 1 -- 10.20.193.4:0/1857578707 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00fc10f650 msgr2=0x7f00fc11dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f010198e640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00fc10f650 0x7f00fc11dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f010198e640 1 -- 10.20.193.4:0/1857578707 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f00fc115840 msgr2=0x7f00fc1237d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f010198e640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f00fc115840 0x7f00fc1237d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f010198e640 1 -- 10.20.193.4:0/1857578707 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f800a650 con 0x7f00fc110040 2026-02-24T09:12:44.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f010198e640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f00fc110040 0x7f00fc11e400 secure :-1 s=READY pgs=701 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00f000c8f0 tx=0x7f00f000cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:44.612 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f00e37fe640 1 -- 10.20.193.4:0/1857578707 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00f00044a0 con 0x7f00fc110040 2026-02-24T09:12:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f010441a640 1 -- 10.20.193.4:0/1857578707 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc124400 con 0x7f00fc110040 2026-02-24T09:12:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f00e37fe640 1 -- 10.20.193.4:0/1857578707 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00f0007cc0 con 0x7f00fc110040 2026-02-24T09:12:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f00e37fe640 1 -- 10.20.193.4:0/1857578707 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00f000f450 con 0x7f00fc110040 2026-02-24T09:12:44.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.605+0000 7f010441a640 1 -- 10.20.193.4:0/1857578707 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc164b00 con 0x7f00fc110040 2026-02-24T09:12:44.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.608+0000 7f00e37fe640 1 -- 10.20.193.4:0/1857578707 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f00f00026a0 con 0x7f00fc110040 2026-02-24T09:12:44.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.609+0000 7f00e37fe640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00d80b56e0 0x7f00d80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.609+0000 7f00e37fe640 1 -- 10.20.193.4:0/1857578707 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f00f00e6a10 con 0x7f00fc110040 2026-02-24T09:12:44.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.609+0000 7f010218f640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00d80b56e0 0x7f00d80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.609+0000 7f010218f640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00d80b56e0 0x7f00d80d5b90 secure :-1 s=READY pgs=330 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00ec004740 tx=0x7f00ec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:44.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.611+0000 7f0106414e00 1 Processor -- start 2026-02-24T09:12:44.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.611+0000 7f0106414e00 1 -- start start 2026-02-24T09:12:44.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.611+0000 7f0106414e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9d9320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.611+0000 7f0106414e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d9860 0x55eaaaa1dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.611+0000 7f0106414e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaaa3e8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.611+0000 7f0106414e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55eaaa8e9ee0 con 0x55eaaa9d9860 2026-02-24T09:12:44.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.611+0000 7f0106414e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55eaaa8e5c10 con 0x55eaaa9d8f50 2026-02-24T09:12:44.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.611+0000 7f0106414e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55eaaa8dfd70 con 0x55eaaaa1e500 2026-02-24T09:12:44.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010198e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d9860 0x55eaaaa1dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010218f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9d9320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010198e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d9860 0x55eaaaa1dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56476/0 (socket says 10.20.193.4:56476) 2026-02-24T09:12:44.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010198e640 1 -- 10.20.193.4:0/1335912946 learned_addr learned my addr 10.20.193.4:0/1335912946 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:44.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f0102990640 1 --2- 10.20.193.4:0/1335912946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaaa3e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010198e640 1 -- 10.20.193.4:0/1335912946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 msgr2=0x55eaaaa3e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:44.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010198e640 1 --2- 10.20.193.4:0/1335912946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaaa3e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010198e640 1 -- 10.20.193.4:0/1335912946 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d8f50 msgr2=0x55eaaa9d9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:44.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010198e640 1 --2- 10.20.193.4:0/1335912946 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9d9320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010198e640 1 -- 10.20.193.4:0/1335912946 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaaa88b340 con 0x55eaaa9d9860 2026-02-24T09:12:44.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010218f640 1 --2- 10.20.193.4:0/1335912946 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9d9320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:44.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f0102990640 1 --2- 10.20.193.4:0/1335912946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaaa3e8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:44.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f010198e640 1 --2- 10.20.193.4:0/1335912946 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d9860 0x55eaaaa1dfc0 secure :-1 s=READY pgs=702 gs=2 cs=0 l=1 c_cookie=17916517776449855130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00f000cfa0 tx=0x7f00f00a8c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a441fded43de9a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:44.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f00e0884640 1 -- 10.20.193.4:0/1335912946 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00f00d20e0 con 0x55eaaa9d9860 2026-02-24T09:12:44.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f00e0884640 1 -- 10.20.193.4:0/1335912946 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00f00ac5f0 con 0x55eaaa9d9860 2026-02-24T09:12:44.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.612+0000 7f00e0884640 1 -- 10.20.193.4:0/1335912946 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00f00b7c70 con 0x55eaaa9d9860 2026-02-24T09:12:44.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.613+0000 7f0106414e00 1 -- 10.20.193.4:0/1335912946 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d9860 msgr2=0x55eaaaa1dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.613+0000 7f0106414e00 1 --2- 10.20.193.4:0/1335912946 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d9860 0x55eaaaa1dfc0 secure :-1 s=READY pgs=702 gs=2 cs=0 l=1 c_cookie=17916517776449855130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00f000cfa0 tx=0x7f00f00a8c90 comp rx=0 tx=0).stop 2026-02-24T09:12:44.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.613+0000 7f0106414e00 1 -- 10.20.193.4:0/1335912946 shutdown_connections 2026-02-24T09:12:44.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.613+0000 7f0106414e00 1 --2- 10.20.193.4:0/1335912946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaaa3e8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.613+0000 7f0106414e00 1 --2- 10.20.193.4:0/1335912946 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d9860 0x55eaaaa1dfc0 unknown :-1 s=CLOSED pgs=702 gs=2 cs=0 l=1 c_cookie=17916517776449855130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.613+0000 7f0106414e00 1 --2- 10.20.193.4:0/1335912946 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9d9320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.613+0000 7f0106414e00 1 -- 10.20.193.4:0/1335912946 >> 10.20.193.4:0/1335912946 conn(0x55eaaa8f7db0 msgr2=0x55eaaa9d7830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:44.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.613+0000 7f0106414e00 1 -- 10.20.193.4:0/1335912946 shutdown_connections 2026-02-24T09:12:44.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.613+0000 7f0106414e00 1 -- 10.20.193.4:0/1335912946 wait complete. 2026-02-24T09:12:44.626 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f0106414e00 1 -- start start 2026-02-24T09:12:44.626 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f0106414e00 1 Processor -- start 2026-02-24T09:12:44.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f0106414e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa35e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f0106414e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaa9d9860 0x55eaaaa36350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f0106414e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaaa1e500 0x55eaaaa3b340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f0106414e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55eaaaa3b880 con 0x55eaaa9d8f50 2026-02-24T09:12:44.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f0106414e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55eaaaa3b9f0 con 0x55eaaaa1e500 2026-02-24T09:12:44.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f0106414e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55eaaaa3bbb0 con 0x55eaaa9d9860 2026-02-24T09:12:44.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f010218f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa35e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f010218f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa35e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56480/0 (socket says 10.20.193.4:56480) 2026-02-24T09:12:44.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f010218f640 1 -- 10.20.193.4:0/876971151 learned_addr learned my addr 10.20.193.4:0/876971151 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:44.627 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f010198e640 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaa9d9860 0x55eaaaa36350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.616+0000 7f0102990640 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaaa1e500 0x55eaaaa3b340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f010218f640 1 -- 10.20.193.4:0/876971151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaa9d9860 msgr2=0x55eaaaa36350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f010218f640 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaa9d9860 0x55eaaaa36350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f010218f640 1 -- 10.20.193.4:0/876971151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaaa1e500 msgr2=0x55eaaaa3b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f010218f640 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaaa1e500 0x55eaaaa3b340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f010218f640 1 -- 10.20.193.4:0/876971151 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaaa8639d0 con 0x55eaaa9d8f50 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f010218f640 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa35e10 secure :-1 s=READY pgs=703 gs=1 cs=0 l=1 c_cookie=16090191587609929097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00ec0116c0 tx=0x7f00ec0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4bd7ffdb77e589 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f00affff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f00affff640 1 -- 10.20.193.4:0/876971151 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00ec01e940 con 0x55eaaa9d8f50 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f00affff640 1 -- 10.20.193.4:0/876971151 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00ec023070 con 0x55eaaa9d8f50 2026-02-24T09:12:44.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f00affff640 1 -- 10.20.193.4:0/876971151 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00ec0273d0 con 0x55eaaa9d8f50 2026-02-24T09:12:44.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f0106414e00 1 -- 10.20.193.4:0/876971151 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc164b00 con 0x55eaaa9d8f50 2026-02-24T09:12:44.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f00affff640 1 -- 10.20.193.4:0/876971151 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f00ec017070 con 0x55eaaa9d8f50 2026-02-24T09:12:44.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f00affff640 10 client.16365 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:44.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f0106414e00 10 client.16365 _ll_register_callbacks cb 0x55eaaa88a080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:44.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f0106414e00 1 -- 10.20.193.4:0/876971151 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eaaa62f4a0 con 0x55eaaa9d8f50 2026-02-24T09:12:44.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f00affff640 1 -- 10.20.193.4:0/876971151 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f00ec01eaa0 con 0x55eaaa9d8f50 2026-02-24T09:12:44.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f0106414e00 10 client.16365 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:44.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.617+0000 7f0106414e00 1 -- 10.20.193.4:0/876971151 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55eaaa875710 con 0x55eaaa9d8f50 2026-02-24T09:12:44.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.618+0000 7f00affff640 1 -- 10.20.193.4:0/876971151 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f00ec02f060 con 0x55eaaa9d8f50 2026-02-24T09:12:44.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.618+0000 7f0106414e00 10 client.16365 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:44.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.618+0000 7f0106414e00 10 client.16365 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:12:44.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.618+0000 7f0106414e00 20 client.16365 populate_metadata read hostname 'trial004' 2026-02-24T09:12:44.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.618+0000 7f0106414e00 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55eaaaa1b870 0x55eaaaa1bd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.618+0000 7f0106414e00 4 client.16365 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:44.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.618+0000 7f0106414e00 1 -- 10.20.193.4:0/876971151 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eaaa8d57b0 con 0x55eaaaa1b870 2026-02-24T09:12:44.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.618+0000 7f010198e640 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55eaaaa1b870 0x55eaaaa1bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.618+0000 7f00affff640 10 client.16365 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:44.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.618+0000 7f010198e640 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55eaaaa1b870 0x55eaaaa1bd10 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=6626707177195310205 s_cookie=1512731542430165550 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bf6cb115f420c7d server_cookie=14fe4d52b3142a2e in_seq=0 out_seq=0 2026-02-24T09:12:44.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f00affff640 1 -- 10.20.193.4:0/876971151 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55eaaa8d57b0 con 0x55eaaaa1b870 2026-02-24T09:12:44.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f00affff640 10 client.16365 handle_command_reply: tid=0 2026-02-24T09:12:44.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 client.16365 shutdown 2026-02-24T09:12:44.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 -- 10.20.193.4:0/876971151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 msgr2=0x55eaaaa35e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa35e10 secure :-1 s=READY pgs=703 gs=1 cs=0 l=1 c_cookie=16090191587609929097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00ec0116c0 tx=0x7f00ec0047e0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 -- 10.20.193.4:0/876971151 shutdown_connections 2026-02-24T09:12:44.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55eaaaa1b870 0x55eaaaa1bd10 crc :-1 s=READY pgs=32 gs=4 cs=0 l=0 c_cookie=6626707177195310205 s_cookie=1512731542430165550 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaaa1e500 0x55eaaaa3b340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f00affff640 0 client.16365 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:44.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaa9d9860 0x55eaaaa36350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 --2- 10.20.193.4:0/876971151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa35e10 unknown :-1 s=CLOSED pgs=703 gs=1 cs=0 l=1 c_cookie=16090191587609929097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 -- 10.20.193.4:0/876971151 >> 10.20.193.4:0/876971151 conn(0x55eaaa8f7db0 msgr2=0x55eaaa9d7040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:44.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 -- 10.20.193.4:0/876971151 shutdown_connections 2026-02-24T09:12:44.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 1 -- 10.20.193.4:0/876971151 wait complete. 2026-02-24T09:12:44.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.619+0000 7f0106414e00 20 client.16365 trim_cache size 0 max 16384 2026-02-24T09:12:44.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f0106414e00 1 Processor -- start 2026-02-24T09:12:44.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f0106414e00 1 -- start start 2026-02-24T09:12:44.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f0106414e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa3a8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f0106414e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d9860 0x55eaaaa321f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f0106414e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaaa32730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f0106414e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55eaaa8dd9a0 con 0x55eaaa9d8f50 2026-02-24T09:12:44.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f0106414e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55eaaa6b9df0 con 0x55eaaa9d9860 2026-02-24T09:12:44.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f0106414e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55eaaa94a2f0 con 0x55eaaaa1e500 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f010218f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa3a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f010218f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa3a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56492/0 (socket says 10.20.193.4:56492) 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.627+0000 7f010218f640 1 -- 10.20.193.4:0/3427155190 learned_addr learned my addr 10.20.193.4:0/3427155190 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f0102990640 1 --2- 10.20.193.4:0/3427155190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaaa32730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f010198e640 1 --2- 10.20.193.4:0/3427155190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d9860 0x55eaaaa321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f010218f640 1 -- 10.20.193.4:0/3427155190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 msgr2=0x55eaaaa32730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f010218f640 1 --2- 10.20.193.4:0/3427155190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaaa32730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f010218f640 1 -- 10.20.193.4:0/3427155190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d9860 msgr2=0x55eaaaa321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f010218f640 1 --2- 10.20.193.4:0/3427155190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d9860 0x55eaaaa321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f010218f640 1 -- 10.20.193.4:0/3427155190 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaaaa28470 con 0x55eaaa9d8f50 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f010218f640 1 --2- 10.20.193.4:0/3427155190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa3a8b0 secure :-1 s=READY pgs=704 gs=1 cs=0 l=1 c_cookie=13395963911891661546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00ec010c40 tx=0x7f00ec021030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e80633f84132ea server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f00ca4e6640 1 -- 10.20.193.4:0/3427155190 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00ec011d20 con 0x55eaaa9d8f50 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f00ca4e6640 1 -- 10.20.193.4:0/3427155190 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00ec023040 con 0x55eaaa9d8f50 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f00ca4e6640 1 -- 10.20.193.4:0/3427155190 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00ec0306f0 con 0x55eaaa9d8f50 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f0106414e00 1 -- 10.20.193.4:0/3427155190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 msgr2=0x55eaaaa3a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f0106414e00 1 --2- 10.20.193.4:0/3427155190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa3a8b0 secure :-1 s=READY pgs=704 gs=1 cs=0 l=1 c_cookie=13395963911891661546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00ec010c40 tx=0x7f00ec021030 comp rx=0 tx=0).stop 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f0106414e00 1 -- 10.20.193.4:0/3427155190 shutdown_connections 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f0106414e00 1 --2- 10.20.193.4:0/3427155190 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaaa32730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.639 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f0106414e00 1 --2- 10.20.193.4:0/3427155190 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d9860 0x55eaaaa321f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f0106414e00 1 --2- 10.20.193.4:0/3427155190 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaaa3a8b0 unknown :-1 s=CLOSED pgs=704 gs=1 cs=0 l=1 c_cookie=13395963911891661546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f0106414e00 1 -- 10.20.193.4:0/3427155190 >> 10.20.193.4:0/3427155190 conn(0x55eaaa8f7db0 msgr2=0x55eaaaa3a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f0106414e00 1 -- 10.20.193.4:0/3427155190 shutdown_connections 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.628+0000 7f0106414e00 1 -- 10.20.193.4:0/3427155190 wait complete. 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f0106414e00 1 -- start start 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f0106414e00 1 Processor -- start 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f0106414e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9b99d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f0106414e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d9860 0x55eaaa9b9f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f0106414e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaa9ba450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f0106414e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55eaaaa84100 con 0x55eaaa9d8f50 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f0106414e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55eaaaa84270 con 0x55eaaa9d9860 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f0106414e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55eaaaa84430 con 0x55eaaaa1e500 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f010218f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f010218f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9b99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56508/0 (socket says 10.20.193.4:56508) 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f010218f640 1 -- 10.20.193.4:0/468689354 learned_addr learned my addr 10.20.193.4:0/468689354 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f0102990640 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaa9ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f010198e640 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d9860 0x55eaaa9b9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f010218f640 1 -- 10.20.193.4:0/468689354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 msgr2=0x55eaaa9ba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f010218f640 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaa9ba450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f010218f640 1 -- 10.20.193.4:0/468689354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d9860 msgr2=0x55eaaa9b9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f010218f640 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d9860 0x55eaaa9b9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f010218f640 1 -- 10.20.193.4:0/468689354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaaa870190 con 0x55eaaa9d8f50 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f010218f640 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9b99d0 secure :-1 s=READY pgs=705 gs=1 cs=0 l=1 c_cookie=4231887607420895869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00ec00b750 tx=0x7f00ec030f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abaaf5b81b3427d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f00affff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f00affff640 1 -- 10.20.193.4:0/468689354 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00ec030660 con 0x55eaaa9d8f50 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f00affff640 1 -- 10.20.193.4:0/468689354 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55eaaa62f4a0 con 0x55eaaa9d8f50 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f00affff640 1 -- 10.20.193.4:0/468689354 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00ec01e790 con 0x55eaaa9d8f50 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.629+0000 7f0106414e00 1 -- 10.20.193.4:0/468689354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaaa875710 con 0x55eaaa9d8f50 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f00affff640 1 -- 10.20.193.4:0/468689354 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f00ec017070 con 0x55eaaa9d8f50 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f00affff640 10 client.16371 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f0106414e00 10 client.16371 _ll_register_callbacks cb 0x55eaaa88a080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f0106414e00 1 -- 10.20.193.4:0/468689354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00f00ac5f0 con 0x55eaaa9d8f50 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f00affff640 1 -- 10.20.193.4:0/468689354 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f00ec0047c0 con 0x55eaaa9d8f50 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f0106414e00 10 client.16371 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f0106414e00 1 -- 10.20.193.4:0/468689354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55eaaa863d00 con 0x55eaaa9d8f50 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f00affff640 1 -- 10.20.193.4:0/468689354 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f00ec02f040 con 0x55eaaa9d8f50 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f0106414e00 10 client.16371 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f0106414e00 10 client.16371 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f0106414e00 20 client.16371 populate_metadata read hostname 'trial004' 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f0106414e00 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55eaaaacbeb0 0x55eaaaaec360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f0106414e00 4 client.16371 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:12:44.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f0106414e00 1 -- 10.20.193.4:0/468689354 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eaaa614160 con 0x55eaaaacbeb0 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.630+0000 7f010198e640 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55eaaaacbeb0 0x55eaaaaec360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.631+0000 7f00affff640 10 client.16371 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.631+0000 7f010198e640 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55eaaaacbeb0 0x55eaaaaec360 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=365016815345078897 s_cookie=18308228048197359644 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=510ccdc0fb01271 server_cookie=fe13e4689fa5981c in_seq=0 out_seq=0 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.631+0000 7f00affff640 1 -- 10.20.193.4:0/468689354 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eaaa614160 con 0x55eaaaacbeb0 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.631+0000 7f00affff640 10 client.16371 handle_command_reply: tid=0 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.631+0000 7f0106414e00 1 client.16371 shutdown 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.631+0000 7f0106414e00 1 -- 10.20.193.4:0/468689354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 msgr2=0x55eaaa9b99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.631+0000 7f0106414e00 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9b99d0 secure :-1 s=READY pgs=705 gs=1 cs=0 l=1 c_cookie=4231887607420895869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00ec00b750 tx=0x7f00ec030f40 comp rx=0 tx=0).stop 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.631+0000 7f0106414e00 1 -- 10.20.193.4:0/468689354 shutdown_connections 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.631+0000 7f0106414e00 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55eaaaacbeb0 0x55eaaaaec360 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=365016815345078897 s_cookie=18308228048197359644 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.631+0000 7f0106414e00 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eaaaa1e500 0x55eaaa9ba450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f0106414e00 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eaaa9d9860 0x55eaaa9b9f10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f00affff640 0 client.16371 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f0106414e00 1 --2- 10.20.193.4:0/468689354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eaaa9d8f50 0x55eaaa9b99d0 unknown :-1 s=CLOSED pgs=705 gs=1 cs=0 l=1 c_cookie=4231887607420895869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f0106414e00 1 -- 10.20.193.4:0/468689354 >> 10.20.193.4:0/468689354 conn(0x55eaaa8f7db0 msgr2=0x55eaaaa329e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f0106414e00 1 -- 10.20.193.4:0/468689354 shutdown_connections 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f0106414e00 1 -- 10.20.193.4:0/468689354 wait complete. 2026-02-24T09:12:44.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f0106414e00 20 client.16371 trim_cache size 0 max 16384 2026-02-24T09:12:44.643 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:12:44.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 -- 10.20.193.4:0/1857578707 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00d80b56e0 msgr2=0x7f00d80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00d80b56e0 0x7f00d80d5b90 secure :-1 s=READY pgs=330 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00ec004740 tx=0x7f00ec00b410 comp rx=0 tx=0).stop 2026-02-24T09:12:44.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 -- 10.20.193.4:0/1857578707 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f00fc110040 msgr2=0x7f00fc11e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:44.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f00fc110040 0x7f00fc11e400 secure :-1 s=READY pgs=701 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00f000c8f0 tx=0x7f00f000cdc0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 -- 10.20.193.4:0/1857578707 shutdown_connections 2026-02-24T09:12:44.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00d80b56e0 0x7f00d80d5b90 unknown :-1 s=CLOSED pgs=330 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f00fc115840 0x7f00fc1237d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f00fc110040 0x7f00fc11e400 unknown :-1 s=CLOSED pgs=701 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 --2- 10.20.193.4:0/1857578707 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00fc10f650 0x7f00fc11dec0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:44.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 -- 10.20.193.4:0/1857578707 >> 10.20.193.4:0/1857578707 conn(0x7f00fc0ecf20 msgr2=0x7f00fc10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:44.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 -- 10.20.193.4:0/1857578707 shutdown_connections 2026-02-24T09:12:44.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:44.632+0000 7f010441a640 1 -- 10.20.193.4:0/1857578707 wait complete. 2026-02-24T09:12:44.707 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:12:44.856 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:44.985 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:44 trial004 ceph-mon[41596]: pgmap v240: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 784 MiB/s wr, 233 op/s 2026-02-24T09:12:44.985 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:44 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2406421749' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:12:45.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 -- 10.20.193.4:0/3469912939 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc3c115840 msgr2=0x7fcc3c176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 --2- 10.20.193.4:0/3469912939 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc3c115840 0x7fcc3c176210 secure :-1 s=READY pgs=706 gs=1 cs=0 l=1 c_cookie=10910769356105272084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc3000aa30 tx=0x7fcc30030280 comp rx=0 tx=0).stop 2026-02-24T09:12:45.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 -- 10.20.193.4:0/3469912939 shutdown_connections 2026-02-24T09:12:45.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 --2- 10.20.193.4:0/3469912939 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc3c115840 0x7fcc3c176210 unknown :-1 s=CLOSED pgs=706 gs=1 cs=0 l=1 c_cookie=10910769356105272084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 --2- 10.20.193.4:0/3469912939 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc3c110040 0x7fcc3c115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 --2- 10.20.193.4:0/3469912939 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3c10f650 0x7fcc3c10fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 -- 10.20.193.4:0/3469912939 >> 10.20.193.4:0/3469912939 conn(0x7fcc3c0ecf20 msgr2=0x7fcc3c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 -- 10.20.193.4:0/3469912939 shutdown_connections 2026-02-24T09:12:45.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 -- 10.20.193.4:0/3469912939 wait complete. 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 Processor -- start 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.010+0000 7fcc41c7f640 1 -- start start 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc41c7f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc3c10f650 0x7fcc3c0f57f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc41c7f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3c110040 0x7fcc3c176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc41c7f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc3c115840 0x7fcc3c0f5ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc41c7f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c0fb100 con 0x7fcc3c10f650 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc41c7f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c0fb270 con 0x7fcc3c110040 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc41c7f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c0fb430 con 0x7fcc3c115840 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc3c10f650 0x7fcc3c0f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc3c10f650 0x7fcc3c0f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56518/0 (socket says 10.20.193.4:56518) 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3b7fe640 1 -- 10.20.193.4:0/1992284678 learned_addr learned my addr 10.20.193.4:0/1992284678 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3affd640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3c110040 0x7fcc3c176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3bfff640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc3c115840 0x7fcc3c0f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3b7fe640 1 -- 10.20.193.4:0/1992284678 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc3c115840 msgr2=0x7fcc3c0f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc3c115840 0x7fcc3c0f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3b7fe640 1 -- 10.20.193.4:0/1992284678 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3c110040 msgr2=0x7fcc3c176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3c110040 0x7fcc3c176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3b7fe640 1 -- 10.20.193.4:0/1992284678 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3000a650 con 0x7fcc3c10f650 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc3c10f650 0x7fcc3c0f57f0 secure :-1 s=READY pgs=707 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc2800d950 tx=0x7fcc2800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc38ff9640 1 -- 10.20.193.4:0/1992284678 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc28004540 con 0x7fcc3c10f650 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc41c7f640 1 -- 10.20.193.4:0/1992284678 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3c0fb710 con 0x7fcc3c10f650 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc38ff9640 1 -- 10.20.193.4:0/1992284678 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc28009d00 con 0x7fcc3c10f650 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc38ff9640 1 -- 10.20.193.4:0/1992284678 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc280106e0 con 0x7fcc3c10f650 2026-02-24T09:12:45.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.011+0000 7fcc41c7f640 1 -- 10.20.193.4:0/1992284678 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3c0fbc30 con 0x7fcc3c10f650 2026-02-24T09:12:45.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.014+0000 7fcc38ff9640 1 -- 10.20.193.4:0/1992284678 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fcc280027c0 con 0x7fcc3c10f650 2026-02-24T09:12:45.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.014+0000 7fcc38ff9640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc100b56d0 0x7fcc100d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.015+0000 7fcc38ff9640 1 -- 10.20.193.4:0/1992284678 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fcc280e6ef0 con 0x7fcc3c10f650 2026-02-24T09:12:45.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.015+0000 7fcc3affd640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc100b56d0 0x7fcc100d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.015+0000 7fcc3affd640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc100b56d0 0x7fcc100d5b80 secure :-1 s=READY pgs=331 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc3c0fc190 tx=0x7fcc2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.017+0000 7fcc43c79e00 1 Processor -- start 2026-02-24T09:12:45.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc43c79e00 1 -- start start 2026-02-24T09:12:45.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cef50 0x562d987cf320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cf860 0x562d98813fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d98814500 0x562d988348e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562d986dfee0 con 0x562d987cf860 2026-02-24T09:12:45.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562d986dbc10 con 0x562d98814500 2026-02-24T09:12:45.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562d986d5d70 con 0x562d987cef50 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cf860 0x562d98813fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cf860 0x562d98813fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56528/0 (socket says 10.20.193.4:56528) 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3affd640 1 -- 10.20.193.4:0/1353664720 learned_addr learned my addr 10.20.193.4:0/1353664720 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3bfff640 1 --2- 10.20.193.4:0/1353664720 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d98814500 0x562d988348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/1353664720 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cef50 0x562d987cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3affd640 1 -- 10.20.193.4:0/1353664720 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cef50 msgr2=0x562d987cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3affd640 1 --2- 10.20.193.4:0/1353664720 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cef50 0x562d987cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3affd640 1 -- 10.20.193.4:0/1353664720 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d98814500 msgr2=0x562d988348e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3affd640 1 --2- 10.20.193.4:0/1353664720 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d98814500 0x562d988348e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3affd640 1 -- 10.20.193.4:0/1353664720 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d98681340 con 0x562d987cf860 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcc3affd640 1 --2- 10.20.193.4:0/1353664720 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cf860 0x562d98813fc0 secure :-1 s=READY pgs=708 gs=1 cs=0 l=1 c_cookie=780024035303321221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc2c009bf0 tx=0x7fcc2c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad333ba34856e85 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcbfffff640 1 -- 10.20.193.4:0/1353664720 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc2c01d460 con 0x562d987cf860 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcbfffff640 1 -- 10.20.193.4:0/1353664720 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc2c01daa0 con 0x562d987cf860 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.018+0000 7fcbfffff640 1 -- 10.20.193.4:0/1353664720 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc2c01aae0 con 0x562d987cf860 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.019+0000 7fcc43c79e00 1 -- 10.20.193.4:0/1353664720 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cf860 msgr2=0x562d98813fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.019+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/1353664720 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cf860 0x562d98813fc0 secure :-1 s=READY pgs=708 gs=1 cs=0 l=1 c_cookie=780024035303321221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc2c009bf0 tx=0x7fcc2c013000 comp rx=0 tx=0).stop 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.019+0000 7fcc43c79e00 1 -- 10.20.193.4:0/1353664720 shutdown_connections 2026-02-24T09:12:45.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.019+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/1353664720 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d98814500 0x562d988348e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.019+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/1353664720 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cf860 0x562d98813fc0 unknown :-1 s=CLOSED pgs=708 gs=1 cs=0 l=1 c_cookie=780024035303321221 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.019+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/1353664720 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cef50 0x562d987cf320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.019+0000 7fcc43c79e00 1 -- 10.20.193.4:0/1353664720 >> 10.20.193.4:0/1353664720 conn(0x562d986eddb0 msgr2=0x562d987cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.019+0000 7fcc43c79e00 1 -- 10.20.193.4:0/1353664720 shutdown_connections 2026-02-24T09:12:45.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.019+0000 7fcc43c79e00 1 -- 10.20.193.4:0/1353664720 wait complete. 2026-02-24T09:12:45.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.020+0000 7fcc43c79e00 1 -- start start 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.020+0000 7fcc43c79e00 1 Processor -- start 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.020+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cef50 0x562d9882bdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.020+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cf860 0x562d9882c2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.020+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d98814500 0x562d988312e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.020+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562d98831820 con 0x562d987cef50 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.020+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562d98831990 con 0x562d987cf860 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.020+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562d98831b50 con 0x562d98814500 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3bfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d98814500 0x562d988312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cef50 0x562d9882bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3bfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d98814500 0x562d988312e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:35376/0 (socket says 10.20.193.4:35376) 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3bfff640 1 -- 10.20.193.4:0/2857749886 learned_addr learned my addr 10.20.193.4:0/2857749886 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3affd640 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cf860 0x562d9882c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3b7fe640 1 -- 10.20.193.4:0/2857749886 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d98814500 msgr2=0x562d988312e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.023 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d98814500 0x562d988312e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3b7fe640 1 -- 10.20.193.4:0/2857749886 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cf860 msgr2=0x562d9882c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cf860 0x562d9882c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3b7fe640 1 -- 10.20.193.4:0/2857749886 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d986599d0 con 0x562d987cef50 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3bfff640 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d98814500 0x562d988312e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cef50 0x562d9882bdb0 secure :-1 s=READY pgs=709 gs=3 cs=0 l=1 c_cookie=6640309133677886820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc280e4a80 tx=0x7fcc28009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c271df9a7a6fd64 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcbfd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/2857749886 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc280ad020 con 0x562d987cef50 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/2857749886 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc280aca60 con 0x562d987cef50 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/2857749886 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc280ae170 con 0x562d987cef50 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcc43c79e00 1 -- 10.20.193.4:0/2857749886 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2c009890 con 0x562d987cef50 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/2857749886 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fcc280b7f10 con 0x562d987cef50 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.021+0000 7fcbfd7fa640 10 client.16383 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc43c79e00 10 client.16383 _ll_register_callbacks cb 0x562d98680080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc43c79e00 1 -- 10.20.193.4:0/2857749886 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d984254a0 con 0x562d987cef50 2026-02-24T09:12:45.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/2857749886 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcc280b5560 con 0x562d987cef50 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc43c79e00 10 client.16383 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc43c79e00 1 -- 10.20.193.4:0/2857749886 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562d9866b710 con 0x562d987cef50 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/2857749886 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fcc28072360 con 0x562d987cef50 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc43c79e00 10 client.16383 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc43c79e00 10 client.16383 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc43c79e00 20 client.16383 populate_metadata read hostname 'trial004' 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x562d988115c0 0x562d98811a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc43c79e00 4 client.16383 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc43c79e00 1 -- 10.20.193.4:0/2857749886 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d986cb7b0 con 0x562d988115c0 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.022+0000 7fcc3affd640 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x562d988115c0 0x562d98811a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.023+0000 7fcc3affd640 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x562d988115c0 0x562d98811a30 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=14287553741823353260 s_cookie=12819163406494356842 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c647966df2af21ac server_cookie=b1e6d13309c8556a in_seq=0 out_seq=0 2026-02-24T09:12:45.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.023+0000 7fcbfd7fa640 10 client.16383 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:45.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/2857749886 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562d986cb7b0 con 0x562d988115c0 2026-02-24T09:12:45.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcbfd7fa640 10 client.16383 handle_command_reply: tid=0 2026-02-24T09:12:45.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 client.16383 shutdown 2026-02-24T09:12:45.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 -- 10.20.193.4:0/2857749886 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cef50 msgr2=0x562d9882bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cef50 0x562d9882bdb0 secure :-1 s=READY pgs=709 gs=3 cs=0 l=1 c_cookie=6640309133677886820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc280e4a80 tx=0x7fcc28009f90 comp rx=0 tx=0).stop 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 -- 10.20.193.4:0/2857749886 shutdown_connections 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x562d988115c0 0x562d98811a30 crc :-1 s=READY pgs=33 gs=4 cs=0 l=0 c_cookie=14287553741823353260 s_cookie=12819163406494356842 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d98814500 0x562d988312e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cf860 0x562d9882c2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/2857749886 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d987cef50 0x562d9882bdb0 unknown :-1 s=CLOSED pgs=709 gs=3 cs=0 l=1 c_cookie=6640309133677886820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcbfd7fa640 0 client.16383 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 -- 10.20.193.4:0/2857749886 >> 10.20.193.4:0/2857749886 conn(0x562d986eddb0 msgr2=0x562d987cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 -- 10.20.193.4:0/2857749886 shutdown_connections 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 1 -- 10.20.193.4:0/2857749886 wait complete. 2026-02-24T09:12:45.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.024+0000 7fcc43c79e00 20 client.16383 trim_cache size 0 max 16384 2026-02-24T09:12:45.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.034+0000 7fcc43c79e00 1 Processor -- start 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.034+0000 7fcc43c79e00 1 -- start start 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.034+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 0x562d98830850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.034+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cf860 0x562d9880efb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.034+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d9880f4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.034+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562d986d39a0 con 0x562d98814500 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.034+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562d984afdf0 con 0x562d987cef50 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.034+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562d987402f0 con 0x562d987cf860 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d9880f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3b7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 0x562d98830850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d9880f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56560/0 (socket says 10.20.193.4:56560) 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3bfff640 1 -- 10.20.193.4:0/112079175 learned_addr learned my addr 10.20.193.4:0/112079175 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:45.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3affd640 1 --2- 10.20.193.4:0/112079175 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cf860 0x562d9880efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3bfff640 1 -- 10.20.193.4:0/112079175 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cf860 msgr2=0x562d9880efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3bfff640 1 --2- 10.20.193.4:0/112079175 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cf860 0x562d9880efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3bfff640 1 -- 10.20.193.4:0/112079175 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 msgr2=0x562d98830850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3bfff640 1 --2- 10.20.193.4:0/112079175 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 0x562d98830850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3bfff640 1 -- 10.20.193.4:0/112079175 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d98666190 con 0x562d98814500 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/112079175 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 0x562d98830850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcc3bfff640 1 --2- 10.20.193.4:0/112079175 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d9880f4f0 secure :-1 s=READY pgs=710 gs=2 cs=0 l=1 c_cookie=2392664136454589700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc3000aa30 tx=0x7fcc3003b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2134735af0314d04 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcbff7fe640 1 -- 10.20.193.4:0/112079175 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc30039690 con 0x562d98814500 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcbff7fe640 1 -- 10.20.193.4:0/112079175 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc3003f040 con 0x562d98814500 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.035+0000 7fcbff7fe640 1 -- 10.20.193.4:0/112079175 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc300054f0 con 0x562d98814500 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.036+0000 7fcc43c79e00 1 -- 10.20.193.4:0/112079175 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 msgr2=0x562d9880f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.036+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/112079175 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d9880f4f0 secure :-1 s=READY pgs=710 gs=2 cs=0 l=1 c_cookie=2392664136454589700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc3000aa30 tx=0x7fcc3003b040 comp rx=0 tx=0).stop 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.036+0000 7fcc43c79e00 1 -- 10.20.193.4:0/112079175 shutdown_connections 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.036+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/112079175 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d9880f4f0 unknown :-1 s=CLOSED pgs=710 gs=2 cs=0 l=1 c_cookie=2392664136454589700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.036+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/112079175 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cf860 0x562d9880efb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.036+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/112079175 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 0x562d98830850 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.036+0000 7fcc43c79e00 1 -- 10.20.193.4:0/112079175 >> 10.20.193.4:0/112079175 conn(0x562d986eddb0 msgr2=0x562d98830140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.036+0000 7fcc43c79e00 1 -- 10.20.193.4:0/112079175 shutdown_connections 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.036+0000 7fcc43c79e00 1 -- 10.20.193.4:0/112079175 wait complete. 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc43c79e00 1 -- start start 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc43c79e00 1 Processor -- start 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 0x562d987ad1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cf860 0x562d987ad720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc43c79e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d987b2080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562d9882c1d0 con 0x562d98814500 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562d987adce0 con 0x562d987cef50 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc43c79e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562d987adea0 con 0x562d987cf860 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d987b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d987b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56576/0 (socket says 10.20.193.4:56576) 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3bfff640 1 -- 10.20.193.4:0/3303448652 learned_addr learned my addr 10.20.193.4:0/3303448652 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3affd640 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cf860 0x562d987ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3bfff640 1 -- 10.20.193.4:0/3303448652 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cf860 msgr2=0x562d987ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3bfff640 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cf860 0x562d987ad720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3bfff640 1 -- 10.20.193.4:0/3303448652 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 msgr2=0x562d987ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 0x562d987ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3bfff640 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 0x562d987ad1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3bfff640 1 -- 10.20.193.4:0/3303448652 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d98659d00 con 0x562d98814500 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 0x562d987ad1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcc3bfff640 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d987b2080 secure :-1 s=READY pgs=711 gs=1 cs=0 l=1 c_cookie=6386186647551987130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc3000a230 tx=0x7fcc30039b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a04aeba4adcdba server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.037+0000 7fcbfd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/3303448652 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc300039a0 con 0x562d98814500 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/3303448652 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc30039d80 con 0x562d98814500 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 1 -- 10.20.193.4:0/3303448652 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3c176a80 con 0x562d98814500 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/3303448652 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc30046ce0 con 0x562d98814500 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 10 client.16389 _ll_register_callbacks cb 0x562d98680080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:45.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 1 -- 10.20.193.4:0/3303448652 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc2c01daa0 con 0x562d98814500 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/3303448652 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fcc30062440 con 0x562d98814500 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/3303448652 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcc30062620 con 0x562d98814500 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 10 client.16389 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 1 -- 10.20.193.4:0/3303448652 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562d9866b970 con 0x562d98814500 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/3303448652 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fcc30044040 con 0x562d98814500 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 10 client.16389 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 10 client.16389 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 20 client.16389 populate_metadata read hostname 'trial004' 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x562d988c21c0 0x562d988e2670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 4 client.16389 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc43c79e00 1 -- 10.20.193.4:0/3303448652 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562d9840a160 con 0x562d988c21c0 2026-02-24T09:12:45.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.038+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x562d988c21c0 0x562d988e2670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcbfd7fa640 10 client.16389 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc3b7fe640 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x562d988c21c0 0x562d988e2670 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=16186202001361027496 s_cookie=15417423227625503548 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0a0f0f649d741a8 server_cookie=d5f5b0bd92797b3c in_seq=0 out_seq=0 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcbfd7fa640 1 -- 10.20.193.4:0/3303448652 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562d9840a160 con 0x562d988c21c0 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcbfd7fa640 10 client.16389 handle_command_reply: tid=0 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 client.16389 shutdown 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 -- 10.20.193.4:0/3303448652 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 msgr2=0x562d987b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d987b2080 secure :-1 s=READY pgs=711 gs=1 cs=0 l=1 c_cookie=6386186647551987130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc3000a230 tx=0x7fcc30039b90 comp rx=0 tx=0).stop 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 -- 10.20.193.4:0/3303448652 shutdown_connections 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x562d988c21c0 0x562d988e2670 crc :-1 s=READY pgs=34 gs=4 cs=0 l=0 c_cookie=16186202001361027496 s_cookie=15417423227625503548 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562d98814500 0x562d987b2080 unknown :-1 s=CLOSED pgs=711 gs=1 cs=0 l=1 c_cookie=6386186647551987130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562d987cf860 0x562d987ad720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcbfd7fa640 0 client.16389 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 --2- 10.20.193.4:0/3303448652 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562d987cef50 0x562d987ad1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 -- 10.20.193.4:0/3303448652 >> 10.20.193.4:0/3303448652 conn(0x562d986eddb0 msgr2=0x562d98830930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 -- 10.20.193.4:0/3303448652 shutdown_connections 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 1 -- 10.20.193.4:0/3303448652 wait complete. 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.039+0000 7fcc43c79e00 20 client.16389 trim_cache size 0 max 16384 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 -- 10.20.193.4:0/1992284678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc100b56d0 msgr2=0x7fcc100d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc100b56d0 0x7fcc100d5b80 secure :-1 s=READY pgs=331 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc3c0fc190 tx=0x7fcc2c005f90 comp rx=0 tx=0).stop 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 -- 10.20.193.4:0/1992284678 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc3c10f650 msgr2=0x7fcc3c0f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc3c10f650 0x7fcc3c0f57f0 secure :-1 s=READY pgs=707 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc2800d950 tx=0x7fcc2800de20 comp rx=0 tx=0).stop 2026-02-24T09:12:45.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 -- 10.20.193.4:0/1992284678 shutdown_connections 2026-02-24T09:12:45.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcc100b56d0 0x7fcc100d5b80 unknown :-1 s=CLOSED pgs=331 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc3c115840 0x7fcc3c0f5ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcc3c110040 0x7fcc3c176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 --2- 10.20.193.4:0/1992284678 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcc3c10f650 0x7fcc3c0f57f0 unknown :-1 s=CLOSED pgs=707 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 -- 10.20.193.4:0/1992284678 >> 10.20.193.4:0/1992284678 conn(0x7fcc3c0ecf20 msgr2=0x7fcc3c111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 -- 10.20.193.4:0/1992284678 shutdown_connections 2026-02-24T09:12:45.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.040+0000 7fcc41c7f640 1 -- 10.20.193.4:0/1992284678 wait complete. 2026-02-24T09:12:45.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:44 trial090 ceph-mon[47278]: pgmap v240: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 784 MiB/s wr, 233 op/s 2026-02-24T09:12:45.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:44 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2406421749' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:12:45.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:44 trial014 ceph-mon[46941]: pgmap v240: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 784 MiB/s wr, 233 op/s 2026-02-24T09:12:45.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:44 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2406421749' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:12:45.146 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:12:45.305 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:45.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.464+0000 7f274b6bb640 1 -- 10.20.193.4:0/4183230461 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2744110040 msgr2=0x7f2744115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.464+0000 7f274b6bb640 1 --2- 10.20.193.4:0/4183230461 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2744110040 0x7f2744115090 secure :-1 s=READY pgs=712 gs=1 cs=0 l=1 c_cookie=4143623135461736365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2738009950 tx=0x7f273802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.464+0000 7f274b6bb640 1 -- 10.20.193.4:0/4183230461 shutdown_connections 2026-02-24T09:12:45.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.464+0000 7f274b6bb640 1 --2- 10.20.193.4:0/4183230461 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2744115840 0x7f2744176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.464+0000 7f274b6bb640 1 --2- 10.20.193.4:0/4183230461 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2744110040 0x7f2744115090 unknown :-1 s=CLOSED pgs=712 gs=1 cs=0 l=1 c_cookie=4143623135461736365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.464+0000 7f274b6bb640 1 --2- 10.20.193.4:0/4183230461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f274410f650 0x7f274410fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.464+0000 7f274b6bb640 1 -- 10.20.193.4:0/4183230461 >> 10.20.193.4:0/4183230461 conn(0x7f27440ecf20 msgr2=0x7f274410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.464+0000 7f274b6bb640 1 -- 10.20.193.4:0/4183230461 shutdown_connections 2026-02-24T09:12:45.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.464+0000 7f274b6bb640 1 -- 10.20.193.4:0/4183230461 wait complete. 2026-02-24T09:12:45.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f274b6bb640 1 Processor -- start 2026-02-24T09:12:45.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f274b6bb640 1 -- start start 2026-02-24T09:12:45.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f274b6bb640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f274410f650 0x7f27440f5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f274b6bb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2744110040 0x7f2744176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f274b6bb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2744115840 0x7f27440f5f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f274b6bb640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f27440fb1a0 con 0x7f2744115840 2026-02-24T09:12:45.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f274b6bb640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f27440fb310 con 0x7f274410f650 2026-02-24T09:12:45.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f274b6bb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27440fb4d0 con 0x7f2744110040 2026-02-24T09:12:45.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2749c31640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2744115840 0x7f27440f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2749c31640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2744115840 0x7f27440f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56602/0 (socket says 10.20.193.4:56602) 2026-02-24T09:12:45.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2749c31640 1 -- 10.20.193.4:0/4087235196 learned_addr learned my addr 10.20.193.4:0/4087235196 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:45.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2748c2f640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2744110040 0x7f2744176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2749430640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f274410f650 0x7f27440f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2749c31640 1 -- 10.20.193.4:0/4087235196 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2744110040 msgr2=0x7f2744176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2749c31640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2744110040 0x7f2744176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2749c31640 1 -- 10.20.193.4:0/4087235196 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f274410f650 msgr2=0x7f27440f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2749c31640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f274410f650 0x7f27440f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2749c31640 1 -- 10.20.193.4:0/4087235196 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2738009570 con 0x7f2744115840 2026-02-24T09:12:45.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.465+0000 7f2749c31640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2744115840 0x7f27440f5f90 secure :-1 s=READY pgs=713 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2740006e90 tx=0x7f274000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.466+0000 7f27327fc640 1 -- 10.20.193.4:0/4087235196 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2740005500 con 0x7f2744115840 2026-02-24T09:12:45.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.466+0000 7f274b6bb640 1 -- 10.20.193.4:0/4087235196 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27440fb7b0 con 0x7f2744115840 2026-02-24T09:12:45.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.466+0000 7f27327fc640 1 -- 10.20.193.4:0/4087235196 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2740005e10 con 0x7f2744115840 2026-02-24T09:12:45.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.466+0000 7f27327fc640 1 -- 10.20.193.4:0/4087235196 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2740003a90 con 0x7f2744115840 2026-02-24T09:12:45.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.466+0000 7f274b6bb640 1 -- 10.20.193.4:0/4087235196 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27440fbcd0 con 0x7f2744115840 2026-02-24T09:12:45.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.469+0000 7f27327fc640 1 -- 10.20.193.4:0/4087235196 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f2740003c20 con 0x7f2744115840 2026-02-24T09:12:45.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.469+0000 7f27327fc640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f27200b56e0 0x7f27200d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.469+0000 7f27327fc640 1 -- 10.20.193.4:0/4087235196 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f27400e79e0 con 0x7f2744115840 2026-02-24T09:12:45.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.470+0000 7f2749430640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f27200b56e0 0x7f27200d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.470+0000 7f2749430640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f27200b56e0 0x7f27200d5b90 secure :-1 s=READY pgs=332 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2734004740 tx=0x7f2734005f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f274d6b5e00 1 Processor -- start 2026-02-24T09:12:45.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f274d6b5e00 1 -- start start 2026-02-24T09:12:45.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9deff50 0x5640d9df0320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9e34fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 0x5640d9e558e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5640d9d00ee0 con 0x5640d9df0860 2026-02-24T09:12:45.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5640d9cfcc10 con 0x5640d9e35500 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5640d9cf6d70 con 0x5640d9deff50 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f2748c2f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9e34fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f2748c2f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9e34fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56606/0 (socket says 10.20.193.4:56606) 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f2748c2f640 1 -- 10.20.193.4:0/3695798754 learned_addr learned my addr 10.20.193.4:0/3695798754 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.472+0000 7f2749c31640 1 --2- 10.20.193.4:0/3695798754 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 0x5640d9e558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.473+0000 7f2748c2f640 1 -- 10.20.193.4:0/3695798754 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9deff50 msgr2=0x5640d9df0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.473+0000 7f2748c2f640 1 --2- 10.20.193.4:0/3695798754 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9deff50 0x5640d9df0320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.473+0000 7f2748c2f640 1 -- 10.20.193.4:0/3695798754 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 msgr2=0x5640d9e558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.473+0000 7f2748c2f640 1 --2- 10.20.193.4:0/3695798754 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 0x5640d9e558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.473+0000 7f2748c2f640 1 -- 10.20.193.4:0/3695798754 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d9ca2340 con 0x5640d9df0860 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.473+0000 7f2748c2f640 1 --2- 10.20.193.4:0/3695798754 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9e34fc0 secure :-1 s=READY pgs=714 gs=1 cs=0 l=1 c_cookie=176910215443795953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2738005dd0 tx=0x7f2738005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27482e754aa4ff1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.473+0000 7f2711ce5640 1 -- 10.20.193.4:0/3695798754 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2738038690 con 0x5640d9df0860 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.473+0000 7f2711ce5640 1 -- 10.20.193.4:0/3695798754 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2738002df0 con 0x5640d9df0860 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.473+0000 7f2711ce5640 1 -- 10.20.193.4:0/3695798754 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2738038ba0 con 0x5640d9df0860 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.474+0000 7f274d6b5e00 1 -- 10.20.193.4:0/3695798754 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 msgr2=0x5640d9e34fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.474+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/3695798754 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9e34fc0 secure :-1 s=READY pgs=714 gs=1 cs=0 l=1 c_cookie=176910215443795953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2738005dd0 tx=0x7f2738005e00 comp rx=0 tx=0).stop 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.474+0000 7f274d6b5e00 1 -- 10.20.193.4:0/3695798754 shutdown_connections 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.474+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/3695798754 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 0x5640d9e558e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.474+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/3695798754 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9e34fc0 unknown :-1 s=CLOSED pgs=714 gs=1 cs=0 l=1 c_cookie=176910215443795953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.474+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/3695798754 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9deff50 0x5640d9df0320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.474+0000 7f274d6b5e00 1 -- 10.20.193.4:0/3695798754 >> 10.20.193.4:0/3695798754 conn(0x5640d9d0edb0 msgr2=0x5640d9dee830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.474+0000 7f274d6b5e00 1 -- 10.20.193.4:0/3695798754 shutdown_connections 2026-02-24T09:12:45.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.474+0000 7f274d6b5e00 1 -- 10.20.193.4:0/3695798754 wait complete. 2026-02-24T09:12:45.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f274d6b5e00 1 -- start start 2026-02-24T09:12:45.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f274d6b5e00 1 Processor -- start 2026-02-24T09:12:45.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e4cb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 0x5640d9e4d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 0x5640d9e520a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5640d9e525e0 con 0x5640d9deff50 2026-02-24T09:12:45.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5640d9e52750 con 0x5640d9e35500 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5640d9e52910 con 0x5640d9df0860 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f2749430640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e4cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f2749430640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e4cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56616/0 (socket says 10.20.193.4:56616) 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.475+0000 7f2749430640 1 -- 10.20.193.4:0/447554129 learned_addr learned my addr 10.20.193.4:0/447554129 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f2748c2f640 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 0x5640d9e4d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f2749c31640 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 0x5640d9e520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f2749430640 1 -- 10.20.193.4:0/447554129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 msgr2=0x5640d9e4d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f2749430640 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 0x5640d9e4d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f2749430640 1 -- 10.20.193.4:0/447554129 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 msgr2=0x5640d9e520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f2749430640 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 0x5640d9e520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f2749430640 1 -- 10.20.193.4:0/447554129 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d9c7a9d0 con 0x5640d9deff50 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f2748c2f640 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 0x5640d9e4d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:45.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f2749c31640 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 0x5640d9e520a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f2749430640 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e4cb70 secure :-1 s=READY pgs=715 gs=1 cs=0 l=1 c_cookie=14610019854340041240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f273400a500 tx=0x7f2734002a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac137a67b57aa18 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f26feffd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f26feffd640 1 -- 10.20.193.4:0/447554129 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2734022030 con 0x5640d9deff50 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f26feffd640 1 -- 10.20.193.4:0/447554129 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2734004570 con 0x5640d9deff50 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f26feffd640 1 -- 10.20.193.4:0/447554129 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f273401c3c0 con 0x5640d9deff50 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f274d6b5e00 1 -- 10.20.193.4:0/447554129 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2744176a80 con 0x5640d9deff50 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f26feffd640 1 -- 10.20.193.4:0/447554129 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2734023070 con 0x5640d9deff50 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f26feffd640 10 client.16401 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f274d6b5e00 10 client.16401 _ll_register_callbacks cb 0x5640d9ca1080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f274d6b5e00 1 -- 10.20.193.4:0/447554129 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5640d9a464a0 con 0x5640d9deff50 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f26feffd640 1 -- 10.20.193.4:0/447554129 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f273401d460 con 0x5640d9deff50 2026-02-24T09:12:45.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f274d6b5e00 10 client.16401 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:45.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.476+0000 7f274d6b5e00 1 -- 10.20.193.4:0/447554129 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5640d9c8c710 con 0x5640d9deff50 2026-02-24T09:12:45.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.477+0000 7f26feffd640 1 -- 10.20.193.4:0/447554129 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f273401d680 con 0x5640d9deff50 2026-02-24T09:12:45.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.477+0000 7f274d6b5e00 10 client.16401 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:45.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.477+0000 7f274d6b5e00 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:45.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.477+0000 7f274d6b5e00 20 client.16401 populate_metadata read hostname 'trial004' 2026-02-24T09:12:45.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.477+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5640d9e32540 0x5640d9e329b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.477+0000 7f274d6b5e00 4 client.16401 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:45.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.477+0000 7f274d6b5e00 1 -- 10.20.193.4:0/447554129 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640d9cec7b0 con 0x5640d9e32540 2026-02-24T09:12:45.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.477+0000 7f2748c2f640 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5640d9e32540 0x5640d9e329b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.477+0000 7f2748c2f640 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5640d9e32540 0x5640d9e329b0 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=9371401798614814567 s_cookie=16290939792528642097 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=820de848b5e48f67 server_cookie=e2150b6d9ef21031 in_seq=0 out_seq=0 2026-02-24T09:12:45.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.477+0000 7f26feffd640 10 client.16401 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:45.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f26feffd640 1 -- 10.20.193.4:0/447554129 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5640d9cec7b0 con 0x5640d9e32540 2026-02-24T09:12:45.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f26feffd640 10 client.16401 handle_command_reply: tid=0 2026-02-24T09:12:45.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 client.16401 shutdown 2026-02-24T09:12:45.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 -- 10.20.193.4:0/447554129 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 msgr2=0x5640d9e4cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e4cb70 secure :-1 s=READY pgs=715 gs=1 cs=0 l=1 c_cookie=14610019854340041240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f273400a500 tx=0x7f2734002a70 comp rx=0 tx=0).stop 2026-02-24T09:12:45.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 -- 10.20.193.4:0/447554129 shutdown_connections 2026-02-24T09:12:45.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5640d9e32540 0x5640d9e329b0 crc :-1 s=READY pgs=85 gs=4 cs=0 l=0 c_cookie=9371401798614814567 s_cookie=16290939792528642097 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e35500 0x5640d9e520a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 0x5640d9e4d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f26feffd640 0 client.16401 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:45.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/447554129 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e4cb70 unknown :-1 s=CLOSED pgs=715 gs=1 cs=0 l=1 c_cookie=14610019854340041240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 -- 10.20.193.4:0/447554129 >> 10.20.193.4:0/447554129 conn(0x5640d9d0edb0 msgr2=0x5640d9dee040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 -- 10.20.193.4:0/447554129 shutdown_connections 2026-02-24T09:12:45.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 1 -- 10.20.193.4:0/447554129 wait complete. 2026-02-24T09:12:45.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.478+0000 7f274d6b5e00 20 client.16401 trim_cache size 0 max 16384 2026-02-24T09:12:45.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f274d6b5e00 1 Processor -- start 2026-02-24T09:12:45.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f274d6b5e00 1 -- start start 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e49f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 0x5640d9e4a4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e32540 0x5640d9def460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5640d9cf49a0 con 0x5640d9deff50 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5640d9ad0df0 con 0x5640d9e32540 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5640d9e4d690 con 0x5640d9df0860 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f2749430640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e49f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f2749430640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e49f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56626/0 (socket says 10.20.193.4:56626) 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.488+0000 7f2749430640 1 -- 10.20.193.4:0/365864530 learned_addr learned my addr 10.20.193.4:0/365864530 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f2748c2f640 1 --2- 10.20.193.4:0/365864530 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 0x5640d9e4a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f2749c31640 1 --2- 10.20.193.4:0/365864530 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e32540 0x5640d9def460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f2749430640 1 -- 10.20.193.4:0/365864530 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 msgr2=0x5640d9e4a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f2749430640 1 --2- 10.20.193.4:0/365864530 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 0x5640d9e4a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f2749430640 1 -- 10.20.193.4:0/365864530 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e32540 msgr2=0x5640d9def460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f2749430640 1 --2- 10.20.193.4:0/365864530 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e32540 0x5640d9def460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f2749430640 1 -- 10.20.193.4:0/365864530 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d9c87190 con 0x5640d9deff50 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f2749430640 1 --2- 10.20.193.4:0/365864530 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e49f60 secure :-1 s=READY pgs=716 gs=1 cs=0 l=1 c_cookie=12229633147628527791 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f273400ebc0 tx=0x7f2734028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b8628d69bda0af server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f27114e4640 1 -- 10.20.193.4:0/365864530 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2734022040 con 0x5640d9deff50 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f27114e4640 1 -- 10.20.193.4:0/365864530 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5640d9a464a0 con 0x5640d9deff50 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.489+0000 7f27114e4640 1 -- 10.20.193.4:0/365864530 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2734010950 con 0x5640d9deff50 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.490+0000 7f274d6b5e00 1 -- 10.20.193.4:0/365864530 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 msgr2=0x5640d9e49f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.490+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/365864530 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e49f60 secure :-1 s=READY pgs=716 gs=1 cs=0 l=1 c_cookie=12229633147628527791 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f273400ebc0 tx=0x7f2734028000 comp rx=0 tx=0).stop 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.490+0000 7f274d6b5e00 1 -- 10.20.193.4:0/365864530 shutdown_connections 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.490+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/365864530 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9e32540 0x5640d9def460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.490+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/365864530 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9df0860 0x5640d9e4a4a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.490+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/365864530 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9deff50 0x5640d9e49f60 unknown :-1 s=CLOSED pgs=716 gs=1 cs=0 l=1 c_cookie=12229633147628527791 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.490+0000 7f274d6b5e00 1 -- 10.20.193.4:0/365864530 >> 10.20.193.4:0/365864530 conn(0x5640d9d0edb0 msgr2=0x5640d9e516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.490+0000 7f274d6b5e00 1 -- 10.20.193.4:0/365864530 shutdown_connections 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.490+0000 7f274d6b5e00 1 -- 10.20.193.4:0/365864530 wait complete. 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f274d6b5e00 1 -- start start 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f274d6b5e00 1 Processor -- start 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9deff50 0x5640d9def880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9dce030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f274d6b5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9e32540 0x5640d9dce570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5640d9e9c270 con 0x5640d9df0860 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5640d9dceab0 con 0x5640d9deff50 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f274d6b5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5640d9dcec70 con 0x5640d9e32540 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f2748c2f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9dce030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f2748c2f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9dce030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56634/0 (socket says 10.20.193.4:56634) 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f2748c2f640 1 -- 10.20.193.4:0/675982931 learned_addr learned my addr 10.20.193.4:0/675982931 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f2749c31640 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9e32540 0x5640d9dce570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f2749430640 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9deff50 0x5640d9def880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f2748c2f640 1 -- 10.20.193.4:0/675982931 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9e32540 msgr2=0x5640d9dce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f2748c2f640 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9e32540 0x5640d9dce570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f2748c2f640 1 -- 10.20.193.4:0/675982931 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9deff50 msgr2=0x5640d9def880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.491+0000 7f2748c2f640 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9deff50 0x5640d9def880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f2748c2f640 1 -- 10.20.193.4:0/675982931 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d9c7ad00 con 0x5640d9df0860 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f2748c2f640 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9dce030 secure :-1 s=READY pgs=717 gs=1 cs=0 l=1 c_cookie=15055591947880109287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f273802f6e0 tx=0x7f2738002f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f0351bd0a014e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f26feffd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f26feffd640 1 -- 10.20.193.4:0/675982931 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2738054070 con 0x5640d9df0860 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 1 -- 10.20.193.4:0/675982931 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640d9c8c710 con 0x5640d9df0860 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 10 client.16407 _ll_register_callbacks cb 0x5640d9ca1080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 1 -- 10.20.193.4:0/675982931 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2738002df0 con 0x5640d9df0860 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f26feffd640 1 -- 10.20.193.4:0/675982931 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f273803c040 con 0x5640d9df0860 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f26feffd640 1 -- 10.20.193.4:0/675982931 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2738055b20 con 0x5640d9df0860 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f26feffd640 1 -- 10.20.193.4:0/675982931 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2738055cb0 con 0x5640d9df0860 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f26feffd640 1 -- 10.20.193.4:0/675982931 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2738055e90 con 0x5640d9df0860 2026-02-24T09:12:45.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 10 client.16407 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 1 -- 10.20.193.4:0/675982931 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5640d9c8c970 con 0x5640d9df0860 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f26feffd640 1 -- 10.20.193.4:0/675982931 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2738004270 con 0x5640d9df0860 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 10 client.16407 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 10 client.16407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 20 client.16407 populate_metadata read hostname 'trial004' 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5640d9e35500 0x5640d9f02e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 4 client.16407 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f274d6b5e00 1 -- 10.20.193.4:0/675982931 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5640d9a2b160 con 0x5640d9e35500 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.492+0000 7f2749430640 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5640d9e35500 0x5640d9f02e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f2749430640 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5640d9e35500 0x5640d9f02e90 crc :-1 s=READY pgs=86 gs=4 cs=0 l=0 c_cookie=13443056812255965735 s_cookie=10328165329518402792 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba8f54f245e97227 server_cookie=8f5503a56f731ce8 in_seq=0 out_seq=0 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f26feffd640 10 client.16407 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f26feffd640 1 -- 10.20.193.4:0/675982931 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5640d9a2b160 con 0x5640d9e35500 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f26feffd640 10 client.16407 handle_command_reply: tid=0 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 client.16407 shutdown 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 -- 10.20.193.4:0/675982931 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 msgr2=0x5640d9dce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9dce030 secure :-1 s=READY pgs=717 gs=1 cs=0 l=1 c_cookie=15055591947880109287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f273802f6e0 tx=0x7f2738002f60 comp rx=0 tx=0).stop 2026-02-24T09:12:45.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 -- 10.20.193.4:0/675982931 shutdown_connections 2026-02-24T09:12:45.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5640d9e35500 0x5640d9f02e90 crc :-1 s=READY pgs=86 gs=4 cs=0 l=0 c_cookie=13443056812255965735 s_cookie=10328165329518402792 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5640d9e32540 0x5640d9dce570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f26feffd640 0 client.16407 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:45.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5640d9df0860 0x5640d9dce030 unknown :-1 s=CLOSED pgs=717 gs=1 cs=0 l=1 c_cookie=15055591947880109287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 --2- 10.20.193.4:0/675982931 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5640d9deff50 0x5640d9def880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 -- 10.20.193.4:0/675982931 >> 10.20.193.4:0/675982931 conn(0x5640d9d0edb0 msgr2=0x5640d9e4fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 -- 10.20.193.4:0/675982931 shutdown_connections 2026-02-24T09:12:45.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 1 -- 10.20.193.4:0/675982931 wait complete. 2026-02-24T09:12:45.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.493+0000 7f274d6b5e00 20 client.16407 trim_cache size 0 max 16384 2026-02-24T09:12:45.505 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:12:45.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 -- 10.20.193.4:0/4087235196 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f27200b56e0 msgr2=0x7f27200d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f27200b56e0 0x7f27200d5b90 secure :-1 s=READY pgs=332 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2734004740 tx=0x7f2734005f70 comp rx=0 tx=0).stop 2026-02-24T09:12:45.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 -- 10.20.193.4:0/4087235196 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2744115840 msgr2=0x7f27440f5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:45.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2744115840 0x7f27440f5f90 secure :-1 s=READY pgs=713 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2740006e90 tx=0x7f274000edf0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 -- 10.20.193.4:0/4087235196 shutdown_connections 2026-02-24T09:12:45.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f27200b56e0 0x7f27200d5b90 unknown :-1 s=CLOSED pgs=332 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2744115840 0x7f27440f5f90 unknown :-1 s=CLOSED pgs=713 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2744110040 0x7f2744176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 --2- 10.20.193.4:0/4087235196 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f274410f650 0x7f27440f5890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:45.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 -- 10.20.193.4:0/4087235196 >> 10.20.193.4:0/4087235196 conn(0x7f27440ecf20 msgr2=0x7f2744111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:45.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 -- 10.20.193.4:0/4087235196 shutdown_connections 2026-02-24T09:12:45.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:45.495+0000 7f274b6bb640 1 -- 10.20.193.4:0/4087235196 wait complete. 2026-02-24T09:12:46.603 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:12:46.604 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:12:46.771 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:46.894 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:46 trial004 ceph-mon[41596]: pgmap v241: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 674 MiB/s wr, 207 op/s 2026-02-24T09:12:46.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 -- 10.20.193.4:0/3417236079 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd93810c840 msgr2=0x7fd938155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 --2- 10.20.193.4:0/3417236079 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd93810c840 0x7fd938155720 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=16744540430330262027 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd920009950 tx=0x7fd92002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 -- 10.20.193.4:0/3417236079 shutdown_connections 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 --2- 10.20.193.4:0/3417236079 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd938155c60 0x7fd938176040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 --2- 10.20.193.4:0/3417236079 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd93810c840 0x7fd938155720 unknown :-1 s=CLOSED pgs=84 gs=2 cs=0 l=1 c_cookie=16744540430330262027 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 --2- 10.20.193.4:0/3417236079 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd93810bf30 0x7fd93810c300 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 -- 10.20.193.4:0/3417236079 >> 10.20.193.4:0/3417236079 conn(0x7fd9380e9bf0 msgr2=0x7fd93810a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 -- 10.20.193.4:0/3417236079 shutdown_connections 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 -- 10.20.193.4:0/3417236079 wait complete. 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 Processor -- start 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 -- start start 2026-02-24T09:12:46.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd93810bf30 0x7fd938161320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd93810c840 0x7fd938161860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd938155c60 0x7fd938166c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd938167250 con 0x7fd93810c840 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381673c0 con 0x7fd93810bf30 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd93d4d5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd938167580 con 0x7fd938155c60 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd936ffd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd93810bf30 0x7fd938161320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd9367fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd93810c840 0x7fd938161860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.936+0000 7fd9377fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd938155c60 0x7fd938166c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd9377fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd938155c60 0x7fd938166c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:35490/0 (socket says 10.20.193.4:35490) 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd9377fe640 1 -- 10.20.193.4:0/2528937893 learned_addr learned my addr 10.20.193.4:0/2528937893 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd936ffd640 1 -- 10.20.193.4:0/2528937893 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd938155c60 msgr2=0x7fd938166c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:46.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd936ffd640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd938155c60 0x7fd938166c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd936ffd640 1 -- 10.20.193.4:0/2528937893 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd93810c840 msgr2=0x7fd938161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:46.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd936ffd640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd93810c840 0x7fd938161860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd936ffd640 1 -- 10.20.193.4:0/2528937893 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd920009570 con 0x7fd93810bf30 2026-02-24T09:12:46.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd936ffd640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd93810bf30 0x7fd938161320 secure :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd92c00e9c0 tx=0x7fd92c00ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:46.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd917fff640 1 -- 10.20.193.4:0/2528937893 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd92c00ccb0 con 0x7fd93810bf30 2026-02-24T09:12:46.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd917fff640 1 -- 10.20.193.4:0/2528937893 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd92c00ce10 con 0x7fd93810bf30 2026-02-24T09:12:46.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd93d4d5640 1 -- 10.20.193.4:0/2528937893 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd938167860 con 0x7fd93810bf30 2026-02-24T09:12:46.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd917fff640 1 -- 10.20.193.4:0/2528937893 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd92c0106b0 con 0x7fd93810bf30 2026-02-24T09:12:46.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.937+0000 7fd93d4d5640 1 -- 10.20.193.4:0/2528937893 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd938152890 con 0x7fd93810bf30 2026-02-24T09:12:46.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.939+0000 7fd917fff640 1 -- 10.20.193.4:0/2528937893 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fd92c01f060 con 0x7fd93810bf30 2026-02-24T09:12:46.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.939+0000 7fd917fff640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd90c0b5760 0x7fd90c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.940+0000 7fd917fff640 1 -- 10.20.193.4:0/2528937893 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd92c014070 con 0x7fd93810bf30 2026-02-24T09:12:46.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.940+0000 7fd9367fc640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd90c0b5760 0x7fd90c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.940+0000 7fd9367fc640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd90c0b5760 0x7fd90c0d5c10 secure :-1 s=READY pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd938167cc0 tx=0x7fd92003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:46.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.944+0000 7fd93f4cfe00 1 Processor -- start 2026-02-24T09:12:46.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.944+0000 7fd93f4cfe00 1 -- start start 2026-02-24T09:12:46.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a724499300 0x55a7244996d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499c10 0x55a7244de370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a7244de8b0 0x55a7244fec90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a7243a9520 con 0x55a724499c10 2026-02-24T09:12:46.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a7243a5250 con 0x55a7244de8b0 2026-02-24T09:12:46.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a72439f3b0 con 0x55a724499300 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9367fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499c10 0x55a7244de370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9367fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499c10 0x55a7244de370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56656/0 (socket says 10.20.193.4:56656) 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9367fc640 1 -- 10.20.193.4:0/4092866512 learned_addr learned my addr 10.20.193.4:0/4092866512 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd936ffd640 1 --2- 10.20.193.4:0/4092866512 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a724499300 0x55a7244996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9377fe640 1 --2- 10.20.193.4:0/4092866512 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a7244de8b0 0x55a7244fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9367fc640 1 -- 10.20.193.4:0/4092866512 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a724499300 msgr2=0x55a7244996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9367fc640 1 --2- 10.20.193.4:0/4092866512 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a724499300 0x55a7244996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9367fc640 1 -- 10.20.193.4:0/4092866512 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a7244de8b0 msgr2=0x55a7244fec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9367fc640 1 --2- 10.20.193.4:0/4092866512 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a7244de8b0 0x55a7244fec90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9367fc640 1 -- 10.20.193.4:0/4092866512 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a72434a6e0 con 0x55a724499c10 2026-02-24T09:12:46.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9367fc640 1 --2- 10.20.193.4:0/4092866512 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499c10 0x55a7244de370 secure :-1 s=READY pgs=718 gs=1 cs=0 l=1 c_cookie=9879511001592974381 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd920005990 tx=0x7fd920040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891b12e97c834c2d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9037fe640 1 -- 10.20.193.4:0/4092866512 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd920002980 con 0x55a724499c10 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9037fe640 1 -- 10.20.193.4:0/4092866512 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd92003e040 con 0x55a724499c10 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.945+0000 7fd9037fe640 1 -- 10.20.193.4:0/4092866512 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd92004f750 con 0x55a724499c10 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.946+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/4092866512 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499c10 msgr2=0x55a7244de370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.946+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/4092866512 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499c10 0x55a7244de370 secure :-1 s=READY pgs=718 gs=1 cs=0 l=1 c_cookie=9879511001592974381 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd920005990 tx=0x7fd920040000 comp rx=0 tx=0).stop 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.946+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/4092866512 shutdown_connections 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.946+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/4092866512 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a7244de8b0 0x55a7244fec90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.946+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/4092866512 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499c10 0x55a7244de370 unknown :-1 s=CLOSED pgs=718 gs=1 cs=0 l=1 c_cookie=9879511001592974381 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.946+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/4092866512 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a724499300 0x55a7244996d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.946+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/4092866512 >> 10.20.193.4:0/4092866512 conn(0x55a7243b74f0 msgr2=0x55a724497be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.946+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/4092866512 shutdown_connections 2026-02-24T09:12:46.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.946+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/4092866512 wait complete. 2026-02-24T09:12:46.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd93f4cfe00 1 -- start start 2026-02-24T09:12:46.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd93f4cfe00 1 Processor -- start 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244b1320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499c10 0x55a7244b1860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a7244de8b0 0x55a7244b6850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a7244b6d90 con 0x55a724499300 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a7244b6f00 con 0x55a724499c10 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a7244b70c0 con 0x55a7244de8b0 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd936ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd936ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56666/0 (socket says 10.20.193.4:56666) 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd936ffd640 1 -- 10.20.193.4:0/502953260 learned_addr learned my addr 10.20.193.4:0/502953260 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd9367fc640 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499c10 0x55a7244b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd9377fe640 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a7244de8b0 0x55a7244b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd936ffd640 1 -- 10.20.193.4:0/502953260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a7244de8b0 msgr2=0x55a7244b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd936ffd640 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a7244de8b0 0x55a7244b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd936ffd640 1 -- 10.20.193.4:0/502953260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499c10 msgr2=0x55a7244b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd936ffd640 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499c10 0x55a7244b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd936ffd640 1 -- 10.20.193.4:0/502953260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a724322cd0 con 0x55a724499300 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd936ffd640 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244b1320 secure :-1 s=READY pgs=719 gs=1 cs=0 l=1 c_cookie=9036549764632131163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd92c0e45f0 tx=0x7fd92c0ac8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6846221c09b65b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd900ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd900ff9640 1 -- 10.20.193.4:0/502953260 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd92c0b5120 con 0x55a724499300 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/502953260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd938060e70 con 0x55a724499300 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd900ff9640 1 -- 10.20.193.4:0/502953260 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd92c0b0070 con 0x55a724499300 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd900ff9640 1 -- 10.20.193.4:0/502953260 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd92c0acc40 con 0x55a724499300 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.947+0000 7fd900ff9640 1 -- 10.20.193.4:0/502953260 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd92c0b7ad0 con 0x55a724499300 2026-02-24T09:12:46.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd900ff9640 10 client.16419 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd93f4cfe00 10 client.16419 _ll_register_callbacks cb 0x55a72431b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/502953260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a72402c9d0 con 0x55a724499300 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd900ff9640 1 -- 10.20.193.4:0/502953260 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd92c0e4420 con 0x55a724499300 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd93f4cfe00 10 client.16419 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/502953260 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55a724334ab0 con 0x55a724499300 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd900ff9640 1 -- 10.20.193.4:0/502953260 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd92c072020 con 0x55a724499300 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd93f4cfe00 10 client.16419 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd93f4cfe00 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd93f4cfe00 20 client.16419 populate_metadata read hostname 'trial004' 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a7244dba90 0x55a7244dbf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd93f4cfe00 4 client.16419 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:46.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/502953260 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7243afb70 con 0x55a7244dba90 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.948+0000 7fd9367fc640 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a7244dba90 0x55a7244dbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.949+0000 7fd900ff9640 10 client.16419 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.949+0000 7fd9367fc640 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a7244dba90 0x55a7244dbf30 crc :-1 s=READY pgs=87 gs=4 cs=0 l=0 c_cookie=17847293537433257430 s_cookie=9773398419290273304 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ae52e9ccd585d6 server_cookie=87a21614a6293618 in_seq=0 out_seq=0 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd900ff9640 1 -- 10.20.193.4:0/502953260 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a7243afb70 con 0x55a7244dba90 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd900ff9640 10 client.16419 handle_command_reply: tid=0 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 client.16419 shutdown 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/502953260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 msgr2=0x55a7244b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244b1320 secure :-1 s=READY pgs=719 gs=1 cs=0 l=1 c_cookie=9036549764632131163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd92c0e45f0 tx=0x7fd92c0ac8d0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/502953260 shutdown_connections 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a7244dba90 0x55a7244dbf30 crc :-1 s=READY pgs=87 gs=4 cs=0 l=0 c_cookie=17847293537433257430 s_cookie=9773398419290273304 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a7244de8b0 0x55a7244b6850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499c10 0x55a7244b1860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd900ff9640 0 client.16419 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:46.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/502953260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244b1320 unknown :-1 s=CLOSED pgs=719 gs=1 cs=0 l=1 c_cookie=9036549764632131163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/502953260 >> 10.20.193.4:0/502953260 conn(0x55a7243b74f0 msgr2=0x55a7244982f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:46.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/502953260 shutdown_connections 2026-02-24T09:12:46.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/502953260 wait complete. 2026-02-24T09:12:46.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.950+0000 7fd93f4cfe00 20 client.16419 trim_cache size 0 max 16384 2026-02-24T09:12:46.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.959+0000 7fd93f4cfe00 1 Processor -- start 2026-02-24T09:12:46.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd93f4cfe00 1 -- start start 2026-02-24T09:12:46.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499300 0x55a7244b4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a724499c10 0x55a7244984f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a7244de8b0 0x55a724498a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a72439cfe0 con 0x55a7244de8b0 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a724067fe0 con 0x55a724499300 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a7244b6960 con 0x55a724499c10 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd9377fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a7244de8b0 0x55a724498a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd9377fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a7244de8b0 0x55a724498a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56674/0 (socket says 10.20.193.4:56674) 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd9377fe640 1 -- 10.20.193.4:0/1202873609 learned_addr learned my addr 10.20.193.4:0/1202873609 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd9367fc640 1 --2- 10.20.193.4:0/1202873609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a724499c10 0x55a7244984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd936ffd640 1 --2- 10.20.193.4:0/1202873609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499300 0x55a7244b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd9377fe640 1 -- 10.20.193.4:0/1202873609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a724499c10 msgr2=0x55a7244984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd9377fe640 1 --2- 10.20.193.4:0/1202873609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a724499c10 0x55a7244984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd9377fe640 1 -- 10.20.193.4:0/1202873609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499300 msgr2=0x55a7244b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd9377fe640 1 --2- 10.20.193.4:0/1202873609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499300 0x55a7244b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd9377fe640 1 -- 10.20.193.4:0/1202873609 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a72432f530 con 0x55a7244de8b0 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd936ffd640 1 --2- 10.20.193.4:0/1202873609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499300 0x55a7244b4c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd9377fe640 1 --2- 10.20.193.4:0/1202873609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a7244de8b0 0x55a724498a30 secure :-1 s=READY pgs=720 gs=1 cs=0 l=1 c_cookie=7320265967959107029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd928005620 tx=0x7fd92800ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6596cf1d099565d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd902ffd640 1 -- 10.20.193.4:0/1202873609 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd928004e30 con 0x55a7244de8b0 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd902ffd640 1 -- 10.20.193.4:0/1202873609 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd928019040 con 0x55a7244de8b0 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd902ffd640 1 -- 10.20.193.4:0/1202873609 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd92801d8f0 con 0x55a7244de8b0 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/1202873609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a7244de8b0 msgr2=0x55a724498a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.960+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/1202873609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a7244de8b0 0x55a724498a30 secure :-1 s=READY pgs=720 gs=1 cs=0 l=1 c_cookie=7320265967959107029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd928005620 tx=0x7fd92800ac50 comp rx=0 tx=0).stop 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/1202873609 shutdown_connections 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/1202873609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a7244de8b0 0x55a724498a30 unknown :-1 s=CLOSED pgs=720 gs=1 cs=0 l=1 c_cookie=7320265967959107029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/1202873609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a724499c10 0x55a7244984f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/1202873609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499300 0x55a7244b4c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/1202873609 >> 10.20.193.4:0/1202873609 conn(0x55a7243b74f0 msgr2=0x55a7244b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/1202873609 shutdown_connections 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/1202873609 wait complete. 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 -- start start 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 Processor -- start 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244bd0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499c10 0x55a7244bd5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a7244de8b0 0x55a7244b7850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a7244b7ef0 con 0x55a724499300 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a7244b8060 con 0x55a724499c10 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd93f4cfe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a7244b8220 con 0x55a7244de8b0 2026-02-24T09:12:46.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd936ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd936ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244bd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56688/0 (socket says 10.20.193.4:56688) 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd936ffd640 1 -- 10.20.193.4:0/285061487 learned_addr learned my addr 10.20.193.4:0/285061487 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd9377fe640 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a7244de8b0 0x55a7244b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd936ffd640 1 -- 10.20.193.4:0/285061487 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a7244de8b0 msgr2=0x55a7244b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd936ffd640 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a7244de8b0 0x55a7244b7850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd936ffd640 1 -- 10.20.193.4:0/285061487 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499c10 msgr2=0x55a7244bd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd936ffd640 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499c10 0x55a7244bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.961+0000 7fd936ffd640 1 -- 10.20.193.4:0/285061487 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a724323000 con 0x55a724499300 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd936ffd640 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244bd0a0 secure :-1 s=READY pgs=721 gs=1 cs=0 l=1 c_cookie=15719914727604978553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd92c0ace00 tx=0x7fd92c071000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da285b2836538379 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd900ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd900ff9640 1 -- 10.20.193.4:0/285061487 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd92c0b5120 con 0x55a724499300 2026-02-24T09:12:46.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/285061487 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9280052c0 con 0x55a724499300 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd900ff9640 1 -- 10.20.193.4:0/285061487 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd92c0b0070 con 0x55a724499300 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd900ff9640 1 -- 10.20.193.4:0/285061487 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd92c0acc70 con 0x55a724499300 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 10 client.16425 _ll_register_callbacks cb 0x55a72431b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/285061487 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a7243b17e0 con 0x55a724499300 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd900ff9640 1 -- 10.20.193.4:0/285061487 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd92c08b020 con 0x55a724499300 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd900ff9640 1 -- 10.20.193.4:0/285061487 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd92c0adab0 con 0x55a724499300 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 10 client.16425 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/285061487 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55a724334d10 con 0x55a724499300 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd900ff9640 1 -- 10.20.193.4:0/285061487 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd92c072040 con 0x55a724499300 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 10 client.16425 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 10 client.16425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 20 client.16425 populate_metadata read hostname 'trial004' 2026-02-24T09:12:46.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a72458c300 0x55a7245ac780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 4 client.16425 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/285061487 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a72402a220 con 0x55a72458c300 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd9367fc640 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a72458c300 0x55a7245ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd9367fc640 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a72458c300 0x55a7245ac780 crc :-1 s=READY pgs=88 gs=4 cs=0 l=0 c_cookie=10135671744823947603 s_cookie=15051324381292127466 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ca923c03631f153 server_cookie=d0e10bc78a17e4ea in_seq=0 out_seq=0 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.962+0000 7fd900ff9640 10 client.16425 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd900ff9640 1 -- 10.20.193.4:0/285061487 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a72402a220 con 0x55a72458c300 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd900ff9640 10 client.16425 handle_command_reply: tid=0 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 client.16425 shutdown 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/285061487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 msgr2=0x55a7244bd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244bd0a0 secure :-1 s=READY pgs=721 gs=1 cs=0 l=1 c_cookie=15719914727604978553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd92c0ace00 tx=0x7fd92c071000 comp rx=0 tx=0).stop 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/285061487 shutdown_connections 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a72458c300 0x55a7245ac780 crc :-1 s=READY pgs=88 gs=4 cs=0 l=0 c_cookie=10135671744823947603 s_cookie=15051324381292127466 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a7244de8b0 0x55a7244b7850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a724499c10 0x55a7244bd5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 --2- 10.20.193.4:0/285061487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a724499300 0x55a7244bd0a0 unknown :-1 s=CLOSED pgs=721 gs=1 cs=0 l=1 c_cookie=15719914727604978553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd900ff9640 0 client.16425 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:46.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/285061487 >> 10.20.193.4:0/285061487 conn(0x55a7243b74f0 msgr2=0x55a7244b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:46.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/285061487 shutdown_connections 2026-02-24T09:12:46.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.963+0000 7fd93f4cfe00 1 -- 10.20.193.4:0/285061487 wait complete. 2026-02-24T09:12:46.974 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:12:46.975 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:12:46.975 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "401d3135-d6c9-48d4-ba02-eb0a9aee9051", 2026-02-24T09:12:46.975 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:12:46.975 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:12:46.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93f4cfe00 20 client.16425 trim_cache size 0 max 16384 2026-02-24T09:12:46.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 -- 10.20.193.4:0/2528937893 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd90c0b5760 msgr2=0x7fd90c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:46.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd90c0b5760 0x7fd90c0d5c10 secure :-1 s=READY pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd938167cc0 tx=0x7fd92003a040 comp rx=0 tx=0).stop 2026-02-24T09:12:46.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 -- 10.20.193.4:0/2528937893 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd93810bf30 msgr2=0x7fd938161320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:46.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd93810bf30 0x7fd938161320 secure :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd92c00e9c0 tx=0x7fd92c00ee90 comp rx=0 tx=0).stop 2026-02-24T09:12:46.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 -- 10.20.193.4:0/2528937893 shutdown_connections 2026-02-24T09:12:46.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd90c0b5760 0x7fd90c0d5c10 unknown :-1 s=CLOSED pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd938155c60 0x7fd938166c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd93810c840 0x7fd938161860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 --2- 10.20.193.4:0/2528937893 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd93810bf30 0x7fd938161320 unknown :-1 s=CLOSED pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:46.977 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 -- 10.20.193.4:0/2528937893 >> 10.20.193.4:0/2528937893 conn(0x7fd9380e9bf0 msgr2=0x7fd938109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:46.977 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 -- 10.20.193.4:0/2528937893 shutdown_connections 2026-02-24T09:12:46.977 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:46.964+0000 7fd93d4d5640 1 -- 10.20.193.4:0/2528937893 wait complete. 2026-02-24T09:12:47.069 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:12:47.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:46 trial090 ceph-mon[47278]: pgmap v241: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 674 MiB/s wr, 207 op/s 2026-02-24T09:12:47.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:46 trial014 ceph-mon[46941]: pgmap v241: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 674 MiB/s wr, 207 op/s 2026-02-24T09:12:47.231 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:12:47.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.384+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3535739747 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e7c1135c0 msgr2=0x7f9e7c173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:47.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.384+0000 7f9e81ddb640 1 --2- 10.20.193.4:0/3535739747 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e7c1135c0 0x7f9e7c173f90 secure :-1 s=READY pgs=722 gs=1 cs=0 l=1 c_cookie=9147568307424995536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e7000aa30 tx=0x7f9e70030280 comp rx=0 tx=0).stop 2026-02-24T09:12:47.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.384+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3535739747 shutdown_connections 2026-02-24T09:12:47.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.384+0000 7f9e81ddb640 1 --2- 10.20.193.4:0/3535739747 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e7c1135c0 0x7f9e7c173f90 unknown :-1 s=CLOSED pgs=722 gs=1 cs=0 l=1 c_cookie=9147568307424995536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.384+0000 7f9e81ddb640 1 --2- 10.20.193.4:0/3535739747 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e7c10ddc0 0x7f9e7c112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.384+0000 7f9e81ddb640 1 --2- 10.20.193.4:0/3535739747 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e7c10d3d0 0x7f9e7c10d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.384+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3535739747 >> 10.20.193.4:0/3535739747 conn(0x7f9e7c0eaca0 msgr2=0x7f9e7c10b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:47.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.384+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3535739747 shutdown_connections 2026-02-24T09:12:47.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.384+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3535739747 wait complete. 2026-02-24T09:12:47.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e81ddb640 1 Processor -- start 2026-02-24T09:12:47.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e81ddb640 1 -- start start 2026-02-24T09:12:47.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e81ddb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e7c10d3d0 0x7f9e7c11bc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e81ddb640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e7c10ddc0 0x7f9e7c11c180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e81ddb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e7c1135c0 0x7f9e7c121550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e81ddb640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c121b70 con 0x7f9e7c10d3d0 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e81ddb640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c121ce0 con 0x7f9e7c10ddc0 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e81ddb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c121ea0 con 0x7f9e7c1135c0 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e7c10d3d0 0x7f9e7c11bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e7c10d3d0 0x7f9e7c11bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56702/0 (socket says 10.20.193.4:56702) 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/3666396645 learned_addr learned my addr 10.20.193.4:0/3666396645 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e7c1135c0 0x7f9e7c121550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7affd640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e7c10ddc0 0x7f9e7c11c180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/3666396645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e7c1135c0 msgr2=0x7f9e7c121550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e7c1135c0 0x7f9e7c121550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/3666396645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e7c10ddc0 msgr2=0x7f9e7c11c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e7c10ddc0 0x7f9e7c11c180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/3666396645 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7000a650 con 0x7f9e7c10d3d0 2026-02-24T09:12:47.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e7c10d3d0 0x7f9e7c11bc40 secure :-1 s=READY pgs=723 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e680072a0 tx=0x7f9e6800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:47.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e78ff9640 1 -- 10.20.193.4:0/3666396645 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e68004500 con 0x7f9e7c10d3d0 2026-02-24T09:12:47.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3666396645 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7c122180 con 0x7f9e7c10d3d0 2026-02-24T09:12:47.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e78ff9640 1 -- 10.20.193.4:0/3666396645 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9e6800bca0 con 0x7f9e7c10d3d0 2026-02-24T09:12:47.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e78ff9640 1 -- 10.20.193.4:0/3666396645 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e680106e0 con 0x7f9e7c10d3d0 2026-02-24T09:12:47.392 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.385+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3666396645 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7c162880 con 0x7f9e7c10d3d0 2026-02-24T09:12:47.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.388+0000 7f9e78ff9640 1 -- 10.20.193.4:0/3666396645 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9e6800b7c0 con 0x7f9e7c10d3d0 2026-02-24T09:12:47.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.389+0000 7f9e78ff9640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e500b56e0 0x7f9e500d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.389+0000 7f9e78ff9640 1 -- 10.20.193.4:0/3666396645 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9e680e6ba0 con 0x7f9e7c10d3d0 2026-02-24T09:12:47.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.389+0000 7f9e7affd640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e500b56e0 0x7f9e500d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.390+0000 7f9e7affd640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e500b56e0 0x7f9e500d5b90 secure :-1 s=READY pgs=334 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e7c1225e0 tx=0x7f9e6c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:47.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e83dd5e00 1 Processor -- start 2026-02-24T09:12:47.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e83dd5e00 1 -- start start 2026-02-24T09:12:47.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f025100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 0x55734f069da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f06a2e0 0x55734f08a6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55734ef30de0 con 0x55734f024d30 2026-02-24T09:12:47.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55734ef2cb10 con 0x55734f025640 2026-02-24T09:12:47.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55734ef26ab0 con 0x55734f06a2e0 2026-02-24T09:12:47.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f025100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f025100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56710/0 (socket says 10.20.193.4:56710) 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/2843306624 learned_addr learned my addr 10.20.193.4:0/2843306624 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7affd640 1 --2- 10.20.193.4:0/2843306624 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 0x55734f069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/2843306624 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f06a2e0 0x55734f08a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/2843306624 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f06a2e0 msgr2=0x55734f08a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/2843306624 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f06a2e0 0x55734f08a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/2843306624 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 msgr2=0x55734f069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/2843306624 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 0x55734f069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/2843306624 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55734eed2310 con 0x55734f024d30 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/2843306624 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f025100 secure :-1 s=READY pgs=724 gs=1 cs=0 l=1 c_cookie=7152164760719046715 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e68004710 tx=0x7f9e68002ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634197f4c1b9b83b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e3ffff640 1 -- 10.20.193.4:0/2843306624 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e680ac6d0 con 0x55734f024d30 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e3ffff640 1 -- 10.20.193.4:0/2843306624 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9e680ad8d0 con 0x55734f024d30 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.391+0000 7f9e3ffff640 1 -- 10.20.193.4:0/2843306624 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e6800bb30 con 0x55734f024d30 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.392+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2843306624 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 msgr2=0x55734f025100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:47.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.392+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/2843306624 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f025100 secure :-1 s=READY pgs=724 gs=1 cs=0 l=1 c_cookie=7152164760719046715 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e68004710 tx=0x7f9e68002ba0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.392+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2843306624 shutdown_connections 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.392+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/2843306624 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f06a2e0 0x55734f08a6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.392+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/2843306624 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 0x55734f069da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.392+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/2843306624 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f025100 unknown :-1 s=CLOSED pgs=724 gs=1 cs=0 l=1 c_cookie=7152164760719046715 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.392+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2843306624 >> 10.20.193.4:0/2843306624 conn(0x55734ef3f6b0 msgr2=0x55734f023610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.392+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2843306624 shutdown_connections 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.392+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2843306624 wait complete. 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e83dd5e00 1 -- start start 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e83dd5e00 1 Processor -- start 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 0x55734f03d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 0x55734f03d910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f06a2e0 0x55734f042900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55734f042e40 con 0x55734f06a2e0 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55734f042fb0 con 0x55734f025640 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55734f043170 con 0x55734f024d30 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f06a2e0 0x55734f042900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f06a2e0 0x55734f042900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56712/0 (socket says 10.20.193.4:56712) 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7bfff640 1 -- 10.20.193.4:0/2514142809 learned_addr learned my addr 10.20.193.4:0/2514142809 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7affd640 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 0x55734f03d910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 0x55734f03d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7bfff640 1 -- 10.20.193.4:0/2514142809 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 msgr2=0x55734f03d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 0x55734f03d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7bfff640 1 -- 10.20.193.4:0/2514142809 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 msgr2=0x55734f03d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 0x55734f03d910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7bfff640 1 -- 10.20.193.4:0/2514142809 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55734eeaa8c0 con 0x55734f06a2e0 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7affd640 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 0x55734f03d910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 0x55734f03d3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f06a2e0 0x55734f042900 secure :-1 s=READY pgs=725 gs=1 cs=0 l=1 c_cookie=16917288858615889579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e7000a230 tx=0x7f9e70039680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac64895d4793eab server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.393+0000 7f9e3d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/2514142809 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e7003e040 con 0x55734f06a2e0 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2514142809 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7c162880 con 0x55734f06a2e0 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/2514142809 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9e70006c90 con 0x55734f06a2e0 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/2514142809 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e700446f0 con 0x55734f06a2e0 2026-02-24T09:12:47.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/2514142809 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9e70044880 con 0x55734f06a2e0 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e3d7fa640 10 client.16437 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 10 client.16437 _ll_register_callbacks cb 0x55734eec2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2514142809 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55734ec764a0 con 0x55734f06a2e0 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/2514142809 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9e70003bb0 con 0x55734f06a2e0 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 10 client.16437 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2514142809 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55734eebc6e0 con 0x55734f06a2e0 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/2514142809 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9e70054020 con 0x55734f06a2e0 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 10 client.16437 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 20 client.16437 populate_metadata read hostname 'trial004' 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55734f067c30 0x55734f0680d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 4 client.16437 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2514142809 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55734ef1c4f0 con 0x55734f067c30 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.394+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55734f067c30 0x55734f0680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.395+0000 7f9e3d7fa640 10 client.16437 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.395+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55734f067c30 0x55734f0680d0 crc :-1 s=READY pgs=89 gs=4 cs=0 l=0 c_cookie=4702994026813828743 s_cookie=13813783590785857015 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414464265d05ae87 server_cookie=bfb46afcbce935f7 in_seq=0 out_seq=0 2026-02-24T09:12:47.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/2514142809 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55734ef1c4f0 con 0x55734f067c30 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e3d7fa640 10 client.16437 handle_command_reply: tid=0 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 client.16437 shutdown 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2514142809 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f06a2e0 msgr2=0x55734f042900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f06a2e0 0x55734f042900 secure :-1 s=READY pgs=725 gs=1 cs=0 l=1 c_cookie=16917288858615889579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e7000a230 tx=0x7f9e70039680 comp rx=0 tx=0).stop 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2514142809 shutdown_connections 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55734f067c30 0x55734f0680d0 crc :-1 s=READY pgs=89 gs=4 cs=0 l=0 c_cookie=4702994026813828743 s_cookie=13813783590785857015 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f06a2e0 0x55734f042900 unknown :-1 s=CLOSED pgs=725 gs=1 cs=0 l=1 c_cookie=16917288858615889579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f025640 0x55734f03d910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e3d7fa640 0 client.16437 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/2514142809 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 0x55734f03d3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2514142809 >> 10.20.193.4:0/2514142809 conn(0x55734ef3f6b0 msgr2=0x55734f023e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2514142809 shutdown_connections 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/2514142809 wait complete. 2026-02-24T09:12:47.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.396+0000 7f9e83dd5e00 20 client.16437 trim_cache size 0 max 16384 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e83dd5e00 1 Processor -- start 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e83dd5e00 1 -- start start 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f03a7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f025640 0x55734f03ad00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f06a2e0 0x55734f062de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55734ef246e0 con 0x55734f024d30 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55734ebeff50 con 0x55734f06a2e0 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55734f025a10 con 0x55734f025640 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f03a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f03a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56714/0 (socket says 10.20.193.4:56714) 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/1466125020 learned_addr learned my addr 10.20.193.4:0/1466125020 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7affd640 1 --2- 10.20.193.4:0/1466125020 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f025640 0x55734f03ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/1466125020 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f025640 msgr2=0x55734f03ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/1466125020 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f025640 0x55734f03ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/1466125020 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f06a2e0 msgr2=0x55734f062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:47.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/1466125020 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f06a2e0 0x55734f062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7b7fe640 1 -- 10.20.193.4:0/1466125020 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55734eeb7160 con 0x55734f024d30 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7affd640 1 --2- 10.20.193.4:0/1466125020 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f025640 0x55734f03ad00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/1466125020 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f03a7c0 secure :-1 s=READY pgs=726 gs=1 cs=0 l=1 c_cookie=15958369385434902969 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e680ad140 tx=0x7f9e680e6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd778467ad50f1b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e3f7fe640 1 -- 10.20.193.4:0/1466125020 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e680ac6d0 con 0x55734f024d30 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e3f7fe640 1 -- 10.20.193.4:0/1466125020 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9e6806de90 con 0x55734f024d30 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.407+0000 7f9e3f7fe640 1 -- 10.20.193.4:0/1466125020 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e68002850 con 0x55734f024d30 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.408+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1466125020 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 msgr2=0x55734f03a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.408+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/1466125020 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f03a7c0 secure :-1 s=READY pgs=726 gs=1 cs=0 l=1 c_cookie=15958369385434902969 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e680ad140 tx=0x7f9e680e6040 comp rx=0 tx=0).stop 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.408+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1466125020 shutdown_connections 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.408+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/1466125020 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f06a2e0 0x55734f062de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.408+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/1466125020 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f025640 0x55734f03ad00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.408+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/1466125020 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f024d30 0x55734f03a7c0 unknown :-1 s=CLOSED pgs=726 gs=1 cs=0 l=1 c_cookie=15958369385434902969 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.408+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1466125020 >> 10.20.193.4:0/1466125020 conn(0x55734ef3f6b0 msgr2=0x55734f027bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.408+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1466125020 shutdown_connections 2026-02-24T09:12:47.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.408+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1466125020 wait complete. 2026-02-24T09:12:47.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 1 -- start start 2026-02-24T09:12:47.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 1 Processor -- start 2026-02-24T09:12:47.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 0x55734f045180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f025640 0x55734f0456c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f06a2e0 0x55734f0cf800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55734ef246e0 con 0x55734f025640 2026-02-24T09:12:47.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55734ebeff50 con 0x55734f06a2e0 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55734f045f60 con 0x55734f024d30 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f025640 0x55734f0456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f025640 0x55734f0456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:56720/0 (socket says 10.20.193.4:56720) 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7affd640 1 -- 10.20.193.4:0/1249121668 learned_addr learned my addr 10.20.193.4:0/1249121668 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 0x55734f045180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7affd640 1 -- 10.20.193.4:0/1249121668 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 msgr2=0x55734f045180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7affd640 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 0x55734f045180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f06a2e0 0x55734f0cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7affd640 1 -- 10.20.193.4:0/1249121668 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f06a2e0 msgr2=0x55734f0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7affd640 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f06a2e0 0x55734f0cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7affd640 1 -- 10.20.193.4:0/1249121668 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55734eeaabf0 con 0x55734f025640 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7bfff640 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f06a2e0 0x55734f0cf800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e7affd640 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f025640 0x55734f0456c0 secure :-1 s=READY pgs=727 gs=1 cs=0 l=1 c_cookie=10485722908686204059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e6c004740 tx=0x7f9e6c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9184c56e016abc9b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e3d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/1249121668 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e6c024070 con 0x55734f025640 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1249121668 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55734eed2310 con 0x55734f025640 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/1249121668 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9e6c01f2f0 con 0x55734f025640 2026-02-24T09:12:47.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/1249121668 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9e6c011ac0 con 0x55734f025640 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 10 client.16443 _ll_register_callbacks cb 0x55734eec2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1249121668 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e680ad8d0 con 0x55734f025640 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.409+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/1249121668 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9e6c011c50 con 0x55734f025640 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/1249121668 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9e6c011e10 con 0x55734f025640 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e83dd5e00 10 client.16443 fetch_fsmap learned FSMap version 19 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1249121668 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55734eebc940 con 0x55734f025640 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/1249121668 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9e6c011440 con 0x55734f025640 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e83dd5e00 10 client.16443 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e83dd5e00 10 client.16443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e83dd5e00 20 client.16443 populate_metadata read hostname 'trial004' 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55734f117c30 0x55734f1380e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e83dd5e00 4 client.16443 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1249121668 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55734ec5b160 con 0x55734f117c30 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.410+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55734f117c30 0x55734f1380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e3d7fa640 10 client.16443 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e7b7fe640 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55734f117c30 0x55734f1380e0 crc :-1 s=READY pgs=90 gs=4 cs=0 l=0 c_cookie=17909385940330007892 s_cookie=13217884850606238624 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f88aeb9feebecd54 server_cookie=b76f5c3d8266eba0 in_seq=0 out_seq=0 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e3d7fa640 1 -- 10.20.193.4:0/1249121668 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x55734ec5b160 con 0x55734f117c30 2026-02-24T09:12:47.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e3d7fa640 10 client.16443 handle_command_reply: tid=0 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 client.16443 shutdown 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1249121668 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f025640 msgr2=0x55734f0456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f025640 0x55734f0456c0 secure :-1 s=READY pgs=727 gs=1 cs=0 l=1 c_cookie=10485722908686204059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e6c004740 tx=0x7f9e6c0047e0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1249121668 shutdown_connections 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55734f117c30 0x55734f1380e0 crc :-1 s=READY pgs=90 gs=4 cs=0 l=0 c_cookie=17909385940330007892 s_cookie=13217884850606238624 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55734f06a2e0 0x55734f0cf800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55734f025640 0x55734f0456c0 unknown :-1 s=CLOSED pgs=727 gs=1 cs=0 l=1 c_cookie=10485722908686204059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e3d7fa640 0 client.16443 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 --2- 10.20.193.4:0/1249121668 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55734f024d30 0x55734f045180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1249121668 >> 10.20.193.4:0/1249121668 conn(0x55734ef3f6b0 msgr2=0x55734f0397b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1249121668 shutdown_connections 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 1 -- 10.20.193.4:0/1249121668 wait complete. 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.411+0000 7f9e83dd5e00 20 client.16443 trim_cache size 0 max 16384 2026-02-24T09:12:47.418 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "401d3135-d6c9-48d4-ba02-eb0a9aee9051", 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:47.419 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:47.420 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:47.421 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3666396645 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e500b56e0 msgr2=0x7f9e500d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:47.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e500b56e0 0x7f9e500d5b90 secure :-1 s=READY pgs=334 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e7c1225e0 tx=0x7f9e6c005f90 comp rx=0 tx=0).stop 2026-02-24T09:12:47.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3666396645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e7c10d3d0 msgr2=0x7f9e7c11bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:12:47.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e7c10d3d0 0x7f9e7c11bc40 secure :-1 s=READY pgs=723 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e680072a0 tx=0x7f9e6800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3666396645 shutdown_connections 2026-02-24T09:12:47.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9e500b56e0 0x7f9e500d5b90 unknown :-1 s=CLOSED pgs=334 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e7c1135c0 0x7f9e7c121550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9e7c10ddc0 0x7f9e7c11c180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 --2- 10.20.193.4:0/3666396645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9e7c10d3d0 0x7f9e7c11bc40 unknown :-1 s=CLOSED pgs=723 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:12:47.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3666396645 >> 10.20.193.4:0/3666396645 conn(0x7f9e7c0eaca0 msgr2=0x7f9e7c10b080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:12:47.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3666396645 shutdown_connections 2026-02-24T09:12:47.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:12:47.412+0000 7f9e81ddb640 1 -- 10.20.193.4:0/3666396645 wait complete. 2026-02-24T09:12:47.511 INFO:tasks.cephfs.filesystem:scrub status for tag:401d3135-d6c9-48d4-ba02-eb0a9aee9051 - {'path': '/', 'tag': '401d3135-d6c9-48d4-ba02-eb0a9aee9051', 'options': 'recursive,force'} 2026-02-24T09:12:48.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:47 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:12:48.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:47 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:48.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:47 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:12:48.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:47 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:48.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:47 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:12:48.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:47 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:48.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:47 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:12:48.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:47 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:48.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:47 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:12:48.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:47 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:48.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:47 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:12:48.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:47 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:12:49.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:48 trial090 ceph-mon[47278]: pgmap v242: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 617 MiB/s wr, 195 op/s 2026-02-24T09:12:49.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:48 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:12:49.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:48 trial014 ceph-mon[46941]: pgmap v242: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 617 MiB/s wr, 195 op/s 2026-02-24T09:12:49.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:48 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:12:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:48 trial004 ceph-mon[41596]: pgmap v242: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 617 MiB/s wr, 195 op/s 2026-02-24T09:12:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:48 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:12:51.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:50 trial090 ceph-mon[47278]: pgmap v243: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 370 MiB/s wr, 121 op/s 2026-02-24T09:12:51.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:50 trial014 ceph-mon[46941]: pgmap v243: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 370 MiB/s wr, 121 op/s 2026-02-24T09:12:51.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:50 trial004 ceph-mon[41596]: pgmap v243: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 370 MiB/s wr, 121 op/s 2026-02-24T09:12:53.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:52 trial090 ceph-mon[47278]: pgmap v244: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 37 KiB/s rd, 385 MiB/s wr, 118 op/s 2026-02-24T09:12:53.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:52 trial014 ceph-mon[46941]: pgmap v244: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 37 KiB/s rd, 385 MiB/s wr, 118 op/s 2026-02-24T09:12:53.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:52 trial004 ceph-mon[41596]: pgmap v244: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 37 KiB/s rd, 385 MiB/s wr, 118 op/s 2026-02-24T09:12:55.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:54 trial090 ceph-mon[47278]: pgmap v245: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 488 MiB/s wr, 131 op/s 2026-02-24T09:12:55.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:54 trial014 ceph-mon[46941]: pgmap v245: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 488 MiB/s wr, 131 op/s 2026-02-24T09:12:55.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:54 trial004 ceph-mon[41596]: pgmap v245: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 488 MiB/s wr, 131 op/s 2026-02-24T09:12:57.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:56 trial090 ceph-mon[47278]: pgmap v246: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 621 MiB/s wr, 164 op/s 2026-02-24T09:12:57.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:56 trial014 ceph-mon[46941]: pgmap v246: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 621 MiB/s wr, 164 op/s 2026-02-24T09:12:57.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:56 trial004 ceph-mon[41596]: pgmap v246: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 621 MiB/s wr, 164 op/s 2026-02-24T09:12:59.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:12:58 trial090 ceph-mon[47278]: pgmap v247: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 827 MiB/s wr, 219 op/s 2026-02-24T09:12:59.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:12:58 trial014 ceph-mon[46941]: pgmap v247: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 827 MiB/s wr, 219 op/s 2026-02-24T09:12:59.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:12:58 trial004 ceph-mon[41596]: pgmap v247: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 827 MiB/s wr, 219 op/s 2026-02-24T09:13:01.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:00 trial090 ceph-mon[47278]: pgmap v248: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 831 MiB/s wr, 225 op/s 2026-02-24T09:13:01.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:00 trial014 ceph-mon[46941]: pgmap v248: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 831 MiB/s wr, 225 op/s 2026-02-24T09:13:01.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:00 trial004 ceph-mon[41596]: pgmap v248: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 831 MiB/s wr, 225 op/s 2026-02-24T09:13:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:02 trial090 ceph-mon[47278]: pgmap v249: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 56 KiB/s rd, 905 MiB/s wr, 258 op/s 2026-02-24T09:13:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:02 trial014 ceph-mon[46941]: pgmap v249: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 56 KiB/s rd, 905 MiB/s wr, 258 op/s 2026-02-24T09:13:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:02 trial004 ceph-mon[41596]: pgmap v249: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 56 KiB/s rd, 905 MiB/s wr, 258 op/s 2026-02-24T09:13:05.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:04 trial090 ceph-mon[47278]: pgmap v250: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 819 MiB/s wr, 237 op/s 2026-02-24T09:13:05.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:04 trial014 ceph-mon[46941]: pgmap v250: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 819 MiB/s wr, 237 op/s 2026-02-24T09:13:05.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:04 trial004 ceph-mon[41596]: pgmap v250: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 819 MiB/s wr, 237 op/s 2026-02-24T09:13:07.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:06 trial014 ceph-mon[46941]: pgmap v251: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 747 MiB/s wr, 220 op/s 2026-02-24T09:13:07.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:06 trial004 ceph-mon[41596]: pgmap v251: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 747 MiB/s wr, 220 op/s 2026-02-24T09:13:07.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:06 trial090 ceph-mon[47278]: pgmap v251: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 747 MiB/s wr, 220 op/s 2026-02-24T09:13:09.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:08 trial014 ceph-mon[46941]: pgmap v252: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 773 MiB/s wr, 228 op/s 2026-02-24T09:13:09.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:08 trial090 ceph-mon[47278]: pgmap v252: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 773 MiB/s wr, 228 op/s 2026-02-24T09:13:09.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:08 trial004 ceph-mon[41596]: pgmap v252: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 773 MiB/s wr, 228 op/s 2026-02-24T09:13:11.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:10 trial004 ceph-mon[41596]: pgmap v253: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 645 MiB/s wr, 192 op/s 2026-02-24T09:13:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:10 trial090 ceph-mon[47278]: pgmap v253: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 645 MiB/s wr, 192 op/s 2026-02-24T09:13:11.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:10 trial014 ceph-mon[46941]: pgmap v253: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 645 MiB/s wr, 192 op/s 2026-02-24T09:13:13.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:12 trial004 ceph-mon[41596]: pgmap v254: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 804 MiB/s wr, 230 op/s 2026-02-24T09:13:13.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:12 trial090 ceph-mon[47278]: pgmap v254: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 804 MiB/s wr, 230 op/s 2026-02-24T09:13:13.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:12 trial014 ceph-mon[46941]: pgmap v254: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 804 MiB/s wr, 230 op/s 2026-02-24T09:13:13.382 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.2 2026-02-24T09:13:13.382 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:13:13.547 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:13.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1878163394 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f43d010da00 msgr2=0x7f43d0112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:13.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 --2- 10.20.193.4:0/1878163394 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f43d010da00 0x7f43d0112a50 secure :-1 s=READY pgs=728 gs=1 cs=0 l=1 c_cookie=4076973133155806908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43c0009950 tx=0x7f43c002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1878163394 shutdown_connections 2026-02-24T09:13:13.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 --2- 10.20.193.4:0/1878163394 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f43d0113200 0x7f43d0173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 --2- 10.20.193.4:0/1878163394 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f43d010da00 0x7f43d0112a50 unknown :-1 s=CLOSED pgs=728 gs=1 cs=0 l=1 c_cookie=4076973133155806908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 --2- 10.20.193.4:0/1878163394 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f43d010d010 0x7f43d010d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1878163394 >> 10.20.193.4:0/1878163394 conn(0x7f43d005f830 msgr2=0x7f43d010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:13.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1878163394 shutdown_connections 2026-02-24T09:13:13.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1878163394 wait complete. 2026-02-24T09:13:13.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 Processor -- start 2026-02-24T09:13:13.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 -- start start 2026-02-24T09:13:13.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f43d010d010 0x7f43d00f5610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:13.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f43d010da00 0x7f43d0173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:13.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f43d0113200 0x7f43d00f5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:13.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f43d00faed0 con 0x7f43d010d010 2026-02-24T09:13:13.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f43d00fb040 con 0x7f43d010da00 2026-02-24T09:13:13.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43d6a0c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f43d00fb200 con 0x7f43d0113200 2026-02-24T09:13:13.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43cffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f43d010d010 0x7f43d00f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:13.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43cffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f43d010d010 0x7f43d00f5610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:35908/0 (socket says 10.20.193.4:35908) 2026-02-24T09:13:13.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43cffff640 1 -- 10.20.193.4:0/1937532579 learned_addr learned my addr 10.20.193.4:0/1937532579 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:13.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43cffff640 1 -- 10.20.193.4:0/1937532579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f43d0113200 msgr2=0x7f43d00f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43cffff640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f43d0113200 0x7f43d00f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43cffff640 1 -- 10.20.193.4:0/1937532579 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f43d010da00 msgr2=0x7f43d0173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43cffff640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f43d010da00 0x7f43d0173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43cffff640 1 -- 10.20.193.4:0/1937532579 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c0009570 con 0x7f43d010d010 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.690+0000 7f43cffff640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f43d010d010 0x7f43d00f5610 secure :-1 s=READY pgs=729 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43bc0072a0 tx=0x7f43bc00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.691+0000 7f43cd7fa640 1 -- 10.20.193.4:0/1937532579 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43bc004500 con 0x7f43d010d010 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.691+0000 7f43cd7fa640 1 -- 10.20.193.4:0/1937532579 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f43bc00bd20 con 0x7f43d010d010 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.691+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1937532579 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d00fb4e0 con 0x7f43d010d010 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.691+0000 7f43cd7fa640 1 -- 10.20.193.4:0/1937532579 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43bc002ea0 con 0x7f43d010d010 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.691+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1937532579 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d00fb9b0 con 0x7f43d010d010 2026-02-24T09:13:13.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.691+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1937532579 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d010e2f0 con 0x7f43d010d010 2026-02-24T09:13:13.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.693+0000 7f43cd7fa640 1 -- 10.20.193.4:0/1937532579 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f43bc00b840 con 0x7f43d010d010 2026-02-24T09:13:13.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.694+0000 7f43cd7fa640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f43a40b56d0 0x7f43a40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:13.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.694+0000 7f43cd7fa640 1 -- 10.20.193.4:0/1937532579 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f43bc0e6c80 con 0x7f43d010d010 2026-02-24T09:13:13.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.694+0000 7f43cf7fe640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f43a40b56d0 0x7f43a40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:13.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.694+0000 7f43cd7fa640 1 -- 10.20.193.4:0/1937532579 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f43bc0a9600 con 0x7f43d010d010 2026-02-24T09:13:13.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.694+0000 7f43cf7fe640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f43a40b56d0 0x7f43a40d5b80 secure :-1 s=READY pgs=335 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43c002f6e0 tx=0x7f43c0005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:13.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.853+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1937532579 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43d00fbbd0 con 0x7f43d010d010 2026-02-24T09:13:13.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.854+0000 7f43cd7fa640 1 -- 10.20.193.4:0/1937532579 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f43bc0ac7b0 con 0x7f43d010d010 2026-02-24T09:13:13.858 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:13:13.858 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:13:13.859 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:13:13.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1937532579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f43a40b56d0 msgr2=0x7f43a40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:13.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f43a40b56d0 0x7f43a40d5b80 secure :-1 s=READY pgs=335 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43c002f6e0 tx=0x7f43c0005900 comp rx=0 tx=0).stop 2026-02-24T09:13:13.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1937532579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f43d010d010 msgr2=0x7f43d00f5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:13.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f43d010d010 0x7f43d00f5610 secure :-1 s=READY pgs=729 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43bc0072a0 tx=0x7f43bc00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1937532579 shutdown_connections 2026-02-24T09:13:13.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f43a40b56d0 0x7f43a40d5b80 unknown :-1 s=CLOSED pgs=335 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f43d0113200 0x7f43d00f5d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f43d010da00 0x7f43d0173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 --2- 10.20.193.4:0/1937532579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f43d010d010 0x7f43d00f5610 unknown :-1 s=CLOSED pgs=729 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:13.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1937532579 >> 10.20.193.4:0/1937532579 conn(0x7f43d005f830 msgr2=0x7f43d0110860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:13.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1937532579 shutdown_connections 2026-02-24T09:13:13.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:13.859+0000 7f43d6a0c640 1 -- 10.20.193.4:0/1937532579 wait complete. 2026-02-24T09:13:13.964 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 140.2 --await-for 45.0' 2026-02-24T09:13:13.964 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 140.2 --await-for 45.0 2026-02-24T09:13:14.135 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:14.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.322+0000 7f004a41c640 1 -- 10.20.193.4:0/1936148609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f004410f280 msgr2=0x7f004410f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:14.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.322+0000 7f004a41c640 1 --2- 10.20.193.4:0/1936148609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f004410f280 0x7f004410f650 secure :-1 s=READY pgs=730 gs=1 cs=0 l=1 c_cookie=14645540950660132724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0030009950 tx=0x7f003002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.322+0000 7f004a41c640 1 -- 10.20.193.4:0/1936148609 shutdown_connections 2026-02-24T09:13:14.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.322+0000 7f004a41c640 1 --2- 10.20.193.4:0/1936148609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0044115470 0x7f0044175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.322+0000 7f004a41c640 1 --2- 10.20.193.4:0/1936148609 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f004410fc70 0x7f0044114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.322+0000 7f004a41c640 1 --2- 10.20.193.4:0/1936148609 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f004410f280 0x7f004410f650 unknown :-1 s=CLOSED pgs=730 gs=1 cs=0 l=1 c_cookie=14645540950660132724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.322+0000 7f004a41c640 1 -- 10.20.193.4:0/1936148609 >> 10.20.193.4:0/1936148609 conn(0x7f004405f830 msgr2=0x7f004410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:14.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.322+0000 7f004a41c640 1 -- 10.20.193.4:0/1936148609 shutdown_connections 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.322+0000 7f004a41c640 1 -- 10.20.193.4:0/1936148609 wait complete. 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f004a41c640 1 Processor -- start 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f004a41c640 1 -- start start 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f004a41c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f004410f280 0x7f004411db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f004a41c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f004410fc70 0x7f004411e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f004a41c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0044115470 0x7f0044123470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f004a41c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0044123a90 con 0x7f004410fc70 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f004a41c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0044123c00 con 0x7f0044115470 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f004a41c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0044123dc0 con 0x7f004410f280 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00437fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f004410fc70 0x7f004411e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00437fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f004410fc70 0x7f004411e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:35928/0 (socket says 10.20.193.4:35928) 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00437fe640 1 -- 10.20.193.4:0/2072015039 learned_addr learned my addr 10.20.193.4:0/2072015039 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f0043fff640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f004410f280 0x7f004411db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f0048992640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0044115470 0x7f0044123470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00437fe640 1 -- 10.20.193.4:0/2072015039 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f004410f280 msgr2=0x7f004411db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00437fe640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f004410f280 0x7f004411db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00437fe640 1 -- 10.20.193.4:0/2072015039 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0044115470 msgr2=0x7f0044123470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00437fe640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0044115470 0x7f0044123470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00437fe640 1 -- 10.20.193.4:0/2072015039 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0030009570 con 0x7f004410fc70 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00437fe640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f004410fc70 0x7f004411e0a0 secure :-1 s=READY pgs=731 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f003400d950 tx=0x7f003400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00417fa640 1 -- 10.20.193.4:0/2072015039 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0034004540 con 0x7f004410fc70 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f004a41c640 1 -- 10.20.193.4:0/2072015039 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00441240a0 con 0x7f004410fc70 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.323+0000 7f00417fa640 1 -- 10.20.193.4:0/2072015039 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0034009d00 con 0x7f004410fc70 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.324+0000 7f00417fa640 1 -- 10.20.193.4:0/2072015039 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00340106e0 con 0x7f004410fc70 2026-02-24T09:13:14.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.324+0000 7f004a41c640 1 -- 10.20.193.4:0/2072015039 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00441647a0 con 0x7f004410fc70 2026-02-24T09:13:14.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.326+0000 7f00417fa640 1 -- 10.20.193.4:0/2072015039 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f00340027c0 con 0x7f004410fc70 2026-02-24T09:13:14.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.327+0000 7f00417fa640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00180b56e0 0x7f00180d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.327+0000 7f00417fa640 1 -- 10.20.193.4:0/2072015039 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f00340e6ea0 con 0x7f004410fc70 2026-02-24T09:13:14.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.327+0000 7f0043fff640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00180b56e0 0x7f00180d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.327+0000 7f0043fff640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00180b56e0 0x7f00180d5b90 secure :-1 s=READY pgs=336 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00300023d0 tx=0x7f0030031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:14.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f004c416e00 1 Processor -- start 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f004c416e00 1 -- start start 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f004c416e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afeca88fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f004c416e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecacdc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f004c416e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecace180 0x55afecaee560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f004c416e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55afec997f20 con 0x55afecace180 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f004c416e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55afec993c50 con 0x55afeca88bd0 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f004c416e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55afec98ddb0 con 0x55afeca894e0 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f0048992640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecace180 0x55afecaee560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f0048992640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecace180 0x55afecaee560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:35942/0 (socket says 10.20.193.4:35942) 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f0048992640 1 -- 10.20.193.4:0/1756411082 learned_addr learned my addr 10.20.193.4:0/1756411082 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f00437fe640 1 --2- 10.20.193.4:0/1756411082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecacdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f0043fff640 1 --2- 10.20.193.4:0/1756411082 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afeca88fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f0048992640 1 -- 10.20.193.4:0/1756411082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 msgr2=0x55afecacdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f0048992640 1 --2- 10.20.193.4:0/1756411082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecacdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f0048992640 1 -- 10.20.193.4:0/1756411082 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 msgr2=0x55afeca88fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f0048992640 1 --2- 10.20.193.4:0/1756411082 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afeca88fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f0048992640 1 -- 10.20.193.4:0/1756411082 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afec92e690 con 0x55afecace180 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.333+0000 7f0048992640 1 --2- 10.20.193.4:0/1756411082 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecace180 0x55afecaee560 secure :-1 s=READY pgs=732 gs=1 cs=0 l=1 c_cookie=14642558985218423383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0038006d50 tx=0x7f0038003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb34d1d144a5fa57 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f0014ce3640 1 -- 10.20.193.4:0/1756411082 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0038010bf0 con 0x55afecace180 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f0014ce3640 1 -- 10.20.193.4:0/1756411082 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0038010d50 con 0x55afecace180 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f0014ce3640 1 -- 10.20.193.4:0/1756411082 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0038011860 con 0x55afecace180 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f004c416e00 1 -- 10.20.193.4:0/1756411082 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecace180 msgr2=0x55afecaee560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f004c416e00 1 --2- 10.20.193.4:0/1756411082 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecace180 0x55afecaee560 secure :-1 s=READY pgs=732 gs=1 cs=0 l=1 c_cookie=14642558985218423383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0038006d50 tx=0x7f0038003ea0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f004c416e00 1 -- 10.20.193.4:0/1756411082 shutdown_connections 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f004c416e00 1 --2- 10.20.193.4:0/1756411082 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecace180 0x55afecaee560 unknown :-1 s=CLOSED pgs=732 gs=1 cs=0 l=1 c_cookie=14642558985218423383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f004c416e00 1 --2- 10.20.193.4:0/1756411082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecacdc40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f004c416e00 1 --2- 10.20.193.4:0/1756411082 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afeca88fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f004c416e00 1 -- 10.20.193.4:0/1756411082 >> 10.20.193.4:0/1756411082 conn(0x55afec9a6880 msgr2=0x55afeca874b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f004c416e00 1 -- 10.20.193.4:0/1756411082 shutdown_connections 2026-02-24T09:13:14.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.334+0000 7f004c416e00 1 -- 10.20.193.4:0/1756411082 wait complete. 2026-02-24T09:13:14.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f004c416e00 1 -- start start 2026-02-24T09:13:14.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f004c416e00 1 Processor -- start 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f004c416e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca88bd0 0x55afecaa0a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f004c416e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecaa0f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f004c416e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afecace180 0x55afecaa5f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f004c416e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55afecaa6470 con 0x55afeca88bd0 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f004c416e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55afecaa65e0 con 0x55afecace180 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f004c416e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55afecaa67a0 con 0x55afeca894e0 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f0043fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca88bd0 0x55afecaa0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f00437fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecaa0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f00437fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecaa0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:33862/0 (socket says 10.20.193.4:33862) 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f00437fe640 1 -- 10.20.193.4:0/1548526896 learned_addr learned my addr 10.20.193.4:0/1548526896 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:14.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f0048992640 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afecace180 0x55afecaa5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f0043fff640 1 -- 10.20.193.4:0/1548526896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 msgr2=0x55afecaa0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f0043fff640 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecaa0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f0043fff640 1 -- 10.20.193.4:0/1548526896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afecace180 msgr2=0x55afecaa5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.336+0000 7f0043fff640 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afecace180 0x55afecaa5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f0043fff640 1 -- 10.20.193.4:0/1548526896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afec9393d0 con 0x55afeca88bd0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f0043fff640 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca88bd0 0x55afecaa0a00 secure :-1 s=READY pgs=733 gs=3 cs=0 l=1 c_cookie=16555125693412969627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00300098a0 tx=0x7f003002f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bf9f1af7d28c9b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f0005ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f0005ffb640 1 -- 10.20.193.4:0/1548526896 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0030038d50 con 0x55afeca88bd0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f004c416e00 1 -- 10.20.193.4:0/1548526896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0038005550 con 0x55afeca88bd0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f0005ffb640 1 -- 10.20.193.4:0/1548526896 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f003004a070 con 0x55afeca88bd0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f0005ffb640 1 -- 10.20.193.4:0/1548526896 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0030043400 con 0x55afeca88bd0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f004c416e00 10 client.16461 _ll_register_callbacks cb 0x55afec90ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f004c416e00 1 -- 10.20.193.4:0/1548526896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55afec61beb0 con 0x55afeca88bd0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f0005ffb640 1 -- 10.20.193.4:0/1548526896 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0030043590 con 0x55afeca88bd0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f0005ffb640 1 -- 10.20.193.4:0/1548526896 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0030043790 con 0x55afeca88bd0 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f004c416e00 10 client.16461 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:14.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.337+0000 7f004c416e00 1 -- 10.20.193.4:0/1548526896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55afec9115c0 con 0x55afeca88bd0 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.338+0000 7f0005ffb640 1 -- 10.20.193.4:0/1548526896 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0030043930 con 0x55afeca88bd0 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.338+0000 7f004c416e00 10 client.16461 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.338+0000 7f004c416e00 10 client.16461 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.338+0000 7f004c416e00 20 client.16461 populate_metadata read hostname 'trial004' 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.338+0000 7f004c416e00 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55afecacb250 0x55afecacb6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.338+0000 7f004c416e00 4 client.16461 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.338+0000 7f004c416e00 1 -- 10.20.193.4:0/1548526896 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afec99ef00 con 0x55afecacb250 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.338+0000 7f00437fe640 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55afecacb250 0x55afecacb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.338+0000 7f00437fe640 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55afecacb250 0x55afecacb6f0 crc :-1 s=READY pgs=91 gs=4 cs=0 l=0 c_cookie=14743036476939605921 s_cookie=12252847219501783425 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc99c990569c97a1 server_cookie=aa0adba0b5895981 in_seq=0 out_seq=0 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.338+0000 7f0005ffb640 10 client.16461 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f0005ffb640 1 -- 10.20.193.4:0/1548526896 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55afec99ef00 con 0x55afecacb250 2026-02-24T09:13:14.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f0005ffb640 10 client.16461 handle_command_reply: tid=0 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 client.16461 shutdown 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 -- 10.20.193.4:0/1548526896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca88bd0 msgr2=0x55afecaa0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca88bd0 0x55afecaa0a00 secure :-1 s=READY pgs=733 gs=3 cs=0 l=1 c_cookie=16555125693412969627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00300098a0 tx=0x7f003002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 -- 10.20.193.4:0/1548526896 shutdown_connections 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55afecacb250 0x55afecacb6f0 crc :-1 s=READY pgs=91 gs=4 cs=0 l=0 c_cookie=14743036476939605921 s_cookie=12252847219501783425 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afecace180 0x55afecaa5f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecaa0f40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 --2- 10.20.193.4:0/1548526896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca88bd0 0x55afecaa0a00 unknown :-1 s=CLOSED pgs=733 gs=3 cs=0 l=1 c_cookie=16555125693412969627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f0005ffb640 0 client.16461 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 -- 10.20.193.4:0/1548526896 >> 10.20.193.4:0/1548526896 conn(0x55afec9a6880 msgr2=0x55afeca87bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 -- 10.20.193.4:0/1548526896 shutdown_connections 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 1 -- 10.20.193.4:0/1548526896 wait complete. 2026-02-24T09:13:14.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.339+0000 7f004c416e00 20 client.16461 trim_cache size 0 max 16384 2026-02-24T09:13:14.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f004c416e00 1 Processor -- start 2026-02-24T09:13:14.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f004c416e00 1 -- start start 2026-02-24T09:13:14.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f004c416e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afecaa5400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f004c416e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca894e0 0x55afeca87dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f004c416e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afecacb250 0x55afeca88300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f004c416e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55afec98b9e0 con 0x55afeca894e0 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f004c416e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55afec643ec0 con 0x55afeca88bd0 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f004c416e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55afec9f7580 con 0x55afecacb250 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f00437fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca894e0 0x55afeca87dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f00437fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca894e0 0x55afeca87dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:35950/0 (socket says 10.20.193.4:35950) 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f00437fe640 1 -- 10.20.193.4:0/1667575370 learned_addr learned my addr 10.20.193.4:0/1667575370 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f00437fe640 1 -- 10.20.193.4:0/1667575370 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afecacb250 msgr2=0x55afeca88300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f00437fe640 1 --2- 10.20.193.4:0/1667575370 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afecacb250 0x55afeca88300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f00437fe640 1 -- 10.20.193.4:0/1667575370 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 msgr2=0x55afecaa5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f00437fe640 1 --2- 10.20.193.4:0/1667575370 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afecaa5400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f00437fe640 1 -- 10.20.193.4:0/1667575370 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afec923500 con 0x55afeca894e0 2026-02-24T09:13:14.356 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f00437fe640 1 --2- 10.20.193.4:0/1667575370 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca894e0 0x55afeca87dc0 secure :-1 s=READY pgs=734 gs=1 cs=0 l=1 c_cookie=5628484468551164575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00340ad1b0 tx=0x7f00340d2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1c64cd9bcba29f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f0007fff640 1 -- 10.20.193.4:0/1667575370 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00340b2ef0 con 0x55afeca894e0 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f0007fff640 1 -- 10.20.193.4:0/1667575370 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00340d0e90 con 0x55afeca894e0 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.350+0000 7f0007fff640 1 -- 10.20.193.4:0/1667575370 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00340ade60 con 0x55afeca894e0 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.351+0000 7f004c416e00 1 -- 10.20.193.4:0/1667575370 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca894e0 msgr2=0x55afeca87dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.351+0000 7f004c416e00 1 --2- 10.20.193.4:0/1667575370 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca894e0 0x55afeca87dc0 secure :-1 s=READY pgs=734 gs=1 cs=0 l=1 c_cookie=5628484468551164575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00340ad1b0 tx=0x7f00340d2040 comp rx=0 tx=0).stop 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.351+0000 7f004c416e00 1 -- 10.20.193.4:0/1667575370 shutdown_connections 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.351+0000 7f004c416e00 1 --2- 10.20.193.4:0/1667575370 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afecacb250 0x55afeca88300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.351+0000 7f004c416e00 1 --2- 10.20.193.4:0/1667575370 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afeca894e0 0x55afeca87dc0 unknown :-1 s=CLOSED pgs=734 gs=1 cs=0 l=1 c_cookie=5628484468551164575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.351+0000 7f004c416e00 1 --2- 10.20.193.4:0/1667575370 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afecaa5400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.351+0000 7f004c416e00 1 -- 10.20.193.4:0/1667575370 >> 10.20.193.4:0/1667575370 conn(0x55afec9a6880 msgr2=0x55afecaa4450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.351+0000 7f004c416e00 1 -- 10.20.193.4:0/1667575370 shutdown_connections 2026-02-24T09:13:14.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.351+0000 7f004c416e00 1 -- 10.20.193.4:0/1667575370 wait complete. 2026-02-24T09:13:14.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.352+0000 7f004c416e00 1 -- start start 2026-02-24T09:13:14.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.352+0000 7f004c416e00 1 Processor -- start 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.352+0000 7f004c416e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afecaa8400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.352+0000 7f004c416e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecaa8940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.352+0000 7f004c416e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecacb250 0x55afecb7ac00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.352+0000 7f004c416e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55afeca63f20 con 0x55afecacb250 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.352+0000 7f004c416e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55afecaa6040 con 0x55afeca88bd0 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.352+0000 7f004c416e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55afecaa68e0 con 0x55afeca894e0 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0048992640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecacb250 0x55afecb7ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0048992640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecacb250 0x55afecb7ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:35964/0 (socket says 10.20.193.4:35964) 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0048992640 1 -- 10.20.193.4:0/3053062912 learned_addr learned my addr 10.20.193.4:0/3053062912 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f00437fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecaa8940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0043fff640 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afecaa8400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0048992640 1 -- 10.20.193.4:0/3053062912 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 msgr2=0x55afecaa8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0048992640 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecaa8940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0048992640 1 -- 10.20.193.4:0/3053062912 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 msgr2=0x55afecaa8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0048992640 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afecaa8400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0048992640 1 -- 10.20.193.4:0/3053062912 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afec91df80 con 0x55afecacb250 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0048992640 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecacb250 0x55afecb7ac00 secure :-1 s=READY pgs=735 gs=1 cs=0 l=1 c_cookie=13656254680749103298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0038011830 tx=0x7f0038011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd84c3473850d8c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0005ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0005ffb640 1 -- 10.20.193.4:0/3053062912 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00380109d0 con 0x55afecacb250 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0005ffb640 1 -- 10.20.193.4:0/3053062912 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00380057c0 con 0x55afecacb250 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0005ffb640 1 -- 10.20.193.4:0/3053062912 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0038006460 con 0x55afecacb250 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f004c416e00 1 -- 10.20.193.4:0/3053062912 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00441647a0 con 0x55afecacb250 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0005ffb640 1 -- 10.20.193.4:0/3053062912 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f00380065f0 con 0x55afecacb250 2026-02-24T09:13:14.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0005ffb640 10 client.16467 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f004c416e00 10 client.16467 _ll_register_callbacks cb 0x55afec90ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f004c416e00 1 -- 10.20.193.4:0/3053062912 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55afec619700 con 0x55afecacb250 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f0005ffb640 1 -- 10.20.193.4:0/3053062912 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0038010b30 con 0x55afecacb250 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f004c416e00 10 client.16467 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.353+0000 7f004c416e00 1 -- 10.20.193.4:0/3053062912 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55afec9118f0 con 0x55afecacb250 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.354+0000 7f0005ffb640 1 -- 10.20.193.4:0/3053062912 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0038026070 con 0x55afecacb250 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.354+0000 7f004c416e00 10 client.16467 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.354+0000 7f004c416e00 10 client.16467 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.354+0000 7f004c416e00 20 client.16467 populate_metadata read hostname 'trial004' 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.354+0000 7f004c416e00 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55afecace180 0x55afecb9cab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.354+0000 7f004c416e00 4 client.16467 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.2, "await_for": 45.0}] 2026-02-24T09:13:14.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.354+0000 7f004c416e00 1 -- 10.20.193.4:0/3053062912 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.2, "await_for": 45.0}) -- 0x55afec9a0b70 con 0x55afecace180 2026-02-24T09:13:14.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.354+0000 7f0043fff640 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55afecace180 0x55afecb9cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:14.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.354+0000 7f0005ffb640 10 client.16467 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:14.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.354+0000 7f0043fff640 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55afecace180 0x55afecb9cab0 crc :-1 s=READY pgs=92 gs=4 cs=0 l=0 c_cookie=11253543386114514969 s_cookie=2439361450055430859 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c2c9e15f9cd6019 server_cookie=21da5a508555f2cb in_seq=0 out_seq=0 2026-02-24T09:13:14.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f0005ffb640 1 -- 10.20.193.4:0/3053062912 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55afec9a0b70 con 0x55afecace180 2026-02-24T09:13:14.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f0005ffb640 10 client.16467 handle_command_reply: tid=0 2026-02-24T09:13:14.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 client.16467 shutdown 2026-02-24T09:13:14.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 -- 10.20.193.4:0/3053062912 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecacb250 msgr2=0x55afecb7ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:14.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecacb250 0x55afecb7ac00 secure :-1 s=READY pgs=735 gs=1 cs=0 l=1 c_cookie=13656254680749103298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0038011830 tx=0x7f0038011860 comp rx=0 tx=0).stop 2026-02-24T09:13:14.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 -- 10.20.193.4:0/3053062912 shutdown_connections 2026-02-24T09:13:14.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55afecace180 0x55afecb9cab0 crc :-1 s=READY pgs=92 gs=4 cs=0 l=0 c_cookie=11253543386114514969 s_cookie=2439361450055430859 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55afecacb250 0x55afecb7ac00 unknown :-1 s=CLOSED pgs=735 gs=1 cs=0 l=1 c_cookie=13656254680749103298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55afeca894e0 0x55afecaa8940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f0005ffb640 0 client.16467 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:14.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 --2- 10.20.193.4:0/3053062912 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55afeca88bd0 0x55afecaa8400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 -- 10.20.193.4:0/3053062912 >> 10.20.193.4:0/3053062912 conn(0x55afec9a6880 msgr2=0x55afeca86db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:14.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 -- 10.20.193.4:0/3053062912 shutdown_connections 2026-02-24T09:13:14.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 1 -- 10.20.193.4:0/3053062912 wait complete. 2026-02-24T09:13:14.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004c416e00 20 client.16467 trim_cache size 0 max 16384 2026-02-24T09:13:14.375 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:13:14.375 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:13:14.375 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:13:14.375 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 14, 2026-02-24T09:13:14.375 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:13:14.375 INFO:teuthology.orchestra.run.trial004.stdout: "563dc6c3": { 2026-02-24T09:13:14.375 INFO:teuthology.orchestra.run.trial004.stdout: "version": 14, 2026-02-24T09:13:14.375 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:13:14.375 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 140.2, 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:13:14.376 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:14.377 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:14.377 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:14.377 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:14.377 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:14.377 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:13:14.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004a41c640 1 -- 10.20.193.4:0/2072015039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00180b56e0 msgr2=0x7f00180d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:14.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004a41c640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00180b56e0 0x7f00180d5b90 secure :-1 s=READY pgs=336 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00300023d0 tx=0x7f0030031040 comp rx=0 tx=0).stop 2026-02-24T09:13:14.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004a41c640 1 -- 10.20.193.4:0/2072015039 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f004410fc70 msgr2=0x7f004411e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:14.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.369+0000 7f004a41c640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f004410fc70 0x7f004411e0a0 secure :-1 s=READY pgs=731 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f003400d950 tx=0x7f003400de20 comp rx=0 tx=0).stop 2026-02-24T09:13:14.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.370+0000 7f004a41c640 1 -- 10.20.193.4:0/2072015039 shutdown_connections 2026-02-24T09:13:14.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.370+0000 7f004a41c640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00180b56e0 0x7f00180d5b90 unknown :-1 s=CLOSED pgs=336 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.370+0000 7f004a41c640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0044115470 0x7f0044123470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.370+0000 7f004a41c640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f004410fc70 0x7f004411e0a0 unknown :-1 s=CLOSED pgs=731 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.370+0000 7f004a41c640 1 --2- 10.20.193.4:0/2072015039 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f004410f280 0x7f004411db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:14.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.370+0000 7f004a41c640 1 -- 10.20.193.4:0/2072015039 >> 10.20.193.4:0/2072015039 conn(0x7f004405f830 msgr2=0x7f004410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:14.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.370+0000 7f004a41c640 1 -- 10.20.193.4:0/2072015039 shutdown_connections 2026-02-24T09:13:14.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:14.370+0000 7f004a41c640 1 -- 10.20.193.4:0/2072015039 wait complete. 2026-02-24T09:13:14.410 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '563dc6c3', quiesce took 1.0 seconds. Will release after: 19.2 2026-02-24T09:13:15.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:14 trial004 ceph-mon[41596]: pgmap v255: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 851 MiB/s wr, 232 op/s 2026-02-24T09:13:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:14 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1937532579' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:15.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:14 trial090 ceph-mon[47278]: pgmap v255: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 851 MiB/s wr, 232 op/s 2026-02-24T09:13:15.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:14 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1937532579' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:15.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:14 trial014 ceph-mon[46941]: pgmap v255: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 851 MiB/s wr, 232 op/s 2026-02-24T09:13:15.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:14 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1937532579' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:16 trial004 ceph-mon[41596]: pgmap v256: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 889 MiB/s wr, 245 op/s 2026-02-24T09:13:17.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:16 trial090 ceph-mon[47278]: pgmap v256: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 889 MiB/s wr, 245 op/s 2026-02-24T09:13:17.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:16 trial014 ceph-mon[46941]: pgmap v256: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 889 MiB/s wr, 245 op/s 2026-02-24T09:13:17.512 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:13:17.669 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:17.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.831+0000 7f3c42662640 1 -- 10.20.193.4:0/2206386981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3c3c10bec0 msgr2=0x7f3c3c10c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:17.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.831+0000 7f3c42662640 1 --2- 10.20.193.4:0/2206386981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3c3c10bec0 0x7f3c3c10c290 secure :-1 s=READY pgs=736 gs=1 cs=0 l=1 c_cookie=17566886410271185632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c20009950 tx=0x7f3c2002f190 comp rx=0 tx=0).stop 2026-02-24T09:13:17.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.831+0000 7f3c42662640 1 -- 10.20.193.4:0/2206386981 shutdown_connections 2026-02-24T09:13:17.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.831+0000 7f3c42662640 1 --2- 10.20.193.4:0/2206386981 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c3c155bf0 0x7f3c3c175fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.831+0000 7f3c42662640 1 --2- 10.20.193.4:0/2206386981 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3c3c10c7d0 0x7f3c3c1556b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.831+0000 7f3c42662640 1 --2- 10.20.193.4:0/2206386981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3c3c10bec0 0x7f3c3c10c290 unknown :-1 s=CLOSED pgs=736 gs=1 cs=0 l=1 c_cookie=17566886410271185632 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.831+0000 7f3c42662640 1 -- 10.20.193.4:0/2206386981 >> 10.20.193.4:0/2206386981 conn(0x7f3c3c0e9b80 msgr2=0x7f3c3c109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:17.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.831+0000 7f3c42662640 1 -- 10.20.193.4:0/2206386981 shutdown_connections 2026-02-24T09:13:17.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.831+0000 7f3c42662640 1 -- 10.20.193.4:0/2206386981 wait complete. 2026-02-24T09:13:17.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c42662640 1 Processor -- start 2026-02-24T09:13:17.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c42662640 1 -- start start 2026-02-24T09:13:17.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c42662640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3c3c10bec0 0x7f3c3c160860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c42662640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c3c10c7d0 0x7f3c3c160da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c42662640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3c3c155bf0 0x7f3c3c166170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c42662640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c166700 con 0x7f3c3c10bec0 2026-02-24T09:13:17.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c42662640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c166870 con 0x7f3c3c155bf0 2026-02-24T09:13:17.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c42662640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c166a30 con 0x7f3c3c10c7d0 2026-02-24T09:13:17.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3c3c10bec0 0x7f3c3c160860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3c3c10bec0 0x7f3c3c160860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:35986/0 (socket says 10.20.193.4:35986) 2026-02-24T09:13:17.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3bfff640 1 -- 10.20.193.4:0/283037762 learned_addr learned my addr 10.20.193.4:0/283037762 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:17.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c40bd8640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3c3c155bf0 0x7f3c3c166170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c3c10c7d0 0x7f3c3c160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3bfff640 1 -- 10.20.193.4:0/283037762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c3c10c7d0 msgr2=0x7f3c3c160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:17.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3bfff640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c3c10c7d0 0x7f3c3c160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3bfff640 1 -- 10.20.193.4:0/283037762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3c3c155bf0 msgr2=0x7f3c3c166170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:17.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3bfff640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3c3c155bf0 0x7f3c3c166170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3bfff640 1 -- 10.20.193.4:0/283037762 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c20009570 con 0x7f3c3c10bec0 2026-02-24T09:13:17.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c3c10c7d0 0x7f3c3c160da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:17.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c3bfff640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3c3c10bec0 0x7f3c3c160860 secure :-1 s=READY pgs=737 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c20038820 tx=0x7f3c200043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:17.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c397fa640 1 -- 10.20.193.4:0/283037762 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c2003d070 con 0x7f3c3c10bec0 2026-02-24T09:13:17.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c397fa640 1 -- 10.20.193.4:0/283037762 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3c20038920 con 0x7f3c3c10bec0 2026-02-24T09:13:17.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c42662640 1 -- 10.20.193.4:0/283037762 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3c166cb0 con 0x7f3c3c10bec0 2026-02-24T09:13:17.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c397fa640 1 -- 10.20.193.4:0/283037762 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c20041960 con 0x7f3c3c10bec0 2026-02-24T09:13:17.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.832+0000 7f3c42662640 1 -- 10.20.193.4:0/283037762 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c3c152680 con 0x7f3c3c10bec0 2026-02-24T09:13:17.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.835+0000 7f3c397fa640 1 -- 10.20.193.4:0/283037762 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f3c20038a90 con 0x7f3c3c10bec0 2026-02-24T09:13:17.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.836+0000 7f3c397fa640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3c140b5760 0x7f3c140d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.836+0000 7f3c397fa640 1 -- 10.20.193.4:0/283037762 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3c2010b2a0 con 0x7f3c3c10bec0 2026-02-24T09:13:17.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.836+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3c140b5760 0x7f3c140d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.836+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3c140b5760 0x7f3c140d5c10 secure :-1 s=READY pgs=337 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c28005fd0 tx=0x7f3c28005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:17.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c4465ce00 1 Processor -- start 2026-02-24T09:13:17.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c4465ce00 1 -- start start 2026-02-24T09:13:17.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf7820 0x562540bf7bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c3c890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540c3cdd0 0x562540c5d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562540b07de0 con 0x562540bf8130 2026-02-24T09:13:17.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562540b03b10 con 0x562540bf7820 2026-02-24T09:13:17.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562540afdab0 con 0x562540c3cdd0 2026-02-24T09:13:17.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c3c890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c3c890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36000/0 (socket says 10.20.193.4:36000) 2026-02-24T09:13:17.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/372589603 learned_addr learned my addr 10.20.193.4:0/372589603 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:17.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c40bd8640 1 --2- 10.20.193.4:0/372589603 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540c3cdd0 0x562540c5d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3bfff640 1 --2- 10.20.193.4:0/372589603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf7820 0x562540bf7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/372589603 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540c3cdd0 msgr2=0x562540c5d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/372589603 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540c3cdd0 0x562540c5d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/372589603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf7820 msgr2=0x562540bf7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/372589603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf7820 0x562540bf7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/372589603 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562540aa9310 con 0x562540bf8130 2026-02-24T09:13:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3bfff640 1 --2- 10.20.193.4:0/372589603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf7820 0x562540bf7bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.838+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/372589603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c3c890 secure :-1 s=READY pgs=738 gs=1 cs=0 l=1 c_cookie=1927006093216306087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c28007320 tx=0x7f3c28018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abe19d5022bd3a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c2cce3640 1 -- 10.20.193.4:0/372589603 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c28024070 con 0x562540bf8130 2026-02-24T09:13:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c2cce3640 1 -- 10.20.193.4:0/372589603 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3c28002b50 con 0x562540bf8130 2026-02-24T09:13:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c2cce3640 1 -- 10.20.193.4:0/372589603 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c2801d6b0 con 0x562540bf8130 2026-02-24T09:13:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c4465ce00 1 -- 10.20.193.4:0/372589603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 msgr2=0x562540c3c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/372589603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c3c890 secure :-1 s=READY pgs=738 gs=1 cs=0 l=1 c_cookie=1927006093216306087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c28007320 tx=0x7f3c28018000 comp rx=0 tx=0).stop 2026-02-24T09:13:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c4465ce00 1 -- 10.20.193.4:0/372589603 shutdown_connections 2026-02-24T09:13:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/372589603 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540c3cdd0 0x562540c5d1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/372589603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c3c890 unknown :-1 s=CLOSED pgs=738 gs=1 cs=0 l=1 c_cookie=1927006093216306087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/372589603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf7820 0x562540bf7bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c4465ce00 1 -- 10.20.193.4:0/372589603 >> 10.20.193.4:0/372589603 conn(0x562540b166b0 msgr2=0x562540bf6100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c4465ce00 1 -- 10.20.193.4:0/372589603 shutdown_connections 2026-02-24T09:13:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.839+0000 7f3c4465ce00 1 -- 10.20.193.4:0/372589603 wait complete. 2026-02-24T09:13:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c4465ce00 1 -- start start 2026-02-24T09:13:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c4465ce00 1 Processor -- start 2026-02-24T09:13:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf7820 0x562540c0fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c10330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540c3cdd0 0x562540c15320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562540c15860 con 0x562540bf8130 2026-02-24T09:13:17.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562540c159d0 con 0x562540c3cdd0 2026-02-24T09:13:17.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562540c15b90 con 0x562540bf7820 2026-02-24T09:13:17.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c3b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c10330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c3b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c10330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36004/0 (socket says 10.20.193.4:36004) 2026-02-24T09:13:17.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/3767799901 learned_addr learned my addr 10.20.193.4:0/3767799901 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:17.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.840+0000 7f3c3bfff640 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf7820 0x562540c0fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/3767799901 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf7820 msgr2=0x562540c0fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:17.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf7820 0x562540c0fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/3767799901 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540c3cdd0 msgr2=0x562540c15320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:17.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540c3cdd0 0x562540c15320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/3767799901 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562540a818c0 con 0x562540bf8130 2026-02-24T09:13:17.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c10330 secure :-1 s=READY pgs=739 gs=1 cs=0 l=1 c_cookie=13934139493466476294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c28007680 tx=0x7f3c28005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c160020b06cf8f06 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:17.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3bfdffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:17.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3bfdffb640 1 -- 10.20.193.4:0/3767799901 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c28024050 con 0x562540bf8130 2026-02-24T09:13:17.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3bfdffb640 1 -- 10.20.193.4:0/3767799901 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3c2801b440 con 0x562540bf8130 2026-02-24T09:13:17.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 1 -- 10.20.193.4:0/3767799901 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c280041b0 con 0x562540bf8130 2026-02-24T09:13:17.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3bfdffb640 1 -- 10.20.193.4:0/3767799901 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c28029670 con 0x562540bf8130 2026-02-24T09:13:17.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 10 client.16479 _ll_register_callbacks cb 0x562540a99160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:17.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 1 -- 10.20.193.4:0/3767799901 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56254084d4a0 con 0x562540bf8130 2026-02-24T09:13:17.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3bfdffb640 1 -- 10.20.193.4:0/3767799901 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3c28029800 con 0x562540bf8130 2026-02-24T09:13:17.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3bfdffb640 1 -- 10.20.193.4:0/3767799901 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3c28029a00 con 0x562540bf8130 2026-02-24T09:13:17.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 10 client.16479 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:17.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 1 -- 10.20.193.4:0/3767799901 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562540a936e0 con 0x562540bf8130 2026-02-24T09:13:17.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3bfdffb640 1 -- 10.20.193.4:0/3767799901 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f3c28029c20 con 0x562540bf8130 2026-02-24T09:13:17.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 10 client.16479 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:17.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 10 client.16479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:17.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 20 client.16479 populate_metadata read hostname 'trial004' 2026-02-24T09:13:17.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562540c3a700 0x562540c3aba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 4 client.16479 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:17.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.841+0000 7f3c4465ce00 1 -- 10.20.193.4:0/3767799901 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562540af34f0 con 0x562540c3a700 2026-02-24T09:13:17.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.842+0000 7f3c3bfff640 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562540c3a700 0x562540c3aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.842+0000 7f3c3bfff640 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562540c3a700 0x562540c3aba0 crc :-1 s=READY pgs=93 gs=4 cs=0 l=0 c_cookie=421840398895089947 s_cookie=14489423566901214501 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5daad9b980d091b server_cookie=c914c5f74151fd25 in_seq=0 out_seq=0 2026-02-24T09:13:17.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.842+0000 7f3bfdffb640 10 client.16479 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:17.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3bfdffb640 1 -- 10.20.193.4:0/3767799901 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562540af34f0 con 0x562540c3a700 2026-02-24T09:13:17.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3bfdffb640 10 client.16479 handle_command_reply: tid=0 2026-02-24T09:13:17.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 client.16479 shutdown 2026-02-24T09:13:17.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 -- 10.20.193.4:0/3767799901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 msgr2=0x562540c10330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:17.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c10330 secure :-1 s=READY pgs=739 gs=1 cs=0 l=1 c_cookie=13934139493466476294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c28007680 tx=0x7f3c28005730 comp rx=0 tx=0).stop 2026-02-24T09:13:17.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 -- 10.20.193.4:0/3767799901 shutdown_connections 2026-02-24T09:13:17.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562540c3a700 0x562540c3aba0 crc :-1 s=READY pgs=93 gs=4 cs=0 l=0 c_cookie=421840398895089947 s_cookie=14489423566901214501 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540c3cdd0 0x562540c15320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540bf8130 0x562540c10330 unknown :-1 s=CLOSED pgs=739 gs=1 cs=0 l=1 c_cookie=13934139493466476294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/3767799901 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf7820 0x562540c0fdf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3bfdffb640 0 client.16479 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:17.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 -- 10.20.193.4:0/3767799901 >> 10.20.193.4:0/3767799901 conn(0x562540b166b0 msgr2=0x562540bf6810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:17.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 -- 10.20.193.4:0/3767799901 shutdown_connections 2026-02-24T09:13:17.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 1 -- 10.20.193.4:0/3767799901 wait complete. 2026-02-24T09:13:17.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.843+0000 7f3c4465ce00 20 client.16479 trim_cache size 0 max 16384 2026-02-24T09:13:17.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.855+0000 7f3c4465ce00 1 Processor -- start 2026-02-24T09:13:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.855+0000 7f3c4465ce00 1 -- start start 2026-02-24T09:13:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.855+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf7820 0x562540bf6c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.855+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf8130 0x562540c0d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.855+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c0d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.855+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562540afb6e0 con 0x562540c3cdd0 2026-02-24T09:13:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.855+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5625407c6f50 con 0x562540bf8130 2026-02-24T09:13:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.855+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562540b6a150 con 0x562540bf7820 2026-02-24T09:13:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.856+0000 7f3c3b7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf8130 0x562540c0d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.856+0000 7f3c40bd8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c0d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.856+0000 7f3c40bd8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c0d700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36010/0 (socket says 10.20.193.4:36010) 2026-02-24T09:13:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.856+0000 7f3c40bd8640 1 -- 10.20.193.4:0/670187150 learned_addr learned my addr 10.20.193.4:0/670187150 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.856+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/670187150 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf7820 msgr2=0x562540bf6c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:13:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.856+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/670187150 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf7820 0x562540bf6c20 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.856+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/670187150 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 msgr2=0x562540c0d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.856+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/670187150 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c0d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.856+0000 7f3c3b7fe640 1 -- 10.20.193.4:0/670187150 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562540a8e160 con 0x562540bf8130 2026-02-24T09:13:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.857+0000 7f3c3b7fe640 1 --2- 10.20.193.4:0/670187150 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf8130 0x562540c0d1c0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=10050512597175019119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c28028b20 tx=0x7f3c28038000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b7a97f50d34a66f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.857+0000 7f3bfffff640 1 -- 10.20.193.4:0/670187150 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c28024070 con 0x562540bf8130 2026-02-24T09:13:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.857+0000 7f3bfffff640 1 -- 10.20.193.4:0/670187150 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x56254084d4a0 con 0x562540bf8130 2026-02-24T09:13:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.857+0000 7f3bfffff640 1 -- 10.20.193.4:0/670187150 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c280283c0 con 0x562540bf8130 2026-02-24T09:13:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 -- 10.20.193.4:0/670187150 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf8130 msgr2=0x562540c0d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/670187150 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf8130 0x562540c0d1c0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=10050512597175019119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c28028b20 tx=0x7f3c28038000 comp rx=0 tx=0).stop 2026-02-24T09:13:17.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 -- 10.20.193.4:0/670187150 shutdown_connections 2026-02-24T09:13:17.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/670187150 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c0d700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/670187150 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf8130 0x562540c0d1c0 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=10050512597175019119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/670187150 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf7820 0x562540bf6c20 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 -- 10.20.193.4:0/670187150 >> 10.20.193.4:0/670187150 conn(0x562540b166b0 msgr2=0x562540c3b260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:17.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 -- 10.20.193.4:0/670187150 shutdown_connections 2026-02-24T09:13:17.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 -- 10.20.193.4:0/670187150 wait complete. 2026-02-24T09:13:17.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 -- start start 2026-02-24T09:13:17.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 Processor -- start 2026-02-24T09:13:17.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf7820 0x562540c180b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf8130 0x562540c185f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c1b4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562540c10460 con 0x562540c3cdd0 2026-02-24T09:13:17.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562540c10e90 con 0x562540bf7820 2026-02-24T09:13:17.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c4465ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562540c15cd0 con 0x562540bf8130 2026-02-24T09:13:17.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.858+0000 7f3c40bd8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c1b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c40bd8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c1b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36014/0 (socket says 10.20.193.4:36014) 2026-02-24T09:13:17.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c40bd8640 1 -- 10.20.193.4:0/2612597755 learned_addr learned my addr 10.20.193.4:0/2612597755 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:17.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c40bd8640 1 -- 10.20.193.4:0/2612597755 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf8130 msgr2=0x562540c185f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:17.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c40bd8640 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf8130 0x562540c185f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c40bd8640 1 -- 10.20.193.4:0/2612597755 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf7820 msgr2=0x562540c180b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:17.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c40bd8640 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf7820 0x562540c180b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c40bd8640 1 -- 10.20.193.4:0/2612597755 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562540a81bf0 con 0x562540c3cdd0 2026-02-24T09:13:17.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c40bd8640 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c1b4d0 secure :-1 s=READY pgs=740 gs=1 cs=0 l=1 c_cookie=6958150037028634006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c30003cd0 tx=0x7f3c30013820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60905097c2f67d96 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:17.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3bfdffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:17.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3bfdffb640 1 -- 10.20.193.4:0/2612597755 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c30018070 con 0x562540c3cdd0 2026-02-24T09:13:17.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 1 -- 10.20.193.4:0/2612597755 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c28028e90 con 0x562540c3cdd0 2026-02-24T09:13:17.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3bfdffb640 1 -- 10.20.193.4:0/2612597755 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3c30003e90 con 0x562540c3cdd0 2026-02-24T09:13:17.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3bfdffb640 1 -- 10.20.193.4:0/2612597755 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c30012a40 con 0x562540c3cdd0 2026-02-24T09:13:17.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 10 client.16485 _ll_register_callbacks cb 0x562540a99160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:17.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 1 -- 10.20.193.4:0/2612597755 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562540788f40 con 0x562540c3cdd0 2026-02-24T09:13:17.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3bfdffb640 1 -- 10.20.193.4:0/2612597755 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3c30012bd0 con 0x562540c3cdd0 2026-02-24T09:13:17.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3bfdffb640 1 -- 10.20.193.4:0/2612597755 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3c30012dd0 con 0x562540c3cdd0 2026-02-24T09:13:17.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 10 client.16485 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:17.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 1 -- 10.20.193.4:0/2612597755 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562540a93940 con 0x562540c3cdd0 2026-02-24T09:13:17.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3bfdffb640 1 -- 10.20.193.4:0/2612597755 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f3c30005cf0 con 0x562540c3cdd0 2026-02-24T09:13:17.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 10 client.16485 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:17.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:17.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 20 client.16485 populate_metadata read hostname 'trial004' 2026-02-24T09:13:17.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562540ceac70 0x562540d0b0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:17.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 4 client.16485 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:13:17.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.859+0000 7f3c4465ce00 1 -- 10.20.193.4:0/2612597755 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3c28002b50 con 0x562540ceac70 2026-02-24T09:13:17.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3c3bfff640 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562540ceac70 0x562540d0b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:17.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3c3bfff640 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562540ceac70 0x562540d0b0f0 crc :-1 s=READY pgs=94 gs=4 cs=0 l=0 c_cookie=13975340305427516463 s_cookie=9706737490502038983 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1f261f69834cc2f server_cookie=86b54251b15735c7 in_seq=0 out_seq=0 2026-02-24T09:13:17.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3bfdffb640 10 client.16485 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:17.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3bfdffb640 1 -- 10.20.193.4:0/2612597755 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x7f3c28002b50 con 0x562540ceac70 2026-02-24T09:13:17.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3bfdffb640 10 client.16485 handle_command_reply: tid=0 2026-02-24T09:13:17.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3c4465ce00 1 client.16485 shutdown 2026-02-24T09:13:17.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3c4465ce00 1 -- 10.20.193.4:0/2612597755 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 msgr2=0x562540c1b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:17.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c1b4d0 secure :-1 s=READY pgs=740 gs=1 cs=0 l=1 c_cookie=6958150037028634006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c30003cd0 tx=0x7f3c30013820 comp rx=0 tx=0).stop 2026-02-24T09:13:17.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3c4465ce00 1 -- 10.20.193.4:0/2612597755 shutdown_connections 2026-02-24T09:13:17.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562540ceac70 0x562540d0b0f0 crc :-1 s=READY pgs=94 gs=4 cs=0 l=0 c_cookie=13975340305427516463 s_cookie=9706737490502038983 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562540c3cdd0 0x562540c1b4d0 unknown :-1 s=CLOSED pgs=740 gs=1 cs=0 l=1 c_cookie=6958150037028634006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.860+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562540bf8130 0x562540c185f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3bfdffb640 0 client.16485 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c4465ce00 1 --2- 10.20.193.4:0/2612597755 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562540bf7820 0x562540c180b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c4465ce00 1 -- 10.20.193.4:0/2612597755 >> 10.20.193.4:0/2612597755 conn(0x562540b166b0 msgr2=0x562540c3ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c4465ce00 1 -- 10.20.193.4:0/2612597755 shutdown_connections 2026-02-24T09:13:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c4465ce00 1 -- 10.20.193.4:0/2612597755 wait complete. 2026-02-24T09:13:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c4465ce00 20 client.16485 trim_cache size 0 max 16384 2026-02-24T09:13:17.888 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:13:17.889 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:13:17.889 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:13:17.889 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:13:17.889 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:13:17.889 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:13:17.889 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:17.889 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:17.889 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:17.889 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:17.890 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:17.890 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:17.890 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:13:17.890 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:13:17.890 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:17.890 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:17.890 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:17.890 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:17.890 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:17.890 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:17.891 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:13:17.891 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:13:17.891 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:17.891 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:17.891 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:17.891 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:17.891 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:17.891 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:17.891 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:13:17.891 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:17.892 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:17.893 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:13:17.894 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:13:17.894 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:17.894 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:17.894 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:17.894 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:17.894 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:17.894 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:17.894 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:17.894 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:13:17.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 -- 10.20.193.4:0/283037762 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3c140b5760 msgr2=0x7f3c140d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:17.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3c140b5760 0x7f3c140d5c10 secure :-1 s=READY pgs=337 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c28005fd0 tx=0x7f3c28005e40 comp rx=0 tx=0).stop 2026-02-24T09:13:17.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 -- 10.20.193.4:0/283037762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3c3c10bec0 msgr2=0x7f3c3c160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:17.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3c3c10bec0 0x7f3c3c160860 secure :-1 s=READY pgs=737 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c20038820 tx=0x7f3c200043d0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 -- 10.20.193.4:0/283037762 shutdown_connections 2026-02-24T09:13:17.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3c140b5760 0x7f3c140d5c10 unknown :-1 s=CLOSED pgs=337 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3c3c155bf0 0x7f3c3c166170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c3c10c7d0 0x7f3c3c160da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 --2- 10.20.193.4:0/283037762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3c3c10bec0 0x7f3c3c160860 unknown :-1 s=CLOSED pgs=737 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:17.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 -- 10.20.193.4:0/283037762 >> 10.20.193.4:0/283037762 conn(0x7f3c3c0e9b80 msgr2=0x7f3c3c109f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:17.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 -- 10.20.193.4:0/283037762 shutdown_connections 2026-02-24T09:13:17.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:17.861+0000 7f3c42662640 1 -- 10.20.193.4:0/283037762 wait complete. 2026-02-24T09:13:17.943 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:13:17.943 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:13:18.101 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:18.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 -- 10.20.193.4:0/4061967231 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b6010d010 msgr2=0x7f3b6010d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 --2- 10.20.193.4:0/4061967231 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b6010d010 0x7f3b6010d3e0 secure :-1 s=READY pgs=741 gs=1 cs=0 l=1 c_cookie=16673719101669168750 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b4c009950 tx=0x7f3b4c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 -- 10.20.193.4:0/4061967231 shutdown_connections 2026-02-24T09:13:18.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 --2- 10.20.193.4:0/4061967231 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b60113200 0x7f3b60173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 --2- 10.20.193.4:0/4061967231 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b6010da00 0x7f3b60112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 --2- 10.20.193.4:0/4061967231 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b6010d010 0x7f3b6010d3e0 unknown :-1 s=CLOSED pgs=741 gs=1 cs=0 l=1 c_cookie=16673719101669168750 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 -- 10.20.193.4:0/4061967231 >> 10.20.193.4:0/4061967231 conn(0x7f3b6005f830 msgr2=0x7f3b6010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:18.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 -- 10.20.193.4:0/4061967231 shutdown_connections 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 -- 10.20.193.4:0/4061967231 wait complete. 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 Processor -- start 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.263+0000 7f3b661ef640 1 -- start start 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b661ef640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b6010d010 0x7f3b60060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b661ef640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b6010da00 0x7f3b600614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b661ef640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b60113200 0x7f3b60061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b661ef640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60163c70 con 0x7f3b6010da00 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b661ef640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60163de0 con 0x7f3b6010d010 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b661ef640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60163fa0 con 0x7f3b60113200 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b6010da00 0x7f3b600614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b6010da00 0x7f3b600614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36028/0 (socket says 10.20.193.4:36028) 2026-02-24T09:13:18.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5effd640 1 -- 10.20.193.4:0/2798172636 learned_addr learned my addr 10.20.193.4:0/2798172636 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5ffff640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b60113200 0x7f3b60061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5effd640 1 -- 10.20.193.4:0/2798172636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b60113200 msgr2=0x7f3b60061a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5effd640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b60113200 0x7f3b60061a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5effd640 1 -- 10.20.193.4:0/2798172636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b6010d010 msgr2=0x7f3b60060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5effd640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b6010d010 0x7f3b60060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5effd640 1 -- 10.20.193.4:0/2798172636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c009570 con 0x7f3b6010da00 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5effd640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b6010da00 0x7f3b600614d0 secure :-1 s=READY pgs=742 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b5000d950 tx=0x7f3b5000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5cff9640 1 -- 10.20.193.4:0/2798172636 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b50004540 con 0x7f3b6010da00 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b661ef640 1 -- 10.20.193.4:0/2798172636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b60164280 con 0x7f3b6010da00 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5cff9640 1 -- 10.20.193.4:0/2798172636 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b50009d00 con 0x7f3b6010da00 2026-02-24T09:13:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b5cff9640 1 -- 10.20.193.4:0/2798172636 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b500106e0 con 0x7f3b6010da00 2026-02-24T09:13:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.264+0000 7f3b661ef640 1 -- 10.20.193.4:0/2798172636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b601647a0 con 0x7f3b6010da00 2026-02-24T09:13:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.265+0000 7f3b661ef640 1 -- 10.20.193.4:0/2798172636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6010e2f0 con 0x7f3b6010da00 2026-02-24T09:13:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.267+0000 7f3b5cff9640 1 -- 10.20.193.4:0/2798172636 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f3b500027c0 con 0x7f3b6010da00 2026-02-24T09:13:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.268+0000 7f3b5cff9640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3b340b56e0 0x7f3b340d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.268+0000 7f3b5cff9640 1 -- 10.20.193.4:0/2798172636 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3b500e72e0 con 0x7f3b6010da00 2026-02-24T09:13:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.268+0000 7f3b5f7fe640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3b340b56e0 0x7f3b340d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.268+0000 7f3b5f7fe640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3b340b56e0 0x7f3b340d5b90 secure :-1 s=READY pgs=338 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b4c02f6e0 tx=0x7f3b4c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.269+0000 7f3b5cff9640 1 -- 10.20.193.4:0/2798172636 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3b500a9c60 con 0x7f3b6010da00 2026-02-24T09:13:18.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.435+0000 7f3b661ef640 1 -- 10.20.193.4:0/2798172636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b6010d3e0 con 0x7f3b6010da00 2026-02-24T09:13:18.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.435+0000 7f3b5cff9640 1 -- 10.20.193.4:0/2798172636 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f3b500ace10 con 0x7f3b6010da00 2026-02-24T09:13:18.440 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:13:18.440 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:13:18.441 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:13:18.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 -- 10.20.193.4:0/2798172636 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3b340b56e0 msgr2=0x7f3b340d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3b340b56e0 0x7f3b340d5b90 secure :-1 s=READY pgs=338 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b4c02f6e0 tx=0x7f3b4c005900 comp rx=0 tx=0).stop 2026-02-24T09:13:18.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 -- 10.20.193.4:0/2798172636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b6010da00 msgr2=0x7f3b600614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b6010da00 0x7f3b600614d0 secure :-1 s=READY pgs=742 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b5000d950 tx=0x7f3b5000de20 comp rx=0 tx=0).stop 2026-02-24T09:13:18.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 -- 10.20.193.4:0/2798172636 shutdown_connections 2026-02-24T09:13:18.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3b340b56e0 0x7f3b340d5b90 unknown :-1 s=CLOSED pgs=338 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b60113200 0x7f3b60061a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b6010da00 0x7f3b600614d0 unknown :-1 s=CLOSED pgs=742 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 --2- 10.20.193.4:0/2798172636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b6010d010 0x7f3b60060f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 -- 10.20.193.4:0/2798172636 >> 10.20.193.4:0/2798172636 conn(0x7f3b6005f830 msgr2=0x7f3b6010ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:18.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 -- 10.20.193.4:0/2798172636 shutdown_connections 2026-02-24T09:13:18.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.439+0000 7f3b661ef640 1 -- 10.20.193.4:0/2798172636 wait complete. 2026-02-24T09:13:18.502 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:13:18.685 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:18.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.864+0000 7fe6cee48640 1 -- 10.20.193.4:0/2751000683 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe6c8061940 msgr2=0x7fe6c8155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.864+0000 7fe6cee48640 1 --2- 10.20.193.4:0/2751000683 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe6c8061940 0x7fe6c8155550 secure :-1 s=READY pgs=743 gs=1 cs=0 l=1 c_cookie=12849138797644285006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b0009950 tx=0x7fe6b002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.864+0000 7fe6cee48640 1 -- 10.20.193.4:0/2751000683 shutdown_connections 2026-02-24T09:13:18.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.864+0000 7fe6cee48640 1 --2- 10.20.193.4:0/2751000683 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe6c8155a90 0x7fe6c8175e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.864+0000 7fe6cee48640 1 --2- 10.20.193.4:0/2751000683 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe6c8061940 0x7fe6c8155550 unknown :-1 s=CLOSED pgs=743 gs=1 cs=0 l=1 c_cookie=12849138797644285006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.864+0000 7fe6cee48640 1 --2- 10.20.193.4:0/2751000683 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe6c8061030 0x7fe6c8061400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.864+0000 7fe6cee48640 1 -- 10.20.193.4:0/2751000683 >> 10.20.193.4:0/2751000683 conn(0x7fe6c80eaca0 msgr2=0x7fe6c810b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.864+0000 7fe6cee48640 1 -- 10.20.193.4:0/2751000683 shutdown_connections 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.864+0000 7fe6cee48640 1 -- 10.20.193.4:0/2751000683 wait complete. 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cee48640 1 Processor -- start 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cee48640 1 -- start start 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cee48640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe6c8061030 0x7fe6c8162160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cee48640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe6c8061940 0x7fe6c81626a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cee48640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe6c8155a90 0x7fe6c8167a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cee48640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8168000 con 0x7fe6c8155a90 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cee48640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8168170 con 0x7fe6c8061030 2026-02-24T09:13:18.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cee48640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8168330 con 0x7fe6c8061940 2026-02-24T09:13:18.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cd3be640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe6c8155a90 0x7fe6c8167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6ccbbd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe6c8061030 0x7fe6c8162160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cd3be640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe6c8155a90 0x7fe6c8167a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36056/0 (socket says 10.20.193.4:36056) 2026-02-24T09:13:18.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6ccbbd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe6c8061030 0x7fe6c8162160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:39608/0 (socket says 10.20.193.4:39608) 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6cd3be640 1 -- 10.20.193.4:0/2416591116 learned_addr learned my addr 10.20.193.4:0/2416591116 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.865+0000 7fe6bffff640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe6c8061940 0x7fe6c81626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6cd3be640 1 -- 10.20.193.4:0/2416591116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe6c8061940 msgr2=0x7fe6c81626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6cd3be640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe6c8061940 0x7fe6c81626a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6cd3be640 1 -- 10.20.193.4:0/2416591116 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe6c8061030 msgr2=0x7fe6c8162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6cd3be640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe6c8061030 0x7fe6c8162160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6cd3be640 1 -- 10.20.193.4:0/2416591116 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b0009570 con 0x7fe6c8155a90 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6cd3be640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe6c8155a90 0x7fe6c8167a70 secure :-1 s=READY pgs=744 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6c400bfd0 tx=0x7fe6c400de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6bdffb640 1 -- 10.20.193.4:0/2416591116 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6c4008cf0 con 0x7fe6c8155a90 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6cee48640 1 -- 10.20.193.4:0/2416591116 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c8168610 con 0x7fe6c8155a90 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6bdffb640 1 -- 10.20.193.4:0/2416591116 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6c4008e50 con 0x7fe6c8155a90 2026-02-24T09:13:18.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6bdffb640 1 -- 10.20.193.4:0/2416591116 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6c40106b0 con 0x7fe6c8155a90 2026-02-24T09:13:18.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.866+0000 7fe6cee48640 1 -- 10.20.193.4:0/2416591116 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c81516b0 con 0x7fe6c8155a90 2026-02-24T09:13:18.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.869+0000 7fe6bdffb640 1 -- 10.20.193.4:0/2416591116 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fe6c4010860 con 0x7fe6c8155a90 2026-02-24T09:13:18.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.870+0000 7fe6bdffb640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe6a40b56e0 0x7fe6a40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.870+0000 7fe6bdffb640 1 -- 10.20.193.4:0/2416591116 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe6c40e8b20 con 0x7fe6c8155a90 2026-02-24T09:13:18.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.870+0000 7fe6ccbbd640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe6a40b56e0 0x7fe6a40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.870+0000 7fe6ccbbd640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe6a40b56e0 0x7fe6a40d5b90 secure :-1 s=READY pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b8004740 tx=0x7fe6b800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:18.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.873+0000 7fe6d0e42e00 1 Processor -- start 2026-02-24T09:13:18.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.873+0000 7fe6d0e42e00 1 -- start start 2026-02-24T09:13:18.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.873+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef05f50 0x55fe2ef06320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.873+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2ef4afc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.873+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef4b500 0x55fe2ef6b8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fe2ee16ee0 con 0x55fe2ef06860 2026-02-24T09:13:18.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fe2ee12c10 con 0x55fe2ef05f50 2026-02-24T09:13:18.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fe2ee0cd70 con 0x55fe2ef4b500 2026-02-24T09:13:18.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6ccbbd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef05f50 0x55fe2ef06320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2ef4afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2ef4afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36064/0 (socket says 10.20.193.4:36064) 2026-02-24T09:13:18.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6bffff640 1 -- 10.20.193.4:0/2748664468 learned_addr learned my addr 10.20.193.4:0/2748664468 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:18.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6cd3be640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef4b500 0x55fe2ef6b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6bffff640 1 -- 10.20.193.4:0/2748664468 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef4b500 msgr2=0x55fe2ef6b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:18.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6bffff640 1 --2- 10.20.193.4:0/2748664468 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef4b500 0x55fe2ef6b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6bffff640 1 -- 10.20.193.4:0/2748664468 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef05f50 msgr2=0x55fe2ef06320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:18.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6bffff640 1 --2- 10.20.193.4:0/2748664468 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef05f50 0x55fe2ef06320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6bffff640 1 -- 10.20.193.4:0/2748664468 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2edb8340 con 0x55fe2ef06860 2026-02-24T09:13:18.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.874+0000 7fe6cd3be640 1 --2- 10.20.193.4:0/2748664468 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef4b500 0x55fe2ef6b8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:13:18.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.875+0000 7fe6bffff640 1 --2- 10.20.193.4:0/2748664468 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2ef4afc0 secure :-1 s=READY pgs=745 gs=3 cs=0 l=1 c_cookie=669722953084333683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b0009950 tx=0x7fe6b0002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b557a3c846e73 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:18.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.875+0000 7fe6954e4640 1 -- 10.20.193.4:0/2748664468 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6b003d070 con 0x55fe2ef06860 2026-02-24T09:13:18.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.875+0000 7fe6954e4640 1 -- 10.20.193.4:0/2748664468 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6b003e040 con 0x55fe2ef06860 2026-02-24T09:13:18.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.875+0000 7fe6954e4640 1 -- 10.20.193.4:0/2748664468 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6b002fc70 con 0x55fe2ef06860 2026-02-24T09:13:18.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.876+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/2748664468 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 msgr2=0x55fe2ef4afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.877+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/2748664468 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2ef4afc0 secure :-1 s=READY pgs=745 gs=3 cs=0 l=1 c_cookie=669722953084333683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b0009950 tx=0x7fe6b0002390 comp rx=0 tx=0).stop 2026-02-24T09:13:18.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.877+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/2748664468 shutdown_connections 2026-02-24T09:13:18.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.877+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/2748664468 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef4b500 0x55fe2ef6b8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.877+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/2748664468 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2ef4afc0 unknown :-1 s=CLOSED pgs=745 gs=3 cs=0 l=1 c_cookie=669722953084333683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.877+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/2748664468 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef05f50 0x55fe2ef06320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.877+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/2748664468 >> 10.20.193.4:0/2748664468 conn(0x55fe2ee24db0 msgr2=0x55fe2ef04830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:18.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.877+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/2748664468 shutdown_connections 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.877+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/2748664468 wait complete. 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.878+0000 7fe6d0e42e00 1 -- start start 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.878+0000 7fe6d0e42e00 1 Processor -- start 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.878+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef62db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.878+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef06860 0x55fe2ef632f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.878+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2ef682e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.878+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fe2ef68820 con 0x55fe2ef05f50 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.878+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fe2ef68990 con 0x55fe2ef4b500 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.878+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fe2ef68b50 con 0x55fe2ef06860 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6ccbbd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef62db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6ccbbd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef62db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36080/0 (socket says 10.20.193.4:36080) 2026-02-24T09:13:18.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6ccbbd640 1 -- 10.20.193.4:0/3564699042 learned_addr learned my addr 10.20.193.4:0/3564699042 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6cd3be640 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2ef682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6ccbbd640 1 -- 10.20.193.4:0/3564699042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef06860 msgr2=0x55fe2ef632f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6ccbbd640 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef06860 0x55fe2ef632f0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6ccbbd640 1 -- 10.20.193.4:0/3564699042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 msgr2=0x55fe2ef682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6ccbbd640 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2ef682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6ccbbd640 1 -- 10.20.193.4:0/3564699042 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c8176a70 con 0x55fe2ef05f50 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6cd3be640 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2ef682e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6ccbbd640 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef62db0 secure :-1 s=READY pgs=746 gs=1 cs=0 l=1 c_cookie=6566742592910042446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b8011010 tx=0x7fe6b80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b21c1989dd4a54e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6867fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6867fc640 1 -- 10.20.193.4:0/3564699042 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6b801d960 con 0x55fe2ef05f50 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6867fc640 1 -- 10.20.193.4:0/3564699042 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6b8015070 con 0x55fe2ef05f50 2026-02-24T09:13:18.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/3564699042 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c81516b0 con 0x55fe2ef05f50 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6867fc640 1 -- 10.20.193.4:0/3564699042 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6b801b690 con 0x55fe2ef05f50 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6d0e42e00 10 client.16503 _ll_register_callbacks cb 0x55fe2edb7080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/3564699042 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe2eb5c4a0 con 0x55fe2ef05f50 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.879+0000 7fe6867fc640 1 -- 10.20.193.4:0/3564699042 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe6b8017070 con 0x55fe2ef05f50 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6867fc640 1 -- 10.20.193.4:0/3564699042 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe6b801ee00 con 0x55fe2ef05f50 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6d0e42e00 10 client.16503 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/3564699042 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55fe2ed909d0 con 0x55fe2ef05f50 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6867fc640 1 -- 10.20.193.4:0/3564699042 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fe6b8004020 con 0x55fe2ef05f50 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6d0e42e00 10 client.16503 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6d0e42e00 10 client.16503 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6d0e42e00 20 client.16503 populate_metadata read hostname 'trial004' 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55fe2ef6b3c0 0x55fe2ef6b860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6d0e42e00 4 client.16503 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/3564699042 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe2ee027b0 con 0x55fe2ef6b3c0 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.880+0000 7fe6bffff640 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55fe2ef6b3c0 0x55fe2ef6b860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6bffff640 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55fe2ef6b3c0 0x55fe2ef6b860 crc :-1 s=READY pgs=34 gs=3 cs=0 l=0 c_cookie=14979281515718292411 s_cookie=17820711295784291776 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cfe1192cc6f6b3bb server_cookie=f74fe2815e038dc0 in_seq=0 out_seq=0 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6867fc640 10 client.16503 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6867fc640 1 -- 10.20.193.4:0/3564699042 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55fe2ee027b0 con 0x55fe2ef6b3c0 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6867fc640 10 client.16503 handle_command_reply: tid=0 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 client.16503 shutdown 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/3564699042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 msgr2=0x55fe2ef62db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef62db0 secure :-1 s=READY pgs=746 gs=1 cs=0 l=1 c_cookie=6566742592910042446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b8011010 tx=0x7fe6b80047e0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/3564699042 shutdown_connections 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55fe2ef6b3c0 0x55fe2ef6b860 crc :-1 s=READY pgs=34 gs=3 cs=0 l=0 c_cookie=14979281515718292411 s_cookie=17820711295784291776 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2ef682e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6867fc640 0 client.16503 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:13:18.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef06860 0x55fe2ef632f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/3564699042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef62db0 unknown :-1 s=CLOSED pgs=746 gs=1 cs=0 l=1 c_cookie=6566742592910042446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/3564699042 >> 10.20.193.4:0/3564699042 conn(0x55fe2ee24db0 msgr2=0x55fe2ef04040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:18.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/3564699042 shutdown_connections 2026-02-24T09:13:18.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.881+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/3564699042 wait complete. 2026-02-24T09:13:18.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.882+0000 7fe6d0e42e00 20 client.16503 trim_cache size 0 max 16384 2026-02-24T09:13:18.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6d0e42e00 1 Processor -- start 2026-02-24T09:13:18.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6d0e42e00 1 -- start start 2026-02-24T09:13:18.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef67850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef06860 0x55fe2ef46110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2ef46650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fe2ee0a9a0 con 0x55fe2ef05f50 2026-02-24T09:13:18.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fe2ebe6df0 con 0x55fe2ef4b500 2026-02-24T09:13:18.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fe2eedaea0 con 0x55fe2ef06860 2026-02-24T09:13:18.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6ccbbd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef67850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6ccbbd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef67850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36082/0 (socket says 10.20.193.4:36082) 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6ccbbd640 1 -- 10.20.193.4:0/177759076 learned_addr learned my addr 10.20.193.4:0/177759076 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.889+0000 7fe6cd3be640 1 --2- 10.20.193.4:0/177759076 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2ef46650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe6bffff640 1 --2- 10.20.193.4:0/177759076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef06860 0x55fe2ef46110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe6ccbbd640 1 -- 10.20.193.4:0/177759076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef06860 msgr2=0x55fe2ef46110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe6ccbbd640 1 --2- 10.20.193.4:0/177759076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef06860 0x55fe2ef46110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe6ccbbd640 1 -- 10.20.193.4:0/177759076 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 msgr2=0x55fe2ef46650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe6ccbbd640 1 --2- 10.20.193.4:0/177759076 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2ef46650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe6ccbbd640 1 -- 10.20.193.4:0/177759076 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2ef55410 con 0x55fe2ef05f50 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe6ccbbd640 1 --2- 10.20.193.4:0/177759076 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef67850 secure :-1 s=READY pgs=747 gs=1 cs=0 l=1 c_cookie=4815336224461009562 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b80043f0 tx=0x7fe6b802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d382c88d11b29a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe694ce3640 1 -- 10.20.193.4:0/177759076 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6b801b670 con 0x55fe2ef05f50 2026-02-24T09:13:18.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe694ce3640 1 -- 10.20.193.4:0/177759076 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6b8015030 con 0x55fe2ef05f50 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe694ce3640 1 -- 10.20.193.4:0/177759076 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6b8026b60 con 0x55fe2ef05f50 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/177759076 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 msgr2=0x55fe2ef67850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.890+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/177759076 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef67850 secure :-1 s=READY pgs=747 gs=1 cs=0 l=1 c_cookie=4815336224461009562 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b80043f0 tx=0x7fe6b802c000 comp rx=0 tx=0).stop 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/177759076 shutdown_connections 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/177759076 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2ef46650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/177759076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef06860 0x55fe2ef46110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/177759076 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef05f50 0x55fe2ef67850 unknown :-1 s=CLOSED pgs=747 gs=1 cs=0 l=1 c_cookie=4815336224461009562 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/177759076 >> 10.20.193.4:0/177759076 conn(0x55fe2ee24db0 msgr2=0x55fe2ef67140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/177759076 shutdown_connections 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/177759076 wait complete. 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 -- start start 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 Processor -- start 2026-02-24T09:13:18.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef05f50 0x55fe2eee4030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2eee4570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2eee4ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55fe2efb2110 con 0x55fe2ef06860 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55fe2efb2280 con 0x55fe2ef4b500 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6d0e42e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55fe2eee9100 con 0x55fe2ef05f50 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2eee4570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.891+0000 7fe6bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2eee4570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36092/0 (socket says 10.20.193.4:36092) 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6bffff640 1 -- 10.20.193.4:0/249204292 learned_addr learned my addr 10.20.193.4:0/249204292 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6bffff640 1 -- 10.20.193.4:0/249204292 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef05f50 msgr2=0x55fe2eee4030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6bffff640 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef05f50 0x55fe2eee4030 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6bffff640 1 -- 10.20.193.4:0/249204292 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 msgr2=0x55fe2eee4ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:13:18.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6bffff640 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2eee4ab0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6bffff640 1 -- 10.20.193.4:0/249204292 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2eda2710 con 0x55fe2ef06860 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6bffff640 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2eee4570 secure :-1 s=READY pgs=748 gs=1 cs=0 l=1 c_cookie=10076499188770803004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b00098a0 tx=0x7fe6b0005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd6ea9fe6320d3c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6867fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6867fc640 1 -- 10.20.193.4:0/249204292 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6b003d040 con 0x55fe2ef06860 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/249204292 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2ed909d0 con 0x55fe2ef06860 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6867fc640 1 -- 10.20.193.4:0/249204292 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe6b0052040 con 0x55fe2ef06860 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6867fc640 1 -- 10.20.193.4:0/249204292 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6b0038b80 con 0x55fe2ef06860 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 10 client.16509 _ll_register_callbacks cb 0x55fe2edb7080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/249204292 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6b003e040 con 0x55fe2ef06860 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6867fc640 1 -- 10.20.193.4:0/249204292 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe6b0038d10 con 0x55fe2ef06860 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6867fc640 1 -- 10.20.193.4:0/249204292 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe6b0042400 con 0x55fe2ef06860 2026-02-24T09:13:18.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 10 client.16509 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:18.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/249204292 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55fe2ed9d190 con 0x55fe2ef06860 2026-02-24T09:13:18.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6867fc640 1 -- 10.20.193.4:0/249204292 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fe6b00425a0 con 0x55fe2ef06860 2026-02-24T09:13:18.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 10 client.16509 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:18.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 10 client.16509 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:13:18.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 20 client.16509 populate_metadata read hostname 'trial004' 2026-02-24T09:13:18.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55fe2eff90d0 0x55fe2f019550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:18.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 4 client.16509 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:13:18.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.892+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/249204292 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fe2eb41160 con 0x55fe2eff90d0 2026-02-24T09:13:18.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.893+0000 7fe6ccbbd640 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55fe2eff90d0 0x55fe2f019550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:18.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6ccbbd640 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55fe2eff90d0 0x55fe2f019550 crc :-1 s=READY pgs=35 gs=2 cs=0 l=0 c_cookie=11703151584348722785 s_cookie=6361761630238207108 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a269f25c29a7d661 server_cookie=5849847f240eec84 in_seq=0 out_seq=0 2026-02-24T09:13:18.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6867fc640 10 client.16509 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:13:18.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6867fc640 1 -- 10.20.193.4:0/249204292 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fe2eb41160 con 0x55fe2eff90d0 2026-02-24T09:13:18.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6867fc640 10 client.16509 handle_command_reply: tid=0 2026-02-24T09:13:18.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 client.16509 shutdown 2026-02-24T09:13:18.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/249204292 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 msgr2=0x55fe2eee4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2eee4570 secure :-1 s=READY pgs=748 gs=1 cs=0 l=1 c_cookie=10076499188770803004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b00098a0 tx=0x7fe6b0005bb0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/249204292 shutdown_connections 2026-02-24T09:13:18.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55fe2eff90d0 0x55fe2f019550 crc :-1 s=READY pgs=35 gs=2 cs=0 l=0 c_cookie=11703151584348722785 s_cookie=6361761630238207108 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55fe2ef4b500 0x55fe2eee4ab0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55fe2ef06860 0x55fe2eee4570 unknown :-1 s=CLOSED pgs=748 gs=1 cs=0 l=1 c_cookie=10076499188770803004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 --2- 10.20.193.4:0/249204292 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55fe2ef05f50 0x55fe2eee4030 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6867fc640 0 client.16509 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:13:18.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/249204292 >> 10.20.193.4:0/249204292 conn(0x55fe2ee24db0 msgr2=0x55fe2ef04c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:18.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/249204292 shutdown_connections 2026-02-24T09:13:18.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.894+0000 7fe6d0e42e00 1 -- 10.20.193.4:0/249204292 wait complete. 2026-02-24T09:13:18.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6d0e42e00 20 client.16509 trim_cache size 0 max 16384 2026-02-24T09:13:18.906 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:13:18.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 -- 10.20.193.4:0/2416591116 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe6a40b56e0 msgr2=0x7fe6a40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe6a40b56e0 0x7fe6a40d5b90 secure :-1 s=READY pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6b8004740 tx=0x7fe6b800b410 comp rx=0 tx=0).stop 2026-02-24T09:13:18.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 -- 10.20.193.4:0/2416591116 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe6c8155a90 msgr2=0x7fe6c8167a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:18.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe6c8155a90 0x7fe6c8167a70 secure :-1 s=READY pgs=744 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6c400bfd0 tx=0x7fe6c400de50 comp rx=0 tx=0).stop 2026-02-24T09:13:18.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 -- 10.20.193.4:0/2416591116 shutdown_connections 2026-02-24T09:13:18.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe6a40b56e0 0x7fe6a40d5b90 unknown :-1 s=CLOSED pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe6c8155a90 0x7fe6c8167a70 unknown :-1 s=CLOSED pgs=744 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe6c8061940 0x7fe6c81626a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 --2- 10.20.193.4:0/2416591116 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe6c8061030 0x7fe6c8162160 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:18.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 -- 10.20.193.4:0/2416591116 >> 10.20.193.4:0/2416591116 conn(0x7fe6c80eaca0 msgr2=0x7fe6c810b080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:18.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 -- 10.20.193.4:0/2416591116 shutdown_connections 2026-02-24T09:13:18.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:18.895+0000 7fe6cee48640 1 -- 10.20.193.4:0/2416591116 wait complete. 2026-02-24T09:13:18.960 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:13:18.991 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:18 trial004 ceph-mon[41596]: pgmap v257: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 833 MiB/s wr, 236 op/s 2026-02-24T09:13:18.991 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:18 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2798172636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:19.118 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:19.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.263+0000 7fe4ee11c640 1 -- 10.20.193.4:0/3337518917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe4e81135c0 msgr2=0x7fe4e8173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.263+0000 7fe4ee11c640 1 --2- 10.20.193.4:0/3337518917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe4e81135c0 0x7fe4e8173f90 secure :-1 s=READY pgs=749 gs=1 cs=0 l=1 c_cookie=4127247314921364727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc00aa30 tx=0x7fe4dc030290 comp rx=0 tx=0).stop 2026-02-24T09:13:19.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.263+0000 7fe4ee11c640 1 -- 10.20.193.4:0/3337518917 shutdown_connections 2026-02-24T09:13:19.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.263+0000 7fe4ee11c640 1 --2- 10.20.193.4:0/3337518917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe4e81135c0 0x7fe4e8173f90 unknown :-1 s=CLOSED pgs=749 gs=1 cs=0 l=1 c_cookie=4127247314921364727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.263+0000 7fe4ee11c640 1 --2- 10.20.193.4:0/3337518917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe4e810ddc0 0x7fe4e8112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.263+0000 7fe4ee11c640 1 --2- 10.20.193.4:0/3337518917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe4e810d3d0 0x7fe4e810d7a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.263+0000 7fe4ee11c640 1 -- 10.20.193.4:0/3337518917 >> 10.20.193.4:0/3337518917 conn(0x7fe4e80eaca0 msgr2=0x7fe4e810b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.263+0000 7fe4ee11c640 1 -- 10.20.193.4:0/3337518917 shutdown_connections 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.263+0000 7fe4ee11c640 1 -- 10.20.193.4:0/3337518917 wait complete. 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4ee11c640 1 Processor -- start 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4ee11c640 1 -- start start 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4ee11c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe4e810d3d0 0x7fe4e8060f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4ee11c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe4e810ddc0 0x7fe4e8173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4ee11c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe4e81135c0 0x7fe4e8061480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4ee11c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e80619c0 con 0x7fe4e81135c0 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4ee11c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8061b30 con 0x7fe4e810d3d0 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4ee11c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8061cf0 con 0x7fe4e810ddc0 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4e6ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe4e810ddc0 0x7fe4e8173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4e7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe4e81135c0 0x7fe4e8061480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4e6ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe4e810ddc0 0x7fe4e8173e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:34014/0 (socket says 10.20.193.4:34014) 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4e6ffd640 1 -- 10.20.193.4:0/119722518 learned_addr learned my addr 10.20.193.4:0/119722518 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe4e810d3d0 0x7fe4e8060f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4e7fff640 1 -- 10.20.193.4:0/119722518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe4e810ddc0 msgr2=0x7fe4e8173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4e7fff640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe4e810ddc0 0x7fe4e8173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4e7fff640 1 -- 10.20.193.4:0/119722518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe4e810d3d0 msgr2=0x7fe4e8060f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4e7fff640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe4e810d3d0 0x7fe4e8060f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.264+0000 7fe4e7fff640 1 -- 10.20.193.4:0/119722518 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc00a650 con 0x7fe4e81135c0 2026-02-24T09:13:19.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.265+0000 7fe4e7fff640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe4e81135c0 0x7fe4e8061480 secure :-1 s=READY pgs=750 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc00aa30 tx=0x7fe4dc0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.265+0000 7fe4e4ff9640 1 -- 10.20.193.4:0/119722518 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4dc03e070 con 0x7fe4e81135c0 2026-02-24T09:13:19.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.265+0000 7fe4ee11c640 1 -- 10.20.193.4:0/119722518 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e80fba90 con 0x7fe4e81135c0 2026-02-24T09:13:19.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.265+0000 7fe4e4ff9640 1 -- 10.20.193.4:0/119722518 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4dc0055a0 con 0x7fe4e81135c0 2026-02-24T09:13:19.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.265+0000 7fe4e4ff9640 1 -- 10.20.193.4:0/119722518 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4dc042a70 con 0x7fe4e81135c0 2026-02-24T09:13:19.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.265+0000 7fe4ee11c640 1 -- 10.20.193.4:0/119722518 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e80fbf00 con 0x7fe4e81135c0 2026-02-24T09:13:19.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.268+0000 7fe4e4ff9640 1 -- 10.20.193.4:0/119722518 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fe4dc0050c0 con 0x7fe4e81135c0 2026-02-24T09:13:19.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.269+0000 7fe4e4ff9640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe4bc0b57e0 0x7fe4bc0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.269+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe4bc0b57e0 0x7fe4bc0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.269+0000 7fe4e4ff9640 1 -- 10.20.193.4:0/119722518 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe4dc10ca00 con 0x7fe4e81135c0 2026-02-24T09:13:19.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.269+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe4bc0b57e0 0x7fe4bc0d5c90 secure :-1 s=READY pgs=340 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4d4004760 tx=0x7fe4d4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.270+0000 7fe4f0116e00 1 Processor -- start 2026-02-24T09:13:19.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.270+0000 7fe4f0116e00 1 -- start start 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.270+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56995f50 0x561c56996320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.270+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56996860 0x561c569dafc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.270+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c569db500 0x561c569fb8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.270+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c568a6ee0 con 0x561c56996860 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.270+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c568a2c10 con 0x561c569db500 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.270+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c5689cd70 con 0x561c56995f50 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56996860 0x561c569dafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56996860 0x561c569dafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36112/0 (socket says 10.20.193.4:36112) 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e6ffd640 1 -- 10.20.193.4:0/3147129928 learned_addr learned my addr 10.20.193.4:0/3147129928 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/3147129928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56995f50 0x561c56996320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e7fff640 1 --2- 10.20.193.4:0/3147129928 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c569db500 0x561c569fb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e6ffd640 1 -- 10.20.193.4:0/3147129928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56995f50 msgr2=0x561c56996320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e6ffd640 1 --2- 10.20.193.4:0/3147129928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56995f50 0x561c56996320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e6ffd640 1 -- 10.20.193.4:0/3147129928 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c569db500 msgr2=0x561c569fb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e6ffd640 1 --2- 10.20.193.4:0/3147129928 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c569db500 0x561c569fb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e6ffd640 1 -- 10.20.193.4:0/3147129928 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c56848340 con 0x561c56996860 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4e6ffd640 1 --2- 10.20.193.4:0/3147129928 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56996860 0x561c569dafc0 secure :-1 s=READY pgs=751 gs=1 cs=0 l=1 c_cookie=7879420423478026995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4d80040d0 tx=0x7fe4d8002c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d595320d15da2f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4abfff640 1 -- 10.20.193.4:0/3147129928 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4d8009e10 con 0x561c56996860 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4abfff640 1 -- 10.20.193.4:0/3147129928 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4d8002e80 con 0x561c56996860 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.271+0000 7fe4abfff640 1 -- 10.20.193.4:0/3147129928 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4d80118a0 con 0x561c56996860 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.272+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3147129928 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56996860 msgr2=0x561c569dafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.272+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/3147129928 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56996860 0x561c569dafc0 secure :-1 s=READY pgs=751 gs=1 cs=0 l=1 c_cookie=7879420423478026995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4d80040d0 tx=0x7fe4d8002c20 comp rx=0 tx=0).stop 2026-02-24T09:13:19.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.272+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3147129928 shutdown_connections 2026-02-24T09:13:19.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.272+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/3147129928 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c569db500 0x561c569fb8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.272+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/3147129928 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56996860 0x561c569dafc0 unknown :-1 s=CLOSED pgs=751 gs=1 cs=0 l=1 c_cookie=7879420423478026995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.272+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/3147129928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56995f50 0x561c56996320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.272+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3147129928 >> 10.20.193.4:0/3147129928 conn(0x561c568b4db0 msgr2=0x561c56994830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.272+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3147129928 shutdown_connections 2026-02-24T09:13:19.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.272+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3147129928 wait complete. 2026-02-24T09:13:19.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 -- start start 2026-02-24T09:13:19.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 Processor -- start 2026-02-24T09:13:19.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56995f50 0x561c569f2cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56996860 0x561c569f31f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c569f81e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c569f8720 con 0x561c569db500 2026-02-24T09:13:19.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c569f8890 con 0x561c56996860 2026-02-24T09:13:19.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c569f8a50 con 0x561c56995f50 2026-02-24T09:13:19.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c569f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c569f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36116/0 (socket says 10.20.193.4:36116) 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e7fff640 1 -- 10.20.193.4:0/1556627324 learned_addr learned my addr 10.20.193.4:0/1556627324 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e6ffd640 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56996860 0x561c569f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e7fff640 1 -- 10.20.193.4:0/1556627324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56995f50 msgr2=0x561c569f2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e7fff640 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56995f50 0x561c569f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e7fff640 1 -- 10.20.193.4:0/1556627324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56996860 msgr2=0x561c569f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e7fff640 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56996860 0x561c569f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e7fff640 1 -- 10.20.193.4:0/1556627324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c568209d0 con 0x561c569db500 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e6ffd640 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56996860 0x561c569f31f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4e7fff640 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c569f81e0 secure :-1 s=READY pgs=752 gs=1 cs=0 l=1 c_cookie=4468393848827198008 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc0307a0 tx=0x7fe4dc030290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e02ec87ebe2ba38 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4a97fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4a97fa640 1 -- 10.20.193.4:0/1556627324 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4dc0ddc00 con 0x561c569db500 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 -- 10.20.193.4:0/1556627324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d80042d0 con 0x561c569db500 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4a97fa640 1 -- 10.20.193.4:0/1556627324 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4dc0f80d0 con 0x561c569db500 2026-02-24T09:13:19.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4a97fa640 1 -- 10.20.193.4:0/1556627324 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4dc0d1040 con 0x561c569db500 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 10 client.16521 _ll_register_callbacks cb 0x561c56847080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 -- 10.20.193.4:0/1556627324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c56527f40 con 0x561c569db500 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4a97fa640 1 -- 10.20.193.4:0/1556627324 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe4dc0dde70 con 0x561c569db500 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4a97fa640 1 -- 10.20.193.4:0/1556627324 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe4dc036320 con 0x561c569db500 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 10 client.16521 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.273+0000 7fe4f0116e00 1 -- 10.20.193.4:0/1556627324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561c56832710 con 0x561c569db500 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.274+0000 7fe4a97fa640 1 -- 10.20.193.4:0/1556627324 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fe4dc0d4720 con 0x561c569db500 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.274+0000 7fe4f0116e00 10 client.16521 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.274+0000 7fe4f0116e00 10 client.16521 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.274+0000 7fe4f0116e00 20 client.16521 populate_metadata read hostname 'trial004' 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.274+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x561c569d8330 0x561c569d87a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.274+0000 7fe4f0116e00 4 client.16521 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.274+0000 7fe4f0116e00 1 -- 10.20.193.4:0/1556627324 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c5652a6f0 con 0x561c569d8330 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.274+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x561c569d8330 0x561c569d87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.274+0000 7fe4a97fa640 10 client.16521 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.274+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x561c569d8330 0x561c569d87a0 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=2714623726629413576 s_cookie=11293424348592075020 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=25ac47e58c97e2c8 server_cookie=9cba4d9c2393f10c in_seq=0 out_seq=0 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4a97fa640 1 -- 10.20.193.4:0/1556627324 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561c5652a6f0 con 0x561c569d8330 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4a97fa640 10 client.16521 handle_command_reply: tid=0 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 client.16521 shutdown 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 -- 10.20.193.4:0/1556627324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 msgr2=0x561c569f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c569f81e0 secure :-1 s=READY pgs=752 gs=1 cs=0 l=1 c_cookie=4468393848827198008 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc0307a0 tx=0x7fe4dc030290 comp rx=0 tx=0).stop 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 -- 10.20.193.4:0/1556627324 shutdown_connections 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x561c569d8330 0x561c569d87a0 crc :-1 s=READY pgs=35 gs=4 cs=0 l=0 c_cookie=2714623726629413576 s_cookie=11293424348592075020 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c569f81e0 unknown :-1 s=CLOSED pgs=752 gs=1 cs=0 l=1 c_cookie=4468393848827198008 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56996860 0x561c569f31f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/1556627324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56995f50 0x561c569f2cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 -- 10.20.193.4:0/1556627324 >> 10.20.193.4:0/1556627324 conn(0x561c568b4db0 msgr2=0x561c56994040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4a97fa640 0 client.16521 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 -- 10.20.193.4:0/1556627324 shutdown_connections 2026-02-24T09:13:19.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 1 -- 10.20.193.4:0/1556627324 wait complete. 2026-02-24T09:13:19.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.275+0000 7fe4f0116e00 20 client.16521 trim_cache size 0 max 16384 2026-02-24T09:13:19.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4f0116e00 1 Processor -- start 2026-02-24T09:13:19.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4f0116e00 1 -- start start 2026-02-24T09:13:19.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56995f50 0x561c56995460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56996860 0x561c569f00a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c569db500 0x561c569f05e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c569f9de0 con 0x561c56995f50 2026-02-24T09:13:19.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c5689a9a0 con 0x561c56996860 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c56676df0 con 0x561c569db500 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4e77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56995f50 0x561c56995460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4e77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56995f50 0x561c56995460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36126/0 (socket says 10.20.193.4:36126) 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4e77fe640 1 -- 10.20.193.4:0/4006652997 learned_addr learned my addr 10.20.193.4:0/4006652997 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4e77fe640 1 -- 10.20.193.4:0/4006652997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c569db500 msgr2=0x561c569f05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/4006652997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c569db500 0x561c569f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4e77fe640 1 -- 10.20.193.4:0/4006652997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56996860 msgr2=0x561c569f00a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/4006652997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56996860 0x561c569f00a0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4e77fe640 1 -- 10.20.193.4:0/4006652997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c5682d190 con 0x561c56995f50 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/4006652997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56995f50 0x561c56995460 secure :-1 s=READY pgs=753 gs=1 cs=0 l=1 c_cookie=10482454969199153714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4d4002eb0 tx=0x7fe4d4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917929418d24d232 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.283+0000 7fe4ab7fe640 1 -- 10.20.193.4:0/4006652997 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4d4025160 con 0x561c56995f50 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.284+0000 7fe4ab7fe640 1 -- 10.20.193.4:0/4006652997 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4d4013930 con 0x561c56995f50 2026-02-24T09:13:19.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.284+0000 7fe4ab7fe640 1 -- 10.20.193.4:0/4006652997 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4d4022a90 con 0x561c56995f50 2026-02-24T09:13:19.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 -- 10.20.193.4:0/4006652997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56995f50 msgr2=0x561c56995460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/4006652997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56995f50 0x561c56995460 secure :-1 s=READY pgs=753 gs=1 cs=0 l=1 c_cookie=10482454969199153714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4d4002eb0 tx=0x7fe4d4011000 comp rx=0 tx=0).stop 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 -- 10.20.193.4:0/4006652997 shutdown_connections 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/4006652997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c569db500 0x561c569f05e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/4006652997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56996860 0x561c569f00a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/4006652997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c56995f50 0x561c56995460 unknown :-1 s=CLOSED pgs=753 gs=1 cs=0 l=1 c_cookie=10482454969199153714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 -- 10.20.193.4:0/4006652997 >> 10.20.193.4:0/4006652997 conn(0x561c568b4db0 msgr2=0x561c569f7830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 -- 10.20.193.4:0/4006652997 shutdown_connections 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 -- 10.20.193.4:0/4006652997 wait complete. 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 -- start start 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.285+0000 7fe4f0116e00 1 Processor -- start 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56995f50 0x561c56974030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56996860 0x561c56974570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4f0116e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c56974ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c569d8790 con 0x561c569db500 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c569e50a0 con 0x561c56995f50 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4f0116e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c569e0370 con 0x561c56996860 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c56974ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c56974ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36140/0 (socket says 10.20.193.4:36140) 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e7fff640 1 -- 10.20.193.4:0/3076577951 learned_addr learned my addr 10.20.193.4:0/3076577951 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56995f50 0x561c56974030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e6ffd640 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56996860 0x561c56974570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e7fff640 1 -- 10.20.193.4:0/3076577951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56996860 msgr2=0x561c56974570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e7fff640 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56996860 0x561c56974570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e7fff640 1 -- 10.20.193.4:0/3076577951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56995f50 msgr2=0x561c56974030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e7fff640 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56995f50 0x561c56974030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e7fff640 1 -- 10.20.193.4:0/3076577951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c56820d00 con 0x561c569db500 2026-02-24T09:13:19.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4a97fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.286+0000 7fe4e7fff640 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c56974ab0 secure :-1 s=READY pgs=754 gs=1 cs=0 l=1 c_cookie=9547467256100364397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc042bd0 tx=0x7fe4dc003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847f6ae28089206d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.287+0000 7fe4a97fa640 1 -- 10.20.193.4:0/3076577951 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4dc0f80c0 con 0x561c569db500 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.287+0000 7fe4a97fa640 1 -- 10.20.193.4:0/3076577951 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe4dc0ee070 con 0x561c569db500 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.287+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3076577951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d4019040 con 0x561c569db500 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.287+0000 7fe4a97fa640 1 -- 10.20.193.4:0/3076577951 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4dc006c90 con 0x561c569db500 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.287+0000 7fe4f0116e00 10 client.16527 _ll_register_callbacks cb 0x561c56847080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.287+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3076577951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c568927b0 con 0x561c569db500 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.287+0000 7fe4a97fa640 1 -- 10.20.193.4:0/3076577951 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe4dc0b2030 con 0x561c569db500 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.287+0000 7fe4a97fa640 1 -- 10.20.193.4:0/3076577951 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe4dc0dde70 con 0x561c569db500 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.287+0000 7fe4f0116e00 10 client.16527 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.287+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3076577951 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561c56832970 con 0x561c569db500 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.288+0000 7fe4a97fa640 1 -- 10.20.193.4:0/3076577951 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fe4dc0dd9e0 con 0x561c569db500 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.288+0000 7fe4f0116e00 10 client.16527 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:19.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.288+0000 7fe4f0116e00 10 client.16527 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:13:19.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.288+0000 7fe4f0116e00 20 client.16527 populate_metadata read hostname 'trial004' 2026-02-24T09:13:19.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.288+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x561c56a88b10 0x561c56aa8fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.288+0000 7fe4f0116e00 4 client.16527 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:13:19.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.288+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3076577951 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c56aa9790 con 0x561c56a88b10 2026-02-24T09:13:19.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.289+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x561c56a88b10 0x561c56aa8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4e77fe640 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x561c56a88b10 0x561c56aa8fc0 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=3982672189895410029 s_cookie=12914252780923618106 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37454b416f8b016d server_cookie=b338a47b4a8d833a in_seq=0 out_seq=0 2026-02-24T09:13:19.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4a97fa640 10 client.16527 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:13:19.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4a97fa640 1 -- 10.20.193.4:0/3076577951 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c56aa9790 con 0x561c56a88b10 2026-02-24T09:13:19.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4a97fa640 10 client.16527 handle_command_reply: tid=0 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 client.16527 shutdown 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3076577951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 msgr2=0x561c56974ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c56974ab0 secure :-1 s=READY pgs=754 gs=1 cs=0 l=1 c_cookie=9547467256100364397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc042bd0 tx=0x7fe4dc003f60 comp rx=0 tx=0).stop 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3076577951 shutdown_connections 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x561c56a88b10 0x561c56aa8fc0 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=3982672189895410029 s_cookie=12914252780923618106 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c569db500 0x561c56974ab0 unknown :-1 s=CLOSED pgs=754 gs=1 cs=0 l=1 c_cookie=9547467256100364397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c56996860 0x561c56974570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 --2- 10.20.193.4:0/3076577951 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c56995f50 0x561c56974030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4a97fa640 0 client.16527 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3076577951 >> 10.20.193.4:0/3076577951 conn(0x561c568b4db0 msgr2=0x561c56994450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3076577951 shutdown_connections 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 1 -- 10.20.193.4:0/3076577951 wait complete. 2026-02-24T09:13:19.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.292+0000 7fe4f0116e00 20 client.16527 trim_cache size 0 max 16384 2026-02-24T09:13:19.298 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:13:19.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 -- 10.20.193.4:0/119722518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe4bc0b57e0 msgr2=0x7fe4bc0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe4bc0b57e0 0x7fe4bc0d5c90 secure :-1 s=READY pgs=340 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4d4004760 tx=0x7fe4d4009190 comp rx=0 tx=0).stop 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 -- 10.20.193.4:0/119722518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe4e81135c0 msgr2=0x7fe4e8061480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe4e81135c0 0x7fe4e8061480 secure :-1 s=READY pgs=750 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc00aa30 tx=0x7fe4dc0039b0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 -- 10.20.193.4:0/119722518 shutdown_connections 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe4bc0b57e0 0x7fe4bc0d5c90 unknown :-1 s=CLOSED pgs=340 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe4e81135c0 0x7fe4e8061480 unknown :-1 s=CLOSED pgs=750 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe4e810ddc0 0x7fe4e8173e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 --2- 10.20.193.4:0/119722518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe4e810d3d0 0x7fe4e8060f40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 -- 10.20.193.4:0/119722518 >> 10.20.193.4:0/119722518 conn(0x7fe4e80eaca0 msgr2=0x7fe4e810b860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 -- 10.20.193.4:0/119722518 shutdown_connections 2026-02-24T09:13:19.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.293+0000 7fe4ee11c640 1 -- 10.20.193.4:0/119722518 wait complete. 2026-02-24T09:13:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:18 trial090 ceph-mon[47278]: pgmap v257: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 833 MiB/s wr, 236 op/s 2026-02-24T09:13:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:18 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2798172636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:19.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:18 trial014 ceph-mon[46941]: pgmap v257: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 833 MiB/s wr, 236 op/s 2026-02-24T09:13:19.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:18 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2798172636' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:19.350 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:13:19.565 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:19.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.711+0000 7f4063e5a640 1 -- 10.20.193.4:0/26011445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f405c1135c0 msgr2=0x7f405c173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.711+0000 7f4063e5a640 1 --2- 10.20.193.4:0/26011445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f405c1135c0 0x7f405c173f90 secure :-1 s=READY pgs=755 gs=1 cs=0 l=1 c_cookie=13339832796305272123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f405800aa30 tx=0x7f4058030290 comp rx=0 tx=0).stop 2026-02-24T09:13:19.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.711+0000 7f4063e5a640 1 -- 10.20.193.4:0/26011445 shutdown_connections 2026-02-24T09:13:19.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.711+0000 7f4063e5a640 1 --2- 10.20.193.4:0/26011445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f405c1135c0 0x7f405c173f90 unknown :-1 s=CLOSED pgs=755 gs=1 cs=0 l=1 c_cookie=13339832796305272123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.711+0000 7f4063e5a640 1 --2- 10.20.193.4:0/26011445 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f405c10ddc0 0x7f405c112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.711+0000 7f4063e5a640 1 --2- 10.20.193.4:0/26011445 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c10d3d0 0x7f405c10d7a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.711+0000 7f4063e5a640 1 -- 10.20.193.4:0/26011445 >> 10.20.193.4:0/26011445 conn(0x7f405c0eacc0 msgr2=0x7f405c10b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.711+0000 7f4063e5a640 1 -- 10.20.193.4:0/26011445 shutdown_connections 2026-02-24T09:13:19.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.711+0000 7f4063e5a640 1 -- 10.20.193.4:0/26011445 wait complete. 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f4063e5a640 1 Processor -- start 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f4063e5a640 1 -- start start 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f4063e5a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f405c10d3d0 0x7f405c0f4ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f4063e5a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c10ddc0 0x7f405c173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f4063e5a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f405c1135c0 0x7f405c0f5570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f4063e5a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f405c0fa7f0 con 0x7f405c1135c0 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f4063e5a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f405c0fa960 con 0x7f405c10d3d0 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f4063e5a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f405c0faad0 con 0x7f405c10ddc0 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f40623d0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f405c1135c0 0x7f405c0f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f40623d0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f405c1135c0 0x7f405c0f5570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36166/0 (socket says 10.20.193.4:36166) 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f40623d0640 1 -- 10.20.193.4:0/3225427616 learned_addr learned my addr 10.20.193.4:0/3225427616 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f40623d0640 1 -- 10.20.193.4:0/3225427616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c10ddc0 msgr2=0x7f405c173e90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f40623d0640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c10ddc0 0x7f405c173e90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f40623d0640 1 -- 10.20.193.4:0/3225427616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f405c10d3d0 msgr2=0x7f405c0f4ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f40623d0640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f405c10d3d0 0x7f405c0f4ee0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f40623d0640 1 -- 10.20.193.4:0/3225427616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405800a650 con 0x7f405c1135c0 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f40623d0640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f405c1135c0 0x7f405c0f5570 secure :-1 s=READY pgs=756 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4058039820 tx=0x7f40580039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.712+0000 7f404affd640 1 -- 10.20.193.4:0/3225427616 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f405803e070 con 0x7f405c1135c0 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.713+0000 7f4063e5a640 1 -- 10.20.193.4:0/3225427616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c0fad50 con 0x7f405c1135c0 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.713+0000 7f404affd640 1 -- 10.20.193.4:0/3225427616 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4058005e10 con 0x7f405c1135c0 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.713+0000 7f404affd640 1 -- 10.20.193.4:0/3225427616 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4058006020 con 0x7f405c1135c0 2026-02-24T09:13:19.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.713+0000 7f4063e5a640 1 -- 10.20.193.4:0/3225427616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c0fb1e0 con 0x7f405c1135c0 2026-02-24T09:13:19.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.718+0000 7f404affd640 1 -- 10.20.193.4:0/3225427616 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f4058039b80 con 0x7f405c1135c0 2026-02-24T09:13:19.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.719+0000 7f4065e54e00 1 Processor -- start 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.719+0000 7f4065e54e00 1 -- start start 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.719+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797cf50 0x5631d797d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.719+0000 7f404affd640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40380b56e0 0x7f40380d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.719+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d79c1fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.719+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79e28e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.719+0000 7f4065e54e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5631d788dee0 con 0x5631d79c2500 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.719+0000 7f4065e54e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5631d7889c10 con 0x5631d797d860 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.719+0000 7f4065e54e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5631d7883d70 con 0x5631d797cf50 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f404affd640 1 -- 10.20.193.4:0/3225427616 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f405810c5e0 con 0x7f405c1135c0 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f40623d0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79e28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f4061bcf640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40380b56e0 0x7f40380d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f40623d0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79e28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36172/0 (socket says 10.20.193.4:36172) 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f40623d0640 1 -- 10.20.193.4:0/1207681119 learned_addr learned my addr 10.20.193.4:0/1207681119 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f40613ce640 1 --2- 10.20.193.4:0/1207681119 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d79c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f40623d0640 1 -- 10.20.193.4:0/1207681119 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797cf50 msgr2=0x5631d797d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f40623d0640 1 --2- 10.20.193.4:0/1207681119 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797cf50 0x5631d797d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f40623d0640 1 -- 10.20.193.4:0/1207681119 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 msgr2=0x5631d79c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f40623d0640 1 --2- 10.20.193.4:0/1207681119 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d79c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f40623d0640 1 -- 10.20.193.4:0/1207681119 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d782f340 con 0x5631d79c2500 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f40623d0640 1 --2- 10.20.193.4:0/1207681119 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79e28e0 secure :-1 s=READY pgs=757 gs=1 cs=0 l=1 c_cookie=14046452787905043380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40580ceee0 tx=0x7f40580ce8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ef0663a9601bb4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f4061bcf640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40380b56e0 0x7f40380d5b90 secure :-1 s=READY pgs=341 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f404c004760 tx=0x7f404c006c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f402a4e6640 1 -- 10.20.193.4:0/1207681119 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40580bc0d0 con 0x5631d79c2500 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f402a4e6640 1 -- 10.20.193.4:0/1207681119 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40580d3310 con 0x5631d79c2500 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.720+0000 7f402a4e6640 1 -- 10.20.193.4:0/1207681119 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40580d35a0 con 0x5631d79c2500 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.721+0000 7f4065e54e00 1 -- 10.20.193.4:0/1207681119 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 msgr2=0x5631d79e28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.721+0000 7f4065e54e00 1 --2- 10.20.193.4:0/1207681119 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79e28e0 secure :-1 s=READY pgs=757 gs=1 cs=0 l=1 c_cookie=14046452787905043380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40580ceee0 tx=0x7f40580ce8a0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.721+0000 7f4065e54e00 1 -- 10.20.193.4:0/1207681119 shutdown_connections 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.721+0000 7f4065e54e00 1 --2- 10.20.193.4:0/1207681119 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79e28e0 unknown :-1 s=CLOSED pgs=757 gs=1 cs=0 l=1 c_cookie=14046452787905043380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.721+0000 7f4065e54e00 1 --2- 10.20.193.4:0/1207681119 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d79c1fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.721+0000 7f4065e54e00 1 --2- 10.20.193.4:0/1207681119 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797cf50 0x5631d797d320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.721+0000 7f4065e54e00 1 -- 10.20.193.4:0/1207681119 >> 10.20.193.4:0/1207681119 conn(0x5631d789bdb0 msgr2=0x5631d797b830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.721+0000 7f4065e54e00 1 -- 10.20.193.4:0/1207681119 shutdown_connections 2026-02-24T09:13:19.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.721+0000 7f4065e54e00 1 -- 10.20.193.4:0/1207681119 wait complete. 2026-02-24T09:13:19.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.722+0000 7f4065e54e00 1 -- start start 2026-02-24T09:13:19.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.722+0000 7f4065e54e00 1 Processor -- start 2026-02-24T09:13:19.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797cf50 0x5631d7995470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797d860 0x5631d79959b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d799a9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5631d799aee0 con 0x5631d79c2500 2026-02-24T09:13:19.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5631d799b050 con 0x5631d797cf50 2026-02-24T09:13:19.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5631d799b210 con 0x5631d797d860 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40623d0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d799a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40623d0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d799a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36186/0 (socket says 10.20.193.4:36186) 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40623d0640 1 -- 10.20.193.4:0/1115924041 learned_addr learned my addr 10.20.193.4:0/1115924041 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40613ce640 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797d860 0x5631d79959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4061bcf640 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797cf50 0x5631d7995470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40623d0640 1 -- 10.20.193.4:0/1115924041 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797d860 msgr2=0x5631d79959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40623d0640 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797d860 0x5631d79959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40623d0640 1 -- 10.20.193.4:0/1115924041 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797cf50 msgr2=0x5631d7995470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40623d0640 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797cf50 0x5631d7995470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40623d0640 1 -- 10.20.193.4:0/1115924041 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d78079d0 con 0x5631d79c2500 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4061bcf640 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797cf50 0x5631d7995470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40623d0640 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d799a9a0 secure :-1 s=READY pgs=758 gs=1 cs=0 l=1 c_cookie=16947589999814566019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4058032040 tx=0x7f405800a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb31ef5009e8e083 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40177fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40177fe640 1 -- 10.20.193.4:0/1115924041 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40580ea980 con 0x5631d79c2500 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 1 -- 10.20.193.4:0/1115924041 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c0fb1e0 con 0x5631d79c2500 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40177fe640 1 -- 10.20.193.4:0/1115924041 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40580dac10 con 0x5631d79c2500 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40177fe640 1 -- 10.20.193.4:0/1115924041 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40580d0b50 con 0x5631d79c2500 2026-02-24T09:13:19.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 10 client.16539 _ll_register_callbacks cb 0x5631d782e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 1 -- 10.20.193.4:0/1115924041 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5631d75d34a0 con 0x5631d79c2500 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40177fe640 1 -- 10.20.193.4:0/1115924041 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4058040bc0 con 0x5631d79c2500 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f40177fe640 1 -- 10.20.193.4:0/1115924041 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4058040dc0 con 0x5631d79c2500 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 10 client.16539 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.723+0000 7f4065e54e00 1 -- 10.20.193.4:0/1115924041 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5631d7819710 con 0x5631d79c2500 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.724+0000 7f40177fe640 1 -- 10.20.193.4:0/1115924041 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f40580aebe0 con 0x5631d79c2500 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.724+0000 7f4065e54e00 10 client.16539 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.724+0000 7f4065e54e00 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.724+0000 7f4065e54e00 20 client.16539 populate_metadata read hostname 'trial004' 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.724+0000 7f4065e54e00 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5631d79bf6f0 0x5631d79bfb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.724+0000 7f4065e54e00 4 client.16539 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.724+0000 7f4065e54e00 1 -- 10.20.193.4:0/1115924041 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631d78797b0 con 0x5631d79bf6f0 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.724+0000 7f4061bcf640 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5631d79bf6f0 0x5631d79bfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.724+0000 7f4061bcf640 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5631d79bf6f0 0x5631d79bfb90 crc :-1 s=READY pgs=95 gs=4 cs=0 l=0 c_cookie=1978420331432434764 s_cookie=4880343139810240635 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b74c2cf2f70dc4c server_cookie=43ba763a7e67687b in_seq=0 out_seq=0 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.724+0000 7f40177fe640 10 client.16539 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f40177fe640 1 -- 10.20.193.4:0/1115924041 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5631d78797b0 con 0x5631d79bf6f0 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f40177fe640 10 client.16539 handle_command_reply: tid=0 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 client.16539 shutdown 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 -- 10.20.193.4:0/1115924041 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 msgr2=0x5631d799a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d799a9a0 secure :-1 s=READY pgs=758 gs=1 cs=0 l=1 c_cookie=16947589999814566019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4058032040 tx=0x7f405800a390 comp rx=0 tx=0).stop 2026-02-24T09:13:19.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 -- 10.20.193.4:0/1115924041 shutdown_connections 2026-02-24T09:13:19.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5631d79bf6f0 0x5631d79bfb90 crc :-1 s=READY pgs=95 gs=4 cs=0 l=0 c_cookie=1978420331432434764 s_cookie=4880343139810240635 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d799a9a0 unknown :-1 s=CLOSED pgs=758 gs=1 cs=0 l=1 c_cookie=16947589999814566019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797d860 0x5631d79959b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f40177fe640 0 client.16539 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:19.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 --2- 10.20.193.4:0/1115924041 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797cf50 0x5631d7995470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 -- 10.20.193.4:0/1115924041 >> 10.20.193.4:0/1115924041 conn(0x5631d789bdb0 msgr2=0x5631d797bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 -- 10.20.193.4:0/1115924041 shutdown_connections 2026-02-24T09:13:19.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 1 -- 10.20.193.4:0/1115924041 wait complete. 2026-02-24T09:13:19.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.725+0000 7f4065e54e00 20 client.16539 trim_cache size 0 max 16384 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.732+0000 7f4065e54e00 1 Processor -- start 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.732+0000 7f4065e54e00 1 -- start start 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.732+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797cf50 0x5631d797c030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.732+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d797c570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.732+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79bae80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.732+0000 7f4065e54e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5631d78819a0 con 0x5631d79c2500 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.732+0000 7f4065e54e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5631d765ddf0 con 0x5631d797d860 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.732+0000 7f4065e54e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5631d7889c10 con 0x5631d797cf50 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.733+0000 7f40623d0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.733+0000 7f40623d0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79bae80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36192/0 (socket says 10.20.193.4:36192) 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.733+0000 7f40623d0640 1 -- 10.20.193.4:0/3698222997 learned_addr learned my addr 10.20.193.4:0/3698222997 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.733+0000 7f40613ce640 1 --2- 10.20.193.4:0/3698222997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d797c570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.733+0000 7f40623d0640 1 -- 10.20.193.4:0/3698222997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797cf50 msgr2=0x5631d797c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.733+0000 7f40623d0640 1 --2- 10.20.193.4:0/3698222997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797cf50 0x5631d797c030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.733+0000 7f40623d0640 1 -- 10.20.193.4:0/3698222997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 msgr2=0x5631d797c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.733+0000 7f40623d0640 1 --2- 10.20.193.4:0/3698222997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d797c570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.733+0000 7f40623d0640 1 -- 10.20.193.4:0/3698222997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d7987ad0 con 0x5631d79c2500 2026-02-24T09:13:19.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.733+0000 7f40623d0640 1 --2- 10.20.193.4:0/3698222997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79bae80 secure :-1 s=READY pgs=759 gs=1 cs=0 l=1 c_cookie=12561188594468101023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40580ceee0 tx=0x7f4058096000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae524e7981f59b9f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.734+0000 7f4029ce5640 1 -- 10.20.193.4:0/3698222997 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40580ea980 con 0x5631d79c2500 2026-02-24T09:13:19.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.734+0000 7f4029ce5640 1 -- 10.20.193.4:0/3698222997 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5631d75d34a0 con 0x5631d79c2500 2026-02-24T09:13:19.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.734+0000 7f4029ce5640 1 -- 10.20.193.4:0/3698222997 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40580dac10 con 0x5631d79c2500 2026-02-24T09:13:19.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.734+0000 7f4065e54e00 1 -- 10.20.193.4:0/3698222997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 msgr2=0x5631d79bae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.735+0000 7f4065e54e00 1 --2- 10.20.193.4:0/3698222997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79bae80 secure :-1 s=READY pgs=759 gs=1 cs=0 l=1 c_cookie=12561188594468101023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40580ceee0 tx=0x7f4058096000 comp rx=0 tx=0).stop 2026-02-24T09:13:19.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.735+0000 7f4065e54e00 1 -- 10.20.193.4:0/3698222997 shutdown_connections 2026-02-24T09:13:19.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.735+0000 7f4065e54e00 1 --2- 10.20.193.4:0/3698222997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d79c2500 0x5631d79bae80 unknown :-1 s=CLOSED pgs=759 gs=1 cs=0 l=1 c_cookie=12561188594468101023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.735+0000 7f4065e54e00 1 --2- 10.20.193.4:0/3698222997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d797c570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.735+0000 7f4065e54e00 1 --2- 10.20.193.4:0/3698222997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d797cf50 0x5631d797c030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.735+0000 7f4065e54e00 1 -- 10.20.193.4:0/3698222997 >> 10.20.193.4:0/3698222997 conn(0x5631d789bdb0 msgr2=0x5631d797b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.735+0000 7f4065e54e00 1 -- 10.20.193.4:0/3698222997 shutdown_connections 2026-02-24T09:13:19.738 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.735+0000 7f4065e54e00 1 -- 10.20.193.4:0/3698222997 wait complete. 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.735+0000 7f4065e54e00 1 -- start start 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.735+0000 7f4065e54e00 1 Processor -- start 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d797cf50 0x5631d79a1310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d799fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4065e54e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d79c2500 0x5631d79a0340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4065e54e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5631d79a0880 con 0x5631d797cf50 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4065e54e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5631d79a09f0 con 0x5631d797d860 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4065e54e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5631d79a0bb0 con 0x5631d79c2500 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4061bcf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d797cf50 0x5631d79a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4061bcf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d797cf50 0x5631d79a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36198/0 (socket says 10.20.193.4:36198) 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4061bcf640 1 -- 10.20.193.4:0/2522960680 learned_addr learned my addr 10.20.193.4:0/2522960680 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:19.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f40623d0640 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d79c2500 0x5631d79a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4061bcf640 1 -- 10.20.193.4:0/2522960680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d79c2500 msgr2=0x5631d79a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4061bcf640 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d79c2500 0x5631d79a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4061bcf640 1 -- 10.20.193.4:0/2522960680 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 msgr2=0x5631d799fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f40613ce640 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d799fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4061bcf640 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d799fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4061bcf640 1 -- 10.20.193.4:0/2522960680 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d7814190 con 0x5631d797cf50 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f40613ce640 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d799fe00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4061bcf640 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d797cf50 0x5631d79a1310 secure :-1 s=READY pgs=760 gs=1 cs=0 l=1 c_cookie=4035319286646668700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5631d79c0440 tx=0x7f404c004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38005582dbdb7d9c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f40177fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f40177fe640 1 -- 10.20.193.4:0/2522960680 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f404c026070 con 0x5631d797cf50 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f40177fe640 1 -- 10.20.193.4:0/2522960680 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f404c01b040 con 0x5631d797cf50 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f40177fe640 1 -- 10.20.193.4:0/2522960680 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f404c022bf0 con 0x5631d797cf50 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f4065e54e00 1 -- 10.20.193.4:0/2522960680 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4058095030 con 0x5631d797cf50 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f40177fe640 1 -- 10.20.193.4:0/2522960680 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f404c022d80 con 0x5631d797cf50 2026-02-24T09:13:19.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.736+0000 7f40177fe640 10 client.16545 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f4065e54e00 10 client.16545 _ll_register_callbacks cb 0x5631d782e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f4065e54e00 1 -- 10.20.193.4:0/2522960680 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40580d3310 con 0x5631d797cf50 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f40177fe640 1 -- 10.20.193.4:0/2522960680 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f404c022500 con 0x5631d797cf50 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f4065e54e00 10 client.16545 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f4065e54e00 1 -- 10.20.193.4:0/2522960680 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5631d7807d00 con 0x5631d797cf50 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f40177fe640 1 -- 10.20.193.4:0/2522960680 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f404c005a20 con 0x5631d797cf50 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f4065e54e00 10 client.16545 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f4065e54e00 10 client.16545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f4065e54e00 20 client.16545 populate_metadata read hostname 'trial004' 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f4065e54e00 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5631d7a11dc0 0x5631d7a12260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f4065e54e00 4 client.16545 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f4065e54e00 1 -- 10.20.193.4:0/2522960680 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631d75b8160 con 0x5631d7a11dc0 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.737+0000 7f40613ce640 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5631d7a11dc0 0x5631d7a12260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f40177fe640 10 client.16545 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f40613ce640 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5631d7a11dc0 0x5631d7a12260 crc :-1 s=READY pgs=96 gs=4 cs=0 l=0 c_cookie=11984430392682219966 s_cookie=15630701253720566595 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6513ff2273809be server_cookie=d8eb67f9aa446b43 in_seq=0 out_seq=0 2026-02-24T09:13:19.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f40177fe640 1 -- 10.20.193.4:0/2522960680 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631d75b8160 con 0x5631d7a11dc0 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f40177fe640 10 client.16545 handle_command_reply: tid=0 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 client.16545 shutdown 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 -- 10.20.193.4:0/2522960680 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d797cf50 msgr2=0x5631d79a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d797cf50 0x5631d79a1310 secure :-1 s=READY pgs=760 gs=1 cs=0 l=1 c_cookie=4035319286646668700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5631d79c0440 tx=0x7f404c004790 comp rx=0 tx=0).stop 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 -- 10.20.193.4:0/2522960680 shutdown_connections 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5631d7a11dc0 0x5631d7a12260 crc :-1 s=READY pgs=96 gs=4 cs=0 l=0 c_cookie=11984430392682219966 s_cookie=15630701253720566595 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5631d79c2500 0x5631d79a0340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5631d797d860 0x5631d799fe00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f40177fe640 0 client.16545 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 --2- 10.20.193.4:0/2522960680 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5631d797cf50 0x5631d79a1310 unknown :-1 s=CLOSED pgs=760 gs=1 cs=0 l=1 c_cookie=4035319286646668700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 -- 10.20.193.4:0/2522960680 >> 10.20.193.4:0/2522960680 conn(0x5631d789bdb0 msgr2=0x5631d797c030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 -- 10.20.193.4:0/2522960680 shutdown_connections 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 1 -- 10.20.193.4:0/2522960680 wait complete. 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.738+0000 7f4065e54e00 20 client.16545 trim_cache size 0 max 16384 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 -- 10.20.193.4:0/3225427616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40380b56e0 msgr2=0x7f40380d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40380b56e0 0x7f40380d5b90 secure :-1 s=READY pgs=341 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f404c004760 tx=0x7f404c006c80 comp rx=0 tx=0).stop 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 -- 10.20.193.4:0/3225427616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f405c1135c0 msgr2=0x7f405c0f5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:19.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f405c1135c0 0x7f405c0f5570 secure :-1 s=READY pgs=756 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4058039820 tx=0x7f40580039b0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 -- 10.20.193.4:0/3225427616 shutdown_connections 2026-02-24T09:13:19.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40380b56e0 0x7f40380d5b90 unknown :-1 s=CLOSED pgs=341 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f405c1135c0 0x7f405c0f5570 unknown :-1 s=CLOSED pgs=756 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f405c10ddc0 0x7f405c173e90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 --2- 10.20.193.4:0/3225427616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f405c10d3d0 0x7f405c0f4ee0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:19.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 -- 10.20.193.4:0/3225427616 >> 10.20.193.4:0/3225427616 conn(0x7f405c0eacc0 msgr2=0x7f405c10b880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:19.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 -- 10.20.193.4:0/3225427616 shutdown_connections 2026-02-24T09:13:19.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:19.739+0000 7f4063e5a640 1 -- 10.20.193.4:0/3225427616 wait complete. 2026-02-24T09:13:20.821 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:13:20.821 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:13:20.971 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:21.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 -- 10.20.193.4:0/2505027704 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f788c10d3b0 msgr2=0x7f788c10d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 --2- 10.20.193.4:0/2505027704 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f788c10d3b0 0x7f788c10d780 secure :-1 s=READY pgs=761 gs=1 cs=0 l=1 c_cookie=15980819503349474318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f787c009950 tx=0x7f787c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 -- 10.20.193.4:0/2505027704 shutdown_connections 2026-02-24T09:13:21.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 --2- 10.20.193.4:0/2505027704 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f788c1135a0 0x7f788c173f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 --2- 10.20.193.4:0/2505027704 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f788c10dda0 0x7f788c112df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 --2- 10.20.193.4:0/2505027704 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f788c10d3b0 0x7f788c10d780 unknown :-1 s=CLOSED pgs=761 gs=1 cs=0 l=1 c_cookie=15980819503349474318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 -- 10.20.193.4:0/2505027704 >> 10.20.193.4:0/2505027704 conn(0x7f788c0eac60 msgr2=0x7f788c10b070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 -- 10.20.193.4:0/2505027704 shutdown_connections 2026-02-24T09:13:21.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 -- 10.20.193.4:0/2505027704 wait complete. 2026-02-24T09:13:21.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 Processor -- start 2026-02-24T09:13:21.122 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:20 trial004 ceph-mon[41596]: pgmap v258: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 703 MiB/s wr, 202 op/s 2026-02-24T09:13:21.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.116+0000 7f7893bfe640 1 -- start start 2026-02-24T09:13:21.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7893bfe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f788c10d3b0 0x7f788c060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7893bfe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f788c10dda0 0x7f788c0614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7893bfe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f788c1135a0 0x7f788c061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7893bfe640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f788c164000 con 0x7f788c1135a0 2026-02-24T09:13:21.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7893bfe640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f788c164170 con 0x7f788c10d3b0 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7893bfe640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f788c164330 con 0x7f788c10dda0 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7892174640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f788c1135a0 0x7f788c061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7892174640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f788c1135a0 0x7f788c061a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36228/0 (socket says 10.20.193.4:36228) 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7892174640 1 -- 10.20.193.4:0/641494543 learned_addr learned my addr 10.20.193.4:0/641494543 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7891172640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f788c10dda0 0x7f788c0614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7891973640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f788c10d3b0 0x7f788c060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7892174640 1 -- 10.20.193.4:0/641494543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f788c10dda0 msgr2=0x7f788c0614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7892174640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f788c10dda0 0x7f788c0614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7892174640 1 -- 10.20.193.4:0/641494543 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f788c10d3b0 msgr2=0x7f788c060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7892174640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f788c10d3b0 0x7f788c060f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7892174640 1 -- 10.20.193.4:0/641494543 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c009570 con 0x7f788c1135a0 2026-02-24T09:13:21.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7892174640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f788c1135a0 0x7f788c061a10 secure :-1 s=READY pgs=762 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f788800f8d0 tx=0x7f788800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f787affd640 1 -- 10.20.193.4:0/641494543 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f788800dce0 con 0x7f788c1135a0 2026-02-24T09:13:21.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f787affd640 1 -- 10.20.193.4:0/641494543 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f788800de40 con 0x7f788c1135a0 2026-02-24T09:13:21.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7893bfe640 1 -- 10.20.193.4:0/641494543 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788c164610 con 0x7f788c1135a0 2026-02-24T09:13:21.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f787affd640 1 -- 10.20.193.4:0/641494543 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7888011740 con 0x7f788c1135a0 2026-02-24T09:13:21.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.117+0000 7f7893bfe640 1 -- 10.20.193.4:0/641494543 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f788c164a90 con 0x7f788c1135a0 2026-02-24T09:13:21.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.120+0000 7f787affd640 1 -- 10.20.193.4:0/641494543 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f7888020060 con 0x7f788c1135a0 2026-02-24T09:13:21.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.121+0000 7f787affd640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78680b56e0 0x7f78680d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.121+0000 7f7891973640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78680b56e0 0x7f78680d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.121+0000 7f787affd640 1 -- 10.20.193.4:0/641494543 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f7888015070 con 0x7f788c1135a0 2026-02-24T09:13:21.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.121+0000 7f7891973640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78680b56e0 0x7f78680d5b90 secure :-1 s=READY pgs=342 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f787c0023d0 tx=0x7f787c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.123+0000 7f7895bf8e00 1 Processor -- start 2026-02-24T09:13:21.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.123+0000 7f7895bf8e00 1 -- start start 2026-02-24T09:13:21.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c5c6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 0x5597d0ca1370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0ca18b0 0x5597d0cc1c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5597d0b6c520 con 0x5597d0c5c300 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5597d0b68250 con 0x5597d0ca18b0 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5597d0b623b0 con 0x5597d0c5cc10 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7891172640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 0x5597d0ca1370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7891973640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c5c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7891172640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 0x5597d0ca1370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:34122/0 (socket says 10.20.193.4:34122) 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7891172640 1 -- 10.20.193.4:0/804195447 learned_addr learned my addr 10.20.193.4:0/804195447 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7892174640 1 --2- 10.20.193.4:0/804195447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0ca18b0 0x5597d0cc1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7891172640 1 -- 10.20.193.4:0/804195447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0ca18b0 msgr2=0x5597d0cc1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7891172640 1 --2- 10.20.193.4:0/804195447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0ca18b0 0x5597d0cc1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7891172640 1 -- 10.20.193.4:0/804195447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 msgr2=0x5597d0c5c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7891172640 1 --2- 10.20.193.4:0/804195447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c5c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7891172640 1 -- 10.20.193.4:0/804195447 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d0b0d6e0 con 0x5597d0c5cc10 2026-02-24T09:13:21.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.124+0000 7f7891973640 1 --2- 10.20.193.4:0/804195447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c5c6d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:13:21.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.125+0000 7f7891172640 1 --2- 10.20.193.4:0/804195447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 0x5597d0ca1370 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=12752371744321045240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f788000bd10 tx=0x7f78800107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0f9868957fc02f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f785a4e6640 1 -- 10.20.193.4:0/804195447 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78800042f0 con 0x5597d0c5cc10 2026-02-24T09:13:21.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f785a4e6640 1 -- 10.20.193.4:0/804195447 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f788000be10 con 0x5597d0c5cc10 2026-02-24T09:13:21.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f785a4e6640 1 -- 10.20.193.4:0/804195447 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7880011ac0 con 0x5597d0c5cc10 2026-02-24T09:13:21.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f7895bf8e00 1 -- 10.20.193.4:0/804195447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 msgr2=0x5597d0ca1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/804195447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 0x5597d0ca1370 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=12752371744321045240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f788000bd10 tx=0x7f78800107a0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f7895bf8e00 1 -- 10.20.193.4:0/804195447 shutdown_connections 2026-02-24T09:13:21.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/804195447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0ca18b0 0x5597d0cc1c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/804195447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 0x5597d0ca1370 unknown :-1 s=CLOSED pgs=98 gs=2 cs=0 l=1 c_cookie=12752371744321045240 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/804195447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c5c6d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f7895bf8e00 1 -- 10.20.193.4:0/804195447 >> 10.20.193.4:0/804195447 conn(0x5597d0b7a4f0 msgr2=0x5597d0c5abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f7895bf8e00 1 -- 10.20.193.4:0/804195447 shutdown_connections 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.126+0000 7f7895bf8e00 1 -- 10.20.193.4:0/804195447 wait complete. 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.127+0000 7f7895bf8e00 1 -- start start 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.127+0000 7f7895bf8e00 1 Processor -- start 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c74380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0c5cc10 0x5597d0c748c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0ca18b0 0x5597d0c76650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5597d0c76bc0 con 0x5597d0c5c300 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5597d0c76d30 con 0x5597d0c5cc10 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5597d0c76ef0 con 0x5597d0ca18b0 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7891973640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c74380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7891973640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c74380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36256/0 (socket says 10.20.193.4:36256) 2026-02-24T09:13:21.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7891973640 1 -- 10.20.193.4:0/2849717513 learned_addr learned my addr 10.20.193.4:0/2849717513 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7892174640 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0ca18b0 0x5597d0c76650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7891973640 1 -- 10.20.193.4:0/2849717513 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0ca18b0 msgr2=0x5597d0c76650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7891973640 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0ca18b0 0x5597d0c76650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7891973640 1 -- 10.20.193.4:0/2849717513 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0c5cc10 msgr2=0x5597d0c748c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7891973640 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0c5cc10 0x5597d0c748c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7891973640 1 -- 10.20.193.4:0/2849717513 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788000b930 con 0x5597d0c5c300 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7891973640 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c74380 secure :-1 s=READY pgs=763 gs=1 cs=0 l=1 c_cookie=15875933459488070056 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f787c0043a0 tx=0x7f787c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc52a55dfa8659a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f78477fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f78477fe640 1 -- 10.20.193.4:0/2849717513 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f787c038d50 con 0x5597d0c5c300 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f78477fe640 1 -- 10.20.193.4:0/2849717513 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f787c0438e0 con 0x5597d0c5c300 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f78477fe640 1 -- 10.20.193.4:0/2849717513 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f787c050650 con 0x5597d0c5c300 2026-02-24T09:13:21.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2849717513 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f788c1747e0 con 0x5597d0c5c300 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f78477fe640 1 -- 10.20.193.4:0/2849717513 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f787c0507b0 con 0x5597d0c5c300 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.128+0000 7f78477fe640 10 client.16557 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7895bf8e00 10 client.16557 _ll_register_callbacks cb 0x5597d0ade790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2849717513 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597d07ef9d0 con 0x5597d0c5c300 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f78477fe640 1 -- 10.20.193.4:0/2849717513 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f787c043400 con 0x5597d0c5c300 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7895bf8e00 10 client.16557 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2849717513 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5597d0ae5cd0 con 0x5597d0c5c300 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f78477fe640 1 -- 10.20.193.4:0/2849717513 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f787c04f070 con 0x5597d0c5c300 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7895bf8e00 10 client.16557 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7895bf8e00 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7895bf8e00 20 client.16557 populate_metadata read hostname 'trial004' 2026-02-24T09:13:21.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5597d0c9ec10 0x5597d0c9f0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7895bf8e00 4 client.16557 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2849717513 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597d0b72b70 con 0x5597d0c9ec10 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.129+0000 7f7891172640 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5597d0c9ec10 0x5597d0c9f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.130+0000 7f7891172640 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5597d0c9ec10 0x5597d0c9f0b0 crc :-1 s=READY pgs=97 gs=4 cs=0 l=0 c_cookie=7983114757060447584 s_cookie=2637788460389353059 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec9b8933fc44d60 server_cookie=249b4ea10e21c663 in_seq=0 out_seq=0 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.130+0000 7f78477fe640 10 client.16557 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f78477fe640 1 -- 10.20.193.4:0/2849717513 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5597d0b72b70 con 0x5597d0c9ec10 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f78477fe640 10 client.16557 handle_command_reply: tid=0 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 client.16557 shutdown 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2849717513 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 msgr2=0x5597d0c74380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c74380 secure :-1 s=READY pgs=763 gs=1 cs=0 l=1 c_cookie=15875933459488070056 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f787c0043a0 tx=0x7f787c009310 comp rx=0 tx=0).stop 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2849717513 shutdown_connections 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5597d0c9ec10 0x5597d0c9f0b0 crc :-1 s=READY pgs=97 gs=4 cs=0 l=0 c_cookie=7983114757060447584 s_cookie=2637788460389353059 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.140 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0ca18b0 0x5597d0c76650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0c5cc10 0x5597d0c748c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2849717513 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c74380 unknown :-1 s=CLOSED pgs=763 gs=1 cs=0 l=1 c_cookie=15875933459488070056 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2849717513 >> 10.20.193.4:0/2849717513 conn(0x5597d0b7a4f0 msgr2=0x5597d0c5b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f78477fe640 0 client.16557 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:21.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2849717513 shutdown_connections 2026-02-24T09:13:21.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2849717513 wait complete. 2026-02-24T09:13:21.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.131+0000 7f7895bf8e00 20 client.16557 trim_cache size 0 max 16384 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7895bf8e00 1 Processor -- start 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7895bf8e00 1 -- start start 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5c300 0x5597d0c9f070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0c5cc10 0x5597d0c765e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0ca18b0 0x5597d0c77d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5597d0b5ffe0 con 0x5597d0ca18b0 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5597d082afe0 con 0x5597d0c5cc10 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5597d0c69050 con 0x5597d0c5c300 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7892174640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0ca18b0 0x5597d0c77d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7892174640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0ca18b0 0x5597d0c77d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36266/0 (socket says 10.20.193.4:36266) 2026-02-24T09:13:21.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7892174640 1 -- 10.20.193.4:0/614086983 learned_addr learned my addr 10.20.193.4:0/614086983 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7891172640 1 --2- 10.20.193.4:0/614086983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0c5cc10 0x5597d0c765e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7892174640 1 -- 10.20.193.4:0/614086983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5c300 msgr2=0x5597d0c9f070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7892174640 1 --2- 10.20.193.4:0/614086983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5c300 0x5597d0c9f070 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7892174640 1 -- 10.20.193.4:0/614086983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0c5cc10 msgr2=0x5597d0c765e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7892174640 1 --2- 10.20.193.4:0/614086983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0c5cc10 0x5597d0c765e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7892174640 1 -- 10.20.193.4:0/614086983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d0af7ab0 con 0x5597d0ca18b0 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.142+0000 7f7892174640 1 --2- 10.20.193.4:0/614086983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0ca18b0 0x5597d0c77d30 secure :-1 s=READY pgs=764 gs=1 cs=0 l=1 c_cookie=14537133317443172475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78880ae290 tx=0x7f788801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9be45bb2eb2387b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7859ce5640 1 -- 10.20.193.4:0/614086983 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78880b3d40 con 0x5597d0ca18b0 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7859ce5640 1 -- 10.20.193.4:0/614086983 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f78880b6320 con 0x5597d0ca18b0 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7859ce5640 1 -- 10.20.193.4:0/614086983 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78880adbc0 con 0x5597d0ca18b0 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7895bf8e00 1 -- 10.20.193.4:0/614086983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0ca18b0 msgr2=0x5597d0c77d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/614086983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0ca18b0 0x5597d0c77d30 secure :-1 s=READY pgs=764 gs=1 cs=0 l=1 c_cookie=14537133317443172475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78880ae290 tx=0x7f788801e000 comp rx=0 tx=0).stop 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7895bf8e00 1 -- 10.20.193.4:0/614086983 shutdown_connections 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/614086983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0ca18b0 0x5597d0c77d30 unknown :-1 s=CLOSED pgs=764 gs=1 cs=0 l=1 c_cookie=14537133317443172475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/614086983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0c5cc10 0x5597d0c765e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/614086983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5c300 0x5597d0c9f070 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7895bf8e00 1 -- 10.20.193.4:0/614086983 >> 10.20.193.4:0/614086983 conn(0x5597d0b7a4f0 msgr2=0x5597d0c77620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7895bf8e00 1 -- 10.20.193.4:0/614086983 shutdown_connections 2026-02-24T09:13:21.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.143+0000 7f7895bf8e00 1 -- 10.20.193.4:0/614086983 wait complete. 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7895bf8e00 1 -- start start 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7895bf8e00 1 Processor -- start 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c98cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 0x5597d0c99230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7895bf8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0ca18b0 0x5597d0c99840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5597d0c61bb0 con 0x5597d0c5c300 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5597d0c66660 con 0x5597d0ca18b0 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7895bf8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5597d0c99ff0 con 0x5597d0c5cc10 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7891973640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c98cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7891973640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c98cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36268/0 (socket says 10.20.193.4:36268) 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7891973640 1 -- 10.20.193.4:0/2960681864 learned_addr learned my addr 10.20.193.4:0/2960681864 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7892174640 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0ca18b0 0x5597d0c99840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7891172640 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 0x5597d0c99230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7891973640 1 -- 10.20.193.4:0/2960681864 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 msgr2=0x5597d0c99230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7891973640 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 0x5597d0c99230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7891973640 1 -- 10.20.193.4:0/2960681864 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0ca18b0 msgr2=0x5597d0c99840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7891973640 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0ca18b0 0x5597d0c99840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7891973640 1 -- 10.20.193.4:0/2960681864 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d0af2530 con 0x5597d0c5c300 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f7891973640 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c98cf0 secure :-1 s=READY pgs=765 gs=1 cs=0 l=1 c_cookie=11959137241867762917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f787c0043a0 tx=0x7f787c02f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f763f591ac3ce5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.144+0000 7f78477fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f78477fe640 1 -- 10.20.193.4:0/2960681864 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f787c005e90 con 0x5597d0c5c300 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f78477fe640 1 -- 10.20.193.4:0/2960681864 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f787c048030 con 0x5597d0c5c300 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f78477fe640 1 -- 10.20.193.4:0/2960681864 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f787c058360 con 0x5597d0c5c300 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2960681864 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f788c164a90 con 0x5597d0c5c300 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f78477fe640 1 -- 10.20.193.4:0/2960681864 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f787c0584f0 con 0x5597d0c5c300 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f78477fe640 10 client.16563 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:21.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 10 client.16563 _ll_register_callbacks cb 0x5597d0ade790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:21.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2960681864 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597d0b747e0 con 0x5597d0c5c300 2026-02-24T09:13:21.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f78477fe640 1 -- 10.20.193.4:0/2960681864 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f787c004100 con 0x5597d0c5c300 2026-02-24T09:13:21.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 10 client.16563 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:21.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2960681864 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5597d0ae6000 con 0x5597d0c5c300 2026-02-24T09:13:21.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f78477fe640 1 -- 10.20.193.4:0/2960681864 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f787c04f070 con 0x5597d0c5c300 2026-02-24T09:13:21.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 10 client.16563 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:21.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 10 client.16563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:21.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 20 client.16563 populate_metadata read hostname 'trial004' 2026-02-24T09:13:21.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5597d0c7f990 0x5597d0c7fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 4 client.16563 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.145+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2960681864 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5597d07ed220 con 0x5597d0c7f990 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.146+0000 7f7891172640 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5597d0c7f990 0x5597d0c7fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.146+0000 7f78477fe640 10 client.16563 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.146+0000 7f7891172640 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5597d0c7f990 0x5597d0c7fe00 crc :-1 s=READY pgs=98 gs=4 cs=0 l=0 c_cookie=13814914217561921944 s_cookie=3598800253999334282 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfb86f494c459998 server_cookie=31f181c38537438a in_seq=0 out_seq=0 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f78477fe640 1 -- 10.20.193.4:0/2960681864 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5597d07ed220 con 0x5597d0c7f990 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f78477fe640 10 client.16563 handle_command_reply: tid=0 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 client.16563 shutdown 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2960681864 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 msgr2=0x5597d0c98cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c98cf0 secure :-1 s=READY pgs=765 gs=1 cs=0 l=1 c_cookie=11959137241867762917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f787c0043a0 tx=0x7f787c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2960681864 shutdown_connections 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5597d0c7f990 0x5597d0c7fe00 crc :-1 s=READY pgs=98 gs=4 cs=0 l=0 c_cookie=13814914217561921944 s_cookie=3598800253999334282 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5597d0ca18b0 0x5597d0c99840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5597d0c5cc10 0x5597d0c99230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f78477fe640 0 client.16563 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 --2- 10.20.193.4:0/2960681864 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5597d0c5c300 0x5597d0c98cf0 unknown :-1 s=CLOSED pgs=765 gs=1 cs=0 l=1 c_cookie=11959137241867762917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2960681864 >> 10.20.193.4:0/2960681864 conn(0x5597d0b7a4f0 msgr2=0x5597d0c79f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2960681864 shutdown_connections 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 1 -- 10.20.193.4:0/2960681864 wait complete. 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7895bf8e00 20 client.16563 trim_cache size 0 max 16384 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:13:21.151 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad", 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7893bfe640 1 -- 10.20.193.4:0/641494543 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78680b56e0 msgr2=0x7f78680d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7893bfe640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78680b56e0 0x7f78680d5b90 secure :-1 s=READY pgs=342 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f787c0023d0 tx=0x7f787c031040 comp rx=0 tx=0).stop 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7893bfe640 1 -- 10.20.193.4:0/641494543 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f788c1135a0 msgr2=0x7f788c061a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.147+0000 7f7893bfe640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f788c1135a0 0x7f788c061a10 secure :-1 s=READY pgs=762 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f788800f8d0 tx=0x7f788800fda0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.148+0000 7f7893bfe640 1 -- 10.20.193.4:0/641494543 shutdown_connections 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.148+0000 7f7893bfe640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78680b56e0 0x7f78680d5b90 unknown :-1 s=CLOSED pgs=342 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.148+0000 7f7893bfe640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f788c1135a0 0x7f788c061a10 unknown :-1 s=CLOSED pgs=762 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.148+0000 7f7893bfe640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f788c10dda0 0x7f788c0614d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.148+0000 7f7893bfe640 1 --2- 10.20.193.4:0/641494543 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f788c10d3b0 0x7f788c060f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.148+0000 7f7893bfe640 1 -- 10.20.193.4:0/641494543 >> 10.20.193.4:0/641494543 conn(0x7f788c0eac60 msgr2=0x7f788c10b040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.148+0000 7f7893bfe640 1 -- 10.20.193.4:0/641494543 shutdown_connections 2026-02-24T09:13:21.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.148+0000 7f7893bfe640 1 -- 10.20.193.4:0/641494543 wait complete. 2026-02-24T09:13:21.204 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:13:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:20 trial090 ceph-mon[47278]: pgmap v258: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 703 MiB/s wr, 202 op/s 2026-02-24T09:13:21.338 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:20 trial014 ceph-mon[46941]: pgmap v258: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 703 MiB/s wr, 202 op/s 2026-02-24T09:13:21.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2021436812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09ac115840 msgr2=0x7f09ac176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 --2- 10.20.193.4:0/2021436812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09ac115840 0x7f09ac176210 secure :-1 s=READY pgs=766 gs=1 cs=0 l=1 c_cookie=7951921554911063597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09a000aa30 tx=0x7f09a0030280 comp rx=0 tx=0).stop 2026-02-24T09:13:21.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2021436812 shutdown_connections 2026-02-24T09:13:21.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 --2- 10.20.193.4:0/2021436812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09ac115840 0x7f09ac176210 unknown :-1 s=CLOSED pgs=766 gs=1 cs=0 l=1 c_cookie=7951921554911063597 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 --2- 10.20.193.4:0/2021436812 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f09ac110040 0x7f09ac115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 --2- 10.20.193.4:0/2021436812 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09ac10f650 0x7f09ac10fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2021436812 >> 10.20.193.4:0/2021436812 conn(0x7f09ac0ecf20 msgr2=0x7f09ac10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2021436812 shutdown_connections 2026-02-24T09:13:21.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2021436812 wait complete. 2026-02-24T09:13:21.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 Processor -- start 2026-02-24T09:13:21.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.501+0000 7f09b1f8b640 1 -- start start 2026-02-24T09:13:21.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09b1f8b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f09ac10f650 0x7f09ac11def0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09b1f8b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09ac110040 0x7f09ac11e430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09b1f8b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09ac115840 0x7f09ac123800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09b1f8b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f09ac123e20 con 0x7f09ac110040 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09b1f8b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f09ac123f90 con 0x7f09ac10f650 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09b1f8b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f09ac124150 con 0x7f09ac115840 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09ac110040 0x7f09ac11e430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09ac110040 0x7f09ac11e430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36282/0 (socket says 10.20.193.4:36282) 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09aaffd640 1 -- 10.20.193.4:0/2923465793 learned_addr learned my addr 10.20.193.4:0/2923465793 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f09ac10f650 0x7f09ac11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09aaffd640 1 -- 10.20.193.4:0/2923465793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09ac115840 msgr2=0x7f09ac123800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09aaffd640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09ac115840 0x7f09ac123800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09aaffd640 1 -- 10.20.193.4:0/2923465793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f09ac10f650 msgr2=0x7f09ac11def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09aaffd640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f09ac10f650 0x7f09ac11def0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09aaffd640 1 -- 10.20.193.4:0/2923465793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a000a650 con 0x7f09ac110040 2026-02-24T09:13:21.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f09ac10f650 0x7f09ac11def0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:21.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09aaffd640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09ac110040 0x7f09ac11e430 secure :-1 s=READY pgs=767 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099c009480 tx=0x7f099c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09a8ff9640 1 -- 10.20.193.4:0/2923465793 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099c00cd40 con 0x7f09ac110040 2026-02-24T09:13:21.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09a8ff9640 1 -- 10.20.193.4:0/2923465793 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f099c004d30 con 0x7f09ac110040 2026-02-24T09:13:21.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2923465793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ac124430 con 0x7f09ac110040 2026-02-24T09:13:21.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09a8ff9640 1 -- 10.20.193.4:0/2923465793 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099c0106b0 con 0x7f09ac110040 2026-02-24T09:13:21.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.502+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2923465793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ac164b30 con 0x7f09ac110040 2026-02-24T09:13:21.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.504+0000 7f09a8ff9640 1 -- 10.20.193.4:0/2923465793 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f099c01f060 con 0x7f09ac110040 2026-02-24T09:13:21.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.505+0000 7f09a8ff9640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09800b56e0 0x7f09800d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.505+0000 7f09a8ff9640 1 -- 10.20.193.4:0/2923465793 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f099c014070 con 0x7f09ac110040 2026-02-24T09:13:21.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.505+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09800b56e0 0x7f09800d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.506+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09800b56e0 0x7f09800d5b90 secure :-1 s=READY pgs=343 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0998004740 tx=0x7f0998005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.507+0000 7f09b3f85e00 1 Processor -- start 2026-02-24T09:13:21.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.507+0000 7f09b3f85e00 1 -- start start 2026-02-24T09:13:21.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x560988550bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988551130 0x560988595890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988595dd0 0x5609885b61b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x560988460de0 con 0x560988595dd0 2026-02-24T09:13:21.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56098845cb10 con 0x560988551130 2026-02-24T09:13:21.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560988456ab0 con 0x560988550820 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09abfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988595dd0 0x5609885b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09abfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988595dd0 0x5609885b61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36294/0 (socket says 10.20.193.4:36294) 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09abfff640 1 -- 10.20.193.4:0/3485242354 learned_addr learned my addr 10.20.193.4:0/3485242354 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/3485242354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x560988550bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09abfff640 1 -- 10.20.193.4:0/3485242354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 msgr2=0x560988550bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09abfff640 1 --2- 10.20.193.4:0/3485242354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x560988550bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09abfff640 1 -- 10.20.193.4:0/3485242354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988551130 msgr2=0x560988595890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09abfff640 1 --2- 10.20.193.4:0/3485242354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988551130 0x560988595890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09abfff640 1 -- 10.20.193.4:0/3485242354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560988402310 con 0x560988595dd0 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f09abfff640 1 --2- 10.20.193.4:0/3485242354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988595dd0 0x5609885b61b0 secure :-1 s=READY pgs=768 gs=1 cs=0 l=1 c_cookie=10137922647423910807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09a00058d0 tx=0x7f09a00069e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb122ef50170397 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f096ffff640 1 -- 10.20.193.4:0/3485242354 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09a003e070 con 0x560988595dd0 2026-02-24T09:13:21.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f096ffff640 1 -- 10.20.193.4:0/3485242354 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f09a0006eb0 con 0x560988595dd0 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.508+0000 7f096ffff640 1 -- 10.20.193.4:0/3485242354 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09a00050c0 con 0x560988595dd0 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.509+0000 7f09b3f85e00 1 -- 10.20.193.4:0/3485242354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988595dd0 msgr2=0x5609885b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.509+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/3485242354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988595dd0 0x5609885b61b0 secure :-1 s=READY pgs=768 gs=1 cs=0 l=1 c_cookie=10137922647423910807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09a00058d0 tx=0x7f09a00069e0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.509+0000 7f09b3f85e00 1 -- 10.20.193.4:0/3485242354 shutdown_connections 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.509+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/3485242354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988595dd0 0x5609885b61b0 unknown :-1 s=CLOSED pgs=768 gs=1 cs=0 l=1 c_cookie=10137922647423910807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.509+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/3485242354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988551130 0x560988595890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.509+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/3485242354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x560988550bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.509+0000 7f09b3f85e00 1 -- 10.20.193.4:0/3485242354 >> 10.20.193.4:0/3485242354 conn(0x56098846f6b0 msgr2=0x56098854f100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.509+0000 7f09b3f85e00 1 -- 10.20.193.4:0/3485242354 shutdown_connections 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.509+0000 7f09b3f85e00 1 -- 10.20.193.4:0/3485242354 wait complete. 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09b3f85e00 1 -- start start 2026-02-24T09:13:21.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09b3f85e00 1 Processor -- start 2026-02-24T09:13:21.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988550820 0x560988568e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x5609885693b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988595dd0 0x56098856e3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56098856e8e0 con 0x560988551130 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56098856ea50 con 0x560988550820 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56098856ec10 con 0x560988595dd0 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x5609885693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x5609885693b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36308/0 (socket says 10.20.193.4:36308) 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09aaffd640 1 -- 10.20.193.4:0/2718484161 learned_addr learned my addr 10.20.193.4:0/2718484161 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09aaffd640 1 -- 10.20.193.4:0/2718484161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988595dd0 msgr2=0x56098856e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09aaffd640 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988595dd0 0x56098856e3a0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09aaffd640 1 -- 10.20.193.4:0/2718484161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988550820 msgr2=0x560988568e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09aaffd640 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988550820 0x560988568e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09aaffd640 1 -- 10.20.193.4:0/2718484161 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609883da8c0 con 0x560988551130 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09aaffd640 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x5609885693b0 secure :-1 s=READY pgs=769 gs=1 cs=0 l=1 c_cookie=2906650019520263259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099c00cfd0 tx=0x7f099c0ad200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28567ecaebe3345b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f096d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f096d7fa640 1 -- 10.20.193.4:0/2718484161 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099c016ea0 con 0x560988551130 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f096d7fa640 1 -- 10.20.193.4:0/2718484161 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f099c0adb50 con 0x560988551130 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f096d7fa640 1 -- 10.20.193.4:0/2718484161 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099c072560 con 0x560988551130 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.510+0000 7f09b3f85e00 1 -- 10.20.193.4:0/2718484161 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ac176a80 con 0x560988551130 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f096d7fa640 1 -- 10.20.193.4:0/2718484161 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f099c0ab130 con 0x560988551130 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f096d7fa640 10 client.16575 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f09b3f85e00 10 client.16575 _ll_register_callbacks cb 0x5609883f2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f09b3f85e00 1 -- 10.20.193.4:0/2718484161 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5609881a64a0 con 0x560988551130 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f096d7fa640 1 -- 10.20.193.4:0/2718484161 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f099c0b2e70 con 0x560988551130 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f09b3f85e00 10 client.16575 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f09b3f85e00 1 -- 10.20.193.4:0/2718484161 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5609883ec6e0 con 0x560988551130 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f096d7fa640 1 -- 10.20.193.4:0/2718484161 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f099c0aeb40 con 0x560988551130 2026-02-24T09:13:21.522 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f09b3f85e00 10 client.16575 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f09b3f85e00 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f09b3f85e00 20 client.16575 populate_metadata read hostname 'trial004' 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5609885934d0 0x560988593970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f09b3f85e00 4 client.16575 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.511+0000 7f09b3f85e00 1 -- 10.20.193.4:0/2718484161 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56098844c4f0 con 0x5609885934d0 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.512+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5609885934d0 0x560988593970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.513+0000 7f096d7fa640 10 client.16575 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.513+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5609885934d0 0x560988593970 crc :-1 s=READY pgs=99 gs=3 cs=0 l=0 c_cookie=5283630474830533639 s_cookie=3610569254420144165 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=495339ec48b3d407 server_cookie=321b519b76a8e025 in_seq=0 out_seq=0 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f096d7fa640 1 -- 10.20.193.4:0/2718484161 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56098844c4f0 con 0x5609885934d0 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f096d7fa640 10 client.16575 handle_command_reply: tid=0 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 client.16575 shutdown 2026-02-24T09:13:21.523 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 -- 10.20.193.4:0/2718484161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 msgr2=0x5609885693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x5609885693b0 secure :-1 s=READY pgs=769 gs=1 cs=0 l=1 c_cookie=2906650019520263259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099c00cfd0 tx=0x7f099c0ad200 comp rx=0 tx=0).stop 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 -- 10.20.193.4:0/2718484161 shutdown_connections 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5609885934d0 0x560988593970 crc :-1 s=READY pgs=99 gs=3 cs=0 l=0 c_cookie=5283630474830533639 s_cookie=3610569254420144165 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988595dd0 0x56098856e3a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f096d7fa640 0 client.16575 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x5609885693b0 unknown :-1 s=CLOSED pgs=769 gs=1 cs=0 l=1 c_cookie=2906650019520263259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/2718484161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988550820 0x560988568e70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 -- 10.20.193.4:0/2718484161 >> 10.20.193.4:0/2718484161 conn(0x56098846f6b0 msgr2=0x56098854f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 -- 10.20.193.4:0/2718484161 shutdown_connections 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 1 -- 10.20.193.4:0/2718484161 wait complete. 2026-02-24T09:13:21.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.514+0000 7f09b3f85e00 20 client.16575 trim_cache size 0 max 16384 2026-02-24T09:13:21.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.525+0000 7f09b3f85e00 1 Processor -- start 2026-02-24T09:13:21.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.525+0000 7f09b3f85e00 1 -- start start 2026-02-24T09:13:21.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x560988566470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856c8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988595dd0 0x560988595260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5609884546e0 con 0x560988551130 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56098811ff50 con 0x560988595dd0 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56098856e4b0 con 0x560988550820 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36316/0 (socket says 10.20.193.4:36316) 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09aaffd640 1 -- 10.20.193.4:0/1714650509 learned_addr learned my addr 10.20.193.4:0/1714650509 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/1714650509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x560988566470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09aaffd640 1 -- 10.20.193.4:0/1714650509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 msgr2=0x560988566470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09aaffd640 1 --2- 10.20.193.4:0/1714650509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x560988566470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09aaffd640 1 -- 10.20.193.4:0/1714650509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988595dd0 msgr2=0x560988595260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09aaffd640 1 --2- 10.20.193.4:0/1714650509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988595dd0 0x560988595260 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09aaffd640 1 -- 10.20.193.4:0/1714650509 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609883e7160 con 0x560988551130 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f09aaffd640 1 --2- 10.20.193.4:0/1714650509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856c8c0 secure :-1 s=READY pgs=770 gs=1 cs=0 l=1 c_cookie=13630667738987656325 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099c00cfd0 tx=0x7f099c06e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd29dc1719bc7485 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f096f7fe640 1 -- 10.20.193.4:0/1714650509 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099c0b2e70 con 0x560988551130 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f096f7fe640 1 -- 10.20.193.4:0/1714650509 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5609881a64a0 con 0x560988551130 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.526+0000 7f096f7fe640 1 -- 10.20.193.4:0/1714650509 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099c0ad8d0 con 0x560988551130 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1714650509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 msgr2=0x56098856c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/1714650509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856c8c0 secure :-1 s=READY pgs=770 gs=1 cs=0 l=1 c_cookie=13630667738987656325 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099c00cfd0 tx=0x7f099c06e000 comp rx=0 tx=0).stop 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1714650509 shutdown_connections 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/1714650509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988595dd0 0x560988595260 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/1714650509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856c8c0 unknown :-1 s=CLOSED pgs=770 gs=1 cs=0 l=1 c_cookie=13630667738987656325 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/1714650509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x560988566470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1714650509 >> 10.20.193.4:0/1714650509 conn(0x56098846f6b0 msgr2=0x56098856c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1714650509 shutdown_connections 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1714650509 wait complete. 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 -- start start 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.527+0000 7f09b3f85e00 1 Processor -- start 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x56098856f310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856f850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09b3f85e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988595dd0 0x560988572200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5609884546e0 con 0x560988551130 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x560988572740 con 0x560988595dd0 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09b3f85e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x560988572900 con 0x560988550820 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856f850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09aaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856f850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36326/0 (socket says 10.20.193.4:36326) 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09aaffd640 1 -- 10.20.193.4:0/1607970254 learned_addr learned my addr 10.20.193.4:0/1607970254 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x56098856f310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09aaffd640 1 -- 10.20.193.4:0/1607970254 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 msgr2=0x56098856f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09aaffd640 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x56098856f310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09aaffd640 1 -- 10.20.193.4:0/1607970254 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988595dd0 msgr2=0x560988572200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09aaffd640 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988595dd0 0x560988572200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09aaffd640 1 -- 10.20.193.4:0/1607970254 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609883dabf0 con 0x560988551130 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09aaffd640 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856f850 secure :-1 s=READY pgs=771 gs=1 cs=0 l=1 c_cookie=4770343248824804059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099c005c10 tx=0x7f099c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4233a9e912e2a2db server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f096d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f096d7fa640 1 -- 10.20.193.4:0/1607970254 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099c0b2e70 con 0x560988551130 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f096d7fa640 1 -- 10.20.193.4:0/1607970254 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f099c0adb50 con 0x560988551130 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f096d7fa640 1 -- 10.20.193.4:0/1607970254 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f099c0722e0 con 0x560988551130 2026-02-24T09:13:21.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1607970254 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ac176a80 con 0x560988551130 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f096d7fa640 1 -- 10.20.193.4:0/1607970254 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f099c072440 con 0x560988551130 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.528+0000 7f096d7fa640 10 client.16581 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09b3f85e00 10 client.16581 _ll_register_callbacks cb 0x5609883f2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1607970254 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5609880e1f40 con 0x560988551130 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f096d7fa640 1 -- 10.20.193.4:0/1607970254 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f099c0ad8d0 con 0x560988551130 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09b3f85e00 10 client.16581 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1607970254 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5609883ec940 con 0x560988551130 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f096d7fa640 1 -- 10.20.193.4:0/1607970254 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f099c0cc070 con 0x560988551130 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09b3f85e00 10 client.16581 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09b3f85e00 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:21.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09b3f85e00 20 client.16581 populate_metadata read hostname 'trial004' 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5609885e57c0 0x5609885e5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09b3f85e00 4 client.16581 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1607970254 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f09a0006eb0 con 0x5609885e57c0 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.529+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5609885e57c0 0x5609885e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09ab7fe640 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5609885e57c0 0x5609885e5c60 crc :-1 s=READY pgs=100 gs=4 cs=0 l=0 c_cookie=2686950979955346392 s_cookie=9275506009847895496 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2549f7ae21204bd8 server_cookie=80b937927cfc15c8 in_seq=0 out_seq=0 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f096d7fa640 10 client.16581 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f096d7fa640 1 -- 10.20.193.4:0/1607970254 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x7f09a0006eb0 con 0x5609885e57c0 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f096d7fa640 10 client.16581 handle_command_reply: tid=0 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09b3f85e00 1 client.16581 shutdown 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1607970254 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 msgr2=0x56098856f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856f850 secure :-1 s=READY pgs=771 gs=1 cs=0 l=1 c_cookie=4770343248824804059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099c005c10 tx=0x7f099c0054e0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1607970254 shutdown_connections 2026-02-24T09:13:21.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5609885e57c0 0x5609885e5c60 crc :-1 s=READY pgs=100 gs=4 cs=0 l=0 c_cookie=2686950979955346392 s_cookie=9275506009847895496 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x560988595dd0 0x560988572200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x560988551130 0x56098856f850 unknown :-1 s=CLOSED pgs=771 gs=1 cs=0 l=1 c_cookie=4770343248824804059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09b3f85e00 1 --2- 10.20.193.4:0/1607970254 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x560988550820 0x56098856f310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f096d7fa640 0 client.16581 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:21.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1607970254 >> 10.20.193.4:0/1607970254 conn(0x56098846f6b0 msgr2=0x56098854f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.530+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1607970254 shutdown_connections 2026-02-24T09:13:21.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b3f85e00 1 -- 10.20.193.4:0/1607970254 wait complete. 2026-02-24T09:13:21.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b3f85e00 20 client.16581 trim_cache size 0 max 16384 2026-02-24T09:13:21.543 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:13:21.543 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:13:21.544 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:13:21.544 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:13:21.544 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:21.544 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad", 2026-02-24T09:13:21.544 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:13:21.544 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:21.544 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:21.544 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:13:21.544 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:21.545 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:13:21.546 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:13:21.547 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:21.547 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:21.547 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:21.547 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:21.547 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:21.547 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:21.547 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:13:21.547 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:13:21.547 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:21.547 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:21.548 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:13:21.549 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:21.550 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:21.550 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:21.550 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:21.550 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:21.550 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:21.550 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:21.550 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:13:21.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2923465793 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09800b56e0 msgr2=0x7f09800d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09800b56e0 0x7f09800d5b90 secure :-1 s=READY pgs=343 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0998004740 tx=0x7f0998005f90 comp rx=0 tx=0).stop 2026-02-24T09:13:21.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2923465793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09ac110040 msgr2=0x7f09ac11e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:21.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09ac110040 0x7f09ac11e430 secure :-1 s=READY pgs=767 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f099c009480 tx=0x7f099c00ee60 comp rx=0 tx=0).stop 2026-02-24T09:13:21.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2923465793 shutdown_connections 2026-02-24T09:13:21.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f09800b56e0 0x7f09800d5b90 unknown :-1 s=CLOSED pgs=343 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f09ac115840 0x7f09ac123800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f09ac110040 0x7f09ac11e430 unknown :-1 s=CLOSED pgs=767 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 --2- 10.20.193.4:0/2923465793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f09ac10f650 0x7f09ac11def0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:21.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2923465793 >> 10.20.193.4:0/2923465793 conn(0x7f09ac0ecf20 msgr2=0x7f09ac10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:21.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.531+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2923465793 shutdown_connections 2026-02-24T09:13:21.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:21.532+0000 7f09b1f8b640 1 -- 10.20.193.4:0/2923465793 wait complete. 2026-02-24T09:13:21.604 INFO:tasks.cephfs.filesystem:scrub status for tag:cd6acc8a-6f69-46f8-804a-f8a1e029e7ad - {'path': '/', 'tag': 'cd6acc8a-6f69-46f8-804a-f8a1e029e7ad', 'options': 'recursive,force'} 2026-02-24T09:13:22.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:21 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:13:22.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:21 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:22.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:21 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:13:22.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:21 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:21 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:13:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:21 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:21 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:13:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:21 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:21 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:13:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:21 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:21 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:13:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:21 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:22 trial004 ceph-mon[41596]: pgmap v259: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 859 MiB/s wr, 259 op/s 2026-02-24T09:13:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:22 trial090 ceph-mon[47278]: pgmap v259: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 859 MiB/s wr, 259 op/s 2026-02-24T09:13:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:22 trial014 ceph-mon[46941]: pgmap v259: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 859 MiB/s wr, 259 op/s 2026-02-24T09:13:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:24 trial004 ceph-mon[41596]: pgmap v260: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 826 MiB/s wr, 274 op/s 2026-02-24T09:13:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:13:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:13:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:24 trial090 ceph-mon[47278]: pgmap v260: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 826 MiB/s wr, 274 op/s 2026-02-24T09:13:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:13:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:13:25.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:24 trial014 ceph-mon[46941]: pgmap v260: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 826 MiB/s wr, 274 op/s 2026-02-24T09:13:25.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:13:25.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:13:25.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:13:25.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:13:25.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:13:27.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:26 trial004 ceph-mon[41596]: pgmap v261: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 816 MiB/s wr, 294 op/s 2026-02-24T09:13:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:26 trial090 ceph-mon[47278]: pgmap v261: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 816 MiB/s wr, 294 op/s 2026-02-24T09:13:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:26 trial014 ceph-mon[46941]: pgmap v261: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 816 MiB/s wr, 294 op/s 2026-02-24T09:13:29.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:28 trial004 ceph-mon[41596]: pgmap v262: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 856 MiB/s wr, 327 op/s 2026-02-24T09:13:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:28 trial090 ceph-mon[47278]: pgmap v262: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 856 MiB/s wr, 327 op/s 2026-02-24T09:13:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:28 trial014 ceph-mon[46941]: pgmap v262: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 856 MiB/s wr, 327 op/s 2026-02-24T09:13:31.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:30 trial004 ceph-mon[41596]: pgmap v263: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 840 MiB/s wr, 317 op/s 2026-02-24T09:13:31.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:30 trial090 ceph-mon[47278]: pgmap v263: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 840 MiB/s wr, 317 op/s 2026-02-24T09:13:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:30 trial014 ceph-mon[46941]: pgmap v263: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 840 MiB/s wr, 317 op/s 2026-02-24T09:13:33.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:32 trial004 ceph-mon[41596]: pgmap v264: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 766 MiB/s wr, 297 op/s 2026-02-24T09:13:33.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:32 trial090 ceph-mon[47278]: pgmap v264: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 766 MiB/s wr, 297 op/s 2026-02-24T09:13:33.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:32 trial014 ceph-mon[46941]: pgmap v264: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 766 MiB/s wr, 297 op/s 2026-02-24T09:13:33.611 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:13:33.731 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:33.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.831+0000 7fedebb2e640 1 -- 10.20.193.4:0/1677443835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fede410fc70 msgr2=0x7fede4114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:33.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.831+0000 7fedebb2e640 1 --2- 10.20.193.4:0/1677443835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fede410fc70 0x7fede4114cc0 secure :-1 s=READY pgs=772 gs=1 cs=0 l=1 c_cookie=8865670374710864843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedd8009950 tx=0x7fedd802f190 comp rx=0 tx=0).stop 2026-02-24T09:13:33.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.831+0000 7fedebb2e640 1 -- 10.20.193.4:0/1677443835 shutdown_connections 2026-02-24T09:13:33.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 --2- 10.20.193.4:0/1677443835 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fede4115470 0x7fede4175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:33.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 --2- 10.20.193.4:0/1677443835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fede410fc70 0x7fede4114cc0 unknown :-1 s=CLOSED pgs=772 gs=1 cs=0 l=1 c_cookie=8865670374710864843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:33.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 --2- 10.20.193.4:0/1677443835 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fede410f280 0x7fede410f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 -- 10.20.193.4:0/1677443835 >> 10.20.193.4:0/1677443835 conn(0x7fede405f830 msgr2=0x7fede410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 -- 10.20.193.4:0/1677443835 shutdown_connections 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 -- 10.20.193.4:0/1677443835 wait complete. 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 Processor -- start 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 -- start start 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fede410f280 0x7fede40f5570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fede410fc70 0x7fede4175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fede4115470 0x7fede40f5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fede40fae80 con 0x7fede410f280 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fede40faff0 con 0x7fede410fc70 2026-02-24T09:13:33.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fedebb2e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fede40fb1b0 con 0x7fede4115470 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fede98a3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fede410f280 0x7fede40f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fede98a3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fede410f280 0x7fede40f5570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46324/0 (socket says 10.20.193.4:46324) 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fede98a3640 1 -- 10.20.193.4:0/4076002375 learned_addr learned my addr 10.20.193.4:0/4076002375 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fede90a2640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fede410fc70 0x7fede4175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fede98a3640 1 -- 10.20.193.4:0/4076002375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fede4115470 msgr2=0x7fede40f5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fede98a3640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fede4115470 0x7fede40f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fede98a3640 1 -- 10.20.193.4:0/4076002375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fede410fc70 msgr2=0x7fede4175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fede98a3640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fede410fc70 0x7fede4175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.832+0000 7fede98a3640 1 -- 10.20.193.4:0/4076002375 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd8009570 con 0x7fede410f280 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.833+0000 7fede98a3640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fede410f280 0x7fede40f5570 secure :-1 s=READY pgs=773 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedd400c9b0 tx=0x7fedd400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.833+0000 7fedd2ffd640 1 -- 10.20.193.4:0/4076002375 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedd40044a0 con 0x7fede410f280 2026-02-24T09:13:33.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.833+0000 7fedd2ffd640 1 -- 10.20.193.4:0/4076002375 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fedd4007da0 con 0x7fede410f280 2026-02-24T09:13:33.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.833+0000 7fedebb2e640 1 -- 10.20.193.4:0/4076002375 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede40fb490 con 0x7fede410f280 2026-02-24T09:13:33.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.833+0000 7fedd2ffd640 1 -- 10.20.193.4:0/4076002375 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fedd400f6d0 con 0x7fede410f280 2026-02-24T09:13:33.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.833+0000 7fedebb2e640 1 -- 10.20.193.4:0/4076002375 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede40fb960 con 0x7fede410f280 2026-02-24T09:13:33.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.833+0000 7fedebb2e640 1 -- 10.20.193.4:0/4076002375 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede4110560 con 0x7fede410f280 2026-02-24T09:13:33.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.834+0000 7fedd2ffd640 1 -- 10.20.193.4:0/4076002375 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fedd4002880 con 0x7fede410f280 2026-02-24T09:13:33.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.835+0000 7fedd2ffd640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fedc00b56e0 0x7fedc00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:33.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.835+0000 7fede90a2640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fedc00b56e0 0x7fedc00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:33.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.835+0000 7fedd2ffd640 1 -- 10.20.193.4:0/4076002375 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fedd40e6f30 con 0x7fede410f280 2026-02-24T09:13:33.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.835+0000 7fede90a2640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fedc00b56e0 0x7fedc00d5b90 secure :-1 s=READY pgs=344 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedd80098a0 tx=0x7fedd8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:33.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.836+0000 7fedd2ffd640 1 -- 10.20.193.4:0/4076002375 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fedd40a98f0 con 0x7fede410f280 2026-02-24T09:13:33.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.970+0000 7fedebb2e640 1 -- 10.20.193.4:0/4076002375 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fede410f650 con 0x7fede410f280 2026-02-24T09:13:33.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.970+0000 7fedd2ffd640 1 -- 10.20.193.4:0/4076002375 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fedd40acaa0 con 0x7fede410f280 2026-02-24T09:13:33.973 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:13:33.973 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:13:33.973 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 -- 10.20.193.4:0/4076002375 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fedc00b56e0 msgr2=0x7fedc00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fedc00b56e0 0x7fedc00d5b90 secure :-1 s=READY pgs=344 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedd80098a0 tx=0x7fedd8031040 comp rx=0 tx=0).stop 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 -- 10.20.193.4:0/4076002375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fede410f280 msgr2=0x7fede40f5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fede410f280 0x7fede40f5570 secure :-1 s=READY pgs=773 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedd400c9b0 tx=0x7fedd400ce80 comp rx=0 tx=0).stop 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 -- 10.20.193.4:0/4076002375 shutdown_connections 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fedc00b56e0 0x7fedc00d5b90 unknown :-1 s=CLOSED pgs=344 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fede4115470 0x7fede40f5c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fede410fc70 0x7fede4175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 --2- 10.20.193.4:0/4076002375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fede410f280 0x7fede40f5570 unknown :-1 s=CLOSED pgs=773 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 -- 10.20.193.4:0/4076002375 >> 10.20.193.4:0/4076002375 conn(0x7fede405f830 msgr2=0x7fede4111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 -- 10.20.193.4:0/4076002375 shutdown_connections 2026-02-24T09:13:33.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:33.971+0000 7fedebb2e640 1 -- 10.20.193.4:0/4076002375 wait complete. 2026-02-24T09:13:34.010 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id 563dc6c3 --release --await' 2026-02-24T09:13:34.011 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id 563dc6c3 --release --await 2026-02-24T09:13:34.129 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:34.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 -- 10.20.193.4:0/4285777827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb66c155750 msgr2=0x7fb66c175b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 --2- 10.20.193.4:0/4285777827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb66c155750 0x7fb66c175b30 secure :-1 s=READY pgs=774 gs=1 cs=0 l=1 c_cookie=3119802109746227415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb66000aa30 tx=0x7fb660030280 comp rx=0 tx=0).stop 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 -- 10.20.193.4:0/4285777827 shutdown_connections 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 --2- 10.20.193.4:0/4285777827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb66c155750 0x7fb66c175b30 unknown :-1 s=CLOSED pgs=774 gs=1 cs=0 l=1 c_cookie=3119802109746227415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 --2- 10.20.193.4:0/4285777827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb66c0618c0 0x7fb66c155210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 --2- 10.20.193.4:0/4285777827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb66c060fb0 0x7fb66c061380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 -- 10.20.193.4:0/4285777827 >> 10.20.193.4:0/4285777827 conn(0x7fb66c05f830 msgr2=0x7fb66c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 -- 10.20.193.4:0/4285777827 shutdown_connections 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 -- 10.20.193.4:0/4285777827 wait complete. 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 Processor -- start 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 -- start start 2026-02-24T09:13:34.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb66c060fb0 0x7fb66c161ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb66c0618c0 0x7fb66c162420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb66c155750 0x7fb66c1677f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c167e10 con 0x7fb66c0618c0 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c167f80 con 0x7fb66c155750 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.230+0000 7fb672867640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c168140 con 0x7fb66c060fb0 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb66b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb66c0618c0 0x7fb66c162420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb66b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb66c0618c0 0x7fb66c162420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46334/0 (socket says 10.20.193.4:46334) 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb66b7fe640 1 -- 10.20.193.4:0/1582650833 learned_addr learned my addr 10.20.193.4:0/1582650833 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb66b7fe640 1 -- 10.20.193.4:0/1582650833 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb66c060fb0 msgr2=0x7fb66c161ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb66b7fe640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb66c060fb0 0x7fb66c161ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb670ddd640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb66c155750 0x7fb66c1677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb66b7fe640 1 -- 10.20.193.4:0/1582650833 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb66c155750 msgr2=0x7fb66c1677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb66b7fe640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb66c155750 0x7fb66c1677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb66b7fe640 1 -- 10.20.193.4:0/1582650833 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66000a650 con 0x7fb66c0618c0 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb670ddd640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb66c155750 0x7fb66c1677f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb66b7fe640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb66c0618c0 0x7fb66c162420 secure :-1 s=READY pgs=775 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb65c005db0 tx=0x7fb65c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb6697fa640 1 -- 10.20.193.4:0/1582650833 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb65c004540 con 0x7fb66c0618c0 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb672867640 1 -- 10.20.193.4:0/1582650833 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66c168420 con 0x7fb66c0618c0 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb6697fa640 1 -- 10.20.193.4:0/1582650833 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb65c00de40 con 0x7fb66c0618c0 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb6697fa640 1 -- 10.20.193.4:0/1582650833 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb65c0106e0 con 0x7fb66c0618c0 2026-02-24T09:13:34.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.231+0000 7fb672867640 1 -- 10.20.193.4:0/1582650833 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66c151370 con 0x7fb66c0618c0 2026-02-24T09:13:34.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.233+0000 7fb6697fa640 1 -- 10.20.193.4:0/1582650833 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fb65c010870 con 0x7fb66c0618c0 2026-02-24T09:13:34.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.233+0000 7fb6697fa640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6400b56e0 0x7fb6400d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.234+0000 7fb66bfff640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6400b56e0 0x7fb6400d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.234+0000 7fb6697fa640 1 -- 10.20.193.4:0/1582650833 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb65c0e6e50 con 0x7fb66c0618c0 2026-02-24T09:13:34.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.234+0000 7fb66bfff640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6400b56e0 0x7fb6400d5b90 secure :-1 s=READY pgs=345 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb658005970 tx=0x7fb658005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:34.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb674861e00 1 Processor -- start 2026-02-24T09:13:34.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb674861e00 1 -- start start 2026-02-24T09:13:34.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb674861e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 0x55c0b58a9380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb674861e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a98c0 0x55c0b58ee020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb674861e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58ee560 0x55c0b590e940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb674861e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55c0b57ba050 con 0x55c0b58a98c0 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb674861e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55c0b57b5d80 con 0x55c0b58ee560 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb674861e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55c0b57afee0 con 0x55c0b58a8fb0 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a98c0 0x55c0b58ee020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a98c0 0x55c0b58ee020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46350/0 (socket says 10.20.193.4:46350) 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66b7fe640 1 -- 10.20.193.4:0/1785895848 learned_addr learned my addr 10.20.193.4:0/1785895848 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb670ddd640 1 --2- 10.20.193.4:0/1785895848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58ee560 0x55c0b590e940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66bfff640 1 --2- 10.20.193.4:0/1785895848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 0x55c0b58a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66b7fe640 1 -- 10.20.193.4:0/1785895848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 msgr2=0x55c0b58a9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66b7fe640 1 --2- 10.20.193.4:0/1785895848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 0x55c0b58a9380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66b7fe640 1 -- 10.20.193.4:0/1785895848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58ee560 msgr2=0x55c0b590e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66b7fe640 1 --2- 10.20.193.4:0/1785895848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58ee560 0x55c0b590e940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66b7fe640 1 -- 10.20.193.4:0/1785895848 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0b575b540 con 0x55c0b58a98c0 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66bfff640 1 --2- 10.20.193.4:0/1785895848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 0x55c0b58a9380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb66b7fe640 1 --2- 10.20.193.4:0/1785895848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a98c0 0x55c0b58ee020 secure :-1 s=READY pgs=776 gs=1 cs=0 l=1 c_cookie=17439220154053078938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb65c0e49e0 tx=0x7fb65c0acba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2048e554a2aaf9a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb63cce3640 1 -- 10.20.193.4:0/1785895848 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb65c0adbc0 con 0x55c0b58a98c0 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb63cce3640 1 -- 10.20.193.4:0/1785895848 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb65c0b2ee0 con 0x55c0b58a98c0 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.235+0000 7fb63cce3640 1 -- 10.20.193.4:0/1785895848 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb65c0acfe0 con 0x55c0b58a98c0 2026-02-24T09:13:34.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.236+0000 7fb674861e00 1 -- 10.20.193.4:0/1785895848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a98c0 msgr2=0x55c0b58ee020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:34.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.236+0000 7fb674861e00 1 --2- 10.20.193.4:0/1785895848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a98c0 0x55c0b58ee020 secure :-1 s=READY pgs=776 gs=1 cs=0 l=1 c_cookie=17439220154053078938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb65c0e49e0 tx=0x7fb65c0acba0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.236+0000 7fb674861e00 1 -- 10.20.193.4:0/1785895848 shutdown_connections 2026-02-24T09:13:34.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.236+0000 7fb674861e00 1 --2- 10.20.193.4:0/1785895848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58ee560 0x55c0b590e940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.236+0000 7fb674861e00 1 --2- 10.20.193.4:0/1785895848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a98c0 0x55c0b58ee020 unknown :-1 s=CLOSED pgs=776 gs=1 cs=0 l=1 c_cookie=17439220154053078938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.236+0000 7fb674861e00 1 --2- 10.20.193.4:0/1785895848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 0x55c0b58a9380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.236+0000 7fb674861e00 1 -- 10.20.193.4:0/1785895848 >> 10.20.193.4:0/1785895848 conn(0x55c0b58874b0 msgr2=0x55c0b58a7890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:34.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.236+0000 7fb674861e00 1 -- 10.20.193.4:0/1785895848 shutdown_connections 2026-02-24T09:13:34.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.236+0000 7fb674861e00 1 -- 10.20.193.4:0/1785895848 wait complete. 2026-02-24T09:13:34.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb674861e00 1 -- start start 2026-02-24T09:13:34.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb674861e00 1 Processor -- start 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb674861e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 0x55c0b5905e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb674861e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58a98c0 0x55c0b5906390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb674861e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b590b380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb674861e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55c0b590b8c0 con 0x55c0b58ee560 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb674861e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55c0b590ba30 con 0x55c0b58a98c0 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb674861e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55c0b590bbf0 con 0x55c0b58a8fb0 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb670ddd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b590b380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb670ddd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b590b380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46364/0 (socket says 10.20.193.4:46364) 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb670ddd640 1 -- 10.20.193.4:0/2793301255 learned_addr learned my addr 10.20.193.4:0/2793301255 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb66bfff640 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 0x55c0b5905e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb66b7fe640 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58a98c0 0x55c0b5906390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb670ddd640 1 -- 10.20.193.4:0/2793301255 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 msgr2=0x55c0b5905e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb670ddd640 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 0x55c0b5905e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb670ddd640 1 -- 10.20.193.4:0/2793301255 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58a98c0 msgr2=0x55c0b5906390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb670ddd640 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58a98c0 0x55c0b5906390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb670ddd640 1 -- 10.20.193.4:0/2793301255 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0b5733bd0 con 0x55c0b58ee560 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb670ddd640 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b590b380 secure :-1 s=READY pgs=777 gs=1 cs=0 l=1 c_cookie=16536803769306963593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb66000aa30 tx=0x7fb660003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57e876995e1de89 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:34.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb62dffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb62dffb640 1 -- 10.20.193.4:0/2793301255 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6600039a0 con 0x55c0b58ee560 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb62dffb640 1 -- 10.20.193.4:0/2793301255 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb660039e40 con 0x55c0b58ee560 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb674861e00 1 -- 10.20.193.4:0/2793301255 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66c151370 con 0x55c0b58ee560 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb62dffb640 1 -- 10.20.193.4:0/2793301255 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb660044710 con 0x55c0b58ee560 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.237+0000 7fb62dffb640 1 -- 10.20.193.4:0/2793301255 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb66004d3b0 con 0x55c0b58ee560 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb62dffb640 10 client.16599 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb674861e00 10 client.16599 _ll_register_callbacks cb 0x55c0b579e290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb674861e00 1 -- 10.20.193.4:0/2793301255 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c0b54ff700 con 0x55c0b58ee560 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb62dffb640 1 -- 10.20.193.4:0/2793301255 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb660003b00 con 0x55c0b58ee560 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb674861e00 10 client.16599 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb674861e00 1 -- 10.20.193.4:0/2793301255 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55c0b5745910 con 0x55c0b58ee560 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb62dffb640 1 -- 10.20.193.4:0/2793301255 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb660039960 con 0x55c0b58ee560 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb674861e00 10 client.16599 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb674861e00 10 client.16599 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb674861e00 20 client.16599 populate_metadata read hostname 'trial004' 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb674861e00 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55c0b58eb700 0x55c0b58ebba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb674861e00 4 client.16599 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb674861e00 1 -- 10.20.193.4:0/2793301255 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0b57a5920 con 0x55c0b58eb700 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.238+0000 7fb66bfff640 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55c0b58eb700 0x55c0b58ebba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.239+0000 7fb62dffb640 10 client.16599 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:34.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.239+0000 7fb66bfff640 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55c0b58eb700 0x55c0b58ebba0 crc :-1 s=READY pgs=101 gs=4 cs=0 l=0 c_cookie=6722570626752890743 s_cookie=4285931550136893326 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d4b5e5e0914c777 server_cookie=3b7ab009798c7f8e in_seq=0 out_seq=0 2026-02-24T09:13:34.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb62dffb640 1 -- 10.20.193.4:0/2793301255 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c0b57a5920 con 0x55c0b58eb700 2026-02-24T09:13:34.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb62dffb640 10 client.16599 handle_command_reply: tid=0 2026-02-24T09:13:34.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 client.16599 shutdown 2026-02-24T09:13:34.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 -- 10.20.193.4:0/2793301255 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 msgr2=0x55c0b590b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:34.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b590b380 secure :-1 s=READY pgs=777 gs=1 cs=0 l=1 c_cookie=16536803769306963593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb66000aa30 tx=0x7fb660003f90 comp rx=0 tx=0).stop 2026-02-24T09:13:34.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 -- 10.20.193.4:0/2793301255 shutdown_connections 2026-02-24T09:13:34.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55c0b58eb700 0x55c0b58ebba0 crc :-1 s=READY pgs=101 gs=4 cs=0 l=0 c_cookie=6722570626752890743 s_cookie=4285931550136893326 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b590b380 unknown :-1 s=CLOSED pgs=777 gs=1 cs=0 l=1 c_cookie=16536803769306963593 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58a98c0 0x55c0b5906390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 --2- 10.20.193.4:0/2793301255 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a8fb0 0x55c0b5905e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb62dffb640 0 client.16599 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:34.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 -- 10.20.193.4:0/2793301255 >> 10.20.193.4:0/2793301255 conn(0x55c0b58874b0 msgr2=0x55c0b58a7890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:34.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 -- 10.20.193.4:0/2793301255 shutdown_connections 2026-02-24T09:13:34.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 1 -- 10.20.193.4:0/2793301255 wait complete. 2026-02-24T09:13:34.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.240+0000 7fb674861e00 20 client.16599 trim_cache size 0 max 16384 2026-02-24T09:13:34.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.248+0000 7fb674861e00 1 Processor -- start 2026-02-24T09:13:34.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 -- start start 2026-02-24T09:13:34.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58a8fb0 0x55c0b58e91a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a98c0 0x55c0b58e96e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b5903110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55c0b58f8190 con 0x55c0b58ee560 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55c0b57adb10 con 0x55c0b58a8fb0 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55c0b54791b0 con 0x55c0b58a98c0 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb670ddd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b5903110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb670ddd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b5903110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46370/0 (socket says 10.20.193.4:46370) 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb670ddd640 1 -- 10.20.193.4:0/55524541 learned_addr learned my addr 10.20.193.4:0/55524541 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb66bfff640 1 --2- 10.20.193.4:0/55524541 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58a8fb0 0x55c0b58e91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb670ddd640 1 -- 10.20.193.4:0/55524541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a98c0 msgr2=0x55c0b58e96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb670ddd640 1 --2- 10.20.193.4:0/55524541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a98c0 0x55c0b58e96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb670ddd640 1 -- 10.20.193.4:0/55524541 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58a8fb0 msgr2=0x55c0b58e91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb670ddd640 1 --2- 10.20.193.4:0/55524541 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58a8fb0 0x55c0b58e91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb670ddd640 1 -- 10.20.193.4:0/55524541 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0b5740390 con 0x55c0b58ee560 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb670ddd640 1 --2- 10.20.193.4:0/55524541 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b5903110 secure :-1 s=READY pgs=778 gs=1 cs=0 l=1 c_cookie=12854382078915637342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb66000a230 tx=0x7fb66004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b263f06534e9f05e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb62ffff640 1 -- 10.20.193.4:0/55524541 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb660003d60 con 0x55c0b58ee560 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb62ffff640 1 -- 10.20.193.4:0/55524541 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55c0b54ff700 con 0x55c0b58ee560 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb62ffff640 1 -- 10.20.193.4:0/55524541 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb660044680 con 0x55c0b58ee560 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 -- 10.20.193.4:0/55524541 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 msgr2=0x55c0b5903110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:34.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 --2- 10.20.193.4:0/55524541 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b5903110 secure :-1 s=READY pgs=778 gs=1 cs=0 l=1 c_cookie=12854382078915637342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb66000a230 tx=0x7fb66004c000 comp rx=0 tx=0).stop 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 -- 10.20.193.4:0/55524541 shutdown_connections 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 --2- 10.20.193.4:0/55524541 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58ee560 0x55c0b5903110 unknown :-1 s=CLOSED pgs=778 gs=1 cs=0 l=1 c_cookie=12854382078915637342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 --2- 10.20.193.4:0/55524541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a98c0 0x55c0b58e96e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 --2- 10.20.193.4:0/55524541 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58a8fb0 0x55c0b58e91a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 -- 10.20.193.4:0/55524541 >> 10.20.193.4:0/55524541 conn(0x55c0b58874b0 msgr2=0x55c0b5902a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 -- 10.20.193.4:0/55524541 shutdown_connections 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.249+0000 7fb674861e00 1 -- 10.20.193.4:0/55524541 wait complete. 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb674861e00 1 -- start start 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb674861e00 1 Processor -- start 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb674861e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a8fb0 0x55c0b588d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb674861e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a98c0 0x55c0b5889ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb674861e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58ee560 0x55c0b588a010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb674861e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55c0b5883f30 con 0x55c0b58a8fb0 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb674861e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55c0b58f36b0 con 0x55c0b58ee560 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb674861e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55c0b5886ef0 con 0x55c0b58a98c0 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb66bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a8fb0 0x55c0b588d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb66bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a8fb0 0x55c0b588d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46384/0 (socket says 10.20.193.4:46384) 2026-02-24T09:13:34.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb66bfff640 1 -- 10.20.193.4:0/2439505160 learned_addr learned my addr 10.20.193.4:0/2439505160 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb66bfff640 1 -- 10.20.193.4:0/2439505160 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a98c0 msgr2=0x55c0b5889ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb66bfff640 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a98c0 0x55c0b5889ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb66bfff640 1 -- 10.20.193.4:0/2439505160 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58ee560 msgr2=0x55c0b588a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb66bfff640 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58ee560 0x55c0b588a010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb66bfff640 1 -- 10.20.193.4:0/2439505160 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0b5733f00 con 0x55c0b58a8fb0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb66bfff640 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a8fb0 0x55c0b588d4a0 secure :-1 s=READY pgs=779 gs=1 cs=0 l=1 c_cookie=2012254312741540458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6580043d0 tx=0x7fb658004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1becf6a2d4b5126a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb62dffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb62dffb640 1 -- 10.20.193.4:0/2439505160 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb658015040 con 0x55c0b58a8fb0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb62dffb640 1 -- 10.20.193.4:0/2439505160 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb658002da0 con 0x55c0b58a8fb0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb62dffb640 1 -- 10.20.193.4:0/2439505160 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb65801e410 con 0x55c0b58a8fb0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.250+0000 7fb674861e00 1 -- 10.20.193.4:0/2439505160 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0b5745910 con 0x55c0b58a8fb0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb62dffb640 1 -- 10.20.193.4:0/2439505160 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb65801e5a0 con 0x55c0b58a8fb0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb62dffb640 10 client.16605 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb674861e00 10 client.16605 _ll_register_callbacks cb 0x55c0b579e290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb674861e00 1 -- 10.20.193.4:0/2439505160 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb65c0b2ee0 con 0x55c0b58a8fb0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb62dffb640 1 -- 10.20.193.4:0/2439505160 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb6580028c0 con 0x55c0b58a8fb0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb674861e00 10 client.16605 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb674861e00 1 -- 10.20.193.4:0/2439505160 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55c0b5745b70 con 0x55c0b58a8fb0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb62dffb640 1 -- 10.20.193.4:0/2439505160 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb65801b040 con 0x55c0b58a8fb0 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb674861e00 10 client.16605 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb674861e00 10 client.16605 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb674861e00 20 client.16605 populate_metadata read hostname 'trial004' 2026-02-24T09:13:34.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb674861e00 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55c0b599d250 0x55c0b59bd700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:34.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb674861e00 4 client.16605 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "563dc6c3", "release": true, "await": true}] 2026-02-24T09:13:34.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb674861e00 1 -- 10.20.193.4:0/2439505160 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "563dc6c3", "release": true, "await": true}) -- 0x55c0b54e43c0 con 0x55c0b599d250 2026-02-24T09:13:34.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb66b7fe640 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55c0b599d250 0x55c0b59bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:34.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb66b7fe640 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55c0b599d250 0x55c0b59bd700 crc :-1 s=READY pgs=102 gs=4 cs=0 l=0 c_cookie=14946747006260868318 s_cookie=10212233915578883757 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf6d8335ffcff4de server_cookie=8db924a3b5469ead in_seq=0 out_seq=0 2026-02-24T09:13:34.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.251+0000 7fb62dffb640 10 client.16605 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.254+0000 7fb62dffb640 1 -- 10.20.193.4:0/2439505160 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c0b54e43c0 con 0x55c0b599d250 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.254+0000 7fb62dffb640 10 client.16605 handle_command_reply: tid=0 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.254+0000 7fb674861e00 1 client.16605 shutdown 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 1 -- 10.20.193.4:0/2439505160 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a8fb0 msgr2=0x55c0b588d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a8fb0 0x55c0b588d4a0 secure :-1 s=READY pgs=779 gs=1 cs=0 l=1 c_cookie=2012254312741540458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6580043d0 tx=0x7fb658004770 comp rx=0 tx=0).stop 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 1 -- 10.20.193.4:0/2439505160 shutdown_connections 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55c0b599d250 0x55c0b59bd700 crc :-1 s=READY pgs=102 gs=4 cs=0 l=0 c_cookie=14946747006260868318 s_cookie=10212233915578883757 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0b58ee560 0x55c0b588a010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb62dffb640 0 client.16605 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0b58a98c0 0x55c0b5889ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 1 --2- 10.20.193.4:0/2439505160 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0b58a8fb0 0x55c0b588d4a0 unknown :-1 s=CLOSED pgs=779 gs=1 cs=0 l=1 c_cookie=2012254312741540458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 1 -- 10.20.193.4:0/2439505160 >> 10.20.193.4:0/2439505160 conn(0x55c0b58874b0 msgr2=0x55c0b5903110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:34.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 1 -- 10.20.193.4:0/2439505160 shutdown_connections 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 1 -- 10.20.193.4:0/2439505160 wait complete. 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb674861e00 20 client.16605 trim_cache size 0 max 16384 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 16, 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "563dc6c3": { 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "version": 16, 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 140.2, 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:34.258 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 -- 10.20.193.4:0/1582650833 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6400b56e0 msgr2=0x7fb6400d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6400b56e0 0x7fb6400d5b90 secure :-1 s=READY pgs=345 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb658005970 tx=0x7fb658005900 comp rx=0 tx=0).stop 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 -- 10.20.193.4:0/1582650833 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb66c0618c0 msgr2=0x7fb66c162420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb66c0618c0 0x7fb66c162420 secure :-1 s=READY pgs=775 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb65c005db0 tx=0x7fb65c00dbe0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 -- 10.20.193.4:0/1582650833 shutdown_connections 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6400b56e0 0x7fb6400d5b90 unknown :-1 s=CLOSED pgs=345 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb66c155750 0x7fb66c1677f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb66c0618c0 0x7fb66c162420 unknown :-1 s=CLOSED pgs=775 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 --2- 10.20.193.4:0/1582650833 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb66c060fb0 0x7fb66c161ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 -- 10.20.193.4:0/1582650833 >> 10.20.193.4:0/1582650833 conn(0x7fb66c05f830 msgr2=0x7fb66c10ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 -- 10.20.193.4:0/1582650833 shutdown_connections 2026-02-24T09:13:34.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:34.255+0000 7fb672867640 1 -- 10.20.193.4:0/1582650833 wait complete. 2026-02-24T09:13:34.321 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '563dc6c3', total seconds elapsed: 20.9 2026-02-24T09:13:35.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:34 trial004 ceph-mon[41596]: pgmap v265: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 465 MiB/s wr, 205 op/s 2026-02-24T09:13:35.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:34 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4076002375' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:35.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:34 trial090 ceph-mon[47278]: pgmap v265: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 465 MiB/s wr, 205 op/s 2026-02-24T09:13:35.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:34 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4076002375' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:35.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:34 trial014 ceph-mon[46941]: pgmap v265: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 465 MiB/s wr, 205 op/s 2026-02-24T09:13:35.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:34 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4076002375' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:37.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:36 trial004 ceph-mon[41596]: pgmap v266: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 222 MiB/s wr, 117 op/s 2026-02-24T09:13:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:36 trial090 ceph-mon[47278]: pgmap v266: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 222 MiB/s wr, 117 op/s 2026-02-24T09:13:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:36 trial014 ceph-mon[46941]: pgmap v266: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 222 MiB/s wr, 117 op/s 2026-02-24T09:13:39.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:38 trial090 ceph-mon[47278]: pgmap v267: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 95 MiB/s wr, 59 op/s 2026-02-24T09:13:39.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:38 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:13:39.145 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:38 trial014 ceph-mon[46941]: pgmap v267: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 95 MiB/s wr, 59 op/s 2026-02-24T09:13:39.145 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:38 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:13:39.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:38 trial004 ceph-mon[41596]: pgmap v267: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 95 MiB/s wr, 59 op/s 2026-02-24T09:13:39.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:38 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:13:41.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:40 trial004 ceph-mon[41596]: pgmap v268: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2026-02-24T09:13:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:40 trial090 ceph-mon[47278]: pgmap v268: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2026-02-24T09:13:41.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:40 trial014 ceph-mon[46941]: pgmap v268: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2026-02-24T09:13:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:42 trial004 ceph-mon[41596]: pgmap v269: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 6.0 MiB/s wr, 8 op/s 2026-02-24T09:13:43.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:42 trial090 ceph-mon[47278]: pgmap v269: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 6.0 MiB/s wr, 8 op/s 2026-02-24T09:13:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:42 trial014 ceph-mon[46941]: pgmap v269: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 6.0 MiB/s wr, 8 op/s 2026-02-24T09:13:45.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:44 trial004 ceph-mon[41596]: pgmap v270: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 14 MiB/s wr, 10 op/s 2026-02-24T09:13:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:44 trial090 ceph-mon[47278]: pgmap v270: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 14 MiB/s wr, 10 op/s 2026-02-24T09:13:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:44 trial014 ceph-mon[46941]: pgmap v270: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 14 MiB/s wr, 10 op/s 2026-02-24T09:13:47.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:46 trial004 ceph-mon[41596]: pgmap v271: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 19 MiB/s wr, 11 op/s 2026-02-24T09:13:47.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:46 trial090 ceph-mon[47278]: pgmap v271: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 19 MiB/s wr, 11 op/s 2026-02-24T09:13:47.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:46 trial014 ceph-mon[46941]: pgmap v271: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 19 MiB/s wr, 11 op/s 2026-02-24T09:13:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:48 trial004 ceph-mon[41596]: pgmap v272: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 97 MiB/s wr, 32 op/s 2026-02-24T09:13:49.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:48 trial090 ceph-mon[47278]: pgmap v272: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 97 MiB/s wr, 32 op/s 2026-02-24T09:13:49.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:48 trial014 ceph-mon[46941]: pgmap v272: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 97 MiB/s wr, 32 op/s 2026-02-24T09:13:51.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:50 trial004 ceph-mon[41596]: pgmap v273: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 202 MiB/s wr, 57 op/s 2026-02-24T09:13:51.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:50 trial090 ceph-mon[47278]: pgmap v273: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 202 MiB/s wr, 57 op/s 2026-02-24T09:13:51.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:50 trial014 ceph-mon[46941]: pgmap v273: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 202 MiB/s wr, 57 op/s 2026-02-24T09:13:51.605 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:13:51.779 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:51.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.947+0000 7f71e0229640 1 -- 10.20.193.4:0/569286997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71d810cc80 msgr2=0x7f71d8111cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:51.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.947+0000 7f71e0229640 1 --2- 10.20.193.4:0/569286997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71d810cc80 0x7f71d8111cd0 secure :-1 s=READY pgs=780 gs=1 cs=0 l=1 c_cookie=483827640842157452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71cc009950 tx=0x7f71cc02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.947+0000 7f71e0229640 1 -- 10.20.193.4:0/569286997 shutdown_connections 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.947+0000 7f71e0229640 1 --2- 10.20.193.4:0/569286997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71d8112480 0x7f71d8172e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.947+0000 7f71e0229640 1 --2- 10.20.193.4:0/569286997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71d810cc80 0x7f71d8111cd0 unknown :-1 s=CLOSED pgs=780 gs=1 cs=0 l=1 c_cookie=483827640842157452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.947+0000 7f71e0229640 1 --2- 10.20.193.4:0/569286997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71d810c290 0x7f71d810c660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.947+0000 7f71e0229640 1 -- 10.20.193.4:0/569286997 >> 10.20.193.4:0/569286997 conn(0x7f71d80e9b80 msgr2=0x7f71d8109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.947+0000 7f71e0229640 1 -- 10.20.193.4:0/569286997 shutdown_connections 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.947+0000 7f71e0229640 1 -- 10.20.193.4:0/569286997 wait complete. 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71e0229640 1 Processor -- start 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71e0229640 1 -- start start 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71e0229640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71d810c290 0x7f71d80f4eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71e0229640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71d810cc80 0x7f71d8172d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71e0229640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71d8112480 0x7f71d80f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71e0229640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f71d80fa7c0 con 0x7f71d8112480 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71e0229640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f71d80fa930 con 0x7f71d810cc80 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71e0229640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f71d80faaf0 con 0x7f71d810c290 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71de79f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71d8112480 0x7f71d80f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71de79f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71d8112480 0x7f71d80f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:40374/0 (socket says 10.20.193.4:40374) 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71de79f640 1 -- 10.20.193.4:0/453448494 learned_addr learned my addr 10.20.193.4:0/453448494 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71d810c290 0x7f71d80f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71dd79d640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71d810cc80 0x7f71d8172d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71de79f640 1 -- 10.20.193.4:0/453448494 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71d810c290 msgr2=0x7f71d80f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71de79f640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71d810c290 0x7f71d80f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71de79f640 1 -- 10.20.193.4:0/453448494 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71d810cc80 msgr2=0x7f71d8172d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:51.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71de79f640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71d810cc80 0x7f71d8172d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.948+0000 7f71de79f640 1 -- 10.20.193.4:0/453448494 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc009570 con 0x7f71d8112480 2026-02-24T09:13:51.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.949+0000 7f71de79f640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71d8112480 0x7f71d80f55b0 secure :-1 s=READY pgs=781 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d400e650 tx=0x7f71d400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:51.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.949+0000 7f71c6ffd640 1 -- 10.20.193.4:0/453448494 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71d400aa20 con 0x7f71d8112480 2026-02-24T09:13:51.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.949+0000 7f71e0229640 1 -- 10.20.193.4:0/453448494 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d80fadd0 con 0x7f71d8112480 2026-02-24T09:13:51.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.949+0000 7f71e0229640 1 -- 10.20.193.4:0/453448494 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d80fb2f0 con 0x7f71d8112480 2026-02-24T09:13:51.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.949+0000 7f71c6ffd640 1 -- 10.20.193.4:0/453448494 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71d400ab80 con 0x7f71d8112480 2026-02-24T09:13:51.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.949+0000 7f71c6ffd640 1 -- 10.20.193.4:0/453448494 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71d4010640 con 0x7f71d8112480 2026-02-24T09:13:51.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.952+0000 7f71c6ffd640 1 -- 10.20.193.4:0/453448494 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f71d4011460 con 0x7f71d8112480 2026-02-24T09:13:51.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.953+0000 7f71c6ffd640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71b00b56d0 0x7f71b00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.954+0000 7f71c6ffd640 1 -- 10.20.193.4:0/453448494 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f71d40e7d20 con 0x7f71d8112480 2026-02-24T09:13:51.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.954+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71b00b56d0 0x7f71b00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.954+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71b00b56d0 0x7f71b00d5b80 secure :-1 s=READY pgs=346 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71c8004740 tx=0x7f71c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:51.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71e2223e00 1 Processor -- start 2026-02-24T09:13:51.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71e2223e00 1 -- start start 2026-02-24T09:13:51.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71cbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71d130 0x561c5d761890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 0x561c5d7821b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71e2223e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c5d62cde0 con 0x561c5d71c820 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71e2223e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c5d628b10 con 0x561c5d761dd0 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71e2223e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c5d622ab0 con 0x561c5d71d130 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71ddf9e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71ddf9e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:40380/0 (socket says 10.20.193.4:40380) 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71ddf9e640 1 -- 10.20.193.4:0/440861173 learned_addr learned my addr 10.20.193.4:0/440861173 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71dd79d640 1 --2- 10.20.193.4:0/440861173 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71d130 0x561c5d761890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71de79f640 1 --2- 10.20.193.4:0/440861173 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 0x561c5d7821b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71ddf9e640 1 -- 10.20.193.4:0/440861173 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71d130 msgr2=0x561c5d761890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:51.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/440861173 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71d130 0x561c5d761890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71ddf9e640 1 -- 10.20.193.4:0/440861173 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 msgr2=0x561c5d7821b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/440861173 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 0x561c5d7821b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71ddf9e640 1 -- 10.20.193.4:0/440861173 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c5d5ce310 con 0x561c5d71c820 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71de79f640 1 --2- 10.20.193.4:0/440861173 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 0x561c5d7821b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.955+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/440861173 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71cbf0 secure :-1 s=READY pgs=782 gs=1 cs=0 l=1 c_cookie=17614256052576383378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71c8009cc0 tx=0x7f71c8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f472688e3496f192 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71b64e6640 1 -- 10.20.193.4:0/440861173 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71c8011e60 con 0x561c5d71c820 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71b64e6640 1 -- 10.20.193.4:0/440861173 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71c80198e0 con 0x561c5d71c820 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71b64e6640 1 -- 10.20.193.4:0/440861173 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71c801bb80 con 0x561c5d71c820 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71e2223e00 1 -- 10.20.193.4:0/440861173 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 msgr2=0x561c5d71cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71e2223e00 1 --2- 10.20.193.4:0/440861173 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71cbf0 secure :-1 s=READY pgs=782 gs=1 cs=0 l=1 c_cookie=17614256052576383378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71c8009cc0 tx=0x7f71c8014000 comp rx=0 tx=0).stop 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71e2223e00 1 -- 10.20.193.4:0/440861173 shutdown_connections 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71e2223e00 1 --2- 10.20.193.4:0/440861173 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 0x561c5d7821b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.962 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71e2223e00 1 --2- 10.20.193.4:0/440861173 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71d130 0x561c5d761890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71e2223e00 1 --2- 10.20.193.4:0/440861173 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71cbf0 unknown :-1 s=CLOSED pgs=782 gs=1 cs=0 l=1 c_cookie=17614256052576383378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71e2223e00 1 -- 10.20.193.4:0/440861173 >> 10.20.193.4:0/440861173 conn(0x561c5d63b6b0 msgr2=0x561c5d71b100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:51.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71e2223e00 1 -- 10.20.193.4:0/440861173 shutdown_connections 2026-02-24T09:13:51.963 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.956+0000 7f71e2223e00 1 -- 10.20.193.4:0/440861173 wait complete. 2026-02-24T09:13:51.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.957+0000 7f71e2223e00 1 -- start start 2026-02-24T09:13:51.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71e2223e00 1 Processor -- start 2026-02-24T09:13:51.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 0x561c5d734da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7352e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 0x561c5d73a2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71e2223e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c5d73a810 con 0x561c5d71d130 2026-02-24T09:13:51.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71e2223e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c5d73a980 con 0x561c5d761dd0 2026-02-24T09:13:51.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71e2223e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c5d73ab40 con 0x561c5d71c820 2026-02-24T09:13:51.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71dd79d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71dd79d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7352e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:40382/0 (socket says 10.20.193.4:40382) 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71dd79d640 1 -- 10.20.193.4:0/2339620679 learned_addr learned my addr 10.20.193.4:0/2339620679 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71de79f640 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 0x561c5d73a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 0x561c5d734da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71dd79d640 1 -- 10.20.193.4:0/2339620679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 msgr2=0x561c5d734da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71dd79d640 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 0x561c5d734da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71dd79d640 1 -- 10.20.193.4:0/2339620679 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 msgr2=0x561c5d73a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71dd79d640 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 0x561c5d73a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71dd79d640 1 -- 10.20.193.4:0/2339620679 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c5d5a68c0 con 0x561c5d71d130 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 0x561c5d734da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71dd79d640 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7352e0 secure :-1 s=READY pgs=783 gs=1 cs=0 l=1 c_cookie=16347315714576688514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71cc004820 tx=0x7f71cc038720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2dd5507d6812582 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f718f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:51.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f718f7fe640 1 -- 10.20.193.4:0/2339620679 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71cc0026a0 con 0x561c5d71d130 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f718f7fe640 1 -- 10.20.193.4:0/2339620679 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71cc002800 con 0x561c5d71d130 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71e2223e00 1 -- 10.20.193.4:0/2339620679 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c8009960 con 0x561c5d71d130 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f718f7fe640 1 -- 10.20.193.4:0/2339620679 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71cc045700 con 0x561c5d71d130 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.958+0000 7f71e2223e00 10 client.16617 _ll_register_callbacks cb 0x561c5d5be160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f71e2223e00 1 -- 10.20.193.4:0/2339620679 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c5d3724a0 con 0x561c5d71d130 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f718f7fe640 1 -- 10.20.193.4:0/2339620679 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f71cc04f440 con 0x561c5d71d130 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f718f7fe640 1 -- 10.20.193.4:0/2339620679 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f71cc04f6e0 con 0x561c5d71d130 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f71e2223e00 10 client.16617 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f71e2223e00 1 -- 10.20.193.4:0/2339620679 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561c5d5b86e0 con 0x561c5d71d130 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f718f7fe640 1 -- 10.20.193.4:0/2339620679 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f71cc04f900 con 0x561c5d71d130 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f71e2223e00 10 client.16617 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:51.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f71e2223e00 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f71e2223e00 20 client.16617 populate_metadata read hostname 'trial004' 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f71e2223e00 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561c5d75f700 0x561c5d75fb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f71e2223e00 4 client.16617 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f71e2223e00 1 -- 10.20.193.4:0/2339620679 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c5d6184f0 con 0x561c5d75f700 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.959+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561c5d75f700 0x561c5d75fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561c5d75f700 0x561c5d75fb70 crc :-1 s=READY pgs=103 gs=4 cs=0 l=0 c_cookie=5602101403274230571 s_cookie=362398071687505423 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dbea98b89e0bb2b server_cookie=5077f204a38660f in_seq=0 out_seq=0 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f718f7fe640 10 client.16617 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f718f7fe640 1 -- 10.20.193.4:0/2339620679 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561c5d6184f0 con 0x561c5d75f700 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f718f7fe640 10 client.16617 handle_command_reply: tid=0 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 client.16617 shutdown 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 -- 10.20.193.4:0/2339620679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 msgr2=0x561c5d7352e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:51.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7352e0 secure :-1 s=READY pgs=783 gs=1 cs=0 l=1 c_cookie=16347315714576688514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71cc004820 tx=0x7f71cc038720 comp rx=0 tx=0).stop 2026-02-24T09:13:51.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 -- 10.20.193.4:0/2339620679 shutdown_connections 2026-02-24T09:13:51.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561c5d75f700 0x561c5d75fb70 crc :-1 s=READY pgs=103 gs=4 cs=0 l=0 c_cookie=5602101403274230571 s_cookie=362398071687505423 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d761dd0 0x561c5d73a2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7352e0 unknown :-1 s=CLOSED pgs=783 gs=1 cs=0 l=1 c_cookie=16347315714576688514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 --2- 10.20.193.4:0/2339620679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 0x561c5d734da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f718f7fe640 0 client.16617 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:51.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 -- 10.20.193.4:0/2339620679 >> 10.20.193.4:0/2339620679 conn(0x561c5d63b6b0 msgr2=0x561c5d71b810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:51.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 -- 10.20.193.4:0/2339620679 shutdown_connections 2026-02-24T09:13:51.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.960+0000 7f71e2223e00 1 -- 10.20.193.4:0/2339620679 wait complete. 2026-02-24T09:13:51.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.961+0000 7f71e2223e00 20 client.16617 trim_cache size 0 max 16384 2026-02-24T09:13:51.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71e2223e00 1 Processor -- start 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71e2223e00 1 -- start start 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71bc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d71d130 0x561c5d732170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d75f700 0x561c5d7326b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71e2223e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c5d6206e0 con 0x561c5d71c820 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71e2223e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c5d2ebf50 con 0x561c5d71d130 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71e2223e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c5d7358c0 con 0x561c5d75f700 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71dd79d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d71d130 0x561c5d732170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71ddf9e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71dd79d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d71d130 0x561c5d732170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:40932/0 (socket says 10.20.193.4:40932) 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71ddf9e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:40392/0 (socket says 10.20.193.4:40392) 2026-02-24T09:13:51.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71dd79d640 1 -- 10.20.193.4:0/1413686054 learned_addr learned my addr 10.20.193.4:0/1413686054 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.978+0000 7f71de79f640 1 --2- 10.20.193.4:0/1413686054 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d75f700 0x561c5d7326b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.979+0000 7f71ddf9e640 1 -- 10.20.193.4:0/1413686054 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d75f700 msgr2=0x561c5d7326b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.979+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/1413686054 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d75f700 0x561c5d7326b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.979+0000 7f71ddf9e640 1 -- 10.20.193.4:0/1413686054 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d71d130 msgr2=0x561c5d732170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.979+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/1413686054 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d71d130 0x561c5d732170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.979+0000 7f71ddf9e640 1 -- 10.20.193.4:0/1413686054 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c5d5b3160 con 0x561c5d71c820 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.979+0000 7f71dd79d640 1 --2- 10.20.193.4:0/1413686054 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d71d130 0x561c5d732170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.979+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/1413686054 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71bc20 secure :-1 s=READY pgs=784 gs=1 cs=0 l=1 c_cookie=779147024035771492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71c8004350 tx=0x7f71c8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad016171b747464 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.979+0000 7f71b5ce5640 1 -- 10.20.193.4:0/1413686054 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71c802c040 con 0x561c5d71c820 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.979+0000 7f71b5ce5640 1 -- 10.20.193.4:0/1413686054 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71c801b830 con 0x561c5d71c820 2026-02-24T09:13:51.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.979+0000 7f71b5ce5640 1 -- 10.20.193.4:0/1413686054 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71c80266c0 con 0x561c5d71c820 2026-02-24T09:13:51.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.980+0000 7f71e2223e00 1 -- 10.20.193.4:0/1413686054 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 msgr2=0x561c5d71bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:51.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.980+0000 7f71e2223e00 1 --2- 10.20.193.4:0/1413686054 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71bc20 secure :-1 s=READY pgs=784 gs=1 cs=0 l=1 c_cookie=779147024035771492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71c8004350 tx=0x7f71c8014000 comp rx=0 tx=0).stop 2026-02-24T09:13:51.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.981+0000 7f71e2223e00 1 -- 10.20.193.4:0/1413686054 shutdown_connections 2026-02-24T09:13:51.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.981+0000 7f71e2223e00 1 --2- 10.20.193.4:0/1413686054 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d75f700 0x561c5d7326b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.981+0000 7f71e2223e00 1 --2- 10.20.193.4:0/1413686054 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d71d130 0x561c5d732170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.981+0000 7f71e2223e00 1 --2- 10.20.193.4:0/1413686054 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71c820 0x561c5d71bc20 unknown :-1 s=CLOSED pgs=784 gs=1 cs=0 l=1 c_cookie=779147024035771492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.981+0000 7f71e2223e00 1 -- 10.20.193.4:0/1413686054 >> 10.20.193.4:0/1413686054 conn(0x561c5d63b6b0 msgr2=0x561c5d760230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.981+0000 7f71e2223e00 1 -- 10.20.193.4:0/1413686054 shutdown_connections 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.981+0000 7f71e2223e00 1 -- 10.20.193.4:0/1413686054 wait complete. 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.981+0000 7f71e2223e00 1 -- start start 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71e2223e00 1 Processor -- start 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 0x561c5d740b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7410b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71e2223e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d75f700 0x561c5d73d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71e2223e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c5d73ac80 con 0x561c5d71d130 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71e2223e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c5d72de50 con 0x561c5d75f700 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71e2223e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c5d68c3d0 con 0x561c5d71c820 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71dd79d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71dd79d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:40406/0 (socket says 10.20.193.4:40406) 2026-02-24T09:13:51.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71dd79d640 1 -- 10.20.193.4:0/3826092616 learned_addr learned my addr 10.20.193.4:0/3826092616 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 0x561c5d740b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71de79f640 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d75f700 0x561c5d73d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71dd79d640 1 -- 10.20.193.4:0/3826092616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 msgr2=0x561c5d740b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71dd79d640 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 0x561c5d740b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71dd79d640 1 -- 10.20.193.4:0/3826092616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d75f700 msgr2=0x561c5d73d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71dd79d640 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d75f700 0x561c5d73d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71dd79d640 1 -- 10.20.193.4:0/3826092616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c5d5ce310 con 0x561c5d71d130 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f71dd79d640 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7410b0 secure :-1 s=READY pgs=785 gs=1 cs=0 l=1 c_cookie=4686275531773655542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71cc004820 tx=0x7f71cc04f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4108fec466f939f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f718f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.982+0000 7f718f7fe640 1 -- 10.20.193.4:0/3826092616 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71cc04f8e0 con 0x561c5d71d130 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 1 -- 10.20.193.4:0/3826092616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c5d5b86e0 con 0x561c5d71d130 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 10 client.16623 _ll_register_callbacks cb 0x561c5d5be160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:51.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f718f7fe640 1 -- 10.20.193.4:0/3826092616 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x561c5d3724a0 con 0x561c5d71d130 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f718f7fe640 1 -- 10.20.193.4:0/3826092616 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71cc038ba0 con 0x561c5d71d130 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 1 -- 10.20.193.4:0/3826092616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c5d2adf40 con 0x561c5d71d130 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f718f7fe640 1 -- 10.20.193.4:0/3826092616 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f71cc038d30 con 0x561c5d71d130 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f718f7fe640 1 -- 10.20.193.4:0/3826092616 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f71cc0377f0 con 0x561c5d71d130 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 10 client.16623 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 1 -- 10.20.193.4:0/3826092616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561c5d5a6bf0 con 0x561c5d71d130 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f718f7fe640 1 -- 10.20.193.4:0/3826092616 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f71cc0379d0 con 0x561c5d71d130 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 10 client.16623 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 20 client.16623 populate_metadata read hostname 'trial004' 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561c5d761dd0 0x561c5d82f8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:51.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 4 client.16623 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71e2223e00 1 -- 10.20.193.4:0/3826092616 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f71c80198e0 con 0x561c5d761dd0 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.983+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561c5d761dd0 0x561c5d82f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.984+0000 7f71ddf9e640 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561c5d761dd0 0x561c5d82f8b0 crc :-1 s=READY pgs=104 gs=4 cs=0 l=0 c_cookie=4222519130251610606 s_cookie=16399076941621028831 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a9966c6eff049ee server_cookie=e3953997a59ee7df in_seq=0 out_seq=0 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.984+0000 7f718f7fe640 10 client.16623 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f718f7fe640 1 -- 10.20.193.4:0/3826092616 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x7f71c80198e0 con 0x561c5d761dd0 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f718f7fe640 10 client.16623 handle_command_reply: tid=0 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 client.16623 shutdown 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 -- 10.20.193.4:0/3826092616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 msgr2=0x561c5d7410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7410b0 secure :-1 s=READY pgs=785 gs=1 cs=0 l=1 c_cookie=4686275531773655542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71cc004820 tx=0x7f71cc04f5a0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 -- 10.20.193.4:0/3826092616 shutdown_connections 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561c5d761dd0 0x561c5d82f8b0 crc :-1 s=READY pgs=104 gs=4 cs=0 l=0 c_cookie=4222519130251610606 s_cookie=16399076941621028831 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c5d75f700 0x561c5d73d0b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c5d71d130 0x561c5d7410b0 unknown :-1 s=CLOSED pgs=785 gs=1 cs=0 l=1 c_cookie=4686275531773655542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f718f7fe640 0 client.16623 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:51.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 --2- 10.20.193.4:0/3826092616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c5d71c820 0x561c5d740b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:51.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 -- 10.20.193.4:0/3826092616 >> 10.20.193.4:0/3826092616 conn(0x561c5d63b6b0 msgr2=0x561c5d760a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:51.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 -- 10.20.193.4:0/3826092616 shutdown_connections 2026-02-24T09:13:51.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 1 -- 10.20.193.4:0/3826092616 wait complete. 2026-02-24T09:13:51.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.985+0000 7f71e2223e00 20 client.16623 trim_cache size 0 max 16384 2026-02-24T09:13:51.995 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:13:51.995 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:51.996 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:51.997 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:13:51.998 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:51.999 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:13:52.000 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:52.001 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:52.001 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:52.001 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:52.001 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:52.001 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:52.001 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:52.001 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:13:52.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 -- 10.20.193.4:0/453448494 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71b00b56d0 msgr2=0x7f71b00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:52.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71b00b56d0 0x7f71b00d5b80 secure :-1 s=READY pgs=346 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71c8004740 tx=0x7f71c8005f90 comp rx=0 tx=0).stop 2026-02-24T09:13:52.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 -- 10.20.193.4:0/453448494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71d8112480 msgr2=0x7f71d80f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:52.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71d8112480 0x7f71d80f55b0 secure :-1 s=READY pgs=781 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f71d400e650 tx=0x7f71d400eb20 comp rx=0 tx=0).stop 2026-02-24T09:13:52.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 -- 10.20.193.4:0/453448494 shutdown_connections 2026-02-24T09:13:52.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f71b00b56d0 0x7f71b00d5b80 unknown :-1 s=CLOSED pgs=346 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71d8112480 0x7f71d80f55b0 unknown :-1 s=CLOSED pgs=781 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71d810cc80 0x7f71d8172d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 --2- 10.20.193.4:0/453448494 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f71d810c290 0x7f71d80f4eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 -- 10.20.193.4:0/453448494 >> 10.20.193.4:0/453448494 conn(0x7f71d80e9b80 msgr2=0x7f71d805fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:52.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 -- 10.20.193.4:0/453448494 shutdown_connections 2026-02-24T09:13:52.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:51.986+0000 7f71e0229640 1 -- 10.20.193.4:0/453448494 wait complete. 2026-02-24T09:13:52.076 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:13:52.076 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:13:52.250 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:52.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.419+0000 7f719dffb640 1 -- 10.20.193.4:0/4198034384 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f719810ebe0 msgr2=0x7f71981531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:52.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.419+0000 7f719dffb640 1 --2- 10.20.193.4:0/4198034384 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f719810ebe0 0x7f71981531d0 secure :-1 s=READY pgs=786 gs=1 cs=0 l=1 c_cookie=14029091485849240983 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7188009950 tx=0x7f718802f190 comp rx=0 tx=0).stop 2026-02-24T09:13:52.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.419+0000 7f719dffb640 1 -- 10.20.193.4:0/4198034384 shutdown_connections 2026-02-24T09:13:52.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.419+0000 7f719dffb640 1 --2- 10.20.193.4:0/4198034384 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f71981537a0 0x7f7198173bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.419+0000 7f719dffb640 1 --2- 10.20.193.4:0/4198034384 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f719810ebe0 0x7f71981531d0 unknown :-1 s=CLOSED pgs=786 gs=1 cs=0 l=1 c_cookie=14029091485849240983 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.419+0000 7f719dffb640 1 --2- 10.20.193.4:0/4198034384 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f719810e1f0 0x7f719810e5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.419+0000 7f719dffb640 1 -- 10.20.193.4:0/4198034384 >> 10.20.193.4:0/4198034384 conn(0x7f71980e9bf0 msgr2=0x7f719810a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:52.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.419+0000 7f719dffb640 1 -- 10.20.193.4:0/4198034384 shutdown_connections 2026-02-24T09:13:52.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.419+0000 7f719dffb640 1 -- 10.20.193.4:0/4198034384 wait complete. 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f719dffb640 1 Processor -- start 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f719dffb640 1 -- start start 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f719dffb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f719810e1f0 0x7f719815f960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f719dffb640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f719810ebe0 0x7f719815fea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f719dffb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71981537a0 0x7f7198165270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f719dffb640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7198165890 con 0x7f71981537a0 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f719dffb640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7198165a00 con 0x7f719810ebe0 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f719dffb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7198165bc0 con 0x7f719810e1f0 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f7197fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71981537a0 0x7f7198165270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f7197fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71981537a0 0x7f7198165270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:40414/0 (socket says 10.20.193.4:40414) 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f7197fff640 1 -- 10.20.193.4:0/565443751 learned_addr learned my addr 10.20.193.4:0/565443751 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:52.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f71977fe640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f719810e1f0 0x7f719815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.420+0000 7f7196ffd640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f719810ebe0 0x7f719815fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f7197fff640 1 -- 10.20.193.4:0/565443751 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f719810e1f0 msgr2=0x7f719815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f7197fff640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f719810e1f0 0x7f719815f960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f7197fff640 1 -- 10.20.193.4:0/565443751 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f719810ebe0 msgr2=0x7f719815fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f7197fff640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f719810ebe0 0x7f719815fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f7197fff640 1 -- 10.20.193.4:0/565443751 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7188009570 con 0x7f71981537a0 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f7197fff640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71981537a0 0x7f7198165270 secure :-1 s=READY pgs=787 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f718c00f8d0 tx=0x7f718c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f7194ff9640 1 -- 10.20.193.4:0/565443751 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f718c00dce0 con 0x7f71981537a0 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f7194ff9640 1 -- 10.20.193.4:0/565443751 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f718c00de40 con 0x7f71981537a0 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f719dffb640 1 -- 10.20.193.4:0/565443751 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7198165ea0 con 0x7f71981537a0 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f7194ff9640 1 -- 10.20.193.4:0/565443751 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f718c0116b0 con 0x7f71981537a0 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.421+0000 7f719dffb640 1 -- 10.20.193.4:0/565443751 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719814f290 con 0x7f71981537a0 2026-02-24T09:13:52.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.422+0000 7f719dffb640 1 -- 10.20.193.4:0/565443751 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7198060420 con 0x7f71981537a0 2026-02-24T09:13:52.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.423+0000 7f7194ff9640 1 -- 10.20.193.4:0/565443751 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f718c020060 con 0x7f71981537a0 2026-02-24T09:13:52.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.424+0000 7f7194ff9640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f716c0b5760 0x7f716c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:52.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.424+0000 7f71977fe640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f716c0b5760 0x7f716c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:52.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.425+0000 7f7194ff9640 1 -- 10.20.193.4:0/565443751 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f718c015070 con 0x7f71981537a0 2026-02-24T09:13:52.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.425+0000 7f71977fe640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f716c0b5760 0x7f716c0d5c10 secure :-1 s=READY pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7184004740 tx=0x7f718400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:52.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.425+0000 7f7194ff9640 1 -- 10.20.193.4:0/565443751 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f718c0a9e80 con 0x7f71981537a0 2026-02-24T09:13:52.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.604+0000 7f719dffb640 1 -- 10.20.193.4:0/565443751 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7198160af0 con 0x7f71981537a0 2026-02-24T09:13:52.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.605+0000 7f7194ff9640 1 -- 10.20.193.4:0/565443751 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f718c0ad7e0 con 0x7f71981537a0 2026-02-24T09:13:52.609 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:13:52.609 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:13:52.609 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.609+0000 7f719dffb640 1 -- 10.20.193.4:0/565443751 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f716c0b5760 msgr2=0x7f716c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.609+0000 7f719dffb640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f716c0b5760 0x7f716c0d5c10 secure :-1 s=READY pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7184004740 tx=0x7f718400b410 comp rx=0 tx=0).stop 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.609+0000 7f719dffb640 1 -- 10.20.193.4:0/565443751 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71981537a0 msgr2=0x7f7198165270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.609+0000 7f719dffb640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71981537a0 0x7f7198165270 secure :-1 s=READY pgs=787 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f718c00f8d0 tx=0x7f718c00fda0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.610+0000 7f719dffb640 1 -- 10.20.193.4:0/565443751 shutdown_connections 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.610+0000 7f719dffb640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f716c0b5760 0x7f716c0d5c10 unknown :-1 s=CLOSED pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.610+0000 7f719dffb640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f71981537a0 0x7f7198165270 unknown :-1 s=CLOSED pgs=787 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.610+0000 7f719dffb640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f719810ebe0 0x7f719815fea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.610+0000 7f719dffb640 1 --2- 10.20.193.4:0/565443751 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f719810e1f0 0x7f719815f960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.610+0000 7f719dffb640 1 -- 10.20.193.4:0/565443751 >> 10.20.193.4:0/565443751 conn(0x7f71980e9bf0 msgr2=0x7f7198109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:52.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.610+0000 7f719dffb640 1 -- 10.20.193.4:0/565443751 shutdown_connections 2026-02-24T09:13:52.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:52.610+0000 7f719dffb640 1 -- 10.20.193.4:0/565443751 wait complete. 2026-02-24T09:13:52.739 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:13:52.911 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:53.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.059+0000 7f0ab842d640 1 -- 10.20.193.4:0/3869808427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0ab0110040 msgr2=0x7f0ab0115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.059+0000 7f0ab842d640 1 --2- 10.20.193.4:0/3869808427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0ab0110040 0x7f0ab0115090 secure :-1 s=READY pgs=788 gs=1 cs=0 l=1 c_cookie=17132759478378599168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa4009950 tx=0x7f0aa402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.059+0000 7f0ab842d640 1 -- 10.20.193.4:0/3869808427 shutdown_connections 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.059+0000 7f0ab842d640 1 --2- 10.20.193.4:0/3869808427 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0ab0115840 0x7f0ab0176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.059+0000 7f0ab842d640 1 --2- 10.20.193.4:0/3869808427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0ab0110040 0x7f0ab0115090 unknown :-1 s=CLOSED pgs=788 gs=1 cs=0 l=1 c_cookie=17132759478378599168 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.059+0000 7f0ab842d640 1 --2- 10.20.193.4:0/3869808427 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab010f650 0x7f0ab010fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.059+0000 7f0ab842d640 1 -- 10.20.193.4:0/3869808427 >> 10.20.193.4:0/3869808427 conn(0x7f0ab00ecf20 msgr2=0x7f0ab010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 -- 10.20.193.4:0/3869808427 shutdown_connections 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 -- 10.20.193.4:0/3869808427 wait complete. 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 Processor -- start 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 -- start start 2026-02-24T09:13:53.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0ab010f650 0x7f0ab00f58e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0ab0110040 0x7f0ab0176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab0115840 0x7f0ab00f5fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab00fb1f0 con 0x7f0ab0110040 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab00fb360 con 0x7f0ab010f650 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab00fb520 con 0x7f0ab0115840 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab59a1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0ab0110040 0x7f0ab0176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab59a1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0ab0110040 0x7f0ab0176110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:40436/0 (socket says 10.20.193.4:40436) 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab59a1640 1 -- 10.20.193.4:0/2095114179 learned_addr learned my addr 10.20.193.4:0/2095114179 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab69a3640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab0115840 0x7f0ab00f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0ab010f650 0x7f0ab00f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab59a1640 1 -- 10.20.193.4:0/2095114179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab0115840 msgr2=0x7f0ab00f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab0115840 0x7f0ab00f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab59a1640 1 -- 10.20.193.4:0/2095114179 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0ab010f650 msgr2=0x7f0ab00f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0ab010f650 0x7f0ab00f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab59a1640 1 -- 10.20.193.4:0/2095114179 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa4009570 con 0x7f0ab0110040 2026-02-24T09:13:53.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0ab010f650 0x7f0ab00f58e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:53.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0ab0110040 0x7f0ab0176110 secure :-1 s=READY pgs=789 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa40023d0 tx=0x7f0aa40043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0a977fe640 1 -- 10.20.193.4:0/2095114179 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa403d070 con 0x7f0ab0110040 2026-02-24T09:13:53.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0a977fe640 1 -- 10.20.193.4:0/2095114179 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aa4038920 con 0x7f0ab0110040 2026-02-24T09:13:53.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 -- 10.20.193.4:0/2095114179 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab00fb7a0 con 0x7f0ab0110040 2026-02-24T09:13:53.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0a977fe640 1 -- 10.20.193.4:0/2095114179 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa40419d0 con 0x7f0ab0110040 2026-02-24T09:13:53.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.060+0000 7f0ab842d640 1 -- 10.20.193.4:0/2095114179 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab00fbc10 con 0x7f0ab0110040 2026-02-24T09:13:53.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.062+0000 7f0a977fe640 1 -- 10.20.193.4:0/2095114179 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f0aa4038a90 con 0x7f0ab0110040 2026-02-24T09:13:53.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.063+0000 7f0a977fe640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0a8c0b56d0 0x7f0a8c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.063+0000 7f0a977fe640 1 -- 10.20.193.4:0/2095114179 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0aa410b400 con 0x7f0ab0110040 2026-02-24T09:13:53.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.063+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0a8c0b56d0 0x7f0a8c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.063+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0a8c0b56d0 0x7f0a8c0d5b80 secure :-1 s=READY pgs=348 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa0004740 tx=0x7f0aa0005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0aba427e00 1 Processor -- start 2026-02-24T09:13:53.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0aba427e00 1 -- start start 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b35f50 0x55d4b1b36320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b36860 0x55d4b1b7afc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b7b500 0x55d4b1b9b8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0aba427e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1a46ee0 con 0x55d4b1b7b500 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0aba427e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1a42c10 con 0x55d4b1b35f50 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0aba427e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1a3cd70 con 0x55d4b1b36860 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab69a3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b7b500 0x55d4b1b9b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab69a3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b7b500 0x55d4b1b9b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:40440/0 (socket says 10.20.193.4:40440) 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab69a3640 1 -- 10.20.193.4:0/741642375 learned_addr learned my addr 10.20.193.4:0/741642375 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/741642375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b36860 0x55d4b1b7afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/741642375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b35f50 0x55d4b1b36320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab69a3640 1 -- 10.20.193.4:0/741642375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b36860 msgr2=0x55d4b1b7afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab69a3640 1 --2- 10.20.193.4:0/741642375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b36860 0x55d4b1b7afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab69a3640 1 -- 10.20.193.4:0/741642375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b35f50 msgr2=0x55d4b1b36320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab69a3640 1 --2- 10.20.193.4:0/741642375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b35f50 0x55d4b1b36320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab69a3640 1 -- 10.20.193.4:0/741642375 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4b19e8340 con 0x55d4b1b7b500 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.065+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/741642375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b35f50 0x55d4b1b36320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0ab69a3640 1 --2- 10.20.193.4:0/741642375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b7b500 0x55d4b1b9b8e0 secure :-1 s=READY pgs=790 gs=1 cs=0 l=1 c_cookie=6651909989108210903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aac003a20 tx=0x7f0aac003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5054e44aaadcd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0a94884640 1 -- 10.20.193.4:0/741642375 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aac011d00 con 0x55d4b1b7b500 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0a94884640 1 -- 10.20.193.4:0/741642375 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aac011e60 con 0x55d4b1b7b500 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0a94884640 1 -- 10.20.193.4:0/741642375 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aac0136d0 con 0x55d4b1b7b500 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0aba427e00 1 -- 10.20.193.4:0/741642375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b7b500 msgr2=0x55d4b1b9b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0aba427e00 1 --2- 10.20.193.4:0/741642375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b7b500 0x55d4b1b9b8e0 secure :-1 s=READY pgs=790 gs=1 cs=0 l=1 c_cookie=6651909989108210903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aac003a20 tx=0x7f0aac003ef0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0aba427e00 1 -- 10.20.193.4:0/741642375 shutdown_connections 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0aba427e00 1 --2- 10.20.193.4:0/741642375 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b7b500 0x55d4b1b9b8e0 unknown :-1 s=CLOSED pgs=790 gs=1 cs=0 l=1 c_cookie=6651909989108210903 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0aba427e00 1 --2- 10.20.193.4:0/741642375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b36860 0x55d4b1b7afc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0aba427e00 1 --2- 10.20.193.4:0/741642375 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b35f50 0x55d4b1b36320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0aba427e00 1 -- 10.20.193.4:0/741642375 >> 10.20.193.4:0/741642375 conn(0x55d4b1a54db0 msgr2=0x55d4b1b34830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0aba427e00 1 -- 10.20.193.4:0/741642375 shutdown_connections 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.066+0000 7f0aba427e00 1 -- 10.20.193.4:0/741642375 wait complete. 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.067+0000 7f0aba427e00 1 -- start start 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.067+0000 7f0aba427e00 1 Processor -- start 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.067+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b35f50 0x55d4b1b92f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.067+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b36860 0x55d4b1b934a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.067+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b98490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.067+0000 7f0aba427e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1b989d0 con 0x55d4b1b35f50 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.067+0000 7f0aba427e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1b98b40 con 0x55d4b1b7b500 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.067+0000 7f0aba427e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1b98d00 con 0x55d4b1b36860 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.067+0000 7f0ab61a2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b35f50 0x55d4b1b92f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.067+0000 7f0ab61a2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b35f50 0x55d4b1b92f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:40452/0 (socket says 10.20.193.4:40452) 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0ab61a2640 1 -- 10.20.193.4:0/4112252426 learned_addr learned my addr 10.20.193.4:0/4112252426 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0ab69a3640 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b98490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b36860 0x55d4b1b934a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0ab61a2640 1 -- 10.20.193.4:0/4112252426 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b36860 msgr2=0x55d4b1b934a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b36860 0x55d4b1b934a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0ab61a2640 1 -- 10.20.193.4:0/4112252426 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 msgr2=0x55d4b1b98490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b98490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0ab61a2640 1 -- 10.20.193.4:0/4112252426 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4b19c09d0 con 0x55d4b1b35f50 2026-02-24T09:13:53.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b35f50 0x55d4b1b92f60 secure :-1 s=READY pgs=791 gs=1 cs=0 l=1 c_cookie=6285258331060689496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa000eee0 tx=0x7f0aa0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5739b926c06fda58 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0a63fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0a63fff640 1 -- 10.20.193.4:0/4112252426 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa001c900 con 0x55d4b1b35f50 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0aba427e00 1 -- 10.20.193.4:0/4112252426 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac0055d0 con 0x55d4b1b35f50 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0aba427e00 10 client.16641 _ll_register_callbacks cb 0x55d4b19e7080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0aba427e00 1 -- 10.20.193.4:0/4112252426 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d4b178c4a0 con 0x55d4b1b35f50 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0a63fff640 1 -- 10.20.193.4:0/4112252426 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aa0019400 con 0x55d4b1b35f50 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0a63fff640 1 -- 10.20.193.4:0/4112252426 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa0024630 con 0x55d4b1b35f50 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0a63fff640 1 -- 10.20.193.4:0/4112252426 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0aa00247c0 con 0x55d4b1b35f50 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0a63fff640 1 -- 10.20.193.4:0/4112252426 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0aa00249a0 con 0x55d4b1b35f50 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0aba427e00 10 client.16641 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.068+0000 7f0aba427e00 1 -- 10.20.193.4:0/4112252426 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d4b19d2710 con 0x55d4b1b35f50 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.069+0000 7f0a63fff640 1 -- 10.20.193.4:0/4112252426 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0aa0024b40 con 0x55d4b1b35f50 2026-02-24T09:13:53.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.069+0000 7f0aba427e00 10 client.16641 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.069+0000 7f0aba427e00 10 client.16641 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.069+0000 7f0aba427e00 20 client.16641 populate_metadata read hostname 'trial004' 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.069+0000 7f0aba427e00 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d4b1b9b600 0x55d4b1b79280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.069+0000 7f0aba427e00 4 client.16641 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.069+0000 7f0aba427e00 1 -- 10.20.193.4:0/4112252426 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4b1a327b0 con 0x55d4b1b9b600 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.069+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d4b1b9b600 0x55d4b1b79280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d4b1b9b600 0x55d4b1b79280 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=15811535257437293157 s_cookie=14312623735128220008 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db6ddb8b251d4a65 server_cookie=c6a0a774a0246168 in_seq=0 out_seq=0 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0a63fff640 10 client.16641 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0a63fff640 1 -- 10.20.193.4:0/4112252426 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d4b1a327b0 con 0x55d4b1b9b600 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0a63fff640 10 client.16641 handle_command_reply: tid=0 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 client.16641 shutdown 2026-02-24T09:13:53.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 -- 10.20.193.4:0/4112252426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b35f50 msgr2=0x55d4b1b92f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b35f50 0x55d4b1b92f60 secure :-1 s=READY pgs=791 gs=1 cs=0 l=1 c_cookie=6285258331060689496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa000eee0 tx=0x7f0aa0004770 comp rx=0 tx=0).stop 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 -- 10.20.193.4:0/4112252426 shutdown_connections 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d4b1b9b600 0x55d4b1b79280 crc :-1 s=READY pgs=36 gs=4 cs=0 l=0 c_cookie=15811535257437293157 s_cookie=14312623735128220008 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b98490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b36860 0x55d4b1b934a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0a63fff640 0 client.16641 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 --2- 10.20.193.4:0/4112252426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b35f50 0x55d4b1b92f60 unknown :-1 s=CLOSED pgs=791 gs=1 cs=0 l=1 c_cookie=6285258331060689496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 -- 10.20.193.4:0/4112252426 >> 10.20.193.4:0/4112252426 conn(0x55d4b1a54db0 msgr2=0x55d4b1b34040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 -- 10.20.193.4:0/4112252426 shutdown_connections 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.070+0000 7f0aba427e00 1 -- 10.20.193.4:0/4112252426 wait complete. 2026-02-24T09:13:53.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.071+0000 7f0aba427e00 20 client.16641 trim_cache size 0 max 16384 2026-02-24T09:13:53.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.079+0000 7f0aba427e00 1 Processor -- start 2026-02-24T09:13:53.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.079+0000 7f0aba427e00 1 -- start start 2026-02-24T09:13:53.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.079+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 0x55d4b1b35460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.079+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b76160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b766a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0aba427e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1a3a9a0 con 0x55d4b1b36860 2026-02-24T09:13:53.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0aba427e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1816df0 con 0x55d4b1b7b500 2026-02-24T09:13:53.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0aba427e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1b93a80 con 0x55d4b1b35f50 2026-02-24T09:13:53.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab59a1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b76160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab59a1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b76160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:40456/0 (socket says 10.20.193.4:40456) 2026-02-24T09:13:53.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab61a2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 0x55d4b1b35460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab59a1640 1 -- 10.20.193.4:0/12454931 learned_addr learned my addr 10.20.193.4:0/12454931 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab69a3640 1 --2- 10.20.193.4:0/12454931 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b766a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab59a1640 1 -- 10.20.193.4:0/12454931 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 msgr2=0x55d4b1b35460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/12454931 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 0x55d4b1b35460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab59a1640 1 -- 10.20.193.4:0/12454931 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 msgr2=0x55d4b1b766a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/12454931 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b766a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab59a1640 1 -- 10.20.193.4:0/12454931 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4b19cd190 con 0x55d4b1b36860 2026-02-24T09:13:53.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/12454931 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b76160 secure :-1 s=READY pgs=792 gs=1 cs=0 l=1 c_cookie=6790124342347019337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa40d1710 tx=0x7f0aa402f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3b5e1d1e53b449 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0a7e4e6640 1 -- 10.20.193.4:0/12454931 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa40d2130 con 0x55d4b1b36860 2026-02-24T09:13:53.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0a7e4e6640 1 -- 10.20.193.4:0/12454931 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aa40d7450 con 0x55d4b1b36860 2026-02-24T09:13:53.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.080+0000 7f0a7e4e6640 1 -- 10.20.193.4:0/12454931 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa40d1550 con 0x55d4b1b36860 2026-02-24T09:13:53.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.081+0000 7f0aba427e00 1 -- 10.20.193.4:0/12454931 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 msgr2=0x55d4b1b76160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.081+0000 7f0aba427e00 1 --2- 10.20.193.4:0/12454931 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b76160 secure :-1 s=READY pgs=792 gs=1 cs=0 l=1 c_cookie=6790124342347019337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa40d1710 tx=0x7f0aa402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.081+0000 7f0aba427e00 1 -- 10.20.193.4:0/12454931 shutdown_connections 2026-02-24T09:13:53.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.081+0000 7f0aba427e00 1 --2- 10.20.193.4:0/12454931 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b766a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.081+0000 7f0aba427e00 1 --2- 10.20.193.4:0/12454931 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b76160 unknown :-1 s=CLOSED pgs=792 gs=1 cs=0 l=1 c_cookie=6790124342347019337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.081+0000 7f0aba427e00 1 --2- 10.20.193.4:0/12454931 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 0x55d4b1b35460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.081+0000 7f0aba427e00 1 -- 10.20.193.4:0/12454931 >> 10.20.193.4:0/12454931 conn(0x55d4b1a54db0 msgr2=0x55d4b1b97ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.081+0000 7f0aba427e00 1 -- 10.20.193.4:0/12454931 shutdown_connections 2026-02-24T09:13:53.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.081+0000 7f0aba427e00 1 -- 10.20.193.4:0/12454931 wait complete. 2026-02-24T09:13:53.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.082+0000 7f0aba427e00 1 -- start start 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.082+0000 7f0aba427e00 1 Processor -- start 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 0x55d4b1b198c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b19e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0aba427e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b15ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0aba427e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1b93f00 con 0x55d4b1b36860 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0aba427e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1b9ae40 con 0x55d4b1b7b500 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0aba427e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d4b1b8bce0 con 0x55d4b1b35f50 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab59a1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b19e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab61a2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 0x55d4b1b198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab59a1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b19e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44380/0 (socket says 10.20.193.4:44380) 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab61a2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 0x55d4b1b198c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:43256/0 (socket says 10.20.193.4:43256) 2026-02-24T09:13:53.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab59a1640 1 -- 10.20.193.4:0/3521790004 learned_addr learned my addr 10.20.193.4:0/3521790004 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab69a3640 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b15ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab59a1640 1 -- 10.20.193.4:0/3521790004 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 msgr2=0x55d4b1b198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 0x55d4b1b198c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab59a1640 1 -- 10.20.193.4:0/3521790004 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 msgr2=0x55d4b1b15ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b15ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab59a1640 1 -- 10.20.193.4:0/3521790004 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4b19c0d00 con 0x55d4b1b36860 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0ab59a1640 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b19e00 secure :-1 s=READY pgs=793 gs=1 cs=0 l=1 c_cookie=12098748902783907532 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa4108f00 tx=0x7f0aa40cd9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e764067114f6cc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0a63fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0a63fff640 1 -- 10.20.193.4:0/3521790004 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa40d14f0 con 0x55d4b1b36860 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0a63fff640 1 -- 10.20.193.4:0/3521790004 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aa40cdb10 con 0x55d4b1b36860 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0a63fff640 1 -- 10.20.193.4:0/3521790004 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa40968c0 con 0x55d4b1b36860 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0aba427e00 1 -- 10.20.193.4:0/3521790004 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab00fbc10 con 0x55d4b1b36860 2026-02-24T09:13:53.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0a63fff640 1 -- 10.20.193.4:0/3521790004 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0aa4096a20 con 0x55d4b1b36860 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.083+0000 7f0a63fff640 10 client.16647 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0aba427e00 10 client.16647 _ll_register_callbacks cb 0x55d4b19e7080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0aba427e00 1 -- 10.20.193.4:0/3521790004 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aac011e60 con 0x55d4b1b36860 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0a63fff640 1 -- 10.20.193.4:0/3521790004 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0aa40f51f0 con 0x55d4b1b36860 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0aba427e00 10 client.16647 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0aba427e00 1 -- 10.20.193.4:0/3521790004 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d4b19d2970 con 0x55d4b1b36860 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0a63fff640 1 -- 10.20.193.4:0/3521790004 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0aa40d23c0 con 0x55d4b1b36860 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0aba427e00 10 client.16647 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0aba427e00 10 client.16647 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0aba427e00 20 client.16647 populate_metadata read hostname 'trial004' 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0aba427e00 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d4b1c294c0 0x55d4b1c49970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0aba427e00 4 client.16647 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0aba427e00 1 -- 10.20.193.4:0/3521790004 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d4b1771160 con 0x55d4b1c294c0 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.084+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d4b1c294c0 0x55d4b1c49970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0ab61a2640 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d4b1c294c0 0x55d4b1c49970 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=12983815176099064257 s_cookie=7828271545450390975 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b42fc71c88b5e9c1 server_cookie=6ca39b7e9fde65bf in_seq=0 out_seq=0 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0a63fff640 10 client.16647 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0a63fff640 1 -- 10.20.193.4:0/3521790004 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d4b1771160 con 0x55d4b1c294c0 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0a63fff640 10 client.16647 handle_command_reply: tid=0 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 client.16647 shutdown 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 -- 10.20.193.4:0/3521790004 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 msgr2=0x55d4b1b19e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b19e00 secure :-1 s=READY pgs=793 gs=1 cs=0 l=1 c_cookie=12098748902783907532 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa4108f00 tx=0x7f0aa40cd9a0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 -- 10.20.193.4:0/3521790004 shutdown_connections 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d4b1c294c0 0x55d4b1c49970 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=12983815176099064257 s_cookie=7828271545450390975 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4b1b7b500 0x55d4b1b15ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4b1b36860 0x55d4b1b19e00 unknown :-1 s=CLOSED pgs=793 gs=1 cs=0 l=1 c_cookie=12098748902783907532 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 --2- 10.20.193.4:0/3521790004 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4b1b35f50 0x55d4b1b198c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0a63fff640 0 client.16647 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:13:53.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 -- 10.20.193.4:0/3521790004 >> 10.20.193.4:0/3521790004 conn(0x55d4b1a54db0 msgr2=0x55d4b1b34450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 -- 10.20.193.4:0/3521790004 shutdown_connections 2026-02-24T09:13:53.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.085+0000 7f0aba427e00 1 -- 10.20.193.4:0/3521790004 wait complete. 2026-02-24T09:13:53.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0aba427e00 20 client.16647 trim_cache size 0 max 16384 2026-02-24T09:13:53.096 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:13:53.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0ab842d640 1 -- 10.20.193.4:0/2095114179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0a8c0b56d0 msgr2=0x7f0a8c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0ab842d640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0a8c0b56d0 0x7f0a8c0d5b80 secure :-1 s=READY pgs=348 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa0004740 tx=0x7f0aa0005f00 comp rx=0 tx=0).stop 2026-02-24T09:13:53.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0ab842d640 1 -- 10.20.193.4:0/2095114179 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0ab0110040 msgr2=0x7f0ab0176110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0ab842d640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0ab0110040 0x7f0ab0176110 secure :-1 s=READY pgs=789 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa40023d0 tx=0x7f0aa40043d0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0ab842d640 1 -- 10.20.193.4:0/2095114179 shutdown_connections 2026-02-24T09:13:53.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0ab842d640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0a8c0b56d0 0x7f0a8c0d5b80 unknown :-1 s=CLOSED pgs=348 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0ab842d640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0ab0115840 0x7f0ab00f5fe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0ab842d640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0ab0110040 0x7f0ab0176110 unknown :-1 s=CLOSED pgs=789 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0ab842d640 1 --2- 10.20.193.4:0/2095114179 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0ab010f650 0x7f0ab00f58e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.086+0000 7f0ab842d640 1 -- 10.20.193.4:0/2095114179 >> 10.20.193.4:0/2095114179 conn(0x7f0ab00ecf20 msgr2=0x7f0ab0111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.087+0000 7f0ab842d640 1 -- 10.20.193.4:0/2095114179 shutdown_connections 2026-02-24T09:13:53.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.087+0000 7f0ab842d640 1 -- 10.20.193.4:0/2095114179 wait complete. 2026-02-24T09:13:53.160 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:52 trial004 ceph-mon[41596]: pgmap v274: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 472 MiB/s wr, 126 op/s 2026-02-24T09:13:53.160 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:52 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/565443751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:53.161 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:13:53.318 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:53.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:52 trial090 ceph-mon[47278]: pgmap v274: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 472 MiB/s wr, 126 op/s 2026-02-24T09:13:53.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:52 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/565443751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:53.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:52 trial014 ceph-mon[46941]: pgmap v274: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 472 MiB/s wr, 126 op/s 2026-02-24T09:13:53.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:52 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/565443751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:13:53.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 -- 10.20.193.4:0/4221909835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f941010d3d0 msgr2=0x7f941010d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 --2- 10.20.193.4:0/4221909835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f941010d3d0 0x7f941010d7a0 secure :-1 s=READY pgs=794 gs=1 cs=0 l=1 c_cookie=5854138632100142371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93fc009950 tx=0x7f93fc02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 -- 10.20.193.4:0/4221909835 shutdown_connections 2026-02-24T09:13:53.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 --2- 10.20.193.4:0/4221909835 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94101135c0 0x7f9410173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 --2- 10.20.193.4:0/4221909835 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f941010ddc0 0x7f9410112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 --2- 10.20.193.4:0/4221909835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f941010d3d0 0x7f941010d7a0 unknown :-1 s=CLOSED pgs=794 gs=1 cs=0 l=1 c_cookie=5854138632100142371 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 -- 10.20.193.4:0/4221909835 >> 10.20.193.4:0/4221909835 conn(0x7f94100eacc0 msgr2=0x7f941010b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 -- 10.20.193.4:0/4221909835 shutdown_connections 2026-02-24T09:13:53.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 -- 10.20.193.4:0/4221909835 wait complete. 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 Processor -- start 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 -- start start 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f941010d3d0 0x7f941011b3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f941010ddc0 0x7f941011b930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94101135c0 0x7f9410120d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9410121290 con 0x7f941010d3d0 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9410121400 con 0x7f941010ddc0 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.461+0000 7f9416640640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94101215c0 con 0x7f94101135c0 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f941010d3d0 0x7f941011b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f941010d3d0 0x7f941011b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44400/0 (socket says 10.20.193.4:44400) 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940ffff640 1 -- 10.20.193.4:0/1807957950 learned_addr learned my addr 10.20.193.4:0/1807957950 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f9414bb6640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94101135c0 0x7f9410120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940ffff640 1 -- 10.20.193.4:0/1807957950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94101135c0 msgr2=0x7f9410120d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940ffff640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94101135c0 0x7f9410120d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940f7fe640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f941010ddc0 0x7f941011b930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940ffff640 1 -- 10.20.193.4:0/1807957950 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f941010ddc0 msgr2=0x7f941011b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940ffff640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f941010ddc0 0x7f941011b930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940ffff640 1 -- 10.20.193.4:0/1807957950 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc009570 con 0x7f941010d3d0 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f9414bb6640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94101135c0 0x7f9410120d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940ffff640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f941010d3d0 0x7f941011b3f0 secure :-1 s=READY pgs=795 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93fc0023d0 tx=0x7f93fc0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940d7fa640 1 -- 10.20.193.4:0/1807957950 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93fc03d070 con 0x7f941010d3d0 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f9416640640 1 -- 10.20.193.4:0/1807957950 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9410121840 con 0x7f941010d3d0 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940d7fa640 1 -- 10.20.193.4:0/1807957950 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f93fc038920 con 0x7f941010d3d0 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f940d7fa640 1 -- 10.20.193.4:0/1807957950 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93fc041960 con 0x7f941010d3d0 2026-02-24T09:13:53.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.462+0000 7f9416640640 1 -- 10.20.193.4:0/1807957950 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9410161e90 con 0x7f941010d3d0 2026-02-24T09:13:53.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.466+0000 7f940d7fa640 1 -- 10.20.193.4:0/1807957950 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f93fc038a90 con 0x7f941010d3d0 2026-02-24T09:13:53.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.468+0000 7f940d7fa640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f93e40b56e0 0x7f93e40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.469+0000 7f940f7fe640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f93e40b56e0 0x7f93e40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.469+0000 7f940d7fa640 1 -- 10.20.193.4:0/1807957950 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f93fc10b3b0 con 0x7f941010d3d0 2026-02-24T09:13:53.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.470+0000 7f940f7fe640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f93e40b56e0 0x7f93e40d5b90 secure :-1 s=READY pgs=349 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9400005970 tx=0x7f9400005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.474+0000 7f941863ae00 1 Processor -- start 2026-02-24T09:13:53.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.474+0000 7f941863ae00 1 -- start start 2026-02-24T09:13:53.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.474+0000 7f941863ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 0x55d84863e320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f941863ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 0x55d848682fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f941863ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d8486a38e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f941863ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d84854eee0 con 0x55d848683500 2026-02-24T09:13:53.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f941863ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d84854ac10 con 0x55d84863e860 2026-02-24T09:13:53.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f941863ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d848544d70 con 0x55d84863df50 2026-02-24T09:13:53.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f940ffff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 0x55d84863e320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f9414bb6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d8486a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f940f7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 0x55d848682fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f9414bb6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d8486a38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44408/0 (socket says 10.20.193.4:44408) 2026-02-24T09:13:53.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f940ffff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 0x55d84863e320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:43276/0 (socket says 10.20.193.4:43276) 2026-02-24T09:13:53.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f940f7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 0x55d848682fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:38226/0 (socket says 10.20.193.4:38226) 2026-02-24T09:13:53.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f9414bb6640 1 -- 10.20.193.4:0/3443962613 learned_addr learned my addr 10.20.193.4:0/3443962613 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f9414bb6640 1 -- 10.20.193.4:0/3443962613 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 msgr2=0x55d84863e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f9414bb6640 1 --2- 10.20.193.4:0/3443962613 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 0x55d84863e320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f9414bb6640 1 -- 10.20.193.4:0/3443962613 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 msgr2=0x55d848682fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f9414bb6640 1 --2- 10.20.193.4:0/3443962613 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 0x55d848682fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f9414bb6640 1 -- 10.20.193.4:0/3443962613 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8484f0340 con 0x55d848683500 2026-02-24T09:13:53.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.475+0000 7f9414bb6640 1 --2- 10.20.193.4:0/3443962613 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d8486a38e0 secure :-1 s=READY pgs=796 gs=1 cs=0 l=1 c_cookie=10488128575201313614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f940400cc00 tx=0x7f940400e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918d515ee37f834e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.476+0000 7f93e0ce3640 1 -- 10.20.193.4:0/3443962613 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9404005330 con 0x55d848683500 2026-02-24T09:13:53.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.476+0000 7f93e0ce3640 1 -- 10.20.193.4:0/3443962613 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9404005490 con 0x55d848683500 2026-02-24T09:13:53.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.476+0000 7f93e0ce3640 1 -- 10.20.193.4:0/3443962613 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9404010b10 con 0x55d848683500 2026-02-24T09:13:53.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.478+0000 7f941863ae00 1 -- 10.20.193.4:0/3443962613 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 msgr2=0x55d8486a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.478+0000 7f941863ae00 1 --2- 10.20.193.4:0/3443962613 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d8486a38e0 secure :-1 s=READY pgs=796 gs=1 cs=0 l=1 c_cookie=10488128575201313614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f940400cc00 tx=0x7f940400e710 comp rx=0 tx=0).stop 2026-02-24T09:13:53.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.478+0000 7f941863ae00 1 -- 10.20.193.4:0/3443962613 shutdown_connections 2026-02-24T09:13:53.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.478+0000 7f941863ae00 1 --2- 10.20.193.4:0/3443962613 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d8486a38e0 unknown :-1 s=CLOSED pgs=796 gs=1 cs=0 l=1 c_cookie=10488128575201313614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.478+0000 7f941863ae00 1 --2- 10.20.193.4:0/3443962613 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 0x55d848682fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.478+0000 7f941863ae00 1 --2- 10.20.193.4:0/3443962613 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 0x55d84863e320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.479+0000 7f941863ae00 1 -- 10.20.193.4:0/3443962613 >> 10.20.193.4:0/3443962613 conn(0x55d84855cdb0 msgr2=0x55d84863c830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.479+0000 7f941863ae00 1 -- 10.20.193.4:0/3443962613 shutdown_connections 2026-02-24T09:13:53.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.479+0000 7f941863ae00 1 -- 10.20.193.4:0/3443962613 wait complete. 2026-02-24T09:13:53.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.480+0000 7f941863ae00 1 -- start start 2026-02-24T09:13:53.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.480+0000 7f941863ae00 1 Processor -- start 2026-02-24T09:13:53.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f941863ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863df50 0x55d84869f0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f941863ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 0x55d84869f5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f941863ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d848683500 0x55d84869fb30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f941863ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d84867ff90 con 0x55d84863df50 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f941863ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d848680100 con 0x55d84863e860 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f941863ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d8486802c0 con 0x55d848683500 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f940ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863df50 0x55d84869f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f940ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863df50 0x55d84869f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44412/0 (socket says 10.20.193.4:44412) 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f940ffff640 1 -- 10.20.193.4:0/3867816142 learned_addr learned my addr 10.20.193.4:0/3867816142 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f940f7fe640 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 0x55d84869f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f9414bb6640 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d848683500 0x55d84869fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f940ffff640 1 -- 10.20.193.4:0/3867816142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d848683500 msgr2=0x55d84869fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f940ffff640 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d848683500 0x55d84869fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f940ffff640 1 -- 10.20.193.4:0/3867816142 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 msgr2=0x55d84869f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f940ffff640 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 0x55d84869f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.481+0000 7f940ffff640 1 -- 10.20.193.4:0/3867816142 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8484c89d0 con 0x55d84863df50 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f940ffff640 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863df50 0x55d84869f0b0 secure :-1 s=READY pgs=797 gs=1 cs=0 l=1 c_cookie=11473445841217357708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93fc108e90 tx=0x7f93fc002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f39de342371878c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f93d1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f93d1ffb640 1 -- 10.20.193.4:0/3867816142 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93fc0dc5f0 con 0x55d84863df50 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f941863ae00 1 -- 10.20.193.4:0/3867816142 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940400c820 con 0x55d84863df50 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f941863ae00 10 client.16659 _ll_register_callbacks cb 0x55d8484ef080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f941863ae00 1 -- 10.20.193.4:0/3867816142 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d8482944a0 con 0x55d84863df50 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f93d1ffb640 1 -- 10.20.193.4:0/3867816142 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d8482944a0 con 0x55d84863df50 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f93d1ffb640 1 -- 10.20.193.4:0/3867816142 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93fc0d9ab0 con 0x55d84863df50 2026-02-24T09:13:53.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f93d1ffb640 1 -- 10.20.193.4:0/3867816142 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f93fc0dc860 con 0x55d84863df50 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f93d1ffb640 1 -- 10.20.193.4:0/3867816142 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f93fc096bc0 con 0x55d84863df50 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f941863ae00 10 client.16659 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.482+0000 7f941863ae00 1 -- 10.20.193.4:0/3867816142 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d8484da710 con 0x55d84863df50 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.483+0000 7f93d1ffb640 1 -- 10.20.193.4:0/3867816142 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f93fc0d3190 con 0x55d84863df50 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.483+0000 7f941863ae00 10 client.16659 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.483+0000 7f941863ae00 10 client.16659 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.483+0000 7f941863ae00 20 client.16659 populate_metadata read hostname 'trial004' 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.483+0000 7f941863ae00 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d8486c5750 0x55d8486e5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.483+0000 7f941863ae00 4 client.16659 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.483+0000 7f941863ae00 1 -- 10.20.193.4:0/3867816142 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d84853a7b0 con 0x55d8486c5750 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.483+0000 7f940f7fe640 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d8486c5750 0x55d8486e5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.484+0000 7f93d1ffb640 10 client.16659 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:13:53.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.484+0000 7f940f7fe640 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d8486c5750 0x55d8486e5c00 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=17062945016042447624 s_cookie=12112785713075730282 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eccbc216b73b6308 server_cookie=a819426e044e376a in_seq=0 out_seq=0 2026-02-24T09:13:53.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f93d1ffb640 1 -- 10.20.193.4:0/3867816142 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d84853a7b0 con 0x55d8486c5750 2026-02-24T09:13:53.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f93d1ffb640 10 client.16659 handle_command_reply: tid=0 2026-02-24T09:13:53.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f941863ae00 1 client.16659 shutdown 2026-02-24T09:13:53.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f941863ae00 1 -- 10.20.193.4:0/3867816142 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863df50 msgr2=0x55d84869f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f941863ae00 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863df50 0x55d84869f0b0 secure :-1 s=READY pgs=797 gs=1 cs=0 l=1 c_cookie=11473445841217357708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93fc108e90 tx=0x7f93fc002b90 comp rx=0 tx=0).stop 2026-02-24T09:13:53.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f941863ae00 1 -- 10.20.193.4:0/3867816142 shutdown_connections 2026-02-24T09:13:53.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f941863ae00 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d8486c5750 0x55d8486e5c00 crc :-1 s=READY pgs=37 gs=4 cs=0 l=0 c_cookie=17062945016042447624 s_cookie=12112785713075730282 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f941863ae00 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d848683500 0x55d84869fb30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f941863ae00 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863e860 0x55d84869f5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.493 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f93d1ffb640 0 client.16659 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:13:53.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f941863ae00 1 --2- 10.20.193.4:0/3867816142 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863df50 0x55d84869f0b0 unknown :-1 s=CLOSED pgs=797 gs=1 cs=0 l=1 c_cookie=11473445841217357708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f941863ae00 1 -- 10.20.193.4:0/3867816142 >> 10.20.193.4:0/3867816142 conn(0x55d84855cdb0 msgr2=0x55d84863c040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.485+0000 7f941863ae00 1 -- 10.20.193.4:0/3867816142 shutdown_connections 2026-02-24T09:13:53.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.489+0000 7f941863ae00 1 -- 10.20.193.4:0/3867816142 wait complete. 2026-02-24T09:13:53.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.489+0000 7f941863ae00 20 client.16659 trim_cache size 0 max 16384 2026-02-24T09:13:53.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.501+0000 7f941863ae00 1 Processor -- start 2026-02-24T09:13:53.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.501+0000 7f941863ae00 1 -- start start 2026-02-24T09:13:53.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.501+0000 7f941863ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 0x55d848689cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.501+0000 7f941863ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863e860 0x55d84868a230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.501+0000 7f941863ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d848683500 0x55d84863d140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.501+0000 7f941863ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d8485429a0 con 0x55d84863e860 2026-02-24T09:13:53.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.501+0000 7f941863ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d84831edf0 con 0x55d848683500 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.501+0000 7f941863ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d84868c880 con 0x55d84863df50 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f9414bb6640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d848683500 0x55d84863d140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f9414bb6640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d848683500 0x55d84863d140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:38242/0 (socket says 10.20.193.4:38242) 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f9414bb6640 1 -- 10.20.193.4:0/3260176983 learned_addr learned my addr 10.20.193.4:0/3260176983 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f940ffff640 1 --2- 10.20.193.4:0/3260176983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 0x55d848689cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f940f7fe640 1 --2- 10.20.193.4:0/3260176983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863e860 0x55d84868a230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f9414bb6640 1 -- 10.20.193.4:0/3260176983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 msgr2=0x55d848689cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f9414bb6640 1 --2- 10.20.193.4:0/3260176983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 0x55d848689cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f9414bb6640 1 -- 10.20.193.4:0/3260176983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863e860 msgr2=0x55d84868a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f9414bb6640 1 --2- 10.20.193.4:0/3260176983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863e860 0x55d84868a230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f9414bb6640 1 -- 10.20.193.4:0/3260176983 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8484d5190 con 0x55d848683500 2026-02-24T09:13:53.508 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.502+0000 7f940f7fe640 1 --2- 10.20.193.4:0/3260176983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863e860 0x55d84868a230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:53.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.503+0000 7f9414bb6640 1 --2- 10.20.193.4:0/3260176983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d848683500 0x55d84863d140 secure :-1 s=READY pgs=87 gs=2 cs=0 l=1 c_cookie=12177481693981855132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f940400eff0 tx=0x7f940400cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8ff1b14e49c4d9c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.503+0000 7f93d3fff640 1 -- 10.20.193.4:0/3260176983 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9404005110 con 0x55d848683500 2026-02-24T09:13:53.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.503+0000 7f93d3fff640 1 -- 10.20.193.4:0/3260176983 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9404020040 con 0x55d848683500 2026-02-24T09:13:53.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.503+0000 7f93d3fff640 1 -- 10.20.193.4:0/3260176983 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9404010420 con 0x55d848683500 2026-02-24T09:13:53.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.505+0000 7f941863ae00 1 -- 10.20.193.4:0/3260176983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d848683500 msgr2=0x55d84863d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.505+0000 7f941863ae00 1 --2- 10.20.193.4:0/3260176983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d848683500 0x55d84863d140 secure :-1 s=READY pgs=87 gs=2 cs=0 l=1 c_cookie=12177481693981855132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f940400eff0 tx=0x7f940400cb10 comp rx=0 tx=0).stop 2026-02-24T09:13:53.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.505+0000 7f941863ae00 1 -- 10.20.193.4:0/3260176983 shutdown_connections 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.505+0000 7f941863ae00 1 --2- 10.20.193.4:0/3260176983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d848683500 0x55d84863d140 unknown :-1 s=CLOSED pgs=87 gs=2 cs=0 l=1 c_cookie=12177481693981855132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.505+0000 7f941863ae00 1 --2- 10.20.193.4:0/3260176983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d84863e860 0x55d84868a230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.505+0000 7f941863ae00 1 --2- 10.20.193.4:0/3260176983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863df50 0x55d848689cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.505+0000 7f941863ae00 1 -- 10.20.193.4:0/3260176983 >> 10.20.193.4:0/3260176983 conn(0x55d84855cdb0 msgr2=0x55d8486840c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.505+0000 7f941863ae00 1 -- 10.20.193.4:0/3260176983 shutdown_connections 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.505+0000 7f941863ae00 1 -- 10.20.193.4:0/3260176983 wait complete. 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.506+0000 7f941863ae00 1 -- start start 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.506+0000 7f941863ae00 1 Processor -- start 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.506+0000 7f941863ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863df50 0x55d8486a6df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.506+0000 7f941863ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863e860 0x55d8486a7350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.506+0000 7f941863ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d848685960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.506+0000 7f941863ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d848685ef0 con 0x55d848683500 2026-02-24T09:13:53.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.506+0000 7f941863ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d848686060 con 0x55d84863df50 2026-02-24T09:13:53.512 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.506+0000 7f941863ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d848686220 con 0x55d84863e860 2026-02-24T09:13:53.512 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.506+0000 7f9414bb6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d848685960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.512 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f9414bb6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d848685960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44432/0 (socket says 10.20.193.4:44432) 2026-02-24T09:13:53.512 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f9414bb6640 1 -- 10.20.193.4:0/828349732 learned_addr learned my addr 10.20.193.4:0/828349732 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.512 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f940f7fe640 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863e860 0x55d8486a7350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f940f7fe640 1 -- 10.20.193.4:0/828349732 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863df50 msgr2=0x55d8486a6df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:13:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f940f7fe640 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863df50 0x55d8486a6df0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f940f7fe640 1 -- 10.20.193.4:0/828349732 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 msgr2=0x55d848685960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f940f7fe640 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d848685960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f940f7fe640 1 -- 10.20.193.4:0/828349732 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8484c8d00 con 0x55d84863e860 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f940f7fe640 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863e860 0x55d8486a7350 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=5173001235214806818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55d8486e64b0 tx=0x7f94000047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47ca313737a2af22 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f93d1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.90:3300/0 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f93d1ffb640 1 -- 10.20.193.4:0/828349732 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9400022030 con 0x55d84863e860 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f941863ae00 1 -- 10.20.193.4:0/828349732 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8484f0340 con 0x55d84863e860 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f93d1ffb640 1 -- 10.20.193.4:0/828349732 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9400023040 con 0x55d84863e860 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f93d1ffb640 1 -- 10.20.193.4:0/828349732 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9400028320 con 0x55d84863e860 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f941863ae00 10 client.26080 _ll_register_callbacks cb 0x55d8484ef080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.507+0000 7f941863ae00 1 -- 10.20.193.4:0/828349732 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9404005490 con 0x55d84863e860 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f93d1ffb640 1 -- 10.20.193.4:0/828349732 <== mon.1 v2:10.20.193.90:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f940001ccf0 con 0x55d84863e860 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f93d1ffb640 1 -- 10.20.193.4:0/828349732 <== mon.1 v2:10.20.193.90:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9400031400 con 0x55d84863e860 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f941863ae00 10 client.26080 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:53.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f941863ae00 1 -- 10.20.193.4:0/828349732 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d8484da970 con 0x55d84863e860 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f93d1ffb640 1 -- 10.20.193.4:0/828349732 <== mon.1 v2:10.20.193.90:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f940002f070 con 0x55d84863e860 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f941863ae00 10 client.26080 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f941863ae00 10 client.26080 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f941863ae00 20 client.26080 populate_metadata read hostname 'trial004' 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f941863ae00 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d8486c5750 0x55d8486882a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f941863ae00 4 client.26080 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f941863ae00 1 -- 10.20.193.4:0/828349732 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d848279160 con 0x55d8486c5750 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.508+0000 7f940ffff640 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d8486c5750 0x55d8486882a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.509+0000 7f93d1ffb640 10 client.26080 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.509+0000 7f940ffff640 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d8486c5750 0x55d8486882a0 crc :-1 s=READY pgs=38 gs=3 cs=0 l=0 c_cookie=9829738198905695731 s_cookie=9562252339302580432 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=886a3ecfccdcadf3 server_cookie=84b3f1d6f0c740d0 in_seq=0 out_seq=0 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.509+0000 7f93d1ffb640 1 -- 10.20.193.4:0/828349732 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d848279160 con 0x55d8486c5750 2026-02-24T09:13:53.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.509+0000 7f93d1ffb640 10 client.26080 handle_command_reply: tid=0 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.509+0000 7f941863ae00 1 client.26080 shutdown 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 1 -- 10.20.193.4:0/828349732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863e860 msgr2=0x55d8486a7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863e860 0x55d8486a7350 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=5173001235214806818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55d8486e64b0 tx=0x7f94000047e0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 1 -- 10.20.193.4:0/828349732 shutdown_connections 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d8486c5750 0x55d8486882a0 crc :-1 s=READY pgs=38 gs=3 cs=0 l=0 c_cookie=9829738198905695731 s_cookie=9562252339302580432 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d848683500 0x55d848685960 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d84863e860 0x55d8486a7350 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=5173001235214806818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 1 --2- 10.20.193.4:0/828349732 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d84863df50 0x55d8486a6df0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f93d1ffb640 0 client.26080 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 1 -- 10.20.193.4:0/828349732 >> 10.20.193.4:0/828349732 conn(0x55d84855cdb0 msgr2=0x55d8486c24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 1 -- 10.20.193.4:0/828349732 shutdown_connections 2026-02-24T09:13:53.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 1 -- 10.20.193.4:0/828349732 wait complete. 2026-02-24T09:13:53.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.510+0000 7f941863ae00 20 client.26080 trim_cache size 0 max 16384 2026-02-24T09:13:53.519 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:13:53.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.512+0000 7f9416640640 1 -- 10.20.193.4:0/1807957950 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f93e40b56e0 msgr2=0x7f93e40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.512+0000 7f9416640640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f93e40b56e0 0x7f93e40d5b90 secure :-1 s=READY pgs=349 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9400005970 tx=0x7f9400005900 comp rx=0 tx=0).stop 2026-02-24T09:13:53.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.512+0000 7f9416640640 1 -- 10.20.193.4:0/1807957950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f941010d3d0 msgr2=0x7f941011b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.512+0000 7f9416640640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f941010d3d0 0x7f941011b3f0 secure :-1 s=READY pgs=795 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93fc0023d0 tx=0x7f93fc0043d0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.512+0000 7f9416640640 1 -- 10.20.193.4:0/1807957950 shutdown_connections 2026-02-24T09:13:53.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.512+0000 7f9416640640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f93e40b56e0 0x7f93e40d5b90 unknown :-1 s=CLOSED pgs=349 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.512+0000 7f9416640640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94101135c0 0x7f9410120d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.512+0000 7f9416640640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f941010ddc0 0x7f941011b930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.512+0000 7f9416640640 1 --2- 10.20.193.4:0/1807957950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f941010d3d0 0x7f941011b3f0 unknown :-1 s=CLOSED pgs=795 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.512+0000 7f9416640640 1 -- 10.20.193.4:0/1807957950 >> 10.20.193.4:0/1807957950 conn(0x7f94100eacc0 msgr2=0x7f941010b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.514+0000 7f9416640640 1 -- 10.20.193.4:0/1807957950 shutdown_connections 2026-02-24T09:13:53.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.514+0000 7f9416640640 1 -- 10.20.193.4:0/1807957950 wait complete. 2026-02-24T09:13:53.647 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:13:53.857 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:53.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.990+0000 7f228dd74640 1 -- 10.20.193.4:0/2470740294 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22780386f0 con 0x7f229010ddc0 2026-02-24T09:13:53.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.990+0000 7f2295266640 1 -- 10.20.193.4:0/2470740294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f229010ddc0 msgr2=0x7f2290112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.990+0000 7f2295266640 1 --2- 10.20.193.4:0/2470740294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f229010ddc0 0x7f2290112e10 secure :-1 s=READY pgs=88 gs=3 cs=0 l=1 c_cookie=948843555674955017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2278009950 tx=0x7f227802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.990+0000 7f2295266640 1 -- 10.20.193.4:0/2470740294 shutdown_connections 2026-02-24T09:13:53.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.990+0000 7f2295266640 1 --2- 10.20.193.4:0/2470740294 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f22901135c0 0x7f2290173f90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.990+0000 7f2295266640 1 --2- 10.20.193.4:0/2470740294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f229010ddc0 0x7f2290112e10 unknown :-1 s=CLOSED pgs=88 gs=3 cs=0 l=1 c_cookie=948843555674955017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.990+0000 7f2295266640 1 --2- 10.20.193.4:0/2470740294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229010d3d0 0x7f229010d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.990+0000 7f2295266640 1 -- 10.20.193.4:0/2470740294 >> 10.20.193.4:0/2470740294 conn(0x7f22900eaca0 msgr2=0x7f229010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:53.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.990+0000 7f2295266640 1 -- 10.20.193.4:0/2470740294 shutdown_connections 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.990+0000 7f2295266640 1 -- 10.20.193.4:0/2470740294 wait complete. 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f2295266640 1 Processor -- start 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f2295266640 1 -- start start 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f2295266640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229010d3d0 0x7f22900f5880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f2295266640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f229010ddc0 0x7f2290173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f2295266640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f22901135c0 0x7f22900f5f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f2295266640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f22900fb190 con 0x7f22901135c0 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f2295266640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f22900fb300 con 0x7f229010ddc0 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f2295266640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22900fb4c0 con 0x7f229010d3d0 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f228f577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f22901135c0 0x7f22900f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f228f577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f22901135c0 0x7f22900f5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44452/0 (socket says 10.20.193.4:44452) 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f228f577640 1 -- 10.20.193.4:0/2999842408 learned_addr learned my addr 10.20.193.4:0/2999842408 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f228e575640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f229010ddc0 0x7f2290173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.991+0000 7f228ed76640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229010d3d0 0x7f22900f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f228e575640 1 -- 10.20.193.4:0/2999842408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229010d3d0 msgr2=0x7f22900f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f228e575640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229010d3d0 0x7f22900f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f228e575640 1 -- 10.20.193.4:0/2999842408 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f22901135c0 msgr2=0x7f22900f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f228e575640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f22901135c0 0x7f22900f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f228e575640 1 -- 10.20.193.4:0/2999842408 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2278009570 con 0x7f229010ddc0 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f228f577640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f22901135c0 0x7f22900f5f80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f228e575640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f229010ddc0 0x7f2290173e90 secure :-1 s=READY pgs=89 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f227802f6e0 tx=0x7f2278004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f226ffff640 1 -- 10.20.193.4:0/2999842408 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f227803d070 con 0x7f229010ddc0 2026-02-24T09:13:53.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f226ffff640 1 -- 10.20.193.4:0/2999842408 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2278002ad0 con 0x7f229010ddc0 2026-02-24T09:13:54.000 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f2295266640 1 -- 10.20.193.4:0/2999842408 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22900fb740 con 0x7f229010ddc0 2026-02-24T09:13:54.000 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f226ffff640 1 -- 10.20.193.4:0/2999842408 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22780418c0 con 0x7f229010ddc0 2026-02-24T09:13:54.000 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.992+0000 7f2295266640 1 -- 10.20.193.4:0/2999842408 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22900fbbb0 con 0x7f229010ddc0 2026-02-24T09:13:54.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.994+0000 7f226ffff640 1 -- 10.20.193.4:0/2999842408 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f2278038b20 con 0x7f229010ddc0 2026-02-24T09:13:54.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.994+0000 7f226ffff640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f22640b56d0 0x7f22640d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.994+0000 7f226ffff640 1 -- 10.20.193.4:0/2999842408 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f227810b020 con 0x7f229010ddc0 2026-02-24T09:13:54.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.994+0000 7f228ed76640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f22640b56d0 0x7f22640d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.995+0000 7f228ed76640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f22640b56d0 0x7f22640d5b80 secure :-1 s=READY pgs=350 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2284004740 tx=0x7f228400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:54.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.998+0000 7f2297260e00 1 Processor -- start 2026-02-24T09:13:54.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.998+0000 7f2297260e00 1 -- start start 2026-02-24T09:13:54.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f2297260e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e579201320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f2297260e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579201860 0x55e579245fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f2297260e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579246500 0x55e5792668e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f2297260e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e579111ee0 con 0x55e579201860 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f2297260e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e57910dc10 con 0x55e579246500 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f2297260e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e579107d70 con 0x55e579200f50 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579201860 0x55e579245fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228ed76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e579201320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579201860 0x55e579245fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44458/0 (socket says 10.20.193.4:44458) 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228e575640 1 -- 10.20.193.4:0/3221736667 learned_addr learned my addr 10.20.193.4:0/3221736667 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228f577640 1 --2- 10.20.193.4:0/3221736667 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579246500 0x55e5792668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228e575640 1 -- 10.20.193.4:0/3221736667 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 msgr2=0x55e579201320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228e575640 1 --2- 10.20.193.4:0/3221736667 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e579201320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228e575640 1 -- 10.20.193.4:0/3221736667 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579246500 msgr2=0x55e5792668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:54.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228e575640 1 --2- 10.20.193.4:0/3221736667 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579246500 0x55e5792668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228e575640 1 -- 10.20.193.4:0/3221736667 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5790b3340 con 0x55e579201860 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f228e575640 1 --2- 10.20.193.4:0/3221736667 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579201860 0x55e579245fc0 secure :-1 s=READY pgs=798 gs=2 cs=0 l=1 c_cookie=18431895557639206957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2278108bb0 tx=0x7f2278038f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcb3f5a722f782d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f225b7fe640 1 -- 10.20.193.4:0/3221736667 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22780d0c40 con 0x55e579201860 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f225b7fe640 1 -- 10.20.193.4:0/3221736667 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2278038920 con 0x55e579201860 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:53.999+0000 7f225b7fe640 1 -- 10.20.193.4:0/3221736667 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22780cf6a0 con 0x55e579201860 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.000+0000 7f2297260e00 1 -- 10.20.193.4:0/3221736667 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579201860 msgr2=0x55e579245fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.000+0000 7f2297260e00 1 --2- 10.20.193.4:0/3221736667 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579201860 0x55e579245fc0 secure :-1 s=READY pgs=798 gs=2 cs=0 l=1 c_cookie=18431895557639206957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2278108bb0 tx=0x7f2278038f60 comp rx=0 tx=0).stop 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.000+0000 7f2297260e00 1 -- 10.20.193.4:0/3221736667 shutdown_connections 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.000+0000 7f2297260e00 1 --2- 10.20.193.4:0/3221736667 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579246500 0x55e5792668e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.000+0000 7f2297260e00 1 --2- 10.20.193.4:0/3221736667 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579201860 0x55e579245fc0 unknown :-1 s=CLOSED pgs=798 gs=2 cs=0 l=1 c_cookie=18431895557639206957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.000+0000 7f2297260e00 1 --2- 10.20.193.4:0/3221736667 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e579201320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.000+0000 7f2297260e00 1 -- 10.20.193.4:0/3221736667 >> 10.20.193.4:0/3221736667 conn(0x55e57911fdb0 msgr2=0x55e5791ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:54.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.000+0000 7f2297260e00 1 -- 10.20.193.4:0/3221736667 shutdown_connections 2026-02-24T09:13:54.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.000+0000 7f2297260e00 1 -- 10.20.193.4:0/3221736667 wait complete. 2026-02-24T09:13:54.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.001+0000 7f2297260e00 1 -- start start 2026-02-24T09:13:54.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.001+0000 7f2297260e00 1 Processor -- start 2026-02-24T09:13:54.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.001+0000 7f2297260e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e579219390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.001+0000 7f2297260e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e5792198d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.001+0000 7f2297260e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921e8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.001+0000 7f2297260e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e57921ee00 con 0x55e579246500 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.001+0000 7f2297260e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e57921ef70 con 0x55e579201860 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.001+0000 7f2297260e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e57921f130 con 0x55e579200f50 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f228f577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f228ed76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e579219390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f228f577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44470/0 (socket says 10.20.193.4:44470) 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f228f577640 1 -- 10.20.193.4:0/3736695107 learned_addr learned my addr 10.20.193.4:0/3736695107 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f228f577640 1 -- 10.20.193.4:0/3736695107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 msgr2=0x55e579219390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f228f577640 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e579219390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f228f577640 1 -- 10.20.193.4:0/3736695107 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 msgr2=0x55e5792198d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f228f577640 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e5792198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f228f577640 1 -- 10.20.193.4:0/3736695107 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57908b9d0 con 0x55e579246500 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f228f577640 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921e8c0 secure :-1 s=READY pgs=799 gs=1 cs=0 l=1 c_cookie=11173416510637411141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f228000a810 tx=0x7f2280003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0ff31dfc070b45 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f2258ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f2258ff9640 1 -- 10.20.193.4:0/3736695107 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2280018070 con 0x55e579246500 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f2258ff9640 1 -- 10.20.193.4:0/3736695107 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2280013c10 con 0x55e579246500 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f2297260e00 1 -- 10.20.193.4:0/3736695107 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22900fbbb0 con 0x55e579246500 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f2258ff9640 1 -- 10.20.193.4:0/3736695107 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f228001c6d0 con 0x55e579246500 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f2258ff9640 1 -- 10.20.193.4:0/3736695107 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f228001c860 con 0x55e579246500 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f2258ff9640 10 client.16674 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f2297260e00 10 client.16674 _ll_register_callbacks cb 0x55e5790b2080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:54.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f2297260e00 1 -- 10.20.193.4:0/3736695107 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e578e574a0 con 0x55e579246500 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.002+0000 7f2258ff9640 1 -- 10.20.193.4:0/3736695107 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f228001ca60 con 0x55e579246500 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.003+0000 7f2297260e00 10 client.16674 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.003+0000 7f2297260e00 1 -- 10.20.193.4:0/3736695107 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e57909d710 con 0x55e579246500 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.003+0000 7f2258ff9640 1 -- 10.20.193.4:0/3736695107 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f228001cc80 con 0x55e579246500 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.003+0000 7f2297260e00 10 client.16674 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.003+0000 7f2297260e00 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.003+0000 7f2297260e00 20 client.16674 populate_metadata read hostname 'trial004' 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.003+0000 7f2297260e00 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e579243cd0 0x55e579244170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.003+0000 7f2297260e00 4 client.16674 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.003+0000 7f2297260e00 1 -- 10.20.193.4:0/3736695107 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5790fd7b0 con 0x55e579243cd0 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.003+0000 7f228ed76640 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e579243cd0 0x55e579244170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.004+0000 7f228ed76640 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e579243cd0 0x55e579244170 crc :-1 s=READY pgs=105 gs=4 cs=0 l=0 c_cookie=11115320503003924025 s_cookie=12061994338038540596 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a418d1b222a4639 server_cookie=a764cff1798f6934 in_seq=0 out_seq=0 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.004+0000 7f2258ff9640 10 client.16674 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.004+0000 7f2258ff9640 1 -- 10.20.193.4:0/3736695107 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e5790fd7b0 con 0x55e579243cd0 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.004+0000 7f2258ff9640 10 client.16674 handle_command_reply: tid=0 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.004+0000 7f2297260e00 1 client.16674 shutdown 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.004+0000 7f2297260e00 1 -- 10.20.193.4:0/3736695107 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 msgr2=0x55e57921e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.004+0000 7f2297260e00 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921e8c0 secure :-1 s=READY pgs=799 gs=1 cs=0 l=1 c_cookie=11173416510637411141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f228000a810 tx=0x7f2280003ea0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.005+0000 7f2297260e00 1 -- 10.20.193.4:0/3736695107 shutdown_connections 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.005+0000 7f2297260e00 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e579243cd0 0x55e579244170 crc :-1 s=READY pgs=105 gs=4 cs=0 l=0 c_cookie=11115320503003924025 s_cookie=12061994338038540596 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.005+0000 7f2297260e00 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921e8c0 unknown :-1 s=CLOSED pgs=799 gs=1 cs=0 l=1 c_cookie=11173416510637411141 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.005+0000 7f2297260e00 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e5792198d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.005+0000 7f2258ff9640 0 client.16674 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:54.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.005+0000 7f2297260e00 1 --2- 10.20.193.4:0/3736695107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e579219390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.005+0000 7f2297260e00 1 -- 10.20.193.4:0/3736695107 >> 10.20.193.4:0/3736695107 conn(0x55e57911fdb0 msgr2=0x55e5791fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:54.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.005+0000 7f2297260e00 1 -- 10.20.193.4:0/3736695107 shutdown_connections 2026-02-24T09:13:54.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.005+0000 7f2297260e00 1 -- 10.20.193.4:0/3736695107 wait complete. 2026-02-24T09:13:54.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.005+0000 7f2297260e00 20 client.16674 trim_cache size 0 max 16384 2026-02-24T09:13:54.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.014+0000 7f2297260e00 1 Processor -- start 2026-02-24T09:13:54.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.014+0000 7f2297260e00 1 -- start start 2026-02-24T09:13:54.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f2297260e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579200f50 0x55e57920b220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f2297260e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e579200140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f2297260e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579246500 0x55e579200680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.024 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f2297260e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e5791059a0 con 0x55e579200f50 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f2297260e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e578ee1df0 con 0x55e579201860 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f2297260e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e5791722f0 con 0x55e579246500 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579200f50 0x55e57920b220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579200f50 0x55e57920b220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44486/0 (socket says 10.20.193.4:44486) 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228ed76640 1 -- 10.20.193.4:0/2104752827 learned_addr learned my addr 10.20.193.4:0/2104752827 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228e575640 1 --2- 10.20.193.4:0/2104752827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e579200140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228f577640 1 --2- 10.20.193.4:0/2104752827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579246500 0x55e579200680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228ed76640 1 -- 10.20.193.4:0/2104752827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579246500 msgr2=0x55e579200680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228ed76640 1 --2- 10.20.193.4:0/2104752827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579246500 0x55e579200680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228ed76640 1 -- 10.20.193.4:0/2104752827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 msgr2=0x55e579200140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:54.025 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228ed76640 1 --2- 10.20.193.4:0/2104752827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e579200140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228ed76640 1 -- 10.20.193.4:0/2104752827 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e57920b9f0 con 0x55e579200f50 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228f577640 1 --2- 10.20.193.4:0/2104752827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579246500 0x55e579200680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f228ed76640 1 --2- 10.20.193.4:0/2104752827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579200f50 0x55e57920b220 secure :-1 s=READY pgs=800 gs=1 cs=0 l=1 c_cookie=3018326341701931950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2284010c40 tx=0x7f2284013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e33fd0e55913ae server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f225affd640 1 -- 10.20.193.4:0/2104752827 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2284024070 con 0x55e579200f50 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f225affd640 1 -- 10.20.193.4:0/2104752827 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2284025040 con 0x55e579200f50 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.015+0000 7f225affd640 1 -- 10.20.193.4:0/2104752827 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f228402a320 con 0x55e579200f50 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 -- 10.20.193.4:0/2104752827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579200f50 msgr2=0x55e57920b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 --2- 10.20.193.4:0/2104752827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579200f50 0x55e57920b220 secure :-1 s=READY pgs=800 gs=1 cs=0 l=1 c_cookie=3018326341701931950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2284010c40 tx=0x7f2284013000 comp rx=0 tx=0).stop 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 -- 10.20.193.4:0/2104752827 shutdown_connections 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 --2- 10.20.193.4:0/2104752827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579246500 0x55e579200680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 --2- 10.20.193.4:0/2104752827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e579200140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 --2- 10.20.193.4:0/2104752827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579200f50 0x55e57920b220 unknown :-1 s=CLOSED pgs=800 gs=1 cs=0 l=1 c_cookie=3018326341701931950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 -- 10.20.193.4:0/2104752827 >> 10.20.193.4:0/2104752827 conn(0x55e57911fdb0 msgr2=0x55e579215f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 -- 10.20.193.4:0/2104752827 shutdown_connections 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 -- 10.20.193.4:0/2104752827 wait complete. 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 -- start start 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.016+0000 7f2297260e00 1 Processor -- start 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e5792251a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e5792256e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921f980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e579220050 con 0x55e579246500 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e5792201c0 con 0x55e579201860 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e579220380 con 0x55e579200f50 2026-02-24T09:13:54.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228f577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921f980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228f577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921f980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44496/0 (socket says 10.20.193.4:44496) 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228f577640 1 -- 10.20.193.4:0/1400507661 learned_addr learned my addr 10.20.193.4:0/1400507661 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228e575640 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e5792256e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228ed76640 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e5792251a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228f577640 1 -- 10.20.193.4:0/1400507661 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 msgr2=0x55e5792251a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228f577640 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e5792251a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228f577640 1 -- 10.20.193.4:0/1400507661 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 msgr2=0x55e5792256e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228f577640 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e5792256e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228f577640 1 -- 10.20.193.4:0/1400507661 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e579098190 con 0x55e579246500 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f228f577640 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921f980 secure :-1 s=READY pgs=801 gs=1 cs=0 l=1 c_cookie=17887528186792925222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22800276c0 tx=0x7f2280006f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83d441d1b945826 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2258ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2258ff9640 1 -- 10.20.193.4:0/1400507661 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2280018040 con 0x55e579246500 2026-02-24T09:13:54.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 1 -- 10.20.193.4:0/1400507661 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2284011600 con 0x55e579246500 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2258ff9640 1 -- 10.20.193.4:0/1400507661 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55e578e574a0 con 0x55e579246500 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2258ff9640 1 -- 10.20.193.4:0/1400507661 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2280010ce0 con 0x55e579246500 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 10 client.16680 _ll_register_callbacks cb 0x55e5790b2080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 1 -- 10.20.193.4:0/1400507661 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2278038920 con 0x55e579246500 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2258ff9640 1 -- 10.20.193.4:0/1400507661 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f228001c660 con 0x55e579246500 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2258ff9640 1 -- 10.20.193.4:0/1400507661 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f228001c8e0 con 0x55e579246500 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 10 client.16680 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.017+0000 7f2297260e00 1 -- 10.20.193.4:0/1400507661 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e57908bd00 con 0x55e579246500 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.018+0000 7f2258ff9640 1 -- 10.20.193.4:0/1400507661 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2280038020 con 0x55e579246500 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.018+0000 7f2297260e00 10 client.16680 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.018+0000 7f2297260e00 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.018+0000 7f2297260e00 20 client.16680 populate_metadata read hostname 'trial004' 2026-02-24T09:13:54.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.018+0000 7f2297260e00 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e5792f45c0 0x55e579314a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.018+0000 7f2297260e00 4 client.16680 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.018+0000 7f2297260e00 1 -- 10.20.193.4:0/1400507661 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e578e3c160 con 0x55e5792f45c0 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.018+0000 7f228ed76640 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e5792f45c0 0x55e579314a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f228ed76640 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e5792f45c0 0x55e579314a70 crc :-1 s=READY pgs=106 gs=4 cs=0 l=0 c_cookie=17241675266037784607 s_cookie=15503511117680410884 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef46bc4ddcd2201f server_cookie=d72789386ca90104 in_seq=0 out_seq=0 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2258ff9640 10 client.16680 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2258ff9640 1 -- 10.20.193.4:0/1400507661 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e578e3c160 con 0x55e5792f45c0 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2258ff9640 10 client.16680 handle_command_reply: tid=0 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 client.16680 shutdown 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 -- 10.20.193.4:0/1400507661 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 msgr2=0x55e57921f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921f980 secure :-1 s=READY pgs=801 gs=1 cs=0 l=1 c_cookie=17887528186792925222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22800276c0 tx=0x7f2280006f40 comp rx=0 tx=0).stop 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 -- 10.20.193.4:0/1400507661 shutdown_connections 2026-02-24T09:13:54.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e5792f45c0 0x55e579314a70 crc :-1 s=READY pgs=106 gs=4 cs=0 l=0 c_cookie=17241675266037784607 s_cookie=15503511117680410884 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e579246500 0x55e57921f980 unknown :-1 s=CLOSED pgs=801 gs=1 cs=0 l=1 c_cookie=17887528186792925222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2258ff9640 0 client.16680 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:54.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e579201860 0x55e5792256e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 --2- 10.20.193.4:0/1400507661 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e579200f50 0x55e5792251a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 -- 10.20.193.4:0/1400507661 >> 10.20.193.4:0/1400507661 conn(0x55e57911fdb0 msgr2=0x55e579200030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:54.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 -- 10.20.193.4:0/1400507661 shutdown_connections 2026-02-24T09:13:54.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 1 -- 10.20.193.4:0/1400507661 wait complete. 2026-02-24T09:13:54.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.019+0000 7f2297260e00 20 client.16680 trim_cache size 0 max 16384 2026-02-24T09:13:54.031 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:13:54.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 -- 10.20.193.4:0/2999842408 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f22640b56d0 msgr2=0x7f22640d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:54.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f22640b56d0 0x7f22640d5b80 secure :-1 s=READY pgs=350 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2284004740 tx=0x7f228400b410 comp rx=0 tx=0).stop 2026-02-24T09:13:54.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 -- 10.20.193.4:0/2999842408 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f229010ddc0 msgr2=0x7f2290173e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:54.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f229010ddc0 0x7f2290173e90 secure :-1 s=READY pgs=89 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f227802f6e0 tx=0x7f2278004270 comp rx=0 tx=0).stop 2026-02-24T09:13:54.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 -- 10.20.193.4:0/2999842408 shutdown_connections 2026-02-24T09:13:54.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f22640b56d0 0x7f22640d5b80 unknown :-1 s=CLOSED pgs=350 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f22901135c0 0x7f22900f5f80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f229010ddc0 0x7f2290173e90 unknown :-1 s=CLOSED pgs=89 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 --2- 10.20.193.4:0/2999842408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229010d3d0 0x7f22900f5880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:54.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 -- 10.20.193.4:0/2999842408 >> 10.20.193.4:0/2999842408 conn(0x7f22900eaca0 msgr2=0x7f2290111470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:54.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 -- 10.20.193.4:0/2999842408 shutdown_connections 2026-02-24T09:13:54.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:54.020+0000 7f2295266640 1 -- 10.20.193.4:0/2999842408 wait complete. 2026-02-24T09:13:55.105 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:13:55.106 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:13:55.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:54 trial004 ceph-mon[41596]: pgmap v275: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 646 MiB/s wr, 169 op/s 2026-02-24T09:13:55.249 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:55.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:54 trial090 ceph-mon[47278]: pgmap v275: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 646 MiB/s wr, 169 op/s 2026-02-24T09:13:55.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:54 trial014 ceph-mon[46941]: pgmap v275: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 646 MiB/s wr, 169 op/s 2026-02-24T09:13:55.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.397+0000 7fef5b002640 1 -- 10.20.193.4:0/1207502056 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fef5410bed0 msgr2=0x7fef5410c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.397+0000 7fef5b002640 1 --2- 10.20.193.4:0/1207502056 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fef5410bed0 0x7fef5410c2a0 secure :-1 s=READY pgs=802 gs=1 cs=0 l=1 c_cookie=7518355938834416338 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef44009950 tx=0x7fef4402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.397+0000 7fef5b002640 1 -- 10.20.193.4:0/1207502056 shutdown_connections 2026-02-24T09:13:55.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.397+0000 7fef5b002640 1 --2- 10.20.193.4:0/1207502056 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef54155c00 0x7fef54175fe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.397+0000 7fef5b002640 1 --2- 10.20.193.4:0/1207502056 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fef5410c7e0 0x7fef541556c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.397+0000 7fef5b002640 1 --2- 10.20.193.4:0/1207502056 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fef5410bed0 0x7fef5410c2a0 unknown :-1 s=CLOSED pgs=802 gs=1 cs=0 l=1 c_cookie=7518355938834416338 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.397+0000 7fef5b002640 1 -- 10.20.193.4:0/1207502056 >> 10.20.193.4:0/1207502056 conn(0x7fef540e9bf0 msgr2=0x7fef5410a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.397+0000 7fef5b002640 1 -- 10.20.193.4:0/1207502056 shutdown_connections 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.397+0000 7fef5b002640 1 -- 10.20.193.4:0/1207502056 wait complete. 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef5b002640 1 Processor -- start 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef5b002640 1 -- start start 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef5b002640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fef5410bed0 0x7fef541612f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef5b002640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef5410c7e0 0x7fef54161830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef5b002640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fef54155c00 0x7fef54166c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef5b002640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fef54167220 con 0x7fef5410bed0 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef5b002640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fef54167390 con 0x7fef54155c00 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef5b002640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fef54167550 con 0x7fef5410c7e0 2026-02-24T09:13:55.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef58d77640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fef5410bed0 0x7fef541612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef58d77640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fef5410bed0 0x7fef541612f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44504/0 (socket says 10.20.193.4:44504) 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef58d77640 1 -- 10.20.193.4:0/1687509405 learned_addr learned my addr 10.20.193.4:0/1687509405 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef4bfff640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef5410c7e0 0x7fef54161830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef58d77640 1 -- 10.20.193.4:0/1687509405 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef5410c7e0 msgr2=0x7fef54161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef58d77640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef5410c7e0 0x7fef54161830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef59578640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fef54155c00 0x7fef54166c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef58d77640 1 -- 10.20.193.4:0/1687509405 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fef54155c00 msgr2=0x7fef54166c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef58d77640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fef54155c00 0x7fef54166c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef58d77640 1 -- 10.20.193.4:0/1687509405 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef44009570 con 0x7fef5410bed0 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef59578640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fef54155c00 0x7fef54166c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef58d77640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fef5410bed0 0x7fef541612f0 secure :-1 s=READY pgs=803 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef44038820 tx=0x7fef44004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef49ffb640 1 -- 10.20.193.4:0/1687509405 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef4403d070 con 0x7fef5410bed0 2026-02-24T09:13:55.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef5b002640 1 -- 10.20.193.4:0/1687509405 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef541677d0 con 0x7fef5410bed0 2026-02-24T09:13:55.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef49ffb640 1 -- 10.20.193.4:0/1687509405 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef44002ad0 con 0x7fef5410bed0 2026-02-24T09:13:55.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef49ffb640 1 -- 10.20.193.4:0/1687509405 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef44041940 con 0x7fef5410bed0 2026-02-24T09:13:55.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.398+0000 7fef5b002640 1 -- 10.20.193.4:0/1687509405 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef54152830 con 0x7fef5410bed0 2026-02-24T09:13:55.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.401+0000 7fef49ffb640 1 -- 10.20.193.4:0/1687509405 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fef44041ad0 con 0x7fef5410bed0 2026-02-24T09:13:55.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.401+0000 7fef49ffb640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fef300b56e0 0x7fef300d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.402+0000 7fef49ffb640 1 -- 10.20.193.4:0/1687509405 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fef4410c300 con 0x7fef5410bed0 2026-02-24T09:13:55.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.402+0000 7fef4bfff640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fef300b56e0 0x7fef300d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.407 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.402+0000 7fef4bfff640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fef300b56e0 0x7fef300d5b90 secure :-1 s=READY pgs=351 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef54167c90 tx=0x7fef3c005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.404+0000 7fef5cffce00 1 Processor -- start 2026-02-24T09:13:55.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.404+0000 7fef5cffce00 1 -- start start 2026-02-24T09:13:55.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.404+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584397f4300 0x5584397f46d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.404+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4c10 0x558439839370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.404+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584398398b0 0x558439859c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.404+0000 7fef5cffce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558439704520 con 0x5584397f4c10 2026-02-24T09:13:55.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.404+0000 7fef5cffce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558439700250 con 0x5584398398b0 2026-02-24T09:13:55.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.404+0000 7fef5cffce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584396fa3b0 con 0x5584397f4300 2026-02-24T09:13:55.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.404+0000 7fef4bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4c10 0x558439839370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef4bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4c10 0x558439839370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44520/0 (socket says 10.20.193.4:44520) 2026-02-24T09:13:55.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef4bfff640 1 -- 10.20.193.4:0/494702767 learned_addr learned my addr 10.20.193.4:0/494702767 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef59578640 1 --2- 10.20.193.4:0/494702767 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584398398b0 0x558439859c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef4bfff640 1 -- 10.20.193.4:0/494702767 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584397f4300 msgr2=0x5584397f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef4bfff640 1 --2- 10.20.193.4:0/494702767 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584397f4300 0x5584397f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef4bfff640 1 -- 10.20.193.4:0/494702767 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584398398b0 msgr2=0x558439859c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef4bfff640 1 --2- 10.20.193.4:0/494702767 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584398398b0 0x558439859c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef4bfff640 1 -- 10.20.193.4:0/494702767 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584396a56e0 con 0x5584397f4c10 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef4bfff640 1 --2- 10.20.193.4:0/494702767 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4c10 0x558439839370 secure :-1 s=READY pgs=804 gs=1 cs=0 l=1 c_cookie=10671874991115060947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef3c00fd10 tx=0x7fef3c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941a1dc32cc9c6d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef214e4640 1 -- 10.20.193.4:0/494702767 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef3c00fe10 con 0x5584397f4c10 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef214e4640 1 -- 10.20.193.4:0/494702767 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef3c01e940 con 0x5584397f4c10 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef214e4640 1 -- 10.20.193.4:0/494702767 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef3c010aa0 con 0x5584397f4c10 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef5cffce00 1 -- 10.20.193.4:0/494702767 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4c10 msgr2=0x558439839370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef5cffce00 1 --2- 10.20.193.4:0/494702767 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4c10 0x558439839370 secure :-1 s=READY pgs=804 gs=1 cs=0 l=1 c_cookie=10671874991115060947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef3c00fd10 tx=0x7fef3c012000 comp rx=0 tx=0).stop 2026-02-24T09:13:55.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef5cffce00 1 -- 10.20.193.4:0/494702767 shutdown_connections 2026-02-24T09:13:55.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef5cffce00 1 --2- 10.20.193.4:0/494702767 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584398398b0 0x558439859c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef5cffce00 1 --2- 10.20.193.4:0/494702767 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4c10 0x558439839370 unknown :-1 s=CLOSED pgs=804 gs=1 cs=0 l=1 c_cookie=10671874991115060947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef5cffce00 1 --2- 10.20.193.4:0/494702767 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584397f4300 0x5584397f46d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef5cffce00 1 -- 10.20.193.4:0/494702767 >> 10.20.193.4:0/494702767 conn(0x5584397124f0 msgr2=0x5584397f2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef5cffce00 1 -- 10.20.193.4:0/494702767 shutdown_connections 2026-02-24T09:13:55.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.405+0000 7fef5cffce00 1 -- 10.20.193.4:0/494702767 wait complete. 2026-02-24T09:13:55.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.407+0000 7fef5cffce00 1 -- start start 2026-02-24T09:13:55.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.407+0000 7fef5cffce00 1 Processor -- start 2026-02-24T09:13:55.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.407+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584397f4300 0x55843980c400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.407+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x55843980c940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.407+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584398398b0 0x55843980e6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.407+0000 7fef5cffce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55843980ec40 con 0x5584398398b0 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.407+0000 7fef5cffce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55843980edb0 con 0x5584397f4c10 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.407+0000 7fef5cffce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55843980ef70 con 0x5584397f4300 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.407+0000 7fef59578640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584398398b0 0x55843980e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef58d77640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584397f4300 0x55843980c400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef59578640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584398398b0 0x55843980e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44530/0 (socket says 10.20.193.4:44530) 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef59578640 1 -- 10.20.193.4:0/3923324353 learned_addr learned my addr 10.20.193.4:0/3923324353 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef4bfff640 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x55843980c940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef59578640 1 -- 10.20.193.4:0/3923324353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584397f4300 msgr2=0x55843980c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef59578640 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584397f4300 0x55843980c400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef59578640 1 -- 10.20.193.4:0/3923324353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 msgr2=0x55843980c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef59578640 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x55843980c940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef59578640 1 -- 10.20.193.4:0/3923324353 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55843967dcd0 con 0x5584398398b0 2026-02-24T09:13:55.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef4bfff640 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x55843980c940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef59578640 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584398398b0 0x55843980e6d0 secure :-1 s=READY pgs=805 gs=2 cs=0 l=1 c_cookie=13048658731088835620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef50013650 tx=0x7fef50013b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51625fb2dd97424 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef127fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef127fc640 1 -- 10.20.193.4:0/3923324353 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef500052e0 con 0x5584398398b0 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef127fc640 1 -- 10.20.193.4:0/3923324353 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef50011db0 con 0x5584398398b0 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef127fc640 1 -- 10.20.193.4:0/3923324353 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef5001c440 con 0x5584398398b0 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef5cffce00 1 -- 10.20.193.4:0/3923324353 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3c00f9b0 con 0x5584398398b0 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef127fc640 1 -- 10.20.193.4:0/3923324353 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fef5000f3e0 con 0x5584398398b0 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef127fc640 10 client.16692 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef5cffce00 10 client.16692 _ll_register_callbacks cb 0x558439676790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef5cffce00 1 -- 10.20.193.4:0/3923324353 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584393879d0 con 0x5584398398b0 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef127fc640 1 -- 10.20.193.4:0/3923324353 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fef50005440 con 0x5584398398b0 2026-02-24T09:13:55.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef5cffce00 10 client.16692 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.408+0000 7fef5cffce00 1 -- 10.20.193.4:0/3923324353 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55843968fab0 con 0x5584398398b0 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.409+0000 7fef127fc640 1 -- 10.20.193.4:0/3923324353 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fef50003780 con 0x5584398398b0 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.409+0000 7fef5cffce00 10 client.16692 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.409+0000 7fef5cffce00 10 client.16692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.409+0000 7fef5cffce00 20 client.16692 populate_metadata read hostname 'trial004' 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.409+0000 7fef5cffce00 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558439836bc0 0x558439837060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.409+0000 7fef5cffce00 4 client.16692 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.409+0000 7fef5cffce00 1 -- 10.20.193.4:0/3923324353 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55843970ab70 con 0x558439836bc0 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.409+0000 7fef58d77640 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558439836bc0 0x558439837060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.410+0000 7fef127fc640 10 client.16692 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:55.419 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.410+0000 7fef58d77640 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558439836bc0 0x558439837060 crc :-1 s=READY pgs=107 gs=4 cs=0 l=0 c_cookie=7803823227756695903 s_cookie=18321077698763692240 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c4cbfe11461515f server_cookie=fe418b19092418d0 in_seq=0 out_seq=0 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.410+0000 7fef127fc640 1 -- 10.20.193.4:0/3923324353 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55843970ab70 con 0x558439836bc0 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.410+0000 7fef127fc640 10 client.16692 handle_command_reply: tid=0 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.410+0000 7fef5cffce00 1 client.16692 shutdown 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 1 -- 10.20.193.4:0/3923324353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584398398b0 msgr2=0x55843980e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584398398b0 0x55843980e6d0 secure :-1 s=READY pgs=805 gs=2 cs=0 l=1 c_cookie=13048658731088835620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef50013650 tx=0x7fef50013b20 comp rx=0 tx=0).stop 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 1 -- 10.20.193.4:0/3923324353 shutdown_connections 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x558439836bc0 0x558439837060 crc :-1 s=READY pgs=107 gs=4 cs=0 l=0 c_cookie=7803823227756695903 s_cookie=18321077698763692240 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584398398b0 0x55843980e6d0 unknown :-1 s=CLOSED pgs=805 gs=2 cs=0 l=1 c_cookie=13048658731088835620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef127fc640 0 client.16692 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x55843980c940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 1 --2- 10.20.193.4:0/3923324353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584397f4300 0x55843980c400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 1 -- 10.20.193.4:0/3923324353 >> 10.20.193.4:0/3923324353 conn(0x5584397124f0 msgr2=0x5584397f32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 1 -- 10.20.193.4:0/3923324353 shutdown_connections 2026-02-24T09:13:55.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 1 -- 10.20.193.4:0/3923324353 wait complete. 2026-02-24T09:13:55.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.411+0000 7fef5cffce00 20 client.16692 trim_cache size 0 max 16384 2026-02-24T09:13:55.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.424+0000 7fef5cffce00 1 Processor -- start 2026-02-24T09:13:55.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.424+0000 7fef5cffce00 1 -- start start 2026-02-24T09:13:55.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.424+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x55843980e660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.424+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x5584397f34f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.424+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584398398b0 0x5584397f3a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.424+0000 7fef5cffce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5584396f7fe0 con 0x5584397f4300 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.424+0000 7fef5cffce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5584393c2fe0 con 0x5584397f4c10 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.424+0000 7fef5cffce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584398010d0 con 0x5584398398b0 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef58d77640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x55843980e660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef4bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x5584397f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef4bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x5584397f34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:38358/0 (socket says 10.20.193.4:38358) 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef58d77640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x55843980e660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44540/0 (socket says 10.20.193.4:44540) 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef59578640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584398398b0 0x5584397f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef4bfff640 1 -- 10.20.193.4:0/1052493427 learned_addr learned my addr 10.20.193.4:0/1052493427 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef58d77640 1 -- 10.20.193.4:0/1052493427 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584398398b0 msgr2=0x5584397f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef58d77640 1 --2- 10.20.193.4:0/1052493427 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584398398b0 0x5584397f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef58d77640 1 -- 10.20.193.4:0/1052493427 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 msgr2=0x5584397f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef58d77640 1 --2- 10.20.193.4:0/1052493427 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x5584397f34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef58d77640 1 -- 10.20.193.4:0/1052493427 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55843968a530 con 0x5584397f4300 2026-02-24T09:13:55.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef58d77640 1 --2- 10.20.193.4:0/1052493427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x55843980e660 secure :-1 s=READY pgs=806 gs=3 cs=0 l=1 c_cookie=282668949801838508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef44032040 tx=0x7fef44109040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec3de985f8a7ac server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef20ce3640 1 -- 10.20.193.4:0/1052493427 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef440d3070 con 0x5584397f4300 2026-02-24T09:13:55.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef20ce3640 1 -- 10.20.193.4:0/1052493427 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef440d8390 con 0x5584397f4300 2026-02-24T09:13:55.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.425+0000 7fef20ce3640 1 -- 10.20.193.4:0/1052493427 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef44038c40 con 0x5584397f4300 2026-02-24T09:13:55.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.426+0000 7fef5cffce00 1 -- 10.20.193.4:0/1052493427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 msgr2=0x55843980e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.426+0000 7fef5cffce00 1 --2- 10.20.193.4:0/1052493427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x55843980e660 secure :-1 s=READY pgs=806 gs=3 cs=0 l=1 c_cookie=282668949801838508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef44032040 tx=0x7fef44109040 comp rx=0 tx=0).stop 2026-02-24T09:13:55.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.426+0000 7fef5cffce00 1 -- 10.20.193.4:0/1052493427 shutdown_connections 2026-02-24T09:13:55.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.426+0000 7fef5cffce00 1 --2- 10.20.193.4:0/1052493427 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584398398b0 0x5584397f3a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.426+0000 7fef5cffce00 1 --2- 10.20.193.4:0/1052493427 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x5584397f34f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.426+0000 7fef5cffce00 1 --2- 10.20.193.4:0/1052493427 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x55843980e660 unknown :-1 s=CLOSED pgs=806 gs=3 cs=0 l=1 c_cookie=282668949801838508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.426+0000 7fef5cffce00 1 -- 10.20.193.4:0/1052493427 >> 10.20.193.4:0/1052493427 conn(0x5584397124f0 msgr2=0x558439810f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.426+0000 7fef5cffce00 1 -- 10.20.193.4:0/1052493427 shutdown_connections 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.426+0000 7fef5cffce00 1 -- 10.20.193.4:0/1052493427 wait complete. 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef5cffce00 1 -- start start 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef5cffce00 1 Processor -- start 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x5584398114e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x558439811a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef5cffce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584398398b0 0x558439816a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef5cffce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558439816f80 con 0x5584397f4300 2026-02-24T09:13:55.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef5cffce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5584398170f0 con 0x5584397f4c10 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef5cffce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584398172b0 con 0x5584398398b0 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef58d77640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x5584398114e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef58d77640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x5584398114e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44554/0 (socket says 10.20.193.4:44554) 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef58d77640 1 -- 10.20.193.4:0/1609912058 learned_addr learned my addr 10.20.193.4:0/1609912058 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef59578640 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584398398b0 0x558439816a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.427+0000 7fef4bfff640 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x558439811a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef58d77640 1 -- 10.20.193.4:0/1609912058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584398398b0 msgr2=0x558439816a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef58d77640 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584398398b0 0x558439816a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef58d77640 1 -- 10.20.193.4:0/1609912058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 msgr2=0x558439811a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef58d77640 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x558439811a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef58d77640 1 -- 10.20.193.4:0/1609912058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55843967e000 con 0x5584397f4300 2026-02-24T09:13:55.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef58d77640 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x5584398114e0 secure :-1 s=READY pgs=807 gs=1 cs=0 l=1 c_cookie=9917355317590783844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef440d2650 tx=0x7fef440d2180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a1861df0547764 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef127fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef127fc640 1 -- 10.20.193.4:0/1609912058 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef440da970 con 0x5584397f4300 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef127fc640 1 -- 10.20.193.4:0/1609912058 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef44109ec0 con 0x5584397f4300 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef127fc640 1 -- 10.20.193.4:0/1609912058 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef440d3560 con 0x5584397f4300 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef5cffce00 1 -- 10.20.193.4:0/1609912058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef54152830 con 0x5584397f4300 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef127fc640 1 -- 10.20.193.4:0/1609912058 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fef440dd320 con 0x5584397f4300 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef127fc640 10 client.16698 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef5cffce00 10 client.16698 _ll_register_callbacks cb 0x558439676790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef5cffce00 1 -- 10.20.193.4:0/1609912058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55843970c7e0 con 0x5584397f4300 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef127fc640 1 -- 10.20.193.4:0/1609912058 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fef440f60d0 con 0x5584397f4300 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef5cffce00 10 client.16698 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:55.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef5cffce00 1 -- 10.20.193.4:0/1609912058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55843968fd10 con 0x5584397f4300 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.428+0000 7fef127fc640 1 -- 10.20.193.4:0/1609912058 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fef440d2210 con 0x5584397f4300 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.429+0000 7fef5cffce00 10 client.16698 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.429+0000 7fef5cffce00 10 client.16698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.429+0000 7fef5cffce00 20 client.16698 populate_metadata read hostname 'trial004' 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.429+0000 7fef5cffce00 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584398e7280 0x558439907730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.429+0000 7fef5cffce00 4 client.16698 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.429+0000 7fef5cffce00 1 -- 10.20.193.4:0/1609912058 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558439385220 con 0x5584398e7280 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.429+0000 7fef4bfff640 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584398e7280 0x558439907730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.429+0000 7fef4bfff640 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584398e7280 0x558439907730 crc :-1 s=READY pgs=108 gs=4 cs=0 l=0 c_cookie=6661363088532846631 s_cookie=7083813293804104522 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c71ea6f83e63827 server_cookie=624ec2a8b8622b4a in_seq=0 out_seq=0 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.429+0000 7fef127fc640 10 client.16698 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef127fc640 1 -- 10.20.193.4:0/1609912058 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558439385220 con 0x5584398e7280 2026-02-24T09:13:55.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef127fc640 10 client.16698 handle_command_reply: tid=0 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 client.16698 shutdown 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 -- 10.20.193.4:0/1609912058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 msgr2=0x5584398114e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x5584398114e0 secure :-1 s=READY pgs=807 gs=1 cs=0 l=1 c_cookie=9917355317590783844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef440d2650 tx=0x7fef440d2180 comp rx=0 tx=0).stop 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 -- 10.20.193.4:0/1609912058 shutdown_connections 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584398e7280 0x558439907730 crc :-1 s=READY pgs=108 gs=4 cs=0 l=0 c_cookie=6661363088532846631 s_cookie=7083813293804104522 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584398398b0 0x558439816a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584397f4c10 0x558439811a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef127fc640 0 client.16698 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 --2- 10.20.193.4:0/1609912058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584397f4300 0x5584398114e0 unknown :-1 s=CLOSED pgs=807 gs=1 cs=0 l=1 c_cookie=9917355317590783844 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 -- 10.20.193.4:0/1609912058 >> 10.20.193.4:0/1609912058 conn(0x5584397124f0 msgr2=0x55843980ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 -- 10.20.193.4:0/1609912058 shutdown_connections 2026-02-24T09:13:55.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.430+0000 7fef5cffce00 1 -- 10.20.193.4:0/1609912058 wait complete. 2026-02-24T09:13:55.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5cffce00 20 client.16698 trim_cache size 0 max 16384 2026-02-24T09:13:55.441 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:13:55.441 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:13:55.441 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "8a539be5-29bd-4316-82f2-87aec88aa8d9", 2026-02-24T09:13:55.441 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:13:55.441 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:13:55.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 -- 10.20.193.4:0/1687509405 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fef300b56e0 msgr2=0x7fef300d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fef300b56e0 0x7fef300d5b90 secure :-1 s=READY pgs=351 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef54167c90 tx=0x7fef3c005d00 comp rx=0 tx=0).stop 2026-02-24T09:13:55.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 -- 10.20.193.4:0/1687509405 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fef5410bed0 msgr2=0x7fef541612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fef5410bed0 0x7fef541612f0 secure :-1 s=READY pgs=803 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef44038820 tx=0x7fef44004300 comp rx=0 tx=0).stop 2026-02-24T09:13:55.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 -- 10.20.193.4:0/1687509405 shutdown_connections 2026-02-24T09:13:55.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fef300b56e0 0x7fef300d5b90 unknown :-1 s=CLOSED pgs=351 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fef54155c00 0x7fef54166c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef5410c7e0 0x7fef54161830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 --2- 10.20.193.4:0/1687509405 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fef5410bed0 0x7fef541612f0 unknown :-1 s=CLOSED pgs=803 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 -- 10.20.193.4:0/1687509405 >> 10.20.193.4:0/1687509405 conn(0x7fef540e9bf0 msgr2=0x7fef54109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 -- 10.20.193.4:0/1687509405 shutdown_connections 2026-02-24T09:13:55.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.431+0000 7fef5b002640 1 -- 10.20.193.4:0/1687509405 wait complete. 2026-02-24T09:13:55.527 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:13:55.673 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:13:55.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.818+0000 7fa774c11640 1 -- 10.20.193.4:0/2187496813 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa77010f740 msgr2=0x7fa77010fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.818+0000 7fa774c11640 1 --2- 10.20.193.4:0/2187496813 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa77010f740 0x7fa77010fb10 secure :-1 s=READY pgs=808 gs=1 cs=0 l=1 c_cookie=12679554825093861829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa764009950 tx=0x7fa76402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 -- 10.20.193.4:0/2187496813 shutdown_connections 2026-02-24T09:13:55.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 --2- 10.20.193.4:0/2187496813 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa770115930 0x7fa770176300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 --2- 10.20.193.4:0/2187496813 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa770110130 0x7fa770115180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 --2- 10.20.193.4:0/2187496813 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa77010f740 0x7fa77010fb10 unknown :-1 s=CLOSED pgs=808 gs=1 cs=0 l=1 c_cookie=12679554825093861829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 -- 10.20.193.4:0/2187496813 >> 10.20.193.4:0/2187496813 conn(0x7fa7700ed050 msgr2=0x7fa77010d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 -- 10.20.193.4:0/2187496813 shutdown_connections 2026-02-24T09:13:55.825 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 -- 10.20.193.4:0/2187496813 wait complete. 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 Processor -- start 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 -- start start 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa77010f740 0x7fa77011e090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa770110130 0x7fa77011e5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa770115930 0x7fa7701239a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fa770123fc0 con 0x7fa77010f740 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fa770124130 con 0x7fa770115930 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa774c11640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7701242f0 con 0x7fa770110130 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa76e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa77010f740 0x7fa77011e090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa76e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa77010f740 0x7fa77011e090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44578/0 (socket says 10.20.193.4:44578) 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa76e575640 1 -- 10.20.193.4:0/2535241624 learned_addr learned my addr 10.20.193.4:0/2535241624 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:55.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa76ed76640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa770115930 0x7fa7701239a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa76e575640 1 -- 10.20.193.4:0/2535241624 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa770110130 msgr2=0x7fa77011e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa76e575640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa770110130 0x7fa77011e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa76e575640 1 -- 10.20.193.4:0/2535241624 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa770115930 msgr2=0x7fa7701239a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa76e575640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa770115930 0x7fa7701239a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa76e575640 1 -- 10.20.193.4:0/2535241624 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa764009570 con 0x7fa77010f740 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.819+0000 7fa76ed76640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa770115930 0x7fa7701239a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.820+0000 7fa76e575640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa77010f740 0x7fa77011e090 secure :-1 s=READY pgs=809 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7640023d0 tx=0x7fa7640043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.820+0000 7fa7577fe640 1 -- 10.20.193.4:0/2535241624 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa76403d070 con 0x7fa77010f740 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.820+0000 7fa774c11640 1 -- 10.20.193.4:0/2535241624 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa770124570 con 0x7fa77010f740 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.820+0000 7fa7577fe640 1 -- 10.20.193.4:0/2535241624 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa764038920 con 0x7fa77010f740 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.820+0000 7fa7577fe640 1 -- 10.20.193.4:0/2535241624 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7640419d0 con 0x7fa77010f740 2026-02-24T09:13:55.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.820+0000 7fa774c11640 1 -- 10.20.193.4:0/2535241624 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa770164cd0 con 0x7fa77010f740 2026-02-24T09:13:55.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.822+0000 7fa7577fe640 1 -- 10.20.193.4:0/2535241624 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fa764038a90 con 0x7fa77010f740 2026-02-24T09:13:55.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.823+0000 7fa7577fe640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa7480b5760 0x7fa7480d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.823+0000 7fa7577fe640 1 -- 10.20.193.4:0/2535241624 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa76410b2f0 con 0x7fa77010f740 2026-02-24T09:13:55.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.823+0000 7fa76dd74640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa7480b5760 0x7fa7480d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.823+0000 7fa76dd74640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa7480b5760 0x7fa7480d5c10 secure :-1 s=READY pgs=352 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa758005970 tx=0x7fa758005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa776c0be00 1 Processor -- start 2026-02-24T09:13:55.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa776c0be00 1 -- start start 2026-02-24T09:13:55.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 0x5616bf237bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf238130 0x5616bf27c890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf27cdd0 0x5616bf29d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa776c0be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5616bf147de0 con 0x5616bf27cdd0 2026-02-24T09:13:55.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa776c0be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5616bf143b10 con 0x5616bf237820 2026-02-24T09:13:55.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa776c0be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5616bf13dab0 con 0x5616bf238130 2026-02-24T09:13:55.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa76ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf27cdd0 0x5616bf29d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa76ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf27cdd0 0x5616bf29d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44582/0 (socket says 10.20.193.4:44582) 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa76ed76640 1 -- 10.20.193.4:0/487068905 learned_addr learned my addr 10.20.193.4:0/487068905 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.826+0000 7fa76dd74640 1 --2- 10.20.193.4:0/487068905 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf238130 0x5616bf27c890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa76e575640 1 --2- 10.20.193.4:0/487068905 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 0x5616bf237bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa76ed76640 1 -- 10.20.193.4:0/487068905 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf238130 msgr2=0x5616bf27c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa76ed76640 1 --2- 10.20.193.4:0/487068905 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf238130 0x5616bf27c890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa76ed76640 1 -- 10.20.193.4:0/487068905 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 msgr2=0x5616bf237bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa76ed76640 1 --2- 10.20.193.4:0/487068905 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 0x5616bf237bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa76ed76640 1 -- 10.20.193.4:0/487068905 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616bf0e9310 con 0x5616bf27cdd0 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa76e575640 1 --2- 10.20.193.4:0/487068905 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 0x5616bf237bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa76ed76640 1 --2- 10.20.193.4:0/487068905 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf27cdd0 0x5616bf29d1b0 secure :-1 s=READY pgs=810 gs=1 cs=0 l=1 c_cookie=15304496070182412800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa760004b70 tx=0x7fa76000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4647e16d195a200 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa754ff9640 1 -- 10.20.193.4:0/487068905 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa76000fea0 con 0x5616bf27cdd0 2026-02-24T09:13:55.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa754ff9640 1 -- 10.20.193.4:0/487068905 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa760004e90 con 0x5616bf27cdd0 2026-02-24T09:13:55.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.827+0000 7fa754ff9640 1 -- 10.20.193.4:0/487068905 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa760011920 con 0x5616bf27cdd0 2026-02-24T09:13:55.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.828+0000 7fa776c0be00 1 -- 10.20.193.4:0/487068905 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf27cdd0 msgr2=0x5616bf29d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.828+0000 7fa776c0be00 1 --2- 10.20.193.4:0/487068905 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf27cdd0 0x5616bf29d1b0 secure :-1 s=READY pgs=810 gs=1 cs=0 l=1 c_cookie=15304496070182412800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa760004b70 tx=0x7fa76000f6c0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.828+0000 7fa776c0be00 1 -- 10.20.193.4:0/487068905 shutdown_connections 2026-02-24T09:13:55.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.828+0000 7fa776c0be00 1 --2- 10.20.193.4:0/487068905 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf27cdd0 0x5616bf29d1b0 unknown :-1 s=CLOSED pgs=810 gs=1 cs=0 l=1 c_cookie=15304496070182412800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.828+0000 7fa776c0be00 1 --2- 10.20.193.4:0/487068905 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf238130 0x5616bf27c890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.828+0000 7fa776c0be00 1 --2- 10.20.193.4:0/487068905 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 0x5616bf237bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.828+0000 7fa776c0be00 1 -- 10.20.193.4:0/487068905 >> 10.20.193.4:0/487068905 conn(0x5616bf1566b0 msgr2=0x5616bf236100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.828+0000 7fa776c0be00 1 -- 10.20.193.4:0/487068905 shutdown_connections 2026-02-24T09:13:55.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.828+0000 7fa776c0be00 1 -- 10.20.193.4:0/487068905 wait complete. 2026-02-24T09:13:55.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa776c0be00 1 -- start start 2026-02-24T09:13:55.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa776c0be00 1 Processor -- start 2026-02-24T09:13:55.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf237820 0x5616bf24fdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf238130 0x5616bf250300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf27cdd0 0x5616bf2552f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa776c0be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5616bf255830 con 0x5616bf237820 2026-02-24T09:13:55.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa776c0be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5616bf2559a0 con 0x5616bf238130 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa776c0be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5616bf255b60 con 0x5616bf27cdd0 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa76e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf237820 0x5616bf24fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa76e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf237820 0x5616bf24fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44596/0 (socket says 10.20.193.4:44596) 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa76e575640 1 -- 10.20.193.4:0/2349679967 learned_addr learned my addr 10.20.193.4:0/2349679967 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa76dd74640 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf238130 0x5616bf250300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa76e575640 1 -- 10.20.193.4:0/2349679967 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf27cdd0 msgr2=0x5616bf2552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa76e575640 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf27cdd0 0x5616bf2552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa76e575640 1 -- 10.20.193.4:0/2349679967 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf238130 msgr2=0x5616bf250300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa76e575640 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf238130 0x5616bf250300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa76e575640 1 -- 10.20.193.4:0/2349679967 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616bf0c18c0 con 0x5616bf237820 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.829+0000 7fa76dd74640 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf238130 0x5616bf250300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:13:55.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa76e575640 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf237820 0x5616bf24fdc0 secure :-1 s=READY pgs=811 gs=1 cs=0 l=1 c_cookie=14250424513411420067 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7640414c0 tx=0x7fa7640d38a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c3ad97cc680fa3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa71ffff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa71ffff640 1 -- 10.20.193.4:0/2349679967 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7640d0e60 con 0x5616bf237820 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa71ffff640 1 -- 10.20.193.4:0/2349679967 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa7640d2060 con 0x5616bf237820 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa71ffff640 1 -- 10.20.193.4:0/2349679967 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7640d32d0 con 0x5616bf237820 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 1 -- 10.20.193.4:0/2349679967 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa760004790 con 0x5616bf237820 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa71ffff640 1 -- 10.20.193.4:0/2349679967 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa764041b30 con 0x5616bf237820 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa71ffff640 10 client.16710 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 10 client.16710 _ll_register_callbacks cb 0x5616bf0d9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 1 -- 10.20.193.4:0/2349679967 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616bee8d4a0 con 0x5616bf237820 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa71ffff640 1 -- 10.20.193.4:0/2349679967 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa7640d71c0 con 0x5616bf237820 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 10 client.16710 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:55.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 1 -- 10.20.193.4:0/2349679967 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5616bf0d36e0 con 0x5616bf237820 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa71ffff640 1 -- 10.20.193.4:0/2349679967 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa764041cf0 con 0x5616bf237820 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 10 client.16710 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 20 client.16710 populate_metadata read hostname 'trial004' 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5616bf27a1d0 0x5616bf27a670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 4 client.16710 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.830+0000 7fa776c0be00 1 -- 10.20.193.4:0/2349679967 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616bf1334f0 con 0x5616bf27a1d0 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.831+0000 7fa76dd74640 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5616bf27a1d0 0x5616bf27a670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.831+0000 7fa71ffff640 10 client.16710 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.831+0000 7fa76dd74640 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5616bf27a1d0 0x5616bf27a670 crc :-1 s=READY pgs=109 gs=4 cs=0 l=0 c_cookie=8137623617882475264 s_cookie=10525768066900900037 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70eea590c3b6cb00 server_cookie=92130a49f7c738c5 in_seq=0 out_seq=0 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.831+0000 7fa71ffff640 1 -- 10.20.193.4:0/2349679967 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5616bf1334f0 con 0x5616bf27a1d0 2026-02-24T09:13:55.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.831+0000 7fa71ffff640 10 client.16710 handle_command_reply: tid=0 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.831+0000 7fa776c0be00 1 client.16710 shutdown 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 1 -- 10.20.193.4:0/2349679967 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf237820 msgr2=0x5616bf24fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf237820 0x5616bf24fdc0 secure :-1 s=READY pgs=811 gs=1 cs=0 l=1 c_cookie=14250424513411420067 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7640414c0 tx=0x7fa7640d38a0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 1 -- 10.20.193.4:0/2349679967 shutdown_connections 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5616bf27a1d0 0x5616bf27a670 crc :-1 s=READY pgs=109 gs=4 cs=0 l=0 c_cookie=8137623617882475264 s_cookie=10525768066900900037 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf27cdd0 0x5616bf2552f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf238130 0x5616bf250300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2349679967 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf237820 0x5616bf24fdc0 unknown :-1 s=CLOSED pgs=811 gs=1 cs=0 l=1 c_cookie=14250424513411420067 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa71ffff640 0 client.16710 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 1 -- 10.20.193.4:0/2349679967 >> 10.20.193.4:0/2349679967 conn(0x5616bf1566b0 msgr2=0x5616bf236810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 1 -- 10.20.193.4:0/2349679967 shutdown_connections 2026-02-24T09:13:55.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 1 -- 10.20.193.4:0/2349679967 wait complete. 2026-02-24T09:13:55.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.832+0000 7fa776c0be00 20 client.16710 trim_cache size 0 max 16384 2026-02-24T09:13:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa776c0be00 1 Processor -- start 2026-02-24T09:13:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa776c0be00 1 -- start start 2026-02-24T09:13:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf237820 0x5616bf236c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf254860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf27cdd0 0x5616bf27bf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa776c0be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5616bf13b6e0 con 0x5616bf238130 2026-02-24T09:13:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa776c0be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5616bee06f50 con 0x5616bf27cdd0 2026-02-24T09:13:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa776c0be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5616bf1a73d0 con 0x5616bf237820 2026-02-24T09:13:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf254860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf237820 0x5616bf236c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf254860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44598/0 (socket says 10.20.193.4:44598) 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76dd74640 1 -- 10.20.193.4:0/1781978451 learned_addr learned my addr 10.20.193.4:0/1781978451 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76ed76640 1 --2- 10.20.193.4:0/1781978451 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf27cdd0 0x5616bf27bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76dd74640 1 -- 10.20.193.4:0/1781978451 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf237820 msgr2=0x5616bf236c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76dd74640 1 --2- 10.20.193.4:0/1781978451 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf237820 0x5616bf236c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76dd74640 1 -- 10.20.193.4:0/1781978451 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf27cdd0 msgr2=0x5616bf27bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76dd74640 1 --2- 10.20.193.4:0/1781978451 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf27cdd0 0x5616bf27bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76dd74640 1 -- 10.20.193.4:0/1781978451 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616bf0ce160 con 0x5616bf238130 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76ed76640 1 --2- 10.20.193.4:0/1781978451 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf27cdd0 0x5616bf27bf60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76e575640 1 --2- 10.20.193.4:0/1781978451 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf237820 0x5616bf236c20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa76dd74640 1 --2- 10.20.193.4:0/1781978451 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf254860 secure :-1 s=READY pgs=812 gs=2 cs=0 l=1 c_cookie=5737646022604709499 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa770124a30 tx=0x7fa758010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa036a880495e7b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa73a4e6640 1 -- 10.20.193.4:0/1781978451 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa758015040 con 0x5616bf238130 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa73a4e6640 1 -- 10.20.193.4:0/1781978451 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa758025150 con 0x5616bf238130 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.844+0000 7fa73a4e6640 1 -- 10.20.193.4:0/1781978451 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7580106e0 con 0x5616bf238130 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.845+0000 7fa776c0be00 1 -- 10.20.193.4:0/1781978451 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 msgr2=0x5616bf254860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.846+0000 7fa776c0be00 1 --2- 10.20.193.4:0/1781978451 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf254860 secure :-1 s=READY pgs=812 gs=2 cs=0 l=1 c_cookie=5737646022604709499 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa770124a30 tx=0x7fa758010000 comp rx=0 tx=0).stop 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.846+0000 7fa776c0be00 1 -- 10.20.193.4:0/1781978451 shutdown_connections 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.846+0000 7fa776c0be00 1 --2- 10.20.193.4:0/1781978451 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf27cdd0 0x5616bf27bf60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.846+0000 7fa776c0be00 1 --2- 10.20.193.4:0/1781978451 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf254860 unknown :-1 s=CLOSED pgs=812 gs=2 cs=0 l=1 c_cookie=5737646022604709499 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.846+0000 7fa776c0be00 1 --2- 10.20.193.4:0/1781978451 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf237820 0x5616bf236c20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.846+0000 7fa776c0be00 1 -- 10.20.193.4:0/1781978451 >> 10.20.193.4:0/1781978451 conn(0x5616bf1566b0 msgr2=0x5616bf254150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.846+0000 7fa776c0be00 1 -- 10.20.193.4:0/1781978451 shutdown_connections 2026-02-24T09:13:55.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.846+0000 7fa776c0be00 1 -- 10.20.193.4:0/1781978451 wait complete. 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.846+0000 7fa776c0be00 1 -- start start 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.846+0000 7fa776c0be00 1 Processor -- start 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 0x5616bf2577a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf257ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa776c0be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf27cdd0 0x5616bf258260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa776c0be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5616bf1aa150 con 0x5616bf238130 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa776c0be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5616bf2e24e0 con 0x5616bf237820 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa776c0be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5616bf2e26a0 con 0x5616bf27cdd0 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf257ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf257ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44614/0 (socket says 10.20.193.4:44614) 2026-02-24T09:13:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76dd74640 1 -- 10.20.193.4:0/2889751201 learned_addr learned my addr 10.20.193.4:0/2889751201 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:13:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76e575640 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 0x5616bf2577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76ed76640 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf27cdd0 0x5616bf258260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76dd74640 1 -- 10.20.193.4:0/2889751201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf27cdd0 msgr2=0x5616bf258260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76dd74640 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf27cdd0 0x5616bf258260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76dd74640 1 -- 10.20.193.4:0/2889751201 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 msgr2=0x5616bf2577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:13:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76dd74640 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 0x5616bf2577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76dd74640 1 -- 10.20.193.4:0/2889751201 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616bf0c1bf0 con 0x5616bf238130 2026-02-24T09:13:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa76dd74640 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf257ce0 secure :-1 s=READY pgs=813 gs=2 cs=0 l=1 c_cookie=11756142976962625034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa758004040 tx=0x7fa758004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32635c0368f7e0a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:13:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa71ffff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa71ffff640 1 -- 10.20.193.4:0/2889751201 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa758025bd0 con 0x5616bf238130 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa71ffff640 1 -- 10.20.193.4:0/2889751201 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa758002b80 con 0x5616bf238130 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa71ffff640 1 -- 10.20.193.4:0/2889751201 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa758010d20 con 0x5616bf238130 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa776c0be00 1 -- 10.20.193.4:0/2889751201 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75800d990 con 0x5616bf238130 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.847+0000 7fa71ffff640 1 -- 10.20.193.4:0/2889751201 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa758038460 con 0x5616bf238130 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa71ffff640 10 client.16716 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa776c0be00 10 client.16716 _ll_register_callbacks cb 0x5616bf0d9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa776c0be00 1 -- 10.20.193.4:0/2889751201 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616bedc8f40 con 0x5616bf238130 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa71ffff640 1 -- 10.20.193.4:0/2889751201 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa758025d30 con 0x5616bf238130 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa776c0be00 10 client.16716 fetch_fsmap learned FSMap version 19 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa776c0be00 1 -- 10.20.193.4:0/2889751201 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5616bf0d3940 con 0x5616bf238130 2026-02-24T09:13:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa71ffff640 1 -- 10.20.193.4:0/2889751201 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa758010460 con 0x5616bf238130 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa776c0be00 10 client.16716 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa776c0be00 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa776c0be00 20 client.16716 populate_metadata read hostname 'trial004' 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5616bf32a610 0x5616bf34aac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa776c0be00 4 client.16716 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa776c0be00 1 -- 10.20.193.4:0/2889751201 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa760004e90 con 0x5616bf32a610 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.848+0000 7fa76e575640 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5616bf32a610 0x5616bf34aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa76e575640 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5616bf32a610 0x5616bf34aac0 crc :-1 s=READY pgs=110 gs=4 cs=0 l=0 c_cookie=4444855399157983565 s_cookie=13318887790590777555 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3daf4c6f88c9e94d server_cookie=b8d631e1097358d3 in_seq=0 out_seq=0 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa71ffff640 10 client.16716 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa71ffff640 1 -- 10.20.193.4:0/2889751201 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x7fa760004e90 con 0x5616bf32a610 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa71ffff640 10 client.16716 handle_command_reply: tid=0 2026-02-24T09:13:55.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 client.16716 shutdown 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 -- 10.20.193.4:0/2889751201 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 msgr2=0x5616bf257ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf257ce0 secure :-1 s=READY pgs=813 gs=2 cs=0 l=1 c_cookie=11756142976962625034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa758004040 tx=0x7fa758004740 comp rx=0 tx=0).stop 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 -- 10.20.193.4:0/2889751201 shutdown_connections 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5616bf32a610 0x5616bf34aac0 crc :-1 s=READY pgs=110 gs=4 cs=0 l=0 c_cookie=4444855399157983565 s_cookie=13318887790590777555 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5616bf27cdd0 0x5616bf258260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5616bf238130 0x5616bf257ce0 unknown :-1 s=CLOSED pgs=813 gs=2 cs=0 l=1 c_cookie=11756142976962625034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 --2- 10.20.193.4:0/2889751201 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5616bf237820 0x5616bf2577a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa71ffff640 0 client.16716 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 -- 10.20.193.4:0/2889751201 >> 10.20.193.4:0/2889751201 conn(0x5616bf1566b0 msgr2=0x5616bf254940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 -- 10.20.193.4:0/2889751201 shutdown_connections 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.849+0000 7fa776c0be00 1 -- 10.20.193.4:0/2889751201 wait complete. 2026-02-24T09:13:55.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa776c0be00 20 client.16716 trim_cache size 0 max 16384 2026-02-24T09:13:55.862 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:13:55.862 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:13:55.862 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:13:55.862 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:13:55.862 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:55.862 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "8a539be5-29bd-4316-82f2-87aec88aa8d9", 2026-02-24T09:13:55.862 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:55.863 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:55.864 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:13:55.865 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:55.866 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:55.867 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:55.868 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:13:55.869 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:13:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 -- 10.20.193.4:0/2535241624 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa7480b5760 msgr2=0x7fa7480d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa7480b5760 0x7fa7480d5c10 secure :-1 s=READY pgs=352 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa758005970 tx=0x7fa758005900 comp rx=0 tx=0).stop 2026-02-24T09:13:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 -- 10.20.193.4:0/2535241624 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa77010f740 msgr2=0x7fa77011e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:13:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa77010f740 0x7fa77011e090 secure :-1 s=READY pgs=809 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7640023d0 tx=0x7fa7640043d0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 -- 10.20.193.4:0/2535241624 shutdown_connections 2026-02-24T09:13:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa7480b5760 0x7fa7480d5c10 unknown :-1 s=CLOSED pgs=352 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa770115930 0x7fa7701239a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa770110130 0x7fa77011e5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 --2- 10.20.193.4:0/2535241624 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa77010f740 0x7fa77011e090 unknown :-1 s=CLOSED pgs=809 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:13:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 -- 10.20.193.4:0/2535241624 >> 10.20.193.4:0/2535241624 conn(0x7fa7700ed050 msgr2=0x7fa77010d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:13:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 -- 10.20.193.4:0/2535241624 shutdown_connections 2026-02-24T09:13:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:13:55.850+0000 7fa774c11640 1 -- 10.20.193.4:0/2535241624 wait complete. 2026-02-24T09:13:55.940 INFO:tasks.cephfs.filesystem:scrub status for tag:8a539be5-29bd-4316-82f2-87aec88aa8d9 - {'path': '/', 'tag': '8a539be5-29bd-4316-82f2-87aec88aa8d9', 'options': 'recursive,force'} 2026-02-24T09:13:56.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:55 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:13:56.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:55 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:56.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:55 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:13:56.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:55 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:56.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:55 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:13:56.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:55 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:56.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:55 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:13:56.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:55 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:56.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:55 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:13:56.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:55 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:56.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:55 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:13:56.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:55 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:13:57.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:56 trial004 ceph-mon[41596]: pgmap v276: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 768 MiB/s wr, 204 op/s 2026-02-24T09:13:57.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:56 trial090 ceph-mon[47278]: pgmap v276: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 768 MiB/s wr, 204 op/s 2026-02-24T09:13:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:56 trial014 ceph-mon[46941]: pgmap v276: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 768 MiB/s wr, 204 op/s 2026-02-24T09:13:59.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:58 trial004 ceph-mon[41596]: pgmap v277: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 54 KiB/s rd, 888 MiB/s wr, 244 op/s 2026-02-24T09:13:59.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:58 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:13:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:58 trial090 ceph-mon[47278]: pgmap v277: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 54 KiB/s rd, 888 MiB/s wr, 244 op/s 2026-02-24T09:13:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:58 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:13:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:58 trial014 ceph-mon[46941]: pgmap v277: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 54 KiB/s rd, 888 MiB/s wr, 244 op/s 2026-02-24T09:13:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:58 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:14:00.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:13:59 trial004 ceph-mon[41596]: pgmap v278: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 827 MiB/s wr, 230 op/s 2026-02-24T09:14:00.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:13:59 trial090 ceph-mon[47278]: pgmap v278: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 827 MiB/s wr, 230 op/s 2026-02-24T09:14:00.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:13:59 trial014 ceph-mon[46941]: pgmap v278: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 827 MiB/s wr, 230 op/s 2026-02-24T09:14:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:02 trial090 ceph-mon[47278]: pgmap v279: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 833 MiB/s wr, 232 op/s 2026-02-24T09:14:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:02 trial014 ceph-mon[46941]: pgmap v279: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 833 MiB/s wr, 232 op/s 2026-02-24T09:14:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:02 trial004 ceph-mon[41596]: pgmap v279: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 833 MiB/s wr, 232 op/s 2026-02-24T09:14:05.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:04 trial090 ceph-mon[47278]: pgmap v280: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 707 MiB/s wr, 201 op/s 2026-02-24T09:14:05.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:04 trial014 ceph-mon[46941]: pgmap v280: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 707 MiB/s wr, 201 op/s 2026-02-24T09:14:05.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:04 trial004 ceph-mon[41596]: pgmap v280: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 707 MiB/s wr, 201 op/s 2026-02-24T09:14:07.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:06 trial090 ceph-mon[47278]: pgmap v281: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 693 MiB/s wr, 197 op/s 2026-02-24T09:14:07.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:06 trial014 ceph-mon[46941]: pgmap v281: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 693 MiB/s wr, 197 op/s 2026-02-24T09:14:07.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:06 trial004 ceph-mon[41596]: pgmap v281: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 693 MiB/s wr, 197 op/s 2026-02-24T09:14:09.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:08 trial090 ceph-mon[47278]: pgmap v282: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 61 KiB/s rd, 824 MiB/s wr, 226 op/s 2026-02-24T09:14:09.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:08 trial014 ceph-mon[46941]: pgmap v282: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 61 KiB/s rd, 824 MiB/s wr, 226 op/s 2026-02-24T09:14:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:08 trial004 ceph-mon[41596]: pgmap v282: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 61 KiB/s rd, 824 MiB/s wr, 226 op/s 2026-02-24T09:14:11.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:10 trial090 ceph-mon[47278]: pgmap v283: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 825 MiB/s wr, 220 op/s 2026-02-24T09:14:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:10 trial014 ceph-mon[46941]: pgmap v283: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 825 MiB/s wr, 220 op/s 2026-02-24T09:14:11.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:10 trial004 ceph-mon[41596]: pgmap v283: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 825 MiB/s wr, 220 op/s 2026-02-24T09:14:11.836 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-24T09:14:11.836 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2026-02-24T09:14:11.836 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:14:12.016 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:12.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 -- 10.20.193.4:0/351385238 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f778410d010 msgr2=0x7f778410d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 --2- 10.20.193.4:0/351385238 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f778410d010 0x7f778410d3e0 secure :-1 s=READY pgs=814 gs=1 cs=0 l=1 c_cookie=544558337324081567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7774009950 tx=0x7f777402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 -- 10.20.193.4:0/351385238 shutdown_connections 2026-02-24T09:14:12.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 --2- 10.20.193.4:0/351385238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7784113200 0x7f7784173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 --2- 10.20.193.4:0/351385238 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f778410da00 0x7f7784112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 --2- 10.20.193.4:0/351385238 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f778410d010 0x7f778410d3e0 unknown :-1 s=CLOSED pgs=814 gs=1 cs=0 l=1 c_cookie=544558337324081567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 -- 10.20.193.4:0/351385238 >> 10.20.193.4:0/351385238 conn(0x7f778405f830 msgr2=0x7f778410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:12.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 -- 10.20.193.4:0/351385238 shutdown_connections 2026-02-24T09:14:12.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 -- 10.20.193.4:0/351385238 wait complete. 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 Processor -- start 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 -- start start 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f778410d010 0x7f77840f55c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f778410da00 0x7f7784173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7784113200 0x7f77840f5cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f77840fae80 con 0x7f778410d010 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f77840faff0 con 0x7f7784113200 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778c5cc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77840fb1b0 con 0x7f778410da00 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778a341640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f778410d010 0x7f77840f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778a341640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f778410d010 0x7f77840f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59454/0 (socket says 10.20.193.4:59454) 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778a341640 1 -- 10.20.193.4:0/371773515 learned_addr learned my addr 10.20.193.4:0/371773515 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:12.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778a341640 1 -- 10.20.193.4:0/371773515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f778410da00 msgr2=0x7f7784173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778a341640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f778410da00 0x7f7784173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778a341640 1 -- 10.20.193.4:0/371773515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7784113200 msgr2=0x7f77840f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778ab42640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7784113200 0x7f77840f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778a341640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7784113200 0x7f77840f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.162+0000 7f778a341640 1 -- 10.20.193.4:0/371773515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7774009570 con 0x7f778410d010 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.163+0000 7f778a341640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f778410d010 0x7f77840f55c0 secure :-1 s=READY pgs=815 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7774038820 tx=0x7f7774004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.163+0000 7f776b7fe640 1 -- 10.20.193.4:0/371773515 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f777403d070 con 0x7f778410d010 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.163+0000 7f778c5cc640 1 -- 10.20.193.4:0/371773515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77840fb430 con 0x7f778410d010 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.163+0000 7f776b7fe640 1 -- 10.20.193.4:0/371773515 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7774002ad0 con 0x7f778410d010 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.163+0000 7f776b7fe640 1 -- 10.20.193.4:0/371773515 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7774041940 con 0x7f778410d010 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.163+0000 7f778c5cc640 1 -- 10.20.193.4:0/371773515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77840fb8f0 con 0x7f778410d010 2026-02-24T09:14:12.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.163+0000 7f778c5cc640 1 -- 10.20.193.4:0/371773515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f778410e2f0 con 0x7f778410d010 2026-02-24T09:14:12.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.165+0000 7f776b7fe640 1 -- 10.20.193.4:0/371773515 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f7774041ad0 con 0x7f778410d010 2026-02-24T09:14:12.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.166+0000 7f776b7fe640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77600b56d0 0x7f77600d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.166+0000 7f776b7fe640 1 -- 10.20.193.4:0/371773515 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f777410b910 con 0x7f778410d010 2026-02-24T09:14:12.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.166+0000 7f7789b40640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77600b56d0 0x7f77600d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.166+0000 7f776b7fe640 1 -- 10.20.193.4:0/371773515 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f77740ce290 con 0x7f778410d010 2026-02-24T09:14:12.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.166+0000 7f7789b40640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77600b56d0 0x7f77600d5b80 secure :-1 s=READY pgs=353 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77840fbf10 tx=0x7f7778009690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:12.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.326+0000 7f778c5cc640 1 -- 10.20.193.4:0/371773515 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f778410d3e0 con 0x7f778410d010 2026-02-24T09:14:12.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.327+0000 7f776b7fe640 1 -- 10.20.193.4:0/371773515 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f77740d1440 con 0x7f778410d010 2026-02-24T09:14:12.330 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:14:12.331 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:14:12.331 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:14:12.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 -- 10.20.193.4:0/371773515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77600b56d0 msgr2=0x7f77600d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77600b56d0 0x7f77600d5b80 secure :-1 s=READY pgs=353 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77840fbf10 tx=0x7f7778009690 comp rx=0 tx=0).stop 2026-02-24T09:14:12.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 -- 10.20.193.4:0/371773515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f778410d010 msgr2=0x7f77840f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f778410d010 0x7f77840f55c0 secure :-1 s=READY pgs=815 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7774038820 tx=0x7f7774004300 comp rx=0 tx=0).stop 2026-02-24T09:14:12.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 -- 10.20.193.4:0/371773515 shutdown_connections 2026-02-24T09:14:12.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f77600b56d0 0x7f77600d5b80 unknown :-1 s=CLOSED pgs=353 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7784113200 0x7f77840f5cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f778410da00 0x7f7784173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 --2- 10.20.193.4:0/371773515 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f778410d010 0x7f77840f55c0 unknown :-1 s=CLOSED pgs=815 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 -- 10.20.193.4:0/371773515 >> 10.20.193.4:0/371773515 conn(0x7f778405f830 msgr2=0x7f7784110160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:12.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 -- 10.20.193.4:0/371773515 shutdown_connections 2026-02-24T09:14:12.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.331+0000 7f778c5cc640 1 -- 10.20.193.4:0/371773515 wait complete. 2026-02-24T09:14:12.444 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2026-02-24T09:14:12.445 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2026-02-24T09:14:12.592 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:12.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.753+0000 7f9c5709f640 1 -- 10.20.193.4:0/1573396795 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c5010bcd0 msgr2=0x7f9c50110b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.753+0000 7f9c5709f640 1 --2- 10.20.193.4:0/1573396795 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c5010bcd0 0x7f9c50110b60 secure :-1 s=READY pgs=90 gs=3 cs=0 l=1 c_cookie=17303697091332147224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c38009890 tx=0x7f9c3802f0e0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.753+0000 7f9c5709f640 1 -- 10.20.193.4:0/1573396795 shutdown_connections 2026-02-24T09:14:12.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.753+0000 7f9c5709f640 1 --2- 10.20.193.4:0/1573396795 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c501112f0 0x7f9c50111cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.753+0000 7f9c5709f640 1 --2- 10.20.193.4:0/1573396795 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c5010bcd0 0x7f9c50110b60 unknown :-1 s=CLOSED pgs=90 gs=3 cs=0 l=1 c_cookie=17303697091332147224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.753+0000 7f9c5709f640 1 --2- 10.20.193.4:0/1573396795 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c5010b2e0 0x7f9c5010b6b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.753+0000 7f9c5709f640 1 -- 10.20.193.4:0/1573396795 >> 10.20.193.4:0/1573396795 conn(0x7f9c500e8e50 msgr2=0x7f9c50109260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.753+0000 7f9c5709f640 1 -- 10.20.193.4:0/1573396795 shutdown_connections 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.753+0000 7f9c5709f640 1 -- 10.20.193.4:0/1573396795 wait complete. 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.754+0000 7f9c5709f640 1 Processor -- start 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.754+0000 7f9c5709f640 1 -- start start 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.754+0000 7f9c5709f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c5010b2e0 0x7f9c500f08d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.754+0000 7f9c5709f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c5010bcd0 0x7f9c500f0e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.754+0000 7f9c5709f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c501112f0 0x7f9c500f61e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.754+0000 7f9c5709f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9c500f67b0 con 0x7f9c501112f0 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.754+0000 7f9c5709f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9c500f68f0 con 0x7f9c5010b2e0 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.754+0000 7f9c5709f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c500f6ab0 con 0x7f9c5010bcd0 2026-02-24T09:14:12.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c54e14640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c5010b2e0 0x7f9c500f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c55615640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c501112f0 0x7f9c500f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c47fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c5010bcd0 0x7f9c500f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c54e14640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c5010b2e0 0x7f9c500f08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:37886/0 (socket says 10.20.193.4:37886) 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c55615640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c501112f0 0x7f9c500f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59474/0 (socket says 10.20.193.4:59474) 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c54e14640 1 -- 10.20.193.4:0/3587488312 learned_addr learned my addr 10.20.193.4:0/3587488312 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c54e14640 1 -- 10.20.193.4:0/3587488312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c5010bcd0 msgr2=0x7f9c500f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c54e14640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c5010bcd0 0x7f9c500f0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c54e14640 1 -- 10.20.193.4:0/3587488312 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c501112f0 msgr2=0x7f9c500f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c54e14640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c501112f0 0x7f9c500f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c54e14640 1 -- 10.20.193.4:0/3587488312 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c380094b0 con 0x7f9c5010b2e0 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c55615640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c501112f0 0x7f9c500f61e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c54e14640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c5010b2e0 0x7f9c500f08d0 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c4000e9c0 tx=0x7f9c4000ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:12.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c45ffb640 1 -- 10.20.193.4:0/3587488312 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c4000cd70 con 0x7f9c5010b2e0 2026-02-24T09:14:12.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c5709f640 1 -- 10.20.193.4:0/3587488312 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c500f6d90 con 0x7f9c5010b2e0 2026-02-24T09:14:12.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c5709f640 1 -- 10.20.193.4:0/3587488312 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c500f74f0 con 0x7f9c5010b2e0 2026-02-24T09:14:12.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.755+0000 7f9c45ffb640 1 -- 10.20.193.4:0/3587488312 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9c40004d30 con 0x7f9c5010b2e0 2026-02-24T09:14:12.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.756+0000 7f9c45ffb640 1 -- 10.20.193.4:0/3587488312 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c400106b0 con 0x7f9c5010b2e0 2026-02-24T09:14:12.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.764+0000 7f9c45ffb640 1 -- 10.20.193.4:0/3587488312 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9c4001f060 con 0x7f9c5010b2e0 2026-02-24T09:14:12.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.766+0000 7f9c45ffb640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c2c0b5760 0x7f9c2c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.766+0000 7f9c45ffb640 1 -- 10.20.193.4:0/3587488312 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9c40014070 con 0x7f9c5010b2e0 2026-02-24T09:14:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.767+0000 7f9c47fff640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c2c0b5760 0x7f9c2c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.768+0000 7f9c47fff640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c2c0b5760 0x7f9c2c0d5c10 secure :-1 s=READY pgs=354 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c500f7270 tx=0x7f9c3803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.770+0000 7f9c59099e00 1 Processor -- start 2026-02-24T09:14:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.770+0000 7f9c59099e00 1 -- start start 2026-02-24T09:14:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.770+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015dbd0 0x56294015dfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.770+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015e4e0 0x5629401a2c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.770+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 0x5629401c3560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.770+0000 7f9c59099e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56294006cf20 con 0x56294015dbd0 2026-02-24T09:14:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.770+0000 7f9c59099e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562940068c50 con 0x5629401a3180 2026-02-24T09:14:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.770+0000 7f9c59099e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562940062db0 con 0x56294015e4e0 2026-02-24T09:14:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.771+0000 7f9c54e14640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015dbd0 0x56294015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.771+0000 7f9c54e14640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015dbd0 0x56294015dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59488/0 (socket says 10.20.193.4:59488) 2026-02-24T09:14:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.771+0000 7f9c54e14640 1 -- 10.20.193.4:0/2277254645 learned_addr learned my addr 10.20.193.4:0/2277254645 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:12.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.771+0000 7f9c55615640 1 --2- 10.20.193.4:0/2277254645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 0x5629401c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.771+0000 7f9c54e14640 1 -- 10.20.193.4:0/2277254645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015e4e0 msgr2=0x5629401a2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:12.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.771+0000 7f9c54e14640 1 --2- 10.20.193.4:0/2277254645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015e4e0 0x5629401a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.771+0000 7f9c54e14640 1 -- 10.20.193.4:0/2277254645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 msgr2=0x5629401c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:12.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.771+0000 7f9c54e14640 1 --2- 10.20.193.4:0/2277254645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 0x5629401c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.771+0000 7f9c54e14640 1 -- 10.20.193.4:0/2277254645 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562940003690 con 0x56294015dbd0 2026-02-24T09:14:12.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.771+0000 7f9c54e14640 1 --2- 10.20.193.4:0/2277254645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015dbd0 0x56294015dfa0 secure :-1 s=READY pgs=816 gs=2 cs=0 l=1 c_cookie=7783259057625069514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c40005460 tx=0x7f9c400a8e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c03b0e01c9577ca server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:12.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.772+0000 7f9c1d4e4640 1 -- 10.20.193.4:0/2277254645 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c400ac7a0 con 0x56294015dbd0 2026-02-24T09:14:12.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.772+0000 7f9c1d4e4640 1 -- 10.20.193.4:0/2277254645 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9c4006be90 con 0x56294015dbd0 2026-02-24T09:14:12.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.772+0000 7f9c1d4e4640 1 -- 10.20.193.4:0/2277254645 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c400d2350 con 0x56294015dbd0 2026-02-24T09:14:12.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.773+0000 7f9c59099e00 1 -- 10.20.193.4:0/2277254645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015dbd0 msgr2=0x56294015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.773+0000 7f9c59099e00 1 --2- 10.20.193.4:0/2277254645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015dbd0 0x56294015dfa0 secure :-1 s=READY pgs=816 gs=2 cs=0 l=1 c_cookie=7783259057625069514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c40005460 tx=0x7f9c400a8e40 comp rx=0 tx=0).stop 2026-02-24T09:14:12.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.773+0000 7f9c59099e00 1 -- 10.20.193.4:0/2277254645 shutdown_connections 2026-02-24T09:14:12.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.773+0000 7f9c59099e00 1 --2- 10.20.193.4:0/2277254645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 0x5629401c3560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.773+0000 7f9c59099e00 1 --2- 10.20.193.4:0/2277254645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015e4e0 0x5629401a2c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.773+0000 7f9c59099e00 1 --2- 10.20.193.4:0/2277254645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015dbd0 0x56294015dfa0 unknown :-1 s=CLOSED pgs=816 gs=2 cs=0 l=1 c_cookie=7783259057625069514 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.773+0000 7f9c59099e00 1 -- 10.20.193.4:0/2277254645 >> 10.20.193.4:0/2277254645 conn(0x56294007b880 msgr2=0x56294015c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:12.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.773+0000 7f9c59099e00 1 -- 10.20.193.4:0/2277254645 shutdown_connections 2026-02-24T09:14:12.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.773+0000 7f9c59099e00 1 -- 10.20.193.4:0/2277254645 wait complete. 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.775+0000 7f9c59099e00 1 -- start start 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.775+0000 7f9c59099e00 1 Processor -- start 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.775+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015dbd0 0x562940175ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.775+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x562940175ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.775+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 0x56294017afe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.775+0000 7f9c59099e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56294017b520 con 0x56294015e4e0 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.775+0000 7f9c59099e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56294017b690 con 0x5629401a3180 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.775+0000 7f9c59099e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56294017b850 con 0x56294015dbd0 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c47fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x562940175ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c47fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x562940175ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59498/0 (socket says 10.20.193.4:59498) 2026-02-24T09:14:12.781 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c47fff640 1 -- 10.20.193.4:0/428010222 learned_addr learned my addr 10.20.193.4:0/428010222 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c55615640 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 0x56294017afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c47fff640 1 -- 10.20.193.4:0/428010222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015dbd0 msgr2=0x562940175ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c47fff640 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015dbd0 0x562940175ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c47fff640 1 -- 10.20.193.4:0/428010222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 msgr2=0x56294017afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c47fff640 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 0x56294017afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c47fff640 1 -- 10.20.193.4:0/428010222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56294000e3d0 con 0x56294015e4e0 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c55615640 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 0x56294017afe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c47fff640 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x562940175ff0 secure :-1 s=READY pgs=817 gs=1 cs=0 l=1 c_cookie=15932918593054675743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c3802f5f0 tx=0x7f9c38002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1d190b4e3d931f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c0e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/428010222 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c380388d0 con 0x56294015e4e0 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/428010222 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9c3804a040 con 0x56294015e4e0 2026-02-24T09:14:12.782 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c59099e00 1 -- 10.20.193.4:0/428010222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c500f74f0 con 0x56294015e4e0 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/428010222 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c3804eea0 con 0x56294015e4e0 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c59099e00 10 client.16734 _ll_register_callbacks cb 0x56293ffe3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c59099e00 1 -- 10.20.193.4:0/428010222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56293fcf0eb0 con 0x56294015e4e0 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/428010222 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9c38058460 con 0x56294015e4e0 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/428010222 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9c38058660 con 0x56294015e4e0 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c59099e00 10 client.16734 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.776+0000 7f9c59099e00 1 -- 10.20.193.4:0/428010222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56293ffe65c0 con 0x56294015e4e0 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.777+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/428010222 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9c3804d070 con 0x56294015e4e0 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.777+0000 7f9c59099e00 10 client.16734 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.777+0000 7f9c59099e00 10 client.16734 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.777+0000 7f9c59099e00 20 client.16734 populate_metadata read hostname 'trial004' 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.777+0000 7f9c59099e00 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5629401a0390 0x5629401a0830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.777+0000 7f9c59099e00 4 client.16734 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:14:12.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.777+0000 7f9c59099e00 1 -- 10.20.193.4:0/428010222 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562940073f00 con 0x5629401a0390 2026-02-24T09:14:12.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.777+0000 7f9c54e14640 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5629401a0390 0x5629401a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.778+0000 7f9c54e14640 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5629401a0390 0x5629401a0830 crc :-1 s=READY pgs=111 gs=4 cs=0 l=0 c_cookie=9043335565413951087 s_cookie=17110028579074782169 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d8061c87927a66f server_cookie=ed7308570088b3d9 in_seq=0 out_seq=0 2026-02-24T09:14:12.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.778+0000 7f9c0e7fc640 10 client.16734 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:12.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.778+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/428010222 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562940073f00 con 0x5629401a0390 2026-02-24T09:14:12.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.778+0000 7f9c0e7fc640 10 client.16734 handle_command_reply: tid=0 2026-02-24T09:14:12.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.778+0000 7f9c59099e00 1 client.16734 shutdown 2026-02-24T09:14:12.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 1 -- 10.20.193.4:0/428010222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 msgr2=0x562940175ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x562940175ff0 secure :-1 s=READY pgs=817 gs=1 cs=0 l=1 c_cookie=15932918593054675743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c3802f5f0 tx=0x7f9c38002390 comp rx=0 tx=0).stop 2026-02-24T09:14:12.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 1 -- 10.20.193.4:0/428010222 shutdown_connections 2026-02-24T09:14:12.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5629401a0390 0x5629401a0830 crc :-1 s=READY pgs=111 gs=4 cs=0 l=0 c_cookie=9043335565413951087 s_cookie=17110028579074782169 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a3180 0x56294017afe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x562940175ff0 unknown :-1 s=CLOSED pgs=817 gs=1 cs=0 l=1 c_cookie=15932918593054675743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c0e7fc640 0 client.16734 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:12.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 1 --2- 10.20.193.4:0/428010222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015dbd0 0x562940175ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 1 -- 10.20.193.4:0/428010222 >> 10.20.193.4:0/428010222 conn(0x56294007b880 msgr2=0x56294015cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:12.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 1 -- 10.20.193.4:0/428010222 shutdown_connections 2026-02-24T09:14:12.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 1 -- 10.20.193.4:0/428010222 wait complete. 2026-02-24T09:14:12.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.779+0000 7f9c59099e00 20 client.16734 trim_cache size 0 max 16384 2026-02-24T09:14:12.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.790+0000 7f9c59099e00 1 Processor -- start 2026-02-24T09:14:12.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c59099e00 1 -- start start 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56294015dbd0 0x5629401a1f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015e4e0 0x5629401a2440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5629401a0390 0x5629401a2980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c59099e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5629400609e0 con 0x5629401a0390 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c59099e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56293fd18ec0 con 0x56294015dbd0 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c59099e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5629400cc580 con 0x56294015e4e0 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c55615640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5629401a0390 0x5629401a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c54e14640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56294015dbd0 0x5629401a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c54e14640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56294015dbd0 0x5629401a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:37912/0 (socket says 10.20.193.4:37912) 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c54e14640 1 -- 10.20.193.4:0/2021796544 learned_addr learned my addr 10.20.193.4:0/2021796544 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c47fff640 1 --2- 10.20.193.4:0/2021796544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015e4e0 0x5629401a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c54e14640 1 -- 10.20.193.4:0/2021796544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015e4e0 msgr2=0x5629401a2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:12.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c54e14640 1 --2- 10.20.193.4:0/2021796544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015e4e0 0x5629401a2440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c54e14640 1 -- 10.20.193.4:0/2021796544 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5629401a0390 msgr2=0x5629401a2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:12.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c54e14640 1 --2- 10.20.193.4:0/2021796544 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5629401a0390 0x5629401a2980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c54e14640 1 -- 10.20.193.4:0/2021796544 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56293fff8500 con 0x56294015dbd0 2026-02-24T09:14:12.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c55615640 1 --2- 10.20.193.4:0/2021796544 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5629401a0390 0x5629401a2980 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:14:12.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.791+0000 7f9c54e14640 1 --2- 10.20.193.4:0/2021796544 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56294015dbd0 0x5629401a1f00 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=17874802670342794644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c40009510 tx=0x7f9c40005000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8100e52ebfc6d94 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:12.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.792+0000 7f9c1cce3640 1 -- 10.20.193.4:0/2021796544 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c400ac7a0 con 0x56294015dbd0 2026-02-24T09:14:12.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.792+0000 7f9c1cce3640 1 -- 10.20.193.4:0/2021796544 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9c4006f070 con 0x56294015dbd0 2026-02-24T09:14:12.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.792+0000 7f9c1cce3640 1 -- 10.20.193.4:0/2021796544 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c400b7c50 con 0x56294015dbd0 2026-02-24T09:14:12.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.793+0000 7f9c59099e00 1 -- 10.20.193.4:0/2021796544 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56294015dbd0 msgr2=0x5629401a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.793+0000 7f9c59099e00 1 --2- 10.20.193.4:0/2021796544 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56294015dbd0 0x5629401a1f00 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=17874802670342794644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c40009510 tx=0x7f9c40005000 comp rx=0 tx=0).stop 2026-02-24T09:14:12.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.793+0000 7f9c59099e00 1 -- 10.20.193.4:0/2021796544 shutdown_connections 2026-02-24T09:14:12.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.793+0000 7f9c59099e00 1 --2- 10.20.193.4:0/2021796544 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5629401a0390 0x5629401a2980 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.793+0000 7f9c59099e00 1 --2- 10.20.193.4:0/2021796544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015e4e0 0x5629401a2440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.793+0000 7f9c59099e00 1 --2- 10.20.193.4:0/2021796544 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56294015dbd0 0x5629401a1f00 unknown :-1 s=CLOSED pgs=92 gs=2 cs=0 l=1 c_cookie=17874802670342794644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.793+0000 7f9c59099e00 1 -- 10.20.193.4:0/2021796544 >> 10.20.193.4:0/2021796544 conn(0x56294007b880 msgr2=0x56294017a630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:12.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.793+0000 7f9c59099e00 1 -- 10.20.193.4:0/2021796544 shutdown_connections 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.793+0000 7f9c59099e00 1 -- 10.20.193.4:0/2021796544 wait complete. 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.794+0000 7f9c59099e00 1 -- start start 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.794+0000 7f9c59099e00 1 Processor -- start 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.794+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015dbd0 0x56294017da40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x56294017df80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c59099e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a0390 0x5629401e8700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c59099e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5629401e8c40 con 0x56294015e4e0 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c59099e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5629401e8db0 con 0x5629401a0390 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c59099e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5629401e8f70 con 0x56294015dbd0 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c47fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x56294017df80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c47fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x56294017df80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59510/0 (socket says 10.20.193.4:59510) 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c47fff640 1 -- 10.20.193.4:0/3212445757 learned_addr learned my addr 10.20.193.4:0/3212445757 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:12.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c55615640 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a0390 0x5629401e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c54e14640 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015dbd0 0x56294017da40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c47fff640 1 -- 10.20.193.4:0/3212445757 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015dbd0 msgr2=0x56294017da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c47fff640 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015dbd0 0x56294017da40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c47fff640 1 -- 10.20.193.4:0/3212445757 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a0390 msgr2=0x5629401e8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c47fff640 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a0390 0x5629401e8700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c47fff640 1 -- 10.20.193.4:0/3212445757 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562940003690 con 0x56294015e4e0 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c54e14640 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015dbd0 0x56294017da40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c47fff640 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x56294017df80 secure :-1 s=READY pgs=818 gs=1 cs=0 l=1 c_cookie=13086940462863931647 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c380577b0 tx=0x7f9c38009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59e27036db0d8ff server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.795+0000 7f9c0e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/3212445757 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c38058d60 con 0x56294015e4e0 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 1 -- 10.20.193.4:0/3212445757 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c4c00ae20 con 0x56294015e4e0 2026-02-24T09:14:12.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/3212445757 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9c3804a040 con 0x56294015e4e0 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 10 client.16740 _ll_register_callbacks cb 0x56293ffe3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/3212445757 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c38042dd0 con 0x56294015e4e0 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 1 -- 10.20.193.4:0/3212445757 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56293fcee700 con 0x56294015e4e0 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/3212445757 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9c380386b0 con 0x56294015e4e0 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/3212445757 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9c380388a0 con 0x56294015e4e0 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 10 client.16740 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 1 -- 10.20.193.4:0/3212445757 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56293fff2f80 con 0x56294015e4e0 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/3212445757 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9c3804d040 con 0x56294015e4e0 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 10 client.16740 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 10 client.16740 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 20 client.16740 populate_metadata read hostname 'trial004' 2026-02-24T09:14:12.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5629401a3180 0x562940270e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:12.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 4 client.16740 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2026-02-24T09:14:12.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.796+0000 7f9c59099e00 1 -- 10.20.193.4:0/3212445757 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x562940075b70 con 0x5629401a3180 2026-02-24T09:14:12.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.797+0000 7f9c54e14640 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5629401a3180 0x562940270e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:12.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.797+0000 7f9c54e14640 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5629401a3180 0x562940270e80 crc :-1 s=READY pgs=112 gs=4 cs=0 l=0 c_cookie=8931517340697349062 s_cookie=13374060706507491131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bf31fb33d81cbc6 server_cookie=b99a355a8fe3873b in_seq=0 out_seq=0 2026-02-24T09:14:12.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.797+0000 7f9c0e7fc640 10 client.16740 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:12.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c0e7fc640 1 -- 10.20.193.4:0/3212445757 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562940075b70 con 0x5629401a3180 2026-02-24T09:14:12.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c0e7fc640 10 client.16740 handle_command_reply: tid=0 2026-02-24T09:14:12.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 client.16740 shutdown 2026-02-24T09:14:12.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 -- 10.20.193.4:0/3212445757 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 msgr2=0x56294017df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x56294017df80 secure :-1 s=READY pgs=818 gs=1 cs=0 l=1 c_cookie=13086940462863931647 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c380577b0 tx=0x7f9c38009290 comp rx=0 tx=0).stop 2026-02-24T09:14:12.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 -- 10.20.193.4:0/3212445757 shutdown_connections 2026-02-24T09:14:12.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5629401a3180 0x562940270e80 crc :-1 s=READY pgs=112 gs=4 cs=0 l=0 c_cookie=8931517340697349062 s_cookie=13374060706507491131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5629401a0390 0x5629401e8700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56294015e4e0 0x56294017df80 unknown :-1 s=CLOSED pgs=818 gs=1 cs=0 l=1 c_cookie=13086940462863931647 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 --2- 10.20.193.4:0/3212445757 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56294015dbd0 0x56294017da40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c0e7fc640 0 client.16740 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:12.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 -- 10.20.193.4:0/3212445757 >> 10.20.193.4:0/3212445757 conn(0x56294007b880 msgr2=0x56294015ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:12.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 -- 10.20.193.4:0/3212445757 shutdown_connections 2026-02-24T09:14:12.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 1 -- 10.20.193.4:0/3212445757 wait complete. 2026-02-24T09:14:12.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.818+0000 7f9c59099e00 20 client.16740 trim_cache size 0 max 16384 2026-02-24T09:14:12.823 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:14:12.823 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:14:12.823 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:14:12.823 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 18, 2026-02-24T09:14:12.823 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:14:12.823 INFO:teuthology.orchestra.run.trial004.stdout: "1cbb26a9": { 2026-02-24T09:14:12.823 INFO:teuthology.orchestra.run.trial004.stdout: "version": 18, 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 150.0, 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:14:12.824 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:14:12.825 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:12.825 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:12.825 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:12.825 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:12.825 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:12.825 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:14:12.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.819+0000 7f9c5709f640 1 -- 10.20.193.4:0/3587488312 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c2c0b5760 msgr2=0x7f9c2c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.819+0000 7f9c5709f640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c2c0b5760 0x7f9c2c0d5c10 secure :-1 s=READY pgs=354 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c500f7270 tx=0x7f9c3803a040 comp rx=0 tx=0).stop 2026-02-24T09:14:12.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.819+0000 7f9c5709f640 1 -- 10.20.193.4:0/3587488312 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c5010b2e0 msgr2=0x7f9c500f08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:12.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.819+0000 7f9c5709f640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c5010b2e0 0x7f9c500f08d0 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c4000e9c0 tx=0x7f9c4000ee90 comp rx=0 tx=0).stop 2026-02-24T09:14:12.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.820+0000 7f9c5709f640 1 -- 10.20.193.4:0/3587488312 shutdown_connections 2026-02-24T09:14:12.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.820+0000 7f9c5709f640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9c2c0b5760 0x7f9c2c0d5c10 unknown :-1 s=CLOSED pgs=354 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.820+0000 7f9c5709f640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9c501112f0 0x7f9c500f61e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.820+0000 7f9c5709f640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c5010bcd0 0x7f9c500f0e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.820+0000 7f9c5709f640 1 --2- 10.20.193.4:0/3587488312 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9c5010b2e0 0x7f9c500f08d0 unknown :-1 s=CLOSED pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:12.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.820+0000 7f9c5709f640 1 -- 10.20.193.4:0/3587488312 >> 10.20.193.4:0/3587488312 conn(0x7f9c500e8e50 msgr2=0x7f9c5010f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:12.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.820+0000 7f9c5709f640 1 -- 10.20.193.4:0/3587488312 shutdown_connections 2026-02-24T09:14:12.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:12.820+0000 7f9c5709f640 1 -- 10.20.193.4:0/3587488312 wait complete. 2026-02-24T09:14:12.912 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1cbb26a9', quiesce took 1.1 seconds. Will release after: 28.9 2026-02-24T09:14:12.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:12 trial004 ceph-mon[41596]: pgmap v284: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 895 MiB/s wr, 241 op/s 2026-02-24T09:14:12.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:12 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/371773515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:13.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:12 trial090 ceph-mon[47278]: pgmap v284: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 895 MiB/s wr, 241 op/s 2026-02-24T09:14:13.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:12 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/371773515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:13.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:12 trial014 ceph-mon[46941]: pgmap v284: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 895 MiB/s wr, 241 op/s 2026-02-24T09:14:13.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:12 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/371773515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:15.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:14 trial090 ceph-mon[47278]: pgmap v285: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 797 MiB/s wr, 218 op/s 2026-02-24T09:14:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:14 trial014 ceph-mon[46941]: pgmap v285: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 797 MiB/s wr, 218 op/s 2026-02-24T09:14:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:14 trial004 ceph-mon[41596]: pgmap v285: 97 pgs: 97 active+clean; 10 GiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 797 MiB/s wr, 218 op/s 2026-02-24T09:14:17.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:16 trial090 ceph-mon[47278]: pgmap v286: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 745 MiB/s wr, 204 op/s 2026-02-24T09:14:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:16 trial014 ceph-mon[46941]: pgmap v286: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 745 MiB/s wr, 204 op/s 2026-02-24T09:14:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:16 trial004 ceph-mon[41596]: pgmap v286: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 745 MiB/s wr, 204 op/s 2026-02-24T09:14:19.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:18 trial090 ceph-mon[47278]: pgmap v287: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 838 MiB/s wr, 229 op/s 2026-02-24T09:14:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:18 trial014 ceph-mon[46941]: pgmap v287: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 838 MiB/s wr, 229 op/s 2026-02-24T09:14:19.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:18 trial004 ceph-mon[41596]: pgmap v287: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 838 MiB/s wr, 229 op/s 2026-02-24T09:14:21.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:20 trial090 ceph-mon[47278]: pgmap v288: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 770 MiB/s wr, 212 op/s 2026-02-24T09:14:21.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:20 trial014 ceph-mon[46941]: pgmap v288: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 770 MiB/s wr, 212 op/s 2026-02-24T09:14:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:20 trial004 ceph-mon[41596]: pgmap v288: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 770 MiB/s wr, 212 op/s 2026-02-24T09:14:23.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:22 trial090 ceph-mon[47278]: pgmap v289: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 873 MiB/s wr, 239 op/s 2026-02-24T09:14:23.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:22 trial014 ceph-mon[46941]: pgmap v289: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 873 MiB/s wr, 239 op/s 2026-02-24T09:14:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:22 trial004 ceph-mon[41596]: pgmap v289: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 873 MiB/s wr, 239 op/s 2026-02-24T09:14:25.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:24 trial090 ceph-mon[47278]: pgmap v290: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 856 MiB/s wr, 232 op/s 2026-02-24T09:14:25.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:24 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:24 trial014 ceph-mon[46941]: pgmap v290: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 856 MiB/s wr, 232 op/s 2026-02-24T09:14:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:24 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:24 trial004 ceph-mon[41596]: pgmap v290: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 856 MiB/s wr, 232 op/s 2026-02-24T09:14:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:24 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:14:25.941 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:14:26.056 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:26.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:26.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:26.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:14:26.078 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:26.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:26.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:26.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:14:26.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:26.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:14:26.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:14:26.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:14:26.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:14:26.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f57237fe640 1 -- 10.20.193.4:0/1354875217 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57140386f0 con 0x7f572c110040 2026-02-24T09:14:26.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 -- 10.20.193.4:0/1354875217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f572c110040 msgr2=0x7f572c115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 --2- 10.20.193.4:0/1354875217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f572c110040 0x7f572c115090 secure :-1 s=READY pgs=819 gs=1 cs=0 l=1 c_cookie=4917181003950678988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5714009950 tx=0x7f571402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 -- 10.20.193.4:0/1354875217 shutdown_connections 2026-02-24T09:14:26.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 --2- 10.20.193.4:0/1354875217 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f572c115840 0x7f572c176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 --2- 10.20.193.4:0/1354875217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f572c110040 0x7f572c115090 unknown :-1 s=CLOSED pgs=819 gs=1 cs=0 l=1 c_cookie=4917181003950678988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 --2- 10.20.193.4:0/1354875217 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f572c10f650 0x7f572c10fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 -- 10.20.193.4:0/1354875217 >> 10.20.193.4:0/1354875217 conn(0x7f572c0ecf20 msgr2=0x7f572c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 -- 10.20.193.4:0/1354875217 shutdown_connections 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 -- 10.20.193.4:0/1354875217 wait complete. 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 Processor -- start 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 -- start start 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f572c10f650 0x7f572c0f5920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f572c110040 0x7f572c176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f572c115840 0x7f572c0f6020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f572c0fb230 con 0x7f572c115840 2026-02-24T09:14:26.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f572c0fb3a0 con 0x7f572c10f650 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.156+0000 7f5732d03640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f572c0fb560 con 0x7f572c110040 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5731279640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f572c115840 0x7f572c0f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5731279640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f572c115840 0x7f572c0f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42240/0 (socket says 10.20.193.4:42240) 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5731279640 1 -- 10.20.193.4:0/1258668752 learned_addr learned my addr 10.20.193.4:0/1258668752 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5730a78640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f572c10f650 0x7f572c0f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5723fff640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f572c110040 0x7f572c176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5731279640 1 -- 10.20.193.4:0/1258668752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f572c110040 msgr2=0x7f572c176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5731279640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f572c110040 0x7f572c176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5731279640 1 -- 10.20.193.4:0/1258668752 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f572c10f650 msgr2=0x7f572c0f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5731279640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f572c10f650 0x7f572c0f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5731279640 1 -- 10.20.193.4:0/1258668752 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5714009570 con 0x7f572c115840 2026-02-24T09:14:26.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5731279640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f572c115840 0x7f572c0f6020 secure :-1 s=READY pgs=820 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5728006e90 tx=0x7f572800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5721ffb640 1 -- 10.20.193.4:0/1258668752 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5728005500 con 0x7f572c115840 2026-02-24T09:14:26.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5721ffb640 1 -- 10.20.193.4:0/1258668752 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5728005e10 con 0x7f572c115840 2026-02-24T09:14:26.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5732d03640 1 -- 10.20.193.4:0/1258668752 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f572c0fb840 con 0x7f572c115840 2026-02-24T09:14:26.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5721ffb640 1 -- 10.20.193.4:0/1258668752 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5728003a90 con 0x7f572c115840 2026-02-24T09:14:26.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.157+0000 7f5732d03640 1 -- 10.20.193.4:0/1258668752 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f572c0fbd60 con 0x7f572c115840 2026-02-24T09:14:26.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.159+0000 7f5721ffb640 1 -- 10.20.193.4:0/1258668752 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f5728003c20 con 0x7f572c115840 2026-02-24T09:14:26.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.159+0000 7f5721ffb640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57080b5750 0x7f57080d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.159+0000 7f5721ffb640 1 -- 10.20.193.4:0/1258668752 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f57280e7920 con 0x7f572c115840 2026-02-24T09:14:26.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.159+0000 7f5730a78640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57080b5750 0x7f57080d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.160+0000 7f5730a78640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57080b5750 0x7f57080d5c00 secure :-1 s=READY pgs=355 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f571c005e30 tx=0x7f571c005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5734cfde00 1 Processor -- start 2026-02-24T09:14:26.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5734cfde00 1 -- start start 2026-02-24T09:14:26.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d39bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d3a130 0x556182d7e890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 0x556182d9f1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5734cfde00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556182c49de0 con 0x556182d39820 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5734cfde00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556182c45b10 con 0x556182d3a130 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5734cfde00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556182c3fab0 con 0x556182d7edd0 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5730a78640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d39bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5730a78640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d39bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42244/0 (socket says 10.20.193.4:42244) 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5730a78640 1 -- 10.20.193.4:0/3532537325 learned_addr learned my addr 10.20.193.4:0/3532537325 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5731279640 1 --2- 10.20.193.4:0/3532537325 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 0x556182d9f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5730a78640 1 -- 10.20.193.4:0/3532537325 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 msgr2=0x556182d9f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5730a78640 1 --2- 10.20.193.4:0/3532537325 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 0x556182d9f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5730a78640 1 -- 10.20.193.4:0/3532537325 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d3a130 msgr2=0x556182d7e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5730a78640 1 --2- 10.20.193.4:0/3532537325 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d3a130 0x556182d7e890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5730a78640 1 -- 10.20.193.4:0/3532537325 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556182beb310 con 0x556182d39820 2026-02-24T09:14:26.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5730a78640 1 --2- 10.20.193.4:0/3532537325 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d39bf0 secure :-1 s=READY pgs=821 gs=1 cs=0 l=1 c_cookie=14842069370875943153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f571c00fd10 tx=0x7f571c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf99f74c6c418f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f56f94e4640 1 -- 10.20.193.4:0/3532537325 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f571c011e60 con 0x556182d39820 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f56f94e4640 1 -- 10.20.193.4:0/3532537325 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f571c01e940 con 0x556182d39820 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f56f94e4640 1 -- 10.20.193.4:0/3532537325 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f571c010b10 con 0x556182d39820 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5734cfde00 1 -- 10.20.193.4:0/3532537325 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 msgr2=0x556182d39bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.161+0000 7f5734cfde00 1 --2- 10.20.193.4:0/3532537325 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d39bf0 secure :-1 s=READY pgs=821 gs=1 cs=0 l=1 c_cookie=14842069370875943153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f571c00fd10 tx=0x7f571c012000 comp rx=0 tx=0).stop 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.162+0000 7f5734cfde00 1 -- 10.20.193.4:0/3532537325 shutdown_connections 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.162+0000 7f5734cfde00 1 --2- 10.20.193.4:0/3532537325 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 0x556182d9f1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.162+0000 7f5734cfde00 1 --2- 10.20.193.4:0/3532537325 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d3a130 0x556182d7e890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.162+0000 7f5734cfde00 1 --2- 10.20.193.4:0/3532537325 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d39bf0 unknown :-1 s=CLOSED pgs=821 gs=1 cs=0 l=1 c_cookie=14842069370875943153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.162+0000 7f5734cfde00 1 -- 10.20.193.4:0/3532537325 >> 10.20.193.4:0/3532537325 conn(0x556182c586b0 msgr2=0x556182d38100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.162+0000 7f5734cfde00 1 -- 10.20.193.4:0/3532537325 shutdown_connections 2026-02-24T09:14:26.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.162+0000 7f5734cfde00 1 -- 10.20.193.4:0/3532537325 wait complete. 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.162+0000 7f5734cfde00 1 -- start start 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 1 Processor -- start 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d39820 0x556182d51e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d52390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 0x556182d57380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556182d578c0 con 0x556182d3a130 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556182d57a30 con 0x556182d39820 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556182d57bf0 con 0x556182d7edd0 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5723fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d52390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5723fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d52390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42252/0 (socket says 10.20.193.4:42252) 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5723fff640 1 -- 10.20.193.4:0/2815237818 learned_addr learned my addr 10.20.193.4:0/2815237818 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5730a78640 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d39820 0x556182d51e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5723fff640 1 -- 10.20.193.4:0/2815237818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 msgr2=0x556182d57380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5731279640 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 0x556182d57380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5723fff640 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 0x556182d57380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5723fff640 1 -- 10.20.193.4:0/2815237818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d39820 msgr2=0x556182d51e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5723fff640 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d39820 0x556182d51e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5723fff640 1 -- 10.20.193.4:0/2815237818 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556182bc38c0 con 0x556182d3a130 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5730a78640 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d39820 0x556182d51e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5731279640 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 0x556182d57380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5723fff640 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d52390 secure :-1 s=READY pgs=822 gs=1 cs=0 l=1 c_cookie=14889280733807752987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5714038680 tx=0x7f57140386b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea159f0cbadb71b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f56ea7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f56ea7fc640 1 -- 10.20.193.4:0/2815237818 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5714005dd0 con 0x556182d3a130 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 1 -- 10.20.193.4:0/2815237818 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c00f9b0 con 0x556182d3a130 2026-02-24T09:14:26.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f56ea7fc640 1 -- 10.20.193.4:0/2815237818 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f571402f9f0 con 0x556182d3a130 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f56ea7fc640 1 -- 10.20.193.4:0/2815237818 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5714038ea0 con 0x556182d3a130 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 10 client.16752 _ll_register_callbacks cb 0x556182bdb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 1 -- 10.20.193.4:0/2815237818 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55618298f4a0 con 0x556182d3a130 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f56ea7fc640 1 -- 10.20.193.4:0/2815237818 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f571404d440 con 0x556182d3a130 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f56ea7fc640 1 -- 10.20.193.4:0/2815237818 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f571404d660 con 0x556182d3a130 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 10 client.16752 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.163+0000 7f5734cfde00 1 -- 10.20.193.4:0/2815237818 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556182bd56e0 con 0x556182d3a130 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.164+0000 7f56ea7fc640 1 -- 10.20.193.4:0/2815237818 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f5714038920 con 0x556182d3a130 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.164+0000 7f5734cfde00 10 client.16752 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.164+0000 7f5734cfde00 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.164+0000 7f5734cfde00 20 client.16752 populate_metadata read hostname 'trial004' 2026-02-24T09:14:26.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.164+0000 7f5734cfde00 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556182d7c6e0 0x556182d7cb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.164+0000 7f5734cfde00 4 client.16752 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.164+0000 7f5734cfde00 1 -- 10.20.193.4:0/2815237818 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556182c354f0 con 0x556182d7c6e0 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.164+0000 7f5730a78640 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556182d7c6e0 0x556182d7cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.164+0000 7f56ea7fc640 10 client.16752 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.164+0000 7f5730a78640 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556182d7c6e0 0x556182d7cb80 crc :-1 s=READY pgs=113 gs=4 cs=0 l=0 c_cookie=9493856034725663246 s_cookie=1323557170943576534 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83c0f3c35285920e server_cookie=125e383c060349d6 in_seq=0 out_seq=0 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f56ea7fc640 1 -- 10.20.193.4:0/2815237818 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556182c354f0 con 0x556182d7c6e0 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f56ea7fc640 10 client.16752 handle_command_reply: tid=0 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 client.16752 shutdown 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 -- 10.20.193.4:0/2815237818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 msgr2=0x556182d52390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d52390 secure :-1 s=READY pgs=822 gs=1 cs=0 l=1 c_cookie=14889280733807752987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5714038680 tx=0x7f57140386b0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 -- 10.20.193.4:0/2815237818 shutdown_connections 2026-02-24T09:14:26.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556182d7c6e0 0x556182d7cb80 crc :-1 s=READY pgs=113 gs=4 cs=0 l=0 c_cookie=9493856034725663246 s_cookie=1323557170943576534 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d7edd0 0x556182d57380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d52390 unknown :-1 s=CLOSED pgs=822 gs=1 cs=0 l=1 c_cookie=14889280733807752987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f56ea7fc640 0 client.16752 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:26.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 --2- 10.20.193.4:0/2815237818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d39820 0x556182d51e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 -- 10.20.193.4:0/2815237818 >> 10.20.193.4:0/2815237818 conn(0x556182c586b0 msgr2=0x556182d38810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 -- 10.20.193.4:0/2815237818 shutdown_connections 2026-02-24T09:14:26.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 1 -- 10.20.193.4:0/2815237818 wait complete. 2026-02-24T09:14:26.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.165+0000 7f5734cfde00 20 client.16752 trim_cache size 0 max 16384 2026-02-24T09:14:26.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5734cfde00 1 Processor -- start 2026-02-24T09:14:26.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5734cfde00 1 -- start start 2026-02-24T09:14:26.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d39820 0x556182d3c6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d4f190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 0x556182d4f6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5734cfde00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556182c3d6e0 con 0x556182d3a130 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5734cfde00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556182908f50 con 0x556182d7edd0 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5734cfde00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556182d3a500 con 0x556182d39820 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5723fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d4f190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5723fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d4f190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42264/0 (socket says 10.20.193.4:42264) 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5723fff640 1 -- 10.20.193.4:0/2033791149 learned_addr learned my addr 10.20.193.4:0/2033791149 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5731279640 1 --2- 10.20.193.4:0/2033791149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 0x556182d4f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5730a78640 1 --2- 10.20.193.4:0/2033791149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d39820 0x556182d3c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5723fff640 1 -- 10.20.193.4:0/2033791149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d39820 msgr2=0x556182d3c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5723fff640 1 --2- 10.20.193.4:0/2033791149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d39820 0x556182d3c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5723fff640 1 -- 10.20.193.4:0/2033791149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 msgr2=0x556182d4f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5723fff640 1 --2- 10.20.193.4:0/2033791149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 0x556182d4f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5723fff640 1 -- 10.20.193.4:0/2033791149 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556182bd0160 con 0x556182d3a130 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5731279640 1 --2- 10.20.193.4:0/2033791149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 0x556182d4f6d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f5723fff640 1 --2- 10.20.193.4:0/2033791149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d4f190 secure :-1 s=READY pgs=823 gs=1 cs=0 l=1 c_cookie=408737519370323691 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5714038dc0 tx=0x7f571404b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac209bb87146eb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f56f8ce3640 1 -- 10.20.193.4:0/2033791149 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5714038470 con 0x556182d3a130 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f56f8ce3640 1 -- 10.20.193.4:0/2033791149 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f571403c040 con 0x556182d3a130 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.174+0000 7f56f8ce3640 1 -- 10.20.193.4:0/2033791149 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f57140373f0 con 0x556182d3a130 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 -- 10.20.193.4:0/2033791149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 msgr2=0x556182d4f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 --2- 10.20.193.4:0/2033791149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d4f190 secure :-1 s=READY pgs=823 gs=1 cs=0 l=1 c_cookie=408737519370323691 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5714038dc0 tx=0x7f571404b000 comp rx=0 tx=0).stop 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 -- 10.20.193.4:0/2033791149 shutdown_connections 2026-02-24T09:14:26.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 --2- 10.20.193.4:0/2033791149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 0x556182d4f6d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 --2- 10.20.193.4:0/2033791149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d3a130 0x556182d4f190 unknown :-1 s=CLOSED pgs=823 gs=1 cs=0 l=1 c_cookie=408737519370323691 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 --2- 10.20.193.4:0/2033791149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d39820 0x556182d3c6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 -- 10.20.193.4:0/2033791149 >> 10.20.193.4:0/2033791149 conn(0x556182c586b0 msgr2=0x556182d7d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 -- 10.20.193.4:0/2033791149 shutdown_connections 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 -- 10.20.193.4:0/2033791149 wait complete. 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 -- start start 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 Processor -- start 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d59960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d3a130 0x556182d59ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 0x556182de42f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556182d5a730 con 0x556182d39820 2026-02-24T09:14:26.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556182de4830 con 0x556182d7edd0 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5734cfde00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556182de49f0 con 0x556182d3a130 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5730a78640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d59960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5730a78640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d59960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42278/0 (socket says 10.20.193.4:42278) 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.175+0000 7f5730a78640 1 -- 10.20.193.4:0/1898203528 learned_addr learned my addr 10.20.193.4:0/1898203528 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5730a78640 1 -- 10.20.193.4:0/1898203528 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d3a130 msgr2=0x556182d59ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5730a78640 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d3a130 0x556182d59ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5730a78640 1 -- 10.20.193.4:0/1898203528 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 msgr2=0x556182de42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5731279640 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 0x556182de42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5730a78640 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 0x556182de42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5730a78640 1 -- 10.20.193.4:0/1898203528 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556182bc3bf0 con 0x556182d39820 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5731279640 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 0x556182de42f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:26.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5730a78640 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d59960 secure :-1 s=READY pgs=824 gs=1 cs=0 l=1 c_cookie=11170544136438836102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x556182d7cab0 tx=0x7f571c002790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b05beb540426b86 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f56ea7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f56ea7fc640 1 -- 10.20.193.4:0/1898203528 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f571c02f040 con 0x556182d39820 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f56ea7fc640 1 -- 10.20.193.4:0/1898203528 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f571c01e680 con 0x556182d39820 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f56ea7fc640 1 -- 10.20.193.4:0/1898203528 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f571c035320 con 0x556182d39820 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 1 -- 10.20.193.4:0/1898203528 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556182bd56e0 con 0x556182d39820 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f56ea7fc640 1 -- 10.20.193.4:0/1898203528 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f571c0049f0 con 0x556182d39820 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f56ea7fc640 10 client.16758 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 10 client.16758 _ll_register_callbacks cb 0x556182bdb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 1 -- 10.20.193.4:0/1898203528 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5561828cd6f0 con 0x556182d39820 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f56ea7fc640 1 -- 10.20.193.4:0/1898203528 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f571c01eab0 con 0x556182d39820 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 10 client.16758 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 1 -- 10.20.193.4:0/1898203528 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556182bd5940 con 0x556182d39820 2026-02-24T09:14:26.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f56ea7fc640 1 -- 10.20.193.4:0/1898203528 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f571c01ec10 con 0x556182d39820 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 10 client.16758 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 20 client.16758 populate_metadata read hostname 'trial004' 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556182e2ca90 0x556182e4cf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 4 client.16758 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.176+0000 7f5734cfde00 1 -- 10.20.193.4:0/1898203528 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5561828caf40 con 0x556182e2ca90 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5723fff640 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556182e2ca90 0x556182e4cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5723fff640 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556182e2ca90 0x556182e4cf10 crc :-1 s=READY pgs=114 gs=4 cs=0 l=0 c_cookie=5232532329353616097 s_cookie=15043947938428165363 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=489db06e2ede9ae1 server_cookie=d0c6d6f1997b1cf3 in_seq=0 out_seq=0 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f56ea7fc640 10 client.16758 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f56ea7fc640 1 -- 10.20.193.4:0/1898203528 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x5561828caf40 con 0x556182e2ca90 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f56ea7fc640 10 client.16758 handle_command_reply: tid=0 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5734cfde00 1 client.16758 shutdown 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5734cfde00 1 -- 10.20.193.4:0/1898203528 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 msgr2=0x556182d59960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5734cfde00 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d59960 secure :-1 s=READY pgs=824 gs=1 cs=0 l=1 c_cookie=11170544136438836102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x556182d7cab0 tx=0x7f571c002790 comp rx=0 tx=0).stop 2026-02-24T09:14:26.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5734cfde00 1 -- 10.20.193.4:0/1898203528 shutdown_connections 2026-02-24T09:14:26.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5734cfde00 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556182e2ca90 0x556182e4cf10 crc :-1 s=READY pgs=114 gs=4 cs=0 l=0 c_cookie=5232532329353616097 s_cookie=15043947938428165363 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5734cfde00 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556182d7edd0 0x556182de42f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5734cfde00 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556182d3a130 0x556182d59ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f56ea7fc640 0 client.16758 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:26.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5734cfde00 1 --2- 10.20.193.4:0/1898203528 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556182d39820 0x556182d59960 unknown :-1 s=CLOSED pgs=824 gs=1 cs=0 l=1 c_cookie=11170544136438836102 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.177+0000 7f5734cfde00 1 -- 10.20.193.4:0/1898203528 >> 10.20.193.4:0/1898203528 conn(0x556182c586b0 msgr2=0x556182d7dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5734cfde00 1 -- 10.20.193.4:0/1898203528 shutdown_connections 2026-02-24T09:14:26.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5734cfde00 1 -- 10.20.193.4:0/1898203528 wait complete. 2026-02-24T09:14:26.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5734cfde00 20 client.16758 trim_cache size 0 max 16384 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:26.194 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:26.195 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:26.196 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:26.197 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:26.198 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 -- 10.20.193.4:0/1258668752 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57080b5750 msgr2=0x7f57080d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57080b5750 0x7f57080d5c00 secure :-1 s=READY pgs=355 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f571c005e30 tx=0x7f571c005da0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 -- 10.20.193.4:0/1258668752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f572c115840 msgr2=0x7f572c0f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f572c115840 0x7f572c0f6020 secure :-1 s=READY pgs=820 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5728006e90 tx=0x7f572800edf0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 -- 10.20.193.4:0/1258668752 shutdown_connections 2026-02-24T09:14:26.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f57080b5750 0x7f57080d5c00 unknown :-1 s=CLOSED pgs=355 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f572c115840 0x7f572c0f6020 unknown :-1 s=CLOSED pgs=820 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f572c110040 0x7f572c176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 --2- 10.20.193.4:0/1258668752 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f572c10f650 0x7f572c0f5920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 -- 10.20.193.4:0/1258668752 >> 10.20.193.4:0/1258668752 conn(0x7f572c0ecf20 msgr2=0x7f572c10dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 -- 10.20.193.4:0/1258668752 shutdown_connections 2026-02-24T09:14:26.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.178+0000 7f5732d03640 1 -- 10.20.193.4:0/1258668752 wait complete. 2026-02-24T09:14:26.216 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:14:26.217 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:14:26.332 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:26.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.433+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2366826792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff618115470 msgr2=0x7ff618175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.433+0000 7ff61d5d9640 1 --2- 10.20.193.4:0/2366826792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff618115470 0x7ff618175e40 secure :-1 s=READY pgs=825 gs=1 cs=0 l=1 c_cookie=7169208428130329529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60800aa30 tx=0x7ff608030280 comp rx=0 tx=0).stop 2026-02-24T09:14:26.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.433+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2366826792 shutdown_connections 2026-02-24T09:14:26.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.433+0000 7ff61d5d9640 1 --2- 10.20.193.4:0/2366826792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff618115470 0x7ff618175e40 unknown :-1 s=CLOSED pgs=825 gs=1 cs=0 l=1 c_cookie=7169208428130329529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.433+0000 7ff61d5d9640 1 --2- 10.20.193.4:0/2366826792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff61810fc70 0x7ff618114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.433+0000 7ff61d5d9640 1 --2- 10.20.193.4:0/2366826792 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61810f280 0x7ff61810f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.433+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2366826792 >> 10.20.193.4:0/2366826792 conn(0x7ff61805f830 msgr2=0x7ff61810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.433+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2366826792 shutdown_connections 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.433+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2366826792 wait complete. 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff61d5d9640 1 Processor -- start 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff61d5d9640 1 -- start start 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff61d5d9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff61810f280 0x7ff61811db50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff61d5d9640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61810fc70 0x7ff61811e090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff61d5d9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff618115470 0x7ff618123460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff61d5d9640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff618123a80 con 0x7ff618115470 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff61d5d9640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff618123bf0 con 0x7ff61810fc70 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff61d5d9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff618123db0 con 0x7ff61810f280 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff6177fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff618115470 0x7ff618123460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff6177fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff618115470 0x7ff618123460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42286/0 (socket says 10.20.193.4:42286) 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff6177fe640 1 -- 10.20.193.4:0/2609976381 learned_addr learned my addr 10.20.193.4:0/2609976381 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff6167fc640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61810fc70 0x7ff61811e090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff6177fe640 1 -- 10.20.193.4:0/2609976381 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff61810f280 msgr2=0x7ff61811db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff616ffd640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff61810f280 0x7ff61811db50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff6177fe640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff61810f280 0x7ff61811db50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff6177fe640 1 -- 10.20.193.4:0/2609976381 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61810fc70 msgr2=0x7ff61811e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff6177fe640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61810fc70 0x7ff61811e090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff6177fe640 1 -- 10.20.193.4:0/2609976381 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60800a650 con 0x7ff618115470 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff616ffd640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff61810f280 0x7ff61811db50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff6177fe640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff618115470 0x7ff618123460 secure :-1 s=READY pgs=826 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60800a330 tx=0x7ff6080039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff5f7fff640 1 -- 10.20.193.4:0/2609976381 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff60803e070 con 0x7ff618115470 2026-02-24T09:14:26.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff5f7fff640 1 -- 10.20.193.4:0/2609976381 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff6080055a0 con 0x7ff618115470 2026-02-24T09:14:26.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2609976381 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff618124030 con 0x7ff618115470 2026-02-24T09:14:26.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff5f7fff640 1 -- 10.20.193.4:0/2609976381 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff608042a70 con 0x7ff618115470 2026-02-24T09:14:26.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.434+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2609976381 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff618164790 con 0x7ff618115470 2026-02-24T09:14:26.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.435+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2609976381 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff618124300 con 0x7ff618115470 2026-02-24T09:14:26.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.436+0000 7ff5f7fff640 1 -- 10.20.193.4:0/2609976381 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff6080050c0 con 0x7ff618115470 2026-02-24T09:14:26.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.437+0000 7ff5f7fff640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b5760 0x7ff5ec0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.437+0000 7ff616ffd640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b5760 0x7ff5ec0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.437+0000 7ff5f7fff640 1 -- 10.20.193.4:0/2609976381 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff60810d3f0 con 0x7ff618115470 2026-02-24T09:14:26.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.437+0000 7ff616ffd640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b5760 0x7ff5ec0d5c10 secure :-1 s=READY pgs=356 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60c005970 tx=0x7ff60c005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.437+0000 7ff5f7fff640 1 -- 10.20.193.4:0/2609976381 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff6080cfd70 con 0x7ff618115470 2026-02-24T09:14:26.573 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.569+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2609976381 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff61811ecb0 con 0x7ff618115470 2026-02-24T09:14:26.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.569+0000 7ff5f7fff640 1 -- 10.20.193.4:0/2609976381 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7ff6080d2f20 con 0x7ff618115470 2026-02-24T09:14:26.574 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:14:26.574 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:14:26.575 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:14:26.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2609976381 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b5760 msgr2=0x7ff5ec0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b5760 0x7ff5ec0d5c10 secure :-1 s=READY pgs=356 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60c005970 tx=0x7ff60c005de0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2609976381 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff618115470 msgr2=0x7ff618123460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff618115470 0x7ff618123460 secure :-1 s=READY pgs=826 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff60800a330 tx=0x7ff6080039b0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2609976381 shutdown_connections 2026-02-24T09:14:26.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5ec0b5760 0x7ff5ec0d5c10 unknown :-1 s=CLOSED pgs=356 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff618115470 0x7ff618123460 unknown :-1 s=CLOSED pgs=826 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff61810fc70 0x7ff61811e090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 --2- 10.20.193.4:0/2609976381 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff61810f280 0x7ff61811db50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2609976381 >> 10.20.193.4:0/2609976381 conn(0x7ff61805f830 msgr2=0x7ff61810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2609976381 shutdown_connections 2026-02-24T09:14:26.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.571+0000 7ff61d5d9640 1 -- 10.20.193.4:0/2609976381 wait complete. 2026-02-24T09:14:26.638 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:14:26.755 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:26.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/4060304823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0cf4110040 msgr2=0x7f0cf4115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 --2- 10.20.193.4:0/4060304823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0cf4110040 0x7f0cf4115090 secure :-1 s=READY pgs=827 gs=1 cs=0 l=1 c_cookie=5574159132408292363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce0009950 tx=0x7f0ce002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/4060304823 shutdown_connections 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 --2- 10.20.193.4:0/4060304823 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0cf4115840 0x7f0cf4176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 --2- 10.20.193.4:0/4060304823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0cf4110040 0x7f0cf4115090 unknown :-1 s=CLOSED pgs=827 gs=1 cs=0 l=1 c_cookie=5574159132408292363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 --2- 10.20.193.4:0/4060304823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0cf410f650 0x7f0cf410fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/4060304823 >> 10.20.193.4:0/4060304823 conn(0x7f0cf40ecf20 msgr2=0x7f0cf410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/4060304823 shutdown_connections 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/4060304823 wait complete. 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 Processor -- start 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 -- start start 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0cf410f650 0x7f0cf40f5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0cf4110040 0x7f0cf4176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0cf4115840 0x7f0cf40f5f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf40fb1a0 con 0x7f0cf4110040 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf40fb310 con 0x7f0cf410f650 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfc9fa640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf40fb4d0 con 0x7f0cf4115840 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cf9f6e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0cf4110040 0x7f0cf4176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cf9f6e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0cf4110040 0x7f0cf4176110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42312/0 (socket says 10.20.193.4:42312) 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cf9f6e640 1 -- 10.20.193.4:0/3037589534 learned_addr learned my addr 10.20.193.4:0/3037589534 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfaf70640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0cf4115840 0x7f0cf40f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0cf410f650 0x7f0cf40f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cf9f6e640 1 -- 10.20.193.4:0/3037589534 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0cf4115840 msgr2=0x7f0cf40f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cf9f6e640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0cf4115840 0x7f0cf40f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cf9f6e640 1 -- 10.20.193.4:0/3037589534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0cf410f650 msgr2=0x7f0cf40f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cf9f6e640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0cf410f650 0x7f0cf40f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cf9f6e640 1 -- 10.20.193.4:0/3037589534 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce0009570 con 0x7f0cf4110040 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0cf410f650 0x7f0cf40f5890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.852+0000 7f0cf9f6e640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0cf4110040 0x7f0cf4176110 secure :-1 s=READY pgs=828 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce00023d0 tx=0x7f0ce00043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.853+0000 7f0cdf7fe640 1 -- 10.20.193.4:0/3037589534 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce003d070 con 0x7f0cf4110040 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.853+0000 7f0cdf7fe640 1 -- 10.20.193.4:0/3037589534 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ce0038920 con 0x7f0cf4110040 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.853+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/3037589534 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf40fb750 con 0x7f0cf4110040 2026-02-24T09:14:26.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.853+0000 7f0cdf7fe640 1 -- 10.20.193.4:0/3037589534 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce00419d0 con 0x7f0cf4110040 2026-02-24T09:14:26.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.853+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/3037589534 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf40fbbc0 con 0x7f0cf4110040 2026-02-24T09:14:26.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.854+0000 7f0cdf7fe640 1 -- 10.20.193.4:0/3037589534 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f0ce0038a90 con 0x7f0cf4110040 2026-02-24T09:14:26.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.855+0000 7f0cdf7fe640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0cd00b56d0 0x7f0cd00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.855+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0cd00b56d0 0x7f0cd00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.855+0000 7f0cdf7fe640 1 -- 10.20.193.4:0/3037589534 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0ce010b400 con 0x7f0cf4110040 2026-02-24T09:14:26.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.855+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0cd00b56d0 0x7f0cd00d5b80 secure :-1 s=READY pgs=357 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cec004740 tx=0x7f0cec005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfe9f4e00 1 Processor -- start 2026-02-24T09:14:26.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfe9f4e00 1 -- start start 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f54ff50 0x56162f550320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f550860 0x56162f594fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f595500 0x56162f5b58e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56162f460ee0 con 0x56162f54ff50 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56162f45cc10 con 0x56162f550860 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56162f456d70 con 0x56162f595500 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfa76f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f54ff50 0x56162f550320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfa76f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f54ff50 0x56162f550320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42322/0 (socket says 10.20.193.4:42322) 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfa76f640 1 -- 10.20.193.4:0/3756899077 learned_addr learned my addr 10.20.193.4:0/3756899077 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cf9f6e640 1 --2- 10.20.193.4:0/3756899077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f550860 0x56162f594fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfa76f640 1 -- 10.20.193.4:0/3756899077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f595500 msgr2=0x56162f5b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/3756899077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f595500 0x56162f5b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfa76f640 1 -- 10.20.193.4:0/3756899077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f550860 msgr2=0x56162f594fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/3756899077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f550860 0x56162f594fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfa76f640 1 -- 10.20.193.4:0/3756899077 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162f402340 con 0x56162f54ff50 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.856+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/3756899077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f54ff50 0x56162f550320 secure :-1 s=READY pgs=829 gs=1 cs=0 l=1 c_cookie=1379095084627317414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cec00af50 tx=0x7f0cec011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132387ac36b2d2a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cdccf3640 1 -- 10.20.193.4:0/3756899077 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0cec010ea0 con 0x56162f54ff50 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cdccf3640 1 -- 10.20.193.4:0/3756899077 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0cec01cb10 con 0x56162f54ff50 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cdccf3640 1 -- 10.20.193.4:0/3756899077 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0cec01ae50 con 0x56162f54ff50 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/3756899077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f54ff50 msgr2=0x56162f550320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/3756899077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f54ff50 0x56162f550320 secure :-1 s=READY pgs=829 gs=1 cs=0 l=1 c_cookie=1379095084627317414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cec00af50 tx=0x7f0cec011000 comp rx=0 tx=0).stop 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/3756899077 shutdown_connections 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/3756899077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f595500 0x56162f5b58e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/3756899077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f550860 0x56162f594fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/3756899077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f54ff50 0x56162f550320 unknown :-1 s=CLOSED pgs=829 gs=1 cs=0 l=1 c_cookie=1379095084627317414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/3756899077 >> 10.20.193.4:0/3756899077 conn(0x56162f46edb0 msgr2=0x56162f54e830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/3756899077 shutdown_connections 2026-02-24T09:14:26.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.857+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/3756899077 wait complete. 2026-02-24T09:14:26.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 1 -- start start 2026-02-24T09:14:26.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 1 Processor -- start 2026-02-24T09:14:26.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f54ff50 0x56162f5acd60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f550860 0x56162f5ad2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5b2290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56162f5b27d0 con 0x56162f595500 2026-02-24T09:14:26.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56162f5b2940 con 0x56162f54ff50 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56162f5b2b00 con 0x56162f550860 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfaf70640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfaf70640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42338/0 (socket says 10.20.193.4:42338) 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfaf70640 1 -- 10.20.193.4:0/2354525917 learned_addr learned my addr 10.20.193.4:0/2354525917 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cf9f6e640 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f550860 0x56162f5ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfaf70640 1 -- 10.20.193.4:0/2354525917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f550860 msgr2=0x56162f5ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfaf70640 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f550860 0x56162f5ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfaf70640 1 -- 10.20.193.4:0/2354525917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f54ff50 msgr2=0x56162f5acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfaf70640 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f54ff50 0x56162f5acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfaf70640 1 -- 10.20.193.4:0/2354525917 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162f3da9d0 con 0x56162f595500 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfaf70640 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5b2290 secure :-1 s=READY pgs=830 gs=1 cs=0 l=1 c_cookie=18135904367583846409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce8003b60 tx=0x7f0ce8005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbafacef264a6009 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0ca7fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0ca7fff640 1 -- 10.20.193.4:0/2354525917 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce8012660 con 0x56162f595500 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2354525917 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cec00ac40 con 0x56162f595500 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0ca7fff640 1 -- 10.20.193.4:0/2354525917 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ce8003e70 con 0x56162f595500 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0ca7fff640 1 -- 10.20.193.4:0/2354525917 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce8011d10 con 0x56162f595500 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 10 client.16776 _ll_register_callbacks cb 0x56162f401080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.858+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2354525917 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56162f1a64a0 con 0x56162f595500 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0ca7fff640 1 -- 10.20.193.4:0/2354525917 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0ce8019360 con 0x56162f595500 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0ca7fff640 1 -- 10.20.193.4:0/2354525917 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0ce8011ea0 con 0x56162f595500 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0cfe9f4e00 10 client.16776 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2354525917 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56162f3ec710 con 0x56162f595500 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0ca7fff640 1 -- 10.20.193.4:0/2354525917 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0ce80113d0 con 0x56162f595500 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0cfe9f4e00 10 client.16776 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0cfe9f4e00 10 client.16776 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0cfe9f4e00 20 client.16776 populate_metadata read hostname 'trial004' 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x56162f592830 0x56162f592cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0cfe9f4e00 4 client.16776 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:14:26.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2354525917 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56162f44c7b0 con 0x56162f592830 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.859+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x56162f592830 0x56162f592cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x56162f592830 0x56162f592cd0 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=4856949717289118641 s_cookie=11587844835341022808 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=43675a08def3abb1 server_cookie=a0d04b7b92d8b658 in_seq=0 out_seq=0 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0ca7fff640 10 client.16776 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0ca7fff640 1 -- 10.20.193.4:0/2354525917 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56162f44c7b0 con 0x56162f592830 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0ca7fff640 10 client.16776 handle_command_reply: tid=0 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 client.16776 shutdown 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2354525917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 msgr2=0x56162f5b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5b2290 secure :-1 s=READY pgs=830 gs=1 cs=0 l=1 c_cookie=18135904367583846409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce8003b60 tx=0x7f0ce8005730 comp rx=0 tx=0).stop 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2354525917 shutdown_connections 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x56162f592830 0x56162f592cd0 crc :-1 s=READY pgs=38 gs=4 cs=0 l=0 c_cookie=4856949717289118641 s_cookie=11587844835341022808 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5b2290 unknown :-1 s=CLOSED pgs=830 gs=1 cs=0 l=1 c_cookie=18135904367583846409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f550860 0x56162f5ad2a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/2354525917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f54ff50 0x56162f5acd60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0ca7fff640 0 client.16776 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2354525917 >> 10.20.193.4:0/2354525917 conn(0x56162f46edb0 msgr2=0x56162f54e040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2354525917 shutdown_connections 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2354525917 wait complete. 2026-02-24T09:14:26.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.860+0000 7f0cfe9f4e00 20 client.16776 trim_cache size 0 max 16384 2026-02-24T09:14:26.869 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:26 trial004 ceph-mon[41596]: pgmap v291: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 845 MiB/s wr, 228 op/s 2026-02-24T09:14:26.869 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:26 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2609976381' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:26.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfe9f4e00 1 Processor -- start 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfe9f4e00 1 -- start start 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 0x56162f5945c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f550860 0x56162f594b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5a9120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56162f5b2690 con 0x56162f595500 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56162f4549a0 con 0x56162f550860 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56162f230df0 con 0x56162f54ff50 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfaf70640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5a9120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfaf70640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5a9120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42350/0 (socket says 10.20.193.4:42350) 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfaf70640 1 -- 10.20.193.4:0/2285088388 learned_addr learned my addr 10.20.193.4:0/2285088388 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cf9f6e640 1 --2- 10.20.193.4:0/2285088388 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f550860 0x56162f594b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.867+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/2285088388 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 0x56162f5945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfaf70640 1 -- 10.20.193.4:0/2285088388 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 msgr2=0x56162f5945c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfaf70640 1 --2- 10.20.193.4:0/2285088388 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 0x56162f5945c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfaf70640 1 -- 10.20.193.4:0/2285088388 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f550860 msgr2=0x56162f594b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfaf70640 1 --2- 10.20.193.4:0/2285088388 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f550860 0x56162f594b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfaf70640 1 -- 10.20.193.4:0/2285088388 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162f3e7190 con 0x56162f595500 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/2285088388 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 0x56162f5945c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfaf70640 1 --2- 10.20.193.4:0/2285088388 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5a9120 secure :-1 s=READY pgs=831 gs=1 cs=0 l=1 c_cookie=5431809165746853499 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce8024bb0 tx=0x7f0ce801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b61a9a8440d567b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cc24e6640 1 -- 10.20.193.4:0/2285088388 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce8003e70 con 0x56162f595500 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cc24e6640 1 -- 10.20.193.4:0/2285088388 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x56162f1a64a0 con 0x56162f595500 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cc24e6640 1 -- 10.20.193.4:0/2285088388 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce801af10 con 0x56162f595500 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2285088388 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 msgr2=0x56162f5a9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/2285088388 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5a9120 secure :-1 s=READY pgs=831 gs=1 cs=0 l=1 c_cookie=5431809165746853499 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce8024bb0 tx=0x7f0ce801e000 comp rx=0 tx=0).stop 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2285088388 shutdown_connections 2026-02-24T09:14:26.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/2285088388 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f595500 0x56162f5a9120 unknown :-1 s=CLOSED pgs=831 gs=1 cs=0 l=1 c_cookie=5431809165746853499 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/2285088388 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f550860 0x56162f594b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/2285088388 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 0x56162f5945c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2285088388 >> 10.20.193.4:0/2285088388 conn(0x56162f46edb0 msgr2=0x56162f5b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2285088388 shutdown_connections 2026-02-24T09:14:26.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.868+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/2285088388 wait complete. 2026-02-24T09:14:26.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cfe9f4e00 1 -- start start 2026-02-24T09:14:26.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cfe9f4e00 1 Processor -- start 2026-02-24T09:14:26.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 0x56162f531040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f550860 0x56162f531580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cfe9f4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f595500 0x56162f5fb100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56162f5a5e10 con 0x56162f550860 2026-02-24T09:14:26.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56162f5fb640 con 0x56162f595500 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cfe9f4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56162f5fb800 con 0x56162f54ff50 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cf9f6e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f550860 0x56162f531580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cf9f6e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f550860 0x56162f531580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42366/0 (socket says 10.20.193.4:42366) 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cf9f6e640 1 -- 10.20.193.4:0/745628998 learned_addr learned my addr 10.20.193.4:0/745628998 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 0x56162f531040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cfaf70640 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f595500 0x56162f5fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cf9f6e640 1 -- 10.20.193.4:0/745628998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 msgr2=0x56162f531040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cf9f6e640 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 0x56162f531040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cf9f6e640 1 -- 10.20.193.4:0/745628998 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f595500 msgr2=0x56162f5fb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cf9f6e640 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f595500 0x56162f5fb100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.869+0000 7f0cf9f6e640 1 -- 10.20.193.4:0/745628998 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162f3dad00 con 0x56162f550860 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cf9f6e640 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f550860 0x56162f531580 secure :-1 s=READY pgs=832 gs=1 cs=0 l=1 c_cookie=18136766017780655829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce0005b30 tx=0x7f0ce00cde90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb2bc99b83126d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0ca7fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0ca7fff640 1 -- 10.20.193.4:0/745628998 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce00dc600 con 0x56162f550860 2026-02-24T09:14:26.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/745628998 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce802a040 con 0x56162f550860 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 10 client.16782 _ll_register_callbacks cb 0x56162f401080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/745628998 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cec01cb10 con 0x56162f550860 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0ca7fff640 1 -- 10.20.193.4:0/745628998 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0ce00d0f30 con 0x56162f550860 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0ca7fff640 1 -- 10.20.193.4:0/745628998 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce0096b20 con 0x56162f550860 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0ca7fff640 1 -- 10.20.193.4:0/745628998 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0ce00cf920 con 0x56162f550860 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0ca7fff640 1 -- 10.20.193.4:0/745628998 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0ce00d3120 con 0x56162f550860 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 10 client.16782 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/745628998 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56162f3ec970 con 0x56162f550860 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0ca7fff640 1 -- 10.20.193.4:0/745628998 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0ce0041b30 con 0x56162f550860 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 10 client.16782 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 10 client.16782 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 20 client.16782 populate_metadata read hostname 'trial004' 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x56162f6436b0 0x56162f663b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 4 client.16782 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:14:26.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/745628998 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56162f18b160 con 0x56162f6436b0 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.870+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x56162f6436b0 0x56162f663b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfa76f640 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x56162f6436b0 0x56162f663b60 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=6019655960352483666 s_cookie=13235705135786393870 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=538a1d33d2df6952 server_cookie=b7aeabb1fa5c810e in_seq=0 out_seq=0 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0ca7fff640 10 client.16782 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0ca7fff640 1 -- 10.20.193.4:0/745628998 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56162f18b160 con 0x56162f6436b0 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0ca7fff640 10 client.16782 handle_command_reply: tid=0 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 client.16782 shutdown 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/745628998 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f550860 msgr2=0x56162f531580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f550860 0x56162f531580 secure :-1 s=READY pgs=832 gs=1 cs=0 l=1 c_cookie=18136766017780655829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce0005b30 tx=0x7f0ce00cde90 comp rx=0 tx=0).stop 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/745628998 shutdown_connections 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x56162f6436b0 0x56162f663b60 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=6019655960352483666 s_cookie=13235705135786393870 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162f595500 0x56162f5fb100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162f550860 0x56162f531580 unknown :-1 s=CLOSED pgs=832 gs=1 cs=0 l=1 c_cookie=18136766017780655829 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 --2- 10.20.193.4:0/745628998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162f54ff50 0x56162f531040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0ca7fff640 0 client.16782 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:14:26.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/745628998 >> 10.20.193.4:0/745628998 conn(0x56162f46edb0 msgr2=0x56162f5aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/745628998 shutdown_connections 2026-02-24T09:14:26.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.871+0000 7f0cfe9f4e00 1 -- 10.20.193.4:0/745628998 wait complete. 2026-02-24T09:14:26.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfe9f4e00 20 client.16782 trim_cache size 0 max 16384 2026-02-24T09:14:26.882 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/3037589534 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0cd00b56d0 msgr2=0x7f0cd00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0cd00b56d0 0x7f0cd00d5b80 secure :-1 s=READY pgs=357 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cec004740 tx=0x7f0cec005f00 comp rx=0 tx=0).stop 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/3037589534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0cf4110040 msgr2=0x7f0cf4176110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0cf4110040 0x7f0cf4176110 secure :-1 s=READY pgs=828 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce00023d0 tx=0x7f0ce00043d0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/3037589534 shutdown_connections 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0cd00b56d0 0x7f0cd00d5b80 unknown :-1 s=CLOSED pgs=357 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0cf4115840 0x7f0cf40f5f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0cf4110040 0x7f0cf4176110 unknown :-1 s=CLOSED pgs=828 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 --2- 10.20.193.4:0/3037589534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0cf410f650 0x7f0cf40f5890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/3037589534 >> 10.20.193.4:0/3037589534 conn(0x7f0cf40ecf20 msgr2=0x7f0cf4111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/3037589534 shutdown_connections 2026-02-24T09:14:26.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:26.872+0000 7f0cfc9fa640 1 -- 10.20.193.4:0/3037589534 wait complete. 2026-02-24T09:14:26.930 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:14:27.045 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:27.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:26 trial090 ceph-mon[47278]: pgmap v291: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 845 MiB/s wr, 228 op/s 2026-02-24T09:14:27.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:26 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2609976381' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:27.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:26 trial014 ceph-mon[46941]: pgmap v291: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 845 MiB/s wr, 228 op/s 2026-02-24T09:14:27.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:26 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2609976381' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:27.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.145+0000 7f2ba6276640 1 -- 10.20.193.4:0/2424388236 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2ba0110040 msgr2=0x7f2ba0115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.145+0000 7f2ba6276640 1 --2- 10.20.193.4:0/2424388236 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2ba0110040 0x7f2ba0115090 secure :-1 s=READY pgs=833 gs=1 cs=0 l=1 c_cookie=15974104131992494176 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b90009950 tx=0x7f2b9002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.145+0000 7f2ba6276640 1 -- 10.20.193.4:0/2424388236 shutdown_connections 2026-02-24T09:14:27.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.145+0000 7f2ba6276640 1 --2- 10.20.193.4:0/2424388236 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2ba0115840 0x7f2ba0176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.145+0000 7f2ba6276640 1 --2- 10.20.193.4:0/2424388236 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2ba0110040 0x7f2ba0115090 unknown :-1 s=CLOSED pgs=833 gs=1 cs=0 l=1 c_cookie=15974104131992494176 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.145+0000 7f2ba6276640 1 --2- 10.20.193.4:0/2424388236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ba010f650 0x7f2ba010fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.145+0000 7f2ba6276640 1 -- 10.20.193.4:0/2424388236 >> 10.20.193.4:0/2424388236 conn(0x7f2ba00ecf20 msgr2=0x7f2ba010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.145+0000 7f2ba6276640 1 -- 10.20.193.4:0/2424388236 shutdown_connections 2026-02-24T09:14:27.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.145+0000 7f2ba6276640 1 -- 10.20.193.4:0/2424388236 wait complete. 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2ba6276640 1 Processor -- start 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2ba6276640 1 -- start start 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2ba6276640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2ba010f650 0x7f2ba00f58c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2ba6276640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ba0110040 0x7f2ba0176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2ba6276640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2ba0115840 0x7f2ba00f5fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2ba6276640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba00fb1d0 con 0x7f2ba010f650 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2ba6276640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba00fb340 con 0x7f2ba0115840 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2ba6276640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba00fb500 con 0x7f2ba0110040 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2ba010f650 0x7f2ba00f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2ba010f650 0x7f2ba00f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42386/0 (socket says 10.20.193.4:42386) 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/665677917 learned_addr learned my addr 10.20.193.4:0/665677917 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9effd640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ba0110040 0x7f2ba0176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/665677917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ba0110040 msgr2=0x7f2ba0176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9f7fe640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ba0110040 0x7f2ba0176110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/665677917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2ba0115840 msgr2=0x7f2ba00f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9ffff640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2ba0115840 0x7f2ba00f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9f7fe640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2ba0115840 0x7f2ba00f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/665677917 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b90009570 con 0x7f2ba010f650 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9ffff640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2ba0115840 0x7f2ba00f5fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9f7fe640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2ba010f650 0x7f2ba00f58c0 secure :-1 s=READY pgs=834 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b8c005db0 tx=0x7f2b8c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9cff9640 1 -- 10.20.193.4:0/665677917 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b8c004500 con 0x7f2ba010f650 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2ba6276640 1 -- 10.20.193.4:0/665677917 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba00fb7e0 con 0x7f2ba010f650 2026-02-24T09:14:27.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2ba6276640 1 -- 10.20.193.4:0/665677917 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba00fbcb0 con 0x7f2ba010f650 2026-02-24T09:14:27.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.146+0000 7f2b9cff9640 1 -- 10.20.193.4:0/665677917 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2b8c004d30 con 0x7f2ba010f650 2026-02-24T09:14:27.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.147+0000 7f2b9cff9640 1 -- 10.20.193.4:0/665677917 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b8c002990 con 0x7f2ba010f650 2026-02-24T09:14:27.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.149+0000 7f2b9cff9640 1 -- 10.20.193.4:0/665677917 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f2b8c009990 con 0x7f2ba010f650 2026-02-24T09:14:27.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.149+0000 7f2b9cff9640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b740b5750 0x7f2b740d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.150+0000 7f2b9effd640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b740b5750 0x7f2b740d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.150+0000 7f2b9cff9640 1 -- 10.20.193.4:0/665677917 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2b8c0e6d80 con 0x7f2ba010f650 2026-02-24T09:14:27.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.150+0000 7f2b9effd640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b740b5750 0x7f2b740d5c00 secure :-1 s=READY pgs=358 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b900098a0 tx=0x7f2b90031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2ba8270e00 1 Processor -- start 2026-02-24T09:14:27.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2ba8270e00 1 -- start start 2026-02-24T09:14:27.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3960f50 0x55ecc3961320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a5fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39c68e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3871ee0 con 0x55ecc3961860 2026-02-24T09:14:27.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ecc386dc10 con 0x55ecc3960f50 2026-02-24T09:14:27.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3867d70 con 0x55ecc39a6500 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42394/0 (socket says 10.20.193.4:42394) 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9effd640 1 -- 10.20.193.4:0/3704332243 learned_addr learned my addr 10.20.193.4:0/3704332243 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9ffff640 1 --2- 10.20.193.4:0/3704332243 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9f7fe640 1 --2- 10.20.193.4:0/3704332243 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3960f50 0x55ecc3961320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9effd640 1 -- 10.20.193.4:0/3704332243 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 msgr2=0x55ecc39c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9effd640 1 --2- 10.20.193.4:0/3704332243 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9effd640 1 -- 10.20.193.4:0/3704332243 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3960f50 msgr2=0x55ecc3961320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9effd640 1 --2- 10.20.193.4:0/3704332243 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3960f50 0x55ecc3961320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9effd640 1 -- 10.20.193.4:0/3704332243 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc3813340 con 0x55ecc3961860 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b9effd640 1 --2- 10.20.193.4:0/3704332243 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a5fc0 secure :-1 s=READY pgs=835 gs=1 cs=0 l=1 c_cookie=7302684980901946832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b90009950 tx=0x7f2b9003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6558594c813da5d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b63fff640 1 -- 10.20.193.4:0/3704332243 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b9004b070 con 0x55ecc3961860 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b63fff640 1 -- 10.20.193.4:0/3704332243 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2b90039930 con 0x55ecc3961860 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.151+0000 7f2b63fff640 1 -- 10.20.193.4:0/3704332243 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b9003f070 con 0x55ecc3961860 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.152+0000 7f2ba8270e00 1 -- 10.20.193.4:0/3704332243 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 msgr2=0x55ecc39a5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.152+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/3704332243 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a5fc0 secure :-1 s=READY pgs=835 gs=1 cs=0 l=1 c_cookie=7302684980901946832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b90009950 tx=0x7f2b9003f000 comp rx=0 tx=0).stop 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.152+0000 7f2ba8270e00 1 -- 10.20.193.4:0/3704332243 shutdown_connections 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.152+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/3704332243 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39c68e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.152+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/3704332243 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a5fc0 unknown :-1 s=CLOSED pgs=835 gs=1 cs=0 l=1 c_cookie=7302684980901946832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.152+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/3704332243 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3960f50 0x55ecc3961320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.152+0000 7f2ba8270e00 1 -- 10.20.193.4:0/3704332243 >> 10.20.193.4:0/3704332243 conn(0x55ecc387fdb0 msgr2=0x55ecc395f830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.152+0000 7f2ba8270e00 1 -- 10.20.193.4:0/3704332243 shutdown_connections 2026-02-24T09:14:27.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.152+0000 7f2ba8270e00 1 -- 10.20.193.4:0/3704332243 wait complete. 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.152+0000 7f2ba8270e00 1 -- start start 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2ba8270e00 1 Processor -- start 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc39bde60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 0x55ecc39be3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39c3390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ecc39c38d0 con 0x55ecc3960f50 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ecc39c3a40 con 0x55ecc3961860 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ecc39c3c00 con 0x55ecc39a6500 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc39bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc39bde60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42398/0 (socket says 10.20.193.4:42398) 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/1407429185 learned_addr learned my addr 10.20.193.4:0/1407429185 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:27.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9effd640 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 0x55ecc39be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/1407429185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 msgr2=0x55ecc39c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9f7fe640 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/1407429185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 msgr2=0x55ecc39be3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9f7fe640 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 0x55ecc39be3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/1407429185 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc37eb9d0 con 0x55ecc3960f50 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9effd640 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 0x55ecc39be3a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b9f7fe640 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc39bde60 secure :-1 s=READY pgs=836 gs=1 cs=0 l=1 c_cookie=8205995131714146212 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b8c0040a0 tx=0x7f2b8c0ac990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e18d1856680fa4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b617fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b617fa640 1 -- 10.20.193.4:0/1407429185 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b8c0adf60 con 0x55ecc3960f50 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b617fa640 1 -- 10.20.193.4:0/1407429185 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2b8c0b2dd0 con 0x55ecc3960f50 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b617fa640 1 -- 10.20.193.4:0/1407429185 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b8c072430 con 0x55ecc3960f50 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1407429185 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba0176a80 con 0x55ecc3960f50 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b617fa640 1 -- 10.20.193.4:0/1407429185 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2b8c0ab090 con 0x55ecc3960f50 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2b617fa640 10 client.16794 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2ba8270e00 10 client.16794 _ll_register_callbacks cb 0x55ecc3812080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.153+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1407429185 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ecc35b74a0 con 0x55ecc3960f50 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2b617fa640 1 -- 10.20.193.4:0/1407429185 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2b8c0b7d60 con 0x55ecc3960f50 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2ba8270e00 10 client.16794 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:27.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1407429185 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55ecc37fd710 con 0x55ecc3960f50 2026-02-24T09:14:27.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2b617fa640 1 -- 10.20.193.4:0/1407429185 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2b8c0aeaa0 con 0x55ecc3960f50 2026-02-24T09:14:27.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2ba8270e00 10 client.16794 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:27.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2ba8270e00 10 client.16794 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:14:27.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2ba8270e00 20 client.16794 populate_metadata read hostname 'trial004' 2026-02-24T09:14:27.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ecc39a3830 0x55ecc39a3ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2ba8270e00 4 client.16794 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:14:27.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1407429185 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecc385d7b0 con 0x55ecc39a3830 2026-02-24T09:14:27.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.154+0000 7f2b9effd640 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ecc39a3830 0x55ecc39a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.155+0000 7f2b617fa640 10 client.16794 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:14:27.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.155+0000 7f2b9effd640 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ecc39a3830 0x55ecc39a3ca0 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=5184056702840051597 s_cookie=6520563612903573697 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47f1781adc43978d server_cookie=5a7db20efa7488c1 in_seq=0 out_seq=0 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2b617fa640 1 -- 10.20.193.4:0/1407429185 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ecc385d7b0 con 0x55ecc39a3830 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2b617fa640 10 client.16794 handle_command_reply: tid=0 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 client.16794 shutdown 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1407429185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 msgr2=0x55ecc39bde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc39bde60 secure :-1 s=READY pgs=836 gs=1 cs=0 l=1 c_cookie=8205995131714146212 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b8c0040a0 tx=0x7f2b8c0ac990 comp rx=0 tx=0).stop 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1407429185 shutdown_connections 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ecc39a3830 0x55ecc39a3ca0 crc :-1 s=READY pgs=39 gs=4 cs=0 l=0 c_cookie=5184056702840051597 s_cookie=6520563612903573697 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39c3390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2b617fa640 0 client.16794 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 0x55ecc39be3a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1407429185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc39bde60 unknown :-1 s=CLOSED pgs=836 gs=1 cs=0 l=1 c_cookie=8205995131714146212 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1407429185 >> 10.20.193.4:0/1407429185 conn(0x55ecc387fdb0 msgr2=0x55ecc395f040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1407429185 shutdown_connections 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1407429185 wait complete. 2026-02-24T09:14:27.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.156+0000 7f2ba8270e00 20 client.16794 trim_cache size 0 max 16384 2026-02-24T09:14:27.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2ba8270e00 1 Processor -- start 2026-02-24T09:14:27.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2ba8270e00 1 -- start start 2026-02-24T09:14:27.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3960f50 0x55ecc39c2900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a1110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39a1650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ecc38659a0 con 0x55ecc3961860 2026-02-24T09:14:27.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3641df0 con 0x55ecc3960f50 2026-02-24T09:14:27.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ecc39ab5a0 con 0x55ecc39a6500 2026-02-24T09:14:27.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9f7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3960f50 0x55ecc39c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a1110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42408/0 (socket says 10.20.193.4:42408) 2026-02-24T09:14:27.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9effd640 1 -- 10.20.193.4:0/3289519879 learned_addr learned my addr 10.20.193.4:0/3289519879 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:27.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9ffff640 1 --2- 10.20.193.4:0/3289519879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9effd640 1 -- 10.20.193.4:0/3289519879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 msgr2=0x55ecc39a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9effd640 1 --2- 10.20.193.4:0/3289519879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9effd640 1 -- 10.20.193.4:0/3289519879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3960f50 msgr2=0x55ecc39c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9effd640 1 --2- 10.20.193.4:0/3289519879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3960f50 0x55ecc39c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9effd640 1 -- 10.20.193.4:0/3289519879 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc39b04c0 con 0x55ecc3961860 2026-02-24T09:14:27.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b9effd640 1 --2- 10.20.193.4:0/3289519879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a1110 secure :-1 s=READY pgs=837 gs=1 cs=0 l=1 c_cookie=10617737288529285510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b9002f6e0 tx=0x7f2b90002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9359c7cf09351186 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.163+0000 7f2b637fe640 1 -- 10.20.193.4:0/3289519879 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b90055040 con 0x55ecc3961860 2026-02-24T09:14:27.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2b637fe640 1 -- 10.20.193.4:0/3289519879 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2b90002a70 con 0x55ecc3961860 2026-02-24T09:14:27.172 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2b637fe640 1 -- 10.20.193.4:0/3289519879 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b9003f040 con 0x55ecc3961860 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 -- 10.20.193.4:0/3289519879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 msgr2=0x55ecc39a1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/3289519879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a1110 secure :-1 s=READY pgs=837 gs=1 cs=0 l=1 c_cookie=10617737288529285510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b9002f6e0 tx=0x7f2b90002390 comp rx=0 tx=0).stop 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 -- 10.20.193.4:0/3289519879 shutdown_connections 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/3289519879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc39a1650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/3289519879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3961860 0x55ecc39a1110 unknown :-1 s=CLOSED pgs=837 gs=1 cs=0 l=1 c_cookie=10617737288529285510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/3289519879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3960f50 0x55ecc39c2900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 -- 10.20.193.4:0/3289519879 >> 10.20.193.4:0/3289519879 conn(0x55ecc387fdb0 msgr2=0x55ecc39c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 -- 10.20.193.4:0/3289519879 shutdown_connections 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 -- 10.20.193.4:0/3289519879 wait complete. 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 -- start start 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.164+0000 7f2ba8270e00 1 Processor -- start 2026-02-24T09:14:27.173 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc393f030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 0x55ecc393f570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc393fab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ecc38659a0 con 0x55ecc3960f50 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ecc39440b0 con 0x55ecc3961860 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3944270 con 0x55ecc39a6500 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc393f030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc393f030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42412/0 (socket says 10.20.193.4:42412) 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/1084757958 learned_addr learned my addr 10.20.193.4:0/1084757958 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9effd640 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 0x55ecc393f570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/1084757958 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 msgr2=0x55ecc393fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9f7fe640 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc393fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/1084757958 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 msgr2=0x55ecc393f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.174 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9f7fe640 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 0x55ecc393f570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9f7fe640 1 -- 10.20.193.4:0/1084757958 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc37f8190 con 0x55ecc3960f50 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9effd640 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 0x55ecc393f570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9f7fe640 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc393f030 secure :-1 s=READY pgs=838 gs=1 cs=0 l=1 c_cookie=9526877921558429754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b8c0aa320 tx=0x7f2b8c0d2030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843644fe7d00803a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b617fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b617fa640 1 -- 10.20.193.4:0/1084757958 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b8c0b81f0 con 0x55ecc3960f50 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b617fa640 1 -- 10.20.193.4:0/1084757958 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ecc35b74a0 con 0x55ecc3960f50 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1084757958 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc3813340 con 0x55ecc3960f50 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b617fa640 1 -- 10.20.193.4:0/1084757958 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b8c0b7d60 con 0x55ecc3960f50 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 10 client.16800 _ll_register_callbacks cb 0x55ecc3812080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1084757958 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b90039930 con 0x55ecc3960f50 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b617fa640 1 -- 10.20.193.4:0/1084757958 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2b8c0b7ec0 con 0x55ecc3960f50 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b617fa640 1 -- 10.20.193.4:0/1084757958 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2b8c0add40 con 0x55ecc3960f50 2026-02-24T09:14:27.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 10 client.16800 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1084757958 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55ecc37ebd00 con 0x55ecc3960f50 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b617fa640 1 -- 10.20.193.4:0/1084757958 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2b8c093070 con 0x55ecc3960f50 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 10 client.16800 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 10 client.16800 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 20 client.16800 populate_metadata read hostname 'trial004' 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ecc3a53eb0 0x55ecc3a74360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 4 client.16800 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1084757958 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ecc359c160 con 0x55ecc3a53eb0 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.165+0000 7f2b9effd640 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ecc3a53eb0 0x55ecc3a74360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2b617fa640 10 client.16800 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2b9effd640 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ecc3a53eb0 0x55ecc3a74360 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=8082860307612181902 s_cookie=10860003721008512056 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=702c169ffc54258e server_cookie=96b67bd87221fc38 in_seq=0 out_seq=0 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2b617fa640 1 -- 10.20.193.4:0/1084757958 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ecc359c160 con 0x55ecc3a53eb0 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2b617fa640 10 client.16800 handle_command_reply: tid=0 2026-02-24T09:14:27.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 client.16800 shutdown 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1084757958 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 msgr2=0x55ecc393f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc393f030 secure :-1 s=READY pgs=838 gs=1 cs=0 l=1 c_cookie=9526877921558429754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b8c0aa320 tx=0x7f2b8c0d2030 comp rx=0 tx=0).stop 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1084757958 shutdown_connections 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ecc3a53eb0 0x55ecc3a74360 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=8082860307612181902 s_cookie=10860003721008512056 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ecc39a6500 0x55ecc393fab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2b617fa640 0 client.16800 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ecc3961860 0x55ecc393f570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 --2- 10.20.193.4:0/1084757958 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ecc3960f50 0x55ecc393f030 unknown :-1 s=CLOSED pgs=838 gs=1 cs=0 l=1 c_cookie=9526877921558429754 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1084757958 >> 10.20.193.4:0/1084757958 conn(0x55ecc387fdb0 msgr2=0x55ecc39c29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1084757958 shutdown_connections 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 1 -- 10.20.193.4:0/1084757958 wait complete. 2026-02-24T09:14:27.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.166+0000 7f2ba8270e00 20 client.16800 trim_cache size 0 max 16384 2026-02-24T09:14:27.178 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 -- 10.20.193.4:0/665677917 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b740b5750 msgr2=0x7f2b740d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b740b5750 0x7f2b740d5c00 secure :-1 s=READY pgs=358 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b900098a0 tx=0x7f2b90031040 comp rx=0 tx=0).stop 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 -- 10.20.193.4:0/665677917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2ba010f650 msgr2=0x7f2ba00f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2ba010f650 0x7f2ba00f58c0 secure :-1 s=READY pgs=834 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b8c005db0 tx=0x7f2b8c00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 -- 10.20.193.4:0/665677917 shutdown_connections 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2b740b5750 0x7f2b740d5c00 unknown :-1 s=CLOSED pgs=358 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2ba0115840 0x7f2ba00f5fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ba0110040 0x7f2ba0176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 --2- 10.20.193.4:0/665677917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2ba010f650 0x7f2ba00f58c0 unknown :-1 s=CLOSED pgs=834 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 -- 10.20.193.4:0/665677917 >> 10.20.193.4:0/665677917 conn(0x7f2ba00ecf20 msgr2=0x7f2ba0111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 -- 10.20.193.4:0/665677917 shutdown_connections 2026-02-24T09:14:27.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.167+0000 7f2ba6276640 1 -- 10.20.193.4:0/665677917 wait complete. 2026-02-24T09:14:27.205 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:14:27.319 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:27.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 -- 10.20.193.4:0/4116194836 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c10110130 msgr2=0x7f0c10115180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 --2- 10.20.193.4:0/4116194836 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c10110130 0x7f0c10115180 secure :-1 s=READY pgs=839 gs=1 cs=0 l=1 c_cookie=4461515759213393603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c04009950 tx=0x7f0c0402f190 comp rx=0 tx=0).stop 2026-02-24T09:14:27.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 -- 10.20.193.4:0/4116194836 shutdown_connections 2026-02-24T09:14:27.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 --2- 10.20.193.4:0/4116194836 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c10115930 0x7f0c10176300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 --2- 10.20.193.4:0/4116194836 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c10110130 0x7f0c10115180 unknown :-1 s=CLOSED pgs=839 gs=1 cs=0 l=1 c_cookie=4461515759213393603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 --2- 10.20.193.4:0/4116194836 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c1010f740 0x7f0c1010fb10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 -- 10.20.193.4:0/4116194836 >> 10.20.193.4:0/4116194836 conn(0x7f0c100ed050 msgr2=0x7f0c1010d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 -- 10.20.193.4:0/4116194836 shutdown_connections 2026-02-24T09:14:27.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 -- 10.20.193.4:0/4116194836 wait complete. 2026-02-24T09:14:27.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 Processor -- start 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 -- start start 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c1010f740 0x7f0c100f5a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c10110130 0x7f0c10176200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c10115930 0x7f0c100f6130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0c100fb340 con 0x7f0c1010f740 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0c100fb4b0 con 0x7f0c10110130 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c18170640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c100fb670 con 0x7f0c10115930 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c15ee5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c1010f740 0x7f0c100f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c15ee5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c1010f740 0x7f0c100f5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42432/0 (socket says 10.20.193.4:42432) 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c15ee5640 1 -- 10.20.193.4:0/2686267252 learned_addr learned my addr 10.20.193.4:0/2686267252 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:27.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c156e4640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c10110130 0x7f0c10176200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.429+0000 7f0c166e6640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c10115930 0x7f0c100f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0c15ee5640 1 -- 10.20.193.4:0/2686267252 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c10115930 msgr2=0x7f0c100f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c10115930 0x7f0c100f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0c15ee5640 1 -- 10.20.193.4:0/2686267252 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c10110130 msgr2=0x7f0c10176200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c10110130 0x7f0c10176200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0c15ee5640 1 -- 10.20.193.4:0/2686267252 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c04009570 con 0x7f0c1010f740 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c1010f740 0x7f0c100f5a30 secure :-1 s=READY pgs=840 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c0000d950 tx=0x7f0c0000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0bfeffd640 1 -- 10.20.193.4:0/2686267252 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c00004540 con 0x7f0c1010f740 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0c18170640 1 -- 10.20.193.4:0/2686267252 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c100fb950 con 0x7f0c1010f740 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0bfeffd640 1 -- 10.20.193.4:0/2686267252 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c00009d00 con 0x7f0c1010f740 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0bfeffd640 1 -- 10.20.193.4:0/2686267252 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c000106e0 con 0x7f0c1010f740 2026-02-24T09:14:27.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.430+0000 7f0c18170640 1 -- 10.20.193.4:0/2686267252 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c100fbe70 con 0x7f0c1010f740 2026-02-24T09:14:27.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.432+0000 7f0bfeffd640 1 -- 10.20.193.4:0/2686267252 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f0c00010870 con 0x7f0c1010f740 2026-02-24T09:14:27.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.432+0000 7f0bfeffd640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0bec0b56d0 0x7f0bec0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.433+0000 7f0c156e4640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0bec0b56d0 0x7f0bec0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.433+0000 7f0bfeffd640 1 -- 10.20.193.4:0/2686267252 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0c000e6fa0 con 0x7f0c1010f740 2026-02-24T09:14:27.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.433+0000 7f0c156e4640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0bec0b56d0 0x7f0bec0d5b80 secure :-1 s=READY pgs=359 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c040023d0 tx=0x7f0c04031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.433+0000 7f0c1a16ae00 1 Processor -- start 2026-02-24T09:14:27.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.433+0000 7f0c1a16ae00 1 -- start start 2026-02-24T09:14:27.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa99f50 0x55610aa9a320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa9a860 0x55610aadefc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 0x55610aaff8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55610a9aaee0 con 0x55610aa99f50 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55610a9a6c10 con 0x55610aa9a860 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55610a9a0d70 con 0x55610aadf500 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c15ee5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa99f50 0x55610aa9a320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c15ee5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa99f50 0x55610aa9a320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42448/0 (socket says 10.20.193.4:42448) 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c15ee5640 1 -- 10.20.193.4:0/1057178463 learned_addr learned my addr 10.20.193.4:0/1057178463 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c166e6640 1 --2- 10.20.193.4:0/1057178463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 0x55610aaff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c15ee5640 1 -- 10.20.193.4:0/1057178463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 msgr2=0x55610aaff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/1057178463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 0x55610aaff8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c15ee5640 1 -- 10.20.193.4:0/1057178463 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa9a860 msgr2=0x55610aadefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/1057178463 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa9a860 0x55610aadefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c15ee5640 1 -- 10.20.193.4:0/1057178463 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610a94c340 con 0x55610aa99f50 2026-02-24T09:14:27.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/1057178463 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa99f50 0x55610aa9a320 secure :-1 s=READY pgs=841 gs=1 cs=0 l=1 c_cookie=14018820422829494408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c000a98a0 tx=0x7f0c00002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28cdae650be5088 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0bde4e6640 1 -- 10.20.193.4:0/1057178463 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c000accb0 con 0x55610aa99f50 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0bde4e6640 1 -- 10.20.193.4:0/1057178463 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c000acad0 con 0x55610aa99f50 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0bde4e6640 1 -- 10.20.193.4:0/1057178463 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c00072650 con 0x55610aa99f50 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1057178463 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa99f50 msgr2=0x55610aa9a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1057178463 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa99f50 0x55610aa9a320 secure :-1 s=READY pgs=841 gs=1 cs=0 l=1 c_cookie=14018820422829494408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c000a98a0 tx=0x7f0c00002390 comp rx=0 tx=0).stop 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1057178463 shutdown_connections 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1057178463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 0x55610aaff8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1057178463 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa9a860 0x55610aadefc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1057178463 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa99f50 0x55610aa9a320 unknown :-1 s=CLOSED pgs=841 gs=1 cs=0 l=1 c_cookie=14018820422829494408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1057178463 >> 10.20.193.4:0/1057178463 conn(0x55610a9b8db0 msgr2=0x55610aa98830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1057178463 shutdown_connections 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.434+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1057178463 wait complete. 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c1a16ae00 1 -- start start 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c1a16ae00 1 Processor -- start 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa99f50 0x55610aaf6e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf7350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 0x55610aafc340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55610aafc880 con 0x55610aa9a860 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55610aafc9f0 con 0x55610aa99f50 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55610aafcbb0 con 0x55610aadf500 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c156e4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf7350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c156e4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf7350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42462/0 (socket says 10.20.193.4:42462) 2026-02-24T09:14:27.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.435+0000 7f0c156e4640 1 -- 10.20.193.4:0/1371498540 learned_addr learned my addr 10.20.193.4:0/1371498540 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa99f50 0x55610aaf6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c156e4640 1 -- 10.20.193.4:0/1371498540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 msgr2=0x55610aafc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c166e6640 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 0x55610aafc340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c156e4640 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 0x55610aafc340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c156e4640 1 -- 10.20.193.4:0/1371498540 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa99f50 msgr2=0x55610aaf6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c156e4640 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa99f50 0x55610aaf6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c156e4640 1 -- 10.20.193.4:0/1371498540 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610a9249d0 con 0x55610aa9a860 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c166e6640 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 0x55610aafc340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c156e4640 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf7350 secure :-1 s=READY pgs=842 gs=1 cs=0 l=1 c_cookie=15913794706379450971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c04009950 tx=0x7f0c04002a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd927f8763d2a5b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0bcb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/1371498540 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c04038d50 con 0x55610aa9a860 2026-02-24T09:14:27.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1371498540 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c100fbe70 con 0x55610aa9a860 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/1371498540 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c040043a0 con 0x55610aa9a860 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/1371498540 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c04043710 con 0x55610aa9a860 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 10 client.16812 _ll_register_callbacks cb 0x55610a94b080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1371498540 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55610a6f04a0 con 0x55610aa9a860 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/1371498540 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0c040438a0 con 0x55610aa9a860 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/1371498540 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0c04043a80 con 0x55610aa9a860 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 10 client.16812 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1371498540 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55610a936710 con 0x55610aa9a860 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/1371498540 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0c04043c60 con 0x55610aa9a860 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 10 client.16812 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 20 client.16812 populate_metadata read hostname 'trial004' 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55610aadc790 0x55610aadcc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 4 client.16812 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1371498540 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55610a9967b0 con 0x55610aadc790 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.436+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55610aadc790 0x55610aadcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0bcb7fe640 10 client.16812 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55610aadc790 0x55610aadcc30 crc :-1 s=READY pgs=115 gs=4 cs=0 l=0 c_cookie=13653020122009094385 s_cookie=5255714364815130683 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd794576d39cc8f1 server_cookie=48f00c5e6bb9403b in_seq=0 out_seq=0 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/1371498540 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55610a9967b0 con 0x55610aadc790 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0bcb7fe640 10 client.16812 handle_command_reply: tid=0 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 client.16812 shutdown 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1371498540 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 msgr2=0x55610aaf7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf7350 secure :-1 s=READY pgs=842 gs=1 cs=0 l=1 c_cookie=15913794706379450971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c04009950 tx=0x7f0c04002a70 comp rx=0 tx=0).stop 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1371498540 shutdown_connections 2026-02-24T09:14:27.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55610aadc790 0x55610aadcc30 crc :-1 s=READY pgs=115 gs=4 cs=0 l=0 c_cookie=13653020122009094385 s_cookie=5255714364815130683 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aadf500 0x55610aafc340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf7350 unknown :-1 s=CLOSED pgs=842 gs=1 cs=0 l=1 c_cookie=15913794706379450971 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0bcb7fe640 0 client.16812 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:27.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1371498540 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa99f50 0x55610aaf6e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1371498540 >> 10.20.193.4:0/1371498540 conn(0x55610a9b8db0 msgr2=0x55610aa98040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1371498540 shutdown_connections 2026-02-24T09:14:27.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.437+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1371498540 wait complete. 2026-02-24T09:14:27.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.438+0000 7f0c1a16ae00 20 client.16812 trim_cache size 0 max 16384 2026-02-24T09:14:27.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.444+0000 7f0c1a16ae00 1 Processor -- start 2026-02-24T09:14:27.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.444+0000 7f0c1a16ae00 1 -- start start 2026-02-24T09:14:27.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.444+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aa99f50 0x55610aaf4100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.444+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf4640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.444+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aadf500 0x55610aada110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.444+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55610a99e9a0 con 0x55610aa9a860 2026-02-24T09:14:27.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.444+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55610a77adf0 con 0x55610aadf500 2026-02-24T09:14:27.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.444+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55610aafd370 con 0x55610aa99f50 2026-02-24T09:14:27.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.444+0000 7f0c156e4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf4640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c156e4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf4640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42464/0 (socket says 10.20.193.4:42464) 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c156e4640 1 -- 10.20.193.4:0/1493589958 learned_addr learned my addr 10.20.193.4:0/1493589958 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c166e6640 1 --2- 10.20.193.4:0/1493589958 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aadf500 0x55610aada110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c156e4640 1 -- 10.20.193.4:0/1493589958 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aa99f50 msgr2=0x55610aaf4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c156e4640 1 --2- 10.20.193.4:0/1493589958 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aa99f50 0x55610aaf4100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c156e4640 1 -- 10.20.193.4:0/1493589958 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aadf500 msgr2=0x55610aada110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c156e4640 1 --2- 10.20.193.4:0/1493589958 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aadf500 0x55610aada110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c156e4640 1 -- 10.20.193.4:0/1493589958 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610a931190 con 0x55610aa9a860 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c156e4640 1 --2- 10.20.193.4:0/1493589958 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf4640 secure :-1 s=READY pgs=843 gs=1 cs=0 l=1 c_cookie=5084049000465518210 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c04005b30 tx=0x7f0c04057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468e2ba1256d4e82 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0bddce5640 1 -- 10.20.193.4:0/1493589958 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c04002ea0 con 0x55610aa9a860 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0bddce5640 1 -- 10.20.193.4:0/1493589958 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55610a6f04a0 con 0x55610aa9a860 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0bddce5640 1 -- 10.20.193.4:0/1493589958 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c040436d0 con 0x55610aa9a860 2026-02-24T09:14:27.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1493589958 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 msgr2=0x55610aaf4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1493589958 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf4640 secure :-1 s=READY pgs=843 gs=1 cs=0 l=1 c_cookie=5084049000465518210 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c04005b30 tx=0x7f0c04057000 comp rx=0 tx=0).stop 2026-02-24T09:14:27.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1493589958 shutdown_connections 2026-02-24T09:14:27.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1493589958 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aadf500 0x55610aada110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1493589958 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aa9a860 0x55610aaf4640 unknown :-1 s=CLOSED pgs=843 gs=1 cs=0 l=1 c_cookie=5084049000465518210 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/1493589958 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aa99f50 0x55610aaf4100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1493589958 >> 10.20.193.4:0/1493589958 conn(0x55610a9b8db0 msgr2=0x55610aaf39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1493589958 shutdown_connections 2026-02-24T09:14:27.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.445+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/1493589958 wait complete. 2026-02-24T09:14:27.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 -- start start 2026-02-24T09:14:27.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 Processor -- start 2026-02-24T09:14:27.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aa99f50 0x55610aa797f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa9a860 0x55610aa79d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aadf500 0x55610ab450c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55610aae4420 con 0x55610aadf500 2026-02-24T09:14:27.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55610aa7a5c0 con 0x55610aa9a860 2026-02-24T09:14:27.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55610ab45600 con 0x55610aa99f50 2026-02-24T09:14:27.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c166e6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aadf500 0x55610ab450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c166e6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aadf500 0x55610ab450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42478/0 (socket says 10.20.193.4:42478) 2026-02-24T09:14:27.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c166e6640 1 -- 10.20.193.4:0/3617830017 learned_addr learned my addr 10.20.193.4:0/3617830017 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aa99f50 0x55610aa797f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c166e6640 1 -- 10.20.193.4:0/3617830017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aa99f50 msgr2=0x55610aa797f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c166e6640 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aa99f50 0x55610aa797f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c166e6640 1 -- 10.20.193.4:0/3617830017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa9a860 msgr2=0x55610aa79d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c166e6640 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa9a860 0x55610aa79d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c166e6640 1 -- 10.20.193.4:0/3617830017 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610a924d00 con 0x55610aadf500 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c166e6640 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aadf500 0x55610ab450c0 secure :-1 s=READY pgs=844 gs=1 cs=0 l=1 c_cookie=14139675443270415846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c0c0146e0 tx=0x7f0c0c014bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43a37e6837275e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0bcb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/3617830017 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c0c003e00 con 0x55610aadf500 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/3617830017 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610a936710 con 0x55610aadf500 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/3617830017 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c0c012bd0 con 0x55610aadf500 2026-02-24T09:14:27.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/3617830017 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c0c01c6f0 con 0x55610aadf500 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 10 client.16818 _ll_register_callbacks cb 0x55610a94b080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/3617830017 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c000acad0 con 0x55610aadf500 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/3617830017 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0c0c01c880 con 0x55610aadf500 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/3617830017 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0c0c01ca80 con 0x55610aadf500 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 10 client.16818 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.446+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/3617830017 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55610a936970 con 0x55610aadf500 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.447+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/3617830017 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0c0c024060 con 0x55610aadf500 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.447+0000 7f0c1a16ae00 10 client.16818 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.447+0000 7f0c1a16ae00 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.447+0000 7f0c1a16ae00 20 client.16818 populate_metadata read hostname 'trial004' 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.447+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55610ab8d760 0x55610abadc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.447+0000 7f0c1a16ae00 4 client.16818 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:14:27.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.447+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/3617830017 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55610a6d5160 con 0x55610ab8d760 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.447+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55610ab8d760 0x55610abadc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.447+0000 7f0c15ee5640 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55610ab8d760 0x55610abadc10 crc :-1 s=READY pgs=116 gs=4 cs=0 l=0 c_cookie=9636923013133401074 s_cookie=8482780325414461533 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85bd3a6bfd9a7bf2 server_cookie=75b8e3c32400605d in_seq=0 out_seq=0 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.447+0000 7f0bcb7fe640 10 client.16818 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0bcb7fe640 1 -- 10.20.193.4:0/3617830017 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55610a6d5160 con 0x55610ab8d760 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0bcb7fe640 10 client.16818 handle_command_reply: tid=0 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 client.16818 shutdown 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/3617830017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aadf500 msgr2=0x55610ab450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aadf500 0x55610ab450c0 secure :-1 s=READY pgs=844 gs=1 cs=0 l=1 c_cookie=14139675443270415846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c0c0146e0 tx=0x7f0c0c014bb0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/3617830017 shutdown_connections 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55610ab8d760 0x55610abadc10 crc :-1 s=READY pgs=116 gs=4 cs=0 l=0 c_cookie=9636923013133401074 s_cookie=8482780325414461533 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55610aadf500 0x55610ab450c0 unknown :-1 s=CLOSED pgs=844 gs=1 cs=0 l=1 c_cookie=14139675443270415846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0bcb7fe640 0 client.16818 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:27.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55610aa9a860 0x55610aa79d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 --2- 10.20.193.4:0/3617830017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55610aa99f50 0x55610aa797f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/3617830017 >> 10.20.193.4:0/3617830017 conn(0x55610a9b8db0 msgr2=0x55610aaf4100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/3617830017 shutdown_connections 2026-02-24T09:14:27.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 1 -- 10.20.193.4:0/3617830017 wait complete. 2026-02-24T09:14:27.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c1a16ae00 20 client.16818 trim_cache size 0 max 16384 2026-02-24T09:14:27.464 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:14:27.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 -- 10.20.193.4:0/2686267252 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0bec0b56d0 msgr2=0x7f0bec0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0bec0b56d0 0x7f0bec0d5b80 secure :-1 s=READY pgs=359 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c040023d0 tx=0x7f0c04031040 comp rx=0 tx=0).stop 2026-02-24T09:14:27.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 -- 10.20.193.4:0/2686267252 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c1010f740 msgr2=0x7f0c100f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:27.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c1010f740 0x7f0c100f5a30 secure :-1 s=READY pgs=840 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c0000d950 tx=0x7f0c0000de20 comp rx=0 tx=0).stop 2026-02-24T09:14:27.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 -- 10.20.193.4:0/2686267252 shutdown_connections 2026-02-24T09:14:27.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0bec0b56d0 0x7f0bec0d5b80 unknown :-1 s=CLOSED pgs=359 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c10115930 0x7f0c100f6130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c10110130 0x7f0c10176200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 --2- 10.20.193.4:0/2686267252 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c1010f740 0x7f0c100f5a30 unknown :-1 s=CLOSED pgs=840 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:27.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 -- 10.20.193.4:0/2686267252 >> 10.20.193.4:0/2686267252 conn(0x7f0c100ed050 msgr2=0x7f0c1010dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:27.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 -- 10.20.193.4:0/2686267252 shutdown_connections 2026-02-24T09:14:27.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:27.448+0000 7f0c18170640 1 -- 10.20.193.4:0/2686267252 wait complete. 2026-02-24T09:14:28.485 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:14:28.486 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:14:28.603 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:28.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.700+0000 7f7be0e37640 1 -- 10.20.193.4:0/1189545849 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7bdc10fc70 msgr2=0x7f7bdc114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.700+0000 7f7be0e37640 1 --2- 10.20.193.4:0/1189545849 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7bdc10fc70 0x7f7bdc114cc0 secure :-1 s=READY pgs=845 gs=1 cs=0 l=1 c_cookie=14838705088076069869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc4009950 tx=0x7f7bc402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.700+0000 7f7be0e37640 1 -- 10.20.193.4:0/1189545849 shutdown_connections 2026-02-24T09:14:28.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.700+0000 7f7be0e37640 1 --2- 10.20.193.4:0/1189545849 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7bdc115470 0x7f7bdc175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.700+0000 7f7be0e37640 1 --2- 10.20.193.4:0/1189545849 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7bdc10fc70 0x7f7bdc114cc0 unknown :-1 s=CLOSED pgs=845 gs=1 cs=0 l=1 c_cookie=14838705088076069869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.700+0000 7f7be0e37640 1 --2- 10.20.193.4:0/1189545849 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bdc10f280 0x7f7bdc10f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.700+0000 7f7be0e37640 1 -- 10.20.193.4:0/1189545849 >> 10.20.193.4:0/1189545849 conn(0x7f7bdc05f830 msgr2=0x7f7bdc10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:28.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.700+0000 7f7be0e37640 1 -- 10.20.193.4:0/1189545849 shutdown_connections 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.700+0000 7f7be0e37640 1 -- 10.20.193.4:0/1189545849 wait complete. 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7be0e37640 1 Processor -- start 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7be0e37640 1 -- start start 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7be0e37640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bdc10f280 0x7f7bdc0f55c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7be0e37640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7bdc10fc70 0x7f7bdc175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7be0e37640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7bdc115470 0x7f7bdc0f5cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7be0e37640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc0fae80 con 0x7f7bdc115470 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7be0e37640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc0faff0 con 0x7f7bdc10fc70 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7be0e37640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc0fb1b0 con 0x7f7bdc10f280 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bdad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7bdc115470 0x7f7bdc0f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bdad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7bdc115470 0x7f7bdc0f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42504/0 (socket says 10.20.193.4:42504) 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bdad76640 1 -- 10.20.193.4:0/1501008286 learned_addr learned my addr 10.20.193.4:0/1501008286 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bda575640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bdc10f280 0x7f7bdc0f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bd9d74640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7bdc10fc70 0x7f7bdc175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bdad76640 1 -- 10.20.193.4:0/1501008286 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bdc10f280 msgr2=0x7f7bdc0f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bdad76640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bdc10f280 0x7f7bdc0f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bdad76640 1 -- 10.20.193.4:0/1501008286 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7bdc10fc70 msgr2=0x7f7bdc175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bdad76640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7bdc10fc70 0x7f7bdc175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bdad76640 1 -- 10.20.193.4:0/1501008286 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc4009570 con 0x7f7bdc115470 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bda575640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bdc10f280 0x7f7bdc0f55c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bdad76640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7bdc115470 0x7f7bdc0f5cc0 secure :-1 s=READY pgs=846 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bcc006e90 tx=0x7f7bcc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:28.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.701+0000 7f7bc37fe640 1 -- 10.20.193.4:0/1501008286 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bcc005500 con 0x7f7bdc115470 2026-02-24T09:14:28.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.702+0000 7f7bc37fe640 1 -- 10.20.193.4:0/1501008286 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7bcc005e10 con 0x7f7bdc115470 2026-02-24T09:14:28.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.702+0000 7f7be0e37640 1 -- 10.20.193.4:0/1501008286 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc0fb490 con 0x7f7bdc115470 2026-02-24T09:14:28.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.702+0000 7f7bc37fe640 1 -- 10.20.193.4:0/1501008286 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bcc003a90 con 0x7f7bdc115470 2026-02-24T09:14:28.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.702+0000 7f7be0e37640 1 -- 10.20.193.4:0/1501008286 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc0fb9b0 con 0x7f7bdc115470 2026-02-24T09:14:28.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.703+0000 7f7bc37fe640 1 -- 10.20.193.4:0/1501008286 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f7bcc00c840 con 0x7f7bdc115470 2026-02-24T09:14:28.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.704+0000 7f7bc37fe640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7bb40b5750 0x7f7bb40d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.704+0000 7f7bda575640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7bb40b5750 0x7f7bb40d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.704+0000 7f7bc37fe640 1 -- 10.20.193.4:0/1501008286 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f7bcc0e7950 con 0x7f7bdc115470 2026-02-24T09:14:28.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.704+0000 7f7bda575640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7bb40b5750 0x7f7bb40d5c00 secure :-1 s=READY pgs=360 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd0005970 tx=0x7f7bd0005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:28.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7be2e31e00 1 Processor -- start 2026-02-24T09:14:28.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7be2e31e00 1 -- start start 2026-02-24T09:14:28.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 0x564f408ac6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408acc10 0x564f408f1370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408f18b0 0x564f40911c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564f407bc520 con 0x564f408acc10 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564f407b8250 con 0x564f408f18b0 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564f407b23b0 con 0x564f408ac300 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bd9d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408acc10 0x564f408f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bd9d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408acc10 0x564f408f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42520/0 (socket says 10.20.193.4:42520) 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bd9d74640 1 -- 10.20.193.4:0/3788668499 learned_addr learned my addr 10.20.193.4:0/3788668499 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bda575640 1 --2- 10.20.193.4:0/3788668499 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 0x564f408ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bd9d74640 1 -- 10.20.193.4:0/3788668499 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 msgr2=0x564f408ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bd9d74640 1 --2- 10.20.193.4:0/3788668499 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 0x564f408ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bd9d74640 1 -- 10.20.193.4:0/3788668499 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408f18b0 msgr2=0x564f40911c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bd9d74640 1 --2- 10.20.193.4:0/3788668499 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408f18b0 0x564f40911c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bd9d74640 1 -- 10.20.193.4:0/3788668499 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4075d6e0 con 0x564f408acc10 2026-02-24T09:14:28.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bda575640 1 --2- 10.20.193.4:0/3788668499 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 0x564f408ac6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bd9d74640 1 --2- 10.20.193.4:0/3788668499 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408acc10 0x564f408f1370 secure :-1 s=READY pgs=847 gs=1 cs=0 l=1 c_cookie=8288843457205488692 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc4005ab0 tx=0x7f7bc4005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7307e335498dcc34 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bc0ff9640 1 -- 10.20.193.4:0/3788668499 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bc4038470 con 0x564f408acc10 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bc0ff9640 1 -- 10.20.193.4:0/3788668499 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7bc40385d0 con 0x564f408acc10 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.706+0000 7f7bc0ff9640 1 -- 10.20.193.4:0/3788668499 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bc4038920 con 0x564f408acc10 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.707+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3788668499 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408acc10 msgr2=0x564f408f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.707+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3788668499 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408acc10 0x564f408f1370 secure :-1 s=READY pgs=847 gs=1 cs=0 l=1 c_cookie=8288843457205488692 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc4005ab0 tx=0x7f7bc4005c30 comp rx=0 tx=0).stop 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.707+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3788668499 shutdown_connections 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.707+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3788668499 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408f18b0 0x564f40911c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.707+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3788668499 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408acc10 0x564f408f1370 unknown :-1 s=CLOSED pgs=847 gs=1 cs=0 l=1 c_cookie=8288843457205488692 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.707+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3788668499 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 0x564f408ac6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.707+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3788668499 >> 10.20.193.4:0/3788668499 conn(0x564f407ca4f0 msgr2=0x564f408aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:28.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.707+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3788668499 shutdown_connections 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.707+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3788668499 wait complete. 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.707+0000 7f7be2e31e00 1 -- start start 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7be2e31e00 1 Processor -- start 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 0x564f408c4290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408acc10 0x564f408c47d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408c97c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564f408c9d00 con 0x564f408f18b0 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564f408c9e70 con 0x564f408ac300 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564f408ca030 con 0x564f408acc10 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bdad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bdad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42534/0 (socket says 10.20.193.4:42534) 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bdad76640 1 -- 10.20.193.4:0/3934673976 learned_addr learned my addr 10.20.193.4:0/3934673976 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:28.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bda575640 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 0x564f408c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bdad76640 1 -- 10.20.193.4:0/3934673976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408acc10 msgr2=0x564f408c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bdad76640 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408acc10 0x564f408c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bdad76640 1 -- 10.20.193.4:0/3934673976 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 msgr2=0x564f408c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bdad76640 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 0x564f408c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bdad76640 1 -- 10.20.193.4:0/3934673976 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f40735cd0 con 0x564f408f18b0 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bda575640 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 0x564f408c4290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7bdad76640 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408c97c0 secure :-1 s=READY pgs=848 gs=1 cs=0 l=1 c_cookie=6989969637142702622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bcc0aa290 tx=0x7f7bcc0ade40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61015c59bca82a1e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7b8bfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3934673976 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bcc0b39e0 con 0x564f408f18b0 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3934673976 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7bcc0b5fc0 con 0x564f408f18b0 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3934673976 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bcc0aebb0 con 0x564f408f18b0 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3934673976 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc1766b0 con 0x564f408f18b0 2026-02-24T09:14:28.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3934673976 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f7bcc079230 con 0x564f408f18b0 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.708+0000 7f7b8bfff640 10 client.16830 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7be2e31e00 10 client.16830 _ll_register_callbacks cb 0x564f4072e790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3934673976 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f4043f9d0 con 0x564f408f18b0 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3934673976 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7bcc0793f0 con 0x564f408f18b0 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7be2e31e00 10 client.16830 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3934673976 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564f40747ab0 con 0x564f408f18b0 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3934673976 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f7bcc0b8970 con 0x564f408f18b0 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7be2e31e00 10 client.16830 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7be2e31e00 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7be2e31e00 20 client.16830 populate_metadata read hostname 'trial004' 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564f408eeae0 0x564f408eef80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7be2e31e00 4 client.16830 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3934673976 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f407c2b70 con 0x564f408eeae0 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.709+0000 7f7bda575640 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564f408eeae0 0x564f408eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7bda575640 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564f408eeae0 0x564f408eef80 crc :-1 s=READY pgs=117 gs=4 cs=0 l=0 c_cookie=13331134455242380934 s_cookie=4459650543399821905 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b901b427d9b15686 server_cookie=3de3dc8a7db96251 in_seq=0 out_seq=0 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7b8bfff640 10 client.16830 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3934673976 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564f407c2b70 con 0x564f408eeae0 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7b8bfff640 10 client.16830 handle_command_reply: tid=0 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7be2e31e00 1 client.16830 shutdown 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3934673976 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 msgr2=0x564f408c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408c97c0 secure :-1 s=READY pgs=848 gs=1 cs=0 l=1 c_cookie=6989969637142702622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bcc0aa290 tx=0x7f7bcc0ade40 comp rx=0 tx=0).stop 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3934673976 shutdown_connections 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564f408eeae0 0x564f408eef80 crc :-1 s=READY pgs=117 gs=4 cs=0 l=0 c_cookie=13331134455242380934 s_cookie=4459650543399821905 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408c97c0 unknown :-1 s=CLOSED pgs=848 gs=1 cs=0 l=1 c_cookie=6989969637142702622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408acc10 0x564f408c47d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3934673976 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 0x564f408c4290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7b8bfff640 0 client.16830 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:28.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.710+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3934673976 >> 10.20.193.4:0/3934673976 conn(0x564f407ca4f0 msgr2=0x564f408ab2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:28.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.711+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3934673976 shutdown_connections 2026-02-24T09:14:28.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.711+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3934673976 wait complete. 2026-02-24T09:14:28.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.711+0000 7f7be2e31e00 20 client.16830 trim_cache size 0 max 16384 2026-02-24T09:14:28.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7be2e31e00 1 Processor -- start 2026-02-24T09:14:28.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7be2e31e00 1 -- start start 2026-02-24T09:14:28.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 0x564f408e9b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408acc10 0x564f408ea0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408adff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564f407affe0 con 0x564f408f18b0 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564f4047afe0 con 0x564f408acc10 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564f408bd550 con 0x564f408ac300 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7bdad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7bdad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42548/0 (socket says 10.20.193.4:42548) 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7bdad76640 1 -- 10.20.193.4:0/120761372 learned_addr learned my addr 10.20.193.4:0/120761372 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7bda575640 1 --2- 10.20.193.4:0/120761372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 0x564f408e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.720+0000 7f7bd9d74640 1 --2- 10.20.193.4:0/120761372 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408acc10 0x564f408ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7bdad76640 1 -- 10.20.193.4:0/120761372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 msgr2=0x564f408e9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7bdad76640 1 --2- 10.20.193.4:0/120761372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 0x564f408e9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7bdad76640 1 -- 10.20.193.4:0/120761372 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408acc10 msgr2=0x564f408ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7bdad76640 1 --2- 10.20.193.4:0/120761372 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408acc10 0x564f408ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7bdad76640 1 -- 10.20.193.4:0/120761372 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f40742530 con 0x564f408f18b0 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7bdad76640 1 --2- 10.20.193.4:0/120761372 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408adff0 secure :-1 s=READY pgs=849 gs=1 cs=0 l=1 c_cookie=4691622644691927234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bcc0aff50 tx=0x7f7bcc0e5020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411bfdf0250a80c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7ba64e6640 1 -- 10.20.193.4:0/120761372 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bcc005c70 con 0x564f408f18b0 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7ba64e6640 1 -- 10.20.193.4:0/120761372 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x564f4043f9d0 con 0x564f408f18b0 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7ba64e6640 1 -- 10.20.193.4:0/120761372 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bcc0b8970 con 0x564f408f18b0 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7be2e31e00 1 -- 10.20.193.4:0/120761372 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 msgr2=0x564f408adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/120761372 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408adff0 secure :-1 s=READY pgs=849 gs=1 cs=0 l=1 c_cookie=4691622644691927234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bcc0aff50 tx=0x7f7bcc0e5020 comp rx=0 tx=0).stop 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7be2e31e00 1 -- 10.20.193.4:0/120761372 shutdown_connections 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/120761372 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f408adff0 unknown :-1 s=CLOSED pgs=849 gs=1 cs=0 l=1 c_cookie=4691622644691927234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/120761372 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408acc10 0x564f408ea0d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/120761372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408ac300 0x564f408e9b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7be2e31e00 1 -- 10.20.193.4:0/120761372 >> 10.20.193.4:0/120761372 conn(0x564f407ca4f0 msgr2=0x564f408e9480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7be2e31e00 1 -- 10.20.193.4:0/120761372 shutdown_connections 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.721+0000 7f7be2e31e00 1 -- 10.20.193.4:0/120761372 wait complete. 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 -- start start 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 Processor -- start 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 0x564f408ce040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408acc10 0x564f408ce580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f40956de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564f40887650 con 0x564f408f18b0 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564f408cee60 con 0x564f408ac300 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564f40957320 con 0x564f408acc10 2026-02-24T09:14:28.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bdad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f40956de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bdad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f40956de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42560/0 (socket says 10.20.193.4:42560) 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bdad76640 1 -- 10.20.193.4:0/3957213311 learned_addr learned my addr 10.20.193.4:0/3957213311 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bda575640 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 0x564f408ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bd9d74640 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408acc10 0x564f408ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bdad76640 1 -- 10.20.193.4:0/3957213311 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408acc10 msgr2=0x564f408ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bdad76640 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408acc10 0x564f408ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bdad76640 1 -- 10.20.193.4:0/3957213311 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 msgr2=0x564f408ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bdad76640 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 0x564f408ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bdad76640 1 -- 10.20.193.4:0/3957213311 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f40736000 con 0x564f408f18b0 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bd9d74640 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408acc10 0x564f408ce580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7bdad76640 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f40956de0 secure :-1 s=READY pgs=850 gs=1 cs=0 l=1 c_cookie=7929736352652391134 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bcc00c630 tx=0x7f7bcc0b8b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0c1532fe58f2de server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7b8bfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:28.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3957213311 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bcc005c70 con 0x564f408f18b0 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3957213311 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7bcc0b8e00 con 0x564f408f18b0 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3957213311 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f40747ab0 con 0x564f408f18b0 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3957213311 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bcc0ad860 con 0x564f408f18b0 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 10 client.16836 _ll_register_callbacks cb 0x564f4072e790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3957213311 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f407c47e0 con 0x564f408f18b0 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3957213311 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f7bcc0ad9f0 con 0x564f408f18b0 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3957213311 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7bcc072dc0 con 0x564f408f18b0 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 10 client.16836 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.722+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3957213311 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564f40747d10 con 0x564f408f18b0 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.723+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3957213311 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f7bcc073d20 con 0x564f408f18b0 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.723+0000 7f7be2e31e00 10 client.16836 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:28.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.723+0000 7f7be2e31e00 10 client.16836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.723+0000 7f7be2e31e00 20 client.16836 populate_metadata read hostname 'trial004' 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.723+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564f4099eac0 0x564f409bef40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.723+0000 7f7be2e31e00 4 client.16836 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.723+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3957213311 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564f4043d220 con 0x564f4099eac0 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.723+0000 7f7bda575640 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564f4099eac0 0x564f409bef40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.723+0000 7f7bda575640 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564f4099eac0 0x564f409bef40 crc :-1 s=READY pgs=118 gs=4 cs=0 l=0 c_cookie=1062298317471873776 s_cookie=3805507598727938515 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebe0ab10267faf0 server_cookie=34cfe0ffa43a81d3 in_seq=0 out_seq=0 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.723+0000 7f7b8bfff640 10 client.16836 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7b8bfff640 1 -- 10.20.193.4:0/3957213311 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564f4043d220 con 0x564f4099eac0 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7b8bfff640 10 client.16836 handle_command_reply: tid=0 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 client.16836 shutdown 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3957213311 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 msgr2=0x564f40956de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f40956de0 secure :-1 s=READY pgs=850 gs=1 cs=0 l=1 c_cookie=7929736352652391134 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bcc00c630 tx=0x7f7bcc0b8b80 comp rx=0 tx=0).stop 2026-02-24T09:14:28.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3957213311 shutdown_connections 2026-02-24T09:14:28.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564f4099eac0 0x564f409bef40 crc :-1 s=READY pgs=118 gs=4 cs=0 l=0 c_cookie=1062298317471873776 s_cookie=3805507598727938515 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564f408f18b0 0x564f40956de0 unknown :-1 s=CLOSED pgs=850 gs=1 cs=0 l=1 c_cookie=7929736352652391134 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564f408acc10 0x564f408ce580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 --2- 10.20.193.4:0/3957213311 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564f408ac300 0x564f408ce040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7b8bfff640 0 client.16836 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:28.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3957213311 >> 10.20.193.4:0/3957213311 conn(0x564f407ca4f0 msgr2=0x564f408e9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:28.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3957213311 shutdown_connections 2026-02-24T09:14:28.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 1 -- 10.20.193.4:0/3957213311 wait complete. 2026-02-24T09:14:28.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be2e31e00 20 client.16836 trim_cache size 0 max 16384 2026-02-24T09:14:28.738 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:14:28.738 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:14:28.738 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf", 2026-02-24T09:14:28.738 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:14:28.738 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:14:28.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be0e37640 1 -- 10.20.193.4:0/1501008286 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7bb40b5750 msgr2=0x7f7bb40d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be0e37640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7bb40b5750 0x7f7bb40d5c00 secure :-1 s=READY pgs=360 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd0005970 tx=0x7f7bd0005900 comp rx=0 tx=0).stop 2026-02-24T09:14:28.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be0e37640 1 -- 10.20.193.4:0/1501008286 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7bdc115470 msgr2=0x7f7bdc0f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.724+0000 7f7be0e37640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7bdc115470 0x7f7bdc0f5cc0 secure :-1 s=READY pgs=846 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bcc006e90 tx=0x7f7bcc00edf0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.725+0000 7f7be0e37640 1 -- 10.20.193.4:0/1501008286 shutdown_connections 2026-02-24T09:14:28.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.725+0000 7f7be0e37640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7bb40b5750 0x7f7bb40d5c00 unknown :-1 s=CLOSED pgs=360 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.725+0000 7f7be0e37640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7bdc115470 0x7f7bdc0f5cc0 unknown :-1 s=CLOSED pgs=846 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.725+0000 7f7be0e37640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7bdc10fc70 0x7f7bdc175d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.725+0000 7f7be0e37640 1 --2- 10.20.193.4:0/1501008286 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7bdc10f280 0x7f7bdc0f55c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.725+0000 7f7be0e37640 1 -- 10.20.193.4:0/1501008286 >> 10.20.193.4:0/1501008286 conn(0x7f7bdc05f830 msgr2=0x7f7bdc112ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:28.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.725+0000 7f7be0e37640 1 -- 10.20.193.4:0/1501008286 shutdown_connections 2026-02-24T09:14:28.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.725+0000 7f7be0e37640 1 -- 10.20.193.4:0/1501008286 wait complete. 2026-02-24T09:14:28.763 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:14:28.878 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.983+0000 7fa146e95640 1 -- 10.20.193.4:0/4275935042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa140110040 msgr2=0x7fa140115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.983+0000 7fa146e95640 1 --2- 10.20.193.4:0/4275935042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa140110040 0x7fa140115090 secure :-1 s=READY pgs=851 gs=1 cs=0 l=1 c_cookie=5910801543961244061 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa128009950 tx=0x7fa12802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.983+0000 7fa146e95640 1 -- 10.20.193.4:0/4275935042 shutdown_connections 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.983+0000 7fa146e95640 1 --2- 10.20.193.4:0/4275935042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa140115840 0x7fa140176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.983+0000 7fa146e95640 1 --2- 10.20.193.4:0/4275935042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa140110040 0x7fa140115090 unknown :-1 s=CLOSED pgs=851 gs=1 cs=0 l=1 c_cookie=5910801543961244061 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.983+0000 7fa146e95640 1 --2- 10.20.193.4:0/4275935042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa14010f650 0x7fa14010fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.983+0000 7fa146e95640 1 -- 10.20.193.4:0/4275935042 >> 10.20.193.4:0/4275935042 conn(0x7fa1400ecf20 msgr2=0x7fa14010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.983+0000 7fa146e95640 1 -- 10.20.193.4:0/4275935042 shutdown_connections 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.983+0000 7fa146e95640 1 -- 10.20.193.4:0/4275935042 wait complete. 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa146e95640 1 Processor -- start 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa146e95640 1 -- start start 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa146e95640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa14010f650 0x7fa1400f5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa146e95640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa140110040 0x7fa140176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa146e95640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa140115840 0x7fa1400f5f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa146e95640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fa1400fb1a0 con 0x7fa14010f650 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa146e95640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fa1400fb310 con 0x7fa140115840 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa146e95640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1400fb4d0 con 0x7fa140110040 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa144c0a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa14010f650 0x7fa1400f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa144c0a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa14010f650 0x7fa1400f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42580/0 (socket says 10.20.193.4:42580) 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa144c0a640 1 -- 10.20.193.4:0/1635014825 learned_addr learned my addr 10.20.193.4:0/1635014825 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa137fff640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa140110040 0x7fa140176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa14540b640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa140115840 0x7fa1400f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa144c0a640 1 -- 10.20.193.4:0/1635014825 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa140110040 msgr2=0x7fa140176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa144c0a640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa140110040 0x7fa140176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa144c0a640 1 -- 10.20.193.4:0/1635014825 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa140115840 msgr2=0x7fa1400f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa144c0a640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa140115840 0x7fa1400f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa144c0a640 1 -- 10.20.193.4:0/1635014825 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa128009570 con 0x7fa14010f650 2026-02-24T09:14:28.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa144c0a640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa14010f650 0x7fa1400f5890 secure :-1 s=READY pgs=852 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa130009480 tx=0x7fa13000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:28.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa135ffb640 1 -- 10.20.193.4:0/1635014825 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa13000cd40 con 0x7fa14010f650 2026-02-24T09:14:28.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa146e95640 1 -- 10.20.193.4:0/1635014825 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1400fb7b0 con 0x7fa14010f650 2026-02-24T09:14:28.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa135ffb640 1 -- 10.20.193.4:0/1635014825 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa130004d30 con 0x7fa14010f650 2026-02-24T09:14:28.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa135ffb640 1 -- 10.20.193.4:0/1635014825 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1300106b0 con 0x7fa14010f650 2026-02-24T09:14:28.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.984+0000 7fa146e95640 1 -- 10.20.193.4:0/1635014825 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1400fbcd0 con 0x7fa14010f650 2026-02-24T09:14:28.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.986+0000 7fa135ffb640 1 -- 10.20.193.4:0/1635014825 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fa13001f060 con 0x7fa14010f650 2026-02-24T09:14:28.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.987+0000 7fa135ffb640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa11c0b5750 0x7fa11c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.987+0000 7fa137fff640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa11c0b5750 0x7fa11c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.987+0000 7fa135ffb640 1 -- 10.20.193.4:0/1635014825 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa130014070 con 0x7fa14010f650 2026-02-24T09:14:28.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.987+0000 7fa137fff640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa11c0b5750 0x7fa11c0d5c00 secure :-1 s=READY pgs=361 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1280023d0 tx=0x7fa128031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:28.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa148e8fe00 1 Processor -- start 2026-02-24T09:14:28.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa148e8fe00 1 -- start start 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea68bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 0x5637feaad890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637feaaddd0 0x5637feace1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5637fe978de0 con 0x5637fea68820 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5637fe974b10 con 0x5637feaaddd0 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5637fe96eab0 con 0x5637fea69130 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa144c0a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea68bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa144c0a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea68bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42586/0 (socket says 10.20.193.4:42586) 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa144c0a640 1 -- 10.20.193.4:0/536700028 learned_addr learned my addr 10.20.193.4:0/536700028 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa14540b640 1 --2- 10.20.193.4:0/536700028 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637feaaddd0 0x5637feace1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa137fff640 1 --2- 10.20.193.4:0/536700028 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 0x5637feaad890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa144c0a640 1 -- 10.20.193.4:0/536700028 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 msgr2=0x5637feaad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa144c0a640 1 --2- 10.20.193.4:0/536700028 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 0x5637feaad890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa144c0a640 1 -- 10.20.193.4:0/536700028 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637feaaddd0 msgr2=0x5637feace1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa144c0a640 1 --2- 10.20.193.4:0/536700028 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637feaaddd0 0x5637feace1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.988+0000 7fa144c0a640 1 -- 10.20.193.4:0/536700028 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637fe91a310 con 0x5637fea68820 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa144c0a640 1 --2- 10.20.193.4:0/536700028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea68bf0 secure :-1 s=READY pgs=853 gs=1 cs=0 l=1 c_cookie=2335005950475974765 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1300e4980 tx=0x7fa1300aa050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20679b8a628b386d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa10d4e4640 1 -- 10.20.193.4:0/536700028 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1300b5460 con 0x5637fea68820 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa10d4e4640 1 -- 10.20.193.4:0/536700028 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa1300b82a0 con 0x5637fea68820 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa10d4e4640 1 -- 10.20.193.4:0/536700028 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1300b8090 con 0x5637fea68820 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa148e8fe00 1 -- 10.20.193.4:0/536700028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 msgr2=0x5637fea68bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/536700028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea68bf0 secure :-1 s=READY pgs=853 gs=1 cs=0 l=1 c_cookie=2335005950475974765 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1300e4980 tx=0x7fa1300aa050 comp rx=0 tx=0).stop 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa148e8fe00 1 -- 10.20.193.4:0/536700028 shutdown_connections 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/536700028 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637feaaddd0 0x5637feace1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/536700028 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 0x5637feaad890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/536700028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea68bf0 unknown :-1 s=CLOSED pgs=853 gs=1 cs=0 l=1 c_cookie=2335005950475974765 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa148e8fe00 1 -- 10.20.193.4:0/536700028 >> 10.20.193.4:0/536700028 conn(0x5637fe9876b0 msgr2=0x5637fea67100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa148e8fe00 1 -- 10.20.193.4:0/536700028 shutdown_connections 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.989+0000 7fa148e8fe00 1 -- 10.20.193.4:0/536700028 wait complete. 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa148e8fe00 1 -- start start 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa148e8fe00 1 Processor -- start 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea68820 0x5637fea80e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637fea69130 0x5637fea813c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637fea863b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5637fea868f0 con 0x5637feaaddd0 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5637fea86a60 con 0x5637fea69130 2026-02-24T09:14:28.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5637fea86c20 con 0x5637fea68820 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa14540b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637fea863b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa14540b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637fea863b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42600/0 (socket says 10.20.193.4:42600) 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa14540b640 1 -- 10.20.193.4:0/3867611058 learned_addr learned my addr 10.20.193.4:0/3867611058 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa137fff640 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637fea69130 0x5637fea813c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa14540b640 1 -- 10.20.193.4:0/3867611058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea68820 msgr2=0x5637fea80e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa14540b640 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea68820 0x5637fea80e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa14540b640 1 -- 10.20.193.4:0/3867611058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637fea69130 msgr2=0x5637fea813c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa14540b640 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637fea69130 0x5637fea813c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa14540b640 1 -- 10.20.193.4:0/3867611058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637fe8f28c0 con 0x5637feaaddd0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa14540b640 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637fea863b0 secure :-1 s=READY pgs=854 gs=1 cs=0 l=1 c_cookie=11055032120747819767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa13c011670 tx=0x7fa13c011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996b5d2449b502f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa0fe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/3867611058 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa13c00faf0 con 0x5637feaaddd0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa148e8fe00 1 -- 10.20.193.4:0/3867611058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1400fbcd0 con 0x5637feaaddd0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.990+0000 7fa148e8fe00 10 client.16848 _ll_register_callbacks cb 0x5637fe90a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa148e8fe00 1 -- 10.20.193.4:0/3867611058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637fe6be4a0 con 0x5637feaaddd0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/3867611058 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa13c011e90 con 0x5637feaaddd0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/3867611058 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa13c013450 con 0x5637feaaddd0 2026-02-24T09:14:28.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/3867611058 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa13c0135e0 con 0x5637feaaddd0 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/3867611058 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa13c013820 con 0x5637feaaddd0 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa148e8fe00 10 client.16848 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa148e8fe00 1 -- 10.20.193.4:0/3867611058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5637fe9046e0 con 0x5637feaaddd0 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/3867611058 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa13c00fc50 con 0x5637feaaddd0 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa148e8fe00 10 client.16848 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa148e8fe00 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa148e8fe00 20 client.16848 populate_metadata read hostname 'trial004' 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5637feaab730 0x5637feaabbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa148e8fe00 4 client.16848 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa148e8fe00 1 -- 10.20.193.4:0/3867611058 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637fe9644f0 con 0x5637feaab730 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa144c0a640 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5637feaab730 0x5637feaabbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa0fe7fc640 10 client.16848 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.991+0000 7fa144c0a640 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5637feaab730 0x5637feaabbd0 crc :-1 s=READY pgs=119 gs=4 cs=0 l=0 c_cookie=14387868657022707821 s_cookie=14461807170639050843 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7abfa5038d0a86d server_cookie=c8b2a8fff023385b in_seq=0 out_seq=0 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/3867611058 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5637fe9644f0 con 0x5637feaab730 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa0fe7fc640 10 client.16848 handle_command_reply: tid=0 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 client.16848 shutdown 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 -- 10.20.193.4:0/3867611058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 msgr2=0x5637fea863b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637fea863b0 secure :-1 s=READY pgs=854 gs=1 cs=0 l=1 c_cookie=11055032120747819767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa13c011670 tx=0x7fa13c011b40 comp rx=0 tx=0).stop 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 -- 10.20.193.4:0/3867611058 shutdown_connections 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5637feaab730 0x5637feaabbd0 crc :-1 s=READY pgs=119 gs=4 cs=0 l=0 c_cookie=14387868657022707821 s_cookie=14461807170639050843 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637fea863b0 unknown :-1 s=CLOSED pgs=854 gs=1 cs=0 l=1 c_cookie=11055032120747819767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637fea69130 0x5637fea813c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/3867611058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea68820 0x5637fea80e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:28.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa0fe7fc640 0 client.16848 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:28.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 -- 10.20.193.4:0/3867611058 >> 10.20.193.4:0/3867611058 conn(0x5637fe9876b0 msgr2=0x5637fea67810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:28.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 -- 10.20.193.4:0/3867611058 shutdown_connections 2026-02-24T09:14:28.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 1 -- 10.20.193.4:0/3867611058 wait complete. 2026-02-24T09:14:28.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:28.992+0000 7fa148e8fe00 20 client.16848 trim_cache size 0 max 16384 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.000+0000 7fa148e8fe00 1 Processor -- start 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.000+0000 7fa148e8fe00 1 -- start start 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637fea68820 0x5637fea7e480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 0x5637fea85920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637feaad2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5637fe96c6e0 con 0x5637feaaddd0 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5637fe637f50 con 0x5637fea68820 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5637fe9db150 con 0x5637fea69130 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa14540b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637feaad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa14540b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637feaad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42612/0 (socket says 10.20.193.4:42612) 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa14540b640 1 -- 10.20.193.4:0/337402476 learned_addr learned my addr 10.20.193.4:0/337402476 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa144c0a640 1 --2- 10.20.193.4:0/337402476 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637fea68820 0x5637fea7e480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa14540b640 1 -- 10.20.193.4:0/337402476 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 msgr2=0x5637fea85920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa14540b640 1 --2- 10.20.193.4:0/337402476 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 0x5637fea85920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa14540b640 1 -- 10.20.193.4:0/337402476 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637fea68820 msgr2=0x5637fea7e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa14540b640 1 --2- 10.20.193.4:0/337402476 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637fea68820 0x5637fea7e480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa14540b640 1 -- 10.20.193.4:0/337402476 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637fe8ff160 con 0x5637feaaddd0 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa14540b640 1 --2- 10.20.193.4:0/337402476 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637feaad2a0 secure :-1 s=READY pgs=855 gs=1 cs=0 l=1 c_cookie=3151251268179637178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa13c012d60 tx=0x7fa13c004fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbb7e5515d8b3ba server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa10cce3640 1 -- 10.20.193.4:0/337402476 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa13c013450 con 0x5637feaaddd0 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa10cce3640 1 -- 10.20.193.4:0/337402476 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5637fe6be4a0 con 0x5637feaaddd0 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa10cce3640 1 -- 10.20.193.4:0/337402476 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa13c01a360 con 0x5637feaaddd0 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 -- 10.20.193.4:0/337402476 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 msgr2=0x5637feaad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/337402476 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637feaad2a0 secure :-1 s=READY pgs=855 gs=1 cs=0 l=1 c_cookie=3151251268179637178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa13c012d60 tx=0x7fa13c004fd0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 -- 10.20.193.4:0/337402476 shutdown_connections 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/337402476 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637feaaddd0 0x5637feaad2a0 unknown :-1 s=CLOSED pgs=855 gs=1 cs=0 l=1 c_cookie=3151251268179637178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/337402476 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 0x5637fea85920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/337402476 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637fea68820 0x5637fea7e480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 -- 10.20.193.4:0/337402476 >> 10.20.193.4:0/337402476 conn(0x5637fe9876b0 msgr2=0x5637fea85210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 -- 10.20.193.4:0/337402476 shutdown_connections 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.001+0000 7fa148e8fe00 1 -- 10.20.193.4:0/337402476 wait complete. 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa148e8fe00 1 -- start start 2026-02-24T09:14:29.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa148e8fe00 1 Processor -- start 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea87620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 0x5637fea87b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa148e8fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637feaaddd0 0x5637fea8b600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5637fea8bb40 con 0x5637fea68820 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5637fea8bcb0 con 0x5637feaaddd0 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa148e8fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5637fea8be70 con 0x5637fea69130 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa144c0a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea87620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa144c0a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea87620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42626/0 (socket says 10.20.193.4:42626) 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa144c0a640 1 -- 10.20.193.4:0/1738077395 learned_addr learned my addr 10.20.193.4:0/1738077395 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa14540b640 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637feaaddd0 0x5637fea8b600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa144c0a640 1 -- 10.20.193.4:0/1738077395 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 msgr2=0x5637fea87b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa144c0a640 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 0x5637fea87b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa144c0a640 1 -- 10.20.193.4:0/1738077395 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637feaaddd0 msgr2=0x5637fea8b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa144c0a640 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637feaaddd0 0x5637fea8b600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa144c0a640 1 -- 10.20.193.4:0/1738077395 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637fe8f2bf0 con 0x5637fea68820 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa144c0a640 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea87620 secure :-1 s=READY pgs=856 gs=1 cs=0 l=1 c_cookie=3171997359517155362 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1300ab420 tx=0x7fa130017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0532cae27f4022 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:29.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa0fe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/1738077395 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1300734f0 con 0x5637fea68820 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.002+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/1738077395 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa1300b7e10 con 0x5637fea68820 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/1738077395 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1300aedf0 con 0x5637fea68820 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 1 -- 10.20.193.4:0/1738077395 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637fe9046e0 con 0x5637fea68820 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/1738077395 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa130016c20 con 0x5637fea68820 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 10 client.16854 _ll_register_callbacks cb 0x5637fe90a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 1 -- 10.20.193.4:0/1738077395 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637fe5f9f40 con 0x5637fea68820 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/1738077395 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa1300169f0 con 0x5637fea68820 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 10 client.16854 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 1 -- 10.20.193.4:0/1738077395 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5637fe904940 con 0x5637fea68820 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/1738077395 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fa130004770 con 0x5637fea68820 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 10 client.16854 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 10 client.16854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 20 client.16854 populate_metadata read hostname 'trial004' 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5637feb5b9d0 0x5637feb7be80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 4 client.16854 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa148e8fe00 1 -- 10.20.193.4:0/1738077395 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa1300b82a0 con 0x5637feb5b9d0 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.003+0000 7fa137fff640 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5637feb5b9d0 0x5637feb7be80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa0fe7fc640 10 client.16854 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa137fff640 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5637feb5b9d0 0x5637feb7be80 crc :-1 s=READY pgs=120 gs=4 cs=0 l=0 c_cookie=4175594636872847483 s_cookie=12914527602999106681 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39f2b132f0d5107b server_cookie=b3399e6e4abd1c79 in_seq=0 out_seq=0 2026-02-24T09:14:29.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa0fe7fc640 1 -- 10.20.193.4:0/1738077395 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x7fa1300b82a0 con 0x5637feb5b9d0 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa0fe7fc640 10 client.16854 handle_command_reply: tid=0 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 client.16854 shutdown 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 -- 10.20.193.4:0/1738077395 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 msgr2=0x5637fea87620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea87620 secure :-1 s=READY pgs=856 gs=1 cs=0 l=1 c_cookie=3171997359517155362 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1300ab420 tx=0x7fa130017000 comp rx=0 tx=0).stop 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 -- 10.20.193.4:0/1738077395 shutdown_connections 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5637feb5b9d0 0x5637feb7be80 crc :-1 s=READY pgs=120 gs=4 cs=0 l=0 c_cookie=4175594636872847483 s_cookie=12914527602999106681 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5637feaaddd0 0x5637fea8b600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5637fea69130 0x5637fea87b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa0fe7fc640 0 client.16854 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 --2- 10.20.193.4:0/1738077395 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5637fea68820 0x5637fea87620 unknown :-1 s=CLOSED pgs=856 gs=1 cs=0 l=1 c_cookie=3171997359517155362 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 -- 10.20.193.4:0/1738077395 >> 10.20.193.4:0/1738077395 conn(0x5637fe9876b0 msgr2=0x5637fea671f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 -- 10.20.193.4:0/1738077395 shutdown_connections 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 1 -- 10.20.193.4:0/1738077395 wait complete. 2026-02-24T09:14:29.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa148e8fe00 20 client.16854 trim_cache size 0 max 16384 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf", 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:14:29.009 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:29.010 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:29.011 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:29.012 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:29.013 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa146e95640 1 -- 10.20.193.4:0/1635014825 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa11c0b5750 msgr2=0x7fa11c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa146e95640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa11c0b5750 0x7fa11c0d5c00 secure :-1 s=READY pgs=361 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1280023d0 tx=0x7fa128031040 comp rx=0 tx=0).stop 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa146e95640 1 -- 10.20.193.4:0/1635014825 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa14010f650 msgr2=0x7fa1400f5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.004+0000 7fa146e95640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa14010f650 0x7fa1400f5890 secure :-1 s=READY pgs=852 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa130009480 tx=0x7fa13000ee60 comp rx=0 tx=0).stop 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.005+0000 7fa146e95640 1 -- 10.20.193.4:0/1635014825 shutdown_connections 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.005+0000 7fa146e95640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa11c0b5750 0x7fa11c0d5c00 unknown :-1 s=CLOSED pgs=361 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.005+0000 7fa146e95640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa140115840 0x7fa1400f5f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.005+0000 7fa146e95640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa140110040 0x7fa140176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.005+0000 7fa146e95640 1 --2- 10.20.193.4:0/1635014825 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa14010f650 0x7fa1400f5890 unknown :-1 s=CLOSED pgs=852 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.005+0000 7fa146e95640 1 -- 10.20.193.4:0/1635014825 >> 10.20.193.4:0/1635014825 conn(0x7fa1400ecf20 msgr2=0x7fa140111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.005+0000 7fa146e95640 1 -- 10.20.193.4:0/1635014825 shutdown_connections 2026-02-24T09:14:29.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:29.005+0000 7fa146e95640 1 -- 10.20.193.4:0/1635014825 wait complete. 2026-02-24T09:14:29.015 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:28 trial004 ceph-mon[41596]: pgmap v292: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 753 MiB/s wr, 205 op/s 2026-02-24T09:14:29.045 INFO:tasks.cephfs.filesystem:scrub status for tag:5b1b5ffd-dbda-4049-9d28-adbb3bc41adf - {'path': '/', 'tag': '5b1b5ffd-dbda-4049-9d28-adbb3bc41adf', 'options': 'recursive,force'} 2026-02-24T09:14:29.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:28 trial090 ceph-mon[47278]: pgmap v292: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 753 MiB/s wr, 205 op/s 2026-02-24T09:14:29.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:28 trial014 ceph-mon[46941]: pgmap v292: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 753 MiB/s wr, 205 op/s 2026-02-24T09:14:30.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:29 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:14:30.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:29 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:14:30.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:29 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:14:30.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:29 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:14:30.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:29 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:14:30.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:29 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:14:30.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:29 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:14:30.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:29 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:14:30.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:29 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:14:30.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:29 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:14:30.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:29 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:14:30.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:29 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:14:31.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:30 trial090 ceph-mon[47278]: pgmap v293: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 494 MiB/s wr, 138 op/s 2026-02-24T09:14:31.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:30 trial014 ceph-mon[46941]: pgmap v293: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 494 MiB/s wr, 138 op/s 2026-02-24T09:14:31.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:30 trial004 ceph-mon[41596]: pgmap v293: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 494 MiB/s wr, 138 op/s 2026-02-24T09:14:33.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:32 trial014 ceph-mon[46941]: pgmap v294: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 302 MiB/s wr, 89 op/s 2026-02-24T09:14:33.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:32 trial004 ceph-mon[41596]: pgmap v294: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 302 MiB/s wr, 89 op/s 2026-02-24T09:14:33.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:32 trial090 ceph-mon[47278]: pgmap v294: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 302 MiB/s wr, 89 op/s 2026-02-24T09:14:35.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:34 trial014 ceph-mon[46941]: pgmap v295: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 72 MiB/s wr, 27 op/s 2026-02-24T09:14:35.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:34 trial004 ceph-mon[41596]: pgmap v295: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 72 MiB/s wr, 27 op/s 2026-02-24T09:14:35.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:34 trial090 ceph-mon[47278]: pgmap v295: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 72 MiB/s wr, 27 op/s 2026-02-24T09:14:37.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:36 trial014 ceph-mon[46941]: pgmap v296: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 1.7 MiB/s wr, 6 op/s 2026-02-24T09:14:37.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:36 trial004 ceph-mon[41596]: pgmap v296: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 1.7 MiB/s wr, 6 op/s 2026-02-24T09:14:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:36 trial090 ceph-mon[47278]: pgmap v296: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 1.7 MiB/s wr, 6 op/s 2026-02-24T09:14:39.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:38 trial014 ceph-mon[46941]: pgmap v297: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-24T09:14:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:38 trial004 ceph-mon[41596]: pgmap v297: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-24T09:14:39.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:38 trial090 ceph-mon[47278]: pgmap v297: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-24T09:14:41.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:40 trial014 ceph-mon[46941]: pgmap v298: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-24T09:14:41.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:40 trial090 ceph-mon[47278]: pgmap v298: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-24T09:14:41.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:40 trial004 ceph-mon[41596]: pgmap v298: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2026-02-24T09:14:41.813 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:14:41.935 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:42.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 -- 10.20.193.4:0/837184927 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd070115470 msgr2=0x7fd070175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 --2- 10.20.193.4:0/837184927 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd070115470 0x7fd070175e40 secure :-1 s=READY pgs=857 gs=1 cs=0 l=1 c_cookie=16502844599458933458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd06000aa30 tx=0x7fd060030280 comp rx=0 tx=0).stop 2026-02-24T09:14:42.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 -- 10.20.193.4:0/837184927 shutdown_connections 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 --2- 10.20.193.4:0/837184927 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd070115470 0x7fd070175e40 unknown :-1 s=CLOSED pgs=857 gs=1 cs=0 l=1 c_cookie=16502844599458933458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 --2- 10.20.193.4:0/837184927 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd07010fc70 0x7fd070114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 --2- 10.20.193.4:0/837184927 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd07010f280 0x7fd07010f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 -- 10.20.193.4:0/837184927 >> 10.20.193.4:0/837184927 conn(0x7fd07005f830 msgr2=0x7fd07010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 -- 10.20.193.4:0/837184927 shutdown_connections 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 -- 10.20.193.4:0/837184927 wait complete. 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 Processor -- start 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 -- start start 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd07010f280 0x7fd0700f5510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd07010fc70 0x7fd070175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd070115470 0x7fd0700f5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd0700fae20 con 0x7fd070115470 2026-02-24T09:14:42.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd0700faf90 con 0x7fd07010f280 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd075548640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0700fb150 con 0x7fd07010fc70 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd06f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd070115470 0x7fd0700f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd06f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd070115470 0x7fd0700f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:37718/0 (socket says 10.20.193.4:37718) 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd06f7fe640 1 -- 10.20.193.4:0/3799736098 learned_addr learned my addr 10.20.193.4:0/3799736098 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd06effd640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd07010f280 0x7fd0700f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.042+0000 7fd06e7fc640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd07010fc70 0x7fd070175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd06f7fe640 1 -- 10.20.193.4:0/3799736098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd07010fc70 msgr2=0x7fd070175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd06f7fe640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd07010fc70 0x7fd070175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd06f7fe640 1 -- 10.20.193.4:0/3799736098 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd07010f280 msgr2=0x7fd0700f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd06f7fe640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd07010f280 0x7fd0700f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd06f7fe640 1 -- 10.20.193.4:0/3799736098 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06000a650 con 0x7fd070115470 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd06f7fe640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd070115470 0x7fd0700f5c10 secure :-1 s=READY pgs=858 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd06000a330 tx=0x7fd0600039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd04ffff640 1 -- 10.20.193.4:0/3799736098 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd06003e070 con 0x7fd070115470 2026-02-24T09:14:42.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd04ffff640 1 -- 10.20.193.4:0/3799736098 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0600055a0 con 0x7fd070115470 2026-02-24T09:14:42.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd04ffff640 1 -- 10.20.193.4:0/3799736098 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd060042a70 con 0x7fd070115470 2026-02-24T09:14:42.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd075548640 1 -- 10.20.193.4:0/3799736098 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0700fb3d0 con 0x7fd070115470 2026-02-24T09:14:42.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd075548640 1 -- 10.20.193.4:0/3799736098 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0700fb870 con 0x7fd070115470 2026-02-24T09:14:42.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.043+0000 7fd075548640 1 -- 10.20.193.4:0/3799736098 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd070110560 con 0x7fd070115470 2026-02-24T09:14:42.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.045+0000 7fd04ffff640 1 -- 10.20.193.4:0/3799736098 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fd0600050c0 con 0x7fd070115470 2026-02-24T09:14:42.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.045+0000 7fd04ffff640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0440b5750 0x7fd0440d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.045+0000 7fd06effd640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0440b5750 0x7fd0440d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.045+0000 7fd04ffff640 1 -- 10.20.193.4:0/3799736098 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd06010d4a0 con 0x7fd070115470 2026-02-24T09:14:42.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.046+0000 7fd06effd640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0440b5750 0x7fd0440d5c00 secure :-1 s=READY pgs=362 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd064004740 tx=0x7fd064004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:42.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.046+0000 7fd04ffff640 1 -- 10.20.193.4:0/3799736098 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fd0600cfe20 con 0x7fd070115470 2026-02-24T09:14:42.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.181+0000 7fd075548640 1 -- 10.20.193.4:0/3799736098 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0700fba90 con 0x7fd070115470 2026-02-24T09:14:42.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.181+0000 7fd04ffff640 1 -- 10.20.193.4:0/3799736098 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fd0600d2fd0 con 0x7fd070115470 2026-02-24T09:14:42.185 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:14:42.185 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:14:42.185 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:14:42.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 -- 10.20.193.4:0/3799736098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0440b5750 msgr2=0x7fd0440d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0440b5750 0x7fd0440d5c00 secure :-1 s=READY pgs=362 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd064004740 tx=0x7fd064004420 comp rx=0 tx=0).stop 2026-02-24T09:14:42.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 -- 10.20.193.4:0/3799736098 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd070115470 msgr2=0x7fd0700f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd070115470 0x7fd0700f5c10 secure :-1 s=READY pgs=858 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd06000a330 tx=0x7fd0600039b0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 -- 10.20.193.4:0/3799736098 shutdown_connections 2026-02-24T09:14:42.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd0440b5750 0x7fd0440d5c00 unknown :-1 s=CLOSED pgs=362 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd070115470 0x7fd0700f5c10 unknown :-1 s=CLOSED pgs=858 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd07010fc70 0x7fd070175d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 --2- 10.20.193.4:0/3799736098 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd07010f280 0x7fd0700f5510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 -- 10.20.193.4:0/3799736098 >> 10.20.193.4:0/3799736098 conn(0x7fd07005f830 msgr2=0x7fd07010d730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:42.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 -- 10.20.193.4:0/3799736098 shutdown_connections 2026-02-24T09:14:42.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.182+0000 7fd075548640 1 -- 10.20.193.4:0/3799736098 wait complete. 2026-02-24T09:14:42.223 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id 1cbb26a9 --release --await' 2026-02-24T09:14:42.224 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id 1cbb26a9 --release --await 2026-02-24T09:14:42.339 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:42.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.434+0000 7f05b87c1640 1 -- 10.20.193.4:0/4210909324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f05b010f280 msgr2=0x7f05b010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.434+0000 7f05b87c1640 1 --2- 10.20.193.4:0/4210909324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f05b010f280 0x7f05b010f650 secure :-1 s=READY pgs=859 gs=1 cs=0 l=1 c_cookie=6961872409086577293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a0009950 tx=0x7f05a002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.434+0000 7f05b87c1640 1 -- 10.20.193.4:0/4210909324 shutdown_connections 2026-02-24T09:14:42.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.434+0000 7f05b87c1640 1 --2- 10.20.193.4:0/4210909324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05b0115470 0x7f05b0175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.434+0000 7f05b87c1640 1 --2- 10.20.193.4:0/4210909324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f05b010fc70 0x7f05b0114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.434+0000 7f05b87c1640 1 --2- 10.20.193.4:0/4210909324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f05b010f280 0x7f05b010f650 unknown :-1 s=CLOSED pgs=859 gs=1 cs=0 l=1 c_cookie=6961872409086577293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.434+0000 7f05b87c1640 1 -- 10.20.193.4:0/4210909324 >> 10.20.193.4:0/4210909324 conn(0x7f05b005f830 msgr2=0x7f05b010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:42.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.434+0000 7f05b87c1640 1 -- 10.20.193.4:0/4210909324 shutdown_connections 2026-02-24T09:14:42.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.434+0000 7f05b87c1640 1 -- 10.20.193.4:0/4210909324 wait complete. 2026-02-24T09:14:42.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b87c1640 1 Processor -- start 2026-02-24T09:14:42.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b87c1640 1 -- start start 2026-02-24T09:14:42.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b87c1640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f05b010f280 0x7f05b011dcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b87c1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05b010fc70 0x7f05b011e210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b87c1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f05b0115470 0x7f05b01235e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b87c1640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f05b0123c00 con 0x7f05b0115470 2026-02-24T09:14:42.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b87c1640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f05b0123d70 con 0x7f05b010f280 2026-02-24T09:14:42.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b87c1640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05b0123f30 con 0x7f05b010fc70 2026-02-24T09:14:42.439 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b6d37640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f05b0115470 0x7f05b01235e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b6d37640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f05b0115470 0x7f05b01235e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:37746/0 (socket says 10.20.193.4:37746) 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b6d37640 1 -- 10.20.193.4:0/490213822 learned_addr learned my addr 10.20.193.4:0/490213822 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b5d35640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05b010fc70 0x7f05b011e210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b6d37640 1 -- 10.20.193.4:0/490213822 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05b010fc70 msgr2=0x7f05b011e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b6d37640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05b010fc70 0x7f05b011e210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b6d37640 1 -- 10.20.193.4:0/490213822 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f05b010f280 msgr2=0x7f05b011dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b6d37640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f05b010f280 0x7f05b011dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b6d37640 1 -- 10.20.193.4:0/490213822 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a0009570 con 0x7f05b0115470 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b6d37640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f05b0115470 0x7f05b01235e0 secure :-1 s=READY pgs=860 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05ac006e90 tx=0x7f05ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05977fe640 1 -- 10.20.193.4:0/490213822 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05ac005500 con 0x7f05b0115470 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b87c1640 1 -- 10.20.193.4:0/490213822 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b0124210 con 0x7f05b0115470 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05977fe640 1 -- 10.20.193.4:0/490213822 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f05ac005e10 con 0x7f05b0115470 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05977fe640 1 -- 10.20.193.4:0/490213822 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05ac003a90 con 0x7f05b0115470 2026-02-24T09:14:42.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.435+0000 7f05b87c1640 1 -- 10.20.193.4:0/490213822 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b0164910 con 0x7f05b0115470 2026-02-24T09:14:42.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.437+0000 7f05977fe640 1 -- 10.20.193.4:0/490213822 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f05ac00c840 con 0x7f05b0115470 2026-02-24T09:14:42.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.438+0000 7f05977fe640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f058c0b5760 0x7f058c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.438+0000 7f05977fe640 1 -- 10.20.193.4:0/490213822 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f05ac0e78c0 con 0x7f05b0115470 2026-02-24T09:14:42.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.438+0000 7f05b6536640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f058c0b5760 0x7f058c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.438+0000 7f05b6536640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f058c0b5760 0x7f058c0d5c10 secure :-1 s=READY pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a002f6e0 tx=0x7f05a0005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:42.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05ba7bbe00 1 Processor -- start 2026-02-24T09:14:42.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05ba7bbe00 1 -- start start 2026-02-24T09:14:42.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d1fb0 0x556a932d2380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a932d28c0 0x556a93317020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a93317560 0x556a93337940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556a931e3050 con 0x556a93317560 2026-02-24T09:14:42.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556a931ded80 con 0x556a932d28c0 2026-02-24T09:14:42.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556a931d8ee0 con 0x556a932d1fb0 2026-02-24T09:14:42.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b6d37640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a93317560 0x556a93337940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b6d37640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a93317560 0x556a93337940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:37750/0 (socket says 10.20.193.4:37750) 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b6d37640 1 -- 10.20.193.4:0/3572359773 learned_addr learned my addr 10.20.193.4:0/3572359773 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b5d35640 1 --2- 10.20.193.4:0/3572359773 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a932d28c0 0x556a93317020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b6536640 1 --2- 10.20.193.4:0/3572359773 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d1fb0 0x556a932d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b6d37640 1 -- 10.20.193.4:0/3572359773 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d1fb0 msgr2=0x556a932d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b6d37640 1 --2- 10.20.193.4:0/3572359773 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d1fb0 0x556a932d2380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b6d37640 1 -- 10.20.193.4:0/3572359773 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a932d28c0 msgr2=0x556a93317020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b6d37640 1 --2- 10.20.193.4:0/3572359773 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a932d28c0 0x556a93317020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b6d37640 1 -- 10.20.193.4:0/3572359773 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a93184540 con 0x556a93317560 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f05b6d37640 1 --2- 10.20.193.4:0/3572359773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a93317560 0x556a93337940 secure :-1 s=READY pgs=861 gs=1 cs=0 l=1 c_cookie=9888655990537599581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05ac0aa200 tx=0x7f05ac0aa380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893b903b26083a5d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f0594cf3640 1 -- 10.20.193.4:0/3572359773 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05ac0ae630 con 0x556a93317560 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f0594cf3640 1 -- 10.20.193.4:0/3572359773 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f05ac0b3950 con 0x556a93317560 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.440+0000 7f0594cf3640 1 -- 10.20.193.4:0/3572359773 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05ac0ae8c0 con 0x556a93317560 2026-02-24T09:14:42.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.441+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/3572359773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a93317560 msgr2=0x556a93337940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.441+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/3572359773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a93317560 0x556a93337940 secure :-1 s=READY pgs=861 gs=1 cs=0 l=1 c_cookie=9888655990537599581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05ac0aa200 tx=0x7f05ac0aa380 comp rx=0 tx=0).stop 2026-02-24T09:14:42.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.441+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/3572359773 shutdown_connections 2026-02-24T09:14:42.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.441+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/3572359773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a93317560 0x556a93337940 unknown :-1 s=CLOSED pgs=861 gs=1 cs=0 l=1 c_cookie=9888655990537599581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.441+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/3572359773 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a932d28c0 0x556a93317020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.441+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/3572359773 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d1fb0 0x556a932d2380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.441+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/3572359773 >> 10.20.193.4:0/3572359773 conn(0x556a932b04b0 msgr2=0x556a932d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:42.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.441+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/3572359773 shutdown_connections 2026-02-24T09:14:42.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.441+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/3572359773 wait complete. 2026-02-24T09:14:42.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 1 -- start start 2026-02-24T09:14:42.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 1 Processor -- start 2026-02-24T09:14:42.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a9332ee10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a932d28c0 0x556a9332f350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a93317560 0x556a93334340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556a93334880 con 0x556a932d1fb0 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556a933349f0 con 0x556a932d28c0 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556a93334bb0 con 0x556a93317560 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05b6536640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a9332ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05b6536640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a9332ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:37754/0 (socket says 10.20.193.4:37754) 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05b6536640 1 -- 10.20.193.4:0/2115278923 learned_addr learned my addr 10.20.193.4:0/2115278923 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05b6d37640 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a93317560 0x556a93334340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05b6536640 1 -- 10.20.193.4:0/2115278923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a93317560 msgr2=0x556a93334340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05b6536640 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a93317560 0x556a93334340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05b6536640 1 -- 10.20.193.4:0/2115278923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a932d28c0 msgr2=0x556a9332f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05b6536640 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a932d28c0 0x556a9332f350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05b6536640 1 -- 10.20.193.4:0/2115278923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a9315cbd0 con 0x556a932d1fb0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05b6536640 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a9332ee10 secure :-1 s=READY pgs=862 gs=1 cs=0 l=1 c_cookie=3624262715897023110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a0002fa0 tx=0x7f05a0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324bf7bce9bc0a86 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f0563fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f0563fff640 1 -- 10.20.193.4:0/2115278923 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05a004b070 con 0x556a932d1fb0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/2115278923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b0164910 con 0x556a932d1fb0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 10 client.16872 _ll_register_callbacks cb 0x556a931c7290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f0563fff640 1 -- 10.20.193.4:0/2115278923 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f05a0038e00 con 0x556a932d1fb0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f0563fff640 1 -- 10.20.193.4:0/2115278923 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05a003d070 con 0x556a932d1fb0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/2115278923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556a92f28700 con 0x556a932d1fb0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.442+0000 7f0563fff640 1 -- 10.20.193.4:0/2115278923 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f05a004f410 con 0x556a932d1fb0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f0563fff640 1 -- 10.20.193.4:0/2115278923 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f05a004f5f0 con 0x556a932d1fb0 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f05ba7bbe00 10 client.16872 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:42.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/2115278923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556a9316e910 con 0x556a932d1fb0 2026-02-24T09:14:42.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f0563fff640 1 -- 10.20.193.4:0/2115278923 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f05a004f750 con 0x556a932d1fb0 2026-02-24T09:14:42.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f05ba7bbe00 10 client.16872 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:42.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f05ba7bbe00 10 client.16872 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:14:42.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f05ba7bbe00 20 client.16872 populate_metadata read hostname 'trial004' 2026-02-24T09:14:42.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556a933147f0 0x556a93314c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f05ba7bbe00 4 client.16872 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:14:42.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/2115278923 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a931ce920 con 0x556a933147f0 2026-02-24T09:14:42.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.443+0000 7f05b5d35640 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556a933147f0 0x556a93314c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.444+0000 7f05b5d35640 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556a933147f0 0x556a93314c60 crc :-1 s=READY pgs=121 gs=4 cs=0 l=0 c_cookie=17160450734359070759 s_cookie=10443012796899186953 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee262b05df104827 server_cookie=90ed08cf3008d909 in_seq=0 out_seq=0 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.444+0000 7f0563fff640 10 client.16872 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f0563fff640 1 -- 10.20.193.4:0/2115278923 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556a931ce920 con 0x556a933147f0 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f0563fff640 10 client.16872 handle_command_reply: tid=0 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 client.16872 shutdown 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/2115278923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 msgr2=0x556a9332ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a9332ee10 secure :-1 s=READY pgs=862 gs=1 cs=0 l=1 c_cookie=3624262715897023110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a0002fa0 tx=0x7f05a0009310 comp rx=0 tx=0).stop 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/2115278923 shutdown_connections 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556a933147f0 0x556a93314c60 crc :-1 s=READY pgs=121 gs=4 cs=0 l=0 c_cookie=17160450734359070759 s_cookie=10443012796899186953 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a93317560 0x556a93334340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a932d28c0 0x556a9332f350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/2115278923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a9332ee10 unknown :-1 s=CLOSED pgs=862 gs=1 cs=0 l=1 c_cookie=3624262715897023110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f0563fff640 0 client.16872 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:42.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/2115278923 >> 10.20.193.4:0/2115278923 conn(0x556a932b04b0 msgr2=0x556a932d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:42.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/2115278923 shutdown_connections 2026-02-24T09:14:42.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/2115278923 wait complete. 2026-02-24T09:14:42.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.445+0000 7f05ba7bbe00 20 client.16872 trim_cache size 0 max 16384 2026-02-24T09:14:42.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.453+0000 7f05ba7bbe00 1 Processor -- start 2026-02-24T09:14:42.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.453+0000 7f05ba7bbe00 1 -- start start 2026-02-24T09:14:42.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.453+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a93319b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.453+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d28c0 0x556a93333810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.453+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a93317560 0x556a9332c200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.453+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556a931d6b10 con 0x556a932d1fb0 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.453+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556a92ea21b0 con 0x556a93317560 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.453+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556a932afef0 con 0x556a932d28c0 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b6536640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a93319b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b6536640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a93319b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:37766/0 (socket says 10.20.193.4:37766) 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b6536640 1 -- 10.20.193.4:0/1362722773 learned_addr learned my addr 10.20.193.4:0/1362722773 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b6d37640 1 --2- 10.20.193.4:0/1362722773 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a93317560 0x556a9332c200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b5d35640 1 --2- 10.20.193.4:0/1362722773 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d28c0 0x556a93333810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b6536640 1 -- 10.20.193.4:0/1362722773 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d28c0 msgr2=0x556a93333810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b6536640 1 --2- 10.20.193.4:0/1362722773 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d28c0 0x556a93333810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b6536640 1 -- 10.20.193.4:0/1362722773 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a93317560 msgr2=0x556a9332c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b6536640 1 --2- 10.20.193.4:0/1362722773 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a93317560 0x556a9332c200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b6536640 1 -- 10.20.193.4:0/1362722773 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a93169390 con 0x556a932d1fb0 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05b6536640 1 --2- 10.20.193.4:0/1362722773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a93319b70 secure :-1 s=READY pgs=863 gs=1 cs=0 l=1 c_cookie=6757836123274065261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a004fae0 tx=0x7f05a0045f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc8a8264a0db56d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f057e4e6640 1 -- 10.20.193.4:0/1362722773 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05a004b030 con 0x556a932d1fb0 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f057e4e6640 1 -- 10.20.193.4:0/1362722773 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x556a92f28700 con 0x556a932d1fb0 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f057e4e6640 1 -- 10.20.193.4:0/1362722773 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05a00373d0 con 0x556a932d1fb0 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/1362722773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 msgr2=0x556a93319b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/1362722773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a93319b70 secure :-1 s=READY pgs=863 gs=1 cs=0 l=1 c_cookie=6757836123274065261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a004fae0 tx=0x7f05a0045f90 comp rx=0 tx=0).stop 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/1362722773 shutdown_connections 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/1362722773 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a93317560 0x556a9332c200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/1362722773 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d28c0 0x556a93333810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/1362722773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a93319b70 unknown :-1 s=CLOSED pgs=863 gs=1 cs=0 l=1 c_cookie=6757836123274065261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/1362722773 >> 10.20.193.4:0/1362722773 conn(0x556a932b04b0 msgr2=0x556a93332860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/1362722773 shutdown_connections 2026-02-24T09:14:42.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.454+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/1362722773 wait complete. 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05ba7bbe00 1 -- start start 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05ba7bbe00 1 Processor -- start 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a932b63b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d28c0 0x556a932b1e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05ba7bbe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a93317560 0x556a932b2350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556a9337e660 con 0x556a932d1fb0 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556a932b2890 con 0x556a93317560 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05ba7bbe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556a932b2a50 con 0x556a932d28c0 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b6536640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a932b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b6536640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a932b63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:37772/0 (socket says 10.20.193.4:37772) 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b6536640 1 -- 10.20.193.4:0/857105616 learned_addr learned my addr 10.20.193.4:0/857105616 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b5d35640 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d28c0 0x556a932b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b6d37640 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a93317560 0x556a932b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b6536640 1 -- 10.20.193.4:0/857105616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d28c0 msgr2=0x556a932b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b6536640 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d28c0 0x556a932b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b6536640 1 -- 10.20.193.4:0/857105616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a93317560 msgr2=0x556a932b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b6536640 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a93317560 0x556a932b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b6536640 1 -- 10.20.193.4:0/857105616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a9315cf00 con 0x556a932d1fb0 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f05b6536640 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a932b63b0 secure :-1 s=READY pgs=864 gs=1 cs=0 l=1 c_cookie=16277528521201305970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a00023d0 tx=0x7f05a0005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e565f2af7e4972 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f0563fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.455+0000 7f0563fff640 1 -- 10.20.193.4:0/857105616 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05a004b040 con 0x556a932d1fb0 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/857105616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a9316e910 con 0x556a932d1fb0 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f0563fff640 1 -- 10.20.193.4:0/857105616 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f05a000b0b0 con 0x556a932d1fb0 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f0563fff640 1 -- 10.20.193.4:0/857105616 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05a004f8c0 con 0x556a932d1fb0 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 10 client.16878 _ll_register_callbacks cb 0x556a931c7290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/857105616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556a92e643f0 con 0x556a932d1fb0 2026-02-24T09:14:42.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f0563fff640 1 -- 10.20.193.4:0/857105616 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f05a0038920 con 0x556a932d1fb0 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f0563fff640 1 -- 10.20.193.4:0/857105616 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f05a0038ae0 con 0x556a932d1fb0 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 10 client.16878 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/857105616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556a9316eb70 con 0x556a932d1fb0 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f0563fff640 1 -- 10.20.193.4:0/857105616 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f05a0038c40 con 0x556a932d1fb0 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 10 client.16878 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 10 client.16878 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 20 client.16878 populate_metadata read hostname 'trial004' 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556a933c5fd0 0x556a933e6480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 4 client.16878 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1cbb26a9", "release": true, "await": true}] 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/857105616 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1cbb26a9", "release": true, "await": true}) -- 0x7f05ac0b3950 con 0x556a933c5fd0 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.456+0000 7f05b5d35640 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556a933c5fd0 0x556a933e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.457+0000 7f05b5d35640 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556a933c5fd0 0x556a933e6480 crc :-1 s=READY pgs=122 gs=4 cs=0 l=0 c_cookie=14731576933481590597 s_cookie=8155363159193081357 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc71132b75822f45 server_cookie=712dab959602d60d in_seq=0 out_seq=0 2026-02-24T09:14:42.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.457+0000 7f0563fff640 10 client.16878 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:42.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f0563fff640 1 -- 10.20.193.4:0/857105616 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f05ac0b3950 con 0x556a933c5fd0 2026-02-24T09:14:42.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f0563fff640 10 client.16878 handle_command_reply: tid=0 2026-02-24T09:14:42.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 client.16878 shutdown 2026-02-24T09:14:42.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/857105616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 msgr2=0x556a932b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a932b63b0 secure :-1 s=READY pgs=864 gs=1 cs=0 l=1 c_cookie=16277528521201305970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a00023d0 tx=0x7f05a0005c70 comp rx=0 tx=0).stop 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/857105616 shutdown_connections 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556a933c5fd0 0x556a933e6480 crc :-1 s=READY pgs=122 gs=4 cs=0 l=0 c_cookie=14731576933481590597 s_cookie=8155363159193081357 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556a93317560 0x556a932b2350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f0563fff640 0 client.16878 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556a932d28c0 0x556a932b1e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 --2- 10.20.193.4:0/857105616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556a932d1fb0 0x556a932b63b0 unknown :-1 s=CLOSED pgs=864 gs=1 cs=0 l=1 c_cookie=16277528521201305970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/857105616 >> 10.20.193.4:0/857105616 conn(0x556a932b04b0 msgr2=0x556a9332b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/857105616 shutdown_connections 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 1 -- 10.20.193.4:0/857105616 wait complete. 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05ba7bbe00 20 client.16878 trim_cache size 0 max 16384 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:14:42.468 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 20, 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "1cbb26a9": { 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "version": 20, 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 150.0, 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:14:42.469 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:14:42.470 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:14:42.470 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:14:42.470 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:42.470 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:42.470 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:42.470 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:42.470 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:42.470 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:14:42.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05b87c1640 1 -- 10.20.193.4:0/490213822 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f058c0b5760 msgr2=0x7f058c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05b87c1640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f058c0b5760 0x7f058c0d5c10 secure :-1 s=READY pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a002f6e0 tx=0x7f05a0005900 comp rx=0 tx=0).stop 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05b87c1640 1 -- 10.20.193.4:0/490213822 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f05b0115470 msgr2=0x7f05b01235e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05b87c1640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f05b0115470 0x7f05b01235e0 secure :-1 s=READY pgs=860 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05ac006e90 tx=0x7f05ac00edf0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05b87c1640 1 -- 10.20.193.4:0/490213822 shutdown_connections 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05b87c1640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f058c0b5760 0x7f058c0d5c10 unknown :-1 s=CLOSED pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05b87c1640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f05b0115470 0x7f05b01235e0 unknown :-1 s=CLOSED pgs=860 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05b87c1640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05b010fc70 0x7f05b011e210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05b87c1640 1 --2- 10.20.193.4:0/490213822 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f05b010f280 0x7f05b011dcd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.460+0000 7f05b87c1640 1 -- 10.20.193.4:0/490213822 >> 10.20.193.4:0/490213822 conn(0x7f05b005f830 msgr2=0x7f05b010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.461+0000 7f05b87c1640 1 -- 10.20.193.4:0/490213822 shutdown_connections 2026-02-24T09:14:42.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.461+0000 7f05b87c1640 1 -- 10.20.193.4:0/490213822 wait complete. 2026-02-24T09:14:42.536 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1cbb26a9', total seconds elapsed: 30.7 2026-02-24T09:14:42.536 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2026-02-24T09:14:42.536 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:14:42.700 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:42.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 -- 10.20.193.4:0/2477377676 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0c010da00 msgr2=0x7fe0c0112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 --2- 10.20.193.4:0/2477377676 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0c010da00 0x7fe0c0112a50 secure :-1 s=READY pgs=865 gs=1 cs=0 l=1 c_cookie=11191598381206373874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0a8009950 tx=0x7fe0a802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 -- 10.20.193.4:0/2477377676 shutdown_connections 2026-02-24T09:14:42.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 --2- 10.20.193.4:0/2477377676 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0c0113200 0x7fe0c0173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 --2- 10.20.193.4:0/2477377676 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0c010da00 0x7fe0c0112a50 unknown :-1 s=CLOSED pgs=865 gs=1 cs=0 l=1 c_cookie=11191598381206373874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 --2- 10.20.193.4:0/2477377676 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0c010d010 0x7fe0c010d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 -- 10.20.193.4:0/2477377676 >> 10.20.193.4:0/2477377676 conn(0x7fe0c005f830 msgr2=0x7fe0c010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 -- 10.20.193.4:0/2477377676 shutdown_connections 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 -- 10.20.193.4:0/2477377676 wait complete. 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 Processor -- start 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 -- start start 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0c010d010 0x7fe0c00f3310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0c010da00 0x7fe0c0173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0c0113200 0x7fe0c00f3a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c00f8c20 con 0x7fe0c0113200 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c00f8d90 con 0x7fe0c010da00 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.853+0000 7fe0c5665640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c00f8f50 con 0x7fe0c010d010 2026-02-24T09:14:42.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0bf7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0c0113200 0x7fe0c00f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0bf7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0c0113200 0x7fe0c00f3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:37782/0 (socket says 10.20.193.4:37782) 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0bf7fe640 1 -- 10.20.193.4:0/3257108673 learned_addr learned my addr 10.20.193.4:0/3257108673 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0beffd640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0c010d010 0x7fe0c00f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0be7fc640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0c010da00 0x7fe0c0173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0bf7fe640 1 -- 10.20.193.4:0/3257108673 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0c010d010 msgr2=0x7fe0c00f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0bf7fe640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0c010d010 0x7fe0c00f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0bf7fe640 1 -- 10.20.193.4:0/3257108673 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0c010da00 msgr2=0x7fe0c0173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0bf7fe640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0c010da00 0x7fe0c0173ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0bf7fe640 1 -- 10.20.193.4:0/3257108673 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a8009570 con 0x7fe0c0113200 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0bf7fe640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0c0113200 0x7fe0c00f3a10 secure :-1 s=READY pgs=866 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b0006e90 tx=0x7fe0b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe09ffff640 1 -- 10.20.193.4:0/3257108673 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0b0005500 con 0x7fe0c0113200 2026-02-24T09:14:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0c5665640 1 -- 10.20.193.4:0/3257108673 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c00f9230 con 0x7fe0c0113200 2026-02-24T09:14:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe09ffff640 1 -- 10.20.193.4:0/3257108673 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0b0005e10 con 0x7fe0c0113200 2026-02-24T09:14:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe09ffff640 1 -- 10.20.193.4:0/3257108673 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0b0003a90 con 0x7fe0c0113200 2026-02-24T09:14:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0c5665640 1 -- 10.20.193.4:0/3257108673 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c00f9750 con 0x7fe0c0113200 2026-02-24T09:14:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.854+0000 7fe0c5665640 1 -- 10.20.193.4:0/3257108673 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c010e2f0 con 0x7fe0c0113200 2026-02-24T09:14:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.857+0000 7fe09ffff640 1 -- 10.20.193.4:0/3257108673 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fe0b000c840 con 0x7fe0c0113200 2026-02-24T09:14:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.858+0000 7fe09ffff640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0900b56d0 0x7fe0900d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.858+0000 7fe0beffd640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0900b56d0 0x7fe0900d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.858+0000 7fe09ffff640 1 -- 10.20.193.4:0/3257108673 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe0b00e7e00 con 0x7fe0c0113200 2026-02-24T09:14:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.858+0000 7fe0beffd640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0900b56d0 0x7fe0900d5b80 secure :-1 s=READY pgs=364 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b4005970 tx=0x7fe0b4005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:42.859+0000 7fe09ffff640 1 -- 10.20.193.4:0/3257108673 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe0b00aa780 con 0x7fe0c0113200 2026-02-24T09:14:43.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.012+0000 7fe0c5665640 1 -- 10.20.193.4:0/3257108673 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0c010d3e0 con 0x7fe0c0113200 2026-02-24T09:14:43.017 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:42 trial004 ceph-mon[41596]: pgmap v299: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 6 op/s 2026-02-24T09:14:43.017 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:42 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3799736098' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:43.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.012+0000 7fe09ffff640 1 -- 10.20.193.4:0/3257108673 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fe0b00ad930 con 0x7fe0c0113200 2026-02-24T09:14:43.018 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:14:43.018 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:14:43.018 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:14:43.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.017+0000 7fe0c5665640 1 -- 10.20.193.4:0/3257108673 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0900b56d0 msgr2=0x7fe0900d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.017+0000 7fe0c5665640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0900b56d0 0x7fe0900d5b80 secure :-1 s=READY pgs=364 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b4005970 tx=0x7fe0b4005ed0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.017+0000 7fe0c5665640 1 -- 10.20.193.4:0/3257108673 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0c0113200 msgr2=0x7fe0c00f3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.017+0000 7fe0c5665640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0c0113200 0x7fe0c00f3a10 secure :-1 s=READY pgs=866 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b0006e90 tx=0x7fe0b000edf0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.018+0000 7fe0c5665640 1 -- 10.20.193.4:0/3257108673 shutdown_connections 2026-02-24T09:14:43.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.018+0000 7fe0c5665640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0900b56d0 0x7fe0900d5b80 unknown :-1 s=CLOSED pgs=364 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.018+0000 7fe0c5665640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0c0113200 0x7fe0c00f3a10 unknown :-1 s=CLOSED pgs=866 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.018+0000 7fe0c5665640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0c010da00 0x7fe0c0173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.018+0000 7fe0c5665640 1 --2- 10.20.193.4:0/3257108673 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0c010d010 0x7fe0c00f3310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.018+0000 7fe0c5665640 1 -- 10.20.193.4:0/3257108673 >> 10.20.193.4:0/3257108673 conn(0x7fe0c005f830 msgr2=0x7fe0c010f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:43.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.018+0000 7fe0c5665640 1 -- 10.20.193.4:0/3257108673 shutdown_connections 2026-02-24T09:14:43.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.018+0000 7fe0c5665640 1 -- 10.20.193.4:0/3257108673 wait complete. 2026-02-24T09:14:43.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:42 trial014 ceph-mon[46941]: pgmap v299: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 6 op/s 2026-02-24T09:14:43.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:42 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3799736098' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:43.130 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2026-02-24T09:14:43.131 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2026-02-24T09:14:43.303 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:43.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:42 trial090 ceph-mon[47278]: pgmap v299: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 6 op/s 2026-02-24T09:14:43.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:42 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3799736098' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:43.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 -- 10.20.193.4:0/1770798575 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3f5c10d010 msgr2=0x7f3f5c10d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 --2- 10.20.193.4:0/1770798575 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3f5c10d010 0x7f3f5c10d3e0 secure :-1 s=READY pgs=867 gs=1 cs=0 l=1 c_cookie=3773062820429459380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f48009950 tx=0x7f3f4802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 -- 10.20.193.4:0/1770798575 shutdown_connections 2026-02-24T09:14:43.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 --2- 10.20.193.4:0/1770798575 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f5c113200 0x7f3f5c173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 --2- 10.20.193.4:0/1770798575 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3f5c10da00 0x7f3f5c112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 --2- 10.20.193.4:0/1770798575 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3f5c10d010 0x7f3f5c10d3e0 unknown :-1 s=CLOSED pgs=867 gs=1 cs=0 l=1 c_cookie=3773062820429459380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 -- 10.20.193.4:0/1770798575 >> 10.20.193.4:0/1770798575 conn(0x7f3f5c05f830 msgr2=0x7f3f5c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:43.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 -- 10.20.193.4:0/1770798575 shutdown_connections 2026-02-24T09:14:43.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 -- 10.20.193.4:0/1770798575 wait complete. 2026-02-24T09:14:43.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 Processor -- start 2026-02-24T09:14:43.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 -- start start 2026-02-24T09:14:43.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3f5c10d010 0x7f3f5c0f5590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3f5c10da00 0x7f3f5c173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f5c113200 0x7f3f5c0f5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c0faea0 con 0x7f3f5c10d010 2026-02-24T09:14:43.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c0fb010 con 0x7f3f5c10da00 2026-02-24T09:14:43.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f62985640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c0fb1d0 con 0x7f3f5c113200 2026-02-24T09:14:43.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f5bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3f5c10d010 0x7f3f5c0f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f5bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3f5c10d010 0x7f3f5c0f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59834/0 (socket says 10.20.193.4:59834) 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f5bfff640 1 -- 10.20.193.4:0/1330478910 learned_addr learned my addr 10.20.193.4:0/1330478910 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f60efb640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f5c113200 0x7f3f5c0f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3f5c10da00 0x7f3f5c173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f5bfff640 1 -- 10.20.193.4:0/1330478910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f5c113200 msgr2=0x7f3f5c0f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f5bfff640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f5c113200 0x7f3f5c0f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f5bfff640 1 -- 10.20.193.4:0/1330478910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3f5c10da00 msgr2=0x7f3f5c173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f5bfff640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3f5c10da00 0x7f3f5c173ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.463+0000 7f3f5bfff640 1 -- 10.20.193.4:0/1330478910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f48009570 con 0x7f3f5c10d010 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.464+0000 7f3f5bfff640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3f5c10d010 0x7f3f5c0f5590 secure :-1 s=READY pgs=868 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f48004820 tx=0x7f3f480028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.464+0000 7f3f597fa640 1 -- 10.20.193.4:0/1330478910 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f4803d070 con 0x7f3f5c10d010 2026-02-24T09:14:43.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.464+0000 7f3f62985640 1 -- 10.20.193.4:0/1330478910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5c0fb450 con 0x7f3f5c10d010 2026-02-24T09:14:43.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.464+0000 7f3f597fa640 1 -- 10.20.193.4:0/1330478910 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f480043d0 con 0x7f3f5c10d010 2026-02-24T09:14:43.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.464+0000 7f3f597fa640 1 -- 10.20.193.4:0/1330478910 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f48041c10 con 0x7f3f5c10d010 2026-02-24T09:14:43.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.464+0000 7f3f62985640 1 -- 10.20.193.4:0/1330478910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f5c0fb910 con 0x7f3f5c10d010 2026-02-24T09:14:43.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.466+0000 7f3f597fa640 1 -- 10.20.193.4:0/1330478910 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f3f48038920 con 0x7f3f5c10d010 2026-02-24T09:14:43.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.467+0000 7f3f597fa640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3f300b56e0 0x7f3f300d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.467+0000 7f3f597fa640 1 -- 10.20.193.4:0/1330478910 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3f4810b710 con 0x7f3f5c10d010 2026-02-24T09:14:43.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.467+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3f300b56e0 0x7f3f300d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.468+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3f300b56e0 0x7f3f300d5b90 secure :-1 s=READY pgs=365 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c005fd0 tx=0x7f3f4c00a580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:43.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f6497fe00 1 Processor -- start 2026-02-24T09:14:43.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f6497fe00 1 -- start start 2026-02-24T09:14:43.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d335fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d37ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d37b180 0x55e27d39b560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e27d244f20 con 0x55e27d3364e0 2026-02-24T09:14:43.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e27d240c50 con 0x55e27d335bd0 2026-02-24T09:14:43.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e27d23adb0 con 0x55e27d37b180 2026-02-24T09:14:43.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f5bfff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d335fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f5b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d37ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f5b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d37ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59836/0 (socket says 10.20.193.4:59836) 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f5b7fe640 1 -- 10.20.193.4:0/3894483590 learned_addr learned my addr 10.20.193.4:0/3894483590 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f60efb640 1 --2- 10.20.193.4:0/3894483590 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d37b180 0x55e27d39b560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f5b7fe640 1 -- 10.20.193.4:0/3894483590 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d37b180 msgr2=0x55e27d39b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/3894483590 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d37b180 0x55e27d39b560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f5b7fe640 1 -- 10.20.193.4:0/3894483590 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 msgr2=0x55e27d335fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/3894483590 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d335fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.471+0000 7f3f5b7fe640 1 -- 10.20.193.4:0/3894483590 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e27d1db690 con 0x55e27d3364e0 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.472+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/3894483590 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d37ac40 secure :-1 s=READY pgs=869 gs=2 cs=0 l=1 c_cookie=11675395093746990413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c00ef40 tx=0x7f3f4c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20755fa9720bd4d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.472+0000 7f3f2cce3640 1 -- 10.20.193.4:0/3894483590 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f4c01d680 con 0x55e27d3364e0 2026-02-24T09:14:43.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.472+0000 7f3f2cce3640 1 -- 10.20.193.4:0/3894483590 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f4c002e30 con 0x55e27d3364e0 2026-02-24T09:14:43.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.472+0000 7f3f2cce3640 1 -- 10.20.193.4:0/3894483590 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f4c010d40 con 0x55e27d3364e0 2026-02-24T09:14:43.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.473+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3894483590 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 msgr2=0x55e27d37ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.473+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/3894483590 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d37ac40 secure :-1 s=READY pgs=869 gs=2 cs=0 l=1 c_cookie=11675395093746990413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c00ef40 tx=0x7f3f4c011000 comp rx=0 tx=0).stop 2026-02-24T09:14:43.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.473+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3894483590 shutdown_connections 2026-02-24T09:14:43.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.473+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/3894483590 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d37b180 0x55e27d39b560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.473+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/3894483590 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d37ac40 unknown :-1 s=CLOSED pgs=869 gs=2 cs=0 l=1 c_cookie=11675395093746990413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.473+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/3894483590 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d335fa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.473+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3894483590 >> 10.20.193.4:0/3894483590 conn(0x55e27d253880 msgr2=0x55e27d3344b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.473+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3894483590 shutdown_connections 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.473+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3894483590 wait complete. 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f6497fe00 1 -- start start 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f6497fe00 1 Processor -- start 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d335bd0 0x55e27d34da60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d3364e0 0x55e27d34dfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d37b180 0x55e27d352f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e27d3534d0 con 0x55e27d335bd0 2026-02-24T09:14:43.483 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e27d353640 con 0x55e27d3364e0 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e27d353800 con 0x55e27d37b180 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f5bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d335bd0 0x55e27d34da60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f5bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d335bd0 0x55e27d34da60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59850/0 (socket says 10.20.193.4:59850) 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f5bfff640 1 -- 10.20.193.4:0/486931563 learned_addr learned my addr 10.20.193.4:0/486931563 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d3364e0 0x55e27d34dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.474+0000 7f3f60efb640 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d37b180 0x55e27d352f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f5bfff640 1 -- 10.20.193.4:0/486931563 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d37b180 msgr2=0x55e27d352f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f5bfff640 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d37b180 0x55e27d352f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f5bfff640 1 -- 10.20.193.4:0/486931563 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d3364e0 msgr2=0x55e27d34dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f5bfff640 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d3364e0 0x55e27d34dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f5bfff640 1 -- 10.20.193.4:0/486931563 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e27d1e63d0 con 0x55e27d335bd0 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f5bfff640 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d335bd0 0x55e27d34da60 secure :-1 s=READY pgs=870 gs=1 cs=0 l=1 c_cookie=16453976931705153831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f480ce010 tx=0x7f3f48038eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45844d7acc1e927 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:43.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f1dffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f1dffb640 1 -- 10.20.193.4:0/486931563 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f480d1240 con 0x55e27d335bd0 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f1dffb640 1 -- 10.20.193.4:0/486931563 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f48002ac0 con 0x55e27d335bd0 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f1dffb640 1 -- 10.20.193.4:0/486931563 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f480d2930 con 0x55e27d335bd0 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f6497fe00 1 -- 10.20.193.4:0/486931563 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c00ebe0 con 0x55e27d335bd0 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f1dffb640 1 -- 10.20.193.4:0/486931563 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3f480dcb80 con 0x55e27d335bd0 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f1dffb640 10 client.16896 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f6497fe00 10 client.16896 _ll_register_callbacks cb 0x55e27d1bba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.475+0000 7f3f6497fe00 1 -- 10.20.193.4:0/486931563 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e27cec8eb0 con 0x55e27d335bd0 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f1dffb640 1 -- 10.20.193.4:0/486931563 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3f48005bd0 con 0x55e27d335bd0 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f6497fe00 10 client.16896 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:43.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f6497fe00 1 -- 10.20.193.4:0/486931563 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e27d1be5c0 con 0x55e27d335bd0 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f1dffb640 1 -- 10.20.193.4:0/486931563 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f3f480dc6f0 con 0x55e27d335bd0 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f6497fe00 10 client.16896 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f6497fe00 10 client.16896 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f6497fe00 20 client.16896 populate_metadata read hostname 'trial004' 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e27d377e70 0x55e27d378310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f6497fe00 4 client.16896 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f6497fe00 1 -- 10.20.193.4:0/486931563 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e27d24bf00 con 0x55e27d377e70 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.476+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e27d377e70 0x55e27d378310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.477+0000 7f3f1dffb640 10 client.16896 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.477+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e27d377e70 0x55e27d378310 crc :-1 s=READY pgs=123 gs=4 cs=0 l=0 c_cookie=15161139340276037141 s_cookie=11397832917202708844 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2672fe71f5a7615 server_cookie=9e2d3ca65f1f296c in_seq=0 out_seq=0 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f1dffb640 1 -- 10.20.193.4:0/486931563 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e27d24bf00 con 0x55e27d377e70 2026-02-24T09:14:43.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f1dffb640 10 client.16896 handle_command_reply: tid=0 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 client.16896 shutdown 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 -- 10.20.193.4:0/486931563 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d335bd0 msgr2=0x55e27d34da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d335bd0 0x55e27d34da60 secure :-1 s=READY pgs=870 gs=1 cs=0 l=1 c_cookie=16453976931705153831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f480ce010 tx=0x7f3f48038eb0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 -- 10.20.193.4:0/486931563 shutdown_connections 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e27d377e70 0x55e27d378310 crc :-1 s=READY pgs=123 gs=4 cs=0 l=0 c_cookie=15161139340276037141 s_cookie=11397832917202708844 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d37b180 0x55e27d352f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f1dffb640 0 client.16896 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d3364e0 0x55e27d34dfa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/486931563 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d335bd0 0x55e27d34da60 unknown :-1 s=CLOSED pgs=870 gs=1 cs=0 l=1 c_cookie=16453976931705153831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 -- 10.20.193.4:0/486931563 >> 10.20.193.4:0/486931563 conn(0x55e27d253880 msgr2=0x55e27d334bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 -- 10.20.193.4:0/486931563 shutdown_connections 2026-02-24T09:14:43.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 1 -- 10.20.193.4:0/486931563 wait complete. 2026-02-24T09:14:43.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.478+0000 7f3f6497fe00 20 client.16896 trim_cache size 0 max 16384 2026-02-24T09:14:43.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.488+0000 7f3f6497fe00 1 Processor -- start 2026-02-24T09:14:43.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.488+0000 7f3f6497fe00 1 -- start start 2026-02-24T09:14:43.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d3513d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d334dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d377e70 0x55e27d335300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e27d2389e0 con 0x55e27d3364e0 2026-02-24T09:14:43.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e27cef0ec0 con 0x55e27d335bd0 2026-02-24T09:14:43.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e27d34e580 con 0x55e27d377e70 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f5b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d334dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f5b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d334dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59852/0 (socket says 10.20.193.4:59852) 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f5b7fe640 1 -- 10.20.193.4:0/2511607352 learned_addr learned my addr 10.20.193.4:0/2511607352 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f5b7fe640 1 -- 10.20.193.4:0/2511607352 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d377e70 msgr2=0x55e27d335300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f60efb640 1 --2- 10.20.193.4:0/2511607352 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d377e70 0x55e27d335300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/2511607352 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d377e70 0x55e27d335300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f5b7fe640 1 -- 10.20.193.4:0/2511607352 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 msgr2=0x55e27d3513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/2511607352 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d3513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f5b7fe640 1 -- 10.20.193.4:0/2511607352 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e27d340430 con 0x55e27d3364e0 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f60efb640 1 --2- 10.20.193.4:0/2511607352 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d377e70 0x55e27d335300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:43.499 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/2511607352 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d334dc0 secure :-1 s=READY pgs=871 gs=1 cs=0 l=1 c_cookie=15926486726117532461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c00ef10 tx=0x7f3f4c010890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd063f4b9635a32d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f1ffff640 1 -- 10.20.193.4:0/2511607352 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f4c02e040 con 0x55e27d3364e0 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f1ffff640 1 -- 10.20.193.4:0/2511607352 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f4c010de0 con 0x55e27d3364e0 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.489+0000 7f3f1ffff640 1 -- 10.20.193.4:0/2511607352 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f4c034320 con 0x55e27d3364e0 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.490+0000 7f3f6497fe00 1 -- 10.20.193.4:0/2511607352 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 msgr2=0x55e27d334dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.490+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/2511607352 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d334dc0 secure :-1 s=READY pgs=871 gs=1 cs=0 l=1 c_cookie=15926486726117532461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c00ef10 tx=0x7f3f4c010890 comp rx=0 tx=0).stop 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.490+0000 7f3f6497fe00 1 -- 10.20.193.4:0/2511607352 shutdown_connections 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.490+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/2511607352 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d377e70 0x55e27d335300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.490+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/2511607352 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d3364e0 0x55e27d334dc0 unknown :-1 s=CLOSED pgs=871 gs=1 cs=0 l=1 c_cookie=15926486726117532461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.490+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/2511607352 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d3513d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.490+0000 7f3f6497fe00 1 -- 10.20.193.4:0/2511607352 >> 10.20.193.4:0/2511607352 conn(0x55e27d253880 msgr2=0x55e27d350cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.490+0000 7f3f6497fe00 1 -- 10.20.193.4:0/2511607352 shutdown_connections 2026-02-24T09:14:43.500 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.490+0000 7f3f6497fe00 1 -- 10.20.193.4:0/2511607352 wait complete. 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 1 -- start start 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 1 Processor -- start 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d355c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d3364e0 0x55e27d3561a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d377e70 0x55e27d3e06a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e27d2a9290 con 0x55e27d377e70 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e27d2a4580 con 0x55e27d335bd0 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e27d3e0be0 con 0x55e27d3364e0 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f60efb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d377e70 0x55e27d3e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f60efb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d377e70 0x55e27d3e06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:59860/0 (socket says 10.20.193.4:59860) 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f60efb640 1 -- 10.20.193.4:0/3564313923 learned_addr learned my addr 10.20.193.4:0/3564313923 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:43.501 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f5bfff640 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d355c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d3364e0 0x55e27d3561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f60efb640 1 -- 10.20.193.4:0/3564313923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d3364e0 msgr2=0x55e27d3561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f60efb640 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d3364e0 0x55e27d3561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f60efb640 1 -- 10.20.193.4:0/3564313923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 msgr2=0x55e27d355c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f60efb640 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d355c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f60efb640 1 -- 10.20.193.4:0/3564313923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e27d1d0500 con 0x55e27d377e70 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f5bfff640 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d355c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f5b7fe640 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d3364e0 0x55e27d3561a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f60efb640 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d377e70 0x55e27d3e06a0 secure :-1 s=READY pgs=872 gs=1 cs=0 l=1 c_cookie=13283437583260639601 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f50013680 tx=0x7f3f50013b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b858401a7252e171 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f1dffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f1dffb640 1 -- 10.20.193.4:0/3564313923 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f50018070 con 0x55e27d377e70 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3564313923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e27d1db690 con 0x55e27d377e70 2026-02-24T09:14:43.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f1dffb640 1 -- 10.20.193.4:0/3564313923 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f5000fcc0 con 0x55e27d377e70 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f1dffb640 1 -- 10.20.193.4:0/3564313923 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f5001c870 con 0x55e27d377e70 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 10 client.16902 _ll_register_callbacks cb 0x55e27d1bba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3564313923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e27cec6700 con 0x55e27d377e70 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f1dffb640 1 -- 10.20.193.4:0/3564313923 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3f5001ca00 con 0x55e27d377e70 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.491+0000 7f3f1dffb640 1 -- 10.20.193.4:0/3564313923 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3f5001cbc0 con 0x55e27d377e70 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.492+0000 7f3f6497fe00 10 client.16902 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.492+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3564313923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e27d1caf80 con 0x55e27d377e70 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.492+0000 7f3f1dffb640 1 -- 10.20.193.4:0/3564313923 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f3f50024060 con 0x55e27d377e70 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.492+0000 7f3f6497fe00 10 client.16902 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.492+0000 7f3f6497fe00 10 client.16902 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.492+0000 7f3f6497fe00 20 client.16902 populate_metadata read hostname 'trial004' 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.492+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e27d37b180 0x55e27d448e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:43.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.492+0000 7f3f6497fe00 4 client.16902 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2026-02-24T09:14:43.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.492+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3564313923 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55e27d24db70 con 0x55e27d37b180 2026-02-24T09:14:43.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.492+0000 7f3f5bfff640 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e27d37b180 0x55e27d448e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:43.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.493+0000 7f3f5bfff640 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e27d37b180 0x55e27d448e10 crc :-1 s=READY pgs=124 gs=4 cs=0 l=0 c_cookie=3026851020845673582 s_cookie=5631060691699768649 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a0188f76d88ec6e server_cookie=4e258bdd4d6e1d49 in_seq=0 out_seq=0 2026-02-24T09:14:43.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.493+0000 7f3f1dffb640 10 client.16902 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:43.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f1dffb640 1 -- 10.20.193.4:0/3564313923 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e27d24db70 con 0x55e27d37b180 2026-02-24T09:14:43.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f1dffb640 10 client.16902 handle_command_reply: tid=0 2026-02-24T09:14:43.509 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 client.16902 shutdown 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3564313923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d377e70 msgr2=0x55e27d3e06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d377e70 0x55e27d3e06a0 secure :-1 s=READY pgs=872 gs=1 cs=0 l=1 c_cookie=13283437583260639601 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f50013680 tx=0x7f3f50013b50 comp rx=0 tx=0).stop 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3564313923 shutdown_connections 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e27d37b180 0x55e27d448e10 crc :-1 s=READY pgs=124 gs=4 cs=0 l=0 c_cookie=3026851020845673582 s_cookie=5631060691699768649 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e27d377e70 0x55e27d3e06a0 unknown :-1 s=CLOSED pgs=872 gs=1 cs=0 l=1 c_cookie=13283437583260639601 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e27d3364e0 0x55e27d3561a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 --2- 10.20.193.4:0/3564313923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e27d335bd0 0x55e27d355c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f1dffb640 0 client.16902 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3564313923 >> 10.20.193.4:0/3564313923 conn(0x55e27d253880 msgr2=0x55e27d3514b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3564313923 shutdown_connections 2026-02-24T09:14:43.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 1 -- 10.20.193.4:0/3564313923 wait complete. 2026-02-24T09:14:43.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.505+0000 7f3f6497fe00 20 client.16902 trim_cache size 0 max 16384 2026-02-24T09:14:43.511 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:14:43.511 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:14:43.511 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:14:43.511 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 22, 2026-02-24T09:14:43.511 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:14:43.511 INFO:teuthology.orchestra.run.trial004.stdout: "c2bd5211": { 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "version": 22, 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 150.0, 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:14:43.512 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:14:43.513 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:14:43.513 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:14:43.513 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:43.513 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:43.513 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:43.513 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:43.513 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:43.513 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:14:43.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 -- 10.20.193.4:0/1330478910 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3f300b56e0 msgr2=0x7f3f300d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3f300b56e0 0x7f3f300d5b90 secure :-1 s=READY pgs=365 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c005fd0 tx=0x7f3f4c00a580 comp rx=0 tx=0).stop 2026-02-24T09:14:43.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 -- 10.20.193.4:0/1330478910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3f5c10d010 msgr2=0x7f3f5c0f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:43.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3f5c10d010 0x7f3f5c0f5590 secure :-1 s=READY pgs=868 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f48004820 tx=0x7f3f480028d0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 -- 10.20.193.4:0/1330478910 shutdown_connections 2026-02-24T09:14:43.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3f300b56e0 0x7f3f300d5b90 unknown :-1 s=CLOSED pgs=365 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f5c113200 0x7f3f5c0f5c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3f5c10da00 0x7f3f5c173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 --2- 10.20.193.4:0/1330478910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3f5c10d010 0x7f3f5c0f5590 unknown :-1 s=CLOSED pgs=868 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:43.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 -- 10.20.193.4:0/1330478910 >> 10.20.193.4:0/1330478910 conn(0x7f3f5c05f830 msgr2=0x7f3f5c110160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:43.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 -- 10.20.193.4:0/1330478910 shutdown_connections 2026-02-24T09:14:43.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:43.506+0000 7f3f62985640 1 -- 10.20.193.4:0/1330478910 wait complete. 2026-02-24T09:14:43.548 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c2bd5211', quiesce took 1.0 seconds. Will release after: 29.0 2026-02-24T09:14:44.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:44 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3257108673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:44.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:44 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:14:44.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:44 trial090 ceph-mon[47278]: pgmap v300: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:14:44.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:44 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3257108673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:44.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:44 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:14:44.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:44 trial014 ceph-mon[46941]: pgmap v300: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:14:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:44 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3257108673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:44 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:14:44.465 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:44 trial004 ceph-mon[41596]: pgmap v300: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-24T09:14:47.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:46 trial090 ceph-mon[47278]: pgmap v301: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:14:47.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:46 trial014 ceph-mon[46941]: pgmap v301: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:14:47.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:46 trial004 ceph-mon[41596]: pgmap v301: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-24T09:14:49.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:48 trial090 ceph-mon[47278]: pgmap v302: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-24T09:14:49.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:48 trial014 ceph-mon[46941]: pgmap v302: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-24T09:14:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:48 trial004 ceph-mon[41596]: pgmap v302: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-24T09:14:51.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:50 trial090 ceph-mon[47278]: pgmap v303: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2026-02-24T09:14:51.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:50 trial014 ceph-mon[46941]: pgmap v303: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2026-02-24T09:14:51.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:50 trial004 ceph-mon[41596]: pgmap v303: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2026-02-24T09:14:53.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:52 trial090 ceph-mon[47278]: pgmap v304: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2026-02-24T09:14:53.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:52 trial014 ceph-mon[46941]: pgmap v304: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2026-02-24T09:14:53.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:52 trial004 ceph-mon[41596]: pgmap v304: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2026-02-24T09:14:55.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:54 trial090 ceph-mon[47278]: pgmap v305: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2026-02-24T09:14:55.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:54 trial014 ceph-mon[46941]: pgmap v305: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2026-02-24T09:14:55.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:54 trial004 ceph-mon[41596]: pgmap v305: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2026-02-24T09:14:57.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:56 trial090 ceph-mon[47278]: pgmap v306: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2026-02-24T09:14:57.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:56 trial014 ceph-mon[46941]: pgmap v306: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2026-02-24T09:14:57.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:56 trial004 ceph-mon[41596]: pgmap v306: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2026-02-24T09:14:59.046 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:14:59.071 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:58 trial004 ceph-mon[41596]: pgmap v307: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2026-02-24T09:14:59.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:58 trial090 ceph-mon[47278]: pgmap v307: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2026-02-24T09:14:59.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:58 trial014 ceph-mon[46941]: pgmap v307: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2026-02-24T09:14:59.167 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:59.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.274+0000 7f37f1dad640 1 -- 10.20.193.4:0/1799656092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f37ec10f740 msgr2=0x7f37ec10fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.274+0000 7f37f1dad640 1 --2- 10.20.193.4:0/1799656092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f37ec10f740 0x7f37ec10fb10 secure :-1 s=READY pgs=873 gs=1 cs=0 l=1 c_cookie=9113885076352689536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d8009950 tx=0x7f37d802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.274+0000 7f37f1dad640 1 -- 10.20.193.4:0/1799656092 shutdown_connections 2026-02-24T09:14:59.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.274+0000 7f37f1dad640 1 --2- 10.20.193.4:0/1799656092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37ec115930 0x7f37ec176300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.274+0000 7f37f1dad640 1 --2- 10.20.193.4:0/1799656092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37ec110130 0x7f37ec115180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.274+0000 7f37f1dad640 1 --2- 10.20.193.4:0/1799656092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f37ec10f740 0x7f37ec10fb10 unknown :-1 s=CLOSED pgs=873 gs=1 cs=0 l=1 c_cookie=9113885076352689536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.274+0000 7f37f1dad640 1 -- 10.20.193.4:0/1799656092 >> 10.20.193.4:0/1799656092 conn(0x7f37ec0ed050 msgr2=0x7f37ec10d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.274+0000 7f37f1dad640 1 -- 10.20.193.4:0/1799656092 shutdown_connections 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.274+0000 7f37f1dad640 1 -- 10.20.193.4:0/1799656092 wait complete. 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37f1dad640 1 Processor -- start 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37f1dad640 1 -- start start 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37f1dad640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37ec10f740 0x7f37ec11e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37f1dad640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37ec110130 0x7f37ec11e5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37f1dad640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f37ec115930 0x7f37ec1239c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37f1dad640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec123f50 con 0x7f37ec115930 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37f1dad640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec1240c0 con 0x7f37ec110130 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37f1dad640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec124280 con 0x7f37ec10f740 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37ebfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f37ec115930 0x7f37ec1239c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37ebfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f37ec115930 0x7f37ec1239c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44964/0 (socket says 10.20.193.4:44964) 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37ebfff640 1 -- 10.20.193.4:0/3607474333 learned_addr learned my addr 10.20.193.4:0/3607474333 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37ec10f740 0x7f37ec11e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37ebfff640 1 -- 10.20.193.4:0/3607474333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37ec10f740 msgr2=0x7f37ec11e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37ebfff640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37ec10f740 0x7f37ec11e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37ebfff640 1 -- 10.20.193.4:0/3607474333 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37ec110130 msgr2=0x7f37ec11e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37ebfff640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37ec110130 0x7f37ec11e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37ebfff640 1 -- 10.20.193.4:0/3607474333 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d8009570 con 0x7f37ec115930 2026-02-24T09:14:59.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37ebfff640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f37ec115930 0x7f37ec1239c0 secure :-1 s=READY pgs=874 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e000b270 tx=0x7f37e000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:59.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37e8ff9640 1 -- 10.20.193.4:0/3607474333 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37e0008cf0 con 0x7f37ec115930 2026-02-24T09:14:59.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37f1dad640 1 -- 10.20.193.4:0/3607474333 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ec124560 con 0x7f37ec115930 2026-02-24T09:14:59.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37e8ff9640 1 -- 10.20.193.4:0/3607474333 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f37e0008e50 con 0x7f37ec115930 2026-02-24T09:14:59.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37e8ff9640 1 -- 10.20.193.4:0/3607474333 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37e00106b0 con 0x7f37ec115930 2026-02-24T09:14:59.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.275+0000 7f37f1dad640 1 -- 10.20.193.4:0/3607474333 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ec164cf0 con 0x7f37ec115930 2026-02-24T09:14:59.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.277+0000 7f37e8ff9640 1 -- 10.20.193.4:0/3607474333 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f37e0017360 con 0x7f37ec115930 2026-02-24T09:14:59.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.278+0000 7f37e8ff9640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f37c00b56e0 0x7f37c00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.278+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f37c00b56e0 0x7f37c00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.278+0000 7f37e8ff9640 1 -- 10.20.193.4:0/3607474333 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f37e00e7c40 con 0x7f37ec115930 2026-02-24T09:14:59.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.278+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f37c00b56e0 0x7f37c00d5b90 secure :-1 s=READY pgs=366 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d80023d0 tx=0x7f37d8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:59.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.279+0000 7f37f3da7e00 1 Processor -- start 2026-02-24T09:14:59.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.279+0000 7f37f3da7e00 1 -- start start 2026-02-24T09:14:59.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d3ebf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d83890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763da41b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563763c4ede0 con 0x563763d3e820 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563763c4ab10 con 0x563763d3f130 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563763c44ab0 con 0x563763d83dd0 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37eb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d3ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37eb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d3ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44976/0 (socket says 10.20.193.4:44976) 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37eb7fe640 1 -- 10.20.193.4:0/738049781 learned_addr learned my addr 10.20.193.4:0/738049781 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37ebfff640 1 --2- 10.20.193.4:0/738049781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763da41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37eaffd640 1 --2- 10.20.193.4:0/738049781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d83890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37eb7fe640 1 -- 10.20.193.4:0/738049781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 msgr2=0x563763da41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/738049781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763da41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37eb7fe640 1 -- 10.20.193.4:0/738049781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 msgr2=0x563763d83890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/738049781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d83890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37eb7fe640 1 -- 10.20.193.4:0/738049781 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563763bf0310 con 0x563763d3e820 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/738049781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d3ebf0 secure :-1 s=READY pgs=875 gs=1 cs=0 l=1 c_cookie=16737616055639194113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d8002fd0 tx=0x7f37d8040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e847f51f773fba01 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37affff640 1 -- 10.20.193.4:0/738049781 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37d802fc10 con 0x563763d3e820 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37affff640 1 -- 10.20.193.4:0/738049781 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f37d8038650 con 0x563763d3e820 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37affff640 1 -- 10.20.193.4:0/738049781 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37d804fbd0 con 0x563763d3e820 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 -- 10.20.193.4:0/738049781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 msgr2=0x563763d3ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/738049781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d3ebf0 secure :-1 s=READY pgs=875 gs=1 cs=0 l=1 c_cookie=16737616055639194113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d8002fd0 tx=0x7f37d8040000 comp rx=0 tx=0).stop 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 -- 10.20.193.4:0/738049781 shutdown_connections 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/738049781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763da41b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/738049781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d83890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/738049781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d3ebf0 unknown :-1 s=CLOSED pgs=875 gs=1 cs=0 l=1 c_cookie=16737616055639194113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 -- 10.20.193.4:0/738049781 >> 10.20.193.4:0/738049781 conn(0x563763c5d6b0 msgr2=0x563763d3d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:59.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 -- 10.20.193.4:0/738049781 shutdown_connections 2026-02-24T09:14:59.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.280+0000 7f37f3da7e00 1 -- 10.20.193.4:0/738049781 wait complete. 2026-02-24T09:14:59.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.281+0000 7f37f3da7e00 1 -- start start 2026-02-24T09:14:59.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.281+0000 7f37f3da7e00 1 Processor -- start 2026-02-24T09:14:59.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3e820 0x563763d56dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3f130 0x563763d57310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d5c300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563763d5c840 con 0x563763d3f130 2026-02-24T09:14:59.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563763d5c9b0 con 0x563763d3e820 2026-02-24T09:14:59.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563763d5cb70 con 0x563763d83dd0 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3f130 0x563763d57310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3f130 0x563763d57310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44990/0 (socket says 10.20.193.4:44990) 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eaffd640 1 -- 10.20.193.4:0/2126017845 learned_addr learned my addr 10.20.193.4:0/2126017845 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3e820 0x563763d56dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37ebfff640 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d5c300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eaffd640 1 -- 10.20.193.4:0/2126017845 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 msgr2=0x563763d5c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eaffd640 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d5c300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eaffd640 1 -- 10.20.193.4:0/2126017845 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3e820 msgr2=0x563763d56dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eaffd640 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3e820 0x563763d56dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eaffd640 1 -- 10.20.193.4:0/2126017845 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563763bc88c0 con 0x563763d3f130 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3e820 0x563763d56dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37eaffd640 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3f130 0x563763d57310 secure :-1 s=READY pgs=876 gs=1 cs=0 l=1 c_cookie=2039600285009160091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37dc004110 tx=0x7f37dc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4e1da727c1a79b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37ad7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:59.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2126017845 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37dc011660 con 0x563763d3f130 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2126017845 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ec176b70 con 0x563763d3f130 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2126017845 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f37dc011ca0 con 0x563763d3f130 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2126017845 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37dc010e50 con 0x563763d3f130 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2126017845 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f37dc00d370 con 0x563763d3f130 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37ad7fa640 10 client.16914 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 10 client.16914 _ll_register_callbacks cb 0x563763be0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2126017845 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637639944a0 con 0x563763d3f130 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2126017845 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f37dc0117c0 con 0x563763d3f130 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 10 client.16914 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2126017845 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563763bda6e0 con 0x563763d3f130 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.282+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2126017845 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f37dc0119a0 con 0x563763d3f130 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.283+0000 7f37f3da7e00 10 client.16914 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.283+0000 7f37f3da7e00 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:14:59.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.283+0000 7f37f3da7e00 20 client.16914 populate_metadata read hostname 'trial004' 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.283+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563763d816c0 0x563763d81b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.283+0000 7f37f3da7e00 4 client.16914 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.283+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2126017845 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563763c3a4f0 con 0x563763d816c0 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.283+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563763d816c0 0x563763d81b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.283+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563763d816c0 0x563763d81b60 crc :-1 s=READY pgs=125 gs=4 cs=0 l=0 c_cookie=5380095948222657256 s_cookie=4584249417345717989 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aa9f0c28b5472e8 server_cookie=3f9e868e82aed6e5 in_seq=0 out_seq=0 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.283+0000 7f37ad7fa640 10 client.16914 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2126017845 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563763c3a4f0 con 0x563763d816c0 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37ad7fa640 10 client.16914 handle_command_reply: tid=0 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 client.16914 shutdown 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2126017845 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3f130 msgr2=0x563763d57310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3f130 0x563763d57310 secure :-1 s=READY pgs=876 gs=1 cs=0 l=1 c_cookie=2039600285009160091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37dc004110 tx=0x7f37dc00f730 comp rx=0 tx=0).stop 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2126017845 shutdown_connections 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563763d816c0 0x563763d81b60 crc :-1 s=READY pgs=125 gs=4 cs=0 l=0 c_cookie=5380095948222657256 s_cookie=4584249417345717989 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d5c300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3f130 0x563763d57310 unknown :-1 s=CLOSED pgs=876 gs=1 cs=0 l=1 c_cookie=2039600285009160091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37ad7fa640 0 client.16914 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:59.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2126017845 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3e820 0x563763d56dd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2126017845 >> 10.20.193.4:0/2126017845 conn(0x563763c5d6b0 msgr2=0x563763d3d810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:59.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2126017845 shutdown_connections 2026-02-24T09:14:59.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2126017845 wait complete. 2026-02-24T09:14:59.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.284+0000 7f37f3da7e00 20 client.16914 trim_cache size 0 max 16384 2026-02-24T09:14:59.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37f3da7e00 1 Processor -- start 2026-02-24T09:14:59.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37f3da7e00 1 -- start start 2026-02-24T09:14:59.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d543d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d7c730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d7cc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563763c426e0 con 0x563763d3e820 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56376390df50 con 0x563763d3f130 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563763d5c410 con 0x563763d83dd0 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44994/0 (socket says 10.20.193.4:44994) 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eb7fe640 1 -- 10.20.193.4:0/970569565 learned_addr learned my addr 10.20.193.4:0/970569565 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eaffd640 1 --2- 10.20.193.4:0/970569565 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d7c730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eb7fe640 1 -- 10.20.193.4:0/970569565 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 msgr2=0x563763d7cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/970569565 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d7cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eb7fe640 1 -- 10.20.193.4:0/970569565 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 msgr2=0x563763d7c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/970569565 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d7c730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eb7fe640 1 -- 10.20.193.4:0/970569565 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563763bd5160 con 0x563763d3e820 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eaffd640 1 --2- 10.20.193.4:0/970569565 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d7c730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:59.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/970569565 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d543d0 secure :-1 s=READY pgs=877 gs=1 cs=0 l=1 c_cookie=9133188721700849932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d802f6e0 tx=0x7f37d8005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebf9ac0af95490c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37af7fe640 1 -- 10.20.193.4:0/970569565 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37d802f9f0 con 0x563763d3e820 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37af7fe640 1 -- 10.20.193.4:0/970569565 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f37d8048070 con 0x563763d3e820 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.293+0000 7f37af7fe640 1 -- 10.20.193.4:0/970569565 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37d8038d30 con 0x563763d3e820 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 -- 10.20.193.4:0/970569565 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 msgr2=0x563763d543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/970569565 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d543d0 secure :-1 s=READY pgs=877 gs=1 cs=0 l=1 c_cookie=9133188721700849932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d802f6e0 tx=0x7f37d8005af0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 -- 10.20.193.4:0/970569565 shutdown_connections 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/970569565 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d7cc70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/970569565 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d7c730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/970569565 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d543d0 unknown :-1 s=CLOSED pgs=877 gs=1 cs=0 l=1 c_cookie=9133188721700849932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 -- 10.20.193.4:0/970569565 >> 10.20.193.4:0/970569565 conn(0x563763c5d6b0 msgr2=0x563763d3ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 -- 10.20.193.4:0/970569565 shutdown_connections 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 -- 10.20.193.4:0/970569565 wait complete. 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 -- start start 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 Processor -- start 2026-02-24T09:14:59.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.294+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d5e940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d5ee80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d5f3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563763c426e0 con 0x563763d3e820 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563763de9490 con 0x563763d3f130 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563763de9650 con 0x563763d83dd0 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37eb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d5e940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37eb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d5e940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45004/0 (socket says 10.20.193.4:45004) 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37eb7fe640 1 -- 10.20.193.4:0/2008770641 learned_addr learned my addr 10.20.193.4:0/2008770641 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37ebfff640 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d5f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37eb7fe640 1 -- 10.20.193.4:0/2008770641 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 msgr2=0x563763d5f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d5f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37eb7fe640 1 -- 10.20.193.4:0/2008770641 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 msgr2=0x563763d5ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d5ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37eb7fe640 1 -- 10.20.193.4:0/2008770641 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563763bc8bf0 con 0x563763d3e820 2026-02-24T09:14:59.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37ebfff640 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d5f3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37eb7fe640 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d5e940 secure :-1 s=READY pgs=878 gs=1 cs=0 l=1 c_cookie=10218974532951189367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d80047f0 tx=0x7f37d8005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd11731fd51a777 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37ad7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2008770641 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37d8038cb0 con 0x563763d3e820 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2008770641 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563763bf0310 con 0x563763d3e820 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2008770641 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f37d8038e10 con 0x563763d3e820 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2008770641 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37d805ab40 con 0x563763d3e820 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 10 client.16920 _ll_register_callbacks cb 0x563763be0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2008770641 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637638cff40 con 0x563763d3e820 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2008770641 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f37d805acd0 con 0x563763d3e820 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2008770641 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f37d806f460 con 0x563763d3e820 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 10 client.16920 fetch_fsmap learned FSMap version 19 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2008770641 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563763bda940 con 0x563763d3e820 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2008770641 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f37d8062040 con 0x563763d3e820 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 10 client.16920 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 10 client.16920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:14:59.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 20 client.16920 populate_metadata read hostname 'trial004' 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563763e310b0 0x563763e51560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 4 client.16920 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.295+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2008770641 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f37d8038650 con 0x563763e310b0 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.296+0000 7f37eaffd640 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563763e310b0 0x563763e51560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.296+0000 7f37eaffd640 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563763e310b0 0x563763e51560 crc :-1 s=READY pgs=126 gs=4 cs=0 l=0 c_cookie=14023988818612550181 s_cookie=5821746424612735870 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c29f37873b737a25 server_cookie=50caff873b714b7e in_seq=0 out_seq=0 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.296+0000 7f37ad7fa640 10 client.16920 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37ad7fa640 1 -- 10.20.193.4:0/2008770641 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x7f37d8038650 con 0x563763e310b0 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37ad7fa640 10 client.16920 handle_command_reply: tid=0 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 client.16920 shutdown 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2008770641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 msgr2=0x563763d5e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d5e940 secure :-1 s=READY pgs=878 gs=1 cs=0 l=1 c_cookie=10218974532951189367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d80047f0 tx=0x7f37d8005fa0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2008770641 shutdown_connections 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563763e310b0 0x563763e51560 crc :-1 s=READY pgs=126 gs=4 cs=0 l=0 c_cookie=14023988818612550181 s_cookie=5821746424612735870 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563763d83dd0 0x563763d5f3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563763d3f130 0x563763d5ee80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 --2- 10.20.193.4:0/2008770641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563763d3e820 0x563763d5e940 unknown :-1 s=CLOSED pgs=878 gs=1 cs=0 l=1 c_cookie=10218974532951189367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37ad7fa640 0 client.16920 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2008770641 >> 10.20.193.4:0/2008770641 conn(0x563763c5d6b0 msgr2=0x563763d3d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2008770641 shutdown_connections 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 1 -- 10.20.193.4:0/2008770641 wait complete. 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f3da7e00 20 client.16920 trim_cache size 0 max 16384 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:14:59.308 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:14:59.309 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:59.310 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:59.311 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:59.312 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:14:59.313 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 -- 10.20.193.4:0/3607474333 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f37c00b56e0 msgr2=0x7f37c00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f37c00b56e0 0x7f37c00d5b90 secure :-1 s=READY pgs=366 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d80023d0 tx=0x7f37d8031040 comp rx=0 tx=0).stop 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 -- 10.20.193.4:0/3607474333 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f37ec115930 msgr2=0x7f37ec1239c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f37ec115930 0x7f37ec1239c0 secure :-1 s=READY pgs=874 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e000b270 tx=0x7f37e000de70 comp rx=0 tx=0).stop 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 -- 10.20.193.4:0/3607474333 shutdown_connections 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f37c00b56e0 0x7f37c00d5b90 unknown :-1 s=CLOSED pgs=366 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f37ec115930 0x7f37ec1239c0 unknown :-1 s=CLOSED pgs=874 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f37ec110130 0x7f37ec11e5f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 --2- 10.20.193.4:0/3607474333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37ec10f740 0x7f37ec11e0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 -- 10.20.193.4:0/3607474333 >> 10.20.193.4:0/3607474333 conn(0x7f37ec0ed050 msgr2=0x7f37ec10d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 -- 10.20.193.4:0/3607474333 shutdown_connections 2026-02-24T09:14:59.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.297+0000 7f37f1dad640 1 -- 10.20.193.4:0/3607474333 wait complete. 2026-02-24T09:14:59.334 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:14:59.334 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:14:59.493 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:59.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.595+0000 7ff105a56640 1 -- 10.20.193.4:0/4065056821 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff100113200 msgr2=0x7ff100173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.595+0000 7ff105a56640 1 --2- 10.20.193.4:0/4065056821 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff100113200 0x7ff100173bd0 secure :-1 s=READY pgs=879 gs=1 cs=0 l=1 c_cookie=14262413821608719120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f000aa30 tx=0x7ff0f0030280 comp rx=0 tx=0).stop 2026-02-24T09:14:59.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.595+0000 7ff105a56640 1 -- 10.20.193.4:0/4065056821 shutdown_connections 2026-02-24T09:14:59.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.595+0000 7ff105a56640 1 --2- 10.20.193.4:0/4065056821 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff100113200 0x7ff100173bd0 unknown :-1 s=CLOSED pgs=879 gs=1 cs=0 l=1 c_cookie=14262413821608719120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.595+0000 7ff105a56640 1 --2- 10.20.193.4:0/4065056821 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff10010da00 0x7ff100112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.595+0000 7ff105a56640 1 --2- 10.20.193.4:0/4065056821 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff10010d010 0x7ff10010d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.595+0000 7ff105a56640 1 -- 10.20.193.4:0/4065056821 >> 10.20.193.4:0/4065056821 conn(0x7ff10005f830 msgr2=0x7ff10010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.595+0000 7ff105a56640 1 -- 10.20.193.4:0/4065056821 shutdown_connections 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff105a56640 1 -- 10.20.193.4:0/4065056821 wait complete. 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff105a56640 1 Processor -- start 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff105a56640 1 -- start start 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff105a56640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff10010d010 0x7ff1000f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff105a56640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff10010da00 0x7ff100173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff105a56640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff100113200 0x7ff1000f5cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff105a56640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff1000fae70 con 0x7ff10010da00 2026-02-24T09:14:59.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff105a56640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff1000fafe0 con 0x7ff100113200 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff105a56640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff1000fb1a0 con 0x7ff10010d010 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff0fe7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff10010da00 0x7ff100173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff0fe7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff10010da00 0x7ff100173ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45024/0 (socket says 10.20.193.4:45024) 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff0fe7fc640 1 -- 10.20.193.4:0/4092156039 learned_addr learned my addr 10.20.193.4:0/4092156039 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff0fe7fc640 1 -- 10.20.193.4:0/4092156039 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff10010d010 msgr2=0x7ff1000f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff0fe7fc640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff10010d010 0x7ff1000f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff0fe7fc640 1 -- 10.20.193.4:0/4092156039 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff100113200 msgr2=0x7ff1000f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff0fe7fc640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff100113200 0x7ff1000f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff0fe7fc640 1 -- 10.20.193.4:0/4092156039 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f000a650 con 0x7ff10010da00 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.596+0000 7ff0fe7fc640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff10010da00 0x7ff100173ad0 secure :-1 s=READY pgs=880 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0e8005db0 tx=0x7ff0e800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.597+0000 7ff104a54640 1 -- 10.20.193.4:0/4092156039 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0e8004500 con 0x7ff10010da00 2026-02-24T09:14:59.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.597+0000 7ff104a54640 1 -- 10.20.193.4:0/4092156039 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff0e8004d30 con 0x7ff10010da00 2026-02-24T09:14:59.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.597+0000 7ff105a56640 1 -- 10.20.193.4:0/4092156039 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1000fb480 con 0x7ff10010da00 2026-02-24T09:14:59.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.597+0000 7ff104a54640 1 -- 10.20.193.4:0/4092156039 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0e8005310 con 0x7ff10010da00 2026-02-24T09:14:59.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.597+0000 7ff105a56640 1 -- 10.20.193.4:0/4092156039 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1000fb900 con 0x7ff10010da00 2026-02-24T09:14:59.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.597+0000 7ff105a56640 1 -- 10.20.193.4:0/4092156039 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff10010e2f0 con 0x7ff10010da00 2026-02-24T09:14:59.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.598+0000 7ff104a54640 1 -- 10.20.193.4:0/4092156039 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff0e80054a0 con 0x7ff10010da00 2026-02-24T09:14:59.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.599+0000 7ff104a54640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff0d40b56d0 0x7ff0d40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.599+0000 7ff104a54640 1 -- 10.20.193.4:0/4092156039 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff0e80e7160 con 0x7ff10010da00 2026-02-24T09:14:59.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.599+0000 7ff0feffd640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff0d40b56d0 0x7ff0d40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.599+0000 7ff0feffd640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff0d40b56d0 0x7ff0d40d5b80 secure :-1 s=READY pgs=367 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f4004740 tx=0x7ff0f4009690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:59.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.599+0000 7ff104a54640 1 -- 10.20.193.4:0/4092156039 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff0e80a9ae0 con 0x7ff10010da00 2026-02-24T09:14:59.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.731+0000 7ff105a56640 1 -- 10.20.193.4:0/4092156039 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1000fbb20 con 0x7ff10010da00 2026-02-24T09:14:59.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.732+0000 7ff104a54640 1 -- 10.20.193.4:0/4092156039 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7ff0e80acc90 con 0x7ff10010da00 2026-02-24T09:14:59.735 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:14:59.735 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:14:59.736 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:14:59.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 -- 10.20.193.4:0/4092156039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff0d40b56d0 msgr2=0x7ff0d40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff0d40b56d0 0x7ff0d40d5b80 secure :-1 s=READY pgs=367 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0f4004740 tx=0x7ff0f4009690 comp rx=0 tx=0).stop 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 -- 10.20.193.4:0/4092156039 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff10010da00 msgr2=0x7ff100173ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff10010da00 0x7ff100173ad0 secure :-1 s=READY pgs=880 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0e8005db0 tx=0x7ff0e800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 -- 10.20.193.4:0/4092156039 shutdown_connections 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff0d40b56d0 0x7ff0d40d5b80 unknown :-1 s=CLOSED pgs=367 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff100113200 0x7ff1000f5cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff10010da00 0x7ff100173ad0 unknown :-1 s=CLOSED pgs=880 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 --2- 10.20.193.4:0/4092156039 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff10010d010 0x7ff1000f55b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 -- 10.20.193.4:0/4092156039 >> 10.20.193.4:0/4092156039 conn(0x7ff10005f830 msgr2=0x7ff1001100c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 -- 10.20.193.4:0/4092156039 shutdown_connections 2026-02-24T09:14:59.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.733+0000 7ff105a56640 1 -- 10.20.193.4:0/4092156039 wait complete. 2026-02-24T09:14:59.772 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:14:59.887 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:14:59.908 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:14:59 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4092156039' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:14:59.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.987+0000 7fdd0a383640 1 -- 10.20.193.4:0/2261445419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd04110040 msgr2=0x7fdd04115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.987+0000 7fdd0a383640 1 --2- 10.20.193.4:0/2261445419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd04110040 0x7fdd04115090 secure :-1 s=READY pgs=881 gs=1 cs=0 l=1 c_cookie=462438536328966584 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf4009950 tx=0x7fdcf402f190 comp rx=0 tx=0).stop 2026-02-24T09:14:59.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.987+0000 7fdd0a383640 1 -- 10.20.193.4:0/2261445419 shutdown_connections 2026-02-24T09:14:59.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.987+0000 7fdd0a383640 1 --2- 10.20.193.4:0/2261445419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd04115840 0x7fdd04176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.987+0000 7fdd0a383640 1 --2- 10.20.193.4:0/2261445419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd04110040 0x7fdd04115090 unknown :-1 s=CLOSED pgs=881 gs=1 cs=0 l=1 c_cookie=462438536328966584 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.987+0000 7fdd0a383640 1 --2- 10.20.193.4:0/2261445419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd0410f650 0x7fdd0410fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.987+0000 7fdd0a383640 1 -- 10.20.193.4:0/2261445419 >> 10.20.193.4:0/2261445419 conn(0x7fdd040ecf20 msgr2=0x7fdd0410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.987+0000 7fdd0a383640 1 -- 10.20.193.4:0/2261445419 shutdown_connections 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.987+0000 7fdd0a383640 1 -- 10.20.193.4:0/2261445419 wait complete. 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd0a383640 1 Processor -- start 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd0a383640 1 -- start start 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd0a383640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd0410f650 0x7fdd040f58a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd0a383640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd04110040 0x7fdd04176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd0a383640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd04115840 0x7fdd040f5fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd0a383640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040fb1b0 con 0x7fdd0410f650 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd0a383640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040fb320 con 0x7fdd04115840 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd0a383640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040fb4e0 con 0x7fdd04110040 2026-02-24T09:14:59.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd03fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd0410f650 0x7fdd040f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd03fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd0410f650 0x7fdd040f58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45050/0 (socket says 10.20.193.4:45050) 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd03fff640 1 -- 10.20.193.4:0/393335157 learned_addr learned my addr 10.20.193.4:0/393335157 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd088f9640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd04115840 0x7fdd040f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd037fe640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd04110040 0x7fdd04176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd03fff640 1 -- 10.20.193.4:0/393335157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd04110040 msgr2=0x7fdd04176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd03fff640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd04110040 0x7fdd04176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd03fff640 1 -- 10.20.193.4:0/393335157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd04115840 msgr2=0x7fdd040f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd03fff640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd04115840 0x7fdd040f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd03fff640 1 -- 10.20.193.4:0/393335157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf4009570 con 0x7fdd0410f650 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd088f9640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd04115840 0x7fdd040f5fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd03fff640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd0410f650 0x7fdd040f58a0 secure :-1 s=READY pgs=882 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf0005db0 tx=0x7fdcf000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:14:59.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd017fa640 1 -- 10.20.193.4:0/393335157 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcf0004500 con 0x7fdd0410f650 2026-02-24T09:14:59.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd017fa640 1 -- 10.20.193.4:0/393335157 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcf0004d30 con 0x7fdd0410f650 2026-02-24T09:14:59.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd017fa640 1 -- 10.20.193.4:0/393335157 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcf0005310 con 0x7fdd0410f650 2026-02-24T09:14:59.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd0a383640 1 -- 10.20.193.4:0/393335157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd040fb7c0 con 0x7fdd0410f650 2026-02-24T09:14:59.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.988+0000 7fdd0a383640 1 -- 10.20.193.4:0/393335157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd040fbc40 con 0x7fdd0410f650 2026-02-24T09:15:00.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.990+0000 7fdd017fa640 1 -- 10.20.193.4:0/393335157 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fdcf00054a0 con 0x7fdd0410f650 2026-02-24T09:15:00.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.991+0000 7fdd017fa640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcd80b5760 0x7fdcd80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.991+0000 7fdd037fe640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcd80b5760 0x7fdcd80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.991+0000 7fdd017fa640 1 -- 10.20.193.4:0/393335157 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fdcf00e6c90 con 0x7fdd0410f650 2026-02-24T09:15:00.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.991+0000 7fdd037fe640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcd80b5760 0x7fdcd80d5c10 secure :-1 s=READY pgs=368 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf40023d0 tx=0x7fdcf4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd0c37de00 1 Processor -- start 2026-02-24T09:15:00.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd0c37de00 1 -- start start 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de585320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de585860 0x5643de5c9fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5ca500 0x5643de5ea8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5643de495ee0 con 0x5643de584f50 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5643de491c10 con 0x5643de585860 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5643de48bd70 con 0x5643de5ca500 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd03fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de585320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd03fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de585320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45056/0 (socket says 10.20.193.4:45056) 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd03fff640 1 -- 10.20.193.4:0/3957549116 learned_addr learned my addr 10.20.193.4:0/3957549116 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd088f9640 1 --2- 10.20.193.4:0/3957549116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5ca500 0x5643de5ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd037fe640 1 --2- 10.20.193.4:0/3957549116 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de585860 0x5643de5c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd03fff640 1 -- 10.20.193.4:0/3957549116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5ca500 msgr2=0x5643de5ea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd03fff640 1 --2- 10.20.193.4:0/3957549116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5ca500 0x5643de5ea8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd03fff640 1 -- 10.20.193.4:0/3957549116 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de585860 msgr2=0x5643de5c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd03fff640 1 --2- 10.20.193.4:0/3957549116 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de585860 0x5643de5c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd03fff640 1 -- 10.20.193.4:0/3957549116 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643de437340 con 0x5643de584f50 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.992+0000 7fdd03fff640 1 --2- 10.20.193.4:0/3957549116 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de585320 secure :-1 s=READY pgs=883 gs=1 cs=0 l=1 c_cookie=8625909839035390721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf0005aa0 tx=0x7fdcf0009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b5634bec405b01 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdcd4ce3640 1 -- 10.20.193.4:0/3957549116 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcf000e350 con 0x5643de584f50 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdcd4ce3640 1 -- 10.20.193.4:0/3957549116 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcf00ad9c0 con 0x5643de584f50 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdcd4ce3640 1 -- 10.20.193.4:0/3957549116 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcf00d20d0 con 0x5643de584f50 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3957549116 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 msgr2=0x5643de585320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/3957549116 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de585320 secure :-1 s=READY pgs=883 gs=1 cs=0 l=1 c_cookie=8625909839035390721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf0005aa0 tx=0x7fdcf0009890 comp rx=0 tx=0).stop 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3957549116 shutdown_connections 2026-02-24T09:15:00.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/3957549116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5ca500 0x5643de5ea8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/3957549116 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de585860 0x5643de5c9fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/3957549116 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de585320 unknown :-1 s=CLOSED pgs=883 gs=1 cs=0 l=1 c_cookie=8625909839035390721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3957549116 >> 10.20.193.4:0/3957549116 conn(0x5643de4a3db0 msgr2=0x5643de583830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3957549116 shutdown_connections 2026-02-24T09:15:00.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.993+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3957549116 wait complete. 2026-02-24T09:15:00.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd0c37de00 1 -- start start 2026-02-24T09:15:00.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd0c37de00 1 Processor -- start 2026-02-24T09:15:00.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 0x5643de5e1d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de585860 0x5643de5e22b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de5ca500 0x5643de5e72a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5643de5e77e0 con 0x5643de5ca500 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5643de5e7950 con 0x5643de584f50 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5643de5e7b10 con 0x5643de585860 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd088f9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de5ca500 0x5643de5e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd088f9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de5ca500 0x5643de5e72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45068/0 (socket says 10.20.193.4:45068) 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd088f9640 1 -- 10.20.193.4:0/3358168574 learned_addr learned my addr 10.20.193.4:0/3358168574 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd037fe640 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de585860 0x5643de5e22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd03fff640 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 0x5643de5e1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd088f9640 1 -- 10.20.193.4:0/3358168574 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de585860 msgr2=0x5643de5e22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd088f9640 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de585860 0x5643de5e22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd088f9640 1 -- 10.20.193.4:0/3358168574 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 msgr2=0x5643de5e1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd088f9640 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 0x5643de5e1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd088f9640 1 -- 10.20.193.4:0/3358168574 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643de40f9d0 con 0x5643de5ca500 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd088f9640 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de5ca500 0x5643de5e72a0 secure :-1 s=READY pgs=884 gs=1 cs=0 l=1 c_cookie=12744222624351541960 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf80126e0 tx=0x7fdcf8012bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dc92f47ef85ac8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdcc5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/3358168574 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcf8010b60 con 0x5643de5ca500 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/3358168574 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcf8010cc0 con 0x5643de5ca500 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3358168574 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd040fbc40 con 0x5643de5ca500 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/3358168574 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcf801a6a0 con 0x5643de5ca500 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.994+0000 7fdd0c37de00 10 client.16938 _ll_register_callbacks cb 0x5643de436080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3358168574 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5643de1db4a0 con 0x5643de5ca500 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/3358168574 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fdcf801a830 con 0x5643de5ca500 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/3358168574 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdcf801aa80 con 0x5643de5ca500 2026-02-24T09:15:00.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdd0c37de00 10 client.16938 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3358168574 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5643de421710 con 0x5643de5ca500 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/3358168574 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fdcf8022060 con 0x5643de5ca500 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdd0c37de00 10 client.16938 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdd0c37de00 10 client.16938 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdd0c37de00 20 client.16938 populate_metadata read hostname 'trial004' 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5643de5c77d0 0x5643de5c7c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdd0c37de00 4 client.16938 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3358168574 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643de4817b0 con 0x5643de5c77d0 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.995+0000 7fdd03fff640 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5643de5c77d0 0x5643de5c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.996+0000 7fdd03fff640 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5643de5c77d0 0x5643de5c7c70 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=2236948708945494911 s_cookie=1752579556536592627 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f0b3cffb977037f server_cookie=185269d233f9a8f3 in_seq=0 out_seq=0 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.996+0000 7fdcc5ffb640 10 client.16938 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/3358168574 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5643de4817b0 con 0x5643de5c77d0 2026-02-24T09:15:00.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdcc5ffb640 10 client.16938 handle_command_reply: tid=0 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 client.16938 shutdown 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3358168574 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de5ca500 msgr2=0x5643de5e72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de5ca500 0x5643de5e72a0 secure :-1 s=READY pgs=884 gs=1 cs=0 l=1 c_cookie=12744222624351541960 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf80126e0 tx=0x7fdcf8012bb0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3358168574 shutdown_connections 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5643de5c77d0 0x5643de5c7c70 crc :-1 s=READY pgs=40 gs=4 cs=0 l=0 c_cookie=2236948708945494911 s_cookie=1752579556536592627 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de5ca500 0x5643de5e72a0 unknown :-1 s=CLOSED pgs=884 gs=1 cs=0 l=1 c_cookie=12744222624351541960 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdcc5ffb640 0 client.16938 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de585860 0x5643de5e22b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/3358168574 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 0x5643de5e1d70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3358168574 >> 10.20.193.4:0/3358168574 conn(0x5643de4a3db0 msgr2=0x5643de583040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3358168574 shutdown_connections 2026-02-24T09:15:00.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 1 -- 10.20.193.4:0/3358168574 wait complete. 2026-02-24T09:15:00.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:14:59.997+0000 7fdd0c37de00 20 client.16938 trim_cache size 0 max 16384 2026-02-24T09:15:00.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd0c37de00 1 Processor -- start 2026-02-24T09:15:00.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd0c37de00 1 -- start start 2026-02-24T09:15:00.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 0x5643de5df050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de585860 0x5643de5df590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5c77d0 0x5643de5c5160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5643de4899a0 con 0x5643de585860 2026-02-24T09:15:00.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5643de265df0 con 0x5643de584f50 2026-02-24T09:15:00.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5643de5cf5a0 con 0x5643de5c77d0 2026-02-24T09:15:00.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd037fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de585860 0x5643de5df590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd037fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de585860 0x5643de5df590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45070/0 (socket says 10.20.193.4:45070) 2026-02-24T09:15:00.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd037fe640 1 -- 10.20.193.4:0/18093525 learned_addr learned my addr 10.20.193.4:0/18093525 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd088f9640 1 --2- 10.20.193.4:0/18093525 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5c77d0 0x5643de5c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd037fe640 1 -- 10.20.193.4:0/18093525 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5c77d0 msgr2=0x5643de5c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd037fe640 1 --2- 10.20.193.4:0/18093525 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5c77d0 0x5643de5c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd037fe640 1 -- 10.20.193.4:0/18093525 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 msgr2=0x5643de5df050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd03fff640 1 --2- 10.20.193.4:0/18093525 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 0x5643de5df050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd037fe640 1 --2- 10.20.193.4:0/18093525 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 0x5643de5df050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.004+0000 7fdd037fe640 1 -- 10.20.193.4:0/18093525 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643de5d43d0 con 0x5643de585860 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd03fff640 1 --2- 10.20.193.4:0/18093525 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 0x5643de5df050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd037fe640 1 --2- 10.20.193.4:0/18093525 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de585860 0x5643de5df590 secure :-1 s=READY pgs=885 gs=1 cs=0 l=1 c_cookie=9085550564528994072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf402f6a0 tx=0x7fdcf403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e165c19e399b718 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdcc7fff640 1 -- 10.20.193.4:0/18093525 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcf402f9f0 con 0x5643de585860 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdcc7fff640 1 -- 10.20.193.4:0/18093525 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcf4038e00 con 0x5643de585860 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdcc7fff640 1 -- 10.20.193.4:0/18093525 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcf4051a80 con 0x5643de585860 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd0c37de00 1 -- 10.20.193.4:0/18093525 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de585860 msgr2=0x5643de5df590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/18093525 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de585860 0x5643de5df590 secure :-1 s=READY pgs=885 gs=1 cs=0 l=1 c_cookie=9085550564528994072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf402f6a0 tx=0x7fdcf403b000 comp rx=0 tx=0).stop 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd0c37de00 1 -- 10.20.193.4:0/18093525 shutdown_connections 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/18093525 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5c77d0 0x5643de5c5160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/18093525 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de585860 0x5643de5df590 unknown :-1 s=CLOSED pgs=885 gs=1 cs=0 l=1 c_cookie=9085550564528994072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/18093525 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de584f50 0x5643de5df050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd0c37de00 1 -- 10.20.193.4:0/18093525 >> 10.20.193.4:0/18093525 conn(0x5643de4a3db0 msgr2=0x5643de5de940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd0c37de00 1 -- 10.20.193.4:0/18093525 shutdown_connections 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.005+0000 7fdd0c37de00 1 -- 10.20.193.4:0/18093525 wait complete. 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 1 -- start start 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 1 Processor -- start 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de5647f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de585860 0x5643de564d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5c77d0 0x5643de565290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5643de5c7260 con 0x5643de584f50 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5643de6302c0 con 0x5643de585860 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5643de630480 con 0x5643de5c77d0 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd03fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de5647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd03fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de5647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45076/0 (socket says 10.20.193.4:45076) 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd03fff640 1 -- 10.20.193.4:0/2644015525 learned_addr learned my addr 10.20.193.4:0/2644015525 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd03fff640 1 -- 10.20.193.4:0/2644015525 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5c77d0 msgr2=0x5643de565290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd03fff640 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5c77d0 0x5643de565290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd03fff640 1 -- 10.20.193.4:0/2644015525 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de585860 msgr2=0x5643de564d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd03fff640 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de585860 0x5643de564d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd03fff640 1 -- 10.20.193.4:0/2644015525 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643de41c190 con 0x5643de584f50 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd03fff640 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de5647f0 secure :-1 s=READY pgs=886 gs=1 cs=0 l=1 c_cookie=15386887102632258942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf00040a0 tx=0x7fdcf0009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d589344bef6f6d7e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdcc5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:00.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/2644015525 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcf00b52c0 con 0x5643de584f50 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/2644015525 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcf00a9230 con 0x5643de584f50 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/2644015525 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcf00adc50 con 0x5643de584f50 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 1 -- 10.20.193.4:0/2644015525 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf404c040 con 0x5643de584f50 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/2644015525 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fdcf0070040 con 0x5643de584f50 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdcc5ffb640 10 client.16944 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 10 client.16944 _ll_register_callbacks cb 0x5643de436080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.006+0000 7fdd0c37de00 1 -- 10.20.193.4:0/2644015525 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf00ad9c0 con 0x5643de584f50 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/2644015525 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdcf00d20d0 con 0x5643de584f50 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 10 client.16944 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 1 -- 10.20.193.4:0/2644015525 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5643de40fd00 con 0x5643de584f50 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/2644015525 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fdcf00b7c70 con 0x5643de584f50 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 10 client.16944 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 10 client.16944 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 20 client.16944 populate_metadata read hostname 'trial004' 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5643de5ca500 0x5643de698030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 4 client.16944 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 1 -- 10.20.193.4:0/2644015525 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643de1c0160 con 0x5643de5ca500 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd037fe640 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5643de5ca500 0x5643de698030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd037fe640 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5643de5ca500 0x5643de698030 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=10267201601319805482 s_cookie=2150412506696002489 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8e7c6d755bfd222a server_cookie=1dd7ccc80e2c2bb9 in_seq=0 out_seq=0 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdcc5ffb640 10 client.16944 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdcc5ffb640 1 -- 10.20.193.4:0/2644015525 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643de1c0160 con 0x5643de5ca500 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdcc5ffb640 10 client.16944 handle_command_reply: tid=0 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 1 client.16944 shutdown 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 1 -- 10.20.193.4:0/2644015525 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 msgr2=0x5643de5647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.007+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de5647f0 secure :-1 s=READY pgs=886 gs=1 cs=0 l=1 c_cookie=15386887102632258942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf00040a0 tx=0x7fdcf0009d40 comp rx=0 tx=0).stop 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0c37de00 1 -- 10.20.193.4:0/2644015525 shutdown_connections 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5643de5ca500 0x5643de698030 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=10267201601319805482 s_cookie=2150412506696002489 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5643de5c77d0 0x5643de565290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdcc5ffb640 0 client.16944 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5643de585860 0x5643de564d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0c37de00 1 --2- 10.20.193.4:0/2644015525 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5643de584f50 0x5643de5647f0 unknown :-1 s=CLOSED pgs=886 gs=1 cs=0 l=1 c_cookie=15386887102632258942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0c37de00 1 -- 10.20.193.4:0/2644015525 >> 10.20.193.4:0/2644015525 conn(0x5643de4a3db0 msgr2=0x5643de5df050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0c37de00 1 -- 10.20.193.4:0/2644015525 shutdown_connections 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0c37de00 1 -- 10.20.193.4:0/2644015525 wait complete. 2026-02-24T09:15:00.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0c37de00 20 client.16944 trim_cache size 0 max 16384 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 -- 10.20.193.4:0/393335157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcd80b5760 msgr2=0x7fdcd80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcd80b5760 0x7fdcd80d5c10 secure :-1 s=READY pgs=368 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf40023d0 tx=0x7fdcf4031040 comp rx=0 tx=0).stop 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 -- 10.20.193.4:0/393335157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd0410f650 msgr2=0x7fdd040f58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd0410f650 0x7fdd040f58a0 secure :-1 s=READY pgs=882 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf0005db0 tx=0x7fdcf000ddf0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 -- 10.20.193.4:0/393335157 shutdown_connections 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fdcd80b5760 0x7fdcd80d5c10 unknown :-1 s=CLOSED pgs=368 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fdd04115840 0x7fdd040f5fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd04110040 0x7fdd04176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 --2- 10.20.193.4:0/393335157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fdd0410f650 0x7fdd040f58a0 unknown :-1 s=CLOSED pgs=882 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 -- 10.20.193.4:0/393335157 >> 10.20.193.4:0/393335157 conn(0x7fdd040ecf20 msgr2=0x7fdd0410dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 -- 10.20.193.4:0/393335157 shutdown_connections 2026-02-24T09:15:00.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.008+0000 7fdd0a383640 1 -- 10.20.193.4:0/393335157 wait complete. 2026-02-24T09:15:00.044 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:15:00.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:14:59 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4092156039' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:15:00.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:14:59 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4092156039' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:15:00.158 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:00.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 -- 10.20.193.4:0/4270973838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbab0119dc0 msgr2=0x7fbab017a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 --2- 10.20.193.4:0/4270973838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbab0119dc0 0x7fbab017a790 secure :-1 s=READY pgs=887 gs=1 cs=0 l=1 c_cookie=11500519450297490645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaac00aa30 tx=0x7fbaac030280 comp rx=0 tx=0).stop 2026-02-24T09:15:00.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 -- 10.20.193.4:0/4270973838 shutdown_connections 2026-02-24T09:15:00.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 --2- 10.20.193.4:0/4270973838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbab0119dc0 0x7fbab017a790 unknown :-1 s=CLOSED pgs=887 gs=1 cs=0 l=1 c_cookie=11500519450297490645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 --2- 10.20.193.4:0/4270973838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbab0114a10 0x7fbab0119610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 --2- 10.20.193.4:0/4270973838 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbab0114020 0x7fbab01143f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 -- 10.20.193.4:0/4270973838 >> 10.20.193.4:0/4270973838 conn(0x7fbab0064c50 msgr2=0x7fbab0065050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 -- 10.20.193.4:0/4270973838 shutdown_connections 2026-02-24T09:15:00.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 -- 10.20.193.4:0/4270973838 wait complete. 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 Processor -- start 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 -- start start 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbab0114020 0x7fbab0122440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.256+0000 7fbab6e87640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbab0114a10 0x7fbab0122980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab6e87640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbab0119dc0 0x7fbab0127d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab6e87640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbab01282e0 con 0x7fbab0114020 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab6e87640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbab0128450 con 0x7fbab0119dc0 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab6e87640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbab0128610 con 0x7fbab0114a10 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab4bfc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbab0114020 0x7fbab0122440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab4bfc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbab0114020 0x7fbab0122440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45094/0 (socket says 10.20.193.4:45094) 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab4bfc640 1 -- 10.20.193.4:0/3611491289 learned_addr learned my addr 10.20.193.4:0/3611491289 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbab0114a10 0x7fbab0122980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab53fd640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbab0119dc0 0x7fbab0127d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab4bfc640 1 -- 10.20.193.4:0/3611491289 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbab0114a10 msgr2=0x7fbab0122980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbab0114a10 0x7fbab0122980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab4bfc640 1 -- 10.20.193.4:0/3611491289 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbab0119dc0 msgr2=0x7fbab0127d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbab0119dc0 0x7fbab0127d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab4bfc640 1 -- 10.20.193.4:0/3611491289 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac00a650 con 0x7fbab0114020 2026-02-24T09:15:00.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab53fd640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbab0119dc0 0x7fbab0127d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:15:00.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbab0114020 0x7fbab0122440 secure :-1 s=READY pgs=888 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaa000c9b0 tx=0x7fbaa000ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbaa5ffb640 1 -- 10.20.193.4:0/3611491289 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaa00044a0 con 0x7fbab0114020 2026-02-24T09:15:00.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab6e87640 1 -- 10.20.193.4:0/3611491289 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab01288f0 con 0x7fbab0114020 2026-02-24T09:15:00.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbaa5ffb640 1 -- 10.20.193.4:0/3611491289 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbaa0007da0 con 0x7fbab0114020 2026-02-24T09:15:00.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbaa5ffb640 1 -- 10.20.193.4:0/3611491289 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaa000f6d0 con 0x7fbab0114020 2026-02-24T09:15:00.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.257+0000 7fbab6e87640 1 -- 10.20.193.4:0/3611491289 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab0169080 con 0x7fbab0114020 2026-02-24T09:15:00.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.259+0000 7fbaa5ffb640 1 -- 10.20.193.4:0/3611491289 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fbaa000f860 con 0x7fbab0114020 2026-02-24T09:15:00.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.260+0000 7fbaa5ffb640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba8c0b56e0 0x7fba8c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.260+0000 7fbaa5ffb640 1 -- 10.20.193.4:0/3611491289 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fbaa00e6ad0 con 0x7fbab0114020 2026-02-24T09:15:00.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.260+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba8c0b56e0 0x7fba8c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.260+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba8c0b56e0 0x7fba8c0d5b90 secure :-1 s=READY pgs=369 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbab0128de0 tx=0x7fba98005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbab8e81e00 1 Processor -- start 2026-02-24T09:15:00.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbab8e81e00 1 -- start start 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10b8f50 0x55cda10b9320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10fdfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 0x55cda111e8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55cda0fc9ee0 con 0x55cda10b9860 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55cda0fc5c10 con 0x55cda10fe500 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55cda0fbfd70 con 0x55cda10b8f50 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbaa7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10fdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbaa7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10fdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45106/0 (socket says 10.20.193.4:45106) 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbaa7fff640 1 -- 10.20.193.4:0/4216645871 learned_addr learned my addr 10.20.193.4:0/4216645871 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/4216645871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10b8f50 0x55cda10b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbab53fd640 1 --2- 10.20.193.4:0/4216645871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 0x55cda111e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbaa7fff640 1 -- 10.20.193.4:0/4216645871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10b8f50 msgr2=0x55cda10b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/4216645871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10b8f50 0x55cda10b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbaa7fff640 1 -- 10.20.193.4:0/4216645871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 msgr2=0x55cda111e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/4216645871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 0x55cda111e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbaa7fff640 1 -- 10.20.193.4:0/4216645871 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda0f6b340 con 0x55cda10b9860 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/4216645871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10fdfc0 secure :-1 s=READY pgs=889 gs=1 cs=0 l=1 c_cookie=113271764693316818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba98004200 tx=0x7fba98014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1926c11e1a074d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.261+0000 7fba7d4e4640 1 -- 10.20.193.4:0/4216645871 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba98011e60 con 0x55cda10b9860 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fba7d4e4640 1 -- 10.20.193.4:0/4216645871 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba98009d70 con 0x55cda10b9860 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fba7d4e4640 1 -- 10.20.193.4:0/4216645871 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba9801b920 con 0x55cda10b9860 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fbab8e81e00 1 -- 10.20.193.4:0/4216645871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 msgr2=0x55cda10fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/4216645871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10fdfc0 secure :-1 s=READY pgs=889 gs=1 cs=0 l=1 c_cookie=113271764693316818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba98004200 tx=0x7fba98014000 comp rx=0 tx=0).stop 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fbab8e81e00 1 -- 10.20.193.4:0/4216645871 shutdown_connections 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/4216645871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 0x55cda111e8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/4216645871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10fdfc0 unknown :-1 s=CLOSED pgs=889 gs=1 cs=0 l=1 c_cookie=113271764693316818 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/4216645871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10b8f50 0x55cda10b9320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fbab8e81e00 1 -- 10.20.193.4:0/4216645871 >> 10.20.193.4:0/4216645871 conn(0x55cda0fd7db0 msgr2=0x55cda10b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fbab8e81e00 1 -- 10.20.193.4:0/4216645871 shutdown_connections 2026-02-24T09:15:00.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.262+0000 7fbab8e81e00 1 -- 10.20.193.4:0/4216645871 wait complete. 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab8e81e00 1 -- start start 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab8e81e00 1 Processor -- start 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10b8f50 0x55cda1115d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda1116250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 0x55cda111b240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55cda111b780 con 0x55cda10b9860 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55cda111b8f0 con 0x55cda10fe500 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55cda111bab0 con 0x55cda10b8f50 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbaa7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda1116250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbaa7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda1116250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45118/0 (socket says 10.20.193.4:45118) 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbaa7fff640 1 -- 10.20.193.4:0/1920857424 learned_addr learned my addr 10.20.193.4:0/1920857424 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab53fd640 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 0x55cda111b240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbaa7fff640 1 -- 10.20.193.4:0/1920857424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10b8f50 msgr2=0x55cda1115d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10b8f50 0x55cda1115d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbaa7fff640 1 -- 10.20.193.4:0/1920857424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 msgr2=0x55cda111b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 0x55cda111b240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbaa7fff640 1 -- 10.20.193.4:0/1920857424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda0f439d0 con 0x55cda10b9860 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab53fd640 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 0x55cda111b240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda1116250 secure :-1 s=READY pgs=890 gs=1 cs=0 l=1 c_cookie=16947009360789550720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba98005940 tx=0x7fba9801bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2fdf397b14b680 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fba6e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fba6e7fc640 1 -- 10.20.193.4:0/1920857424 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba98011e60 con 0x55cda10b9860 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fba6e7fc640 1 -- 10.20.193.4:0/1920857424 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba9801ae70 con 0x55cda10b9860 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fba6e7fc640 1 -- 10.20.193.4:0/1920857424 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba98009ee0 con 0x55cda10b9860 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fbab8e81e00 1 -- 10.20.193.4:0/1920857424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba98009940 con 0x55cda10b9860 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.263+0000 7fba6e7fc640 1 -- 10.20.193.4:0/1920857424 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fba98004720 con 0x55cda10b9860 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fba6e7fc640 10 client.16956 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab8e81e00 10 client.16956 _ll_register_callbacks cb 0x55cda0f6a080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab8e81e00 1 -- 10.20.193.4:0/1920857424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cda0d0f4a0 con 0x55cda10b9860 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fba6e7fc640 1 -- 10.20.193.4:0/1920857424 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fba9801a460 con 0x55cda10b9860 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab8e81e00 10 client.16956 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab8e81e00 1 -- 10.20.193.4:0/1920857424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55cda0f55710 con 0x55cda10b9860 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fba6e7fc640 1 -- 10.20.193.4:0/1920857424 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fba98035030 con 0x55cda10b9860 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab8e81e00 10 client.16956 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab8e81e00 10 client.16956 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab8e81e00 20 client.16956 populate_metadata read hostname 'trial004' 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55cda10fb610 0x55cda10fbab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab8e81e00 4 client.16956 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab8e81e00 1 -- 10.20.193.4:0/1920857424 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cda0fb57b0 con 0x55cda10fb610 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.264+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55cda10fb610 0x55cda10fbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.265+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55cda10fb610 0x55cda10fbab0 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=15240283656985826743 s_cookie=6344427047383024131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3805d3d52d4d5b7 server_cookie=580beec90ea54203 in_seq=0 out_seq=0 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.265+0000 7fba6e7fc640 10 client.16956 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.265+0000 7fba6e7fc640 1 -- 10.20.193.4:0/1920857424 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cda0fb57b0 con 0x55cda10fb610 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.265+0000 7fba6e7fc640 10 client.16956 handle_command_reply: tid=0 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.265+0000 7fbab8e81e00 1 client.16956 shutdown 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 1 -- 10.20.193.4:0/1920857424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 msgr2=0x55cda1116250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda1116250 secure :-1 s=READY pgs=890 gs=1 cs=0 l=1 c_cookie=16947009360789550720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba98005940 tx=0x7fba9801bce0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 1 -- 10.20.193.4:0/1920857424 shutdown_connections 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55cda10fb610 0x55cda10fbab0 crc :-1 s=READY pgs=41 gs=4 cs=0 l=0 c_cookie=15240283656985826743 s_cookie=6344427047383024131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10fe500 0x55cda111b240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda1116250 unknown :-1 s=CLOSED pgs=890 gs=1 cs=0 l=1 c_cookie=16947009360789550720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/1920857424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10b8f50 0x55cda1115d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fba6e7fc640 0 client.16956 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 1 -- 10.20.193.4:0/1920857424 >> 10.20.193.4:0/1920857424 conn(0x55cda0fd7db0 msgr2=0x55cda10b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 1 -- 10.20.193.4:0/1920857424 shutdown_connections 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 1 -- 10.20.193.4:0/1920857424 wait complete. 2026-02-24T09:15:00.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.266+0000 7fbab8e81e00 20 client.16956 trim_cache size 0 max 16384 2026-02-24T09:15:00.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.272+0000 7fbab8e81e00 1 Processor -- start 2026-02-24T09:15:00.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbab8e81e00 1 -- start start 2026-02-24T09:15:00.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b8f50 0x55cda111a7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10f8fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10fe500 0x55cda10f94f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55cda0fbd9a0 con 0x55cda10b9860 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55cda0d99df0 con 0x55cda10b8f50 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55cda11035a0 con 0x55cda10fe500 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbaa7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbaa7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10f8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45124/0 (socket says 10.20.193.4:45124) 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbaa7fff640 1 -- 10.20.193.4:0/421311237 learned_addr learned my addr 10.20.193.4:0/421311237 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/421311237 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b8f50 0x55cda111a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbab53fd640 1 --2- 10.20.193.4:0/421311237 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10fe500 0x55cda10f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbaa7fff640 1 -- 10.20.193.4:0/421311237 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10fe500 msgr2=0x55cda10f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/421311237 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10fe500 0x55cda10f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbaa7fff640 1 -- 10.20.193.4:0/421311237 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b8f50 msgr2=0x55cda111a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/421311237 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b8f50 0x55cda111a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbaa7fff640 1 -- 10.20.193.4:0/421311237 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda0f50190 con 0x55cda10b9860 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/421311237 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b8f50 0x55cda111a7b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/421311237 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10f8fb0 secure :-1 s=READY pgs=891 gs=1 cs=0 l=1 c_cookie=10699180820156712651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba98005970 tx=0x7fba98036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947b2044ed1d06cb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fba7cce3640 1 -- 10.20.193.4:0/421311237 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba98025b00 con 0x55cda10b9860 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fba7cce3640 1 -- 10.20.193.4:0/421311237 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55cda0d0f4a0 con 0x55cda10b9860 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.273+0000 7fba7cce3640 1 -- 10.20.193.4:0/421311237 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba9801a460 con 0x55cda10b9860 2026-02-24T09:15:00.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 -- 10.20.193.4:0/421311237 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 msgr2=0x55cda10f8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/421311237 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10f8fb0 secure :-1 s=READY pgs=891 gs=1 cs=0 l=1 c_cookie=10699180820156712651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba98005970 tx=0x7fba98036000 comp rx=0 tx=0).stop 2026-02-24T09:15:00.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 -- 10.20.193.4:0/421311237 shutdown_connections 2026-02-24T09:15:00.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/421311237 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10fe500 0x55cda10f94f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/421311237 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b9860 0x55cda10f8fb0 unknown :-1 s=CLOSED pgs=891 gs=1 cs=0 l=1 c_cookie=10699180820156712651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/421311237 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b8f50 0x55cda111a7b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 -- 10.20.193.4:0/421311237 >> 10.20.193.4:0/421311237 conn(0x55cda0fd7db0 msgr2=0x55cda111a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 -- 10.20.193.4:0/421311237 shutdown_connections 2026-02-24T09:15:00.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 -- 10.20.193.4:0/421311237 wait complete. 2026-02-24T09:15:00.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 -- start start 2026-02-24T09:15:00.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 Processor -- start 2026-02-24T09:15:00.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b8f50 0x55cda111a880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b9860 0x55cda1097030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10fe500 0x55cda1097570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55cda1165100 con 0x55cda10b8f50 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55cda1165270 con 0x55cda10b9860 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab8e81e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55cda1097ab0 con 0x55cda10fe500 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab4bfc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b8f50 0x55cda111a880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab4bfc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b8f50 0x55cda111a880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45128/0 (socket says 10.20.193.4:45128) 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbab4bfc640 1 -- 10.20.193.4:0/905636342 learned_addr learned my addr 10.20.193.4:0/905636342 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.274+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b9860 0x55cda1097030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab53fd640 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10fe500 0x55cda1097570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab4bfc640 1 -- 10.20.193.4:0/905636342 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10fe500 msgr2=0x55cda1097570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10fe500 0x55cda1097570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab4bfc640 1 -- 10.20.193.4:0/905636342 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b9860 msgr2=0x55cda1097030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b9860 0x55cda1097030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab4bfc640 1 -- 10.20.193.4:0/905636342 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda0f43d00 con 0x55cda10b8f50 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b9860 0x55cda1097030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab4bfc640 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b8f50 0x55cda111a880 secure :-1 s=READY pgs=892 gs=1 cs=0 l=1 c_cookie=12651144457111665046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaa000f830 tx=0x7fbaa00acfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af91e4dae84af996 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fba6e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fba6e7fc640 1 -- 10.20.193.4:0/905636342 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaa00b2b60 con 0x55cda10b8f50 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 1 -- 10.20.193.4:0/905636342 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cda0f55710 con 0x55cda10b8f50 2026-02-24T09:15:00.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fba6e7fc640 1 -- 10.20.193.4:0/905636342 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbaa00b5140 con 0x55cda10b8f50 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fba6e7fc640 1 -- 10.20.193.4:0/905636342 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaa00ac9e0 con 0x55cda10b8f50 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 10 client.16962 _ll_register_callbacks cb 0x55cda0f6a080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 1 -- 10.20.193.4:0/905636342 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba98009d70 con 0x55cda10b8f50 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fba6e7fc640 1 -- 10.20.193.4:0/905636342 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fbaa00acb70 con 0x55cda10b8f50 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fba6e7fc640 1 -- 10.20.193.4:0/905636342 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbaa00b7af0 con 0x55cda10b8f50 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 10 client.16962 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 1 -- 10.20.193.4:0/905636342 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55cda0f55970 con 0x55cda10b8f50 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fba6e7fc640 1 -- 10.20.193.4:0/905636342 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fbaa00a90b0 con 0x55cda10b8f50 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 10 client.16962 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 10 client.16962 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 20 client.16962 populate_metadata read hostname 'trial004' 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55cda11abf50 0x55cda11cc400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 4 client.16962 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbab8e81e00 1 -- 10.20.193.4:0/905636342 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cda0cf4160 con 0x55cda11abf50 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.275+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55cda11abf50 0x55cda11cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fba6e7fc640 10 client.16962 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbaa7fff640 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55cda11abf50 0x55cda11cc400 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=726201267953995946 s_cookie=18172615041714938125 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a13fc34a3d610aa server_cookie=fc3219190956e10d in_seq=0 out_seq=0 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fba6e7fc640 1 -- 10.20.193.4:0/905636342 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cda0cf4160 con 0x55cda11abf50 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fba6e7fc640 10 client.16962 handle_command_reply: tid=0 2026-02-24T09:15:00.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 client.16962 shutdown 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 -- 10.20.193.4:0/905636342 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b8f50 msgr2=0x55cda111a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b8f50 0x55cda111a880 secure :-1 s=READY pgs=892 gs=1 cs=0 l=1 c_cookie=12651144457111665046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaa000f830 tx=0x7fbaa00acfc0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 -- 10.20.193.4:0/905636342 shutdown_connections 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55cda11abf50 0x55cda11cc400 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=726201267953995946 s_cookie=18172615041714938125 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cda10fe500 0x55cda1097570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cda10b9860 0x55cda1097030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fba6e7fc640 0 client.16962 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 --2- 10.20.193.4:0/905636342 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cda10b8f50 0x55cda111a880 unknown :-1 s=CLOSED pgs=892 gs=1 cs=0 l=1 c_cookie=12651144457111665046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 -- 10.20.193.4:0/905636342 >> 10.20.193.4:0/905636342 conn(0x55cda0fd7db0 msgr2=0x55cda10b7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 -- 10.20.193.4:0/905636342 shutdown_connections 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 1 -- 10.20.193.4:0/905636342 wait complete. 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab8e81e00 20 client.16962 trim_cache size 0 max 16384 2026-02-24T09:15:00.283 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 -- 10.20.193.4:0/3611491289 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba8c0b56e0 msgr2=0x7fba8c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba8c0b56e0 0x7fba8c0d5b90 secure :-1 s=READY pgs=369 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbab0128de0 tx=0x7fba98005f90 comp rx=0 tx=0).stop 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 -- 10.20.193.4:0/3611491289 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbab0114020 msgr2=0x7fbab0122440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbab0114020 0x7fbab0122440 secure :-1 s=READY pgs=888 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaa000c9b0 tx=0x7fbaa000ce80 comp rx=0 tx=0).stop 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 -- 10.20.193.4:0/3611491289 shutdown_connections 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba8c0b56e0 0x7fba8c0d5b90 unknown :-1 s=CLOSED pgs=369 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbab0119dc0 0x7fbab0127d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbab0114a10 0x7fbab0122980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 --2- 10.20.193.4:0/3611491289 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbab0114020 0x7fbab0122440 unknown :-1 s=CLOSED pgs=888 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 -- 10.20.193.4:0/3611491289 >> 10.20.193.4:0/3611491289 conn(0x7fbab0064c50 msgr2=0x7fbab0116b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 -- 10.20.193.4:0/3611491289 shutdown_connections 2026-02-24T09:15:00.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.276+0000 7fbab6e87640 1 -- 10.20.193.4:0/3611491289 wait complete. 2026-02-24T09:15:00.316 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:15:00.432 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:00.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.534+0000 7ff4c4a31640 1 -- 10.20.193.4:0/188126821 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff4c0115930 msgr2=0x7ff4c0176300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.534+0000 7ff4c4a31640 1 --2- 10.20.193.4:0/188126821 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff4c0115930 0x7ff4c0176300 secure :-1 s=READY pgs=893 gs=1 cs=0 l=1 c_cookie=16892387628781639095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b000aa30 tx=0x7ff4b0030280 comp rx=0 tx=0).stop 2026-02-24T09:15:00.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.534+0000 7ff4c4a31640 1 -- 10.20.193.4:0/188126821 shutdown_connections 2026-02-24T09:15:00.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.534+0000 7ff4c4a31640 1 --2- 10.20.193.4:0/188126821 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff4c0115930 0x7ff4c0176300 unknown :-1 s=CLOSED pgs=893 gs=1 cs=0 l=1 c_cookie=16892387628781639095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.534+0000 7ff4c4a31640 1 --2- 10.20.193.4:0/188126821 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff4c0110130 0x7ff4c0115180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.534+0000 7ff4c4a31640 1 --2- 10.20.193.4:0/188126821 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff4c010f740 0x7ff4c010fb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.534+0000 7ff4c4a31640 1 -- 10.20.193.4:0/188126821 >> 10.20.193.4:0/188126821 conn(0x7ff4c00ed050 msgr2=0x7ff4c010d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.534+0000 7ff4c4a31640 1 -- 10.20.193.4:0/188126821 shutdown_connections 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.534+0000 7ff4c4a31640 1 -- 10.20.193.4:0/188126821 wait complete. 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4c4a31640 1 Processor -- start 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4c4a31640 1 -- start start 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4c4a31640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff4c010f740 0x7ff4c011e060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4c4a31640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff4c0110130 0x7ff4c011e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4c4a31640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff4c0115930 0x7ff4c0123970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4c4a31640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0123f90 con 0x7ff4c0115930 2026-02-24T09:15:00.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4c4a31640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0124100 con 0x7ff4c010f740 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4c4a31640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01242c0 con 0x7ff4c0110130 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4bed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff4c0115930 0x7ff4c0123970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4bed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff4c0115930 0x7ff4c0123970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45138/0 (socket says 10.20.193.4:45138) 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4bed76640 1 -- 10.20.193.4:0/1468925417 learned_addr learned my addr 10.20.193.4:0/1468925417 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4be575640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff4c010f740 0x7ff4c011e060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4bed76640 1 -- 10.20.193.4:0/1468925417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff4c0110130 msgr2=0x7ff4c011e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4bed76640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff4c0110130 0x7ff4c011e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4bed76640 1 -- 10.20.193.4:0/1468925417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff4c010f740 msgr2=0x7ff4c011e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4bed76640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff4c010f740 0x7ff4c011e060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4bed76640 1 -- 10.20.193.4:0/1468925417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b000a650 con 0x7ff4c0115930 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4bed76640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff4c0115930 0x7ff4c0123970 secure :-1 s=READY pgs=894 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b000a330 tx=0x7ff4b00039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4a77fe640 1 -- 10.20.193.4:0/1468925417 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4b003e070 con 0x7ff4c0115930 2026-02-24T09:15:00.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4c4a31640 1 -- 10.20.193.4:0/1468925417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c0124540 con 0x7ff4c0115930 2026-02-24T09:15:00.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4a77fe640 1 -- 10.20.193.4:0/1468925417 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4b00055a0 con 0x7ff4c0115930 2026-02-24T09:15:00.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4a77fe640 1 -- 10.20.193.4:0/1468925417 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4b0042910 con 0x7ff4c0115930 2026-02-24T09:15:00.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.535+0000 7ff4c4a31640 1 -- 10.20.193.4:0/1468925417 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c0164ca0 con 0x7ff4c0115930 2026-02-24T09:15:00.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.537+0000 7ff4a77fe640 1 -- 10.20.193.4:0/1468925417 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff4b00050c0 con 0x7ff4c0115930 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.538+0000 7ff4a77fe640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff4980b56e0 0x7ff4980d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.538+0000 7ff4a77fe640 1 -- 10.20.193.4:0/1468925417 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff4b010ca00 con 0x7ff4c0115930 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.538+0000 7ff4be575640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff4980b56e0 0x7ff4980d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.538+0000 7ff4be575640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff4980b56e0 0x7ff4980d5b90 secure :-1 s=READY pgs=370 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b4004740 tx=0x7ff4b4004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4c6a2be00 1 Processor -- start 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4c6a2be00 1 -- start start 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f2f50 0x5582627f3320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f3860 0x558262837fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558262838500 0x5582628588e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558262703ee0 con 0x5582627f3860 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5582626ffc10 con 0x5582627f2f50 2026-02-24T09:15:00.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5582626f9d70 con 0x558262838500 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4bdd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f3860 0x558262837fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4bdd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f3860 0x558262837fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45140/0 (socket says 10.20.193.4:45140) 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4bdd74640 1 -- 10.20.193.4:0/3898135335 learned_addr learned my addr 10.20.193.4:0/3898135335 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4bed76640 1 --2- 10.20.193.4:0/3898135335 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558262838500 0x5582628588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4be575640 1 --2- 10.20.193.4:0/3898135335 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f2f50 0x5582627f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4bdd74640 1 -- 10.20.193.4:0/3898135335 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558262838500 msgr2=0x5582628588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4bdd74640 1 --2- 10.20.193.4:0/3898135335 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558262838500 0x5582628588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4bdd74640 1 -- 10.20.193.4:0/3898135335 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f2f50 msgr2=0x5582627f3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4bdd74640 1 --2- 10.20.193.4:0/3898135335 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f2f50 0x5582627f3320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4bdd74640 1 -- 10.20.193.4:0/3898135335 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582626a5340 con 0x5582627f3860 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4bdd74640 1 --2- 10.20.193.4:0/3898135335 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f3860 0x558262837fc0 secure :-1 s=READY pgs=895 gs=1 cs=0 l=1 c_cookie=7630203979447307815 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a8009b20 tx=0x7ff4a800e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e3ee17beba8e27 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4a4ff9640 1 -- 10.20.193.4:0/3898135335 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a800edb0 con 0x5582627f3860 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4a4ff9640 1 -- 10.20.193.4:0/3898135335 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4a8004d30 con 0x5582627f3860 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.540+0000 7ff4a4ff9640 1 -- 10.20.193.4:0/3898135335 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a8010740 con 0x5582627f3860 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.541+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/3898135335 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f3860 msgr2=0x558262837fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.541+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/3898135335 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f3860 0x558262837fc0 secure :-1 s=READY pgs=895 gs=1 cs=0 l=1 c_cookie=7630203979447307815 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a8009b20 tx=0x7ff4a800e350 comp rx=0 tx=0).stop 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.541+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/3898135335 shutdown_connections 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.541+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/3898135335 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558262838500 0x5582628588e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.541+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/3898135335 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f3860 0x558262837fc0 unknown :-1 s=CLOSED pgs=895 gs=1 cs=0 l=1 c_cookie=7630203979447307815 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.541+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/3898135335 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f2f50 0x5582627f3320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.541+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/3898135335 >> 10.20.193.4:0/3898135335 conn(0x558262711db0 msgr2=0x5582627f1830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.541+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/3898135335 shutdown_connections 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.541+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/3898135335 wait complete. 2026-02-24T09:15:00.551 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.541+0000 7ff4c6a2be00 1 -- start start 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 Processor -- start 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 0x55826284fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f3860 0x558262850330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262855320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558262855860 con 0x558262838500 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5582628559d0 con 0x5582627f3860 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558262855b90 con 0x5582627f2f50 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262855320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262855320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45152/0 (socket says 10.20.193.4:45152) 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bed76640 1 -- 10.20.193.4:0/2639014419 learned_addr learned my addr 10.20.193.4:0/2639014419 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bdd74640 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f3860 0x558262850330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.552 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4be575640 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 0x55826284fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bed76640 1 -- 10.20.193.4:0/2639014419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 msgr2=0x55826284fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bed76640 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 0x55826284fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bed76640 1 -- 10.20.193.4:0/2639014419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f3860 msgr2=0x558262850330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bed76640 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f3860 0x558262850330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bed76640 1 -- 10.20.193.4:0/2639014419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55826267d9d0 con 0x558262838500 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bdd74640 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f3860 0x558262850330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4be575640 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 0x55826284fdf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4bed76640 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262855320 secure :-1 s=READY pgs=896 gs=1 cs=0 l=1 c_cookie=11778374500806068707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b0030fd0 tx=0x7ff4b0030280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3753134381089e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff46ffff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff46ffff640 1 -- 10.20.193.4:0/2639014419 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4b00baea0 con 0x558262838500 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff46ffff640 1 -- 10.20.193.4:0/2639014419 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4b00d3770 con 0x558262838500 2026-02-24T09:15:00.553 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/2639014419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a80097c0 con 0x558262838500 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff46ffff640 1 -- 10.20.193.4:0/2639014419 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4b00d3c80 con 0x558262838500 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 10 client.16974 _ll_register_callbacks cb 0x5582626a4080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/2639014419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5582624494a0 con 0x558262838500 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff46ffff640 1 -- 10.20.193.4:0/2639014419 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff4b00d8070 con 0x558262838500 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff46ffff640 1 -- 10.20.193.4:0/2639014419 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff4b00d7030 con 0x558262838500 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 10 client.16974 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/2639014419 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55826268f710 con 0x558262838500 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff46ffff640 1 -- 10.20.193.4:0/2639014419 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff4b00dda20 con 0x558262838500 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 10 client.16974 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 10 client.16974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 20 client.16974 populate_metadata read hostname 'trial004' 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5582628355f0 0x558262835a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 4 client.16974 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.542+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/2639014419 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582626ef7b0 con 0x5582628355f0 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.543+0000 7ff4be575640 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5582628355f0 0x558262835a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.543+0000 7ff4be575640 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5582628355f0 0x558262835a60 crc :-1 s=READY pgs=127 gs=4 cs=0 l=0 c_cookie=1122898119506186635 s_cookie=2863680345795976596 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9555e3ec1ed18b server_cookie=27bdd61a216fdd94 in_seq=0 out_seq=0 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.543+0000 7ff46ffff640 10 client.16974 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.543+0000 7ff46ffff640 1 -- 10.20.193.4:0/2639014419 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5582626ef7b0 con 0x5582628355f0 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.543+0000 7ff46ffff640 10 client.16974 handle_command_reply: tid=0 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 client.16974 shutdown 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/2639014419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 msgr2=0x558262855320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262855320 secure :-1 s=READY pgs=896 gs=1 cs=0 l=1 c_cookie=11778374500806068707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b0030fd0 tx=0x7ff4b0030280 comp rx=0 tx=0).stop 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/2639014419 shutdown_connections 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5582628355f0 0x558262835a60 crc :-1 s=READY pgs=127 gs=4 cs=0 l=0 c_cookie=1122898119506186635 s_cookie=2863680345795976596 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262855320 unknown :-1 s=CLOSED pgs=896 gs=1 cs=0 l=1 c_cookie=11778374500806068707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f3860 0x558262850330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff46ffff640 0 client.16974 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:00.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/2639014419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 0x55826284fdf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/2639014419 >> 10.20.193.4:0/2639014419 conn(0x558262711db0 msgr2=0x5582627f1040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/2639014419 shutdown_connections 2026-02-24T09:15:00.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/2639014419 wait complete. 2026-02-24T09:15:00.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.544+0000 7ff4c6a2be00 20 client.16974 trim_cache size 0 max 16384 2026-02-24T09:15:00.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4c6a2be00 1 Processor -- start 2026-02-24T09:15:00.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4c6a2be00 1 -- start start 2026-02-24T09:15:00.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 0x558262832150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f3860 0x558262832690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262832bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5582626f79a0 con 0x558262838500 2026-02-24T09:15:00.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5582624d3df0 con 0x5582627f3860 2026-02-24T09:15:00.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558262855a50 con 0x5582627f2f50 2026-02-24T09:15:00.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4bed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262832bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4bed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262832bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45160/0 (socket says 10.20.193.4:45160) 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4bed76640 1 -- 10.20.193.4:0/3939822413 learned_addr learned my addr 10.20.193.4:0/3939822413 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.550+0000 7ff4be575640 1 --2- 10.20.193.4:0/3939822413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 0x558262832150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4bed76640 1 -- 10.20.193.4:0/3939822413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 msgr2=0x558262832150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4bed76640 1 --2- 10.20.193.4:0/3939822413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 0x558262832150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4bed76640 1 -- 10.20.193.4:0/3939822413 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f3860 msgr2=0x558262832690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4bed76640 1 --2- 10.20.193.4:0/3939822413 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f3860 0x558262832690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4bed76640 1 -- 10.20.193.4:0/3939822413 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558262842450 con 0x558262838500 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4bed76640 1 --2- 10.20.193.4:0/3939822413 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262832bd0 secure :-1 s=READY pgs=897 gs=1 cs=0 l=1 c_cookie=16902721192654552976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b0006d80 tx=0x7ff4b00d8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea92875ec9a43f90 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff48a4e6640 1 -- 10.20.193.4:0/3939822413 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4b00d7070 con 0x558262838500 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff48a4e6640 1 -- 10.20.193.4:0/3939822413 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5582624494a0 con 0x558262838500 2026-02-24T09:15:00.563 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff48a4e6640 1 -- 10.20.193.4:0/3939822413 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4b00baea0 con 0x558262838500 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/3939822413 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 msgr2=0x558262832bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/3939822413 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262832bd0 secure :-1 s=READY pgs=897 gs=1 cs=0 l=1 c_cookie=16902721192654552976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b0006d80 tx=0x7ff4b00d8000 comp rx=0 tx=0).stop 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/3939822413 shutdown_connections 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/3939822413 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558262838500 0x558262832bd0 unknown :-1 s=CLOSED pgs=897 gs=1 cs=0 l=1 c_cookie=16902721192654552976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/3939822413 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5582627f3860 0x558262832690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/3939822413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f2f50 0x558262832150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/3939822413 >> 10.20.193.4:0/3939822413 conn(0x558262711db0 msgr2=0x5582627f1450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/3939822413 shutdown_connections 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.551+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/3939822413 wait complete. 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4c6a2be00 1 -- start start 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4c6a2be00 1 Processor -- start 2026-02-24T09:15:00.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f2f50 0x5582627d6ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f3860 0x5582627d2360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4c6a2be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558262838500 0x5582627d28e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5582627d2fe0 con 0x5582627f2f50 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5582627d3150 con 0x558262838500 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4c6a2be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55826289e100 con 0x5582627f3860 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4be575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f2f50 0x5582627d6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4be575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f2f50 0x5582627d6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45176/0 (socket says 10.20.193.4:45176) 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4be575640 1 -- 10.20.193.4:0/975858923 learned_addr learned my addr 10.20.193.4:0/975858923 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4bdd74640 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f3860 0x5582627d2360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4be575640 1 -- 10.20.193.4:0/975858923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f3860 msgr2=0x5582627d2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4be575640 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f3860 0x5582627d2360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4be575640 1 -- 10.20.193.4:0/975858923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558262838500 msgr2=0x5582627d28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4be575640 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558262838500 0x5582627d28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4be575640 1 -- 10.20.193.4:0/975858923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55826268a190 con 0x5582627f2f50 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4be575640 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f2f50 0x5582627d6ba0 secure :-1 s=READY pgs=898 gs=1 cs=0 l=1 c_cookie=6671009645535824476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5582628362e0 tx=0x7ff4b40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c942fed975e0a5c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff46ffff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff46ffff640 1 -- 10.20.193.4:0/975858923 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4b4011660 con 0x5582627f2f50 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff46ffff640 1 -- 10.20.193.4:0/975858923 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4b4011ca0 con 0x5582627f2f50 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff46ffff640 1 -- 10.20.193.4:0/975858923 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4b4029d00 con 0x5582627f2f50 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/975858923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55826268f710 con 0x5582627f2f50 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff46ffff640 1 -- 10.20.193.4:0/975858923 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff4b402e020 con 0x5582627f2f50 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.552+0000 7ff46ffff640 10 client.16980 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4c6a2be00 10 client.16980 _ll_register_callbacks cb 0x5582626a4080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:00.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/975858923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4a8004d30 con 0x5582627f2f50 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff46ffff640 1 -- 10.20.193.4:0/975858923 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff4b4011e10 con 0x5582627f2f50 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4c6a2be00 10 client.16980 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/975858923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55826267dd00 con 0x5582627f2f50 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff46ffff640 1 -- 10.20.193.4:0/975858923 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff4b40117c0 con 0x5582627f2f50 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4c6a2be00 10 client.16980 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4c6a2be00 10 client.16980 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4c6a2be00 20 client.16980 populate_metadata read hostname 'trial004' 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5582628e60c0 0x558262906570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4c6a2be00 4 client.16980 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/975858923 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55826242e160 con 0x5582628e60c0 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.553+0000 7ff4bdd74640 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5582628e60c0 0x558262906570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:00.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff46ffff640 10 client.16980 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4bdd74640 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5582628e60c0 0x558262906570 crc :-1 s=READY pgs=128 gs=4 cs=0 l=0 c_cookie=3082486866992555815 s_cookie=9734821440562863413 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ac731794be5e727 server_cookie=87190885dc9b1d35 in_seq=0 out_seq=0 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff46ffff640 1 -- 10.20.193.4:0/975858923 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55826242e160 con 0x5582628e60c0 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff46ffff640 10 client.16980 handle_command_reply: tid=0 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 client.16980 shutdown 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/975858923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f2f50 msgr2=0x5582627d6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f2f50 0x5582627d6ba0 secure :-1 s=READY pgs=898 gs=1 cs=0 l=1 c_cookie=6671009645535824476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5582628362e0 tx=0x7ff4b40047e0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/975858923 shutdown_connections 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5582628e60c0 0x558262906570 crc :-1 s=READY pgs=128 gs=4 cs=0 l=0 c_cookie=3082486866992555815 s_cookie=9734821440562863413 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558262838500 0x5582627d28e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5582627f3860 0x5582627d2360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff46ffff640 0 client.16980 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:00.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 --2- 10.20.193.4:0/975858923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5582627f2f50 0x5582627d6ba0 unknown :-1 s=CLOSED pgs=898 gs=1 cs=0 l=1 c_cookie=6671009645535824476 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.569 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/975858923 >> 10.20.193.4:0/975858923 conn(0x558262711db0 msgr2=0x5582627f1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.569 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/975858923 shutdown_connections 2026-02-24T09:15:00.569 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 1 -- 10.20.193.4:0/975858923 wait complete. 2026-02-24T09:15:00.569 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c6a2be00 20 client.16980 trim_cache size 0 max 16384 2026-02-24T09:15:00.569 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:15:00.570 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 -- 10.20.193.4:0/1468925417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff4980b56e0 msgr2=0x7ff4980d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.570 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff4980b56e0 0x7ff4980d5b90 secure :-1 s=READY pgs=370 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b4004740 tx=0x7ff4b4004420 comp rx=0 tx=0).stop 2026-02-24T09:15:00.570 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 -- 10.20.193.4:0/1468925417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff4c0115930 msgr2=0x7ff4c0123970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:00.570 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff4c0115930 0x7ff4c0123970 secure :-1 s=READY pgs=894 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b000a330 tx=0x7ff4b00039b0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.570 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 -- 10.20.193.4:0/1468925417 shutdown_connections 2026-02-24T09:15:00.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff4980b56e0 0x7ff4980d5b90 unknown :-1 s=CLOSED pgs=370 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff4c0115930 0x7ff4c0123970 unknown :-1 s=CLOSED pgs=894 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff4c0110130 0x7ff4c011e5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 --2- 10.20.193.4:0/1468925417 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff4c010f740 0x7ff4c011e060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:00.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 -- 10.20.193.4:0/1468925417 >> 10.20.193.4:0/1468925417 conn(0x7ff4c00ed050 msgr2=0x7ff4c010d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:00.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.554+0000 7ff4c4a31640 1 -- 10.20.193.4:0/1468925417 shutdown_connections 2026-02-24T09:15:00.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:00.555+0000 7ff4c4a31640 1 -- 10.20.193.4:0/1468925417 wait complete. 2026-02-24T09:15:01.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:00 trial090 ceph-mon[47278]: pgmap v308: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 6.6 MiB/s wr, 44 op/s 2026-02-24T09:15:01.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:00 trial014 ceph-mon[46941]: pgmap v308: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 6.6 MiB/s wr, 44 op/s 2026-02-24T09:15:01.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:00 trial004 ceph-mon[41596]: pgmap v308: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 6.6 MiB/s wr, 44 op/s 2026-02-24T09:15:01.592 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:15:01.592 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:15:01.711 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:01.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.811+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1513896192 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1b6c060fd0 msgr2=0x7f1b6c0613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:01.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.811+0000 7f1b70cd4640 1 --2- 10.20.193.4:0/1513896192 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1b6c060fd0 0x7f1b6c0613a0 secure :-1 s=READY pgs=899 gs=1 cs=0 l=1 c_cookie=14080432429874891964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b60009950 tx=0x7f1b6002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.811+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1513896192 shutdown_connections 2026-02-24T09:15:01.816 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.811+0000 7f1b70cd4640 1 --2- 10.20.193.4:0/1513896192 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1b6c155730 0x7f1b6c175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.811+0000 7f1b70cd4640 1 --2- 10.20.193.4:0/1513896192 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b6c0618e0 0x7f1b6c1551f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.811+0000 7f1b70cd4640 1 --2- 10.20.193.4:0/1513896192 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1b6c060fd0 0x7f1b6c0613a0 unknown :-1 s=CLOSED pgs=899 gs=1 cs=0 l=1 c_cookie=14080432429874891964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.811+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1513896192 >> 10.20.193.4:0/1513896192 conn(0x7f1b6c05f830 msgr2=0x7f1b6c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.811+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1513896192 shutdown_connections 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.811+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1513896192 wait complete. 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b70cd4640 1 Processor -- start 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b70cd4640 1 -- start start 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b70cd4640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1b6c060fd0 0x7f1b6c161f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b70cd4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1b6c0618e0 0x7f1b6c162440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b70cd4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b6c155730 0x7f1b6c167810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b70cd4640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c167e30 con 0x7f1b6c0618e0 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b70cd4640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c167fa0 con 0x7f1b6c060fd0 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b70cd4640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c168160 con 0x7f1b6c155730 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b69d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1b6c0618e0 0x7f1b6c162440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b69d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1b6c0618e0 0x7f1b6c162440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45184/0 (socket says 10.20.193.4:45184) 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b69d74640 1 -- 10.20.193.4:0/1367424462 learned_addr learned my addr 10.20.193.4:0/1367424462 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b6a575640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1b6c060fd0 0x7f1b6c161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b6ad76640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b6c155730 0x7f1b6c167810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b69d74640 1 -- 10.20.193.4:0/1367424462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b6c155730 msgr2=0x7f1b6c167810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b69d74640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b6c155730 0x7f1b6c167810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b69d74640 1 -- 10.20.193.4:0/1367424462 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1b6c060fd0 msgr2=0x7f1b6c161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:01.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b69d74640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1b6c060fd0 0x7f1b6c161f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b69d74640 1 -- 10.20.193.4:0/1367424462 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b60009570 con 0x7f1b6c0618e0 2026-02-24T09:15:01.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b6ad76640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b6c155730 0x7f1b6c167810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:01.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b69d74640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1b6c0618e0 0x7f1b6c162440 secure :-1 s=READY pgs=900 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b54005db0 tx=0x7f1b5400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:01.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b537fe640 1 -- 10.20.193.4:0/1367424462 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b54004500 con 0x7f1b6c0618e0 2026-02-24T09:15:01.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1367424462 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6c168440 con 0x7f1b6c0618e0 2026-02-24T09:15:01.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b537fe640 1 -- 10.20.193.4:0/1367424462 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1b54004d30 con 0x7f1b6c0618e0 2026-02-24T09:15:01.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b537fe640 1 -- 10.20.193.4:0/1367424462 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b54005310 con 0x7f1b6c0618e0 2026-02-24T09:15:01.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.812+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1367424462 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6c151350 con 0x7f1b6c0618e0 2026-02-24T09:15:01.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.814+0000 7f1b537fe640 1 -- 10.20.193.4:0/1367424462 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f1b540054a0 con 0x7f1b6c0618e0 2026-02-24T09:15:01.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.814+0000 7f1b537fe640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1b440b56e0 0x7f1b440d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.815+0000 7f1b6a575640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1b440b56e0 0x7f1b440d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.815+0000 7f1b537fe640 1 -- 10.20.193.4:0/1367424462 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1b540e6ce0 con 0x7f1b6c0618e0 2026-02-24T09:15:01.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.815+0000 7f1b6a575640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1b440b56e0 0x7f1b440d5b90 secure :-1 s=READY pgs=371 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b600023d0 tx=0x7f1b60031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:01.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b72ccee00 1 Processor -- start 2026-02-24T09:15:01.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b72ccee00 1 -- start start 2026-02-24T09:15:01.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.826 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06dc10 0x5622bc0b2370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc0b28b0 0x5622bc0d2c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5622bbf7d520 con 0x5622bc06d300 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5622bbf79250 con 0x5622bc0b28b0 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5622bbf733b0 con 0x5622bc06dc10 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b6a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b6a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45200/0 (socket says 10.20.193.4:45200) 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b6a575640 1 -- 10.20.193.4:0/870183461 learned_addr learned my addr 10.20.193.4:0/870183461 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b6ad76640 1 --2- 10.20.193.4:0/870183461 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc0b28b0 0x5622bc0d2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b69d74640 1 --2- 10.20.193.4:0/870183461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06dc10 0x5622bc0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b6a575640 1 -- 10.20.193.4:0/870183461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06dc10 msgr2=0x5622bc0b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b6a575640 1 --2- 10.20.193.4:0/870183461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06dc10 0x5622bc0b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b6a575640 1 -- 10.20.193.4:0/870183461 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc0b28b0 msgr2=0x5622bc0d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:01.827 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b6a575640 1 --2- 10.20.193.4:0/870183461 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc0b28b0 0x5622bc0d2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b6a575640 1 -- 10.20.193.4:0/870183461 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622bbf1e6e0 con 0x5622bc06d300 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b69d74640 1 --2- 10.20.193.4:0/870183461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06dc10 0x5622bc0b2370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b6a575640 1 --2- 10.20.193.4:0/870183461 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06d6d0 secure :-1 s=READY pgs=901 gs=1 cs=0 l=1 c_cookie=1910810636943997819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b60002ed0 tx=0x7f1b60040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8490268015bb7b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b50ff9640 1 -- 10.20.193.4:0/870183461 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b60002a80 con 0x5622bc06d300 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b50ff9640 1 -- 10.20.193.4:0/870183461 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1b60038920 con 0x5622bc06d300 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.816+0000 7f1b50ff9640 1 -- 10.20.193.4:0/870183461 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b6004f920 con 0x5622bc06d300 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.817+0000 7f1b72ccee00 1 -- 10.20.193.4:0/870183461 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 msgr2=0x5622bc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.817+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/870183461 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06d6d0 secure :-1 s=READY pgs=901 gs=1 cs=0 l=1 c_cookie=1910810636943997819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b60002ed0 tx=0x7f1b60040000 comp rx=0 tx=0).stop 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.817+0000 7f1b72ccee00 1 -- 10.20.193.4:0/870183461 shutdown_connections 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.817+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/870183461 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc0b28b0 0x5622bc0d2c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.817+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/870183461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06dc10 0x5622bc0b2370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.817+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/870183461 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06d6d0 unknown :-1 s=CLOSED pgs=901 gs=1 cs=0 l=1 c_cookie=1910810636943997819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.817+0000 7f1b72ccee00 1 -- 10.20.193.4:0/870183461 >> 10.20.193.4:0/870183461 conn(0x5622bbf8b4f0 msgr2=0x5622bc06bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.817+0000 7f1b72ccee00 1 -- 10.20.193.4:0/870183461 shutdown_connections 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.817+0000 7f1b72ccee00 1 -- 10.20.193.4:0/870183461 wait complete. 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b72ccee00 1 -- start start 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b72ccee00 1 Processor -- start 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc085270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06dc10 0x5622bc0857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc0b28b0 0x5622bc08a7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5622bc08ace0 con 0x5622bc06d300 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5622bc08ae50 con 0x5622bc0b28b0 2026-02-24T09:15:01.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5622bc08b010 con 0x5622bc06dc10 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b6a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc085270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b6a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc085270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45202/0 (socket says 10.20.193.4:45202) 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b6a575640 1 -- 10.20.193.4:0/227709697 learned_addr learned my addr 10.20.193.4:0/227709697 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b6ad76640 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc0b28b0 0x5622bc08a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b6a575640 1 -- 10.20.193.4:0/227709697 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06dc10 msgr2=0x5622bc0857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b6a575640 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06dc10 0x5622bc0857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b6a575640 1 -- 10.20.193.4:0/227709697 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc0b28b0 msgr2=0x5622bc08a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b6a575640 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc0b28b0 0x5622bc08a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b6a575640 1 -- 10.20.193.4:0/227709697 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622bbef6cd0 con 0x5622bc06d300 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b6a575640 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc085270 secure :-1 s=READY pgs=902 gs=1 cs=0 l=1 c_cookie=10915575146436822001 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b60002d30 tx=0x7f1b6004fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977be9c3327303f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.818+0000 7f1b1bfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b1bfff640 1 -- 10.20.193.4:0/227709697 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b6002fc10 con 0x5622bc06d300 2026-02-24T09:15:01.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b1bfff640 1 -- 10.20.193.4:0/227709697 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1b60038e00 con 0x5622bc06d300 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b1bfff640 1 -- 10.20.193.4:0/227709697 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b60059d00 con 0x5622bc06d300 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 1 -- 10.20.193.4:0/227709697 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6c1766a0 con 0x5622bc06d300 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b1bfff640 1 -- 10.20.193.4:0/227709697 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1b60064410 con 0x5622bc06d300 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b1bfff640 10 client.16992 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 10 client.16992 _ll_register_callbacks cb 0x5622bbeef790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 1 -- 10.20.193.4:0/227709697 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5622bbc009d0 con 0x5622bc06d300 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b1bfff640 1 -- 10.20.193.4:0/227709697 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1b6002fd70 con 0x5622bc06d300 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 10 client.16992 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 1 -- 10.20.193.4:0/227709697 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5622bbf08ab0 con 0x5622bc06d300 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b1bfff640 1 -- 10.20.193.4:0/227709697 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f1b60059410 con 0x5622bc06d300 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 10 client.16992 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:01.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 20 client.16992 populate_metadata read hostname 'trial004' 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622bc0af830 0x5622bc0afca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 4 client.16992 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b72ccee00 1 -- 10.20.193.4:0/227709697 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622bbf83b70 con 0x5622bc0af830 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.819+0000 7f1b69d74640 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622bc0af830 0x5622bc0afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.820+0000 7f1b69d74640 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622bc0af830 0x5622bc0afca0 crc :-1 s=READY pgs=129 gs=4 cs=0 l=0 c_cookie=9502014431897123486 s_cookie=13112206933132760624 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83ddefc82fdcfa9e server_cookie=b5f7eabbf6cad630 in_seq=0 out_seq=0 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.820+0000 7f1b1bfff640 10 client.16992 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b1bfff640 1 -- 10.20.193.4:0/227709697 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5622bbf83b70 con 0x5622bc0af830 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b1bfff640 10 client.16992 handle_command_reply: tid=0 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 client.16992 shutdown 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 -- 10.20.193.4:0/227709697 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 msgr2=0x5622bc085270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:01.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc085270 secure :-1 s=READY pgs=902 gs=1 cs=0 l=1 c_cookie=10915575146436822001 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b60002d30 tx=0x7f1b6004fd80 comp rx=0 tx=0).stop 2026-02-24T09:15:01.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 -- 10.20.193.4:0/227709697 shutdown_connections 2026-02-24T09:15:01.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622bc0af830 0x5622bc0afca0 crc :-1 s=READY pgs=129 gs=4 cs=0 l=0 c_cookie=9502014431897123486 s_cookie=13112206933132760624 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc0b28b0 0x5622bc08a7a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06dc10 0x5622bc0857b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b1bfff640 0 client.16992 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:01.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/227709697 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc085270 unknown :-1 s=CLOSED pgs=902 gs=1 cs=0 l=1 c_cookie=10915575146436822001 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 -- 10.20.193.4:0/227709697 >> 10.20.193.4:0/227709697 conn(0x5622bbf8b4f0 msgr2=0x5622bc06c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:01.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 -- 10.20.193.4:0/227709697 shutdown_connections 2026-02-24T09:15:01.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 1 -- 10.20.193.4:0/227709697 wait complete. 2026-02-24T09:15:01.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.821+0000 7f1b72ccee00 20 client.16992 trim_cache size 0 max 16384 2026-02-24T09:15:01.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b72ccee00 1 Processor -- start 2026-02-24T09:15:01.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b72ccee00 1 -- start start 2026-02-24T09:15:01.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bbf8b4f0 0x5622bc06b4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06ba20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc06dc10 0x5622bc06bf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5622bbf70fe0 con 0x5622bc06d300 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5622bbc3bfe0 con 0x5622bc06dc10 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5622bbffedd0 con 0x5622bbf8b4f0 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b69d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b69d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45212/0 (socket says 10.20.193.4:45212) 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b69d74640 1 -- 10.20.193.4:0/875629978 learned_addr learned my addr 10.20.193.4:0/875629978 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b6ad76640 1 --2- 10.20.193.4:0/875629978 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc06dc10 0x5622bc06bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.830+0000 7f1b6a575640 1 --2- 10.20.193.4:0/875629978 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bbf8b4f0 0x5622bc06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b69d74640 1 -- 10.20.193.4:0/875629978 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bbf8b4f0 msgr2=0x5622bc06b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:01.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b69d74640 1 --2- 10.20.193.4:0/875629978 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bbf8b4f0 0x5622bc06b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b69d74640 1 -- 10.20.193.4:0/875629978 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc06dc10 msgr2=0x5622bc06bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b69d74640 1 --2- 10.20.193.4:0/875629978 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc06dc10 0x5622bc06bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b69d74640 1 -- 10.20.193.4:0/875629978 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622bbf03530 con 0x5622bc06d300 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b69d74640 1 --2- 10.20.193.4:0/875629978 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06ba20 secure :-1 s=READY pgs=903 gs=1 cs=0 l=1 c_cookie=4700419053510505121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b540e4780 tx=0x7f1b54009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413b3e39abf8b2a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b364e6640 1 -- 10.20.193.4:0/875629978 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b540ada10 con 0x5622bc06d300 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b364e6640 1 -- 10.20.193.4:0/875629978 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1b54096030 con 0x5622bc06d300 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b364e6640 1 -- 10.20.193.4:0/875629978 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b540a9280 con 0x5622bc06d300 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b72ccee00 1 -- 10.20.193.4:0/875629978 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 msgr2=0x5622bc06ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/875629978 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06ba20 secure :-1 s=READY pgs=903 gs=1 cs=0 l=1 c_cookie=4700419053510505121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b540e4780 tx=0x7f1b54009de0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b72ccee00 1 -- 10.20.193.4:0/875629978 shutdown_connections 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/875629978 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc06dc10 0x5622bc06bf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/875629978 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bc06d300 0x5622bc06ba20 unknown :-1 s=CLOSED pgs=903 gs=1 cs=0 l=1 c_cookie=4700419053510505121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/875629978 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bbf8b4f0 0x5622bc06b4e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b72ccee00 1 -- 10.20.193.4:0/875629978 >> 10.20.193.4:0/875629978 conn(0x5622bc08a140 msgr2=0x5622bc088cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b72ccee00 1 -- 10.20.193.4:0/875629978 shutdown_connections 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.831+0000 7f1b72ccee00 1 -- 10.20.193.4:0/875629978 wait complete. 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 -- start start 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 Processor -- start 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bbf8b4f0 0x5622bc091540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06d300 0x5622bc08faf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc06dc10 0x5622bc090030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5622bc048650 con 0x5622bbf8b4f0 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5622bc07d030 con 0x5622bc06dc10 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5622bc07e530 con 0x5622bc06d300 2026-02-24T09:15:01.842 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b6a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bbf8b4f0 0x5622bc091540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b6a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bbf8b4f0 0x5622bc091540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45226/0 (socket says 10.20.193.4:45226) 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b6a575640 1 -- 10.20.193.4:0/1873235487 learned_addr learned my addr 10.20.193.4:0/1873235487 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b69d74640 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06d300 0x5622bc08faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b6a575640 1 -- 10.20.193.4:0/1873235487 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06d300 msgr2=0x5622bc08faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b6a575640 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06d300 0x5622bc08faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b6a575640 1 -- 10.20.193.4:0/1873235487 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc06dc10 msgr2=0x5622bc090030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b6a575640 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc06dc10 0x5622bc090030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b6a575640 1 -- 10.20.193.4:0/1873235487 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622bbef7000 con 0x5622bbf8b4f0 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b6a575640 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bbf8b4f0 0x5622bc091540 secure :-1 s=READY pgs=904 gs=1 cs=0 l=1 c_cookie=18282170610561631289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b60043e20 tx=0x7f1b60005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb7514ea59cc439 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b1bfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b1bfff640 1 -- 10.20.193.4:0/1873235487 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b60037bd0 con 0x5622bbf8b4f0 2026-02-24T09:15:01.843 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b1bfff640 1 -- 10.20.193.4:0/1873235487 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5622bbc009d0 con 0x5622bbf8b4f0 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 -- 10.20.193.4:0/1873235487 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b540c4e70 con 0x5622bbf8b4f0 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b1bfff640 1 -- 10.20.193.4:0/1873235487 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b60038e00 con 0x5622bbf8b4f0 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 10 client.16998 _ll_register_callbacks cb 0x5622bbeef790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 -- 10.20.193.4:0/1873235487 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5622bbf857e0 con 0x5622bbf8b4f0 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b1bfff640 1 -- 10.20.193.4:0/1873235487 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1b60043400 con 0x5622bbf8b4f0 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b1bfff640 1 -- 10.20.193.4:0/1873235487 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1b60043700 con 0x5622bbf8b4f0 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 10 client.16998 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.832+0000 7f1b72ccee00 1 -- 10.20.193.4:0/1873235487 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5622bbf08d10 con 0x5622bbf8b4f0 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.833+0000 7f1b1bfff640 1 -- 10.20.193.4:0/1873235487 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f1b6002f9f0 con 0x5622bbf8b4f0 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.833+0000 7f1b72ccee00 10 client.16998 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.833+0000 7f1b72ccee00 10 client.16998 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.833+0000 7f1b72ccee00 20 client.16998 populate_metadata read hostname 'trial004' 2026-02-24T09:15:01.844 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.833+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622bc0af830 0x5622bc1807c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.833+0000 7f1b72ccee00 4 client.16998 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.833+0000 7f1b72ccee00 1 -- 10.20.193.4:0/1873235487 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5622bbbfe220 con 0x5622bc0af830 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.833+0000 7f1b69d74640 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622bc0af830 0x5622bc1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.833+0000 7f1b69d74640 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622bc0af830 0x5622bc1807c0 crc :-1 s=READY pgs=130 gs=4 cs=0 l=0 c_cookie=10870075283383658578 s_cookie=7610532484451552143 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96da43e0cbd62852 server_cookie=699e0af8e74e4b8f in_seq=0 out_seq=0 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.833+0000 7f1b1bfff640 10 client.16998 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b1bfff640 1 -- 10.20.193.4:0/1873235487 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5622bbbfe220 con 0x5622bc0af830 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b1bfff640 10 client.16998 handle_command_reply: tid=0 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 client.16998 shutdown 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 -- 10.20.193.4:0/1873235487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bbf8b4f0 msgr2=0x5622bc091540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bbf8b4f0 0x5622bc091540 secure :-1 s=READY pgs=904 gs=1 cs=0 l=1 c_cookie=18282170610561631289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b60043e20 tx=0x7f1b60005e90 comp rx=0 tx=0).stop 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 -- 10.20.193.4:0/1873235487 shutdown_connections 2026-02-24T09:15:01.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622bc0af830 0x5622bc1807c0 crc :-1 s=READY pgs=130 gs=4 cs=0 l=0 c_cookie=10870075283383658578 s_cookie=7610532484451552143 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622bc06dc10 0x5622bc090030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622bc06d300 0x5622bc08faf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b1bfff640 0 client.16998 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:01.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 --2- 10.20.193.4:0/1873235487 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622bbf8b4f0 0x5622bc091540 unknown :-1 s=CLOSED pgs=904 gs=1 cs=0 l=1 c_cookie=18282170610561631289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 -- 10.20.193.4:0/1873235487 >> 10.20.193.4:0/1873235487 conn(0x5622bc08a140 msgr2=0x5622bc06dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:01.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 -- 10.20.193.4:0/1873235487 shutdown_connections 2026-02-24T09:15:01.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 1 -- 10.20.193.4:0/1873235487 wait complete. 2026-02-24T09:15:01.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.834+0000 7f1b72ccee00 20 client.16998 trim_cache size 0 max 16384 2026-02-24T09:15:01.846 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:15:01.847 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:15:01.847 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "decad7a7-69bd-4dbf-948b-081612f34ad7", 2026-02-24T09:15:01.847 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:15:01.847 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:15:01.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1367424462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1b440b56e0 msgr2=0x7f1b440d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:01.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1b440b56e0 0x7f1b440d5b90 secure :-1 s=READY pgs=371 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b600023d0 tx=0x7f1b60031040 comp rx=0 tx=0).stop 2026-02-24T09:15:01.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1367424462 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1b6c0618e0 msgr2=0x7f1b6c162440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:01.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1b6c0618e0 0x7f1b6c162440 secure :-1 s=READY pgs=900 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b54005db0 tx=0x7f1b5400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1367424462 shutdown_connections 2026-02-24T09:15:01.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1b440b56e0 0x7f1b440d5b90 unknown :-1 s=CLOSED pgs=371 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b6c155730 0x7f1b6c167810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1b6c0618e0 0x7f1b6c162440 unknown :-1 s=CLOSED pgs=900 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 --2- 10.20.193.4:0/1367424462 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1b6c060fd0 0x7f1b6c161f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:01.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1367424462 >> 10.20.193.4:0/1367424462 conn(0x7f1b6c05f830 msgr2=0x7f1b6c10ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:01.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1367424462 shutdown_connections 2026-02-24T09:15:01.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:01.835+0000 7f1b70cd4640 1 -- 10.20.193.4:0/1367424462 wait complete. 2026-02-24T09:15:01.871 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:15:01.985 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:02.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 -- 10.20.193.4:0/706789090 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6458110040 msgr2=0x7f6458115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:02.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 --2- 10.20.193.4:0/706789090 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6458110040 0x7f6458115090 secure :-1 s=READY pgs=905 gs=1 cs=0 l=1 c_cookie=5137462228740937314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6448009890 tx=0x7f644802f0e0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 -- 10.20.193.4:0/706789090 shutdown_connections 2026-02-24T09:15:02.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 --2- 10.20.193.4:0/706789090 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6458115840 0x7f6458176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 --2- 10.20.193.4:0/706789090 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6458110040 0x7f6458115090 unknown :-1 s=CLOSED pgs=905 gs=1 cs=0 l=1 c_cookie=5137462228740937314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 --2- 10.20.193.4:0/706789090 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f645810f650 0x7f645810fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 -- 10.20.193.4:0/706789090 >> 10.20.193.4:0/706789090 conn(0x7f64580ecf20 msgr2=0x7f645810d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 -- 10.20.193.4:0/706789090 shutdown_connections 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 -- 10.20.193.4:0/706789090 wait complete. 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 Processor -- start 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 -- start start 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f645810f650 0x7f64580f5920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6458110040 0x7f6458176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6458115840 0x7f64580f6020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f64580fb230 con 0x7f6458115840 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f64580fb3a0 con 0x7f645810f650 2026-02-24T09:15:02.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.095+0000 7f645e189640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64580fb560 con 0x7f6458110040 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6457fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6458115840 0x7f64580f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6457fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6458115840 0x7f64580f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45236/0 (socket says 10.20.193.4:45236) 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6457fff640 1 -- 10.20.193.4:0/3121624569 learned_addr learned my addr 10.20.193.4:0/3121624569 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6456ffd640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6458110040 0x7f6458176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f64577fe640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f645810f650 0x7f64580f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6457fff640 1 -- 10.20.193.4:0/3121624569 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6458110040 msgr2=0x7f6458176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6457fff640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6458110040 0x7f6458176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6457fff640 1 -- 10.20.193.4:0/3121624569 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f645810f650 msgr2=0x7f64580f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6457fff640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f645810f650 0x7f64580f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6457fff640 1 -- 10.20.193.4:0/3121624569 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64440094b0 con 0x7f6458115840 2026-02-24T09:15:02.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f64577fe640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f645810f650 0x7f64580f5920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:15:02.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6457fff640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6458115840 0x7f64580f6020 secure :-1 s=READY pgs=906 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f644c006a20 tx=0x7f644c00fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:02.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6454ff9640 1 -- 10.20.193.4:0/3121624569 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f644c00dd70 con 0x7f6458115840 2026-02-24T09:15:02.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f645e189640 1 -- 10.20.193.4:0/3121624569 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64480094b0 con 0x7f6458115840 2026-02-24T09:15:02.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6454ff9640 1 -- 10.20.193.4:0/3121624569 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f644c005e10 con 0x7f6458115840 2026-02-24T09:15:02.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f6454ff9640 1 -- 10.20.193.4:0/3121624569 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f644c004bc0 con 0x7f6458115840 2026-02-24T09:15:02.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.096+0000 7f645e189640 1 -- 10.20.193.4:0/3121624569 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64580fbbd0 con 0x7f6458115840 2026-02-24T09:15:02.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.098+0000 7f6454ff9640 1 -- 10.20.193.4:0/3121624569 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f644c005820 con 0x7f6458115840 2026-02-24T09:15:02.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.099+0000 7f6454ff9640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f642c0b56d0 0x7f642c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.099+0000 7f64577fe640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f642c0b56d0 0x7f642c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.099+0000 7f6454ff9640 1 -- 10.20.193.4:0/3121624569 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f644c015070 con 0x7f6458115840 2026-02-24T09:15:02.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.099+0000 7f64577fe640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f642c0b56d0 0x7f642c0d5b80 secure :-1 s=READY pgs=372 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6444004740 tx=0x7f6444005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:02.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.099+0000 7f6460183e00 1 Processor -- start 2026-02-24T09:15:02.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.099+0000 7f6460183e00 1 -- start start 2026-02-24T09:15:02.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4ef820 0x55b23c4efbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4f0130 0x55b23c534890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c534dd0 0x55b23c5551b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b23c3ffde0 con 0x55b23c4f0130 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b23c3fbb10 con 0x55b23c4ef820 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b23c3f5ab0 con 0x55b23c534dd0 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6456ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4f0130 0x55b23c534890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6456ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4f0130 0x55b23c534890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45244/0 (socket says 10.20.193.4:45244) 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6456ffd640 1 -- 10.20.193.4:0/2001531162 learned_addr learned my addr 10.20.193.4:0/2001531162 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f64577fe640 1 --2- 10.20.193.4:0/2001531162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4ef820 0x55b23c4efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6457fff640 1 --2- 10.20.193.4:0/2001531162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c534dd0 0x55b23c5551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6456ffd640 1 -- 10.20.193.4:0/2001531162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c534dd0 msgr2=0x55b23c5551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6456ffd640 1 --2- 10.20.193.4:0/2001531162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c534dd0 0x55b23c5551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6456ffd640 1 -- 10.20.193.4:0/2001531162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4ef820 msgr2=0x55b23c4efbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6456ffd640 1 --2- 10.20.193.4:0/2001531162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4ef820 0x55b23c4efbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6456ffd640 1 -- 10.20.193.4:0/2001531162 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b23c3a1310 con 0x55b23c4f0130 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6456ffd640 1 --2- 10.20.193.4:0/2001531162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4f0130 0x55b23c534890 secure :-1 s=READY pgs=907 gs=1 cs=0 l=1 c_cookie=5743964486485431210 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64480384b0 tx=0x7f6448002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb6a944836c53aa server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f641bfff640 1 -- 10.20.193.4:0/2001531162 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f644803d050 con 0x55b23c4f0130 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f641bfff640 1 -- 10.20.193.4:0/2001531162 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f644803e040 con 0x55b23c4f0130 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f641bfff640 1 -- 10.20.193.4:0/2001531162 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64480046b0 con 0x55b23c4f0130 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 -- 10.20.193.4:0/2001531162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4f0130 msgr2=0x55b23c534890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 --2- 10.20.193.4:0/2001531162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4f0130 0x55b23c534890 secure :-1 s=READY pgs=907 gs=1 cs=0 l=1 c_cookie=5743964486485431210 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64480384b0 tx=0x7f6448002390 comp rx=0 tx=0).stop 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 -- 10.20.193.4:0/2001531162 shutdown_connections 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 --2- 10.20.193.4:0/2001531162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c534dd0 0x55b23c5551b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 --2- 10.20.193.4:0/2001531162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4f0130 0x55b23c534890 unknown :-1 s=CLOSED pgs=907 gs=1 cs=0 l=1 c_cookie=5743964486485431210 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.100+0000 7f6460183e00 1 --2- 10.20.193.4:0/2001531162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4ef820 0x55b23c4efbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.101+0000 7f6460183e00 1 -- 10.20.193.4:0/2001531162 >> 10.20.193.4:0/2001531162 conn(0x55b23c40e6b0 msgr2=0x55b23c4ee100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:02.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.101+0000 7f6460183e00 1 -- 10.20.193.4:0/2001531162 shutdown_connections 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.101+0000 7f6460183e00 1 -- 10.20.193.4:0/2001531162 wait complete. 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.101+0000 7f6460183e00 1 -- start start 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 1 Processor -- start 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4ef820 0x55b23c507da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4f0130 0x55b23c5082e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c534dd0 0x55b23c50d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b23c50d810 con 0x55b23c4ef820 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b23c50d980 con 0x55b23c4f0130 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b23c50db40 con 0x55b23c534dd0 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64577fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4ef820 0x55b23c507da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64577fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4ef820 0x55b23c507da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45246/0 (socket says 10.20.193.4:45246) 2026-02-24T09:15:02.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64577fe640 1 -- 10.20.193.4:0/4226107677 learned_addr learned my addr 10.20.193.4:0/4226107677 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6457fff640 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c534dd0 0x55b23c50d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6456ffd640 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4f0130 0x55b23c5082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64577fe640 1 -- 10.20.193.4:0/4226107677 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c534dd0 msgr2=0x55b23c50d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64577fe640 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c534dd0 0x55b23c50d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64577fe640 1 -- 10.20.193.4:0/4226107677 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4f0130 msgr2=0x55b23c5082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64577fe640 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4f0130 0x55b23c5082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64577fe640 1 -- 10.20.193.4:0/4226107677 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b23c3798c0 con 0x55b23c4ef820 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6456ffd640 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4f0130 0x55b23c5082e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64577fe640 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4ef820 0x55b23c507da0 secure :-1 s=READY pgs=908 gs=1 cs=0 l=1 c_cookie=15478612894346777794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6444012a60 tx=0x7f64440047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6cf146b0f5214c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64197fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64197fa640 1 -- 10.20.193.4:0/4226107677 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6444023070 con 0x55b23c4ef820 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 1 -- 10.20.193.4:0/4226107677 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6458176a80 con 0x55b23c4ef820 2026-02-24T09:15:02.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64197fa640 1 -- 10.20.193.4:0/4226107677 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6444016070 con 0x55b23c4ef820 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64197fa640 1 -- 10.20.193.4:0/4226107677 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6444028d70 con 0x55b23c4ef820 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 10 client.17010 _ll_register_callbacks cb 0x55b23c391160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 1 -- 10.20.193.4:0/4226107677 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b23c1454a0 con 0x55b23c4ef820 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64197fa640 1 -- 10.20.193.4:0/4226107677 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f644401b400 con 0x55b23c4ef820 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f64197fa640 1 -- 10.20.193.4:0/4226107677 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f644401b600 con 0x55b23c4ef820 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 10 client.17010 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.102+0000 7f6460183e00 1 -- 10.20.193.4:0/4226107677 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55b23c38b6e0 con 0x55b23c4ef820 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.103+0000 7f64197fa640 1 -- 10.20.193.4:0/4226107677 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6444028420 con 0x55b23c4ef820 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.103+0000 7f6460183e00 10 client.17010 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.103+0000 7f6460183e00 10 client.17010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:02.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.103+0000 7f6460183e00 20 client.17010 populate_metadata read hostname 'trial004' 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.103+0000 7f6460183e00 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b23c532750 0x55b23c532bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.103+0000 7f6460183e00 4 client.17010 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.103+0000 7f6460183e00 1 -- 10.20.193.4:0/4226107677 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b23c3eb4f0 con 0x55b23c532750 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.103+0000 7f6456ffd640 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b23c532750 0x55b23c532bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6456ffd640 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b23c532750 0x55b23c532bf0 crc :-1 s=READY pgs=131 gs=4 cs=0 l=0 c_cookie=13344654415862644297 s_cookie=17289002278311473044 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b931bc7cfbd73e49 server_cookie=efeedff897acaf94 in_seq=0 out_seq=0 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f64197fa640 10 client.17010 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f64197fa640 1 -- 10.20.193.4:0/4226107677 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b23c3eb4f0 con 0x55b23c532750 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f64197fa640 10 client.17010 handle_command_reply: tid=0 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 client.17010 shutdown 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 -- 10.20.193.4:0/4226107677 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4ef820 msgr2=0x55b23c507da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:02.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4ef820 0x55b23c507da0 secure :-1 s=READY pgs=908 gs=1 cs=0 l=1 c_cookie=15478612894346777794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6444012a60 tx=0x7f64440047e0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 -- 10.20.193.4:0/4226107677 shutdown_connections 2026-02-24T09:15:02.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b23c532750 0x55b23c532bf0 crc :-1 s=READY pgs=131 gs=4 cs=0 l=0 c_cookie=13344654415862644297 s_cookie=17289002278311473044 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c534dd0 0x55b23c50d2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4f0130 0x55b23c5082e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 --2- 10.20.193.4:0/4226107677 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c4ef820 0x55b23c507da0 unknown :-1 s=CLOSED pgs=908 gs=1 cs=0 l=1 c_cookie=15478612894346777794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f64197fa640 0 client.17010 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:02.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 -- 10.20.193.4:0/4226107677 >> 10.20.193.4:0/4226107677 conn(0x55b23c40e6b0 msgr2=0x55b23c4ee810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:02.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 -- 10.20.193.4:0/4226107677 shutdown_connections 2026-02-24T09:15:02.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 1 -- 10.20.193.4:0/4226107677 wait complete. 2026-02-24T09:15:02.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.104+0000 7f6460183e00 20 client.17010 trim_cache size 0 max 16384 2026-02-24T09:15:02.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6460183e00 1 Processor -- start 2026-02-24T09:15:02.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6460183e00 1 -- start start 2026-02-24T09:15:02.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6460183e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4ef820 0x55b23c5053a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6460183e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c4f0130 0x55b23c50c840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6460183e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5342c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6460183e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b23c3f36e0 con 0x55b23c534dd0 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6460183e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b23c0bef50 con 0x55b23c4ef820 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6460183e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b23c530d70 con 0x55b23c4f0130 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6457fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6457fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5342c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45254/0 (socket says 10.20.193.4:45254) 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6457fff640 1 -- 10.20.193.4:0/85661518 learned_addr learned my addr 10.20.193.4:0/85661518 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f64577fe640 1 --2- 10.20.193.4:0/85661518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4ef820 0x55b23c5053a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6456ffd640 1 --2- 10.20.193.4:0/85661518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c4f0130 0x55b23c50c840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6457fff640 1 -- 10.20.193.4:0/85661518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c4f0130 msgr2=0x55b23c50c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6457fff640 1 --2- 10.20.193.4:0/85661518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c4f0130 0x55b23c50c840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6457fff640 1 -- 10.20.193.4:0/85661518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4ef820 msgr2=0x55b23c5053a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6457fff640 1 --2- 10.20.193.4:0/85661518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4ef820 0x55b23c5053a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6457fff640 1 -- 10.20.193.4:0/85661518 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b23c386160 con 0x55b23c534dd0 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f6457fff640 1 --2- 10.20.193.4:0/85661518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5342c0 secure :-1 s=READY pgs=909 gs=1 cs=0 l=1 c_cookie=17033694221610418420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f644c0057d0 tx=0x7f644c005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec63d6a56bb680f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f641b7fe640 1 -- 10.20.193.4:0/85661518 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f644c006cb0 con 0x55b23c534dd0 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f641b7fe640 1 -- 10.20.193.4:0/85661518 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f644c0ae8d0 con 0x55b23c534dd0 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.113+0000 7f641b7fe640 1 -- 10.20.193.4:0/85661518 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f644c0d30d0 con 0x55b23c534dd0 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 -- 10.20.193.4:0/85661518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 msgr2=0x55b23c5342c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 --2- 10.20.193.4:0/85661518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5342c0 secure :-1 s=READY pgs=909 gs=1 cs=0 l=1 c_cookie=17033694221610418420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f644c0057d0 tx=0x7f644c005670 comp rx=0 tx=0).stop 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 -- 10.20.193.4:0/85661518 shutdown_connections 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 --2- 10.20.193.4:0/85661518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5342c0 unknown :-1 s=CLOSED pgs=909 gs=1 cs=0 l=1 c_cookie=17033694221610418420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 --2- 10.20.193.4:0/85661518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c4f0130 0x55b23c50c840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 --2- 10.20.193.4:0/85661518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4ef820 0x55b23c5053a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 -- 10.20.193.4:0/85661518 >> 10.20.193.4:0/85661518 conn(0x55b23c40e6b0 msgr2=0x55b23c50c130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 -- 10.20.193.4:0/85661518 shutdown_connections 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 -- 10.20.193.4:0/85661518 wait complete. 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 -- start start 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 Processor -- start 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c4ef820 0x55b23c5125c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4f0130 0x55b23c512b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5113c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.114+0000 7f6460183e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b23c45f3d0 con 0x55b23c534dd0 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b23c511900 con 0x55b23c4f0130 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b23c511ac0 con 0x55b23c4ef820 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6457fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5113c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f64577fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c4ef820 0x55b23c5125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6457fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5113c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45260/0 (socket says 10.20.193.4:45260) 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6457fff640 1 -- 10.20.193.4:0/1642020909 learned_addr learned my addr 10.20.193.4:0/1642020909 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6457fff640 1 -- 10.20.193.4:0/1642020909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c4ef820 msgr2=0x55b23c5125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6457fff640 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c4ef820 0x55b23c5125c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6457fff640 1 -- 10.20.193.4:0/1642020909 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4f0130 msgr2=0x55b23c512b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6457fff640 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4f0130 0x55b23c512b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6457fff640 1 -- 10.20.193.4:0/1642020909 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b23c379bf0 con 0x55b23c534dd0 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6457fff640 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5113c0 secure :-1 s=READY pgs=910 gs=1 cs=0 l=1 c_cookie=16326062396517157642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f644c0ab140 tx=0x7f644c0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e291d3401d448b0a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f64197fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f64197fa640 1 -- 10.20.193.4:0/1642020909 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f644c0d30d0 con 0x55b23c534dd0 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f64197fa640 1 -- 10.20.193.4:0/1642020909 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f644c0d3260 con 0x55b23c534dd0 2026-02-24T09:15:02.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 1 -- 10.20.193.4:0/1642020909 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64580fbbd0 con 0x55b23c534dd0 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f64197fa640 1 -- 10.20.193.4:0/1642020909 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f644c0aede0 con 0x55b23c534dd0 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 10 client.17016 _ll_register_callbacks cb 0x55b23c391160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 1 -- 10.20.193.4:0/1642020909 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b23c080f40 con 0x55b23c534dd0 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f64197fa640 1 -- 10.20.193.4:0/1642020909 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f644c0abeb0 con 0x55b23c534dd0 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f64197fa640 1 -- 10.20.193.4:0/1642020909 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f644c0ac090 con 0x55b23c534dd0 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 10 client.17016 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 1 -- 10.20.193.4:0/1642020909 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55b23c38b940 con 0x55b23c534dd0 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f64197fa640 1 -- 10.20.193.4:0/1642020909 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f644c0cc020 con 0x55b23c534dd0 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 10 client.17016 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 10 client.17016 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 20 client.17016 populate_metadata read hostname 'trial004' 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b23c5e27f0 0x55b23c602ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:02.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 4 client.17016 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f6460183e00 1 -- 10.20.193.4:0/1642020909 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f644803e040 con 0x55b23c5e27f0 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.115+0000 7f64577fe640 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b23c5e27f0 0x55b23c602ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f64577fe640 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b23c5e27f0 0x55b23c602ca0 crc :-1 s=READY pgs=132 gs=4 cs=0 l=0 c_cookie=222879801271077678 s_cookie=17356425881148138468 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=317d3ff965f4b2e server_cookie=f0de6961703b23e4 in_seq=0 out_seq=0 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f64197fa640 10 client.17016 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f64197fa640 1 -- 10.20.193.4:0/1642020909 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x7f644803e040 con 0x55b23c5e27f0 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f64197fa640 10 client.17016 handle_command_reply: tid=0 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 client.17016 shutdown 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 -- 10.20.193.4:0/1642020909 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 msgr2=0x55b23c5113c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5113c0 secure :-1 s=READY pgs=910 gs=1 cs=0 l=1 c_cookie=16326062396517157642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f644c0ab140 tx=0x7f644c0055d0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 -- 10.20.193.4:0/1642020909 shutdown_connections 2026-02-24T09:15:02.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b23c5e27f0 0x55b23c602ca0 crc :-1 s=READY pgs=132 gs=4 cs=0 l=0 c_cookie=222879801271077678 s_cookie=17356425881148138468 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b23c534dd0 0x55b23c5113c0 unknown :-1 s=CLOSED pgs=910 gs=1 cs=0 l=1 c_cookie=16326062396517157642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b23c4f0130 0x55b23c512b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 --2- 10.20.193.4:0/1642020909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b23c4ef820 0x55b23c5125c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f64197fa640 0 client.17016 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:02.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 -- 10.20.193.4:0/1642020909 >> 10.20.193.4:0/1642020909 conn(0x55b23c40e6b0 msgr2=0x55b23c50c920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:02.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 -- 10.20.193.4:0/1642020909 shutdown_connections 2026-02-24T09:15:02.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 1 -- 10.20.193.4:0/1642020909 wait complete. 2026-02-24T09:15:02.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f6460183e00 20 client.17016 trim_cache size 0 max 16384 2026-02-24T09:15:02.131 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:15:02.131 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:15:02.131 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:15:02.131 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:15:02.131 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.131 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "decad7a7-69bd-4dbf-948b-081612f34ad7", 2026-02-24T09:15:02.131 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:15:02.131 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:02.131 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.132 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:15:02.133 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.134 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.135 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.136 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:02.137 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 -- 10.20.193.4:0/3121624569 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f642c0b56d0 msgr2=0x7f642c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f642c0b56d0 0x7f642c0d5b80 secure :-1 s=READY pgs=372 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6444004740 tx=0x7f6444005f90 comp rx=0 tx=0).stop 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 -- 10.20.193.4:0/3121624569 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6458115840 msgr2=0x7f64580f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6458115840 0x7f64580f6020 secure :-1 s=READY pgs=906 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f644c006a20 tx=0x7f644c00fdc0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 -- 10.20.193.4:0/3121624569 shutdown_connections 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f642c0b56d0 0x7f642c0d5b80 unknown :-1 s=CLOSED pgs=372 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6458115840 0x7f64580f6020 unknown :-1 s=CLOSED pgs=906 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6458110040 0x7f6458176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 --2- 10.20.193.4:0/3121624569 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f645810f650 0x7f64580f5920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:02.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 -- 10.20.193.4:0/3121624569 >> 10.20.193.4:0/3121624569 conn(0x7f64580ecf20 msgr2=0x7f645810dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:02.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 -- 10.20.193.4:0/3121624569 shutdown_connections 2026-02-24T09:15:02.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:02.116+0000 7f645e189640 1 -- 10.20.193.4:0/3121624569 wait complete. 2026-02-24T09:15:02.153 INFO:tasks.cephfs.filesystem:scrub status for tag:decad7a7-69bd-4dbf-948b-081612f34ad7 - {'path': '/', 'tag': 'decad7a7-69bd-4dbf-948b-081612f34ad7', 'options': 'recursive,force'} 2026-02-24T09:15:03.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:02 trial090 ceph-mon[47278]: pgmap v309: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 13 MiB/s wr, 84 op/s 2026-02-24T09:15:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:02 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:15:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:02 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:02 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:15:03.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:02 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:02 trial014 ceph-mon[46941]: pgmap v309: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 13 MiB/s wr, 84 op/s 2026-02-24T09:15:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:02 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:15:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:02 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:02 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:15:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:02 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:02 trial004 ceph-mon[41596]: pgmap v309: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 13 MiB/s wr, 84 op/s 2026-02-24T09:15:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:02 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:15:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:02 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:02 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:15:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:02 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:05.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:04 trial090 ceph-mon[47278]: pgmap v310: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 15 MiB/s wr, 95 op/s 2026-02-24T09:15:05.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:04 trial014 ceph-mon[46941]: pgmap v310: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 15 MiB/s wr, 95 op/s 2026-02-24T09:15:05.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:04 trial004 ceph-mon[41596]: pgmap v310: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 15 MiB/s wr, 95 op/s 2026-02-24T09:15:07.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:06 trial090 ceph-mon[47278]: pgmap v311: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 16 MiB/s wr, 103 op/s 2026-02-24T09:15:07.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:06 trial014 ceph-mon[46941]: pgmap v311: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 16 MiB/s wr, 103 op/s 2026-02-24T09:15:07.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:06 trial004 ceph-mon[41596]: pgmap v311: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 16 MiB/s wr, 103 op/s 2026-02-24T09:15:09.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:08 trial090 ceph-mon[47278]: pgmap v312: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 19 MiB/s wr, 116 op/s 2026-02-24T09:15:09.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:08 trial014 ceph-mon[46941]: pgmap v312: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 19 MiB/s wr, 116 op/s 2026-02-24T09:15:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:08 trial004 ceph-mon[41596]: pgmap v312: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 19 MiB/s wr, 116 op/s 2026-02-24T09:15:11.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:10 trial090 ceph-mon[47278]: pgmap v313: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 19 MiB/s wr, 115 op/s 2026-02-24T09:15:11.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:10 trial014 ceph-mon[46941]: pgmap v313: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 19 MiB/s wr, 115 op/s 2026-02-24T09:15:11.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:10 trial004 ceph-mon[41596]: pgmap v313: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 19 MiB/s wr, 115 op/s 2026-02-24T09:15:12.549 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:15:12.665 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:12.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.764+0000 7f7d8d85f640 1 -- 10.20.193.4:0/2370681042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d8810f280 msgr2=0x7f7d8810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:12.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.764+0000 7f7d8d85f640 1 --2- 10.20.193.4:0/2370681042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d8810f280 0x7f7d8810f650 secure :-1 s=READY pgs=911 gs=1 cs=0 l=1 c_cookie=2856562960206677595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d7c009950 tx=0x7f7d7c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.764+0000 7f7d8d85f640 1 -- 10.20.193.4:0/2370681042 shutdown_connections 2026-02-24T09:15:12.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.764+0000 7f7d8d85f640 1 --2- 10.20.193.4:0/2370681042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d88115470 0x7f7d88175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.764+0000 7f7d8d85f640 1 --2- 10.20.193.4:0/2370681042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d8810fc70 0x7f7d88114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.764+0000 7f7d8d85f640 1 --2- 10.20.193.4:0/2370681042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d8810f280 0x7f7d8810f650 unknown :-1 s=CLOSED pgs=911 gs=1 cs=0 l=1 c_cookie=2856562960206677595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.764+0000 7f7d8d85f640 1 -- 10.20.193.4:0/2370681042 >> 10.20.193.4:0/2370681042 conn(0x7f7d8805f830 msgr2=0x7f7d8810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:12.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.764+0000 7f7d8d85f640 1 -- 10.20.193.4:0/2370681042 shutdown_connections 2026-02-24T09:15:12.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.764+0000 7f7d8d85f640 1 -- 10.20.193.4:0/2370681042 wait complete. 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8d85f640 1 Processor -- start 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8d85f640 1 -- start start 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8d85f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d8810f280 0x7f7d8811dbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8d85f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d8810fc70 0x7f7d8811e0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8d85f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d88115470 0x7f7d881234c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8d85f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88123ae0 con 0x7f7d8810f280 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8d85f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88123c50 con 0x7f7d88115470 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8d85f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88123e10 con 0x7f7d8810fc70 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d86ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d8810f280 0x7f7d8811dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d86ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d8810f280 0x7f7d8811dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51610/0 (socket says 10.20.193.4:51610) 2026-02-24T09:15:12.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d86ffd640 1 -- 10.20.193.4:0/109213412 learned_addr learned my addr 10.20.193.4:0/109213412 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d877fe640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d88115470 0x7f7d881234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d867fc640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d8810fc70 0x7f7d8811e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d86ffd640 1 -- 10.20.193.4:0/109213412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d8810fc70 msgr2=0x7f7d8811e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d86ffd640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d8810fc70 0x7f7d8811e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d86ffd640 1 -- 10.20.193.4:0/109213412 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d88115470 msgr2=0x7f7d881234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d86ffd640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d88115470 0x7f7d881234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d86ffd640 1 -- 10.20.193.4:0/109213412 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7c009570 con 0x7f7d8810f280 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d86ffd640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d8810f280 0x7f7d8811dbb0 secure :-1 s=READY pgs=912 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d7c0023d0 tx=0x7f7d7c0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8c85d640 1 -- 10.20.193.4:0/109213412 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d7c03d070 con 0x7f7d8810f280 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8c85d640 1 -- 10.20.193.4:0/109213412 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7d7c038920 con 0x7f7d8810f280 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8d85f640 1 -- 10.20.193.4:0/109213412 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d88124090 con 0x7f7d8810f280 2026-02-24T09:15:12.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8c85d640 1 -- 10.20.193.4:0/109213412 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d7c0419d0 con 0x7f7d8810f280 2026-02-24T09:15:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.765+0000 7f7d8d85f640 1 -- 10.20.193.4:0/109213412 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d881647f0 con 0x7f7d8810f280 2026-02-24T09:15:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.766+0000 7f7d8d85f640 1 -- 10.20.193.4:0/109213412 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d88110560 con 0x7f7d8810f280 2026-02-24T09:15:12.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.767+0000 7f7d8c85d640 1 -- 10.20.193.4:0/109213412 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f7d7c038a90 con 0x7f7d8810f280 2026-02-24T09:15:12.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.768+0000 7f7d8c85d640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d5c0b56e0 0x7f7d5c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:12.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.768+0000 7f7d8c85d640 1 -- 10.20.193.4:0/109213412 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f7d7c10b950 con 0x7f7d8810f280 2026-02-24T09:15:12.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.768+0000 7f7d867fc640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d5c0b56e0 0x7f7d5c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:12.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.768+0000 7f7d867fc640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d5c0b56e0 0x7f7d5c0d5b90 secure :-1 s=READY pgs=373 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d88124550 tx=0x7f7d70004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:12.775 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.768+0000 7f7d8c85d640 1 -- 10.20.193.4:0/109213412 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f7d7c0ce3a0 con 0x7f7d8810f280 2026-02-24T09:15:12.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.898+0000 7f7d8d85f640 1 -- 10.20.193.4:0/109213412 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d8811ed10 con 0x7f7d8810f280 2026-02-24T09:15:12.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.898+0000 7f7d8c85d640 1 -- 10.20.193.4:0/109213412 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f7d7c0d14c0 con 0x7f7d8810f280 2026-02-24T09:15:12.902 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:15:12.903 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:15:12.904 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:15:12.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 -- 10.20.193.4:0/109213412 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d5c0b56e0 msgr2=0x7f7d5c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:12.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d5c0b56e0 0x7f7d5c0d5b90 secure :-1 s=READY pgs=373 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d88124550 tx=0x7f7d70004420 comp rx=0 tx=0).stop 2026-02-24T09:15:12.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 -- 10.20.193.4:0/109213412 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d8810f280 msgr2=0x7f7d8811dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:12.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d8810f280 0x7f7d8811dbb0 secure :-1 s=READY pgs=912 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d7c0023d0 tx=0x7f7d7c0043d0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 -- 10.20.193.4:0/109213412 shutdown_connections 2026-02-24T09:15:12.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7d5c0b56e0 0x7f7d5c0d5b90 unknown :-1 s=CLOSED pgs=373 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7d88115470 0x7f7d881234c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d8810fc70 0x7f7d8811e0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 --2- 10.20.193.4:0/109213412 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7d8810f280 0x7f7d8811dbb0 unknown :-1 s=CLOSED pgs=912 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:12.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 -- 10.20.193.4:0/109213412 >> 10.20.193.4:0/109213412 conn(0x7f7d8805f830 msgr2=0x7f7d8810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:12.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 -- 10.20.193.4:0/109213412 shutdown_connections 2026-02-24T09:15:12.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:12.899+0000 7f7d8d85f640 1 -- 10.20.193.4:0/109213412 wait complete. 2026-02-24T09:15:12.940 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id c2bd5211 --release --await' 2026-02-24T09:15:12.941 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id c2bd5211 --release --await 2026-02-24T09:15:13.060 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:13.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:12 trial090 ceph-mon[47278]: pgmap v314: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 12 MiB/s wr, 77 op/s 2026-02-24T09:15:13.086 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:12 trial004 ceph-mon[41596]: pgmap v314: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 12 MiB/s wr, 77 op/s 2026-02-24T09:15:13.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:12 trial014 ceph-mon[46941]: pgmap v314: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 12 MiB/s wr, 77 op/s 2026-02-24T09:15:13.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.202+0000 7f9a6a827640 1 -- 10.20.193.4:0/2211149176 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9a64155c60 msgr2=0x7f9a64176040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:13.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.202+0000 7f9a6a827640 1 --2- 10.20.193.4:0/2211149176 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9a64155c60 0x7f9a64176040 secure :-1 s=READY pgs=913 gs=1 cs=0 l=1 c_cookie=3249617371815302916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6000aa30 tx=0x7f9a60030290 comp rx=0 tx=0).stop 2026-02-24T09:15:13.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.202+0000 7f9a6a827640 1 -- 10.20.193.4:0/2211149176 shutdown_connections 2026-02-24T09:15:13.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.202+0000 7f9a6a827640 1 --2- 10.20.193.4:0/2211149176 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9a64155c60 0x7f9a64176040 unknown :-1 s=CLOSED pgs=913 gs=1 cs=0 l=1 c_cookie=3249617371815302916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.202+0000 7f9a6a827640 1 --2- 10.20.193.4:0/2211149176 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a6410c840 0x7f9a64155720 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.202+0000 7f9a6a827640 1 --2- 10.20.193.4:0/2211149176 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9a6410bf30 0x7f9a6410c300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.202+0000 7f9a6a827640 1 -- 10.20.193.4:0/2211149176 >> 10.20.193.4:0/2211149176 conn(0x7f9a640e9bf0 msgr2=0x7f9a6410a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:13.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.203+0000 7f9a6a827640 1 -- 10.20.193.4:0/2211149176 shutdown_connections 2026-02-24T09:15:13.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.203+0000 7f9a6a827640 1 -- 10.20.193.4:0/2211149176 wait complete. 2026-02-24T09:15:13.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.203+0000 7f9a6a827640 1 Processor -- start 2026-02-24T09:15:13.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.203+0000 7f9a6a827640 1 -- start start 2026-02-24T09:15:13.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.203+0000 7f9a6a827640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a6410bf30 0x7f9a641612c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.203+0000 7f9a6a827640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9a6410c840 0x7f9a64161800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.203+0000 7f9a6a827640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9a64155c60 0x7f9a64166bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.203+0000 7f9a6a827640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641671f0 con 0x7f9a6410c840 2026-02-24T09:15:13.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.203+0000 7f9a6a827640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64167360 con 0x7f9a64155c60 2026-02-24T09:15:13.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.203+0000 7f9a6a827640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64167520 con 0x7f9a6410bf30 2026-02-24T09:15:13.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a5b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9a6410c840 0x7f9a64161800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a5b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9a6410c840 0x7f9a64161800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45078/0 (socket says 10.20.193.4:45078) 2026-02-24T09:15:13.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a5b7fe640 1 -- 10.20.193.4:0/517766236 learned_addr learned my addr 10.20.193.4:0/517766236 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:13.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a6410bf30 0x7f9a641612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a5b7fe640 1 -- 10.20.193.4:0/517766236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a6410bf30 msgr2=0x7f9a641612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:13.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a5b7fe640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a6410bf30 0x7f9a641612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a5b7fe640 1 -- 10.20.193.4:0/517766236 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9a64155c60 msgr2=0x7f9a64166bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:15:13.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a5b7fe640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9a64155c60 0x7f9a64166bd0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a5b7fe640 1 -- 10.20.193.4:0/517766236 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6000a650 con 0x7f9a6410c840 2026-02-24T09:15:13.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a5b7fe640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9a6410c840 0x7f9a64161800 secure :-1 s=READY pgs=914 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a4c00b520 tx=0x7f9a4c00b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:13.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a597fa640 1 -- 10.20.193.4:0/517766236 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a4c0044a0 con 0x7f9a6410c840 2026-02-24T09:15:13.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a6a827640 1 -- 10.20.193.4:0/517766236 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a64167800 con 0x7f9a6410c840 2026-02-24T09:15:13.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a597fa640 1 -- 10.20.193.4:0/517766236 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a4c002c20 con 0x7f9a6410c840 2026-02-24T09:15:13.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a597fa640 1 -- 10.20.193.4:0/517766236 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a4c00fdb0 con 0x7f9a6410c840 2026-02-24T09:15:13.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.204+0000 7f9a6a827640 1 -- 10.20.193.4:0/517766236 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a64152910 con 0x7f9a6410c840 2026-02-24T09:15:13.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.208+0000 7f9a597fa640 1 -- 10.20.193.4:0/517766236 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9a4c002740 con 0x7f9a6410c840 2026-02-24T09:15:13.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.208+0000 7f9a597fa640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a400b5760 0x7f9a400d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.208+0000 7f9a597fa640 1 -- 10.20.193.4:0/517766236 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9a4c0e64b0 con 0x7f9a6410c840 2026-02-24T09:15:13.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.209+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a400b5760 0x7f9a400d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.209+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a400b5760 0x7f9a400d5c10 secure :-1 s=READY pgs=374 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a54004740 tx=0x7f9a54004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:13.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a6c821e00 1 Processor -- start 2026-02-24T09:15:13.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a6c821e00 1 -- start start 2026-02-24T09:15:13.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 0x55affde9e380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9e8c0 0x55affdee3020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf03940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55affddaf050 con 0x55affdee3560 2026-02-24T09:15:13.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55affddaad80 con 0x55affde9dfb0 2026-02-24T09:15:13.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55affdda4ee0 con 0x55affde9e8c0 2026-02-24T09:15:13.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a68d9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf03940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a68d9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf03940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45086/0 (socket says 10.20.193.4:45086) 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a68d9d640 1 -- 10.20.193.4:0/3426617938 learned_addr learned my addr 10.20.193.4:0/3426617938 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/3426617938 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 0x55affde9e380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.212+0000 7f9a5b7fe640 1 --2- 10.20.193.4:0/3426617938 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9e8c0 0x55affdee3020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a68d9d640 1 -- 10.20.193.4:0/3426617938 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9e8c0 msgr2=0x55affdee3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/3426617938 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9e8c0 0x55affdee3020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a68d9d640 1 -- 10.20.193.4:0/3426617938 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 msgr2=0x55affde9e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/3426617938 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 0x55affde9e380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a68d9d640 1 -- 10.20.193.4:0/3426617938 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55affdd50540 con 0x55affdee3560 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/3426617938 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 0x55affde9e380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/3426617938 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf03940 secure :-1 s=READY pgs=915 gs=1 cs=0 l=1 c_cookie=15232999584558849529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6000a360 tx=0x7f9a60006a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3667c6a0d4d9df9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:13.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a38ce3640 1 -- 10.20.193.4:0/3426617938 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a6003e070 con 0x55affdee3560 2026-02-24T09:15:13.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a38ce3640 1 -- 10.20.193.4:0/3426617938 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a60030af0 con 0x55affdee3560 2026-02-24T09:15:13.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a38ce3640 1 -- 10.20.193.4:0/3426617938 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a600050c0 con 0x55affdee3560 2026-02-24T09:15:13.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3426617938 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 msgr2=0x55affdf03940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:13.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/3426617938 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf03940 secure :-1 s=READY pgs=915 gs=1 cs=0 l=1 c_cookie=15232999584558849529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6000a360 tx=0x7f9a60006a90 comp rx=0 tx=0).stop 2026-02-24T09:15:13.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3426617938 shutdown_connections 2026-02-24T09:15:13.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/3426617938 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf03940 unknown :-1 s=CLOSED pgs=915 gs=1 cs=0 l=1 c_cookie=15232999584558849529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/3426617938 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9e8c0 0x55affdee3020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/3426617938 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 0x55affde9e380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3426617938 >> 10.20.193.4:0/3426617938 conn(0x55affde7c4b0 msgr2=0x55affde9c890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3426617938 shutdown_connections 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.213+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3426617938 wait complete. 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.214+0000 7f9a6c821e00 1 -- start start 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.214+0000 7f9a6c821e00 1 Processor -- start 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 0x55affdefaed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 0x55affdefb410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf00400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55affdf00940 con 0x55affdee3560 2026-02-24T09:15:13.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55affdf00ab0 con 0x55affde9e8c0 2026-02-24T09:15:13.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55affdf00c70 con 0x55affde9dfb0 2026-02-24T09:15:13.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a68d9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf00400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a68d9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf00400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45088/0 (socket says 10.20.193.4:45088) 2026-02-24T09:15:13.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a68d9d640 1 -- 10.20.193.4:0/1750101300 learned_addr learned my addr 10.20.193.4:0/1750101300 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:13.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 0x55affdefaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a68d9d640 1 -- 10.20.193.4:0/1750101300 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 msgr2=0x55affdefaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:13.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 0x55affdefaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a68d9d640 1 -- 10.20.193.4:0/1750101300 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 msgr2=0x55affdefb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:13.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a5b7fe640 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 0x55affdefb410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 0x55affdefb410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a68d9d640 1 -- 10.20.193.4:0/1750101300 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a64060e70 con 0x55affdee3560 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a5b7fe640 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 0x55affdefb410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf00400 secure :-1 s=READY pgs=916 gs=1 cs=0 l=1 c_cookie=12316071806112444047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6000a390 tx=0x7f9a60006f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaeb7a0de7892e8f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a25ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a25ffb640 1 -- 10.20.193.4:0/1750101300 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a6003e040 con 0x55affdee3560 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1750101300 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5400f9b0 con 0x55affdee3560 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a25ffb640 1 -- 10.20.193.4:0/1750101300 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a60042410 con 0x55affdee3560 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a25ffb640 1 -- 10.20.193.4:0/1750101300 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a6004a650 con 0x55affdee3560 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 10 client.17034 _ll_register_callbacks cb 0x55affdd93290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1750101300 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55affdaf4700 con 0x55affdee3560 2026-02-24T09:15:13.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a25ffb640 1 -- 10.20.193.4:0/1750101300 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9a600383d0 con 0x55affdee3560 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a25ffb640 1 -- 10.20.193.4:0/1750101300 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9a6004a7e0 con 0x55affdee3560 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 10 client.17034 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1750101300 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55affdd28bd0 con 0x55affdee3560 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a25ffb640 1 -- 10.20.193.4:0/1750101300 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9a60049070 con 0x55affdee3560 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 10 client.17034 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 10 client.17034 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.215+0000 7f9a6c821e00 20 client.17034 populate_metadata read hostname 'trial004' 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.216+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55affdee0470 0x55affdee0910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.216+0000 7f9a6c821e00 4 client.17034 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.216+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1750101300 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55affdd9a920 con 0x55affdee0470 2026-02-24T09:15:13.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.216+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55affdee0470 0x55affdee0910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.216+0000 7f9a25ffb640 10 client.17034 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.216+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55affdee0470 0x55affdee0910 crc :-1 s=READY pgs=133 gs=4 cs=0 l=0 c_cookie=11049673986857223279 s_cookie=5330571568387798452 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=995853f2867fc46f server_cookie=49f9fe994f8d35b4 in_seq=0 out_seq=0 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a25ffb640 1 -- 10.20.193.4:0/1750101300 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55affdd9a920 con 0x55affdee0470 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a25ffb640 10 client.17034 handle_command_reply: tid=0 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 client.17034 shutdown 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1750101300 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 msgr2=0x55affdf00400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf00400 secure :-1 s=READY pgs=916 gs=1 cs=0 l=1 c_cookie=12316071806112444047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6000a390 tx=0x7f9a60006f70 comp rx=0 tx=0).stop 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1750101300 shutdown_connections 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55affdee0470 0x55affdee0910 crc :-1 s=READY pgs=133 gs=4 cs=0 l=0 c_cookie=11049673986857223279 s_cookie=5330571568387798452 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee3560 0x55affdf00400 unknown :-1 s=CLOSED pgs=916 gs=1 cs=0 l=1 c_cookie=12316071806112444047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a25ffb640 0 client.17034 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:13.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 0x55affdefb410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/1750101300 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 0x55affdefaed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1750101300 >> 10.20.193.4:0/1750101300 conn(0x55affde7c4b0 msgr2=0x55affde9c890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:13.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1750101300 shutdown_connections 2026-02-24T09:15:13.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1750101300 wait complete. 2026-02-24T09:15:13.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.217+0000 7f9a6c821e00 20 client.17034 trim_cache size 0 max 16384 2026-02-24T09:15:13.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.226+0000 7f9a6c821e00 1 Processor -- start 2026-02-24T09:15:13.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.226+0000 7f9a6c821e00 1 -- start start 2026-02-24T09:15:13.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 0x55affdee2200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 0x55affdee2740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affdee2c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55affdda2b10 con 0x55affdee0470 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55affda6e1b0 con 0x55affde9e8c0 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55affdf00db0 con 0x55affde9dfb0 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a68d9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affdee2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a5bfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 0x55affdee2200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a68d9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affdee2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45098/0 (socket says 10.20.193.4:45098) 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a5bfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 0x55affdee2200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:44068/0 (socket says 10.20.193.4:44068) 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a68d9d640 1 -- 10.20.193.4:0/1943131656 learned_addr learned my addr 10.20.193.4:0/1943131656 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a5b7fe640 1 --2- 10.20.193.4:0/1943131656 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 0x55affdee2740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a68d9d640 1 -- 10.20.193.4:0/1943131656 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 msgr2=0x55affdee2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/1943131656 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 0x55affdee2200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a68d9d640 1 -- 10.20.193.4:0/1943131656 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 msgr2=0x55affdee2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:13.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/1943131656 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 0x55affdee2740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a68d9d640 1 -- 10.20.193.4:0/1943131656 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55affdeed3d0 con 0x55affdee0470 2026-02-24T09:15:13.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a5b7fe640 1 --2- 10.20.193.4:0/1943131656 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 0x55affdee2740 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:13.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/1943131656 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affdee2c80 secure :-1 s=READY pgs=917 gs=3 cs=0 l=1 c_cookie=9782763892106424820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a60005010 tx=0x7f9a60044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c35bedb68571f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:13.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a27fff640 1 -- 10.20.193.4:0/1943131656 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a6003e070 con 0x55affdee0470 2026-02-24T09:15:13.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a27fff640 1 -- 10.20.193.4:0/1943131656 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55affdaf4700 con 0x55affdee0470 2026-02-24T09:15:13.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.227+0000 7f9a27fff640 1 -- 10.20.193.4:0/1943131656 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a6004aa10 con 0x55affdee0470 2026-02-24T09:15:13.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1943131656 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 msgr2=0x55affdee2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:13.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/1943131656 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affdee2c80 secure :-1 s=READY pgs=917 gs=3 cs=0 l=1 c_cookie=9782763892106424820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a60005010 tx=0x7f9a60044000 comp rx=0 tx=0).stop 2026-02-24T09:15:13.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1943131656 shutdown_connections 2026-02-24T09:15:13.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/1943131656 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affdee2c80 unknown :-1 s=CLOSED pgs=917 gs=3 cs=0 l=1 c_cookie=9782763892106424820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/1943131656 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9e8c0 0x55affdee2740 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/1943131656 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9dfb0 0x55affdee2200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1943131656 >> 10.20.193.4:0/1943131656 conn(0x55affde7c4b0 msgr2=0x55affdef72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1943131656 shutdown_connections 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 -- 10.20.193.4:0/1943131656 wait complete. 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 -- start start 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 Processor -- start 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 0x55affde82000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9e8c0 0x55affde82540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affde7dcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55affde9edd0 con 0x55affdee0470 2026-02-24T09:15:13.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55affde7e420 con 0x55affde9dfb0 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.228+0000 7f9a6c821e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55affde7e5e0 con 0x55affde9e8c0 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a68d9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affde7dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a68d9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affde7dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:45108/0 (socket says 10.20.193.4:45108) 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a68d9d640 1 -- 10.20.193.4:0/3943879950 learned_addr learned my addr 10.20.193.4:0/3943879950 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a5b7fe640 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9e8c0 0x55affde82540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a68d9d640 1 -- 10.20.193.4:0/3943879950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9e8c0 msgr2=0x55affde82540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 0x55affde82000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9e8c0 0x55affde82540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a68d9d640 1 -- 10.20.193.4:0/3943879950 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 msgr2=0x55affde82000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 0x55affde82000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a68d9d640 1 -- 10.20.193.4:0/3943879950 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55affdd3a910 con 0x55affdee0470 2026-02-24T09:15:13.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 0x55affde82000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a68d9d640 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affde7dcf0 secure :-1 s=READY pgs=918 gs=1 cs=0 l=1 c_cookie=11731844024367937471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6000ab60 tx=0x7f9a600039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cfe1fb70bd77bf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a25ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a25ffb640 1 -- 10.20.193.4:0/3943879950 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a6003e050 con 0x55affdee0470 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3943879950 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55affdd28bd0 con 0x55affdee0470 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a25ffb640 1 -- 10.20.193.4:0/3943879950 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a60049810 con 0x55affdee0470 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a25ffb640 1 -- 10.20.193.4:0/3943879950 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a600543f0 con 0x55affdee0470 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a6c821e00 10 client.17040 _ll_register_callbacks cb 0x55affdd93290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3943879950 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55affda303f0 con 0x55affdee0470 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a25ffb640 1 -- 10.20.193.4:0/3943879950 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9a60054580 con 0x55affdee0470 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a25ffb640 1 -- 10.20.193.4:0/3943879950 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9a60054780 con 0x55affdee0470 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a6c821e00 10 client.17040 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:13.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.229+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3943879950 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55affdd35390 con 0x55affdee0470 2026-02-24T09:15:13.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.230+0000 7f9a25ffb640 1 -- 10.20.193.4:0/3943879950 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9a60049050 con 0x55affdee0470 2026-02-24T09:15:13.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.230+0000 7f9a6c821e00 10 client.17040 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:13.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.230+0000 7f9a6c821e00 10 client.17040 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:15:13.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.230+0000 7f9a6c821e00 20 client.17040 populate_metadata read hostname 'trial004' 2026-02-24T09:15:13.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.230+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55affdee3560 0x55affdf32f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:13.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.230+0000 7f9a6c821e00 4 client.17040 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c2bd5211", "release": true, "await": true}] 2026-02-24T09:15:13.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.230+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3943879950 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c2bd5211", "release": true, "await": true}) -- 0x7f9a60030af0 con 0x55affdee3560 2026-02-24T09:15:13.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.230+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55affdee3560 0x55affdf32f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:13.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.230+0000 7f9a5bfff640 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55affdee3560 0x55affdf32f70 crc :-1 s=READY pgs=134 gs=4 cs=0 l=0 c_cookie=7475606467659096648 s_cookie=4948219747129980950 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67beb079916ee248 server_cookie=44ab9ba4aa417816 in_seq=0 out_seq=0 2026-02-24T09:15:13.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.230+0000 7f9a25ffb640 10 client.17040 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:13.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a25ffb640 1 -- 10.20.193.4:0/3943879950 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f9a60030af0 con 0x55affdee3560 2026-02-24T09:15:13.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a25ffb640 10 client.17040 handle_command_reply: tid=0 2026-02-24T09:15:13.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 client.17040 shutdown 2026-02-24T09:15:13.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3943879950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 msgr2=0x55affde7dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:13.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affde7dcf0 secure :-1 s=READY pgs=918 gs=1 cs=0 l=1 c_cookie=11731844024367937471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6000ab60 tx=0x7f9a600039e0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3943879950 shutdown_connections 2026-02-24T09:15:13.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55affdee3560 0x55affdf32f70 crc :-1 s=READY pgs=134 gs=4 cs=0 l=0 c_cookie=7475606467659096648 s_cookie=4948219747129980950 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55affdee0470 0x55affde7dcf0 unknown :-1 s=CLOSED pgs=918 gs=1 cs=0 l=1 c_cookie=11731844024367937471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55affde9e8c0 0x55affde82540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a25ffb640 0 client.17040 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:13.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 --2- 10.20.193.4:0/3943879950 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55affde9dfb0 0x55affde82000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3943879950 >> 10.20.193.4:0/3943879950 conn(0x55affde7c4b0 msgr2=0x55affdef7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:13.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3943879950 shutdown_connections 2026-02-24T09:15:13.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 1 -- 10.20.193.4:0/3943879950 wait complete. 2026-02-24T09:15:13.244 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.234+0000 7f9a6c821e00 20 client.17040 trim_cache size 0 max 16384 2026-02-24T09:15:13.244 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:15:13.244 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:15:13.244 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 24, 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: "c2bd5211": { 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: "version": 24, 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:15:13.245 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 150.0, 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:13.246 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:15:13.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 -- 10.20.193.4:0/517766236 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a400b5760 msgr2=0x7f9a400d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:13.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a400b5760 0x7f9a400d5c10 secure :-1 s=READY pgs=374 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a54004740 tx=0x7f9a54004420 comp rx=0 tx=0).stop 2026-02-24T09:15:13.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 -- 10.20.193.4:0/517766236 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9a6410c840 msgr2=0x7f9a64161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:13.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9a6410c840 0x7f9a64161800 secure :-1 s=READY pgs=914 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a4c00b520 tx=0x7f9a4c00b9f0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 -- 10.20.193.4:0/517766236 shutdown_connections 2026-02-24T09:15:13.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9a400b5760 0x7f9a400d5c10 unknown :-1 s=CLOSED pgs=374 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9a64155c60 0x7f9a64166bd0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9a6410c840 0x7f9a64161800 unknown :-1 s=CLOSED pgs=914 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 --2- 10.20.193.4:0/517766236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a6410bf30 0x7f9a641612c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:13.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 -- 10.20.193.4:0/517766236 >> 10.20.193.4:0/517766236 conn(0x7f9a640e9bf0 msgr2=0x7f9a64109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:13.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 -- 10.20.193.4:0/517766236 shutdown_connections 2026-02-24T09:15:13.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:13.235+0000 7f9a6a827640 1 -- 10.20.193.4:0/517766236 wait complete. 2026-02-24T09:15:13.324 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c2bd5211', total seconds elapsed: 30.8 2026-02-24T09:15:14.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:13 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/109213412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:15:14.094 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:13 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:15:14.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:13 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/109213412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:15:14.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:13 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:15:14.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:13 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/109213412' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:15:14.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:13 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:15:15.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:14 trial014 ceph-mon[46941]: pgmap v315: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6.2 MiB/s wr, 43 op/s 2026-02-24T09:15:15.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:14 trial004 ceph-mon[41596]: pgmap v315: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6.2 MiB/s wr, 43 op/s 2026-02-24T09:15:15.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:14 trial090 ceph-mon[47278]: pgmap v315: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6.2 MiB/s wr, 43 op/s 2026-02-24T09:15:17.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:16 trial014 ceph-mon[46941]: pgmap v316: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 20 MiB/s wr, 120 op/s 2026-02-24T09:15:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:16 trial004 ceph-mon[41596]: pgmap v316: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 20 MiB/s wr, 120 op/s 2026-02-24T09:15:17.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:16 trial090 ceph-mon[47278]: pgmap v316: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 20 MiB/s wr, 120 op/s 2026-02-24T09:15:19.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:18 trial014 ceph-mon[46941]: pgmap v317: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 43 MiB/s wr, 250 op/s 2026-02-24T09:15:19.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:18 trial004 ceph-mon[41596]: pgmap v317: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 43 MiB/s wr, 250 op/s 2026-02-24T09:15:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:18 trial090 ceph-mon[47278]: pgmap v317: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 43 MiB/s wr, 250 op/s 2026-02-24T09:15:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:20 trial004 ceph-mon[41596]: pgmap v318: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 258 op/s 2026-02-24T09:15:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:20 trial090 ceph-mon[47278]: pgmap v318: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 258 op/s 2026-02-24T09:15:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:20 trial014 ceph-mon[46941]: pgmap v318: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 258 op/s 2026-02-24T09:15:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:22 trial004 ceph-mon[41596]: pgmap v319: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 53 MiB/s wr, 261 op/s 2026-02-24T09:15:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:22 trial090 ceph-mon[47278]: pgmap v319: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 53 MiB/s wr, 261 op/s 2026-02-24T09:15:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:22 trial014 ceph-mon[46941]: pgmap v319: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 53 MiB/s wr, 261 op/s 2026-02-24T09:15:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:24 trial004 ceph-mon[41596]: pgmap v320: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 60 MiB/s wr, 263 op/s 2026-02-24T09:15:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:24 trial090 ceph-mon[47278]: pgmap v320: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 60 MiB/s wr, 263 op/s 2026-02-24T09:15:25.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:24 trial014 ceph-mon[46941]: pgmap v320: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 60 MiB/s wr, 263 op/s 2026-02-24T09:15:26.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:26.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:26.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:26.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:15:26.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:26.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:26.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:26.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:26.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:15:26.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:26.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:15:26.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:15:26.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:15:26.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:15:26.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:15:27.116 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:26 trial004 ceph-mon[41596]: pgmap v321: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 74 MiB/s wr, 261 op/s 2026-02-24T09:15:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:26 trial090 ceph-mon[47278]: pgmap v321: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 74 MiB/s wr, 261 op/s 2026-02-24T09:15:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:26 trial014 ceph-mon[46941]: pgmap v321: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 74 MiB/s wr, 261 op/s 2026-02-24T09:15:29.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:28 trial004 ceph-mon[41596]: pgmap v322: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 167 MiB/s wr, 201 op/s 2026-02-24T09:15:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:28 trial090 ceph-mon[47278]: pgmap v322: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 167 MiB/s wr, 201 op/s 2026-02-24T09:15:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:28 trial014 ceph-mon[46941]: pgmap v322: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 8.1 KiB/s rd, 167 MiB/s wr, 201 op/s 2026-02-24T09:15:31.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:30 trial004 ceph-mon[41596]: pgmap v323: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 264 MiB/s wr, 93 op/s 2026-02-24T09:15:31.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:30 trial090 ceph-mon[47278]: pgmap v323: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 264 MiB/s wr, 93 op/s 2026-02-24T09:15:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:30 trial014 ceph-mon[46941]: pgmap v323: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 264 MiB/s wr, 93 op/s 2026-02-24T09:15:32.154 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:15:32.335 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:32.488 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 -- 10.20.193.4:0/861539006 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd3810f650 msgr2=0x7fbd3810fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 --2- 10.20.193.4:0/861539006 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd3810f650 0x7fbd3810fa20 secure :-1 s=READY pgs=919 gs=1 cs=0 l=1 c_cookie=18070676358472960368 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd28009950 tx=0x7fbd2802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 -- 10.20.193.4:0/861539006 shutdown_connections 2026-02-24T09:15:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 --2- 10.20.193.4:0/861539006 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd38115840 0x7fbd38176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 --2- 10.20.193.4:0/861539006 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd38110040 0x7fbd38115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 --2- 10.20.193.4:0/861539006 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd3810f650 0x7fbd3810fa20 unknown :-1 s=CLOSED pgs=919 gs=1 cs=0 l=1 c_cookie=18070676358472960368 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 -- 10.20.193.4:0/861539006 >> 10.20.193.4:0/861539006 conn(0x7fbd380ecf20 msgr2=0x7fbd3810d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 -- 10.20.193.4:0/861539006 shutdown_connections 2026-02-24T09:15:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 -- 10.20.193.4:0/861539006 wait complete. 2026-02-24T09:15:32.489 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 Processor -- start 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 -- start start 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd3810f650 0x7fbd3811a700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd38110040 0x7fbd3811ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd38115840 0x7fbd38120010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38120630 con 0x7fbd38115840 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbd381207a0 con 0x7fbd3810f650 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd4006a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38120960 con 0x7fbd38110040 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd3e5e0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd38115840 0x7fbd38120010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd3e5e0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd38115840 0x7fbd38120010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33580/0 (socket says 10.20.193.4:33580) 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/903303997 learned_addr learned my addr 10.20.193.4:0/903303997 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.483+0000 7fbd3dddf640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd3810f650 0x7fbd3811a700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd3d5de640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd38110040 0x7fbd3811ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/903303997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd38110040 msgr2=0x7fbd3811ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd38110040 0x7fbd3811ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/903303997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd3810f650 msgr2=0x7fbd3811a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd3810f650 0x7fbd3811a700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/903303997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd28009570 con 0x7fbd38115840 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd38115840 0x7fbd38120010 secure :-1 s=READY pgs=920 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd34006e90 tx=0x7fbd3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd26ffd640 1 -- 10.20.193.4:0/903303997 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd34005500 con 0x7fbd38115840 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd4006a640 1 -- 10.20.193.4:0/903303997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd38120c40 con 0x7fbd38115840 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd26ffd640 1 -- 10.20.193.4:0/903303997 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbd34005e10 con 0x7fbd38115840 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd26ffd640 1 -- 10.20.193.4:0/903303997 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd34003a90 con 0x7fbd38115840 2026-02-24T09:15:32.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.484+0000 7fbd4006a640 1 -- 10.20.193.4:0/903303997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd38161340 con 0x7fbd38115840 2026-02-24T09:15:32.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.486+0000 7fbd26ffd640 1 -- 10.20.193.4:0/903303997 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fbd3400c840 con 0x7fbd38115840 2026-02-24T09:15:32.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.486+0000 7fbd26ffd640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd140b5760 0x7fbd140d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.486+0000 7fbd3dddf640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd140b5760 0x7fbd140d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.487+0000 7fbd26ffd640 1 -- 10.20.193.4:0/903303997 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fbd340e7900 con 0x7fbd38115840 2026-02-24T09:15:32.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.487+0000 7fbd3dddf640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd140b5760 0x7fbd140d5c10 secure :-1 s=READY pgs=375 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd280023d0 tx=0x7fbd28031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:32.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd42064e00 1 Processor -- start 2026-02-24T09:15:32.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd42064e00 1 -- start start 2026-02-24T09:15:32.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d50bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d95890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d95dd0 0x5576d6db61b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd42064e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5576d6c60de0 con 0x5576d6d51130 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd42064e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5576d6c5cb10 con 0x5576d6d95dd0 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd42064e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5576d6c56ab0 con 0x5576d6d50820 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3d5de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d95890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3d5de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d95890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33596/0 (socket says 10.20.193.4:33596) 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3d5de640 1 -- 10.20.193.4:0/1015345500 learned_addr learned my addr 10.20.193.4:0/1015345500 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3dddf640 1 --2- 10.20.193.4:0/1015345500 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d50bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/1015345500 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d95dd0 0x5576d6db61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.496 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3d5de640 1 -- 10.20.193.4:0/1015345500 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 msgr2=0x5576d6d50bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3d5de640 1 --2- 10.20.193.4:0/1015345500 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d50bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3d5de640 1 -- 10.20.193.4:0/1015345500 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d95dd0 msgr2=0x5576d6db61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3d5de640 1 --2- 10.20.193.4:0/1015345500 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d95dd0 0x5576d6db61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3d5de640 1 -- 10.20.193.4:0/1015345500 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d6c02310 con 0x5576d6d51130 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd3d5de640 1 --2- 10.20.193.4:0/1015345500 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d95890 secure :-1 s=READY pgs=921 gs=1 cs=0 l=1 c_cookie=12752799597278814595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2c005fd0 tx=0x7fbd2c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fb0baa9f8c6183 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.488+0000 7fbd064e6640 1 -- 10.20.193.4:0/1015345500 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd2c0042f0 con 0x5576d6d51130 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd064e6640 1 -- 10.20.193.4:0/1015345500 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbd2c00ce70 con 0x5576d6d51130 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd064e6640 1 -- 10.20.193.4:0/1015345500 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd2c010980 con 0x5576d6d51130 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd42064e00 1 -- 10.20.193.4:0/1015345500 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 msgr2=0x5576d6d95890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd42064e00 1 --2- 10.20.193.4:0/1015345500 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d95890 secure :-1 s=READY pgs=921 gs=1 cs=0 l=1 c_cookie=12752799597278814595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2c005fd0 tx=0x7fbd2c00e720 comp rx=0 tx=0).stop 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd42064e00 1 -- 10.20.193.4:0/1015345500 shutdown_connections 2026-02-24T09:15:32.497 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd42064e00 1 --2- 10.20.193.4:0/1015345500 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d95dd0 0x5576d6db61b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd42064e00 1 --2- 10.20.193.4:0/1015345500 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d95890 unknown :-1 s=CLOSED pgs=921 gs=1 cs=0 l=1 c_cookie=12752799597278814595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd42064e00 1 --2- 10.20.193.4:0/1015345500 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d50bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd42064e00 1 -- 10.20.193.4:0/1015345500 >> 10.20.193.4:0/1015345500 conn(0x5576d6c6f6b0 msgr2=0x5576d6d4f100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:32.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd42064e00 1 -- 10.20.193.4:0/1015345500 shutdown_connections 2026-02-24T09:15:32.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.489+0000 7fbd42064e00 1 -- 10.20.193.4:0/1015345500 wait complete. 2026-02-24T09:15:32.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.491+0000 7fbd42064e00 1 -- start start 2026-02-24T09:15:32.498 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.491+0000 7fbd42064e00 1 Processor -- start 2026-02-24T09:15:32.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.491+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d68e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.491+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d51130 0x5576d6d69370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6d6e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.502 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd42064e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5576d6d6e8a0 con 0x5576d6d95dd0 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd42064e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5576d6d6ea10 con 0x5576d6d51130 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd42064e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5576d6d6ebd0 con 0x5576d6d50820 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3dddf640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d68e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3dddf640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d68e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:34636/0 (socket says 10.20.193.4:34636) 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3e5e0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6d6e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3dddf640 1 -- 10.20.193.4:0/2958244313 learned_addr learned my addr 10.20.193.4:0/2958244313 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3d5de640 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d51130 0x5576d6d69370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/2958244313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 msgr2=0x5576d6d68e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d68e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/2958244313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d51130 msgr2=0x5576d6d69370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:32.503 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d51130 0x5576d6d69370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/2958244313 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d6bda8c0 con 0x5576d6d95dd0 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3d5de640 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d51130 0x5576d6d69370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6d6e360 secure :-1 s=READY pgs=922 gs=2 cs=0 l=1 c_cookie=2326157937221511288 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd340adea0 tx=0x7fbd340a9bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20482c51c38b2878 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbcef7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbcef7fe640 1 -- 10.20.193.4:0/2958244313 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd340ad9f0 con 0x5576d6d95dd0 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbcef7fe640 1 -- 10.20.193.4:0/2958244313 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbd340b3950 con 0x5576d6d95dd0 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbcef7fe640 1 -- 10.20.193.4:0/2958244313 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd340b8b60 con 0x5576d6d95dd0 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd42064e00 1 -- 10.20.193.4:0/2958244313 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2c00c7b0 con 0x5576d6d95dd0 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbcef7fe640 1 -- 10.20.193.4:0/2958244313 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fbd34072dc0 con 0x5576d6d95dd0 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbcef7fe640 10 client.17052 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd42064e00 10 client.17052 _ll_register_callbacks cb 0x5576d6bf2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:32.504 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd42064e00 1 -- 10.20.193.4:0/2958244313 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5576d69a64a0 con 0x5576d6d95dd0 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbcef7fe640 1 -- 10.20.193.4:0/2958244313 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbd340b5f30 con 0x5576d6d95dd0 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd42064e00 10 client.17052 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.492+0000 7fbd42064e00 1 -- 10.20.193.4:0/2958244313 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5576d6bec6e0 con 0x5576d6d95dd0 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.493+0000 7fbcef7fe640 1 -- 10.20.193.4:0/2958244313 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fbd340abc10 con 0x5576d6d95dd0 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.493+0000 7fbd42064e00 10 client.17052 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.493+0000 7fbd42064e00 10 client.17052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.493+0000 7fbd42064e00 20 client.17052 populate_metadata read hostname 'trial004' 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.493+0000 7fbd42064e00 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5576d6d936d0 0x5576d6d93b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.493+0000 7fbd42064e00 4 client.17052 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.493+0000 7fbd42064e00 1 -- 10.20.193.4:0/2958244313 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576d6c4c4f0 con 0x5576d6d936d0 2026-02-24T09:15:32.505 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.493+0000 7fbd3dddf640 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5576d6d936d0 0x5576d6d93b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.493+0000 7fbcef7fe640 10 client.17052 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.493+0000 7fbd3dddf640 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5576d6d936d0 0x5576d6d93b40 crc :-1 s=READY pgs=135 gs=4 cs=0 l=0 c_cookie=14009360479320914969 s_cookie=7634600756842545740 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c26b3f219451bc19 server_cookie=69f38cf04187424c in_seq=0 out_seq=0 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbcef7fe640 1 -- 10.20.193.4:0/2958244313 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5576d6c4c4f0 con 0x5576d6d936d0 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbcef7fe640 10 client.17052 handle_command_reply: tid=0 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 client.17052 shutdown 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 -- 10.20.193.4:0/2958244313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 msgr2=0x5576d6d6e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6d6e360 secure :-1 s=READY pgs=922 gs=2 cs=0 l=1 c_cookie=2326157937221511288 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd340adea0 tx=0x7fbd340a9bc0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 -- 10.20.193.4:0/2958244313 shutdown_connections 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5576d6d936d0 0x5576d6d93b40 crc :-1 s=READY pgs=135 gs=4 cs=0 l=0 c_cookie=14009360479320914969 s_cookie=7634600756842545740 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6d6e360 unknown :-1 s=CLOSED pgs=922 gs=2 cs=0 l=1 c_cookie=2326157937221511288 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbcef7fe640 0 client.17052 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:32.506 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d51130 0x5576d6d69370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 --2- 10.20.193.4:0/2958244313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d68e30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 -- 10.20.193.4:0/2958244313 >> 10.20.193.4:0/2958244313 conn(0x5576d6c6f6b0 msgr2=0x5576d6d4f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:32.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 -- 10.20.193.4:0/2958244313 shutdown_connections 2026-02-24T09:15:32.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 1 -- 10.20.193.4:0/2958244313 wait complete. 2026-02-24T09:15:32.507 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.494+0000 7fbd42064e00 20 client.17052 trim_cache size 0 max 16384 2026-02-24T09:15:32.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd42064e00 1 Processor -- start 2026-02-24T09:15:32.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd42064e00 1 -- start start 2026-02-24T09:15:32.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d50820 0x5576d6d66220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d66760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d95dd0 0x5576d6d8e840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd42064e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5576d6c546e0 con 0x5576d6d51130 2026-02-24T09:15:32.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd42064e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5576d691ff50 con 0x5576d6d50820 2026-02-24T09:15:32.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd42064e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5576d6cc03d0 con 0x5576d6d95dd0 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3d5de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d66760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3d5de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d66760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33614/0 (socket says 10.20.193.4:33614) 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3d5de640 1 -- 10.20.193.4:0/2124234472 learned_addr learned my addr 10.20.193.4:0/2124234472 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3dddf640 1 --2- 10.20.193.4:0/2124234472 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d50820 0x5576d6d66220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/2124234472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d95dd0 0x5576d6d8e840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3d5de640 1 -- 10.20.193.4:0/2124234472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d95dd0 msgr2=0x5576d6d8e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3d5de640 1 --2- 10.20.193.4:0/2124234472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d95dd0 0x5576d6d8e840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3d5de640 1 -- 10.20.193.4:0/2124234472 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d50820 msgr2=0x5576d6d66220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3d5de640 1 --2- 10.20.193.4:0/2124234472 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d50820 0x5576d6d66220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3d5de640 1 -- 10.20.193.4:0/2124234472 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d6be7160 con 0x5576d6d51130 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd3d5de640 1 --2- 10.20.193.4:0/2124234472 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d66760 secure :-1 s=READY pgs=923 gs=1 cs=0 l=1 c_cookie=1074986087306541973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2c005db0 tx=0x7fbd2c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb1e26a064bb95 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:32.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd05ce5640 1 -- 10.20.193.4:0/2124234472 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd2c01d070 con 0x5576d6d51130 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd05ce5640 1 -- 10.20.193.4:0/2124234472 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbd2c0043b0 con 0x5576d6d51130 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.504+0000 7fbd05ce5640 1 -- 10.20.193.4:0/2124234472 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd2c004720 con 0x5576d6d51130 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 -- 10.20.193.4:0/2124234472 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 msgr2=0x5576d6d66760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 --2- 10.20.193.4:0/2124234472 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d66760 secure :-1 s=READY pgs=923 gs=1 cs=0 l=1 c_cookie=1074986087306541973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2c005db0 tx=0x7fbd2c005de0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 -- 10.20.193.4:0/2124234472 shutdown_connections 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 --2- 10.20.193.4:0/2124234472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d95dd0 0x5576d6d8e840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 --2- 10.20.193.4:0/2124234472 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d51130 0x5576d6d66760 unknown :-1 s=CLOSED pgs=923 gs=1 cs=0 l=1 c_cookie=1074986087306541973 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 --2- 10.20.193.4:0/2124234472 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d50820 0x5576d6d66220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 -- 10.20.193.4:0/2124234472 >> 10.20.193.4:0/2124234472 conn(0x5576d6c6f6b0 msgr2=0x5576d6d536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 -- 10.20.193.4:0/2124234472 shutdown_connections 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 -- 10.20.193.4:0/2124234472 wait complete. 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 -- start start 2026-02-24T09:15:32.515 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.505+0000 7fbd42064e00 1 Processor -- start 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d70ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d51130 0x5576d6d713e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6dfb2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5576d6d51500 con 0x5576d6d95dd0 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5576d6dfb830 con 0x5576d6d51130 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5576d6dfb9f0 con 0x5576d6d50820 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd3e5e0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6dfb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd3e5e0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6dfb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33630/0 (socket says 10.20.193.4:33630) 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/30870977 learned_addr learned my addr 10.20.193.4:0/30870977 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd3dddf640 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d70ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/30870977 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 msgr2=0x5576d6d70ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:32.516 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d70ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/30870977 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d51130 msgr2=0x5576d6d713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d51130 0x5576d6d713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd3e5e0640 1 -- 10.20.193.4:0/30870977 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d6bdabf0 con 0x5576d6d95dd0 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd3e5e0640 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6dfb2f0 secure :-1 s=READY pgs=924 gs=1 cs=0 l=1 c_cookie=4891368535986642055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd34008fd0 tx=0x7fbd340abfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e1a1c495019c87 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbcef7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbcef7fe640 1 -- 10.20.193.4:0/30870977 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd340b5f30 con 0x5576d6d95dd0 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 -- 10.20.193.4:0/30870977 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d6c02310 con 0x5576d6d95dd0 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbcef7fe640 1 -- 10.20.193.4:0/30870977 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5576d69a64a0 con 0x5576d6d95dd0 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbcef7fe640 1 -- 10.20.193.4:0/30870977 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd340acd80 con 0x5576d6d95dd0 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 10 client.17058 _ll_register_callbacks cb 0x5576d6bf2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 -- 10.20.193.4:0/30870977 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd2c00ce70 con 0x5576d6d95dd0 2026-02-24T09:15:32.517 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbcef7fe640 1 -- 10.20.193.4:0/30870977 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fbd340b3950 con 0x5576d6d95dd0 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbcef7fe640 1 -- 10.20.193.4:0/30870977 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbd340b8b60 con 0x5576d6d95dd0 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 10 client.17058 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 -- 10.20.193.4:0/30870977 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5576d6bec940 con 0x5576d6d95dd0 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbcef7fe640 1 -- 10.20.193.4:0/30870977 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fbd34072dc0 con 0x5576d6d95dd0 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 10 client.17058 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 10 client.17058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 20 client.17058 populate_metadata read hostname 'trial004' 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5576d6e43220 0x5576d6e636d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 4 client.17058 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.506+0000 7fbd42064e00 1 -- 10.20.193.4:0/30870977 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5576d698b160 con 0x5576d6e43220 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd3dddf640 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5576d6e43220 0x5576d6e636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd3dddf640 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5576d6e43220 0x5576d6e636d0 crc :-1 s=READY pgs=136 gs=4 cs=0 l=0 c_cookie=9422463743676595888 s_cookie=4921298208999426302 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82c350da3ed73eb0 server_cookie=444bf6a59d2d48fe in_seq=0 out_seq=0 2026-02-24T09:15:32.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbcef7fe640 10 client.17058 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbcef7fe640 1 -- 10.20.193.4:0/30870977 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x5576d698b160 con 0x5576d6e43220 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbcef7fe640 10 client.17058 handle_command_reply: tid=0 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 client.17058 shutdown 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 -- 10.20.193.4:0/30870977 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 msgr2=0x5576d6dfb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6dfb2f0 secure :-1 s=READY pgs=924 gs=1 cs=0 l=1 c_cookie=4891368535986642055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd34008fd0 tx=0x7fbd340abfe0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 -- 10.20.193.4:0/30870977 shutdown_connections 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5576d6e43220 0x5576d6e636d0 crc :-1 s=READY pgs=136 gs=4 cs=0 l=0 c_cookie=9422463743676595888 s_cookie=4921298208999426302 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5576d6d95dd0 0x5576d6dfb2f0 unknown :-1 s=CLOSED pgs=924 gs=1 cs=0 l=1 c_cookie=4891368535986642055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbcef7fe640 0 client.17058 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5576d6d51130 0x5576d6d713e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 --2- 10.20.193.4:0/30870977 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5576d6d50820 0x5576d6d70ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 -- 10.20.193.4:0/30870977 >> 10.20.193.4:0/30870977 conn(0x5576d6c6f6b0 msgr2=0x5576d6d4ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:32.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 -- 10.20.193.4:0/30870977 shutdown_connections 2026-02-24T09:15:32.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 1 -- 10.20.193.4:0/30870977 wait complete. 2026-02-24T09:15:32.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.507+0000 7fbd42064e00 20 client.17058 trim_cache size 0 max 16384 2026-02-24T09:15:32.520 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:15:32.520 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:15:32.520 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:15:32.520 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:15:32.521 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:32.522 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.523 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.524 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.525 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:15:32.526 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 -- 10.20.193.4:0/903303997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd140b5760 msgr2=0x7fbd140d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd140b5760 0x7fbd140d5c10 secure :-1 s=READY pgs=375 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd280023d0 tx=0x7fbd28031040 comp rx=0 tx=0).stop 2026-02-24T09:15:32.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 -- 10.20.193.4:0/903303997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd38115840 msgr2=0x7fbd38120010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd38115840 0x7fbd38120010 secure :-1 s=READY pgs=920 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd34006e90 tx=0x7fbd3400edf0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 -- 10.20.193.4:0/903303997 shutdown_connections 2026-02-24T09:15:32.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbd140b5760 0x7fbd140d5c10 unknown :-1 s=CLOSED pgs=375 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbd38115840 0x7fbd38120010 unknown :-1 s=CLOSED pgs=920 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd38110040 0x7fbd3811ac40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 --2- 10.20.193.4:0/903303997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbd3810f650 0x7fbd3811a700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 -- 10.20.193.4:0/903303997 >> 10.20.193.4:0/903303997 conn(0x7fbd380ecf20 msgr2=0x7fbd3810d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:32.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 -- 10.20.193.4:0/903303997 shutdown_connections 2026-02-24T09:15:32.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.508+0000 7fbd4006a640 1 -- 10.20.193.4:0/903303997 wait complete. 2026-02-24T09:15:32.552 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:15:32.553 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:15:32.684 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:32.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.814+0000 7faa05feb640 1 -- 10.20.193.4:0/432251796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0010da00 msgr2=0x7faa00112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.814+0000 7faa05feb640 1 --2- 10.20.193.4:0/432251796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0010da00 0x7faa00112a50 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=793880685339640442 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9f0009890 tx=0x7fa9f002f0e0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.814+0000 7faa05feb640 1 -- 10.20.193.4:0/432251796 shutdown_connections 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.814+0000 7faa05feb640 1 --2- 10.20.193.4:0/432251796 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa00113200 0x7faa00173bd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.814+0000 7faa05feb640 1 --2- 10.20.193.4:0/432251796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0010da00 0x7faa00112a50 unknown :-1 s=CLOSED pgs=100 gs=2 cs=0 l=1 c_cookie=793880685339640442 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.814+0000 7faa05feb640 1 --2- 10.20.193.4:0/432251796 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa0010d010 0x7faa0010d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.814+0000 7faa05feb640 1 -- 10.20.193.4:0/432251796 >> 10.20.193.4:0/432251796 conn(0x7faa0005f830 msgr2=0x7faa0010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.814+0000 7faa05feb640 1 -- 10.20.193.4:0/432251796 shutdown_connections 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.814+0000 7faa05feb640 1 -- 10.20.193.4:0/432251796 wait complete. 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.814+0000 7faa05feb640 1 Processor -- start 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7faa05feb640 1 -- start start 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7faa05feb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0010d010 0x7faa000f3360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7faa05feb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0010da00 0x7faa00173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7faa05feb640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa00113200 0x7faa000f3a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7faa05feb640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7faa000f8c70 con 0x7faa0010da00 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7faa05feb640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7faa000f8de0 con 0x7faa00113200 2026-02-24T09:15:32.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7faa05feb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7faa000f8fa0 con 0x7faa0010d010 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9feffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0010da00 0x7faa00173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9feffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0010da00 0x7faa00173ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33638/0 (socket says 10.20.193.4:33638) 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9feffd640 1 -- 10.20.193.4:0/53182678 learned_addr learned my addr 10.20.193.4:0/53182678 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9ff7fe640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0010d010 0x7faa000f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9fffff640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa00113200 0x7faa000f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9feffd640 1 -- 10.20.193.4:0/53182678 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0010d010 msgr2=0x7faa000f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9feffd640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0010d010 0x7faa000f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9feffd640 1 -- 10.20.193.4:0/53182678 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa00113200 msgr2=0x7faa000f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9feffd640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa00113200 0x7faa000f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9feffd640 1 -- 10.20.193.4:0/53182678 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f00094b0 con 0x7faa0010da00 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9ff7fe640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0010d010 0x7faa000f3360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9feffd640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0010da00 0x7faa00173ad0 secure :-1 s=READY pgs=925 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9f00023b0 tx=0x7fa9f00028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9fcff9640 1 -- 10.20.193.4:0/53182678 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9f003d070 con 0x7faa0010da00 2026-02-24T09:15:32.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7faa05feb640 1 -- 10.20.193.4:0/53182678 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa000f9220 con 0x7faa0010da00 2026-02-24T09:15:32.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7faa05feb640 1 -- 10.20.193.4:0/53182678 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa000f96e0 con 0x7faa0010da00 2026-02-24T09:15:32.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9fcff9640 1 -- 10.20.193.4:0/53182678 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9f002fcb0 con 0x7faa0010da00 2026-02-24T09:15:32.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.815+0000 7fa9fcff9640 1 -- 10.20.193.4:0/53182678 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9f004a6c0 con 0x7faa0010da00 2026-02-24T09:15:32.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.816+0000 7faa05feb640 1 -- 10.20.193.4:0/53182678 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0010e2f0 con 0x7faa0010da00 2026-02-24T09:15:32.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.819+0000 7fa9fcff9640 1 -- 10.20.193.4:0/53182678 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fa9f00386b0 con 0x7faa0010da00 2026-02-24T09:15:32.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.820+0000 7fa9fcff9640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9d40b5750 0x7fa9d40d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:32.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.820+0000 7fa9fcff9640 1 -- 10.20.193.4:0/53182678 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa9f010b3e0 con 0x7faa0010da00 2026-02-24T09:15:32.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.820+0000 7fa9ff7fe640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9d40b5750 0x7fa9d40d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:32.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.820+0000 7fa9fcff9640 1 -- 10.20.193.4:0/53182678 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa9f00cdda0 con 0x7faa0010da00 2026-02-24T09:15:32.824 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.820+0000 7fa9ff7fe640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9d40b5750 0x7fa9d40d5c00 secure :-1 s=READY pgs=376 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9ec004740 tx=0x7fa9ec009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:32.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:32 trial004 ceph-mon[41596]: pgmap v324: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 538 MiB/s wr, 141 op/s 2026-02-24T09:15:32.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.973+0000 7faa05feb640 1 -- 10.20.193.4:0/53182678 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa0010d3e0 con 0x7faa0010da00 2026-02-24T09:15:32.977 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.973+0000 7fa9fcff9640 1 -- 10.20.193.4:0/53182678 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fa9f00d0f50 con 0x7faa0010da00 2026-02-24T09:15:32.978 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:15:32.978 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:15:32.978 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:15:32.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 -- 10.20.193.4:0/53182678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9d40b5750 msgr2=0x7fa9d40d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9d40b5750 0x7fa9d40d5c00 secure :-1 s=READY pgs=376 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9ec004740 tx=0x7fa9ec009310 comp rx=0 tx=0).stop 2026-02-24T09:15:32.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 -- 10.20.193.4:0/53182678 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0010da00 msgr2=0x7faa00173ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:32.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0010da00 0x7faa00173ad0 secure :-1 s=READY pgs=925 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9f00023b0 tx=0x7fa9f00028d0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 -- 10.20.193.4:0/53182678 shutdown_connections 2026-02-24T09:15:32.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9d40b5750 0x7fa9d40d5c00 unknown :-1 s=CLOSED pgs=376 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faa00113200 0x7faa000f3a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faa0010da00 0x7faa00173ad0 unknown :-1 s=CLOSED pgs=925 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 --2- 10.20.193.4:0/53182678 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faa0010d010 0x7faa000f3360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:32.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 -- 10.20.193.4:0/53182678 >> 10.20.193.4:0/53182678 conn(0x7faa0005f830 msgr2=0x7faa0010b500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:32.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 -- 10.20.193.4:0/53182678 shutdown_connections 2026-02-24T09:15:32.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:32.979+0000 7faa05feb640 1 -- 10.20.193.4:0/53182678 wait complete. 2026-02-24T09:15:33.104 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:15:33.268 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:33.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:32 trial090 ceph-mon[47278]: pgmap v324: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 538 MiB/s wr, 141 op/s 2026-02-24T09:15:33.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:32 trial014 ceph-mon[46941]: pgmap v324: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 538 MiB/s wr, 141 op/s 2026-02-24T09:15:33.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.428+0000 7f500a7cf640 1 -- 10.20.193.4:0/3035470313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5004110130 msgr2=0x7f5004115180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.428+0000 7f500a7cf640 1 --2- 10.20.193.4:0/3035470313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5004110130 0x7f5004115180 secure :-1 s=READY pgs=926 gs=1 cs=0 l=1 c_cookie=10043598358686089365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff4009950 tx=0x7f4ff402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.428+0000 7f500a7cf640 1 -- 10.20.193.4:0/3035470313 shutdown_connections 2026-02-24T09:15:33.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.428+0000 7f500a7cf640 1 --2- 10.20.193.4:0/3035470313 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5004115930 0x7f5004176300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.428+0000 7f500a7cf640 1 --2- 10.20.193.4:0/3035470313 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5004110130 0x7f5004115180 unknown :-1 s=CLOSED pgs=926 gs=1 cs=0 l=1 c_cookie=10043598358686089365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.428+0000 7f500a7cf640 1 --2- 10.20.193.4:0/3035470313 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f500410f740 0x7f500410fb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.428+0000 7f500a7cf640 1 -- 10.20.193.4:0/3035470313 >> 10.20.193.4:0/3035470313 conn(0x7f50040ed050 msgr2=0x7f500410d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.428+0000 7f500a7cf640 1 -- 10.20.193.4:0/3035470313 shutdown_connections 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.428+0000 7f500a7cf640 1 -- 10.20.193.4:0/3035470313 wait complete. 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.428+0000 7f500a7cf640 1 Processor -- start 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f500a7cf640 1 -- start start 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f500a7cf640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f500410f740 0x7f50040f5a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f500a7cf640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5004110130 0x7f5004176200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f500a7cf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5004115930 0x7f50040f6130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f500a7cf640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f50040fb340 con 0x7f5004115930 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f500a7cf640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f50040fb4b0 con 0x7f500410f740 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f500a7cf640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f50040fb670 con 0x7f5004110130 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5008d45640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5004115930 0x7f50040f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5008d45640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5004115930 0x7f50040f6130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52004/0 (socket says 10.20.193.4:52004) 2026-02-24T09:15:33.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5008d45640 1 -- 10.20.193.4:0/1290653545 learned_addr learned my addr 10.20.193.4:0/1290653545 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5003fff640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f500410f740 0x7f50040f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f50037fe640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5004110130 0x7f5004176200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5008d45640 1 -- 10.20.193.4:0/1290653545 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5004110130 msgr2=0x7f5004176200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5008d45640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5004110130 0x7f5004176200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5008d45640 1 -- 10.20.193.4:0/1290653545 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f500410f740 msgr2=0x7f50040f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5008d45640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f500410f740 0x7f50040f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5008d45640 1 -- 10.20.193.4:0/1290653545 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff4009570 con 0x7f5004115930 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5003fff640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f500410f740 0x7f50040f5a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f5008d45640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5004115930 0x7f50040f6130 secure :-1 s=READY pgs=927 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff8006e90 tx=0x7f4ff800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f50017fa640 1 -- 10.20.193.4:0/1290653545 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ff8005500 con 0x7f5004115930 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f500a7cf640 1 -- 10.20.193.4:0/1290653545 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50040fb950 con 0x7f5004115930 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f500a7cf640 1 -- 10.20.193.4:0/1290653545 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50040fbe70 con 0x7f5004115930 2026-02-24T09:15:33.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f50017fa640 1 -- 10.20.193.4:0/1290653545 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ff8005e10 con 0x7f5004115930 2026-02-24T09:15:33.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.429+0000 7f50017fa640 1 -- 10.20.193.4:0/1290653545 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ff80039e0 con 0x7f5004115930 2026-02-24T09:15:33.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.432+0000 7f50017fa640 1 -- 10.20.193.4:0/1290653545 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f4ff800c8d0 con 0x7f5004115930 2026-02-24T09:15:33.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.432+0000 7f50017fa640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fd80b56d0 0x7f4fd80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.433+0000 7f50017fa640 1 -- 10.20.193.4:0/1290653545 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4ff80e7a40 con 0x7f5004115930 2026-02-24T09:15:33.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.433+0000 7f5003fff640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fd80b56d0 0x7f4fd80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.433+0000 7f5003fff640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fd80b56d0 0x7f4fd80d5b80 secure :-1 s=READY pgs=377 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff0005970 tx=0x7f4ff0005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f500c7c9e00 1 Processor -- start 2026-02-24T09:15:33.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f500c7c9e00 1 -- start start 2026-02-24T09:15:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04eab320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04eeffc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f108e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bd04dbbee0 con 0x55bd04ef0500 2026-02-24T09:15:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bd04db7c10 con 0x55bd04eaaf50 2026-02-24T09:15:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bd04db1d70 con 0x55bd04eab860 2026-02-24T09:15:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f5008d45640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f108e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f5008d45640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f108e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52008/0 (socket says 10.20.193.4:52008) 2026-02-24T09:15:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f5008d45640 1 -- 10.20.193.4:0/3312190443 learned_addr learned my addr 10.20.193.4:0/3312190443 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:33.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f5003fff640 1 --2- 10.20.193.4:0/3312190443 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04eab320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f50037fe640 1 --2- 10.20.193.4:0/3312190443 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04eeffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f5008d45640 1 -- 10.20.193.4:0/3312190443 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 msgr2=0x55bd04eeffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f5008d45640 1 --2- 10.20.193.4:0/3312190443 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04eeffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f5008d45640 1 -- 10.20.193.4:0/3312190443 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 msgr2=0x55bd04eab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f5008d45640 1 --2- 10.20.193.4:0/3312190443 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04eab320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.436+0000 7f5008d45640 1 -- 10.20.193.4:0/3312190443 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd04d5d340 con 0x55bd04ef0500 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.437+0000 7f5008d45640 1 --2- 10.20.193.4:0/3312190443 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f108e0 secure :-1 s=READY pgs=928 gs=1 cs=0 l=1 c_cookie=12594492817480424347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff8006b60 tx=0x7f4ff800cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec8a07d30211b9b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.437+0000 7f4fd4ce3640 1 -- 10.20.193.4:0/3312190443 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ff8095ea0 con 0x55bd04ef0500 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.437+0000 7f4fd4ce3640 1 -- 10.20.193.4:0/3312190443 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ff80ad570 con 0x55bd04ef0500 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.437+0000 7f4fd4ce3640 1 -- 10.20.193.4:0/3312190443 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ff80b8f20 con 0x55bd04ef0500 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.437+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3312190443 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 msgr2=0x55bd04f108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.437+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/3312190443 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f108e0 secure :-1 s=READY pgs=928 gs=1 cs=0 l=1 c_cookie=12594492817480424347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff8006b60 tx=0x7f4ff800cd10 comp rx=0 tx=0).stop 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.438+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3312190443 shutdown_connections 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.438+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/3312190443 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f108e0 unknown :-1 s=CLOSED pgs=928 gs=1 cs=0 l=1 c_cookie=12594492817480424347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.438+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/3312190443 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04eeffc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.438+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/3312190443 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04eab320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.438+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3312190443 >> 10.20.193.4:0/3312190443 conn(0x55bd04dc9db0 msgr2=0x55bd04ea9830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.438+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3312190443 shutdown_connections 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.438+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3312190443 wait complete. 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 1 -- start start 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 1 Processor -- start 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04f07d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04f082d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f0d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bd04f0d800 con 0x55bd04ef0500 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bd04f0d970 con 0x55bd04eaaf50 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bd04f0db30 con 0x55bd04eab860 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5008d45640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f0d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5008d45640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f0d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52014/0 (socket says 10.20.193.4:52014) 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5008d45640 1 -- 10.20.193.4:0/3837684222 learned_addr learned my addr 10.20.193.4:0/3837684222 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5003fff640 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04f07d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f50037fe640 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04f082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5008d45640 1 -- 10.20.193.4:0/3837684222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 msgr2=0x55bd04f082d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5008d45640 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04f082d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5008d45640 1 -- 10.20.193.4:0/3837684222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 msgr2=0x55bd04f07d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5008d45640 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04f07d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5008d45640 1 -- 10.20.193.4:0/3837684222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd04d359d0 con 0x55bd04ef0500 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5003fff640 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04f07d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f5008d45640 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f0d2c0 secure :-1 s=READY pgs=929 gs=1 cs=0 l=1 c_cookie=3077785975615650395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff80adfe0 tx=0x7f4ff80e5340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab67e09bb3ffa5b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f4fc5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/3837684222 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ff80b2030 con 0x55bd04ef0500 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/3837684222 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ff80ae770 con 0x55bd04ef0500 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3837684222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50040fbe70 con 0x55bd04ef0500 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/3837684222 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ff8095ea0 con 0x55bd04ef0500 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 10 client.17076 _ll_register_callbacks cb 0x55bd04d5c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3837684222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bd04b014a0 con 0x55bd04ef0500 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.439+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/3837684222 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4ff8079260 con 0x55bd04ef0500 2026-02-24T09:15:33.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/3837684222 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4ff80b8cd0 con 0x55bd04ef0500 2026-02-24T09:15:33.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f500c7c9e00 10 client.17076 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:33.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3837684222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55bd04d47710 con 0x55bd04ef0500 2026-02-24T09:15:33.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/3837684222 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4ff8073bd0 con 0x55bd04ef0500 2026-02-24T09:15:33.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f500c7c9e00 10 client.17076 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:33.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f500c7c9e00 10 client.17076 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:15:33.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f500c7c9e00 20 client.17076 populate_metadata read hostname 'trial004' 2026-02-24T09:15:33.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bd04eed210 0x55bd04eed6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f500c7c9e00 4 client.17076 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:33.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3837684222 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd04da77b0 con 0x55bd04eed210 2026-02-24T09:15:33.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.440+0000 7f5003fff640 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bd04eed210 0x55bd04eed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.441+0000 7f5003fff640 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bd04eed210 0x55bd04eed6b0 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=10973069128088282391 s_cookie=2575864142353058907 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=98482c3bf381e517 server_cookie=23bf4eca3a9ecc5b in_seq=0 out_seq=0 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.441+0000 7f4fc5ffb640 10 client.17076 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/3837684222 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bd04da77b0 con 0x55bd04eed210 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f4fc5ffb640 10 client.17076 handle_command_reply: tid=0 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 client.17076 shutdown 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3837684222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 msgr2=0x55bd04f0d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f0d2c0 secure :-1 s=READY pgs=929 gs=1 cs=0 l=1 c_cookie=3077785975615650395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff80adfe0 tx=0x7f4ff80e5340 comp rx=0 tx=0).stop 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3837684222 shutdown_connections 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bd04eed210 0x55bd04eed6b0 crc :-1 s=READY pgs=42 gs=4 cs=0 l=0 c_cookie=10973069128088282391 s_cookie=2575864142353058907 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04f0d2c0 unknown :-1 s=CLOSED pgs=929 gs=1 cs=0 l=1 c_cookie=3077785975615650395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04f082d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f4fc5ffb640 0 client.17076 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:15:33.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/3837684222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04f07d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3837684222 >> 10.20.193.4:0/3837684222 conn(0x55bd04dc9db0 msgr2=0x55bd04ea9040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3837684222 shutdown_connections 2026-02-24T09:15:33.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 1 -- 10.20.193.4:0/3837684222 wait complete. 2026-02-24T09:15:33.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.442+0000 7f500c7c9e00 20 client.17076 trim_cache size 0 max 16384 2026-02-24T09:15:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f500c7c9e00 1 Processor -- start 2026-02-24T09:15:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f500c7c9e00 1 -- start start 2026-02-24T09:15:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04eaaf50 0x55bd04f05180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04f056c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04ef0500 0x55bd04eeb160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bd04daf9a0 con 0x55bd04eaaf50 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bd04b8bdf0 con 0x55bd04ef0500 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bd04ef5370 con 0x55bd04eab860 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f5003fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04eaaf50 0x55bd04f05180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f5003fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04eaaf50 0x55bd04f05180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52028/0 (socket says 10.20.193.4:52028) 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f5003fff640 1 -- 10.20.193.4:0/1579360151 learned_addr learned my addr 10.20.193.4:0/1579360151 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f5003fff640 1 -- 10.20.193.4:0/1579360151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 msgr2=0x55bd04f056c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f5003fff640 1 --2- 10.20.193.4:0/1579360151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04f056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f5003fff640 1 -- 10.20.193.4:0/1579360151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04ef0500 msgr2=0x55bd04eeb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f5003fff640 1 --2- 10.20.193.4:0/1579360151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04ef0500 0x55bd04eeb160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f5003fff640 1 -- 10.20.193.4:0/1579360151 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd04d42190 con 0x55bd04eaaf50 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f5003fff640 1 --2- 10.20.193.4:0/1579360151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04eaaf50 0x55bd04f05180 secure :-1 s=READY pgs=930 gs=1 cs=0 l=1 c_cookie=17462880416390488900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff0014040 tx=0x7f4ff0009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2589d376614a344 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f4fc7fff640 1 -- 10.20.193.4:0/1579360151 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ff0024040 con 0x55bd04eaaf50 2026-02-24T09:15:33.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f4fc7fff640 1 -- 10.20.193.4:0/1579360151 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ff0011d90 con 0x55bd04eaaf50 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.452+0000 7f4fc7fff640 1 -- 10.20.193.4:0/1579360151 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ff001e6a0 con 0x55bd04eaaf50 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.453+0000 7f500c7c9e00 1 -- 10.20.193.4:0/1579360151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04eaaf50 msgr2=0x55bd04f05180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.453+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/1579360151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04eaaf50 0x55bd04f05180 secure :-1 s=READY pgs=930 gs=1 cs=0 l=1 c_cookie=17462880416390488900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff0014040 tx=0x7f4ff0009000 comp rx=0 tx=0).stop 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.453+0000 7f500c7c9e00 1 -- 10.20.193.4:0/1579360151 shutdown_connections 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.453+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/1579360151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04ef0500 0x55bd04eeb160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.453+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/1579360151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04f056c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.453+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/1579360151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04eaaf50 0x55bd04f05180 unknown :-1 s=CLOSED pgs=930 gs=1 cs=0 l=1 c_cookie=17462880416390488900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.453+0000 7f500c7c9e00 1 -- 10.20.193.4:0/1579360151 >> 10.20.193.4:0/1579360151 conn(0x55bd04dc9db0 msgr2=0x55bd04eee780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.453+0000 7f500c7c9e00 1 -- 10.20.193.4:0/1579360151 shutdown_connections 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.453+0000 7f500c7c9e00 1 -- 10.20.193.4:0/1579360151 wait complete. 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.454+0000 7f500c7c9e00 1 -- start start 2026-02-24T09:15:33.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.454+0000 7f500c7c9e00 1 Processor -- start 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.454+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04e8ea30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.454+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04e8a360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.454+0000 7f500c7c9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04e8a8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.454+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bd04e8ae10 con 0x55bd04ef0500 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.454+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bd04e8af80 con 0x55bd04eaaf50 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.454+0000 7f500c7c9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bd04e8b140 con 0x55bd04eab860 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f50037fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04e8a360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f50037fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04e8a360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:45228/0 (socket says 10.20.193.4:45228) 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f50037fe640 1 -- 10.20.193.4:0/2630064878 learned_addr learned my addr 10.20.193.4:0/2630064878 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f5003fff640 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04e8ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f5008d45640 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04e8a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f50037fe640 1 -- 10.20.193.4:0/2630064878 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 msgr2=0x55bd04e8ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f50037fe640 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04e8ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f50037fe640 1 -- 10.20.193.4:0/2630064878 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 msgr2=0x55bd04e8a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f50037fe640 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04e8a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f50037fe640 1 -- 10.20.193.4:0/2630064878 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd04d35d00 con 0x55bd04eab860 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f5008d45640 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04e8a8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f50037fe640 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04e8a360 secure :-1 s=READY pgs=101 gs=2 cs=0 l=1 c_cookie=11712589417192638136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff402f6e0 tx=0x7f4ff40386a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a28b7a04dbc446b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f4fc5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.90:3300/0 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/2630064878 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ff403e070 con 0x55bd04eab860 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/2630064878 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ff4005dd0 con 0x55bd04eab860 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f500c7c9e00 1 -- 10.20.193.4:0/2630064878 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff000fe50 con 0x55bd04eab860 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f500c7c9e00 10 client.26365 _ll_register_callbacks cb 0x55bd04d5c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:33.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f500c7c9e00 1 -- 10.20.193.4:0/2630064878 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ff80ad570 con 0x55bd04eab860 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.455+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/2630064878 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ff4038b40 con 0x55bd04eab860 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/2630064878 <== mon.1 v2:10.20.193.90:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4ff4038ca0 con 0x55bd04eab860 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/2630064878 <== mon.1 v2:10.20.193.90:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4ff4038ea0 con 0x55bd04eab860 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f500c7c9e00 10 client.26365 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f500c7c9e00 1 -- 10.20.193.4:0/2630064878 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55bd04d47970 con 0x55bd04eab860 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/2630064878 <== mon.1 v2:10.20.193.90:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4ff404c020 con 0x55bd04eab860 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f500c7c9e00 10 client.26365 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f500c7c9e00 10 client.26365 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f500c7c9e00 20 client.26365 populate_metadata read hostname 'trial004' 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bd04f9dfc0 0x55bd04fbe420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f500c7c9e00 4 client.26365 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f500c7c9e00 1 -- 10.20.193.4:0/2630064878 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bd04ae6160 con 0x55bd04f9dfc0 2026-02-24T09:15:33.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.456+0000 7f5003fff640 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bd04f9dfc0 0x55bd04fbe420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f4fc5ffb640 10 client.26365 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f5003fff640 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bd04f9dfc0 0x55bd04fbe420 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=15819270384416933938 s_cookie=7222072791797435922 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db895699bd074832 server_cookie=6439f4f0a1198e12 in_seq=0 out_seq=0 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f4fc5ffb640 1 -- 10.20.193.4:0/2630064878 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bd04ae6160 con 0x55bd04f9dfc0 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f4fc5ffb640 10 client.26365 handle_command_reply: tid=0 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 client.26365 shutdown 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 -- 10.20.193.4:0/2630064878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 msgr2=0x55bd04e8a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04e8a360 secure :-1 s=READY pgs=101 gs=2 cs=0 l=1 c_cookie=11712589417192638136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff402f6e0 tx=0x7f4ff40386a0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 -- 10.20.193.4:0/2630064878 shutdown_connections 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bd04f9dfc0 0x55bd04fbe420 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=15819270384416933938 s_cookie=7222072791797435922 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bd04ef0500 0x55bd04e8a8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bd04eab860 0x55bd04e8a360 unknown :-1 s=CLOSED pgs=101 gs=2 cs=0 l=1 c_cookie=11712589417192638136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 --2- 10.20.193.4:0/2630064878 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bd04eaaf50 0x55bd04e8ea30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f4fc5ffb640 0 client.26365 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:15:33.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 -- 10.20.193.4:0/2630064878 >> 10.20.193.4:0/2630064878 conn(0x55bd04dc9db0 msgr2=0x55bd04f04170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 -- 10.20.193.4:0/2630064878 shutdown_connections 2026-02-24T09:15:33.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 1 -- 10.20.193.4:0/2630064878 wait complete. 2026-02-24T09:15:33.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.457+0000 7f500c7c9e00 20 client.26365 trim_cache size 0 max 16384 2026-02-24T09:15:33.469 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:15:33.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 -- 10.20.193.4:0/1290653545 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fd80b56d0 msgr2=0x7f4fd80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fd80b56d0 0x7f4fd80d5b80 secure :-1 s=READY pgs=377 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff0005970 tx=0x7f4ff0005900 comp rx=0 tx=0).stop 2026-02-24T09:15:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 -- 10.20.193.4:0/1290653545 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5004115930 msgr2=0x7f50040f6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5004115930 0x7f50040f6130 secure :-1 s=READY pgs=927 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ff8006e90 tx=0x7f4ff800edf0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 -- 10.20.193.4:0/1290653545 shutdown_connections 2026-02-24T09:15:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fd80b56d0 0x7f4fd80d5b80 unknown :-1 s=CLOSED pgs=377 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5004115930 0x7f50040f6130 unknown :-1 s=CLOSED pgs=927 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5004110130 0x7f5004176200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 --2- 10.20.193.4:0/1290653545 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f500410f740 0x7f50040f5a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 -- 10.20.193.4:0/1290653545 >> 10.20.193.4:0/1290653545 conn(0x7f50040ed050 msgr2=0x7f500410dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 -- 10.20.193.4:0/1290653545 shutdown_connections 2026-02-24T09:15:33.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.458+0000 7f500a7cf640 1 -- 10.20.193.4:0/1290653545 wait complete. 2026-02-24T09:15:33.545 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:15:33.691 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:33.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.847+0000 7f41f1b6a640 1 -- 10.20.193.4:0/902198756 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41ec10c290 msgr2=0x7f41ec10c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.847+0000 7f41f1b6a640 1 --2- 10.20.193.4:0/902198756 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41ec10c290 0x7f41ec10c660 secure :-1 s=READY pgs=931 gs=1 cs=0 l=1 c_cookie=11603894493512559194 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41d8009950 tx=0x7f41d802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.847+0000 7f41f1b6a640 1 -- 10.20.193.4:0/902198756 shutdown_connections 2026-02-24T09:15:33.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.847+0000 7f41f1b6a640 1 --2- 10.20.193.4:0/902198756 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41ec112480 0x7f41ec172e50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.847+0000 7f41f1b6a640 1 --2- 10.20.193.4:0/902198756 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41ec10cc80 0x7f41ec111cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.847+0000 7f41f1b6a640 1 --2- 10.20.193.4:0/902198756 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41ec10c290 0x7f41ec10c660 unknown :-1 s=CLOSED pgs=931 gs=1 cs=0 l=1 c_cookie=11603894493512559194 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.847+0000 7f41f1b6a640 1 -- 10.20.193.4:0/902198756 >> 10.20.193.4:0/902198756 conn(0x7f41ec0e9b80 msgr2=0x7f41ec109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.847+0000 7f41f1b6a640 1 -- 10.20.193.4:0/902198756 shutdown_connections 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.847+0000 7f41f1b6a640 1 -- 10.20.193.4:0/902198756 wait complete. 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41f1b6a640 1 Processor -- start 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41f1b6a640 1 -- start start 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41f1b6a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41ec10c290 0x7f41ec0f4f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41f1b6a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41ec10cc80 0x7f41ec172d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41f1b6a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41ec112480 0x7f41ec0f5650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41f1b6a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f41ec0fa860 con 0x7f41ec10c290 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41f1b6a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f41ec0fa9d0 con 0x7f41ec10cc80 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41f1b6a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41ec0fab90 con 0x7f41ec112480 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41eb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41ec10c290 0x7f41ec0f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41eb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41ec10c290 0x7f41ec0f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52048/0 (socket says 10.20.193.4:52048) 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41eb7fe640 1 -- 10.20.193.4:0/3790912644 learned_addr learned my addr 10.20.193.4:0/3790912644 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41eb7fe640 1 -- 10.20.193.4:0/3790912644 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41ec112480 msgr2=0x7f41ec0f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41ec112480 0x7f41ec0f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41eb7fe640 1 -- 10.20.193.4:0/3790912644 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41ec10cc80 msgr2=0x7f41ec172d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41ec10cc80 0x7f41ec172d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41eb7fe640 1 -- 10.20.193.4:0/3790912644 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e000a590 con 0x7f41ec10c290 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.848+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41ec10c290 0x7f41ec0f4f50 secure :-1 s=READY pgs=932 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41d80023d0 tx=0x7f41d8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.849+0000 7f41e8ff9640 1 -- 10.20.193.4:0/3790912644 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41d803d070 con 0x7f41ec10c290 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.849+0000 7f41e8ff9640 1 -- 10.20.193.4:0/3790912644 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41d8002ad0 con 0x7f41ec10c290 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.849+0000 7f41f1b6a640 1 -- 10.20.193.4:0/3790912644 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d8009570 con 0x7f41ec10c290 2026-02-24T09:15:33.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.849+0000 7f41e8ff9640 1 -- 10.20.193.4:0/3790912644 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41d80418a0 con 0x7f41ec10c290 2026-02-24T09:15:33.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.849+0000 7f41f1b6a640 1 -- 10.20.193.4:0/3790912644 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41ec0fb0f0 con 0x7f41ec10c290 2026-02-24T09:15:33.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.851+0000 7f41e8ff9640 1 -- 10.20.193.4:0/3790912644 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f41d8041a30 con 0x7f41ec10c290 2026-02-24T09:15:33.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.852+0000 7f41e8ff9640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41c00b56d0 0x7f41c00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.852+0000 7f41eaffd640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41c00b56d0 0x7f41c00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.853+0000 7f41e8ff9640 1 -- 10.20.193.4:0/3790912644 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f41d810b1f0 con 0x7f41ec10c290 2026-02-24T09:15:33.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.853+0000 7f41eaffd640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41c00b56d0 0x7f41c00d5b80 secure :-1 s=READY pgs=378 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41ec0fb8f0 tx=0x7f41dc009690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41f3b64e00 1 Processor -- start 2026-02-24T09:15:33.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41f3b64e00 1 -- start start 2026-02-24T09:15:33.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00131f50 0x55ee00132320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00176fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00177500 0x55ee001978e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ee00042ee0 con 0x55ee00132860 2026-02-24T09:15:33.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ee0003ec10 con 0x55ee00177500 2026-02-24T09:15:33.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ee00038d70 con 0x55ee00131f50 2026-02-24T09:15:33.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41eaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00176fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41eaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00176fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52050/0 (socket says 10.20.193.4:52050) 2026-02-24T09:15:33.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41eaffd640 1 -- 10.20.193.4:0/709564013 learned_addr learned my addr 10.20.193.4:0/709564013 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:33.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/709564013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00131f50 0x55ee00132320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41ebfff640 1 --2- 10.20.193.4:0/709564013 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00177500 0x55ee001978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41eaffd640 1 -- 10.20.193.4:0/709564013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00131f50 msgr2=0x55ee00132320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41eaffd640 1 --2- 10.20.193.4:0/709564013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00131f50 0x55ee00132320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41eaffd640 1 -- 10.20.193.4:0/709564013 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00177500 msgr2=0x55ee001978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41eaffd640 1 --2- 10.20.193.4:0/709564013 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00177500 0x55ee001978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41eaffd640 1 -- 10.20.193.4:0/709564013 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edfffe4340 con 0x55ee00132860 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41eaffd640 1 --2- 10.20.193.4:0/709564013 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00176fc0 secure :-1 s=READY pgs=933 gs=1 cs=0 l=1 c_cookie=1363039568074528438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41dc0098a0 tx=0x7f41dc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ea7d43f5e256b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41affff640 1 -- 10.20.193.4:0/709564013 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41dc025680 con 0x55ee00132860 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41affff640 1 -- 10.20.193.4:0/709564013 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41dc009e30 con 0x55ee00132860 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.855+0000 7f41affff640 1 -- 10.20.193.4:0/709564013 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41dc01ccc0 con 0x55ee00132860 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.856+0000 7f41f3b64e00 1 -- 10.20.193.4:0/709564013 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 msgr2=0x55ee00176fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.856+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/709564013 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00176fc0 secure :-1 s=READY pgs=933 gs=1 cs=0 l=1 c_cookie=1363039568074528438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41dc0098a0 tx=0x7f41dc011000 comp rx=0 tx=0).stop 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.856+0000 7f41f3b64e00 1 -- 10.20.193.4:0/709564013 shutdown_connections 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.856+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/709564013 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00177500 0x55ee001978e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.856+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/709564013 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00176fc0 unknown :-1 s=CLOSED pgs=933 gs=1 cs=0 l=1 c_cookie=1363039568074528438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.856+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/709564013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00131f50 0x55ee00132320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.856+0000 7f41f3b64e00 1 -- 10.20.193.4:0/709564013 >> 10.20.193.4:0/709564013 conn(0x55ee00050db0 msgr2=0x55ee00130830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.856+0000 7f41f3b64e00 1 -- 10.20.193.4:0/709564013 shutdown_connections 2026-02-24T09:15:33.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.856+0000 7f41f3b64e00 1 -- 10.20.193.4:0/709564013 wait complete. 2026-02-24T09:15:33.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.857+0000 7f41f3b64e00 1 -- start start 2026-02-24T09:15:33.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.857+0000 7f41f3b64e00 1 Processor -- start 2026-02-24T09:15:33.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.857+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00131f50 0x55ee0018ed50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.857+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee0018f290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.857+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00177500 0x55ee00194280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.857+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ee001947c0 con 0x55ee00132860 2026-02-24T09:15:33.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.857+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ee00194930 con 0x55ee00177500 2026-02-24T09:15:33.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.857+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ee00194af0 con 0x55ee00131f50 2026-02-24T09:15:33.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41eaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee0018f290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41eaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee0018f290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52054/0 (socket says 10.20.193.4:52054) 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41eaffd640 1 -- 10.20.193.4:0/2389425426 learned_addr learned my addr 10.20.193.4:0/2389425426 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00131f50 0x55ee0018ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41ebfff640 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00177500 0x55ee00194280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41eaffd640 1 -- 10.20.193.4:0/2389425426 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00131f50 msgr2=0x55ee0018ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41eaffd640 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00131f50 0x55ee0018ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41eaffd640 1 -- 10.20.193.4:0/2389425426 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00177500 msgr2=0x55ee00194280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41eaffd640 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00177500 0x55ee00194280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41eaffd640 1 -- 10.20.193.4:0/2389425426 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edfffbc9d0 con 0x55ee00132860 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41eaffd640 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee0018f290 secure :-1 s=READY pgs=934 gs=1 cs=0 l=1 c_cookie=16689637865393093880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41dc025690 tx=0x7f41dc0256c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79d81368ca9fcf8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41ad7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:33.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41ad7fa640 1 -- 10.20.193.4:0/2389425426 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41dc025c90 con 0x55ee00132860 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41ad7fa640 1 -- 10.20.193.4:0/2389425426 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41dc01c5d0 con 0x55ee00132860 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41ad7fa640 1 -- 10.20.193.4:0/2389425426 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41dc02f3d0 con 0x55ee00132860 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2389425426 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41dc00ee00 con 0x55ee00132860 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41ad7fa640 1 -- 10.20.193.4:0/2389425426 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f41dc02c070 con 0x55ee00132860 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41ad7fa640 10 client.17094 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41f3b64e00 10 client.17094 _ll_register_callbacks cb 0x55edfffe3080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.858+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2389425426 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55edffd884a0 con 0x55ee00132860 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41ad7fa640 1 -- 10.20.193.4:0/2389425426 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f41dc025df0 con 0x55ee00132860 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41f3b64e00 10 client.17094 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2389425426 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55edfffce710 con 0x55ee00132860 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41ad7fa640 1 -- 10.20.193.4:0/2389425426 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f41dc018070 con 0x55ee00132860 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41f3b64e00 10 client.17094 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:33.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41f3b64e00 10 client.17094 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41f3b64e00 20 client.17094 populate_metadata read hostname 'trial004' 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ee001745d0 0x55ee00174a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41f3b64e00 4 client.17094 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2389425426 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee0002e7b0 con 0x55ee001745d0 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.859+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ee001745d0 0x55ee00174a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.860+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ee001745d0 0x55ee00174a70 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=15105601312774789058 s_cookie=5959599170987749093 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d1a1e05c6e9d97c2 server_cookie=52b4bfdee66feee5 in_seq=0 out_seq=0 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.860+0000 7f41ad7fa640 10 client.17094 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.860+0000 7f41ad7fa640 1 -- 10.20.193.4:0/2389425426 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ee0002e7b0 con 0x55ee001745d0 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.860+0000 7f41ad7fa640 10 client.17094 handle_command_reply: tid=0 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.860+0000 7f41f3b64e00 1 client.17094 shutdown 2026-02-24T09:15:33.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2389425426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 msgr2=0x55ee0018f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee0018f290 secure :-1 s=READY pgs=934 gs=1 cs=0 l=1 c_cookie=16689637865393093880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41dc025690 tx=0x7f41dc0256c0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2389425426 shutdown_connections 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ee001745d0 0x55ee00174a70 crc :-1 s=READY pgs=43 gs=4 cs=0 l=0 c_cookie=15105601312774789058 s_cookie=5959599170987749093 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00177500 0x55ee00194280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee0018f290 unknown :-1 s=CLOSED pgs=934 gs=1 cs=0 l=1 c_cookie=16689637865393093880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41ad7fa640 0 client.17094 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/2389425426 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00131f50 0x55ee0018ed50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2389425426 >> 10.20.193.4:0/2389425426 conn(0x55ee00050db0 msgr2=0x55ee00130040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2389425426 shutdown_connections 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2389425426 wait complete. 2026-02-24T09:15:33.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.861+0000 7f41f3b64e00 20 client.17094 trim_cache size 0 max 16384 2026-02-24T09:15:33.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41f3b64e00 1 Processor -- start 2026-02-24T09:15:33.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41f3b64e00 1 -- start start 2026-02-24T09:15:33.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 0x55ee00176140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00132860 0x55ee00176680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00177500 0x55ee00176bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ee000369a0 con 0x55ee00177500 2026-02-24T09:15:33.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55edffe12df0 con 0x55ee00131f50 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ee0017c6a0 con 0x55ee00132860 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41ebfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00177500 0x55ee00176bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41ebfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00177500 0x55ee00176bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52066/0 (socket says 10.20.193.4:52066) 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41ebfff640 1 -- 10.20.193.4:0/2829699063 learned_addr learned my addr 10.20.193.4:0/2829699063 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41eaffd640 1 --2- 10.20.193.4:0/2829699063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00132860 0x55ee00176680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/2829699063 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 0x55ee00176140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41ebfff640 1 -- 10.20.193.4:0/2829699063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00132860 msgr2=0x55ee00176680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41ebfff640 1 --2- 10.20.193.4:0/2829699063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00132860 0x55ee00176680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41ebfff640 1 -- 10.20.193.4:0/2829699063 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 msgr2=0x55ee00176140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.871+0000 7f41ebfff640 1 --2- 10.20.193.4:0/2829699063 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 0x55ee00176140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.872+0000 7f41ebfff640 1 -- 10.20.193.4:0/2829699063 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee001813b0 con 0x55ee00177500 2026-02-24T09:15:33.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.872+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/2829699063 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 0x55ee00176140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.872+0000 7f41ebfff640 1 --2- 10.20.193.4:0/2829699063 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00177500 0x55ee00176bc0 secure :-1 s=READY pgs=935 gs=1 cs=0 l=1 c_cookie=15425174224633508805 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41e00057a0 tx=0x7f41e000ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6113a3b31cab3c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.872+0000 7f41af7fe640 1 -- 10.20.193.4:0/2829699063 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41e0013450 con 0x55ee00177500 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.872+0000 7f41af7fe640 1 -- 10.20.193.4:0/2829699063 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41e0013a90 con 0x55ee00177500 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.872+0000 7f41af7fe640 1 -- 10.20.193.4:0/2829699063 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41e0012b70 con 0x55ee00177500 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.872+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2829699063 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00177500 msgr2=0x55ee00176bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.872+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/2829699063 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00177500 0x55ee00176bc0 secure :-1 s=READY pgs=935 gs=1 cs=0 l=1 c_cookie=15425174224633508805 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41e00057a0 tx=0x7f41e000ac60 comp rx=0 tx=0).stop 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2829699063 shutdown_connections 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/2829699063 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00177500 0x55ee00176bc0 unknown :-1 s=CLOSED pgs=935 gs=1 cs=0 l=1 c_cookie=15425174224633508805 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/2829699063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00132860 0x55ee00176680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/2829699063 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 0x55ee00176140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2829699063 >> 10.20.193.4:0/2829699063 conn(0x55ee00050db0 msgr2=0x55ee00130450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2829699063 shutdown_connections 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 -- 10.20.193.4:0/2829699063 wait complete. 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 -- start start 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 Processor -- start 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 0x55ee00111780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00111cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.873+0000 7f41f3b64e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00177500 0x55ee001dd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ee00112440 con 0x55ee00132860 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ee001125b0 con 0x55ee00131f50 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ee001dd640 con 0x55ee00177500 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00111cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00111cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52072/0 (socket says 10.20.193.4:52072) 2026-02-24T09:15:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eaffd640 1 -- 10.20.193.4:0/4035162143 learned_addr learned my addr 10.20.193.4:0/4035162143 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41ebfff640 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00177500 0x55ee001dd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eaffd640 1 -- 10.20.193.4:0/4035162143 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00177500 msgr2=0x55ee001dd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eaffd640 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00177500 0x55ee001dd100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 0x55ee00111780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eaffd640 1 -- 10.20.193.4:0/4035162143 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 msgr2=0x55ee00111780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eaffd640 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 0x55ee00111780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eaffd640 1 -- 10.20.193.4:0/4035162143 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edfffc9190 con 0x55ee00132860 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 0x55ee00111780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41eaffd640 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00111cc0 secure :-1 s=READY pgs=936 gs=1 cs=0 l=1 c_cookie=11329062580324392195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41dc010ca0 tx=0x7f41dc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d38ea649267dd03 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41ad7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41ad7fa640 1 -- 10.20.193.4:0/4035162143 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41dc0383a0 con 0x55ee00132860 2026-02-24T09:15:33.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41ad7fa640 1 -- 10.20.193.4:0/4035162143 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55edffd884a0 con 0x55ee00132860 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 1 -- 10.20.193.4:0/4035162143 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e0005440 con 0x55ee00132860 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41ad7fa640 1 -- 10.20.193.4:0/4035162143 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41dc038c40 con 0x55ee00132860 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 10 client.17100 _ll_register_callbacks cb 0x55edfffe3080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 1 -- 10.20.193.4:0/4035162143 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41dc009e30 con 0x55ee00132860 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41ad7fa640 1 -- 10.20.193.4:0/4035162143 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f41dc02c040 con 0x55ee00132860 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41ad7fa640 1 -- 10.20.193.4:0/4035162143 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f41dc038dd0 con 0x55ee00132860 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 10 client.17100 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 1 -- 10.20.193.4:0/4035162143 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55edfffbcd00 con 0x55ee00132860 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41ad7fa640 1 -- 10.20.193.4:0/4035162143 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f41dc018050 con 0x55ee00132860 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 10 client.17100 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 10 client.17100 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:15:33.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 20 client.17100 populate_metadata read hostname 'trial004' 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ee002252e0 0x55ee00245790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 4 client.17100 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.874+0000 7f41f3b64e00 1 -- 10.20.193.4:0/4035162143 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55edffd6d160 con 0x55ee002252e0 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ee002252e0 0x55ee00245790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41ad7fa640 10 client.17100 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41eb7fe640 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ee002252e0 0x55ee00245790 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=653423761802643250 s_cookie=6086350707977851831 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9116d730a0bc732 server_cookie=54770fb8d77793b7 in_seq=0 out_seq=0 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41ad7fa640 1 -- 10.20.193.4:0/4035162143 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55edffd6d160 con 0x55ee002252e0 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41ad7fa640 10 client.17100 handle_command_reply: tid=0 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 client.17100 shutdown 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 -- 10.20.193.4:0/4035162143 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 msgr2=0x55ee00111cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00111cc0 secure :-1 s=READY pgs=936 gs=1 cs=0 l=1 c_cookie=11329062580324392195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41dc010ca0 tx=0x7f41dc004740 comp rx=0 tx=0).stop 2026-02-24T09:15:33.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 -- 10.20.193.4:0/4035162143 shutdown_connections 2026-02-24T09:15:33.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55ee002252e0 0x55ee00245790 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=653423761802643250 s_cookie=6086350707977851831 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ee00177500 0x55ee001dd100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ee00132860 0x55ee00111cc0 unknown :-1 s=CLOSED pgs=936 gs=1 cs=0 l=1 c_cookie=11329062580324392195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41ad7fa640 0 client.17100 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:15:33.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 --2- 10.20.193.4:0/4035162143 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ee00131f50 0x55ee00111780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 -- 10.20.193.4:0/4035162143 >> 10.20.193.4:0/4035162143 conn(0x55ee00050db0 msgr2=0x55ee00130c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 -- 10.20.193.4:0/4035162143 shutdown_connections 2026-02-24T09:15:33.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 1 -- 10.20.193.4:0/4035162143 wait complete. 2026-02-24T09:15:33.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.875+0000 7f41f3b64e00 20 client.17100 trim_cache size 0 max 16384 2026-02-24T09:15:33.889 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:15:33.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 -- 10.20.193.4:0/3790912644 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41c00b56d0 msgr2=0x7f41c00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41c00b56d0 0x7f41c00d5b80 secure :-1 s=READY pgs=378 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41ec0fb8f0 tx=0x7f41dc009690 comp rx=0 tx=0).stop 2026-02-24T09:15:33.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 -- 10.20.193.4:0/3790912644 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41ec10c290 msgr2=0x7f41ec0f4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:33.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41ec10c290 0x7f41ec0f4f50 secure :-1 s=READY pgs=932 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41d80023d0 tx=0x7f41d8004290 comp rx=0 tx=0).stop 2026-02-24T09:15:33.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 -- 10.20.193.4:0/3790912644 shutdown_connections 2026-02-24T09:15:33.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41c00b56d0 0x7f41c00d5b80 unknown :-1 s=CLOSED pgs=378 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41ec112480 0x7f41ec0f5650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41ec10cc80 0x7f41ec172d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 --2- 10.20.193.4:0/3790912644 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41ec10c290 0x7f41ec0f4f50 unknown :-1 s=CLOSED pgs=932 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:33.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 -- 10.20.193.4:0/3790912644 >> 10.20.193.4:0/3790912644 conn(0x7f41ec0e9b80 msgr2=0x7f41ec10a740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:33.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 -- 10.20.193.4:0/3790912644 shutdown_connections 2026-02-24T09:15:33.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:33.876+0000 7f41f1b6a640 1 -- 10.20.193.4:0/3790912644 wait complete. 2026-02-24T09:15:33.964 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:15:34.138 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:34.171 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:33 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/53182678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:15:34.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 -- 10.20.193.4:0/1456870983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f18f410f650 msgr2=0x7f18f410fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:34.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 --2- 10.20.193.4:0/1456870983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f18f410f650 0x7f18f410fa20 secure :-1 s=READY pgs=937 gs=1 cs=0 l=1 c_cookie=10109625098377995573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e8009950 tx=0x7f18e802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 -- 10.20.193.4:0/1456870983 shutdown_connections 2026-02-24T09:15:34.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 --2- 10.20.193.4:0/1456870983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f18f4115840 0x7f18f4176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 --2- 10.20.193.4:0/1456870983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18f4110040 0x7f18f4115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 --2- 10.20.193.4:0/1456870983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f18f410f650 0x7f18f410fa20 unknown :-1 s=CLOSED pgs=937 gs=1 cs=0 l=1 c_cookie=10109625098377995573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 -- 10.20.193.4:0/1456870983 >> 10.20.193.4:0/1456870983 conn(0x7f18f40ecf20 msgr2=0x7f18f410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 -- 10.20.193.4:0/1456870983 shutdown_connections 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 -- 10.20.193.4:0/1456870983 wait complete. 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 Processor -- start 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.285+0000 7f18f8c32640 1 -- start start 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f8c32640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18f410f650 0x7f18f411df40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f8c32640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f18f4110040 0x7f18f411e480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f8c32640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f18f4115840 0x7f18f4123850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f8c32640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4123e70 con 0x7f18f4115840 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f8c32640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4123fe0 con 0x7f18f4110040 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f8c32640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18f41241a0 con 0x7f18f410f650 2026-02-24T09:15:34.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f18f4115840 0x7f18f4123850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f18f4115840 0x7f18f4123850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52088/0 (socket says 10.20.193.4:52088) 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f2d76640 1 -- 10.20.193.4:0/4139994717 learned_addr learned my addr 10.20.193.4:0/4139994717 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f1d74640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f18f4110040 0x7f18f411e480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f2d76640 1 -- 10.20.193.4:0/4139994717 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18f410f650 msgr2=0x7f18f411df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f2d76640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18f410f650 0x7f18f411df40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f2d76640 1 -- 10.20.193.4:0/4139994717 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f18f4110040 msgr2=0x7f18f411e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f2d76640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f18f4110040 0x7f18f411e480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f2d76640 1 -- 10.20.193.4:0/4139994717 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e400a590 con 0x7f18f4115840 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f2d76640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f18f4115840 0x7f18f4123850 secure :-1 s=READY pgs=938 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e4005790 tx=0x7f18e4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18db7fe640 1 -- 10.20.193.4:0/4139994717 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18e400fd60 con 0x7f18f4115840 2026-02-24T09:15:34.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f8c32640 1 -- 10.20.193.4:0/4139994717 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e8009570 con 0x7f18f4115840 2026-02-24T09:15:34.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18db7fe640 1 -- 10.20.193.4:0/4139994717 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18e4003e20 con 0x7f18f4115840 2026-02-24T09:15:34.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18f8c32640 1 -- 10.20.193.4:0/4139994717 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f41649e0 con 0x7f18f4115840 2026-02-24T09:15:34.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.286+0000 7f18db7fe640 1 -- 10.20.193.4:0/4139994717 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18e40199f0 con 0x7f18f4115840 2026-02-24T09:15:34.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.289+0000 7f18db7fe640 1 -- 10.20.193.4:0/4139994717 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f18e4017020 con 0x7f18f4115840 2026-02-24T09:15:34.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.289+0000 7f18db7fe640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18cc0b5760 0x7f18cc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.290+0000 7f18db7fe640 1 -- 10.20.193.4:0/4139994717 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f18e40e7c90 con 0x7f18f4115840 2026-02-24T09:15:34.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.290+0000 7f18f2575640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18cc0b5760 0x7f18cc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.290+0000 7f18f2575640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18cc0b5760 0x7f18cc0d5c10 secure :-1 s=READY pgs=379 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e802f6e0 tx=0x7f18e8005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18fac2ce00 1 Processor -- start 2026-02-24T09:15:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18fac2ce00 1 -- start start 2026-02-24T09:15:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454ed0f50 0x55a454ed1320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed1860 0x55a454f15fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f368e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a454de1ee0 con 0x55a454f16500 2026-02-24T09:15:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a454dddc10 con 0x55a454ed1860 2026-02-24T09:15:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a454dd7d70 con 0x55a454ed0f50 2026-02-24T09:15:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18f2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18f2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f368e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52098/0 (socket says 10.20.193.4:52098) 2026-02-24T09:15:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18f2d76640 1 -- 10.20.193.4:0/4192283623 learned_addr learned my addr 10.20.193.4:0/4192283623 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18f1d74640 1 --2- 10.20.193.4:0/4192283623 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed1860 0x55a454f15fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18f2d76640 1 -- 10.20.193.4:0/4192283623 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454ed0f50 msgr2=0x55a454ed1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18f2d76640 1 --2- 10.20.193.4:0/4192283623 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454ed0f50 0x55a454ed1320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18f2d76640 1 -- 10.20.193.4:0/4192283623 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed1860 msgr2=0x55a454f15fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18f2d76640 1 --2- 10.20.193.4:0/4192283623 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed1860 0x55a454f15fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18f2d76640 1 -- 10.20.193.4:0/4192283623 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a454d83340 con 0x55a454f16500 2026-02-24T09:15:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18f2d76640 1 --2- 10.20.193.4:0/4192283623 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f368e0 secure :-1 s=READY pgs=939 gs=1 cs=0 l=1 c_cookie=8423196492959527480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e4011f70 tx=0x7f18e4019400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e53495142b3238 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18d8ff9640 1 -- 10.20.193.4:0/4192283623 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18e40b3ce0 con 0x55a454f16500 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18d8ff9640 1 -- 10.20.193.4:0/4192283623 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18e40b62c0 con 0x55a454f16500 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.295+0000 7f18d8ff9640 1 -- 10.20.193.4:0/4192283623 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18e40aeed0 con 0x55a454f16500 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.297+0000 7f18fac2ce00 1 -- 10.20.193.4:0/4192283623 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 msgr2=0x55a454f368e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.297+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/4192283623 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f368e0 secure :-1 s=READY pgs=939 gs=1 cs=0 l=1 c_cookie=8423196492959527480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e4011f70 tx=0x7f18e4019400 comp rx=0 tx=0).stop 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.297+0000 7f18fac2ce00 1 -- 10.20.193.4:0/4192283623 shutdown_connections 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.297+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/4192283623 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f368e0 unknown :-1 s=CLOSED pgs=939 gs=1 cs=0 l=1 c_cookie=8423196492959527480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.297+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/4192283623 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed1860 0x55a454f15fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.297+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/4192283623 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454ed0f50 0x55a454ed1320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.297+0000 7f18fac2ce00 1 -- 10.20.193.4:0/4192283623 >> 10.20.193.4:0/4192283623 conn(0x55a454defdb0 msgr2=0x55a454ecf830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.297+0000 7f18fac2ce00 1 -- 10.20.193.4:0/4192283623 shutdown_connections 2026-02-24T09:15:34.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.297+0000 7f18fac2ce00 1 -- 10.20.193.4:0/4192283623 wait complete. 2026-02-24T09:15:34.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18fac2ce00 1 -- start start 2026-02-24T09:15:34.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18fac2ce00 1 Processor -- start 2026-02-24T09:15:34.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 0x55a454f2dbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 0x55a454f2e0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454f16500 0x55a454f330e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a454f33620 con 0x55a454ed1860 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a454f33790 con 0x55a454ed0f50 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a454f33950 con 0x55a454f16500 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18f2575640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 0x55a454f2dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18f2575640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 0x55a454f2dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:52932/0 (socket says 10.20.193.4:52932) 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18f2575640 1 -- 10.20.193.4:0/812216266 learned_addr learned my addr 10.20.193.4:0/812216266 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18f1d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 0x55a454f2e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.298+0000 7f18f2d76640 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454f16500 0x55a454f330e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18f2575640 1 -- 10.20.193.4:0/812216266 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454f16500 msgr2=0x55a454f330e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18f2575640 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454f16500 0x55a454f330e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18f2575640 1 -- 10.20.193.4:0/812216266 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 msgr2=0x55a454f2e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18f2575640 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 0x55a454f2e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18f2575640 1 -- 10.20.193.4:0/812216266 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a454d5b9d0 con 0x55a454ed0f50 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18f2575640 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 0x55a454f2dbb0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=3240577969025450367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e8038610 tx=0x7f18e8004420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cf8d87e56b8017f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18a3fff640 10 client.0 ms_handle_connect on v2:10.20.193.14:3300/0 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18a3fff640 1 -- 10.20.193.4:0/812216266 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18e803d070 con 0x55a454ed0f50 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 1 -- 10.20.193.4:0/812216266 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f41649e0 con 0x55a454ed0f50 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18a3fff640 1 -- 10.20.193.4:0/812216266 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18e8038e00 con 0x55a454ed0f50 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18a3fff640 1 -- 10.20.193.4:0/812216266 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18e8045bc0 con 0x55a454ed0f50 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 10 client.26267 _ll_register_callbacks cb 0x55a454d82080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 1 -- 10.20.193.4:0/812216266 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a454b274a0 con 0x55a454ed0f50 2026-02-24T09:15:34.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18a3fff640 1 -- 10.20.193.4:0/812216266 <== mon.2 v2:10.20.193.14:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f18e8058440 con 0x55a454ed0f50 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18a3fff640 1 -- 10.20.193.4:0/812216266 <== mon.2 v2:10.20.193.14:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f18e8058660 con 0x55a454ed0f50 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 10 client.26267 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 1 -- 10.20.193.4:0/812216266 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55a454d6d710 con 0x55a454ed0f50 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18a3fff640 1 -- 10.20.193.4:0/812216266 <== mon.2 v2:10.20.193.14:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f18e8056060 con 0x55a454ed0f50 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 10 client.26267 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 10 client.26267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 20 client.26267 populate_metadata read hostname 'trial004' 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a454f135d0 0x55a454f13a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 4 client.26267 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18fac2ce00 1 -- 10.20.193.4:0/812216266 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a454dcd7b0 con 0x55a454f135d0 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18f1d74640 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a454f135d0 0x55a454f13a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18a3fff640 10 client.26267 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.299+0000 7f18f1d74640 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a454f135d0 0x55a454f13a40 crc :-1 s=READY pgs=137 gs=4 cs=0 l=0 c_cookie=11697888773708250867 s_cookie=14083908082048257828 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2573fdc92e8fef3 server_cookie=c37417c7e7bd4f24 in_seq=0 out_seq=0 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18a3fff640 1 -- 10.20.193.4:0/812216266 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a454dcd7b0 con 0x55a454f135d0 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18a3fff640 10 client.26267 handle_command_reply: tid=0 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 client.26267 shutdown 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 -- 10.20.193.4:0/812216266 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 msgr2=0x55a454f2dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 0x55a454f2dbb0 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=3240577969025450367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e8038610 tx=0x7f18e8004420 comp rx=0 tx=0).stop 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 -- 10.20.193.4:0/812216266 shutdown_connections 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a454f135d0 0x55a454f13a40 crc :-1 s=READY pgs=137 gs=4 cs=0 l=0 c_cookie=11697888773708250867 s_cookie=14083908082048257828 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454f16500 0x55a454f330e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 0x55a454f2e0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/812216266 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 0x55a454f2dbb0 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=3240577969025450367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18a3fff640 0 client.26267 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:34.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 -- 10.20.193.4:0/812216266 >> 10.20.193.4:0/812216266 conn(0x55a454defdb0 msgr2=0x55a454ecf040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:34.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 -- 10.20.193.4:0/812216266 shutdown_connections 2026-02-24T09:15:34.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 1 -- 10.20.193.4:0/812216266 wait complete. 2026-02-24T09:15:34.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.300+0000 7f18fac2ce00 20 client.26267 trim_cache size 0 max 16384 2026-02-24T09:15:34.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18fac2ce00 1 Processor -- start 2026-02-24T09:15:34.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18fac2ce00 1 -- start start 2026-02-24T09:15:34.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454ed0f50 0x55a454f32650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed1860 0x55a454f11100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f11640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a454dd59a0 con 0x55a454f16500 2026-02-24T09:15:34.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a454bb1df0 con 0x55a454ed1860 2026-02-24T09:15:34.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a454f36a60 con 0x55a454ed0f50 2026-02-24T09:15:34.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18f2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f11640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18f2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f11640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52104/0 (socket says 10.20.193.4:52104) 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18f2d76640 1 -- 10.20.193.4:0/3307355939 learned_addr learned my addr 10.20.193.4:0/3307355939 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18f2575640 1 --2- 10.20.193.4:0/3307355939 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454ed0f50 0x55a454f32650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18f1d74640 1 --2- 10.20.193.4:0/3307355939 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed1860 0x55a454f11100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18f2d76640 1 -- 10.20.193.4:0/3307355939 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454ed0f50 msgr2=0x55a454f32650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18f2d76640 1 --2- 10.20.193.4:0/3307355939 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454ed0f50 0x55a454f32650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18f2d76640 1 -- 10.20.193.4:0/3307355939 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed1860 msgr2=0x55a454f11100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18f2d76640 1 --2- 10.20.193.4:0/3307355939 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed1860 0x55a454f11100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.310+0000 7f18f2d76640 1 -- 10.20.193.4:0/3307355939 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a454f20420 con 0x55a454f16500 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.311+0000 7f18f2d76640 1 --2- 10.20.193.4:0/3307355939 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f11640 secure :-1 s=READY pgs=940 gs=2 cs=0 l=1 c_cookie=3506772304676060618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e40ae230 tx=0x7f18e4005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30aa8ed4d864fdca server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.311+0000 7f18be4e6640 1 -- 10.20.193.4:0/3307355939 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18e40aa230 con 0x55a454f16500 2026-02-24T09:15:34.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.311+0000 7f18be4e6640 1 -- 10.20.193.4:0/3307355939 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18e40aa390 con 0x55a454f16500 2026-02-24T09:15:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.311+0000 7f18be4e6640 1 -- 10.20.193.4:0/3307355939 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18e40733d0 con 0x55a454f16500 2026-02-24T09:15:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3307355939 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 msgr2=0x55a454f11640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/3307355939 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f11640 secure :-1 s=READY pgs=940 gs=2 cs=0 l=1 c_cookie=3506772304676060618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e40ae230 tx=0x7f18e4005040 comp rx=0 tx=0).stop 2026-02-24T09:15:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3307355939 shutdown_connections 2026-02-24T09:15:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/3307355939 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454f16500 0x55a454f11640 unknown :-1 s=CLOSED pgs=940 gs=2 cs=0 l=1 c_cookie=3506772304676060618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/3307355939 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed1860 0x55a454f11100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/3307355939 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454ed0f50 0x55a454f32650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3307355939 >> 10.20.193.4:0/3307355939 conn(0x55a454defdb0 msgr2=0x55a454f31f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3307355939 shutdown_connections 2026-02-24T09:15:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3307355939 wait complete. 2026-02-24T09:15:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 -- start start 2026-02-24T09:15:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.312+0000 7f18fac2ce00 1 Processor -- start 2026-02-24T09:15:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 0x55a454eaf030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 0x55a454eaf570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18fac2ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454f16500 0x55a454eafab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a454f2e6d0 con 0x55a454ed1860 2026-02-24T09:15:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a454eb40b0 con 0x55a454ed0f50 2026-02-24T09:15:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18fac2ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a454eb4270 con 0x55a454f16500 2026-02-24T09:15:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f1d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 0x55a454eaf570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f1d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 0x55a454eaf570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52116/0 (socket says 10.20.193.4:52116) 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f1d74640 1 -- 10.20.193.4:0/3497589264 learned_addr learned my addr 10.20.193.4:0/3497589264 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f2575640 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 0x55a454eaf030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f2d76640 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454f16500 0x55a454eafab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f1d74640 1 -- 10.20.193.4:0/3497589264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454f16500 msgr2=0x55a454eafab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f1d74640 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454f16500 0x55a454eafab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f1d74640 1 -- 10.20.193.4:0/3497589264 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 msgr2=0x55a454eaf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f1d74640 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 0x55a454eaf030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f1d74640 1 -- 10.20.193.4:0/3497589264 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a454d68190 con 0x55a454ed1860 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18f1d74640 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 0x55a454eaf570 secure :-1 s=READY pgs=941 gs=2 cs=0 l=1 c_cookie=1251398086940209219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18dc0023d0 tx=0x7f18dc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115ddbee0cacb043 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18a3fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18a3fff640 1 -- 10.20.193.4:0/3497589264 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18dc016070 con 0x55a454ed1860 2026-02-24T09:15:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18a3fff640 1 -- 10.20.193.4:0/3497589264 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18dc017040 con 0x55a454ed1860 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18a3fff640 1 -- 10.20.193.4:0/3497589264 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18dc010740 con 0x55a454ed1860 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3497589264 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a454d83340 con 0x55a454ed1860 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18a3fff640 1 -- 10.20.193.4:0/3497589264 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f18dc01d420 con 0x55a454ed1860 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.313+0000 7f18a3fff640 10 client.17118 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18fac2ce00 10 client.17118 _ll_register_callbacks cb 0x55a454d82080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3497589264 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18e40b62c0 con 0x55a454ed1860 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18a3fff640 1 -- 10.20.193.4:0/3497589264 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f18dc020170 con 0x55a454ed1860 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18fac2ce00 10 client.17118 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3497589264 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55a454d5bd00 con 0x55a454ed1860 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18a3fff640 1 -- 10.20.193.4:0/3497589264 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f18dc003c60 con 0x55a454ed1860 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18fac2ce00 10 client.17118 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18fac2ce00 10 client.17118 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18fac2ce00 20 client.17118 populate_metadata read hostname 'trial004' 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a454fc46f0 0x55a454fe4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18fac2ce00 4 client.17118 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3497589264 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a454b0c160 con 0x55a454fc46f0 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18f2575640 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a454fc46f0 0x55a454fe4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18a3fff640 10 client.17118 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.314+0000 7f18f2575640 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a454fc46f0 0x55a454fe4ba0 crc :-1 s=READY pgs=138 gs=4 cs=0 l=0 c_cookie=11068597170287594318 s_cookie=8377992836791380412 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=999b8e7b80e2cb4e server_cookie=74449c18b7b7a9bc in_seq=0 out_seq=0 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18a3fff640 1 -- 10.20.193.4:0/3497589264 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a454b0c160 con 0x55a454fc46f0 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18a3fff640 10 client.17118 handle_command_reply: tid=0 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 client.17118 shutdown 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3497589264 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 msgr2=0x55a454eaf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 0x55a454eaf570 secure :-1 s=READY pgs=941 gs=2 cs=0 l=1 c_cookie=1251398086940209219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18dc0023d0 tx=0x7f18dc005f90 comp rx=0 tx=0).stop 2026-02-24T09:15:34.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3497589264 shutdown_connections 2026-02-24T09:15:34.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a454fc46f0 0x55a454fe4ba0 crc :-1 s=READY pgs=138 gs=4 cs=0 l=0 c_cookie=11068597170287594318 s_cookie=8377992836791380412 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a454f16500 0x55a454eafab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a454ed1860 0x55a454eaf570 unknown :-1 s=CLOSED pgs=941 gs=2 cs=0 l=1 c_cookie=1251398086940209219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18a3fff640 0 client.17118 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:34.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 --2- 10.20.193.4:0/3497589264 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a454ed0f50 0x55a454eaf030 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3497589264 >> 10.20.193.4:0/3497589264 conn(0x55a454defdb0 msgr2=0x55a454ecfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:34.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3497589264 shutdown_connections 2026-02-24T09:15:34.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 1 -- 10.20.193.4:0/3497589264 wait complete. 2026-02-24T09:15:34.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.315+0000 7f18fac2ce00 20 client.17118 trim_cache size 0 max 16384 2026-02-24T09:15:34.328 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:15:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 -- 10.20.193.4:0/4139994717 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18cc0b5760 msgr2=0x7f18cc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18cc0b5760 0x7f18cc0d5c10 secure :-1 s=READY pgs=379 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e802f6e0 tx=0x7f18e8005c50 comp rx=0 tx=0).stop 2026-02-24T09:15:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 -- 10.20.193.4:0/4139994717 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f18f4115840 msgr2=0x7f18f4123850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f18f4115840 0x7f18f4123850 secure :-1 s=READY pgs=938 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e4005790 tx=0x7f18e4003c20 comp rx=0 tx=0).stop 2026-02-24T09:15:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 -- 10.20.193.4:0/4139994717 shutdown_connections 2026-02-24T09:15:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f18cc0b5760 0x7f18cc0d5c10 unknown :-1 s=CLOSED pgs=379 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f18f4115840 0x7f18f4123850 unknown :-1 s=CLOSED pgs=938 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f18f4110040 0x7f18f411e480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 --2- 10.20.193.4:0/4139994717 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18f410f650 0x7f18f411df40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 -- 10.20.193.4:0/4139994717 >> 10.20.193.4:0/4139994717 conn(0x7f18f40ecf20 msgr2=0x7f18f410d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 -- 10.20.193.4:0/4139994717 shutdown_connections 2026-02-24T09:15:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:34.316+0000 7f18f8c32640 1 -- 10.20.193.4:0/4139994717 wait complete. 2026-02-24T09:15:34.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:33 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/53182678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:15:34.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:33 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/53182678' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:15:35.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:34 trial004 ceph-mon[41596]: pgmap v325: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 707 MiB/s wr, 185 op/s 2026-02-24T09:15:35.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:34 trial090 ceph-mon[47278]: pgmap v325: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 707 MiB/s wr, 185 op/s 2026-02-24T09:15:35.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:34 trial014 ceph-mon[46941]: pgmap v325: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 707 MiB/s wr, 185 op/s 2026-02-24T09:15:35.388 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:15:35.389 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:15:35.563 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:35.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.719+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/3125088219 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4fdc10fc70 msgr2=0x7f4fdc114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:35.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.719+0000 7f4fe1fc1640 1 --2- 10.20.193.4:0/3125088219 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4fdc10fc70 0x7f4fdc114cc0 secure :-1 s=READY pgs=942 gs=3 cs=0 l=1 c_cookie=13833029414684303580 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fcc009950 tx=0x7f4fcc02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.719+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/3125088219 shutdown_connections 2026-02-24T09:15:35.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.719+0000 7f4fe1fc1640 1 --2- 10.20.193.4:0/3125088219 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fdc115470 0x7f4fdc175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.719+0000 7f4fe1fc1640 1 --2- 10.20.193.4:0/3125088219 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4fdc10fc70 0x7f4fdc114cc0 unknown :-1 s=CLOSED pgs=942 gs=3 cs=0 l=1 c_cookie=13833029414684303580 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.719+0000 7f4fe1fc1640 1 --2- 10.20.193.4:0/3125088219 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4fdc10f280 0x7f4fdc10f650 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.719+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/3125088219 >> 10.20.193.4:0/3125088219 conn(0x7f4fdc05f830 msgr2=0x7f4fdc10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:35.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.719+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/3125088219 shutdown_connections 2026-02-24T09:15:35.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.719+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/3125088219 wait complete. 2026-02-24T09:15:35.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fe1fc1640 1 Processor -- start 2026-02-24T09:15:35.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fe1fc1640 1 -- start start 2026-02-24T09:15:35.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fe1fc1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fdc10f280 0x7f4fdc0f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fe1fc1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4fdc10fc70 0x7f4fdc175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fe1fc1640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4fdc115470 0x7f4fdc0f5cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fe1fc1640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0faec0 con 0x7f4fdc10fc70 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fe1fc1640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0fb030 con 0x7f4fdc115470 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fe1fc1640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0fb1f0 con 0x7f4fdc10f280 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4fdc10fc70 0x7f4fdc175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4fdc10fc70 0x7f4fdc175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52132/0 (socket says 10.20.193.4:52132) 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdaffd640 1 -- 10.20.193.4:0/2205300462 learned_addr learned my addr 10.20.193.4:0/2205300462 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdbfff640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4fdc115470 0x7f4fdc0f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdaffd640 1 -- 10.20.193.4:0/2205300462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fdc10f280 msgr2=0x7f4fdc0f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdb7fe640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fdc10f280 0x7f4fdc0f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fdc10f280 0x7f4fdc0f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdaffd640 1 -- 10.20.193.4:0/2205300462 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4fdc115470 msgr2=0x7f4fdc0f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:35.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4fdc115470 0x7f4fdc0f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdaffd640 1 -- 10.20.193.4:0/2205300462 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc009570 con 0x7f4fdc10fc70 2026-02-24T09:15:35.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdb7fe640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fdc10f280 0x7f4fdc0f55b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:35.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4fdc10fc70 0x7f4fdc175d40 secure :-1 s=READY pgs=943 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fcc038820 tx=0x7f4fcc004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:35.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fd8ff9640 1 -- 10.20.193.4:0/2205300462 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fcc03d070 con 0x7f4fdc10fc70 2026-02-24T09:15:35.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/2205300462 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc0fb470 con 0x7f4fdc10fc70 2026-02-24T09:15:35.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fd8ff9640 1 -- 10.20.193.4:0/2205300462 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4fcc002ad0 con 0x7f4fdc10fc70 2026-02-24T09:15:35.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fd8ff9640 1 -- 10.20.193.4:0/2205300462 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fcc041930 con 0x7f4fdc10fc70 2026-02-24T09:15:35.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.720+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/2205300462 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc0fb930 con 0x7f4fdc10fc70 2026-02-24T09:15:35.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.723+0000 7f4fd8ff9640 1 -- 10.20.193.4:0/2205300462 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f4fcc02f9f0 con 0x7f4fdc10fc70 2026-02-24T09:15:35.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.724+0000 7f4fd8ff9640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fb00b56d0 0x7f4fb00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.724+0000 7f4fd8ff9640 1 -- 10.20.193.4:0/2205300462 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4fcc10b220 con 0x7f4fdc10fc70 2026-02-24T09:15:35.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.724+0000 7f4fdb7fe640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fb00b56d0 0x7f4fb00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.724+0000 7f4fdb7fe640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fb00b56d0 0x7f4fb00d5b80 secure :-1 s=READY pgs=380 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc8004740 tx=0x7f4fc8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:35.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fe3fbbe00 1 Processor -- start 2026-02-24T09:15:35.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fe3fbbe00 1 -- start start 2026-02-24T09:15:35.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 0x555e4b75e6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b7a3370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b7a38b0 0x555e4b7c3c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555e4b66e520 con 0x555e4b7a38b0 2026-02-24T09:15:35.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555e4b66a250 con 0x555e4b75e300 2026-02-24T09:15:35.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555e4b6643b0 con 0x555e4b75ec10 2026-02-24T09:15:35.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fdb7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 0x555e4b75e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fdbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b7a38b0 0x555e4b7c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fdbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b7a38b0 0x555e4b7c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52136/0 (socket says 10.20.193.4:52136) 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fdb7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 0x555e4b75e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:52966/0 (socket says 10.20.193.4:52966) 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fdbfff640 1 -- 10.20.193.4:0/493042988 learned_addr learned my addr 10.20.193.4:0/493042988 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.730+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/493042988 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b7a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.731+0000 7f4fdbfff640 1 -- 10.20.193.4:0/493042988 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 msgr2=0x555e4b7a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.731+0000 7f4fdbfff640 1 --2- 10.20.193.4:0/493042988 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b7a3370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.731+0000 7f4fdbfff640 1 -- 10.20.193.4:0/493042988 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 msgr2=0x555e4b75e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.731+0000 7f4fdbfff640 1 --2- 10.20.193.4:0/493042988 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 0x555e4b75e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.731+0000 7f4fdbfff640 1 -- 10.20.193.4:0/493042988 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e4b60f6e0 con 0x555e4b7a38b0 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.731+0000 7f4fdbfff640 1 --2- 10.20.193.4:0/493042988 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b7a38b0 0x555e4b7c3c90 secure :-1 s=READY pgs=944 gs=2 cs=0 l=1 c_cookie=16042823613912600138 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd000a2e0 tx=0x7f4fd0003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea38f140d824e4a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.731+0000 7f4f9ffff640 1 -- 10.20.193.4:0/493042988 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fd000ae30 con 0x555e4b7a38b0 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.731+0000 7f4f9ffff640 1 -- 10.20.193.4:0/493042988 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4fd0003e30 con 0x555e4b7a38b0 2026-02-24T09:15:35.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.731+0000 7f4f9ffff640 1 -- 10.20.193.4:0/493042988 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fd0011a50 con 0x555e4b7a38b0 2026-02-24T09:15:35.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.732+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/493042988 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b7a38b0 msgr2=0x555e4b7c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.732+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/493042988 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b7a38b0 0x555e4b7c3c90 secure :-1 s=READY pgs=944 gs=2 cs=0 l=1 c_cookie=16042823613912600138 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fd000a2e0 tx=0x7f4fd0003c30 comp rx=0 tx=0).stop 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.732+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/493042988 shutdown_connections 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.732+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/493042988 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b7a38b0 0x555e4b7c3c90 unknown :-1 s=CLOSED pgs=944 gs=2 cs=0 l=1 c_cookie=16042823613912600138 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.732+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/493042988 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b7a3370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.732+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/493042988 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 0x555e4b75e6d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.732+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/493042988 >> 10.20.193.4:0/493042988 conn(0x555e4b67c4f0 msgr2=0x555e4b75cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.732+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/493042988 shutdown_connections 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.732+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/493042988 wait complete. 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.733+0000 7f4fe3fbbe00 1 -- start start 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.733+0000 7f4fe3fbbe00 1 Processor -- start 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75e300 0x555e4b776310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75ec10 0x555e4b776850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b7a38b0 0x555e4b77b840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555e4b77bd80 con 0x555e4b75ec10 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555e4b77bef0 con 0x555e4b7a38b0 2026-02-24T09:15:35.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555e4b77c0b0 con 0x555e4b75e300 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75ec10 0x555e4b776850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdb7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75e300 0x555e4b776310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdb7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75e300 0x555e4b776310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:45358/0 (socket says 10.20.193.4:45358) 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdb7fe640 1 -- 10.20.193.4:0/55223174 learned_addr learned my addr 10.20.193.4:0/55223174 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdbfff640 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b7a38b0 0x555e4b77b840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdaffd640 1 -- 10.20.193.4:0/55223174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75e300 msgr2=0x555e4b776310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75e300 0x555e4b776310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdaffd640 1 -- 10.20.193.4:0/55223174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b7a38b0 msgr2=0x555e4b77b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b7a38b0 0x555e4b77b840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdaffd640 1 -- 10.20.193.4:0/55223174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e4b5e7cd0 con 0x555e4b75ec10 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75ec10 0x555e4b776850 secure :-1 s=READY pgs=945 gs=3 cs=0 l=1 c_cookie=7053589243576706682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fcc108d00 tx=0x7f4fcc0d1710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e3620ba6e7e67a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4f9d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/55223174 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fcc0d72b0 con 0x555e4b75ec10 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/55223174 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4fcc0d9890 con 0x555e4b75ec10 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/55223174 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fcc0dc4c0 con 0x555e4b75ec10 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.734+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/55223174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd00052d0 con 0x555e4b75ec10 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/55223174 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4fcc096690 con 0x555e4b75ec10 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4f9d7fa640 10 client.17130 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:15:35.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4fe3fbbe00 10 client.17130 _ll_register_callbacks cb 0x555e4b5e0790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/55223174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e4b2f19d0 con 0x555e4b75ec10 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/55223174 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4fcc0dc6d0 con 0x555e4b75ec10 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4fe3fbbe00 10 client.17130 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/55223174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x555e4b5f9ab0 con 0x555e4b75ec10 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/55223174 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4fcc0961b0 con 0x555e4b75ec10 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4fe3fbbe00 10 client.17130 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4fe3fbbe00 10 client.17130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4fe3fbbe00 20 client.17130 populate_metadata read hostname 'trial004' 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555e4b7a08d0 0x555e4b7a0d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4fe3fbbe00 4 client.17130 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.735+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/55223174 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e4b674b70 con 0x555e4b7a08d0 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.736+0000 7f4fdb7fe640 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555e4b7a08d0 0x555e4b7a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.736+0000 7f4f9d7fa640 10 client.17130 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.736+0000 7f4fdb7fe640 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555e4b7a08d0 0x555e4b7a0d70 crc :-1 s=READY pgs=139 gs=4 cs=0 l=0 c_cookie=12122492559006408843 s_cookie=2778045303456627888 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a83bbec133e4a08b server_cookie=268d997c1a797cb0 in_seq=0 out_seq=0 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/55223174 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555e4b674b70 con 0x555e4b7a08d0 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4f9d7fa640 10 client.17130 handle_command_reply: tid=0 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 client.17130 shutdown 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/55223174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75ec10 msgr2=0x555e4b776850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:35.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75ec10 0x555e4b776850 secure :-1 s=READY pgs=945 gs=3 cs=0 l=1 c_cookie=7053589243576706682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fcc108d00 tx=0x7f4fcc0d1710 comp rx=0 tx=0).stop 2026-02-24T09:15:35.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/55223174 shutdown_connections 2026-02-24T09:15:35.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555e4b7a08d0 0x555e4b7a0d70 crc :-1 s=READY pgs=139 gs=4 cs=0 l=0 c_cookie=12122492559006408843 s_cookie=2778045303456627888 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b7a38b0 0x555e4b77b840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4f9d7fa640 0 client.17130 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:35.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75ec10 0x555e4b776850 unknown :-1 s=CLOSED pgs=945 gs=3 cs=0 l=1 c_cookie=7053589243576706682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/55223174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75e300 0x555e4b776310 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/55223174 >> 10.20.193.4:0/55223174 conn(0x555e4b67c4f0 msgr2=0x555e4b75d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:35.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/55223174 shutdown_connections 2026-02-24T09:15:35.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/55223174 wait complete. 2026-02-24T09:15:35.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.737+0000 7f4fe3fbbe00 20 client.17130 trim_cache size 0 max 16384 2026-02-24T09:15:35.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fe3fbbe00 1 Processor -- start 2026-02-24T09:15:35.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fe3fbbe00 1 -- start start 2026-02-24T09:15:35.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b67c4f0 0x555e4b777560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75e300 0x555e4b777aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b777fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555e4b661fe0 con 0x555e4b75e300 2026-02-24T09:15:35.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555e4b32cfe0 con 0x555e4b67c4f0 2026-02-24T09:15:35.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555e4b79d060 con 0x555e4b75ec10 2026-02-24T09:15:35.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75e300 0x555e4b777aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdb7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b67c4f0 0x555e4b777560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdaffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75e300 0x555e4b777aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52140/0 (socket says 10.20.193.4:52140) 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdb7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b67c4f0 0x555e4b777560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:52982/0 (socket says 10.20.193.4:52982) 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdbfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b777fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdaffd640 1 -- 10.20.193.4:0/2968798395 learned_addr learned my addr 10.20.193.4:0/2968798395 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdaffd640 1 -- 10.20.193.4:0/2968798395 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 msgr2=0x555e4b777fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/2968798395 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b777fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdaffd640 1 -- 10.20.193.4:0/2968798395 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b67c4f0 msgr2=0x555e4b777560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/2968798395 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b67c4f0 0x555e4b777560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdaffd640 1 -- 10.20.193.4:0/2968798395 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e4b5f4530 con 0x555e4b75e300 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdb7fe640 1 --2- 10.20.193.4:0/2968798395 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b67c4f0 0x555e4b777560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.749+0000 7f4fdbfff640 1 --2- 10.20.193.4:0/2968798395 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b777fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.750+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/2968798395 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75e300 0x555e4b777aa0 secure :-1 s=READY pgs=946 gs=2 cs=0 l=1 c_cookie=14188452456440055725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fcc0ce800 tx=0x7f4fcc03a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e78255e2a0c7ad server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.750+0000 7f4f9f7fe640 1 -- 10.20.193.4:0/2968798395 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fcc0d72b0 con 0x555e4b75e300 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.750+0000 7f4f9f7fe640 1 -- 10.20.193.4:0/2968798395 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x555e4b2f19d0 con 0x555e4b75e300 2026-02-24T09:15:35.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.750+0000 7f4f9f7fe640 1 -- 10.20.193.4:0/2968798395 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fcc0961b0 con 0x555e4b75e300 2026-02-24T09:15:35.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.751+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/2968798395 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75e300 msgr2=0x555e4b777aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:35.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.751+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/2968798395 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75e300 0x555e4b777aa0 secure :-1 s=READY pgs=946 gs=2 cs=0 l=1 c_cookie=14188452456440055725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fcc0ce800 tx=0x7f4fcc03a030 comp rx=0 tx=0).stop 2026-02-24T09:15:35.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.751+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/2968798395 shutdown_connections 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.751+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/2968798395 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b777fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.751+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/2968798395 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b75e300 0x555e4b777aa0 unknown :-1 s=CLOSED pgs=946 gs=2 cs=0 l=1 c_cookie=14188452456440055725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.751+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/2968798395 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b67c4f0 0x555e4b777560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.751+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/2968798395 >> 10.20.193.4:0/2968798395 conn(0x555e4b773e60 msgr2=0x555e4b75c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.751+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/2968798395 shutdown_connections 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.751+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/2968798395 wait complete. 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.752+0000 7f4fe3fbbe00 1 -- start start 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.752+0000 7f4fe3fbbe00 1 Processor -- start 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b67c4f0 0x555e4b780690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 0x555e4b780bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fe3fbbe00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b7e7dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555e4b739650 con 0x555e4b67c4f0 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555e4b77b950 con 0x555e4b75e300 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fe3fbbe00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555e4b7e8400 con 0x555e4b75ec10 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b67c4f0 0x555e4b780690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b67c4f0 0x555e4b780690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52144/0 (socket says 10.20.193.4:52144) 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdb7fe640 1 -- 10.20.193.4:0/590261398 learned_addr learned my addr 10.20.193.4:0/590261398 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdbfff640 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b7e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 0x555e4b780bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdb7fe640 1 -- 10.20.193.4:0/590261398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 msgr2=0x555e4b7e7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdb7fe640 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b7e7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdb7fe640 1 -- 10.20.193.4:0/590261398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 msgr2=0x555e4b780bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdb7fe640 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 0x555e4b780bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdb7fe640 1 -- 10.20.193.4:0/590261398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e4b5f9ab0 con 0x555e4b67c4f0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fdb7fe640 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b67c4f0 0x555e4b780690 secure :-1 s=READY pgs=947 gs=1 cs=0 l=1 c_cookie=3814509598502401163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x555e4b7a1620 tx=0x7f4fc80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34efdc450b0db48b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4f9d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/590261398 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fc8027040 con 0x555e4b67c4f0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/590261398 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4fc802c950 con 0x555e4b67c4f0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/590261398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc8009de0 con 0x555e4b67c4f0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/590261398 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fc8018040 con 0x555e4b67c4f0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/590261398 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4fc8012a40 con 0x555e4b67c4f0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.753+0000 7f4f9d7fa640 10 client.17136 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fe3fbbe00 10 client.17136 _ll_register_callbacks cb 0x555e4b5e0790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/590261398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e4b6767e0 con 0x555e4b67c4f0 2026-02-24T09:15:35.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/590261398 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4fc8012450 con 0x555e4b67c4f0 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fe3fbbe00 10 client.17136 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/590261398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x555e4b5e8000 con 0x555e4b67c4f0 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/590261398 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4fc8032020 con 0x555e4b67c4f0 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fe3fbbe00 10 client.17136 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fe3fbbe00 10 client.17136 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fe3fbbe00 20 client.17136 populate_metadata read hostname 'trial004' 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555e4b7a08d0 0x555e4b7eb5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fe3fbbe00 4 client.17136 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/590261398 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555e4b2ef220 con 0x555e4b7a08d0 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.754+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555e4b7a08d0 0x555e4b7eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.755+0000 7f4fdaffd640 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555e4b7a08d0 0x555e4b7eb5a0 crc :-1 s=READY pgs=140 gs=4 cs=0 l=0 c_cookie=11032437667180301835 s_cookie=478398143364007321 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=991b179b1eebce0b server_cookie=6a39c93a46b0599 in_seq=0 out_seq=0 2026-02-24T09:15:35.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.755+0000 7f4f9d7fa640 10 client.17136 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:35.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.755+0000 7f4f9d7fa640 1 -- 10.20.193.4:0/590261398 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555e4b2ef220 con 0x555e4b7a08d0 2026-02-24T09:15:35.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.755+0000 7f4f9d7fa640 10 client.17136 handle_command_reply: tid=0 2026-02-24T09:15:35.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.755+0000 7f4fe3fbbe00 1 client.17136 shutdown 2026-02-24T09:15:35.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.755+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/590261398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b67c4f0 msgr2=0x555e4b780690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:35.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.755+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b67c4f0 0x555e4b780690 secure :-1 s=READY pgs=947 gs=1 cs=0 l=1 c_cookie=3814509598502401163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x555e4b7a1620 tx=0x7f4fc80047e0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/590261398 shutdown_connections 2026-02-24T09:15:35.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555e4b7a08d0 0x555e4b7eb5a0 crc :-1 s=READY pgs=140 gs=4 cs=0 l=0 c_cookie=11032437667180301835 s_cookie=478398143364007321 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555e4b75ec10 0x555e4b7e7dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555e4b75e300 0x555e4b780bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe3fbbe00 1 --2- 10.20.193.4:0/590261398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555e4b67c4f0 0x555e4b780690 unknown :-1 s=CLOSED pgs=947 gs=1 cs=0 l=1 c_cookie=3814509598502401163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4f9d7fa640 0 client.17136 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/590261398 >> 10.20.193.4:0/590261398 conn(0x555e4b773e60 msgr2=0x555e4b777ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/590261398 shutdown_connections 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe3fbbe00 1 -- 10.20.193.4:0/590261398 wait complete. 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe3fbbe00 20 client.17136 trim_cache size 0 max 16384 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "8cb15914-baf4-40f4-a213-ea7a448da074", 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:15:35.762 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/2205300462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fb00b56d0 msgr2=0x7f4fb00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe1fc1640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fb00b56d0 0x7f4fb00d5b80 secure :-1 s=READY pgs=380 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc8004740 tx=0x7f4fc8005f90 comp rx=0 tx=0).stop 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/2205300462 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4fdc10fc70 msgr2=0x7f4fdc175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.756+0000 7f4fe1fc1640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4fdc10fc70 0x7f4fdc175d40 secure :-1 s=READY pgs=943 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fcc038820 tx=0x7f4fcc004300 comp rx=0 tx=0).stop 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.757+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/2205300462 shutdown_connections 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.757+0000 7f4fe1fc1640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4fb00b56d0 0x7f4fb00d5b80 unknown :-1 s=CLOSED pgs=380 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.757+0000 7f4fe1fc1640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4fdc115470 0x7f4fdc0f5cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.757+0000 7f4fe1fc1640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4fdc10fc70 0x7f4fdc175d40 unknown :-1 s=CLOSED pgs=943 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.757+0000 7f4fe1fc1640 1 --2- 10.20.193.4:0/2205300462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fdc10f280 0x7f4fdc0f55b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.757+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/2205300462 >> 10.20.193.4:0/2205300462 conn(0x7f4fdc05f830 msgr2=0x7f4fdc10d730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:35.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.757+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/2205300462 shutdown_connections 2026-02-24T09:15:35.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:35.757+0000 7f4fe1fc1640 1 -- 10.20.193.4:0/2205300462 wait complete. 2026-02-24T09:15:35.867 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:15:36.038 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:15:36.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.177+0000 7f68ccbdf640 1 -- 10.20.193.4:0/823427110 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f68c8112480 msgr2=0x7f68c8172e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:36.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.177+0000 7f68ccbdf640 1 --2- 10.20.193.4:0/823427110 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f68c8112480 0x7f68c8172e50 secure :-1 s=READY pgs=948 gs=1 cs=0 l=1 c_cookie=14195741858963157285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b800aa30 tx=0x7f68b8030280 comp rx=0 tx=0).stop 2026-02-24T09:15:36.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.177+0000 7f68ccbdf640 1 -- 10.20.193.4:0/823427110 shutdown_connections 2026-02-24T09:15:36.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.177+0000 7f68ccbdf640 1 --2- 10.20.193.4:0/823427110 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f68c8112480 0x7f68c8172e50 unknown :-1 s=CLOSED pgs=948 gs=1 cs=0 l=1 c_cookie=14195741858963157285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.177+0000 7f68ccbdf640 1 --2- 10.20.193.4:0/823427110 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f68c810cc80 0x7f68c8111cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.177+0000 7f68ccbdf640 1 --2- 10.20.193.4:0/823427110 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f68c810c290 0x7f68c810c660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.177+0000 7f68ccbdf640 1 -- 10.20.193.4:0/823427110 >> 10.20.193.4:0/823427110 conn(0x7f68c80e9b80 msgr2=0x7f68c8109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:36.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.177+0000 7f68ccbdf640 1 -- 10.20.193.4:0/823427110 shutdown_connections 2026-02-24T09:15:36.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.177+0000 7f68ccbdf640 1 -- 10.20.193.4:0/823427110 wait complete. 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.177+0000 7f68ccbdf640 1 Processor -- start 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68ccbdf640 1 -- start start 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68ccbdf640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f68c810c290 0x7f68c80f4ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68ccbdf640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f68c810cc80 0x7f68c8172d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68ccbdf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f68c8112480 0x7f68c80f55f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68ccbdf640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f68c80fa7b0 con 0x7f68c8112480 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68ccbdf640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f68c80fa920 con 0x7f68c810c290 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68ccbdf640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f68c80faae0 con 0x7f68c810cc80 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f68c8112480 0x7f68c80f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f68c8112480 0x7f68c80f55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52156/0 (socket says 10.20.193.4:52156) 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6d76640 1 -- 10.20.193.4:0/4198818378 learned_addr learned my addr 10.20.193.4:0/4198818378 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6575640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f68c810c290 0x7f68c80f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c5d74640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f68c810cc80 0x7f68c8172d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6d76640 1 -- 10.20.193.4:0/4198818378 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f68c810cc80 msgr2=0x7f68c8172d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6d76640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f68c810cc80 0x7f68c8172d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6d76640 1 -- 10.20.193.4:0/4198818378 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f68c810c290 msgr2=0x7f68c80f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6d76640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f68c810c290 0x7f68c80f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6d76640 1 -- 10.20.193.4:0/4198818378 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b800a650 con 0x7f68c8112480 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6575640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f68c810c290 0x7f68c80f4ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c5d74640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f68c810cc80 0x7f68c8172d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68c6d76640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f68c8112480 0x7f68c80f55f0 secure :-1 s=READY pgs=949 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b800a330 tx=0x7f68b8003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68af7fe640 1 -- 10.20.193.4:0/4198818378 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68b803e070 con 0x7f68c8112480 2026-02-24T09:15:36.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68ccbdf640 1 -- 10.20.193.4:0/4198818378 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c80fad60 con 0x7f68c8112480 2026-02-24T09:15:36.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68af7fe640 1 -- 10.20.193.4:0/4198818378 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68b8003b40 con 0x7f68c8112480 2026-02-24T09:15:36.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68af7fe640 1 -- 10.20.193.4:0/4198818378 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68b8042930 con 0x7f68c8112480 2026-02-24T09:15:36.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.178+0000 7f68ccbdf640 1 -- 10.20.193.4:0/4198818378 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c80fb1d0 con 0x7f68c8112480 2026-02-24T09:15:36.185 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.182+0000 7f68af7fe640 1 -- 10.20.193.4:0/4198818378 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f68b80050c0 con 0x7f68c8112480 2026-02-24T09:15:36.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.184+0000 7f68af7fe640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f68a00b56d0 0x7f68a00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.184+0000 7f68c6575640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f68a00b56d0 0x7f68a00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.184+0000 7f68af7fe640 1 -- 10.20.193.4:0/4198818378 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f68b810c910 con 0x7f68c8112480 2026-02-24T09:15:36.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.184+0000 7f68c6575640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f68a00b56d0 0x7f68a00d5b80 secure :-1 s=READY pgs=381 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68bc004740 tx=0x7f68bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:36.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.186+0000 7f68cebd9e00 1 Processor -- start 2026-02-24T09:15:36.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.186+0000 7f68cebd9e00 1 -- start start 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.186+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x55781924bbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.186+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x557819290890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.186+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557819290dd0 0x5578192b11b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.186+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55781915bde0 con 0x55781924b820 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.186+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557819157b10 con 0x55781924c130 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.186+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557819151ab0 con 0x557819290dd0 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.186+0000 7f68c6575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x55781924bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68c6575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x55781924bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52158/0 (socket says 10.20.193.4:52158) 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68c6575640 1 -- 10.20.193.4:0/1142668028 learned_addr learned my addr 10.20.193.4:0/1142668028 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68c6d76640 1 --2- 10.20.193.4:0/1142668028 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557819290dd0 0x5578192b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68c5d74640 1 --2- 10.20.193.4:0/1142668028 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x557819290890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68c6575640 1 -- 10.20.193.4:0/1142668028 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557819290dd0 msgr2=0x5578192b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68c6575640 1 --2- 10.20.193.4:0/1142668028 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557819290dd0 0x5578192b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68c6575640 1 -- 10.20.193.4:0/1142668028 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 msgr2=0x557819290890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68c6575640 1 --2- 10.20.193.4:0/1142668028 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x557819290890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68c6575640 1 -- 10.20.193.4:0/1142668028 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578190fd310 con 0x55781924b820 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68c6575640 1 --2- 10.20.193.4:0/1142668028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x55781924bbf0 secure :-1 s=READY pgs=950 gs=1 cs=0 l=1 c_cookie=7018176026941871653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68bc004120 tx=0x7f68bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616591e9a1085625 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68acff9640 1 -- 10.20.193.4:0/1142668028 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68bc011e60 con 0x55781924b820 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68acff9640 1 -- 10.20.193.4:0/1142668028 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68bc01d940 con 0x55781924b820 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.187+0000 7f68acff9640 1 -- 10.20.193.4:0/1142668028 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68bc01ab50 con 0x55781924b820 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.188+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1142668028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 msgr2=0x55781924bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.188+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1142668028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x55781924bbf0 secure :-1 s=READY pgs=950 gs=1 cs=0 l=1 c_cookie=7018176026941871653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68bc004120 tx=0x7f68bc013000 comp rx=0 tx=0).stop 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.188+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1142668028 shutdown_connections 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.188+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1142668028 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557819290dd0 0x5578192b11b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.188+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1142668028 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x557819290890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.188+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1142668028 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x55781924bbf0 unknown :-1 s=CLOSED pgs=950 gs=1 cs=0 l=1 c_cookie=7018176026941871653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.188+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1142668028 >> 10.20.193.4:0/1142668028 conn(0x55781916a6b0 msgr2=0x55781924a100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.188+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1142668028 shutdown_connections 2026-02-24T09:15:36.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.188+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1142668028 wait complete. 2026-02-24T09:15:36.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68cebd9e00 1 -- start start 2026-02-24T09:15:36.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68cebd9e00 1 Processor -- start 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x557819263e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781924c130 0x557819264340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557819290dd0 0x557819269330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557819269870 con 0x55781924b820 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5578192699e0 con 0x557819290dd0 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557819269ba0 con 0x55781924c130 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68c6575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x557819263e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68c6575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x557819263e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52168/0 (socket says 10.20.193.4:52168) 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68c6575640 1 -- 10.20.193.4:0/4038189981 learned_addr learned my addr 10.20.193.4:0/4038189981 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.189+0000 7f68c5d74640 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781924c130 0x557819264340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68c6d76640 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557819290dd0 0x557819269330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68c6575640 1 -- 10.20.193.4:0/4038189981 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781924c130 msgr2=0x557819264340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68c6575640 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781924c130 0x557819264340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68c6575640 1 -- 10.20.193.4:0/4038189981 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557819290dd0 msgr2=0x557819269330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68c6575640 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557819290dd0 0x557819269330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68c6575640 1 -- 10.20.193.4:0/4038189981 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578190d58c0 con 0x55781924b820 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68c6575640 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x557819263e00 secure :-1 s=READY pgs=951 gs=1 cs=0 l=1 c_cookie=14349200130350986540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68bc011f50 tx=0x7f68bc011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c722997e448f352c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f6877fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f6877fff640 1 -- 10.20.193.4:0/4038189981 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68bc02c070 con 0x55781924b820 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f6877fff640 1 -- 10.20.193.4:0/4038189981 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68bc01aac0 con 0x55781924b820 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f6877fff640 1 -- 10.20.193.4:0/4038189981 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68bc027b00 con 0x55781924b820 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68cebd9e00 1 -- 10.20.193.4:0/4038189981 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68bc002e10 con 0x55781924b820 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f6877fff640 1 -- 10.20.193.4:0/4038189981 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f68bc027c90 con 0x55781924b820 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f6877fff640 10 client.17148 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68cebd9e00 10 client.17148 _ll_register_callbacks cb 0x5578190ed160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68cebd9e00 1 -- 10.20.193.4:0/4038189981 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557818ea14a0 con 0x55781924b820 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f6877fff640 1 -- 10.20.193.4:0/4038189981 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f68bc027e50 con 0x55781924b820 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68cebd9e00 10 client.17148 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.190+0000 7f68cebd9e00 1 -- 10.20.193.4:0/4038189981 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5578190e76e0 con 0x55781924b820 2026-02-24T09:15:36.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.191+0000 7f6877fff640 1 -- 10.20.193.4:0/4038189981 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f68bc039060 con 0x55781924b820 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.191+0000 7f68cebd9e00 10 client.17148 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.191+0000 7f68cebd9e00 10 client.17148 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.191+0000 7f68cebd9e00 20 client.17148 populate_metadata read hostname 'trial004' 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.191+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55781928e5c0 0x55781928ea60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.191+0000 7f68cebd9e00 4 client.17148 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.191+0000 7f68cebd9e00 1 -- 10.20.193.4:0/4038189981 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578191474f0 con 0x55781928e5c0 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.191+0000 7f68c5d74640 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55781928e5c0 0x55781928ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.191+0000 7f6877fff640 10 client.17148 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.191+0000 7f68c5d74640 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55781928e5c0 0x55781928ea60 crc :-1 s=READY pgs=141 gs=4 cs=0 l=0 c_cookie=1867953348360934811 s_cookie=2297062843014825943 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19ec4dac6a0e159b server_cookie=1fe0ce7c40a5c7d7 in_seq=0 out_seq=0 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f6877fff640 1 -- 10.20.193.4:0/4038189981 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5578191474f0 con 0x55781928e5c0 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f6877fff640 10 client.17148 handle_command_reply: tid=0 2026-02-24T09:15:36.194 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 client.17148 shutdown 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 -- 10.20.193.4:0/4038189981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 msgr2=0x557819263e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x557819263e00 secure :-1 s=READY pgs=951 gs=1 cs=0 l=1 c_cookie=14349200130350986540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68bc011f50 tx=0x7f68bc011f80 comp rx=0 tx=0).stop 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 -- 10.20.193.4:0/4038189981 shutdown_connections 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55781928e5c0 0x55781928ea60 crc :-1 s=READY pgs=141 gs=4 cs=0 l=0 c_cookie=1867953348360934811 s_cookie=2297062843014825943 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557819290dd0 0x557819269330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781924c130 0x557819264340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f6877fff640 0 client.17148 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/4038189981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x557819263e00 unknown :-1 s=CLOSED pgs=951 gs=1 cs=0 l=1 c_cookie=14349200130350986540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 -- 10.20.193.4:0/4038189981 >> 10.20.193.4:0/4038189981 conn(0x55781916a6b0 msgr2=0x55781924a810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 -- 10.20.193.4:0/4038189981 shutdown_connections 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 1 -- 10.20.193.4:0/4038189981 wait complete. 2026-02-24T09:15:36.195 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.192+0000 7f68cebd9e00 20 client.17148 trim_cache size 0 max 16384 2026-02-24T09:15:36.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.207+0000 7f68cebd9e00 1 Processor -- start 2026-02-24T09:15:36.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.207+0000 7f68cebd9e00 1 -- start start 2026-02-24T09:15:36.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.207+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x5578192611f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.207+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x557819261730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.207+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781928e5c0 0x55781924aa10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.207+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55781914f6e0 con 0x55781924b820 2026-02-24T09:15:36.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.207+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557818e1af50 con 0x55781924c130 2026-02-24T09:15:36.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.207+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5578191be150 con 0x55781928e5c0 2026-02-24T09:15:36.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c6575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x5578192611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c6575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x5578192611f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52182/0 (socket says 10.20.193.4:52182) 2026-02-24T09:15:36.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c6575640 1 -- 10.20.193.4:0/1263955083 learned_addr learned my addr 10.20.193.4:0/1263955083 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:36.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c5d74640 1 --2- 10.20.193.4:0/1263955083 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x557819261730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c6d76640 1 --2- 10.20.193.4:0/1263955083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781928e5c0 0x55781924aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c6575640 1 -- 10.20.193.4:0/1263955083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781928e5c0 msgr2=0x55781924aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:36.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c6575640 1 --2- 10.20.193.4:0/1263955083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781928e5c0 0x55781924aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c6575640 1 -- 10.20.193.4:0/1263955083 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 msgr2=0x557819261730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:36.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c6575640 1 --2- 10.20.193.4:0/1263955083 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x557819261730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c6575640 1 -- 10.20.193.4:0/1263955083 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557819290c40 con 0x55781924b820 2026-02-24T09:15:36.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c5d74640 1 --2- 10.20.193.4:0/1263955083 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x557819261730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68c6575640 1 --2- 10.20.193.4:0/1263955083 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x5578192611f0 secure :-1 s=READY pgs=952 gs=1 cs=0 l=1 c_cookie=7428825635618137866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68bc01a670 tx=0x7f68bc013020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67187d8e5555a70a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68924e6640 1 -- 10.20.193.4:0/1263955083 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68bc02c040 con 0x55781924b820 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68924e6640 1 -- 10.20.193.4:0/1263955083 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x557818ea14a0 con 0x55781924b820 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.208+0000 7f68924e6640 1 -- 10.20.193.4:0/1263955083 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68bc027880 con 0x55781924b820 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.209+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1263955083 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 msgr2=0x5578192611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.209+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1263955083 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x5578192611f0 secure :-1 s=READY pgs=952 gs=1 cs=0 l=1 c_cookie=7428825635618137866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68bc01a670 tx=0x7f68bc013020 comp rx=0 tx=0).stop 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.209+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1263955083 shutdown_connections 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.209+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1263955083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781928e5c0 0x55781924aa10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.209+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1263955083 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x557819261730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.209+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1263955083 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781924b820 0x5578192611f0 unknown :-1 s=CLOSED pgs=952 gs=1 cs=0 l=1 c_cookie=7428825635618137866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.209+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1263955083 >> 10.20.193.4:0/1263955083 conn(0x55781916a6b0 msgr2=0x55781924e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.209+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1263955083 shutdown_connections 2026-02-24T09:15:36.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.209+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1263955083 wait complete. 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68cebd9e00 1 -- start start 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68cebd9e00 1 Processor -- start 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781924b820 0x55781926a4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x55781926aa10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68cebd9e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781928e5c0 0x55781926f370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55781928ae70 con 0x55781928e5c0 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5578191bb3d0 con 0x55781924c130 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68cebd9e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5578191bf410 con 0x55781924b820 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c6d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781928e5c0 0x55781926f370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c6d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781928e5c0 0x55781926f370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52196/0 (socket says 10.20.193.4:52196) 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c6d76640 1 -- 10.20.193.4:0/1599959816 learned_addr learned my addr 10.20.193.4:0/1599959816 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c6575640 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781924b820 0x55781926a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c5d74640 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x55781926aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c6d76640 1 -- 10.20.193.4:0/1599959816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781924b820 msgr2=0x55781926a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c6d76640 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781924b820 0x55781926a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c6d76640 1 -- 10.20.193.4:0/1599959816 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 msgr2=0x55781926aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c6d76640 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x55781926aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c6d76640 1 -- 10.20.193.4:0/1599959816 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578190e76e0 con 0x55781928e5c0 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f68c6d76640 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781928e5c0 0x55781926f370 secure :-1 s=READY pgs=953 gs=1 cs=0 l=1 c_cookie=11018600041850495741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b8006c10 tx=0x7f68b8042410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e9ee5be89a62fd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f6877fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.210+0000 7f6877fff640 1 -- 10.20.193.4:0/1599959816 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68b80055c0 con 0x55781928e5c0 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1599959816 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b0003810 con 0x55781928e5c0 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f6877fff640 1 -- 10.20.193.4:0/1599959816 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f68b80d89a0 con 0x55781928e5c0 2026-02-24T09:15:36.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f6877fff640 1 -- 10.20.193.4:0/1599959816 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68b80ddbb0 con 0x55781928e5c0 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 10 client.17154 _ll_register_callbacks cb 0x5578190ed160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1599959816 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68bc01d940 con 0x55781928e5c0 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f6877fff640 1 -- 10.20.193.4:0/1599959816 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f68b809e2b0 con 0x55781928e5c0 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f6877fff640 1 -- 10.20.193.4:0/1599959816 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f68b8097d80 con 0x55781928e5c0 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 10 client.17154 fetch_fsmap learned FSMap version 19 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1599959816 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5578190e2160 con 0x55781928e5c0 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f6877fff640 1 -- 10.20.193.4:0/1599959816 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f68b80d0c60 con 0x55781928e5c0 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 10 client.17154 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 10 client.17154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 20 client.17154 populate_metadata read hostname 'trial004' 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557819290dd0 0x55781935e170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 4 client.17154 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:15:36.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1599959816 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557818e86160 con 0x557819290dd0 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.211+0000 7f68c6575640 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557819290dd0 0x55781935e170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f68c6575640 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557819290dd0 0x55781935e170 crc :-1 s=READY pgs=142 gs=4 cs=0 l=0 c_cookie=14552845717111049764 s_cookie=11798407658500648174 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f618134f780e24 server_cookie=a3bc5d41382decee in_seq=0 out_seq=0 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f6877fff640 10 client.17154 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f6877fff640 1 -- 10.20.193.4:0/1599959816 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x557818e86160 con 0x557819290dd0 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f6877fff640 10 client.17154 handle_command_reply: tid=0 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f68cebd9e00 1 client.17154 shutdown 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1599959816 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781928e5c0 msgr2=0x55781926f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781928e5c0 0x55781926f370 secure :-1 s=READY pgs=953 gs=1 cs=0 l=1 c_cookie=11018600041850495741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b8006c10 tx=0x7f68b8042410 comp rx=0 tx=0).stop 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1599959816 shutdown_connections 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557819290dd0 0x55781935e170 crc :-1 s=READY pgs=142 gs=4 cs=0 l=0 c_cookie=14552845717111049764 s_cookie=11798407658500648174 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55781928e5c0 0x55781926f370 unknown :-1 s=CLOSED pgs=953 gs=1 cs=0 l=1 c_cookie=11018600041850495741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55781924c130 0x55781926aa10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f68cebd9e00 1 --2- 10.20.193.4:0/1599959816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55781924b820 0x55781926a4d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f6877fff640 0 client.17154 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:15:36.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.212+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1599959816 >> 10.20.193.4:0/1599959816 conn(0x55781916a6b0 msgr2=0x5578192601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:36.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1599959816 shutdown_connections 2026-02-24T09:15:36.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68cebd9e00 1 -- 10.20.193.4:0/1599959816 wait complete. 2026-02-24T09:15:36.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68cebd9e00 20 client.17154 trim_cache size 0 max 16384 2026-02-24T09:15:36.222 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:15:36.222 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "8cb15914-baf4-40f4-a213-ea7a448da074", 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.223 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:15:36.224 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.225 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.226 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.227 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:15:36.228 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:15:36.229 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:15:36.230 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:15:36.230 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:15:36.230 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:15:36.230 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:15:36.230 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:15:36.230 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:36.230 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:15:36.230 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:15:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 -- 10.20.193.4:0/4198818378 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f68a00b56d0 msgr2=0x7f68a00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f68a00b56d0 0x7f68a00d5b80 secure :-1 s=READY pgs=381 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68bc004740 tx=0x7f68bc005f90 comp rx=0 tx=0).stop 2026-02-24T09:15:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 -- 10.20.193.4:0/4198818378 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f68c8112480 msgr2=0x7f68c80f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:15:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f68c8112480 0x7f68c80f55f0 secure :-1 s=READY pgs=949 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b800a330 tx=0x7f68b8003780 comp rx=0 tx=0).stop 2026-02-24T09:15:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 -- 10.20.193.4:0/4198818378 shutdown_connections 2026-02-24T09:15:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f68a00b56d0 0x7f68a00d5b80 unknown :-1 s=CLOSED pgs=381 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f68c8112480 0x7f68c80f55f0 unknown :-1 s=CLOSED pgs=949 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f68c810cc80 0x7f68c8172d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 --2- 10.20.193.4:0/4198818378 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f68c810c290 0x7f68c80f4ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:15:36.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 -- 10.20.193.4:0/4198818378 >> 10.20.193.4:0/4198818378 conn(0x7f68c80e9b80 msgr2=0x7f68c810a740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:15:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 -- 10.20.193.4:0/4198818378 shutdown_connections 2026-02-24T09:15:36.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:15:36.213+0000 7f68ccbdf640 1 -- 10.20.193.4:0/4198818378 wait complete. 2026-02-24T09:15:36.324 INFO:tasks.cephfs.filesystem:scrub status for tag:8cb15914-baf4-40f4-a213-ea7a448da074 - {'path': '/', 'tag': '8cb15914-baf4-40f4-a213-ea7a448da074', 'options': 'recursive,force'} 2026-02-24T09:15:37.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:36 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:15:37.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:36 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:37.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:36 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:15:37.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:36 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:37.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:36 trial004 ceph-mon[41596]: pgmap v326: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 802 MiB/s wr, 211 op/s 2026-02-24T09:15:37.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:36 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:15:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:36 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:36 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:15:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:36 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:36 trial090 ceph-mon[47278]: pgmap v326: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 802 MiB/s wr, 211 op/s 2026-02-24T09:15:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:36 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:15:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:36 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:36 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:15:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:36 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:15:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:36 trial014 ceph-mon[46941]: pgmap v326: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 802 MiB/s wr, 211 op/s 2026-02-24T09:15:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:38 trial004 ceph-mon[41596]: pgmap v327: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 856 MiB/s wr, 231 op/s 2026-02-24T09:15:39.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:38 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:15:39.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:38 trial090 ceph-mon[47278]: pgmap v327: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 856 MiB/s wr, 231 op/s 2026-02-24T09:15:39.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:38 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:15:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:38 trial014 ceph-mon[46941]: pgmap v327: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 856 MiB/s wr, 231 op/s 2026-02-24T09:15:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:38 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:15:41.145 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:40 trial014 ceph-mon[46941]: pgmap v328: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 750 MiB/s wr, 203 op/s 2026-02-24T09:15:41.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:40 trial004 ceph-mon[41596]: pgmap v328: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 750 MiB/s wr, 203 op/s 2026-02-24T09:15:41.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:40 trial090 ceph-mon[47278]: pgmap v328: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 750 MiB/s wr, 203 op/s 2026-02-24T09:15:43.134 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:42 trial090 ceph-mon[47278]: pgmap v329: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 637 MiB/s wr, 176 op/s 2026-02-24T09:15:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:42 trial004 ceph-mon[41596]: pgmap v329: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 637 MiB/s wr, 176 op/s 2026-02-24T09:15:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:42 trial014 ceph-mon[46941]: pgmap v329: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 637 MiB/s wr, 176 op/s 2026-02-24T09:15:45.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:44 trial004 ceph-mon[41596]: pgmap v330: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 361 MiB/s wr, 107 op/s 2026-02-24T09:15:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:44 trial090 ceph-mon[47278]: pgmap v330: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 361 MiB/s wr, 107 op/s 2026-02-24T09:15:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:44 trial014 ceph-mon[46941]: pgmap v330: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 361 MiB/s wr, 107 op/s 2026-02-24T09:15:47.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:46 trial004 ceph-mon[41596]: pgmap v331: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 242 MiB/s wr, 75 op/s 2026-02-24T09:15:47.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:46 trial090 ceph-mon[47278]: pgmap v331: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 242 MiB/s wr, 75 op/s 2026-02-24T09:15:47.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:46 trial014 ceph-mon[46941]: pgmap v331: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 242 MiB/s wr, 75 op/s 2026-02-24T09:15:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:48 trial004 ceph-mon[41596]: pgmap v332: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 315 MiB/s wr, 92 op/s 2026-02-24T09:15:49.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:48 trial090 ceph-mon[47278]: pgmap v332: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 315 MiB/s wr, 92 op/s 2026-02-24T09:15:49.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:48 trial014 ceph-mon[46941]: pgmap v332: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 315 MiB/s wr, 92 op/s 2026-02-24T09:15:51.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:50 trial004 ceph-mon[41596]: pgmap v333: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 399 MiB/s wr, 106 op/s 2026-02-24T09:15:51.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:50 trial090 ceph-mon[47278]: pgmap v333: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 399 MiB/s wr, 106 op/s 2026-02-24T09:15:51.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:50 trial014 ceph-mon[46941]: pgmap v333: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 399 MiB/s wr, 106 op/s 2026-02-24T09:15:53.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:52 trial004 ceph-mon[41596]: pgmap v334: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 671 MiB/s wr, 175 op/s 2026-02-24T09:15:53.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:52 trial090 ceph-mon[47278]: pgmap v334: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 671 MiB/s wr, 175 op/s 2026-02-24T09:15:53.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:52 trial014 ceph-mon[46941]: pgmap v334: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 8.0 KiB/s rd, 671 MiB/s wr, 175 op/s 2026-02-24T09:15:54.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:54 trial090 ceph-mon[47278]: pgmap v335: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 814 MiB/s wr, 218 op/s 2026-02-24T09:15:54.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:54 trial014 ceph-mon[46941]: pgmap v335: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 814 MiB/s wr, 218 op/s 2026-02-24T09:15:54.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:54 trial004 ceph-mon[41596]: pgmap v335: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 814 MiB/s wr, 218 op/s 2026-02-24T09:15:57.082 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:56 trial090 ceph-mon[47278]: pgmap v336: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 881 MiB/s wr, 238 op/s 2026-02-24T09:15:57.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:56 trial014 ceph-mon[46941]: pgmap v336: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 881 MiB/s wr, 238 op/s 2026-02-24T09:15:57.168 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:56 trial004 ceph-mon[41596]: pgmap v336: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 881 MiB/s wr, 238 op/s 2026-02-24T09:15:59.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:15:58 trial090 ceph-mon[47278]: pgmap v337: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 849 MiB/s wr, 235 op/s 2026-02-24T09:15:59.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:15:58 trial014 ceph-mon[46941]: pgmap v337: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 849 MiB/s wr, 235 op/s 2026-02-24T09:15:59.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:15:58 trial004 ceph-mon[41596]: pgmap v337: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 849 MiB/s wr, 235 op/s 2026-02-24T09:16:01.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:00 trial014 ceph-mon[46941]: pgmap v338: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 719 MiB/s wr, 201 op/s 2026-02-24T09:16:01.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:00 trial004 ceph-mon[41596]: pgmap v338: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 719 MiB/s wr, 201 op/s 2026-02-24T09:16:01.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:00 trial090 ceph-mon[47278]: pgmap v338: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 719 MiB/s wr, 201 op/s 2026-02-24T09:16:03.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:02 trial014 ceph-mon[46941]: pgmap v339: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 49 KiB/s rd, 781 MiB/s wr, 218 op/s 2026-02-24T09:16:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:02 trial004 ceph-mon[41596]: pgmap v339: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 49 KiB/s rd, 781 MiB/s wr, 218 op/s 2026-02-24T09:16:03.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:02 trial090 ceph-mon[47278]: pgmap v339: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 49 KiB/s rd, 781 MiB/s wr, 218 op/s 2026-02-24T09:16:05.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:04 trial014 ceph-mon[46941]: pgmap v340: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 699 MiB/s wr, 197 op/s 2026-02-24T09:16:05.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:04 trial004 ceph-mon[41596]: pgmap v340: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 699 MiB/s wr, 197 op/s 2026-02-24T09:16:05.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:04 trial090 ceph-mon[47278]: pgmap v340: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 699 MiB/s wr, 197 op/s 2026-02-24T09:16:06.325 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:16:06.482 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.638+0000 7f40e3e68640 1 -- 10.20.193.4:0/2022304729 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40dc112480 msgr2=0x7f40dc172e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.638+0000 7f40e3e68640 1 --2- 10.20.193.4:0/2022304729 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40dc112480 0x7f40dc172e50 secure :-1 s=READY pgs=954 gs=1 cs=0 l=1 c_cookie=10647965122652481536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d800aa30 tx=0x7f40d8030280 comp rx=0 tx=0).stop 2026-02-24T09:16:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.638+0000 7f40e3e68640 1 -- 10.20.193.4:0/2022304729 shutdown_connections 2026-02-24T09:16:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.638+0000 7f40e3e68640 1 --2- 10.20.193.4:0/2022304729 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40dc112480 0x7f40dc172e50 unknown :-1 s=CLOSED pgs=954 gs=1 cs=0 l=1 c_cookie=10647965122652481536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.638+0000 7f40e3e68640 1 --2- 10.20.193.4:0/2022304729 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f40dc10cc80 0x7f40dc111cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.638+0000 7f40e3e68640 1 --2- 10.20.193.4:0/2022304729 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f40dc10c290 0x7f40dc10c660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.638+0000 7f40e3e68640 1 -- 10.20.193.4:0/2022304729 >> 10.20.193.4:0/2022304729 conn(0x7f40dc0e9b80 msgr2=0x7f40dc109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.638+0000 7f40e3e68640 1 -- 10.20.193.4:0/2022304729 shutdown_connections 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.638+0000 7f40e3e68640 1 -- 10.20.193.4:0/2022304729 wait complete. 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e3e68640 1 Processor -- start 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e3e68640 1 -- start start 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e3e68640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f40dc10c290 0x7f40dc114fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e3e68640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f40dc10cc80 0x7f40dc115520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e3e68640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40dc112480 0x7f40dc11a8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e3e68640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc11af10 con 0x7f40dc112480 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e3e68640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc11b080 con 0x7f40dc10c290 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e3e68640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc11b240 con 0x7f40dc10cc80 2026-02-24T09:16:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e23de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40dc112480 0x7f40dc11a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e23de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40dc112480 0x7f40dc11a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38868/0 (socket says 10.20.193.4:38868) 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e23de640 1 -- 10.20.193.4:0/1763886616 learned_addr learned my addr 10.20.193.4:0/1763886616 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e23de640 1 -- 10.20.193.4:0/1763886616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f40dc10cc80 msgr2=0x7f40dc115520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e23de640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f40dc10cc80 0x7f40dc115520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e23de640 1 -- 10.20.193.4:0/1763886616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f40dc10c290 msgr2=0x7f40dc114fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e23de640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f40dc10c290 0x7f40dc114fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e23de640 1 -- 10.20.193.4:0/1763886616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d800a650 con 0x7f40dc112480 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e23de640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40dc112480 0x7f40dc11a8f0 secure :-1 s=READY pgs=955 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d800a330 tx=0x7f40d80039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40caffd640 1 -- 10.20.193.4:0/1763886616 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40d803e070 con 0x7f40dc112480 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e3e68640 1 -- 10.20.193.4:0/1763886616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40dc11b4c0 con 0x7f40dc112480 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40e3e68640 1 -- 10.20.193.4:0/1763886616 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40dc15bc20 con 0x7f40dc112480 2026-02-24T09:16:06.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40caffd640 1 -- 10.20.193.4:0/1763886616 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40d80055a0 con 0x7f40dc112480 2026-02-24T09:16:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.639+0000 7f40caffd640 1 -- 10.20.193.4:0/1763886616 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40d8042820 con 0x7f40dc112480 2026-02-24T09:16:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.643+0000 7f40caffd640 1 -- 10.20.193.4:0/1763886616 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f40d80050c0 con 0x7f40dc112480 2026-02-24T09:16:06.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.643+0000 7f40caffd640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40b80b5760 0x7f40b80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.643+0000 7f40caffd640 1 -- 10.20.193.4:0/1763886616 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f40d810c930 con 0x7f40dc112480 2026-02-24T09:16:06.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.643+0000 7f40e1bdd640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40b80b5760 0x7f40b80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.644+0000 7f40e1bdd640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40b80b5760 0x7f40b80d5c10 secure :-1 s=READY pgs=382 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40cc004740 tx=0x7f40cc009690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:06.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.647+0000 7f40e5e62e00 1 Processor -- start 2026-02-24T09:16:06.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.647+0000 7f40e5e62e00 1 -- start start 2026-02-24T09:16:06.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d00bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d45dd0 0x55a3a5d661b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5c10de0 con 0x55a3a5d01130 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5c0cb10 con 0x55a3a5d45dd0 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5c06ab0 con 0x55a3a5d00820 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e13dc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e13dc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38880/0 (socket says 10.20.193.4:38880) 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e13dc640 1 -- 10.20.193.4:0/1715874523 learned_addr learned my addr 10.20.193.4:0/1715874523 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e1bdd640 1 --2- 10.20.193.4:0/1715874523 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d00bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e23de640 1 --2- 10.20.193.4:0/1715874523 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d45dd0 0x55a3a5d661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e13dc640 1 -- 10.20.193.4:0/1715874523 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 msgr2=0x55a3a5d00bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e13dc640 1 --2- 10.20.193.4:0/1715874523 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d00bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e13dc640 1 -- 10.20.193.4:0/1715874523 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d45dd0 msgr2=0x55a3a5d661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:06.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e13dc640 1 --2- 10.20.193.4:0/1715874523 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d45dd0 0x55a3a5d661b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e13dc640 1 -- 10.20.193.4:0/1715874523 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a5bb2310 con 0x55a3a5d01130 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40e13dc640 1 --2- 10.20.193.4:0/1715874523 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45890 secure :-1 s=READY pgs=956 gs=1 cs=0 l=1 c_cookie=3888897090038469701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d000bb00 tx=0x7f40d000d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f8234c93cb1445 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40aa4e6640 1 -- 10.20.193.4:0/1715874523 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40d000dcb0 con 0x55a3a5d01130 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40aa4e6640 1 -- 10.20.193.4:0/1715874523 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40d000de10 con 0x55a3a5d01130 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.648+0000 7f40aa4e6640 1 -- 10.20.193.4:0/1715874523 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40d0010770 con 0x55a3a5d01130 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.649+0000 7f40e5e62e00 1 -- 10.20.193.4:0/1715874523 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 msgr2=0x55a3a5d45890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.649+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/1715874523 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45890 secure :-1 s=READY pgs=956 gs=1 cs=0 l=1 c_cookie=3888897090038469701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d000bb00 tx=0x7f40d000d2e0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.649+0000 7f40e5e62e00 1 -- 10.20.193.4:0/1715874523 shutdown_connections 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.649+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/1715874523 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d45dd0 0x55a3a5d661b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.649+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/1715874523 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45890 unknown :-1 s=CLOSED pgs=956 gs=1 cs=0 l=1 c_cookie=3888897090038469701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.649+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/1715874523 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d00bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.649+0000 7f40e5e62e00 1 -- 10.20.193.4:0/1715874523 >> 10.20.193.4:0/1715874523 conn(0x55a3a5c1f6b0 msgr2=0x55a3a5cff100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:06.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.649+0000 7f40e5e62e00 1 -- 10.20.193.4:0/1715874523 shutdown_connections 2026-02-24T09:16:06.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.649+0000 7f40e5e62e00 1 -- 10.20.193.4:0/1715874523 wait complete. 2026-02-24T09:16:06.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.650+0000 7f40e5e62e00 1 -- start start 2026-02-24T09:16:06.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.650+0000 7f40e5e62e00 1 Processor -- start 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d00820 0x55a3a5d18dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d19300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d45dd0 0x55a3a5d1e2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5d1e830 con 0x55a3a5d01130 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5d1e9a0 con 0x55a3a5d00820 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5d1eb60 con 0x55a3a5d45dd0 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e13dc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d19300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e13dc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d19300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38888/0 (socket says 10.20.193.4:38888) 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e13dc640 1 -- 10.20.193.4:0/518855105 learned_addr learned my addr 10.20.193.4:0/518855105 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e1bdd640 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d00820 0x55a3a5d18dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e23de640 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d45dd0 0x55a3a5d1e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e13dc640 1 -- 10.20.193.4:0/518855105 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d45dd0 msgr2=0x55a3a5d1e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e13dc640 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d45dd0 0x55a3a5d1e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e13dc640 1 -- 10.20.193.4:0/518855105 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d00820 msgr2=0x55a3a5d18dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e13dc640 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d00820 0x55a3a5d18dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e13dc640 1 -- 10.20.193.4:0/518855105 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a5b8a8c0 con 0x55a3a5d01130 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e23de640 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d45dd0 0x55a3a5d1e2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e13dc640 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d19300 secure :-1 s=READY pgs=957 gs=1 cs=0 l=1 c_cookie=14368605129130526724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d00047b0 tx=0x7f40d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7678a3c9fae4804 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40977fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40977fe640 1 -- 10.20.193.4:0/518855105 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40d00106e0 con 0x55a3a5d01130 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 1 -- 10.20.193.4:0/518855105 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d000b720 con 0x55a3a5d01130 2026-02-24T09:16:06.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40977fe640 1 -- 10.20.193.4:0/518855105 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40d00040d0 con 0x55a3a5d01130 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40977fe640 1 -- 10.20.193.4:0/518855105 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40d0010e80 con 0x55a3a5d01130 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 10 client.17166 _ll_register_callbacks cb 0x55a3a5ba2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 1 -- 10.20.193.4:0/518855105 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3a59564a0 con 0x55a3a5d01130 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40977fe640 1 -- 10.20.193.4:0/518855105 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f40d001b480 con 0x55a3a5d01130 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40977fe640 1 -- 10.20.193.4:0/518855105 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f40d001b720 con 0x55a3a5d01130 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 10 client.17166 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.651+0000 7f40e5e62e00 1 -- 10.20.193.4:0/518855105 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55a3a5b9c6e0 con 0x55a3a5d01130 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.652+0000 7f40977fe640 1 -- 10.20.193.4:0/518855105 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f40d002c060 con 0x55a3a5d01130 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.652+0000 7f40e5e62e00 10 client.17166 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.652+0000 7f40e5e62e00 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.652+0000 7f40e5e62e00 20 client.17166 populate_metadata read hostname 'trial004' 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.652+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a3a5d435e0 0x55a3a5d43a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.652+0000 7f40e5e62e00 4 client.17166 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.652+0000 7f40e5e62e00 1 -- 10.20.193.4:0/518855105 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3a5bfc4f0 con 0x55a3a5d435e0 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.652+0000 7f40e1bdd640 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a3a5d435e0 0x55a3a5d43a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e1bdd640 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a3a5d435e0 0x55a3a5d43a80 crc :-1 s=READY pgs=143 gs=4 cs=0 l=0 c_cookie=3162547721863233064 s_cookie=16240162580256939946 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2be3a065aae0fe28 server_cookie=e160a5d29ace5faa in_seq=0 out_seq=0 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40977fe640 10 client.17166 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40977fe640 1 -- 10.20.193.4:0/518855105 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a3a5bfc4f0 con 0x55a3a5d435e0 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40977fe640 10 client.17166 handle_command_reply: tid=0 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 client.17166 shutdown 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 -- 10.20.193.4:0/518855105 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 msgr2=0x55a3a5d19300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d19300 secure :-1 s=READY pgs=957 gs=1 cs=0 l=1 c_cookie=14368605129130526724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d00047b0 tx=0x7f40d000dcc0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 -- 10.20.193.4:0/518855105 shutdown_connections 2026-02-24T09:16:06.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a3a5d435e0 0x55a3a5d43a80 crc :-1 s=READY pgs=143 gs=4 cs=0 l=0 c_cookie=3162547721863233064 s_cookie=16240162580256939946 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d45dd0 0x55a3a5d1e2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40977fe640 0 client.17166 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:06.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d19300 unknown :-1 s=CLOSED pgs=957 gs=1 cs=0 l=1 c_cookie=14368605129130526724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/518855105 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d00820 0x55a3a5d18dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 -- 10.20.193.4:0/518855105 >> 10.20.193.4:0/518855105 conn(0x55a3a5c1f6b0 msgr2=0x55a3a5cff810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:06.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 -- 10.20.193.4:0/518855105 shutdown_connections 2026-02-24T09:16:06.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.653+0000 7f40e5e62e00 1 -- 10.20.193.4:0/518855105 wait complete. 2026-02-24T09:16:06.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.654+0000 7f40e5e62e00 20 client.17166 trim_cache size 0 max 16384 2026-02-24T09:16:06.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e5e62e00 1 Processor -- start 2026-02-24T09:16:06.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e5e62e00 1 -- start start 2026-02-24T09:16:06.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d036e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d435e0 0x55a3a5cffa10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5c046e0 con 0x55a3a5d01130 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a3a58cff50 con 0x55a3a5d435e0 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5c73150 con 0x55a3a5d00820 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e13dc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e13dc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38898/0 (socket says 10.20.193.4:38898) 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e13dc640 1 -- 10.20.193.4:0/964885172 learned_addr learned my addr 10.20.193.4:0/964885172 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e1bdd640 1 --2- 10.20.193.4:0/964885172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d036e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e13dc640 1 -- 10.20.193.4:0/964885172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 msgr2=0x55a3a5d036e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e13dc640 1 --2- 10.20.193.4:0/964885172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d036e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.665+0000 7f40e13dc640 1 -- 10.20.193.4:0/964885172 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d435e0 msgr2=0x55a3a5cffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.666+0000 7f40e13dc640 1 --2- 10.20.193.4:0/964885172 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d435e0 0x55a3a5cffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.666+0000 7f40e13dc640 1 -- 10.20.193.4:0/964885172 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a5b97160 con 0x55a3a5d01130 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.666+0000 7f40e13dc640 1 --2- 10.20.193.4:0/964885172 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45370 secure :-1 s=READY pgs=958 gs=1 cs=0 l=1 c_cookie=5175232004998006341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d001bbf0 tx=0x7f40d000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d21e16c8238645 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:06.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.666+0000 7f40a9ce5640 1 -- 10.20.193.4:0/964885172 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40d000da90 con 0x55a3a5d01130 2026-02-24T09:16:06.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.666+0000 7f40a9ce5640 1 -- 10.20.193.4:0/964885172 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40d0033070 con 0x55a3a5d01130 2026-02-24T09:16:06.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.666+0000 7f40a9ce5640 1 -- 10.20.193.4:0/964885172 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40d0002a60 con 0x55a3a5d01130 2026-02-24T09:16:06.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 -- 10.20.193.4:0/964885172 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 msgr2=0x55a3a5d45370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:06.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/964885172 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45370 secure :-1 s=READY pgs=958 gs=1 cs=0 l=1 c_cookie=5175232004998006341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d001bbf0 tx=0x7f40d000bfd0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 -- 10.20.193.4:0/964885172 shutdown_connections 2026-02-24T09:16:06.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/964885172 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d435e0 0x55a3a5cffa10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/964885172 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d01130 0x55a3a5d45370 unknown :-1 s=CLOSED pgs=958 gs=1 cs=0 l=1 c_cookie=5175232004998006341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/964885172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d036e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 -- 10.20.193.4:0/964885172 >> 10.20.193.4:0/964885172 conn(0x55a3a5c1f6b0 msgr2=0x55a3a5d17790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 -- 10.20.193.4:0/964885172 shutdown_connections 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 -- 10.20.193.4:0/964885172 wait complete. 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 -- start start 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.667+0000 7f40e5e62e00 1 Processor -- start 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d208b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d01130 0x55a3a5d20df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d435e0 0x55a3a5dab2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5d215c0 con 0x55a3a5d435e0 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5d21730 con 0x55a3a5d01130 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a3a5dab860 con 0x55a3a5d00820 2026-02-24T09:16:06.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e23de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d435e0 0x55a3a5dab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e23de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d435e0 0x55a3a5dab2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38910/0 (socket says 10.20.193.4:38910) 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e23de640 1 -- 10.20.193.4:0/3108269691 learned_addr learned my addr 10.20.193.4:0/3108269691 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e13dc640 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d01130 0x55a3a5d20df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e1bdd640 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e23de640 1 -- 10.20.193.4:0/3108269691 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 msgr2=0x55a3a5d208b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e23de640 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d208b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e23de640 1 -- 10.20.193.4:0/3108269691 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d01130 msgr2=0x55a3a5d20df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e23de640 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d01130 0x55a3a5d20df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e23de640 1 -- 10.20.193.4:0/3108269691 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a5b8abf0 con 0x55a3a5d435e0 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e23de640 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d435e0 0x55a3a5dab2f0 secure :-1 s=READY pgs=959 gs=1 cs=0 l=1 c_cookie=10746551441722116965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d80cff10 tx=0x7f40d80d2680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95236b993c4f0b65 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40977fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:06.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40977fe640 1 -- 10.20.193.4:0/3108269691 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40d80d3b50 con 0x55a3a5d435e0 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 1 -- 10.20.193.4:0/3108269691 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3a5b9c6e0 con 0x55a3a5d435e0 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40977fe640 1 -- 10.20.193.4:0/3108269691 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f40d80d89c0 con 0x55a3a5d435e0 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40977fe640 1 -- 10.20.193.4:0/3108269691 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40d8097e30 con 0x55a3a5d435e0 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 10 client.17172 _ll_register_callbacks cb 0x55a3a5ba2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 1 -- 10.20.193.4:0/3108269691 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3a58946f0 con 0x55a3a5d435e0 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40977fe640 1 -- 10.20.193.4:0/3108269691 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f40d8097f90 con 0x55a3a5d435e0 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40977fe640 1 -- 10.20.193.4:0/3108269691 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f40d80d0c80 con 0x55a3a5d435e0 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 10 client.17172 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.668+0000 7f40e5e62e00 1 -- 10.20.193.4:0/3108269691 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55a3a5b9c940 con 0x55a3a5d435e0 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40977fe640 1 -- 10.20.193.4:0/3108269691 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f40d80d4690 con 0x55a3a5d435e0 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e5e62e00 10 client.17172 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e5e62e00 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:06.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e5e62e00 20 client.17172 populate_metadata read hostname 'trial004' 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a3a5d45dd0 0x55a3a5e13850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e5e62e00 4 client.17172 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e5e62e00 1 -- 10.20.193.4:0/3108269691 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a3a5891f40 con 0x55a3a5d45dd0 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e1bdd640 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a3a5d45dd0 0x55a3a5e13850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e1bdd640 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a3a5d45dd0 0x55a3a5e13850 crc :-1 s=READY pgs=144 gs=4 cs=0 l=0 c_cookie=16007772042796568474 s_cookie=8218393107100167518 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de2707dc30518f9a server_cookie=720d98fced396d5e in_seq=0 out_seq=0 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40977fe640 10 client.17172 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40977fe640 1 -- 10.20.193.4:0/3108269691 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x55a3a5891f40 con 0x55a3a5d45dd0 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40977fe640 10 client.17172 handle_command_reply: tid=0 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e5e62e00 1 client.17172 shutdown 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e5e62e00 1 -- 10.20.193.4:0/3108269691 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d435e0 msgr2=0x55a3a5dab2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.669+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d435e0 0x55a3a5dab2f0 secure :-1 s=READY pgs=959 gs=1 cs=0 l=1 c_cookie=10746551441722116965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d80cff10 tx=0x7f40d80d2680 comp rx=0 tx=0).stop 2026-02-24T09:16:06.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e5e62e00 1 -- 10.20.193.4:0/3108269691 shutdown_connections 2026-02-24T09:16:06.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55a3a5d45dd0 0x55a3a5e13850 crc :-1 s=READY pgs=144 gs=4 cs=0 l=0 c_cookie=16007772042796568474 s_cookie=8218393107100167518 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a3a5d435e0 0x55a3a5dab2f0 unknown :-1 s=CLOSED pgs=959 gs=1 cs=0 l=1 c_cookie=10746551441722116965 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40977fe640 0 client.17172 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:06.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a3a5d01130 0x55a3a5d20df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e5e62e00 1 --2- 10.20.193.4:0/3108269691 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a3a5d00820 0x55a3a5d208b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e5e62e00 1 -- 10.20.193.4:0/3108269691 >> 10.20.193.4:0/3108269691 conn(0x55a3a5c1f6b0 msgr2=0x55a3a5d44360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:06.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e5e62e00 1 -- 10.20.193.4:0/3108269691 shutdown_connections 2026-02-24T09:16:06.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e5e62e00 1 -- 10.20.193.4:0/3108269691 wait complete. 2026-02-24T09:16:06.681 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e5e62e00 20 client.17172 trim_cache size 0 max 16384 2026-02-24T09:16:06.682 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:16:06.682 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:16:06.682 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:16:06.682 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:16:06.682 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:16:06.682 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:16:06.682 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.682 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.682 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.682 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:16:06.683 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:16:06.685 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.686 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.688 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:06.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:06.690 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:06.690 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:16:06.690 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:16:06.690 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:16:06.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 -- 10.20.193.4:0/1763886616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40b80b5760 msgr2=0x7f40b80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:06.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40b80b5760 0x7f40b80d5c10 secure :-1 s=READY pgs=382 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40cc004740 tx=0x7f40cc009690 comp rx=0 tx=0).stop 2026-02-24T09:16:06.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 -- 10.20.193.4:0/1763886616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40dc112480 msgr2=0x7f40dc11a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:06.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40dc112480 0x7f40dc11a8f0 secure :-1 s=READY pgs=955 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40d800a330 tx=0x7f40d80039b0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 -- 10.20.193.4:0/1763886616 shutdown_connections 2026-02-24T09:16:06.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f40b80b5760 0x7f40b80d5c10 unknown :-1 s=CLOSED pgs=382 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f40dc112480 0x7f40dc11a8f0 unknown :-1 s=CLOSED pgs=955 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f40dc10cc80 0x7f40dc115520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 --2- 10.20.193.4:0/1763886616 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f40dc10c290 0x7f40dc114fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:06.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 -- 10.20.193.4:0/1763886616 >> 10.20.193.4:0/1763886616 conn(0x7f40dc0e9b80 msgr2=0x7f40dc109f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:06.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 -- 10.20.193.4:0/1763886616 shutdown_connections 2026-02-24T09:16:06.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:06.670+0000 7f40e3e68640 1 -- 10.20.193.4:0/1763886616 wait complete. 2026-02-24T09:16:06.742 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:16:06.743 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:16:06.904 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:06.933 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:06 trial004 ceph-mon[41596]: pgmap v341: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 710 MiB/s wr, 194 op/s 2026-02-24T09:16:07.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.070+0000 7f7045344640 1 -- 10.20.193.4:0/1957268852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f704010d010 msgr2=0x7f704010d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.070+0000 7f7045344640 1 --2- 10.20.193.4:0/1957268852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f704010d010 0x7f704010d3e0 secure :-1 s=READY pgs=960 gs=1 cs=0 l=1 c_cookie=4549208530044440000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7034009950 tx=0x7f703402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.070+0000 7f7045344640 1 -- 10.20.193.4:0/1957268852 shutdown_connections 2026-02-24T09:16:07.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.070+0000 7f7045344640 1 --2- 10.20.193.4:0/1957268852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7040113200 0x7f7040173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.070+0000 7f7045344640 1 --2- 10.20.193.4:0/1957268852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f704010da00 0x7f7040112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.070+0000 7f7045344640 1 --2- 10.20.193.4:0/1957268852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f704010d010 0x7f704010d3e0 unknown :-1 s=CLOSED pgs=960 gs=1 cs=0 l=1 c_cookie=4549208530044440000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.070+0000 7f7045344640 1 -- 10.20.193.4:0/1957268852 >> 10.20.193.4:0/1957268852 conn(0x7f704005f830 msgr2=0x7f704010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:07.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.070+0000 7f7045344640 1 -- 10.20.193.4:0/1957268852 shutdown_connections 2026-02-24T09:16:07.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.070+0000 7f7045344640 1 -- 10.20.193.4:0/1957268852 wait complete. 2026-02-24T09:16:07.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f7045344640 1 Processor -- start 2026-02-24T09:16:07.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f7045344640 1 -- start start 2026-02-24T09:16:07.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f7045344640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f704010d010 0x7f70400f56a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f7045344640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f704010da00 0x7f7040173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f7045344640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7040113200 0x7f70400f5da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f7045344640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f70400faf60 con 0x7f704010d010 2026-02-24T09:16:07.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f7045344640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f70400fb0d0 con 0x7f704010da00 2026-02-24T09:16:07.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f7045344640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f70400fb290 con 0x7f7040113200 2026-02-24T09:16:07.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f703effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f704010d010 0x7f70400f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f703effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f704010d010 0x7f70400f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38932/0 (socket says 10.20.193.4:38932) 2026-02-24T09:16:07.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f703effd640 1 -- 10.20.193.4:0/4207539583 learned_addr learned my addr 10.20.193.4:0/4207539583 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:07.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f703effd640 1 -- 10.20.193.4:0/4207539583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7040113200 msgr2=0x7f70400f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f703effd640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7040113200 0x7f70400f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f703effd640 1 -- 10.20.193.4:0/4207539583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f704010da00 msgr2=0x7f7040173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f703effd640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f704010da00 0x7f7040173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f703effd640 1 -- 10.20.193.4:0/4207539583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7034009570 con 0x7f704010d010 2026-02-24T09:16:07.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f703effd640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f704010d010 0x7f70400f56a0 secure :-1 s=READY pgs=961 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70340023d0 tx=0x7f70340043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:07.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f701ffff640 1 -- 10.20.193.4:0/4207539583 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f703403d070 con 0x7f704010d010 2026-02-24T09:16:07.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f7045344640 1 -- 10.20.193.4:0/4207539583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70400fb510 con 0x7f704010d010 2026-02-24T09:16:07.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f701ffff640 1 -- 10.20.193.4:0/4207539583 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7034038920 con 0x7f704010d010 2026-02-24T09:16:07.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f701ffff640 1 -- 10.20.193.4:0/4207539583 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7034041960 con 0x7f704010d010 2026-02-24T09:16:07.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.071+0000 7f7045344640 1 -- 10.20.193.4:0/4207539583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70400fb9d0 con 0x7f704010d010 2026-02-24T09:16:07.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.072+0000 7f7045344640 1 -- 10.20.193.4:0/4207539583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f704010e2f0 con 0x7f704010d010 2026-02-24T09:16:07.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.074+0000 7f701ffff640 1 -- 10.20.193.4:0/4207539583 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f7034038a90 con 0x7f704010d010 2026-02-24T09:16:07.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.075+0000 7f701ffff640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70140b56d0 0x7f70140d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.075+0000 7f701ffff640 1 -- 10.20.193.4:0/4207539583 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f703410ba40 con 0x7f704010d010 2026-02-24T09:16:07.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.075+0000 7f703e7fc640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70140b56d0 0x7f70140d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.076+0000 7f703e7fc640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70140b56d0 0x7f70140d5b80 secure :-1 s=READY pgs=383 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7028005970 tx=0x7f7028005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:07.081 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.076+0000 7f701ffff640 1 -- 10.20.193.4:0/4207539583 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f70340ce3c0 con 0x7f704010d010 2026-02-24T09:16:07.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.238+0000 7f7045344640 1 -- 10.20.193.4:0/4207539583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f704010d3e0 con 0x7f704010d010 2026-02-24T09:16:07.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.239+0000 7f701ffff640 1 -- 10.20.193.4:0/4207539583 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f70340d1570 con 0x7f704010d010 2026-02-24T09:16:07.244 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:16:07.244 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:16:07.244 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:16:07.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.244+0000 7f7045344640 1 -- 10.20.193.4:0/4207539583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70140b56d0 msgr2=0x7f70140d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.244+0000 7f7045344640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70140b56d0 0x7f70140d5b80 secure :-1 s=READY pgs=383 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7028005970 tx=0x7f7028005900 comp rx=0 tx=0).stop 2026-02-24T09:16:07.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.244+0000 7f7045344640 1 -- 10.20.193.4:0/4207539583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f704010d010 msgr2=0x7f70400f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.244+0000 7f7045344640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f704010d010 0x7f70400f56a0 secure :-1 s=READY pgs=961 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70340023d0 tx=0x7f70340043d0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.245+0000 7f7045344640 1 -- 10.20.193.4:0/4207539583 shutdown_connections 2026-02-24T09:16:07.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.245+0000 7f7045344640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70140b56d0 0x7f70140d5b80 unknown :-1 s=CLOSED pgs=383 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.245+0000 7f7045344640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7040113200 0x7f70400f5da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.245+0000 7f7045344640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f704010da00 0x7f7040173ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.245+0000 7f7045344640 1 --2- 10.20.193.4:0/4207539583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f704010d010 0x7f70400f56a0 unknown :-1 s=CLOSED pgs=961 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.245+0000 7f7045344640 1 -- 10.20.193.4:0/4207539583 >> 10.20.193.4:0/4207539583 conn(0x7f704005f830 msgr2=0x7f70401101c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:07.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.245+0000 7f7045344640 1 -- 10.20.193.4:0/4207539583 shutdown_connections 2026-02-24T09:16:07.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.245+0000 7f7045344640 1 -- 10.20.193.4:0/4207539583 wait complete. 2026-02-24T09:16:07.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:06 trial090 ceph-mon[47278]: pgmap v341: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 710 MiB/s wr, 194 op/s 2026-02-24T09:16:07.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:06 trial014 ceph-mon[46941]: pgmap v341: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 710 MiB/s wr, 194 op/s 2026-02-24T09:16:07.359 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:16:07.521 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 -- 10.20.193.4:0/3315685042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f217c110040 msgr2=0x7f217c115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 --2- 10.20.193.4:0/3315685042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f217c110040 0x7f217c115090 secure :-1 s=READY pgs=962 gs=1 cs=0 l=1 c_cookie=8997745887449341845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2164009950 tx=0x7f216402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 -- 10.20.193.4:0/3315685042 shutdown_connections 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 --2- 10.20.193.4:0/3315685042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f217c115840 0x7f217c176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 --2- 10.20.193.4:0/3315685042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f217c110040 0x7f217c115090 unknown :-1 s=CLOSED pgs=962 gs=1 cs=0 l=1 c_cookie=8997745887449341845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 --2- 10.20.193.4:0/3315685042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f217c10f650 0x7f217c10fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 -- 10.20.193.4:0/3315685042 >> 10.20.193.4:0/3315685042 conn(0x7f217c0ecf20 msgr2=0x7f217c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 -- 10.20.193.4:0/3315685042 shutdown_connections 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 -- 10.20.193.4:0/3315685042 wait complete. 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 Processor -- start 2026-02-24T09:16:07.682 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.678+0000 7f2182bfc640 1 -- start start 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2182bfc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f217c10f650 0x7f217c0f58d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2182bfc640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f217c110040 0x7f217c176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2182bfc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f217c115840 0x7f217c0f5fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2182bfc640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0fb190 con 0x7f217c10f650 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2182bfc640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0fb300 con 0x7f217c110040 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2182bfc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0fb4c0 con 0x7f217c115840 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2180971640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f217c10f650 0x7f217c0f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2180971640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f217c10f650 0x7f217c0f58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38944/0 (socket says 10.20.193.4:38944) 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2180971640 1 -- 10.20.193.4:0/4035525007 learned_addr learned my addr 10.20.193.4:0/4035525007 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2181172640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f217c115840 0x7f217c0f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2173fff640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f217c110040 0x7f217c176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2180971640 1 -- 10.20.193.4:0/4035525007 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f217c115840 msgr2=0x7f217c0f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2180971640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f217c115840 0x7f217c0f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2180971640 1 -- 10.20.193.4:0/4035525007 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f217c110040 msgr2=0x7f217c176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2180971640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f217c110040 0x7f217c176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2180971640 1 -- 10.20.193.4:0/4035525007 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2164009570 con 0x7f217c10f650 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2180971640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f217c10f650 0x7f217c0f58d0 secure :-1 s=READY pgs=963 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f216c00d950 tx=0x7f216c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2171ffb640 1 -- 10.20.193.4:0/4035525007 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f216c004540 con 0x7f217c10f650 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2182bfc640 1 -- 10.20.193.4:0/4035525007 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c0fb7a0 con 0x7f217c10f650 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2171ffb640 1 -- 10.20.193.4:0/4035525007 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f216c009d00 con 0x7f217c10f650 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2171ffb640 1 -- 10.20.193.4:0/4035525007 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f216c0106e0 con 0x7f217c10f650 2026-02-24T09:16:07.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.679+0000 7f2182bfc640 1 -- 10.20.193.4:0/4035525007 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c0fbcc0 con 0x7f217c10f650 2026-02-24T09:16:07.685 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.682+0000 7f2171ffb640 1 -- 10.20.193.4:0/4035525007 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f216c0027c0 con 0x7f217c10f650 2026-02-24T09:16:07.686 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.683+0000 7f2171ffb640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21580b56d0 0x7f21580d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.686 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.683+0000 7f2171ffb640 1 -- 10.20.193.4:0/4035525007 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f216c0e6e60 con 0x7f217c10f650 2026-02-24T09:16:07.686 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.683+0000 7f2173fff640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21580b56d0 0x7f21580d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.686 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.683+0000 7f2173fff640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21580b56d0 0x7f21580d5b80 secure :-1 s=READY pgs=384 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21640023d0 tx=0x7f2164031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:07.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2184bf6e00 1 Processor -- start 2026-02-24T09:16:07.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2184bf6e00 1 -- start start 2026-02-24T09:16:07.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc457f50 0x55d2dc458320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc458860 0x55d2dc49cfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc49d500 0x55d2dc4bd8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc368ee0 con 0x55d2dc49d500 2026-02-24T09:16:07.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc364c10 con 0x55d2dc457f50 2026-02-24T09:16:07.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc35ed70 con 0x55d2dc458860 2026-02-24T09:16:07.690 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2181172640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc49d500 0x55d2dc4bd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2181172640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc49d500 0x55d2dc4bd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38950/0 (socket says 10.20.193.4:38950) 2026-02-24T09:16:07.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2181172640 1 -- 10.20.193.4:0/1817643 learned_addr learned my addr 10.20.193.4:0/1817643 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:07.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.686+0000 7f2173fff640 1 --2- 10.20.193.4:0/1817643 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc458860 0x55d2dc49cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.687+0000 7f2180971640 1 --2- 10.20.193.4:0/1817643 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc457f50 0x55d2dc458320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.687+0000 7f2181172640 1 -- 10.20.193.4:0/1817643 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc458860 msgr2=0x55d2dc49cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:07.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.687+0000 7f2181172640 1 --2- 10.20.193.4:0/1817643 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc458860 0x55d2dc49cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.687+0000 7f2181172640 1 -- 10.20.193.4:0/1817643 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc457f50 msgr2=0x55d2dc458320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:07.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.687+0000 7f2181172640 1 --2- 10.20.193.4:0/1817643 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc457f50 0x55d2dc458320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.687+0000 7f2181172640 1 -- 10.20.193.4:0/1817643 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2dc30a340 con 0x55d2dc49d500 2026-02-24T09:16:07.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.687+0000 7f2181172640 1 --2- 10.20.193.4:0/1817643 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc49d500 0x55d2dc4bd8e0 secure :-1 s=READY pgs=964 gs=1 cs=0 l=1 c_cookie=753884855210349874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2178005630 tx=0x7f2178003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a765648145c1532 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:07.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.687+0000 7f21494e4640 1 -- 10.20.193.4:0/1817643 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2178003e30 con 0x55d2dc49d500 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.687+0000 7f21494e4640 1 -- 10.20.193.4:0/1817643 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2178011910 con 0x55d2dc49d500 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.687+0000 7f21494e4640 1 -- 10.20.193.4:0/1817643 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f217801ba80 con 0x55d2dc49d500 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.688+0000 7f2184bf6e00 1 -- 10.20.193.4:0/1817643 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc49d500 msgr2=0x55d2dc4bd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.688+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/1817643 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc49d500 0x55d2dc4bd8e0 secure :-1 s=READY pgs=964 gs=1 cs=0 l=1 c_cookie=753884855210349874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2178005630 tx=0x7f2178003c30 comp rx=0 tx=0).stop 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.688+0000 7f2184bf6e00 1 -- 10.20.193.4:0/1817643 shutdown_connections 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.688+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/1817643 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc49d500 0x55d2dc4bd8e0 unknown :-1 s=CLOSED pgs=964 gs=1 cs=0 l=1 c_cookie=753884855210349874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.688+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/1817643 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc458860 0x55d2dc49cfc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.688+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/1817643 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc457f50 0x55d2dc458320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.688+0000 7f2184bf6e00 1 -- 10.20.193.4:0/1817643 >> 10.20.193.4:0/1817643 conn(0x55d2dc376db0 msgr2=0x55d2dc456830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.688+0000 7f2184bf6e00 1 -- 10.20.193.4:0/1817643 shutdown_connections 2026-02-24T09:16:07.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.688+0000 7f2184bf6e00 1 -- 10.20.193.4:0/1817643 wait complete. 2026-02-24T09:16:07.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 -- start start 2026-02-24T09:16:07.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 Processor -- start 2026-02-24T09:16:07.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b4d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc458860 0x55d2dc4b5270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc49d500 0x55d2dc4ba260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc4ba7a0 con 0x55d2dc457f50 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc4ba910 con 0x55d2dc458860 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc4baad0 con 0x55d2dc49d500 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2180971640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2180971640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38952/0 (socket says 10.20.193.4:38952) 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2180971640 1 -- 10.20.193.4:0/670099078 learned_addr learned my addr 10.20.193.4:0/670099078 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2180971640 1 -- 10.20.193.4:0/670099078 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc49d500 msgr2=0x55d2dc4ba260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2180971640 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc49d500 0x55d2dc4ba260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2173fff640 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc458860 0x55d2dc4b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2180971640 1 -- 10.20.193.4:0/670099078 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc458860 msgr2=0x55d2dc4b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2180971640 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc458860 0x55d2dc4b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2180971640 1 -- 10.20.193.4:0/670099078 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2dc2e29d0 con 0x55d2dc457f50 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2173fff640 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc458860 0x55d2dc4b5270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2180971640 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b4d30 secure :-1 s=READY pgs=965 gs=1 cs=0 l=1 c_cookie=3541368964328598321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f216c0aa400 tx=0x7f216c002bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3125784f61662b31 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f213a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f213a7fc640 1 -- 10.20.193.4:0/670099078 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f216c0ae040 con 0x55d2dc457f50 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f213a7fc640 1 -- 10.20.193.4:0/670099078 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f216c0ac990 con 0x55d2dc457f50 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 -- 10.20.193.4:0/670099078 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21780052d0 con 0x55d2dc457f50 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f213a7fc640 1 -- 10.20.193.4:0/670099078 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f216c0b80c0 con 0x55d2dc457f50 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 10 client.17190 _ll_register_callbacks cb 0x55d2dc309080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 -- 10.20.193.4:0/670099078 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d2dc0ae4a0 con 0x55d2dc457f50 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f213a7fc640 1 -- 10.20.193.4:0/670099078 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f216c0acf40 con 0x55d2dc457f50 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f213a7fc640 1 -- 10.20.193.4:0/670099078 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f216c072290 con 0x55d2dc457f50 2026-02-24T09:16:07.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 10 client.17190 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.689+0000 7f2184bf6e00 1 -- 10.20.193.4:0/670099078 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d2dc2f4710 con 0x55d2dc457f50 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.690+0000 7f213a7fc640 1 -- 10.20.193.4:0/670099078 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f216c0ab170 con 0x55d2dc457f50 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.690+0000 7f2184bf6e00 10 client.17190 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.690+0000 7f2184bf6e00 10 client.17190 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.690+0000 7f2184bf6e00 20 client.17190 populate_metadata read hostname 'trial004' 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.690+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d2dc49a7d0 0x55d2dc49ac70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.690+0000 7f2184bf6e00 4 client.17190 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.690+0000 7f2184bf6e00 1 -- 10.20.193.4:0/670099078 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2dc3547b0 con 0x55d2dc49a7d0 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.690+0000 7f2173fff640 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d2dc49a7d0 0x55d2dc49ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f213a7fc640 10 client.17190 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2173fff640 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d2dc49a7d0 0x55d2dc49ac70 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=9864252742435911620 s_cookie=8606608016915131728 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=88e4dd9b2f90b7c4 server_cookie=7770d06441416d50 in_seq=0 out_seq=0 2026-02-24T09:16:07.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f213a7fc640 1 -- 10.20.193.4:0/670099078 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d2dc3547b0 con 0x55d2dc49a7d0 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f213a7fc640 10 client.17190 handle_command_reply: tid=0 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 client.17190 shutdown 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 -- 10.20.193.4:0/670099078 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 msgr2=0x55d2dc4b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b4d30 secure :-1 s=READY pgs=965 gs=1 cs=0 l=1 c_cookie=3541368964328598321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f216c0aa400 tx=0x7f216c002bf0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 -- 10.20.193.4:0/670099078 shutdown_connections 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d2dc49a7d0 0x55d2dc49ac70 crc :-1 s=READY pgs=44 gs=4 cs=0 l=0 c_cookie=9864252742435911620 s_cookie=8606608016915131728 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc49d500 0x55d2dc4ba260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc458860 0x55d2dc4b5270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/670099078 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b4d30 unknown :-1 s=CLOSED pgs=965 gs=1 cs=0 l=1 c_cookie=3541368964328598321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f213a7fc640 0 client.17190 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 -- 10.20.193.4:0/670099078 >> 10.20.193.4:0/670099078 conn(0x55d2dc376db0 msgr2=0x55d2dc456040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 -- 10.20.193.4:0/670099078 shutdown_connections 2026-02-24T09:16:07.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 1 -- 10.20.193.4:0/670099078 wait complete. 2026-02-24T09:16:07.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.691+0000 7f2184bf6e00 20 client.17190 trim_cache size 0 max 16384 2026-02-24T09:16:07.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.701+0000 7f2184bf6e00 1 Processor -- start 2026-02-24T09:16:07.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2184bf6e00 1 -- start start 2026-02-24T09:16:07.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b97d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc458860 0x55d2dc498160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc49d500 0x55d2dc4986a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc35c9a0 con 0x55d2dc457f50 2026-02-24T09:16:07.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc138df0 con 0x55d2dc49d500 2026-02-24T09:16:07.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc3c8270 con 0x55d2dc458860 2026-02-24T09:16:07.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2180971640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2180971640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38968/0 (socket says 10.20.193.4:38968) 2026-02-24T09:16:07.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2180971640 1 -- 10.20.193.4:0/4105807311 learned_addr learned my addr 10.20.193.4:0/4105807311 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:07.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2173fff640 1 --2- 10.20.193.4:0/4105807311 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc458860 0x55d2dc498160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2181172640 1 --2- 10.20.193.4:0/4105807311 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc49d500 0x55d2dc4986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2180971640 1 -- 10.20.193.4:0/4105807311 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc458860 msgr2=0x55d2dc498160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:07.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2180971640 1 --2- 10.20.193.4:0/4105807311 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc458860 0x55d2dc498160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2180971640 1 -- 10.20.193.4:0/4105807311 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc49d500 msgr2=0x55d2dc4986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:07.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2180971640 1 --2- 10.20.193.4:0/4105807311 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc49d500 0x55d2dc4986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2180971640 1 -- 10.20.193.4:0/4105807311 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2dc4a7390 con 0x55d2dc457f50 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2180971640 1 --2- 10.20.193.4:0/4105807311 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b97d0 secure :-1 s=READY pgs=966 gs=1 cs=0 l=1 c_cookie=4062352376688254433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f216c0e4960 tx=0x7f216c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38605ff69cf79de1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2148ce3640 1 -- 10.20.193.4:0/4105807311 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f216c0ae9a0 con 0x55d2dc457f50 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2148ce3640 1 -- 10.20.193.4:0/4105807311 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d2dc0ae4a0 con 0x55d2dc457f50 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.702+0000 7f2148ce3640 1 -- 10.20.193.4:0/4105807311 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f216c0b2eb0 con 0x55d2dc457f50 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 -- 10.20.193.4:0/4105807311 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 msgr2=0x55d2dc4b97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/4105807311 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b97d0 secure :-1 s=READY pgs=966 gs=1 cs=0 l=1 c_cookie=4062352376688254433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f216c0e4960 tx=0x7f216c01c000 comp rx=0 tx=0).stop 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 -- 10.20.193.4:0/4105807311 shutdown_connections 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/4105807311 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc49d500 0x55d2dc4986a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/4105807311 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc458860 0x55d2dc498160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/4105807311 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc457f50 0x55d2dc4b97d0 unknown :-1 s=CLOSED pgs=966 gs=1 cs=0 l=1 c_cookie=4062352376688254433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 -- 10.20.193.4:0/4105807311 >> 10.20.193.4:0/4105807311 conn(0x55d2dc376db0 msgr2=0x55d2dc4b90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 -- 10.20.193.4:0/4105807311 shutdown_connections 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 -- 10.20.193.4:0/4105807311 wait complete. 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 -- start start 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 Processor -- start 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc457f50 0x55d2dc498ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc458860 0x55d2dc436030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc49d500 0x55d2dc436570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc35c9a0 con 0x55d2dc458860 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc5042f0 con 0x55d2dc49d500 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2184bf6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d2dc436b30 con 0x55d2dc457f50 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2173fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc458860 0x55d2dc436030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2173fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc458860 0x55d2dc436030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38974/0 (socket says 10.20.193.4:38974) 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.703+0000 7f2173fff640 1 -- 10.20.193.4:0/67890828 learned_addr learned my addr 10.20.193.4:0/67890828 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2180971640 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc457f50 0x55d2dc498ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2173fff640 1 -- 10.20.193.4:0/67890828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc457f50 msgr2=0x55d2dc498ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2173fff640 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc457f50 0x55d2dc498ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2173fff640 1 -- 10.20.193.4:0/67890828 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc49d500 msgr2=0x55d2dc436570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2173fff640 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc49d500 0x55d2dc436570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2173fff640 1 -- 10.20.193.4:0/67890828 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2dc2ef190 con 0x55d2dc458860 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2173fff640 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc458860 0x55d2dc436030 secure :-1 s=READY pgs=967 gs=1 cs=0 l=1 c_cookie=4149414826071305376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21640098a0 tx=0x7f216402f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3995aeccbdb82ca0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f213a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f213a7fc640 1 -- 10.20.193.4:0/67890828 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2164002af0 con 0x55d2dc458860 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 1 -- 10.20.193.4:0/67890828 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2dc2f4710 con 0x55d2dc458860 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f213a7fc640 1 -- 10.20.193.4:0/67890828 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2164004200 con 0x55d2dc458860 2026-02-24T09:16:07.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f213a7fc640 1 -- 10.20.193.4:0/67890828 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2164056890 con 0x55d2dc458860 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 10 client.17196 _ll_register_callbacks cb 0x55d2dc309080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 1 -- 10.20.193.4:0/67890828 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2178011910 con 0x55d2dc458860 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f213a7fc640 1 -- 10.20.193.4:0/67890828 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2164056a20 con 0x55d2dc458860 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f213a7fc640 1 -- 10.20.193.4:0/67890828 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2164056be0 con 0x55d2dc458860 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 10 client.17196 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 1 -- 10.20.193.4:0/67890828 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d2dc2e2d00 con 0x55d2dc458860 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f213a7fc640 1 -- 10.20.193.4:0/67890828 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f216402f9f0 con 0x55d2dc458860 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 10 client.17196 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 10 client.17196 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 20 client.17196 populate_metadata read hostname 'trial004' 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d2dc54b0c0 0x55d2dc56b570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 4 client.17196 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:16:07.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2184bf6e00 1 -- 10.20.193.4:0/67890828 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d2dc093160 con 0x55d2dc54b0c0 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.704+0000 7f2180971640 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d2dc54b0c0 0x55d2dc56b570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2180971640 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d2dc54b0c0 0x55d2dc56b570 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=11435009622554656961 s_cookie=836764018808197434 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9eb150aa9b8b40c1 server_cookie=b9cc87115e4113a in_seq=0 out_seq=0 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f213a7fc640 10 client.17196 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f213a7fc640 1 -- 10.20.193.4:0/67890828 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d2dc093160 con 0x55d2dc54b0c0 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f213a7fc640 10 client.17196 handle_command_reply: tid=0 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 client.17196 shutdown 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 -- 10.20.193.4:0/67890828 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc458860 msgr2=0x55d2dc436030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc458860 0x55d2dc436030 secure :-1 s=READY pgs=967 gs=1 cs=0 l=1 c_cookie=4149414826071305376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21640098a0 tx=0x7f216402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 -- 10.20.193.4:0/67890828 shutdown_connections 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55d2dc54b0c0 0x55d2dc56b570 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=11435009622554656961 s_cookie=836764018808197434 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d2dc49d500 0x55d2dc436570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d2dc458860 0x55d2dc436030 unknown :-1 s=CLOSED pgs=967 gs=1 cs=0 l=1 c_cookie=4149414826071305376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 --2- 10.20.193.4:0/67890828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d2dc457f50 0x55d2dc498ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f213a7fc640 0 client.17196 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:16:07.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 -- 10.20.193.4:0/67890828 >> 10.20.193.4:0/67890828 conn(0x55d2dc376db0 msgr2=0x55d2dc4b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:07.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 -- 10.20.193.4:0/67890828 shutdown_connections 2026-02-24T09:16:07.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 1 -- 10.20.193.4:0/67890828 wait complete. 2026-02-24T09:16:07.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.705+0000 7f2184bf6e00 20 client.17196 trim_cache size 0 max 16384 2026-02-24T09:16:07.717 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:16:07.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 -- 10.20.193.4:0/4035525007 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21580b56d0 msgr2=0x7f21580d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21580b56d0 0x7f21580d5b80 secure :-1 s=READY pgs=384 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21640023d0 tx=0x7f2164031040 comp rx=0 tx=0).stop 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 -- 10.20.193.4:0/4035525007 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f217c10f650 msgr2=0x7f217c0f58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f217c10f650 0x7f217c0f58d0 secure :-1 s=READY pgs=963 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f216c00d950 tx=0x7f216c00de20 comp rx=0 tx=0).stop 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 -- 10.20.193.4:0/4035525007 shutdown_connections 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f21580b56d0 0x7f21580d5b80 unknown :-1 s=CLOSED pgs=384 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f217c115840 0x7f217c0f5fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f217c110040 0x7f217c176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 --2- 10.20.193.4:0/4035525007 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f217c10f650 0x7f217c0f58d0 unknown :-1 s=CLOSED pgs=963 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 -- 10.20.193.4:0/4035525007 >> 10.20.193.4:0/4035525007 conn(0x7f217c0ecf20 msgr2=0x7f217c10dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 -- 10.20.193.4:0/4035525007 shutdown_connections 2026-02-24T09:16:07.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:07.706+0000 7f2182bfc640 1 -- 10.20.193.4:0/4035525007 wait complete. 2026-02-24T09:16:07.797 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:16:07.973 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:08.096 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:07 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4207539583' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:08.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.117+0000 7f16e5a5c640 1 -- 10.20.193.4:0/1561690122 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e010ddc0 msgr2=0x7f16e0112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.117+0000 7f16e5a5c640 1 --2- 10.20.193.4:0/1561690122 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e010ddc0 0x7f16e0112e10 secure :-1 s=READY pgs=968 gs=1 cs=0 l=1 c_cookie=289144080283107928 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c8009950 tx=0x7f16c802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 -- 10.20.193.4:0/1561690122 shutdown_connections 2026-02-24T09:16:08.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 --2- 10.20.193.4:0/1561690122 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e01135c0 0x7f16e0173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 --2- 10.20.193.4:0/1561690122 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e010ddc0 0x7f16e0112e10 unknown :-1 s=CLOSED pgs=968 gs=1 cs=0 l=1 c_cookie=289144080283107928 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 --2- 10.20.193.4:0/1561690122 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010d3d0 0x7f16e010d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 -- 10.20.193.4:0/1561690122 >> 10.20.193.4:0/1561690122 conn(0x7f16e00eaca0 msgr2=0x7f16e010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 -- 10.20.193.4:0/1561690122 shutdown_connections 2026-02-24T09:16:08.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 -- 10.20.193.4:0/1561690122 wait complete. 2026-02-24T09:16:08.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 Processor -- start 2026-02-24T09:16:08.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 -- start start 2026-02-24T09:16:08.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e010d3d0 0x7f16e0060f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010ddc0 0x7f16e0173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e0061480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f16e00619c0 con 0x7f16e01135c0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0061b30 con 0x7f16e010ddc0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16e5a5c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0061cf0 con 0x7f16e010d3d0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16df7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e0061480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16df7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e0061480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38990/0 (socket says 10.20.193.4:38990) 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16df7fe640 1 -- 10.20.193.4:0/625776964 learned_addr learned my addr 10.20.193.4:0/625776964 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16de7fc640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010ddc0 0x7f16e0173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16deffd640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e010d3d0 0x7f16e0060f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16df7fe640 1 -- 10.20.193.4:0/625776964 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e010d3d0 msgr2=0x7f16e0060f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16df7fe640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e010d3d0 0x7f16e0060f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16df7fe640 1 -- 10.20.193.4:0/625776964 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010ddc0 msgr2=0x7f16e0173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16df7fe640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010ddc0 0x7f16e0173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.118+0000 7f16df7fe640 1 -- 10.20.193.4:0/625776964 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c8009570 con 0x7f16e01135c0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.119+0000 7f16df7fe640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e0061480 secure :-1 s=READY pgs=969 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d0006e90 tx=0x7f16d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.119+0000 7f16e4a5a640 1 -- 10.20.193.4:0/625776964 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16d0005500 con 0x7f16e01135c0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.119+0000 7f16e5a5c640 1 -- 10.20.193.4:0/625776964 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e00fb9a0 con 0x7f16e01135c0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.119+0000 7f16e4a5a640 1 -- 10.20.193.4:0/625776964 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16d0005e10 con 0x7f16e01135c0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.119+0000 7f16e4a5a640 1 -- 10.20.193.4:0/625776964 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16d0003a90 con 0x7f16e01135c0 2026-02-24T09:16:08.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.119+0000 7f16e5a5c640 1 -- 10.20.193.4:0/625776964 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e00fbe70 con 0x7f16e01135c0 2026-02-24T09:16:08.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.122+0000 7f16e4a5a640 1 -- 10.20.193.4:0/625776964 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f16d000c840 con 0x7f16e01135c0 2026-02-24T09:16:08.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.123+0000 7f16e4a5a640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16b40b56e0 0x7f16b40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.123+0000 7f16e4a5a640 1 -- 10.20.193.4:0/625776964 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f16d00e7a00 con 0x7f16e01135c0 2026-02-24T09:16:08.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.123+0000 7f16deffd640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16b40b56e0 0x7f16b40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.123+0000 7f16deffd640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16b40b56e0 0x7f16b40d5b90 secure :-1 s=READY pgs=385 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d4004740 tx=0x7f16d4004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.126+0000 7f16e7a56e00 1 Processor -- start 2026-02-24T09:16:08.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.126+0000 7f16e7a56e00 1 -- start start 2026-02-24T09:16:08.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456bf50 0x55d9f456c320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 0x55d9f45d18e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d9f447cee0 con 0x55d9f456c860 2026-02-24T09:16:08.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4478c10 con 0x55d9f456bf50 2026-02-24T09:16:08.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4472d70 con 0x55d9f45b1500 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16de7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16de7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:38998/0 (socket says 10.20.193.4:38998) 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16de7fc640 1 -- 10.20.193.4:0/3915012428 learned_addr learned my addr 10.20.193.4:0/3915012428 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16deffd640 1 --2- 10.20.193.4:0/3915012428 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456bf50 0x55d9f456c320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16df7fe640 1 --2- 10.20.193.4:0/3915012428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 0x55d9f45d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16de7fc640 1 -- 10.20.193.4:0/3915012428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 msgr2=0x55d9f45d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16de7fc640 1 --2- 10.20.193.4:0/3915012428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 0x55d9f45d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16de7fc640 1 -- 10.20.193.4:0/3915012428 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456bf50 msgr2=0x55d9f456c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16de7fc640 1 --2- 10.20.193.4:0/3915012428 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456bf50 0x55d9f456c320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16de7fc640 1 -- 10.20.193.4:0/3915012428 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f441e340 con 0x55d9f456c860 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16de7fc640 1 --2- 10.20.193.4:0/3915012428 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0fc0 secure :-1 s=READY pgs=970 gs=1 cs=0 l=1 c_cookie=7431299734382682719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c80059f0 tx=0x7f16c8005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672147bc5755a25f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16a3fff640 1 -- 10.20.193.4:0/3915012428 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c8038470 con 0x55d9f456c860 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16a3fff640 1 -- 10.20.193.4:0/3915012428 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16c80385d0 con 0x55d9f456c860 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.127+0000 7f16a3fff640 1 -- 10.20.193.4:0/3915012428 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c8038920 con 0x55d9f456c860 2026-02-24T09:16:08.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.128+0000 7f16e7a56e00 1 -- 10.20.193.4:0/3915012428 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 msgr2=0x55d9f45b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.132 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.128+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/3915012428 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0fc0 secure :-1 s=READY pgs=970 gs=1 cs=0 l=1 c_cookie=7431299734382682719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c80059f0 tx=0x7f16c8005c30 comp rx=0 tx=0).stop 2026-02-24T09:16:08.132 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.128+0000 7f16e7a56e00 1 -- 10.20.193.4:0/3915012428 shutdown_connections 2026-02-24T09:16:08.132 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.128+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/3915012428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 0x55d9f45d18e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.132 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.128+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/3915012428 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0fc0 unknown :-1 s=CLOSED pgs=970 gs=1 cs=0 l=1 c_cookie=7431299734382682719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.132 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.128+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/3915012428 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456bf50 0x55d9f456c320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.132 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.128+0000 7f16e7a56e00 1 -- 10.20.193.4:0/3915012428 >> 10.20.193.4:0/3915012428 conn(0x55d9f448adb0 msgr2=0x55d9f456a830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.132 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.128+0000 7f16e7a56e00 1 -- 10.20.193.4:0/3915012428 shutdown_connections 2026-02-24T09:16:08.132 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.128+0000 7f16e7a56e00 1 -- 10.20.193.4:0/3915012428 wait complete. 2026-02-24T09:16:08.133 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.130+0000 7f16e7a56e00 1 -- start start 2026-02-24T09:16:08.133 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.130+0000 7f16e7a56e00 1 Processor -- start 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.130+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f456bf50 0x55d9f45c8db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.130+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456c860 0x55d9f45c92f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.130+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f45b1500 0x55d9f45ce2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.130+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d9f45ce820 con 0x55d9f45b1500 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.130+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d9f45ce990 con 0x55d9f456c860 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.130+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d9f45ceb50 con 0x55d9f456bf50 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16df7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f45b1500 0x55d9f45ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16df7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f45b1500 0x55d9f45ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39012/0 (socket says 10.20.193.4:39012) 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16df7fe640 1 -- 10.20.193.4:0/73182026 learned_addr learned my addr 10.20.193.4:0/73182026 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16deffd640 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f456bf50 0x55d9f45c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16de7fc640 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456c860 0x55d9f45c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16df7fe640 1 -- 10.20.193.4:0/73182026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f456bf50 msgr2=0x55d9f45c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16df7fe640 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f456bf50 0x55d9f45c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16df7fe640 1 -- 10.20.193.4:0/73182026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456c860 msgr2=0x55d9f45c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16df7fe640 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456c860 0x55d9f45c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16df7fe640 1 -- 10.20.193.4:0/73182026 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f43f69d0 con 0x55d9f45b1500 2026-02-24T09:16:08.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16df7fe640 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f45b1500 0x55d9f45ce2e0 secure :-1 s=READY pgs=971 gs=1 cs=0 l=1 c_cookie=2379743122300703461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d000c630 tx=0x7f16d00adeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21068bc2e56992e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16a17fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:08.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16a17fa640 1 -- 10.20.193.4:0/73182026 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16d00adaf0 con 0x55d9f45b1500 2026-02-24T09:16:08.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16e7a56e00 1 -- 10.20.193.4:0/73182026 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e0174800 con 0x55d9f45b1500 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16a17fa640 1 -- 10.20.193.4:0/73182026 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16d00b3070 con 0x55d9f45b1500 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16a17fa640 1 -- 10.20.193.4:0/73182026 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16d00aec40 con 0x55d9f45b1500 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16e7a56e00 10 client.17208 _ll_register_callbacks cb 0x55d9f441d080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16e7a56e00 1 -- 10.20.193.4:0/73182026 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9f41c24a0 con 0x55d9f45b1500 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16a17fa640 1 -- 10.20.193.4:0/73182026 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f16d00b89e0 con 0x55d9f45b1500 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16a17fa640 1 -- 10.20.193.4:0/73182026 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f16d00b8bc0 con 0x55d9f45b1500 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16e7a56e00 10 client.17208 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.131+0000 7f16e7a56e00 1 -- 10.20.193.4:0/73182026 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d9f4408710 con 0x55d9f45b1500 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.132+0000 7f16a17fa640 1 -- 10.20.193.4:0/73182026 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f16d0072ec0 con 0x55d9f45b1500 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.132+0000 7f16e7a56e00 10 client.17208 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.132+0000 7f16e7a56e00 10 client.17208 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.132+0000 7f16e7a56e00 20 client.17208 populate_metadata read hostname 'trial004' 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.132+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d9f45ae780 0x55d9f45aec20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.132+0000 7f16e7a56e00 4 client.17208 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.132+0000 7f16e7a56e00 1 -- 10.20.193.4:0/73182026 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9f44687b0 con 0x55d9f45ae780 2026-02-24T09:16:08.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.132+0000 7f16deffd640 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d9f45ae780 0x55d9f45aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.132+0000 7f16deffd640 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d9f45ae780 0x55d9f45aec20 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=1651496347280104656 s_cookie=13113771357147865618 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=16eb4b2d877c5cd0 server_cookie=b5fd7991d07da212 in_seq=0 out_seq=0 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.132+0000 7f16a17fa640 10 client.17208 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16a17fa640 1 -- 10.20.193.4:0/73182026 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d9f44687b0 con 0x55d9f45ae780 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16a17fa640 10 client.17208 handle_command_reply: tid=0 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 client.17208 shutdown 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 -- 10.20.193.4:0/73182026 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f45b1500 msgr2=0x55d9f45ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f45b1500 0x55d9f45ce2e0 secure :-1 s=READY pgs=971 gs=1 cs=0 l=1 c_cookie=2379743122300703461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d000c630 tx=0x7f16d00adeb0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 -- 10.20.193.4:0/73182026 shutdown_connections 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d9f45ae780 0x55d9f45aec20 crc :-1 s=READY pgs=45 gs=4 cs=0 l=0 c_cookie=1651496347280104656 s_cookie=13113771357147865618 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16a17fa640 0 client.17208 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f45b1500 0x55d9f45ce2e0 unknown :-1 s=CLOSED pgs=971 gs=1 cs=0 l=1 c_cookie=2379743122300703461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456c860 0x55d9f45c92f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/73182026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f456bf50 0x55d9f45c8db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 -- 10.20.193.4:0/73182026 >> 10.20.193.4:0/73182026 conn(0x55d9f448adb0 msgr2=0x55d9f456a040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 -- 10.20.193.4:0/73182026 shutdown_connections 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 1 -- 10.20.193.4:0/73182026 wait complete. 2026-02-24T09:16:08.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.133+0000 7f16e7a56e00 20 client.17208 trim_cache size 0 max 16384 2026-02-24T09:16:08.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16e7a56e00 1 Processor -- start 2026-02-24T09:16:08.146 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16e7a56e00 1 -- start start 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f456bf50 0x55d9f45b0510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f45b1500 0x55d9f45b0f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d9f44709a0 con 0x55d9f456c860 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d9f424cdf0 con 0x55d9f45b1500 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4540ea0 con 0x55d9f456bf50 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16de7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16de7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39014/0 (socket says 10.20.193.4:39014) 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16de7fc640 1 -- 10.20.193.4:0/1768248033 learned_addr learned my addr 10.20.193.4:0/1768248033 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16de7fc640 1 -- 10.20.193.4:0/1768248033 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f456bf50 msgr2=0x55d9f45b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16de7fc640 1 --2- 10.20.193.4:0/1768248033 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f456bf50 0x55d9f45b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16de7fc640 1 -- 10.20.193.4:0/1768248033 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f45b1500 msgr2=0x55d9f45b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16de7fc640 1 --2- 10.20.193.4:0/1768248033 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f45b1500 0x55d9f45b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16de7fc640 1 -- 10.20.193.4:0/1768248033 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f45bb410 con 0x55d9f456c860 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.143+0000 7f16de7fc640 1 --2- 10.20.193.4:0/1768248033 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0a50 secure :-1 s=READY pgs=972 gs=1 cs=0 l=1 c_cookie=12751457776718183028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c802f6e0 tx=0x7f16c802f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f64749adadfa74 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.147 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.144+0000 7f16a37fe640 1 -- 10.20.193.4:0/1768248033 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c8038470 con 0x55d9f456c860 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.144+0000 7f16a37fe640 1 -- 10.20.193.4:0/1768248033 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16c803c040 con 0x55d9f456c860 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.144+0000 7f16a37fe640 1 -- 10.20.193.4:0/1768248033 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c8038ba0 con 0x55d9f456c860 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.145+0000 7f16e7a56e00 1 -- 10.20.193.4:0/1768248033 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 msgr2=0x55d9f45b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.145+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/1768248033 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0a50 secure :-1 s=READY pgs=972 gs=1 cs=0 l=1 c_cookie=12751457776718183028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c802f6e0 tx=0x7f16c802f730 comp rx=0 tx=0).stop 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.145+0000 7f16e7a56e00 1 -- 10.20.193.4:0/1768248033 shutdown_connections 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.145+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/1768248033 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f45b1500 0x55d9f45b0f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.145+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/1768248033 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456c860 0x55d9f45b0a50 unknown :-1 s=CLOSED pgs=972 gs=1 cs=0 l=1 c_cookie=12751457776718183028 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.145+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/1768248033 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f456bf50 0x55d9f45b0510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.145+0000 7f16e7a56e00 1 -- 10.20.193.4:0/1768248033 >> 10.20.193.4:0/1768248033 conn(0x55d9f448adb0 msgr2=0x55d9f456a450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.145+0000 7f16e7a56e00 1 -- 10.20.193.4:0/1768248033 shutdown_connections 2026-02-24T09:16:08.148 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.145+0000 7f16e7a56e00 1 -- 10.20.193.4:0/1768248033 wait complete. 2026-02-24T09:16:08.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.145+0000 7f16e7a56e00 1 -- start start 2026-02-24T09:16:08.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16e7a56e00 1 Processor -- start 2026-02-24T09:16:08.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456bf50 0x55d9f454b5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456c860 0x55d9f454bb30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16e7a56e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 0x55d9f454c070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4617200 con 0x55d9f456bf50 2026-02-24T09:16:08.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4617370 con 0x55d9f456c860 2026-02-24T09:16:08.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16e7a56e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4617530 con 0x55d9f45b1500 2026-02-24T09:16:08.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16deffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456bf50 0x55d9f454b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16deffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456bf50 0x55d9f454b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39028/0 (socket says 10.20.193.4:39028) 2026-02-24T09:16:08.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16deffd640 1 -- 10.20.193.4:0/921018770 learned_addr learned my addr 10.20.193.4:0/921018770 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:08.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16de7fc640 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456c860 0x55d9f454bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16df7fe640 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 0x55d9f454c070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16deffd640 1 -- 10.20.193.4:0/921018770 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 msgr2=0x55d9f454c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16deffd640 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 0x55d9f454c070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16deffd640 1 -- 10.20.193.4:0/921018770 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456c860 msgr2=0x55d9f454bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16deffd640 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456c860 0x55d9f454bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16deffd640 1 -- 10.20.193.4:0/921018770 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f4403190 con 0x55d9f456bf50 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16df7fe640 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 0x55d9f454c070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16deffd640 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456bf50 0x55d9f454b5f0 secure :-1 s=READY pgs=973 gs=1 cs=0 l=1 c_cookie=14325474184564721120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55d9f45af4d0 tx=0x7f16d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ce4edf0a0245e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16a17fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.146+0000 7f16a17fa640 1 -- 10.20.193.4:0/921018770 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16d4020d50 con 0x55d9f456bf50 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 1 -- 10.20.193.4:0/921018770 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9f441e340 con 0x55d9f456bf50 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16a17fa640 1 -- 10.20.193.4:0/921018770 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16d4011920 con 0x55d9f456bf50 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16a17fa640 1 -- 10.20.193.4:0/921018770 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16d401f9a0 con 0x55d9f456bf50 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 10 client.17214 _ll_register_callbacks cb 0x55d9f441d080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 1 -- 10.20.193.4:0/921018770 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16c80385d0 con 0x55d9f456bf50 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16a17fa640 1 -- 10.20.193.4:0/921018770 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f16d401fb30 con 0x55d9f456bf50 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16a17fa640 1 -- 10.20.193.4:0/921018770 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f16d401fd50 con 0x55d9f456bf50 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 10 client.17214 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 1 -- 10.20.193.4:0/921018770 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d9f43f6d00 con 0x55d9f456bf50 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16a17fa640 1 -- 10.20.193.4:0/921018770 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f16d4019070 con 0x55d9f456bf50 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 10 client.17214 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:08.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 10 client.17214 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 20 client.17214 populate_metadata read hostname 'trial004' 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d9f465f5d0 0x55d9f467fa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 4 client.17214 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16e7a56e00 1 -- 10.20.193.4:0/921018770 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9f41a7160 con 0x55d9f465f5d0 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.147+0000 7f16de7fc640 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d9f465f5d0 0x55d9f467fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16de7fc640 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d9f465f5d0 0x55d9f467fa50 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=14323600995081967433 s_cookie=9604517158280632564 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c6c7a737204ad749 server_cookie=854a1977f27618f4 in_seq=0 out_seq=0 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16a17fa640 10 client.17214 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16a17fa640 1 -- 10.20.193.4:0/921018770 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9f41a7160 con 0x55d9f465f5d0 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16a17fa640 10 client.17214 handle_command_reply: tid=0 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 client.17214 shutdown 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 -- 10.20.193.4:0/921018770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456bf50 msgr2=0x55d9f454b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456bf50 0x55d9f454b5f0 secure :-1 s=READY pgs=973 gs=1 cs=0 l=1 c_cookie=14325474184564721120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55d9f45af4d0 tx=0x7f16d4004770 comp rx=0 tx=0).stop 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 -- 10.20.193.4:0/921018770 shutdown_connections 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d9f465f5d0 0x55d9f467fa50 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=14323600995081967433 s_cookie=9604517158280632564 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d9f45b1500 0x55d9f454c070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d9f456c860 0x55d9f454bb30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16a17fa640 0 client.17214 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 --2- 10.20.193.4:0/921018770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d9f456bf50 0x55d9f454b5f0 unknown :-1 s=CLOSED pgs=973 gs=1 cs=0 l=1 c_cookie=14325474184564721120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 -- 10.20.193.4:0/921018770 >> 10.20.193.4:0/921018770 conn(0x55d9f448adb0 msgr2=0x55d9f456ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 -- 10.20.193.4:0/921018770 shutdown_connections 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 1 -- 10.20.193.4:0/921018770 wait complete. 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.148+0000 7f16e7a56e00 20 client.17214 trim_cache size 0 max 16384 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 -- 10.20.193.4:0/625776964 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16b40b56e0 msgr2=0x7f16b40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16b40b56e0 0x7f16b40d5b90 secure :-1 s=READY pgs=385 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d4004740 tx=0x7f16d4004420 comp rx=0 tx=0).stop 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 -- 10.20.193.4:0/625776964 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 msgr2=0x7f16e0061480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e0061480 secure :-1 s=READY pgs=969 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d0006e90 tx=0x7f16d000edf0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 -- 10.20.193.4:0/625776964 shutdown_connections 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16b40b56e0 0x7f16b40d5b90 unknown :-1 s=CLOSED pgs=385 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e0061480 unknown :-1 s=CLOSED pgs=969 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010ddc0 0x7f16e0173e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 --2- 10.20.193.4:0/625776964 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e010d3d0 0x7f16e0060f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 -- 10.20.193.4:0/625776964 >> 10.20.193.4:0/625776964 conn(0x7f16e00eaca0 msgr2=0x7f16e010b860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 -- 10.20.193.4:0/625776964 shutdown_connections 2026-02-24T09:16:08.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.149+0000 7f16e5a5c640 1 -- 10.20.193.4:0/625776964 wait complete. 2026-02-24T09:16:08.221 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:16:08.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:07 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4207539583' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:08.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:07 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4207539583' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:08.386 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:08.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.519+0000 7f3b09047640 1 -- 10.20.193.4:0/3945653950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b0410d3d0 msgr2=0x7f3b0410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.519+0000 7f3b09047640 1 --2- 10.20.193.4:0/3945653950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b0410d3d0 0x7f3b0410d7a0 secure :-1 s=READY pgs=974 gs=1 cs=0 l=1 c_cookie=3174095353642329995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af8009950 tx=0x7f3af802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.519+0000 7f3b09047640 1 -- 10.20.193.4:0/3945653950 shutdown_connections 2026-02-24T09:16:08.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.519+0000 7f3b09047640 1 --2- 10.20.193.4:0/3945653950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b041135c0 0x7f3b04173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.519+0000 7f3b09047640 1 --2- 10.20.193.4:0/3945653950 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b0410ddc0 0x7f3b04112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.519+0000 7f3b09047640 1 --2- 10.20.193.4:0/3945653950 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b0410d3d0 0x7f3b0410d7a0 unknown :-1 s=CLOSED pgs=974 gs=1 cs=0 l=1 c_cookie=3174095353642329995 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.519+0000 7f3b09047640 1 -- 10.20.193.4:0/3945653950 >> 10.20.193.4:0/3945653950 conn(0x7f3b040eaca0 msgr2=0x7f3b0410b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b09047640 1 -- 10.20.193.4:0/3945653950 shutdown_connections 2026-02-24T09:16:08.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b09047640 1 -- 10.20.193.4:0/3945653950 wait complete. 2026-02-24T09:16:08.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b09047640 1 Processor -- start 2026-02-24T09:16:08.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b09047640 1 -- start start 2026-02-24T09:16:08.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b09047640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b0410d3d0 0x7f3b040f5850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b09047640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b0410ddc0 0x7f3b04173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b09047640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b041135c0 0x7f3b040f5f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b09047640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040fb160 con 0x7f3b041135c0 2026-02-24T09:16:08.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b09047640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040fb2d0 con 0x7f3b0410ddc0 2026-02-24T09:16:08.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b09047640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040fb490 con 0x7f3b0410d3d0 2026-02-24T09:16:08.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b03577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b041135c0 0x7f3b040f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b03577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b041135c0 0x7f3b040f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39032/0 (socket says 10.20.193.4:39032) 2026-02-24T09:16:08.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b03577640 1 -- 10.20.193.4:0/198839082 learned_addr learned my addr 10.20.193.4:0/198839082 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:08.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b02d76640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b0410d3d0 0x7f3b040f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b02575640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b0410ddc0 0x7f3b04173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b03577640 1 -- 10.20.193.4:0/198839082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b0410d3d0 msgr2=0x7f3b040f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b03577640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b0410d3d0 0x7f3b040f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b03577640 1 -- 10.20.193.4:0/198839082 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b0410ddc0 msgr2=0x7f3b04173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b03577640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b0410ddc0 0x7f3b04173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.520+0000 7f3b03577640 1 -- 10.20.193.4:0/198839082 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af8009570 con 0x7f3b041135c0 2026-02-24T09:16:08.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.521+0000 7f3b03577640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b041135c0 0x7f3b040f5f50 secure :-1 s=READY pgs=975 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af400f8d0 tx=0x7f3af400fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.521+0000 7f3ae3fff640 1 -- 10.20.193.4:0/198839082 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3af400dce0 con 0x7f3b041135c0 2026-02-24T09:16:08.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.521+0000 7f3b09047640 1 -- 10.20.193.4:0/198839082 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b040fb770 con 0x7f3b041135c0 2026-02-24T09:16:08.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.521+0000 7f3ae3fff640 1 -- 10.20.193.4:0/198839082 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3af400de40 con 0x7f3b041135c0 2026-02-24T09:16:08.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.521+0000 7f3ae3fff640 1 -- 10.20.193.4:0/198839082 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3af4011740 con 0x7f3b041135c0 2026-02-24T09:16:08.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.521+0000 7f3b09047640 1 -- 10.20.193.4:0/198839082 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b040fbc40 con 0x7f3b041135c0 2026-02-24T09:16:08.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.524+0000 7f3ae3fff640 1 -- 10.20.193.4:0/198839082 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f3af4020060 con 0x7f3b041135c0 2026-02-24T09:16:08.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.525+0000 7f3ae3fff640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ad40b56d0 0x7f3ad40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.525+0000 7f3ae3fff640 1 -- 10.20.193.4:0/198839082 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3af4015070 con 0x7f3b041135c0 2026-02-24T09:16:08.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.525+0000 7f3b02d76640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ad40b56d0 0x7f3ad40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.526+0000 7f3b02d76640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ad40b56d0 0x7f3ad40d5b80 secure :-1 s=READY pgs=386 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af80023d0 tx=0x7f3af8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b0b041e00 1 Processor -- start 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b0b041e00 1 -- start start 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18d7d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7d860 0x555c18dc1fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18dc2500 0x555c18de28e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555c18c8dee0 con 0x555c18dc2500 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555c18c89c10 con 0x555c18d7cf50 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555c18c83d70 con 0x555c18d7d860 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b03577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18dc2500 0x555c18de28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b03577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18dc2500 0x555c18de28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39042/0 (socket says 10.20.193.4:39042) 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b03577640 1 -- 10.20.193.4:0/3497455772 learned_addr learned my addr 10.20.193.4:0/3497455772 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b02d76640 1 --2- 10.20.193.4:0/3497455772 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18d7d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b02575640 1 --2- 10.20.193.4:0/3497455772 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7d860 0x555c18dc1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b03577640 1 -- 10.20.193.4:0/3497455772 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7d860 msgr2=0x555c18dc1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b03577640 1 --2- 10.20.193.4:0/3497455772 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7d860 0x555c18dc1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b03577640 1 -- 10.20.193.4:0/3497455772 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 msgr2=0x555c18d7d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b03577640 1 --2- 10.20.193.4:0/3497455772 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18d7d320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b03577640 1 -- 10.20.193.4:0/3497455772 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c18c2f340 con 0x555c18dc2500 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b02575640 1 --2- 10.20.193.4:0/3497455772 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7d860 0x555c18dc1fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3b03577640 1 --2- 10.20.193.4:0/3497455772 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18dc2500 0x555c18de28e0 secure :-1 s=READY pgs=976 gs=1 cs=0 l=1 c_cookie=15487480159942819222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af40aa720 tx=0x7f3af40066e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ee9526374d3d96 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3acb7fe640 1 -- 10.20.193.4:0/3497455772 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3af40aeb50 con 0x555c18dc2500 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3acb7fe640 1 -- 10.20.193.4:0/3497455772 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3af40b3e70 con 0x555c18dc2500 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.527+0000 7f3acb7fe640 1 -- 10.20.193.4:0/3497455772 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3af40adf50 con 0x555c18dc2500 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.528+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3497455772 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18dc2500 msgr2=0x555c18de28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.528+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/3497455772 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18dc2500 0x555c18de28e0 secure :-1 s=READY pgs=976 gs=1 cs=0 l=1 c_cookie=15487480159942819222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af40aa720 tx=0x7f3af40066e0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.528+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3497455772 shutdown_connections 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.528+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/3497455772 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18dc2500 0x555c18de28e0 unknown :-1 s=CLOSED pgs=976 gs=1 cs=0 l=1 c_cookie=15487480159942819222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.528+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/3497455772 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7d860 0x555c18dc1fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.528+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/3497455772 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18d7d320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.528+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3497455772 >> 10.20.193.4:0/3497455772 conn(0x555c18c9bdb0 msgr2=0x555c18d7b830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.528+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3497455772 shutdown_connections 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.528+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3497455772 wait complete. 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b0b041e00 1 -- start start 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b0b041e00 1 Processor -- start 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18dd9d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dda280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18dc2500 0x555c18ddf270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555c18ddf7b0 con 0x555c18d7d860 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555c18ddf920 con 0x555c18d7cf50 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555c18ddfae0 con 0x555c18dc2500 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b02575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dda280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b02575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dda280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39052/0 (socket says 10.20.193.4:39052) 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b02575640 1 -- 10.20.193.4:0/1999965994 learned_addr learned my addr 10.20.193.4:0/1999965994 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b03577640 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18dc2500 0x555c18ddf270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b02575640 1 -- 10.20.193.4:0/1999965994 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18dc2500 msgr2=0x555c18ddf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b02575640 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18dc2500 0x555c18ddf270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b02575640 1 -- 10.20.193.4:0/1999965994 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 msgr2=0x555c18dd9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b02575640 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18dd9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b02575640 1 -- 10.20.193.4:0/1999965994 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c18c079d0 con 0x555c18d7d860 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b02575640 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dda280 secure :-1 s=READY pgs=977 gs=1 cs=0 l=1 c_cookie=6631731563745471445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec004270 tx=0x7f3aec010810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c08a4b886cb6bd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3ac8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/1999965994 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3aec012940 con 0x555c18d7d860 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.529+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1999965994 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b040fbc40 con 0x555c18d7d860 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/1999965994 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3aec01a400 con 0x555c18d7d860 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/1999965994 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3aec011660 con 0x555c18d7d860 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b0b041e00 10 client.17226 _ll_register_callbacks cb 0x555c18c2e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1999965994 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c189d34a0 con 0x555c18d7d860 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/1999965994 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3aec0117f0 con 0x555c18d7d860 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/1999965994 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3aec011a10 con 0x555c18d7d860 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b0b041e00 10 client.17226 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:08.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1999965994 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x555c18c19710 con 0x555c18d7d860 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/1999965994 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f3aec018020 con 0x555c18d7d860 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b0b041e00 10 client.17226 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b0b041e00 10 client.17226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b0b041e00 20 client.17226 populate_metadata read hostname 'trial004' 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555c18dbf7e0 0x555c18dbfc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b0b041e00 4 client.17226 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1999965994 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c18c797b0 con 0x555c18dbf7e0 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.530+0000 7f3b02d76640 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555c18dbf7e0 0x555c18dbfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.531+0000 7f3ac8ff9640 10 client.17226 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.531+0000 7f3b02d76640 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555c18dbf7e0 0x555c18dbfc80 crc :-1 s=READY pgs=145 gs=4 cs=0 l=0 c_cookie=16768513551271184100 s_cookie=10746915561161442186 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8b5ba3b42d7c6e4 server_cookie=9524b6c36625438a in_seq=0 out_seq=0 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/1999965994 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555c18c797b0 con 0x555c18dbf7e0 2026-02-24T09:16:08.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3ac8ff9640 10 client.17226 handle_command_reply: tid=0 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 client.17226 shutdown 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1999965994 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 msgr2=0x555c18dda280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dda280 secure :-1 s=READY pgs=977 gs=1 cs=0 l=1 c_cookie=6631731563745471445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec004270 tx=0x7f3aec010810 comp rx=0 tx=0).stop 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1999965994 shutdown_connections 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555c18dbf7e0 0x555c18dbfc80 crc :-1 s=READY pgs=145 gs=4 cs=0 l=0 c_cookie=16768513551271184100 s_cookie=10746915561161442186 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18dc2500 0x555c18ddf270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dda280 unknown :-1 s=CLOSED pgs=977 gs=1 cs=0 l=1 c_cookie=6631731563745471445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/1999965994 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18dd9d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3ac8ff9640 0 client.17226 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1999965994 >> 10.20.193.4:0/1999965994 conn(0x555c18c9bdb0 msgr2=0x555c18d7b040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1999965994 shutdown_connections 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1999965994 wait complete. 2026-02-24T09:16:08.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.532+0000 7f3b0b041e00 20 client.17226 trim_cache size 0 max 16384 2026-02-24T09:16:08.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.541+0000 7f3b0b041e00 1 Processor -- start 2026-02-24T09:16:08.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b0b041e00 1 -- start start 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7cf50 0x555c18dbd0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dbd5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18dc2500 0x555c18dc1570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555c18ddf670 con 0x555c18d7d860 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555c18c819a0 con 0x555c18dc2500 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555c18a5ddf0 con 0x555c18d7cf50 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dbd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dbd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39064/0 (socket says 10.20.193.4:39064) 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02575640 1 -- 10.20.193.4:0/1593106371 learned_addr learned my addr 10.20.193.4:0/1593106371 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02d76640 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7cf50 0x555c18dbd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02575640 1 -- 10.20.193.4:0/1593106371 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7cf50 msgr2=0x555c18dbd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02575640 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7cf50 0x555c18dbd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02575640 1 -- 10.20.193.4:0/1593106371 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18dc2500 msgr2=0x555c18dc1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b03577640 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18dc2500 0x555c18dc1570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02575640 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18dc2500 0x555c18dc1570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02575640 1 -- 10.20.193.4:0/1593106371 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c18c14190 con 0x555c18d7d860 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02d76640 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7cf50 0x555c18dbd0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b03577640 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18dc2500 0x555c18dc1570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3b02575640 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dbd5f0 secure :-1 s=READY pgs=978 gs=1 cs=0 l=1 c_cookie=15676278701670096002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec00f010 tx=0x7f3aec002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98d546c35115c82 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3acaffd640 1 -- 10.20.193.4:0/1593106371 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3aec02f070 con 0x555c18d7d860 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3acaffd640 1 -- 10.20.193.4:0/1593106371 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3aec027060 con 0x555c18d7d860 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.542+0000 7f3acaffd640 1 -- 10.20.193.4:0/1593106371 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3aec011290 con 0x555c18d7d860 2026-02-24T09:16:08.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.543+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1593106371 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 msgr2=0x555c18dbd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.543+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dbd5f0 secure :-1 s=READY pgs=978 gs=1 cs=0 l=1 c_cookie=15676278701670096002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec00f010 tx=0x7f3aec002390 comp rx=0 tx=0).stop 2026-02-24T09:16:08.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.543+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1593106371 shutdown_connections 2026-02-24T09:16:08.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.543+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18dc2500 0x555c18dc1570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.543+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18dbd5f0 unknown :-1 s=CLOSED pgs=978 gs=1 cs=0 l=1 c_cookie=15676278701670096002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.543+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/1593106371 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18d7cf50 0x555c18dbd0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.543+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1593106371 >> 10.20.193.4:0/1593106371 conn(0x555c18c9bdb0 msgr2=0x555c18dde8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.543+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1593106371 shutdown_connections 2026-02-24T09:16:08.550 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.543+0000 7f3b0b041e00 1 -- 10.20.193.4:0/1593106371 wait complete. 2026-02-24T09:16:08.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.544+0000 7f3b0b041e00 1 -- start start 2026-02-24T09:16:08.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.544+0000 7f3b0b041e00 1 Processor -- start 2026-02-24T09:16:08.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.544+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18d602c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.554 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.544+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18d60800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.544+0000 7f3b0b041e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18dc2500 0x555c18d5f070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.544+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555c18d60d40 con 0x555c18d7d860 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.544+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555c18d60eb0 con 0x555c18d7cf50 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b0b041e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555c18d5f5b0 con 0x555c18dc2500 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18d60800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18d60800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39066/0 (socket says 10.20.193.4:39066) 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02575640 1 -- 10.20.193.4:0/3041556923 learned_addr learned my addr 10.20.193.4:0/3041556923 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02d76640 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18d602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02575640 1 -- 10.20.193.4:0/3041556923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18dc2500 msgr2=0x555c18d5f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02575640 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18dc2500 0x555c18d5f070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02575640 1 -- 10.20.193.4:0/3041556923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 msgr2=0x555c18d602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:08.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02575640 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18d602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02575640 1 -- 10.20.193.4:0/3041556923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c18c07d00 con 0x555c18d7d860 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02d76640 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18d602c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b02575640 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18d60800 secure :-1 s=READY pgs=979 gs=1 cs=0 l=1 c_cookie=2638599880550566809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec00f010 tx=0x7f3aec0116b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249e309c889acb99 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3ac8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/3041556923 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3aec02f040 con 0x555c18d7d860 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3041556923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c18c19710 con 0x555c18d7d860 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b0b041e00 10 client.17232 _ll_register_callbacks cb 0x555c18c2e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3041556923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3af40b3e70 con 0x555c18d7d860 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/3041556923 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3af40b3e70 con 0x555c18d7d860 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/3041556923 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3aec012ea0 con 0x555c18d7d860 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.545+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/3041556923 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3aec0356e0 con 0x555c18d7d860 2026-02-24T09:16:08.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/3041556923 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3aec035930 con 0x555c18d7d860 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3b0b041e00 10 client.17232 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3041556923 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x555c18c19970 con 0x555c18d7d860 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/3041556923 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f3aec03c030 con 0x555c18d7d860 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3b0b041e00 10 client.17232 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3b0b041e00 10 client.17232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3b0b041e00 20 client.17232 populate_metadata read hostname 'trial004' 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555c18e703b0 0x555c18e90860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3b0b041e00 4 client.17232 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3041556923 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c189b8160 con 0x555c18e703b0 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.546+0000 7f3b02d76640 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555c18e703b0 0x555c18e90860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3b02d76640 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555c18e703b0 0x555c18e90860 crc :-1 s=READY pgs=146 gs=4 cs=0 l=0 c_cookie=6854461497402418805 s_cookie=1143685228102357119 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f1ff06a57436675 server_cookie=fdf2fa7cbe7107f in_seq=0 out_seq=0 2026-02-24T09:16:08.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3ac8ff9640 10 client.17232 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3ac8ff9640 1 -- 10.20.193.4:0/3041556923 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c189b8160 con 0x555c18e703b0 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3ac8ff9640 10 client.17232 handle_command_reply: tid=0 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3b0b041e00 1 client.17232 shutdown 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3041556923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 msgr2=0x555c18d60800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18d60800 secure :-1 s=READY pgs=979 gs=1 cs=0 l=1 c_cookie=2638599880550566809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec00f010 tx=0x7f3aec0116b0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3041556923 shutdown_connections 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555c18e703b0 0x555c18e90860 crc :-1 s=READY pgs=146 gs=4 cs=0 l=0 c_cookie=6854461497402418805 s_cookie=1143685228102357119 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555c18dc2500 0x555c18d5f070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555c18d7d860 0x555c18d60800 unknown :-1 s=CLOSED pgs=979 gs=1 cs=0 l=1 c_cookie=2638599880550566809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3ac8ff9640 0 client.17232 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:08.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.547+0000 7f3b0b041e00 1 --2- 10.20.193.4:0/3041556923 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555c18d7cf50 0x555c18d602c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.548+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3041556923 >> 10.20.193.4:0/3041556923 conn(0x555c18c9bdb0 msgr2=0x555c18dd7000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.548+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3041556923 shutdown_connections 2026-02-24T09:16:08.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.548+0000 7f3b0b041e00 1 -- 10.20.193.4:0/3041556923 wait complete. 2026-02-24T09:16:08.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.548+0000 7f3b0b041e00 20 client.17232 trim_cache size 0 max 16384 2026-02-24T09:16:08.559 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:16:08.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.548+0000 7f3b09047640 1 -- 10.20.193.4:0/198839082 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ad40b56d0 msgr2=0x7f3ad40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.548+0000 7f3b09047640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ad40b56d0 0x7f3ad40d5b80 secure :-1 s=READY pgs=386 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af80023d0 tx=0x7f3af8031040 comp rx=0 tx=0).stop 2026-02-24T09:16:08.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.548+0000 7f3b09047640 1 -- 10.20.193.4:0/198839082 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b041135c0 msgr2=0x7f3b040f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:08.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.548+0000 7f3b09047640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b041135c0 0x7f3b040f5f50 secure :-1 s=READY pgs=975 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af400f8d0 tx=0x7f3af400fda0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.549+0000 7f3b09047640 1 -- 10.20.193.4:0/198839082 shutdown_connections 2026-02-24T09:16:08.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.549+0000 7f3b09047640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3ad40b56d0 0x7f3ad40d5b80 unknown :-1 s=CLOSED pgs=386 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.549+0000 7f3b09047640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3b041135c0 0x7f3b040f5f50 unknown :-1 s=CLOSED pgs=975 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.549+0000 7f3b09047640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3b0410ddc0 0x7f3b04173e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.549+0000 7f3b09047640 1 --2- 10.20.193.4:0/198839082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3b0410d3d0 0x7f3b040f5850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:08.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.549+0000 7f3b09047640 1 -- 10.20.193.4:0/198839082 >> 10.20.193.4:0/198839082 conn(0x7f3b040eaca0 msgr2=0x7f3b04110520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:08.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.549+0000 7f3b09047640 1 -- 10.20.193.4:0/198839082 shutdown_connections 2026-02-24T09:16:08.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:08.549+0000 7f3b09047640 1 -- 10.20.193.4:0/198839082 wait complete. 2026-02-24T09:16:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:08 trial004 ceph-mon[41596]: pgmap v342: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 861 MiB/s wr, 240 op/s 2026-02-24T09:16:09.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:08 trial090 ceph-mon[47278]: pgmap v342: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 861 MiB/s wr, 240 op/s 2026-02-24T09:16:09.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:08 trial014 ceph-mon[46941]: pgmap v342: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 861 MiB/s wr, 240 op/s 2026-02-24T09:16:09.663 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:16:09.663 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:16:09.813 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 -- 10.20.193.4:0/2525746644 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2a28115470 msgr2=0x7f2a28175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 --2- 10.20.193.4:0/2525746644 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2a28115470 0x7f2a28175e40 secure :-1 s=READY pgs=980 gs=1 cs=0 l=1 c_cookie=17596057873888980563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a2400aa30 tx=0x7f2a24030280 comp rx=0 tx=0).stop 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 -- 10.20.193.4:0/2525746644 shutdown_connections 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 --2- 10.20.193.4:0/2525746644 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2a28115470 0x7f2a28175e40 unknown :-1 s=CLOSED pgs=980 gs=1 cs=0 l=1 c_cookie=17596057873888980563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 --2- 10.20.193.4:0/2525746644 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2a2810fc70 0x7f2a28114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 --2- 10.20.193.4:0/2525746644 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2a2810f280 0x7f2a2810f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 -- 10.20.193.4:0/2525746644 >> 10.20.193.4:0/2525746644 conn(0x7f2a2805f830 msgr2=0x7f2a2810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 -- 10.20.193.4:0/2525746644 shutdown_connections 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 -- 10.20.193.4:0/2525746644 wait complete. 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 Processor -- start 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.976+0000 7f2a30381640 1 -- start start 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a30381640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2a2810f280 0x7f2a2811db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a30381640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2a2810fc70 0x7f2a2811e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a30381640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2a28115470 0x7f2a28123480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a30381640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28123aa0 con 0x7f2a2810f280 2026-02-24T09:16:09.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a30381640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28123c10 con 0x7f2a28115470 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a30381640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28123dd0 con 0x7f2a2810fc70 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2e0f6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2a2810f280 0x7f2a2811db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2e0f6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2a2810f280 0x7f2a2811db70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39090/0 (socket says 10.20.193.4:39090) 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2e0f6640 1 -- 10.20.193.4:0/3997332891 learned_addr learned my addr 10.20.193.4:0/3997332891 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2a2810fc70 0x7f2a2811e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2e8f7640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2a28115470 0x7f2a28123480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2e0f6640 1 -- 10.20.193.4:0/3997332891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2a2810fc70 msgr2=0x7f2a2811e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2a2810fc70 0x7f2a2811e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2e0f6640 1 -- 10.20.193.4:0/3997332891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2a28115470 msgr2=0x7f2a28123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2a28115470 0x7f2a28123480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2e0f6640 1 -- 10.20.193.4:0/3997332891 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2400a650 con 0x7f2a2810f280 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2a2810f280 0x7f2a2811db70 secure :-1 s=READY pgs=981 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1800b500 tx=0x7f2a1800b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a0f7fe640 1 -- 10.20.193.4:0/3997332891 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a180044a0 con 0x7f2a2810f280 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a30381640 1 -- 10.20.193.4:0/3997332891 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a281240b0 con 0x7f2a2810f280 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a0f7fe640 1 -- 10.20.193.4:0/3997332891 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a18002b80 con 0x7f2a2810f280 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a0f7fe640 1 -- 10.20.193.4:0/3997332891 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1800fd90 con 0x7f2a2810f280 2026-02-24T09:16:09.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.977+0000 7f2a30381640 1 -- 10.20.193.4:0/3997332891 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a28164830 con 0x7f2a2810f280 2026-02-24T09:16:09.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.980+0000 7f2a0f7fe640 1 -- 10.20.193.4:0/3997332891 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f2a18002cf0 con 0x7f2a2810f280 2026-02-24T09:16:09.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.981+0000 7f2a0f7fe640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2a040b56e0 0x7f2a040d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.982+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2a040b56e0 0x7f2a040d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.982+0000 7f2a0f7fe640 1 -- 10.20.193.4:0/3997332891 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2a180e6080 con 0x7f2a2810f280 2026-02-24T09:16:09.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.982+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2a040b56e0 0x7f2a040d5b90 secure :-1 s=READY pgs=387 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c005970 tx=0x7f2a1c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:09.986 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a3237be00 1 Processor -- start 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a3237be00 1 -- start start 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cae56d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb2a370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb4ac90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a3237be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564c6c9f5520 con 0x564c6cae5c10 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a3237be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564c6c9f1250 con 0x564c6cb2a8b0 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a3237be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564c6c9eb3b0 con 0x564c6cae5300 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2d8f5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb2a370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2d8f5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb2a370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39098/0 (socket says 10.20.193.4:39098) 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2d8f5640 1 -- 10.20.193.4:0/2473979757 learned_addr learned my addr 10.20.193.4:0/2473979757 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/2473979757 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cae56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2d8f5640 1 -- 10.20.193.4:0/2473979757 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 msgr2=0x564c6cae56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2e8f7640 1 --2- 10.20.193.4:0/2473979757 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb4ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/2473979757 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cae56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2d8f5640 1 -- 10.20.193.4:0/2473979757 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 msgr2=0x564c6cb4ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:09.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/2473979757 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb4ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2d8f5640 1 -- 10.20.193.4:0/2473979757 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c6c9966e0 con 0x564c6cae5c10 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2e8f7640 1 --2- 10.20.193.4:0/2473979757 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb4ac90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/2473979757 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb2a370 secure :-1 s=READY pgs=982 gs=1 cs=0 l=1 c_cookie=1470932192027817521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c00fd10 tx=0x7f2a1c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1469cd090a813631 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.983+0000 7f2a0c884640 1 -- 10.20.193.4:0/2473979757 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c01e460 con 0x564c6cae5c10 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a0c884640 1 -- 10.20.193.4:0/2473979757 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a1c01eaa0 con 0x564c6cae5c10 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a0c884640 1 -- 10.20.193.4:0/2473979757 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c010be0 con 0x564c6cae5c10 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a3237be00 1 -- 10.20.193.4:0/2473979757 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 msgr2=0x564c6cb2a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2473979757 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb2a370 secure :-1 s=READY pgs=982 gs=1 cs=0 l=1 c_cookie=1470932192027817521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c00fd10 tx=0x7f2a1c012000 comp rx=0 tx=0).stop 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a3237be00 1 -- 10.20.193.4:0/2473979757 shutdown_connections 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2473979757 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb4ac90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2473979757 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb2a370 unknown :-1 s=CLOSED pgs=982 gs=1 cs=0 l=1 c_cookie=1470932192027817521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2473979757 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cae56d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a3237be00 1 -- 10.20.193.4:0/2473979757 >> 10.20.193.4:0/2473979757 conn(0x564c6ca034f0 msgr2=0x564c6cae3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a3237be00 1 -- 10.20.193.4:0/2473979757 shutdown_connections 2026-02-24T09:16:09.988 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.984+0000 7f2a3237be00 1 -- 10.20.193.4:0/2473979757 wait complete. 2026-02-24T09:16:09.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a3237be00 1 -- start start 2026-02-24T09:16:09.989 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a3237be00 1 Processor -- start 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5300 0x564c6cafd2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5c10 0x564c6cafd830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb02820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a3237be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564c6cb02d60 con 0x564c6cae5300 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a3237be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564c6cb02ed0 con 0x564c6cb2a8b0 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a3237be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564c6cb03090 con 0x564c6cae5c10 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2e0f6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5300 0x564c6cafd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2e0f6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5300 0x564c6cafd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39110/0 (socket says 10.20.193.4:39110) 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2e0f6640 1 -- 10.20.193.4:0/2416260660 learned_addr learned my addr 10.20.193.4:0/2416260660 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5c10 0x564c6cafd830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2e8f7640 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb02820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2e0f6640 1 -- 10.20.193.4:0/2416260660 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5c10 msgr2=0x564c6cafd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5c10 0x564c6cafd830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2e0f6640 1 -- 10.20.193.4:0/2416260660 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 msgr2=0x564c6cb02820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb02820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2e0f6640 1 -- 10.20.193.4:0/2416260660 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c6c96ecd0 con 0x564c6cae5300 2026-02-24T09:16:09.990 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5300 0x564c6cafd2f0 secure :-1 s=READY pgs=983 gs=1 cs=0 l=1 c_cookie=13953905364664656763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a18006fd0 tx=0x7f2a18004880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a63aff8a41237b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f29d7fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.985+0000 7f29d7fff640 1 -- 10.20.193.4:0/2416260660 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a180ad260 con 0x564c6cae5300 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 1 -- 10.20.193.4:0/2416260660 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a1c00f9b0 con 0x564c6cae5300 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f29d7fff640 1 -- 10.20.193.4:0/2416260660 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a1805a2d0 con 0x564c6cae5300 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f29d7fff640 1 -- 10.20.193.4:0/2416260660 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a18071540 con 0x564c6cae5300 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 10 client.17244 _ll_register_callbacks cb 0x564c6c967790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 1 -- 10.20.193.4:0/2416260660 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564c6c6789d0 con 0x564c6cae5300 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f29d7fff640 1 -- 10.20.193.4:0/2416260660 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2a180716c0 con 0x564c6cae5300 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f29d7fff640 1 -- 10.20.193.4:0/2416260660 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2a180aa390 con 0x564c6cae5300 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 10 client.17244 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 1 -- 10.20.193.4:0/2416260660 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564c6c980ab0 con 0x564c6cae5300 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f29d7fff640 1 -- 10.20.193.4:0/2416260660 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2a180c6060 con 0x564c6cae5300 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 10 client.17244 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 10 client.17244 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 20 client.17244 populate_metadata read hostname 'trial004' 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564c6cb27bc0 0x564c6cb28060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 4 client.17244 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a3237be00 1 -- 10.20.193.4:0/2416260660 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c6c9fbb70 con 0x564c6cb27bc0 2026-02-24T09:16:09.991 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.986+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564c6cb27bc0 0x564c6cb28060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f29d7fff640 10 client.17244 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564c6cb27bc0 0x564c6cb28060 crc :-1 s=READY pgs=147 gs=4 cs=0 l=0 c_cookie=15323589687838735731 s_cookie=13089226412671271005 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4a853a21b777d73 server_cookie=b5a6461297ee805d in_seq=0 out_seq=0 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f29d7fff640 1 -- 10.20.193.4:0/2416260660 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564c6c9fbb70 con 0x564c6cb27bc0 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f29d7fff640 10 client.17244 handle_command_reply: tid=0 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f2a3237be00 1 client.17244 shutdown 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f2a3237be00 1 -- 10.20.193.4:0/2416260660 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5300 msgr2=0x564c6cafd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5300 0x564c6cafd2f0 secure :-1 s=READY pgs=983 gs=1 cs=0 l=1 c_cookie=13953905364664656763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a18006fd0 tx=0x7f2a18004880 comp rx=0 tx=0).stop 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f2a3237be00 1 -- 10.20.193.4:0/2416260660 shutdown_connections 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564c6cb27bc0 0x564c6cb28060 crc :-1 s=READY pgs=147 gs=4 cs=0 l=0 c_cookie=15323589687838735731 s_cookie=13089226412671271005 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb02820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5c10 0x564c6cafd830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2416260660 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5300 0x564c6cafd2f0 unknown :-1 s=CLOSED pgs=983 gs=1 cs=0 l=1 c_cookie=13953905364664656763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f29d7fff640 0 client.17244 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.987+0000 7f2a3237be00 1 -- 10.20.193.4:0/2416260660 >> 10.20.193.4:0/2416260660 conn(0x564c6ca034f0 msgr2=0x564c6cae42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.988+0000 7f2a3237be00 1 -- 10.20.193.4:0/2416260660 shutdown_connections 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.988+0000 7f2a3237be00 1 -- 10.20.193.4:0/2416260660 wait complete. 2026-02-24T09:16:09.992 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.988+0000 7f2a3237be00 20 client.17244 trim_cache size 0 max 16384 2026-02-24T09:16:10.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:09.999+0000 7f2a3237be00 1 Processor -- start 2026-02-24T09:16:10.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a3237be00 1 -- start start 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cae44f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cae5c10 0x564c6cae4a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cb2a8b0 0x564c6cb29950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a3237be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564c6c9e8fe0 con 0x564c6cb2a8b0 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a3237be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564c6c6b3fe0 con 0x564c6cae5c10 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a3237be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564c6caf65b0 con 0x564c6cae5300 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2e8f7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cb2a8b0 0x564c6cb29950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2e8f7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cb2a8b0 0x564c6cb29950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39124/0 (socket says 10.20.193.4:39124) 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2e8f7640 1 -- 10.20.193.4:0/1992884424 learned_addr learned my addr 10.20.193.4:0/1992884424 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/1992884424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cae44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/1992884424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cae5c10 0x564c6cae4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2e8f7640 1 -- 10.20.193.4:0/1992884424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 msgr2=0x564c6cae44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2e8f7640 1 --2- 10.20.193.4:0/1992884424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cae44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2e8f7640 1 -- 10.20.193.4:0/1992884424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cae5c10 msgr2=0x564c6cae4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2e8f7640 1 --2- 10.20.193.4:0/1992884424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cae5c10 0x564c6cae4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2e8f7640 1 -- 10.20.193.4:0/1992884424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c6c97b530 con 0x564c6cb2a8b0 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/1992884424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cae5c10 0x564c6cae4a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f2a2e8f7640 1 --2- 10.20.193.4:0/1992884424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cb2a8b0 0x564c6cb29950 secure :-1 s=READY pgs=984 gs=1 cs=0 l=1 c_cookie=7755972564677513428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a2400a230 tx=0x7f2a24032040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba2bff4654750d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f29f64e6640 1 -- 10.20.193.4:0/1992884424 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a24003ea0 con 0x564c6cb2a8b0 2026-02-24T09:16:10.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f29f64e6640 1 -- 10.20.193.4:0/1992884424 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a24039470 con 0x564c6cb2a8b0 2026-02-24T09:16:10.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.000+0000 7f29f64e6640 1 -- 10.20.193.4:0/1992884424 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a24005340 con 0x564c6cb2a8b0 2026-02-24T09:16:10.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.001+0000 7f2a3237be00 1 -- 10.20.193.4:0/1992884424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cb2a8b0 msgr2=0x564c6cb29950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.001+0000 7f2a3237be00 1 --2- 10.20.193.4:0/1992884424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cb2a8b0 0x564c6cb29950 secure :-1 s=READY pgs=984 gs=1 cs=0 l=1 c_cookie=7755972564677513428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a2400a230 tx=0x7f2a24032040 comp rx=0 tx=0).stop 2026-02-24T09:16:10.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.001+0000 7f2a3237be00 1 -- 10.20.193.4:0/1992884424 shutdown_connections 2026-02-24T09:16:10.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.001+0000 7f2a3237be00 1 --2- 10.20.193.4:0/1992884424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cb2a8b0 0x564c6cb29950 unknown :-1 s=CLOSED pgs=984 gs=1 cs=0 l=1 c_cookie=7755972564677513428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.001+0000 7f2a3237be00 1 --2- 10.20.193.4:0/1992884424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cae5c10 0x564c6cae4a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.001+0000 7f2a3237be00 1 --2- 10.20.193.4:0/1992884424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cae44f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.001+0000 7f2a3237be00 1 -- 10.20.193.4:0/1992884424 >> 10.20.193.4:0/1992884424 conn(0x564c6ca034f0 msgr2=0x564c6cb01e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:10.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.001+0000 7f2a3237be00 1 -- 10.20.193.4:0/1992884424 shutdown_connections 2026-02-24T09:16:10.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.001+0000 7f2a3237be00 1 -- 10.20.193.4:0/1992884424 wait complete. 2026-02-24T09:16:10.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a3237be00 1 -- start start 2026-02-24T09:16:10.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a3237be00 1 Processor -- start 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cb03600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb03b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a3237be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb04080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a3237be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564c6cb02930 con 0x564c6cae5c10 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a3237be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564c6cb08860 con 0x564c6cb2a8b0 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a3237be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564c6cb08a20 con 0x564c6cae5300 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a2d8f5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb03b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a2d8f5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb03b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39130/0 (socket says 10.20.193.4:39130) 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a2d8f5640 1 -- 10.20.193.4:0/2849391796 learned_addr learned my addr 10.20.193.4:0/2849391796 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cb03600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a2d8f5640 1 -- 10.20.193.4:0/2849391796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 msgr2=0x564c6cb03600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cb03600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a2d8f5640 1 -- 10.20.193.4:0/2849391796 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 msgr2=0x564c6cb04080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb04080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a2d8f5640 1 -- 10.20.193.4:0/2849391796 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c6c96f000 con 0x564c6cae5c10 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.002+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cb03600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a2d8f5640 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb03b40 secure :-1 s=READY pgs=985 gs=1 cs=0 l=1 c_cookie=11761086787148289261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c002fd0 tx=0x7f2a1c010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a337c61eb88394ed server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f29d7fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f29d7fff640 1 -- 10.20.193.4:0/2849391796 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c030030 con 0x564c6cae5c10 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f29d7fff640 1 -- 10.20.193.4:0/2849391796 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2a1c031040 con 0x564c6cae5c10 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f29d7fff640 1 -- 10.20.193.4:0/2849391796 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2a1c036320 con 0x564c6cae5c10 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 1 -- 10.20.193.4:0/2849391796 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a24041040 con 0x564c6cae5c10 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f29d7fff640 1 -- 10.20.193.4:0/2849391796 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2a1c036e40 con 0x564c6cae5c10 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f29d7fff640 10 client.17250 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 10 client.17250 _ll_register_callbacks cb 0x564c6c967790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 1 -- 10.20.193.4:0/2849391796 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564c6c9fd7e0 con 0x564c6cae5c10 2026-02-24T09:16:10.007 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f29d7fff640 1 -- 10.20.193.4:0/2849391796 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2a1c036480 con 0x564c6cae5c10 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 10 client.17250 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 1 -- 10.20.193.4:0/2849391796 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564c6c980d10 con 0x564c6cae5c10 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f29d7fff640 1 -- 10.20.193.4:0/2849391796 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2a1c03d020 con 0x564c6cae5c10 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 10 client.17250 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 10 client.17250 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 20 client.17250 populate_metadata read hostname 'trial004' 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564c6cbd83c0 0x564c6cbf8870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 4 client.17250 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.003+0000 7f2a3237be00 1 -- 10.20.193.4:0/2849391796 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564c6c676220 con 0x564c6cbd83c0 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.004+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564c6cbd83c0 0x564c6cbf8870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.004+0000 7f2a2e0f6640 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564c6cbd83c0 0x564c6cbf8870 crc :-1 s=READY pgs=148 gs=4 cs=0 l=0 c_cookie=14418584504181380350 s_cookie=315081169845949710 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8191a36afaed4fe server_cookie=45f64a79415150e in_seq=0 out_seq=0 2026-02-24T09:16:10.008 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.004+0000 7f29d7fff640 10 client.17250 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f29d7fff640 1 -- 10.20.193.4:0/2849391796 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564c6c676220 con 0x564c6cbd83c0 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f29d7fff640 10 client.17250 handle_command_reply: tid=0 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 client.17250 shutdown 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 -- 10.20.193.4:0/2849391796 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 msgr2=0x564c6cb03b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb03b40 secure :-1 s=READY pgs=985 gs=1 cs=0 l=1 c_cookie=11761086787148289261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c002fd0 tx=0x7f2a1c010730 comp rx=0 tx=0).stop 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 -- 10.20.193.4:0/2849391796 shutdown_connections 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564c6cbd83c0 0x564c6cbf8870 crc :-1 s=READY pgs=148 gs=4 cs=0 l=0 c_cookie=14418584504181380350 s_cookie=315081169845949710 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564c6cb2a8b0 0x564c6cb04080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564c6cae5c10 0x564c6cb03b40 unknown :-1 s=CLOSED pgs=985 gs=1 cs=0 l=1 c_cookie=11761086787148289261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f29d7fff640 0 client.17250 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 --2- 10.20.193.4:0/2849391796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564c6cae5300 0x564c6cb03600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 -- 10.20.193.4:0/2849391796 >> 10.20.193.4:0/2849391796 conn(0x564c6ca034f0 msgr2=0x564c6cb00550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 -- 10.20.193.4:0/2849391796 shutdown_connections 2026-02-24T09:16:10.009 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 1 -- 10.20.193.4:0/2849391796 wait complete. 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.005+0000 7f2a3237be00 20 client.17250 trim_cache size 0 max 16384 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "6a3e476f-236c-4f0d-be47-9df08723e765", 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 -- 10.20.193.4:0/3997332891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2a040b56e0 msgr2=0x7f2a040d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2a040b56e0 0x7f2a040d5b90 secure :-1 s=READY pgs=387 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1c005970 tx=0x7f2a1c005900 comp rx=0 tx=0).stop 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 -- 10.20.193.4:0/3997332891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2a2810f280 msgr2=0x7f2a2811db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2a2810f280 0x7f2a2811db70 secure :-1 s=READY pgs=981 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a1800b500 tx=0x7f2a1800b9d0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 -- 10.20.193.4:0/3997332891 shutdown_connections 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2a040b56e0 0x7f2a040d5b90 unknown :-1 s=CLOSED pgs=387 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.010 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2a28115470 0x7f2a28123480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2a2810fc70 0x7f2a2811e0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 --2- 10.20.193.4:0/3997332891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2a2810f280 0x7f2a2811db70 unknown :-1 s=CLOSED pgs=981 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 -- 10.20.193.4:0/3997332891 >> 10.20.193.4:0/3997332891 conn(0x7f2a2805f830 msgr2=0x7f2a2810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:10.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 -- 10.20.193.4:0/3997332891 shutdown_connections 2026-02-24T09:16:10.011 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.006+0000 7f2a30381640 1 -- 10.20.193.4:0/3997332891 wait complete. 2026-02-24T09:16:10.119 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:16:10.278 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:10.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.436+0000 7f050e0b3640 1 -- 10.20.193.4:0/2579550732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05081135c0 msgr2=0x7f0508173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.436+0000 7f050e0b3640 1 --2- 10.20.193.4:0/2579550732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05081135c0 0x7f0508173f90 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=1155171716248539428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04fc00aa30 tx=0x7f04fc030280 comp rx=0 tx=0).stop 2026-02-24T09:16:10.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.436+0000 7f050e0b3640 1 -- 10.20.193.4:0/2579550732 shutdown_connections 2026-02-24T09:16:10.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.436+0000 7f050e0b3640 1 --2- 10.20.193.4:0/2579550732 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05081135c0 0x7f0508173f90 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=1155171716248539428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.436+0000 7f050e0b3640 1 --2- 10.20.193.4:0/2579550732 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f050810ddc0 0x7f0508112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.436+0000 7f050e0b3640 1 --2- 10.20.193.4:0/2579550732 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f050810d3d0 0x7f050810d7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.436+0000 7f050e0b3640 1 -- 10.20.193.4:0/2579550732 >> 10.20.193.4:0/2579550732 conn(0x7f05080eaca0 msgr2=0x7f050810b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:10.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.436+0000 7f050e0b3640 1 -- 10.20.193.4:0/2579550732 shutdown_connections 2026-02-24T09:16:10.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.436+0000 7f050e0b3640 1 -- 10.20.193.4:0/2579550732 wait complete. 2026-02-24T09:16:10.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f050e0b3640 1 Processor -- start 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f050e0b3640 1 -- start start 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f050e0b3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f050810d3d0 0x7f05080f58c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f050e0b3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810ddc0 0x7f0508173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f050e0b3640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f05081135c0 0x7f05080f5fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f050e0b3640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f05080fb1d0 con 0x7f050810d3d0 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f050e0b3640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f05080fb340 con 0x7f05081135c0 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f050e0b3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05080fb500 con 0x7f050810ddc0 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f05077fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f050810d3d0 0x7f05080f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f05077fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f050810d3d0 0x7f05080f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39152/0 (socket says 10.20.193.4:39152) 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f05077fe640 1 -- 10.20.193.4:0/3039206026 learned_addr learned my addr 10.20.193.4:0/3039206026 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f0507fff640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f05081135c0 0x7f05080f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f0506ffd640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810ddc0 0x7f0508173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f05077fe640 1 -- 10.20.193.4:0/3039206026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810ddc0 msgr2=0x7f0508173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f05077fe640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810ddc0 0x7f0508173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f05077fe640 1 -- 10.20.193.4:0/3039206026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f05081135c0 msgr2=0x7f05080f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f05077fe640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f05081135c0 0x7f05080f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.437+0000 7f05077fe640 1 -- 10.20.193.4:0/3039206026 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f40094b0 con 0x7f050810d3d0 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.438+0000 7f05077fe640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f050810d3d0 0x7f05080f58c0 secure :-1 s=READY pgs=986 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04f4009fd0 tx=0x7f04f4002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.438+0000 7f0504ff9640 1 -- 10.20.193.4:0/3039206026 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04f400ece0 con 0x7f050810d3d0 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.438+0000 7f050e0b3640 1 -- 10.20.193.4:0/3039206026 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc00a650 con 0x7f050810d3d0 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.438+0000 7f050e0b3640 1 -- 10.20.193.4:0/3039206026 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05080fbb70 con 0x7f050810d3d0 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.438+0000 7f0504ff9640 1 -- 10.20.193.4:0/3039206026 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f04f400ee40 con 0x7f050810d3d0 2026-02-24T09:16:10.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.438+0000 7f0504ff9640 1 -- 10.20.193.4:0/3039206026 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04f4018810 con 0x7f050810d3d0 2026-02-24T09:16:10.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.441+0000 7f0504ff9640 1 -- 10.20.193.4:0/3039206026 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f04f4016020 con 0x7f050810d3d0 2026-02-24T09:16:10.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.442+0000 7f0504ff9640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04dc0b5750 0x7f04dc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.442+0000 7f0504ff9640 1 -- 10.20.193.4:0/3039206026 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f04f40e6bb0 con 0x7f050810d3d0 2026-02-24T09:16:10.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.442+0000 7f0506ffd640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04dc0b5750 0x7f04dc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.443+0000 7f0506ffd640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04dc0b5750 0x7f04dc0d5c00 secure :-1 s=READY pgs=388 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05080fc260 tx=0x7f04f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:10.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.444+0000 7f05100ade00 1 Processor -- start 2026-02-24T09:16:10.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f05100ade00 1 -- start start 2026-02-24T09:16:10.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f05100ade00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 0x562c11d7dbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f05100ade00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11dc2890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f05100ade00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11de31b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f05100ade00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562c11c8dde0 con 0x562c11dc2dd0 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f05100ade00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562c11c89b10 con 0x562c11d7d820 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f05100ade00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562c11c83ab0 con 0x562c11d7e130 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f0507fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11de31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f0507fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11de31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39162/0 (socket says 10.20.193.4:39162) 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f0507fff640 1 -- 10.20.193.4:0/577129161 learned_addr learned my addr 10.20.193.4:0/577129161 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f05077fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 0x562c11d7dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f0506ffd640 1 --2- 10.20.193.4:0/577129161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11dc2890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f0507fff640 1 -- 10.20.193.4:0/577129161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 msgr2=0x562c11dc2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f0507fff640 1 --2- 10.20.193.4:0/577129161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11dc2890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f0507fff640 1 -- 10.20.193.4:0/577129161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 msgr2=0x562c11d7dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f0507fff640 1 --2- 10.20.193.4:0/577129161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 0x562c11d7dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f0507fff640 1 -- 10.20.193.4:0/577129161 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c11c2f310 con 0x562c11dc2dd0 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f05077fe640 1 --2- 10.20.193.4:0/577129161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 0x562c11d7dbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f0507fff640 1 --2- 10.20.193.4:0/577129161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11de31b0 secure :-1 s=READY pgs=987 gs=1 cs=0 l=1 c_cookie=8126926428495323546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04fc006d60 tx=0x7f04fc006d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c8a4874632a19a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f04cbfff640 1 -- 10.20.193.4:0/577129161 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04fc03e050 con 0x562c11dc2dd0 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f04cbfff640 1 -- 10.20.193.4:0/577129161 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f04fc03f040 con 0x562c11dc2dd0 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.445+0000 7f04cbfff640 1 -- 10.20.193.4:0/577129161 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04fc0050c0 con 0x562c11dc2dd0 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.446+0000 7f05100ade00 1 -- 10.20.193.4:0/577129161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 msgr2=0x562c11de31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.446+0000 7f05100ade00 1 --2- 10.20.193.4:0/577129161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11de31b0 secure :-1 s=READY pgs=987 gs=1 cs=0 l=1 c_cookie=8126926428495323546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04fc006d60 tx=0x7f04fc006d90 comp rx=0 tx=0).stop 2026-02-24T09:16:10.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.446+0000 7f05100ade00 1 -- 10.20.193.4:0/577129161 shutdown_connections 2026-02-24T09:16:10.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.446+0000 7f05100ade00 1 --2- 10.20.193.4:0/577129161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11de31b0 unknown :-1 s=CLOSED pgs=987 gs=1 cs=0 l=1 c_cookie=8126926428495323546 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.446+0000 7f05100ade00 1 --2- 10.20.193.4:0/577129161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11dc2890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.446+0000 7f05100ade00 1 --2- 10.20.193.4:0/577129161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 0x562c11d7dbf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.446+0000 7f05100ade00 1 -- 10.20.193.4:0/577129161 >> 10.20.193.4:0/577129161 conn(0x562c11c9c6b0 msgr2=0x562c11d7c100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:10.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.446+0000 7f05100ade00 1 -- 10.20.193.4:0/577129161 shutdown_connections 2026-02-24T09:16:10.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.446+0000 7f05100ade00 1 -- 10.20.193.4:0/577129161 wait complete. 2026-02-24T09:16:10.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f05100ade00 1 -- start start 2026-02-24T09:16:10.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f05100ade00 1 Processor -- start 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f05100ade00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 0x562c11d95d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f05100ade00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11d962c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f05100ade00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11d9b2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f05100ade00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562c11d9b7f0 con 0x562c11dc2dd0 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f05100ade00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562c11d9b960 con 0x562c11d7d820 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f05100ade00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562c11d9bb20 con 0x562c11d7e130 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f0507fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11d9b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f0507fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11d9b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39176/0 (socket says 10.20.193.4:39176) 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f0507fff640 1 -- 10.20.193.4:0/1439755852 learned_addr learned my addr 10.20.193.4:0/1439755852 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f05077fe640 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 0x562c11d95d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f0506ffd640 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11d962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f0507fff640 1 -- 10.20.193.4:0/1439755852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 msgr2=0x562c11d962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f0507fff640 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11d962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f0507fff640 1 -- 10.20.193.4:0/1439755852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 msgr2=0x562c11d95d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f0507fff640 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 0x562c11d95d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f0507fff640 1 -- 10.20.193.4:0/1439755852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0508174800 con 0x562c11dc2dd0 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f0507fff640 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11d9b2b0 secure :-1 s=READY pgs=988 gs=1 cs=0 l=1 c_cookie=4957335064060847049 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04fc007010 tx=0x7f04fc030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cbfdf9c5ef63c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f04c97fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.448+0000 7f04c97fa640 1 -- 10.20.193.4:0/1439755852 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04fc0050c0 con 0x562c11dc2dd0 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 1 -- 10.20.193.4:0/1439755852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05080fbb70 con 0x562c11dc2dd0 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f04c97fa640 1 -- 10.20.193.4:0/1439755852 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f04fc039660 con 0x562c11dc2dd0 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f04c97fa640 1 -- 10.20.193.4:0/1439755852 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04fc0439d0 con 0x562c11dc2dd0 2026-02-24T09:16:10.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f04c97fa640 1 -- 10.20.193.4:0/1439755852 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f04fc043ba0 con 0x562c11dc2dd0 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f04c97fa640 10 client.17262 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 10 client.17262 _ll_register_callbacks cb 0x562c11c1f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 1 -- 10.20.193.4:0/1439755852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c119d34a0 con 0x562c11dc2dd0 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f04c97fa640 1 -- 10.20.193.4:0/1439755852 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f04fc0435e0 con 0x562c11dc2dd0 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 10 client.17262 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 1 -- 10.20.193.4:0/1439755852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562c11c078c0 con 0x562c11dc2dd0 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f04c97fa640 1 -- 10.20.193.4:0/1439755852 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f04fc005250 con 0x562c11dc2dd0 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 10 client.17262 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 10 client.17262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 20 client.17262 populate_metadata read hostname 'trial004' 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562c11dc0260 0x562c11dc0700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 4 client.17262 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.449+0000 7f05100ade00 1 -- 10.20.193.4:0/1439755852 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c11c794f0 con 0x562c11dc0260 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.450+0000 7f05077fe640 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562c11dc0260 0x562c11dc0700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.450+0000 7f04c97fa640 10 client.17262 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.450+0000 7f05077fe640 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562c11dc0260 0x562c11dc0700 crc :-1 s=READY pgs=149 gs=4 cs=0 l=0 c_cookie=5798846864918341157 s_cookie=9503444222666311745 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5079a48002586625 server_cookie=83e3042b4ac38841 in_seq=0 out_seq=0 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.450+0000 7f04c97fa640 1 -- 10.20.193.4:0/1439755852 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562c11c794f0 con 0x562c11dc0260 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.450+0000 7f04c97fa640 10 client.17262 handle_command_reply: tid=0 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.450+0000 7f05100ade00 1 client.17262 shutdown 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 1 -- 10.20.193.4:0/1439755852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 msgr2=0x562c11d9b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11d9b2b0 secure :-1 s=READY pgs=988 gs=1 cs=0 l=1 c_cookie=4957335064060847049 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04fc007010 tx=0x7f04fc030cf0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 1 -- 10.20.193.4:0/1439755852 shutdown_connections 2026-02-24T09:16:10.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562c11dc0260 0x562c11dc0700 crc :-1 s=READY pgs=149 gs=4 cs=0 l=0 c_cookie=5798846864918341157 s_cookie=9503444222666311745 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11dc2dd0 0x562c11d9b2b0 unknown :-1 s=CLOSED pgs=988 gs=1 cs=0 l=1 c_cookie=4957335064060847049 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11d962c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f04c97fa640 0 client.17262 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:10.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 1 --2- 10.20.193.4:0/1439755852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7d820 0x562c11d95d80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 1 -- 10.20.193.4:0/1439755852 >> 10.20.193.4:0/1439755852 conn(0x562c11c9c6b0 msgr2=0x562c11d7c810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:10.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 1 -- 10.20.193.4:0/1439755852 shutdown_connections 2026-02-24T09:16:10.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 1 -- 10.20.193.4:0/1439755852 wait complete. 2026-02-24T09:16:10.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.451+0000 7f05100ade00 20 client.17262 trim_cache size 0 max 16384 2026-02-24T09:16:10.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05100ade00 1 Processor -- start 2026-02-24T09:16:10.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05100ade00 1 -- start start 2026-02-24T09:16:10.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05100ade00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11dc0dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05100ade00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11dc1300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05100ade00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11dc0260 0x562c11dc1840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05100ade00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562c11c816e0 con 0x562c11d7d820 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05100ade00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562c1194cf50 con 0x562c11dc0260 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05100ade00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562c11cf0150 con 0x562c11d7e130 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05077fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11dc0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05077fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11dc0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39192/0 (socket says 10.20.193.4:39192) 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.464+0000 7f05077fe640 1 -- 10.20.193.4:0/4203923357 learned_addr learned my addr 10.20.193.4:0/4203923357 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.465+0000 7f0507fff640 1 --2- 10.20.193.4:0/4203923357 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11dc0260 0x562c11dc1840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.465+0000 7f05077fe640 1 -- 10.20.193.4:0/4203923357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 msgr2=0x562c11dc1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.465+0000 7f05077fe640 1 --2- 10.20.193.4:0/4203923357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11dc1300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.465+0000 7f05077fe640 1 -- 10.20.193.4:0/4203923357 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11dc0260 msgr2=0x562c11dc1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.465+0000 7f05077fe640 1 --2- 10.20.193.4:0/4203923357 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11dc0260 0x562c11dc1840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.465+0000 7f05077fe640 1 -- 10.20.193.4:0/4203923357 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c11c196e0 con 0x562c11d7d820 2026-02-24T09:16:10.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.465+0000 7f05077fe640 1 --2- 10.20.193.4:0/4203923357 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11dc0dc0 secure :-1 s=READY pgs=989 gs=1 cs=0 l=1 c_cookie=1858338256534611128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04f4009230 tx=0x7f04f40e4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ca24cc6543a4b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:10.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.465+0000 7f04cb7fe640 1 -- 10.20.193.4:0/4203923357 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04f40b2c40 con 0x562c11d7d820 2026-02-24T09:16:10.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.465+0000 7f04cb7fe640 1 -- 10.20.193.4:0/4203923357 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f04f40b5220 con 0x562c11d7d820 2026-02-24T09:16:10.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.465+0000 7f04cb7fe640 1 -- 10.20.193.4:0/4203923357 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04f40acd40 con 0x562c11d7d820 2026-02-24T09:16:10.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.466+0000 7f05100ade00 1 -- 10.20.193.4:0/4203923357 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 msgr2=0x562c11dc0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.466+0000 7f05100ade00 1 --2- 10.20.193.4:0/4203923357 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11dc0dc0 secure :-1 s=READY pgs=989 gs=1 cs=0 l=1 c_cookie=1858338256534611128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04f4009230 tx=0x7f04f40e4040 comp rx=0 tx=0).stop 2026-02-24T09:16:10.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.466+0000 7f05100ade00 1 -- 10.20.193.4:0/4203923357 shutdown_connections 2026-02-24T09:16:10.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.466+0000 7f05100ade00 1 --2- 10.20.193.4:0/4203923357 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11dc0260 0x562c11dc1840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.466+0000 7f05100ade00 1 --2- 10.20.193.4:0/4203923357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11d7e130 0x562c11dc1300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.466+0000 7f05100ade00 1 --2- 10.20.193.4:0/4203923357 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11dc0dc0 unknown :-1 s=CLOSED pgs=989 gs=1 cs=0 l=1 c_cookie=1858338256534611128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.466+0000 7f05100ade00 1 -- 10.20.193.4:0/4203923357 >> 10.20.193.4:0/4203923357 conn(0x562c11c9c6b0 msgr2=0x562c11d7ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:10.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.466+0000 7f05100ade00 1 -- 10.20.193.4:0/4203923357 shutdown_connections 2026-02-24T09:16:10.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.466+0000 7f05100ade00 1 -- 10.20.193.4:0/4203923357 wait complete. 2026-02-24T09:16:10.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05100ade00 1 -- start start 2026-02-24T09:16:10.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05100ade00 1 Processor -- start 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05100ade00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11d9fa40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05100ade00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7e130 0x562c11d9ff80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05100ade00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11dc0260 0x562c11e28300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05100ade00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562c11da0700 con 0x562c11d7d820 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05100ade00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562c11da0870 con 0x562c11d7e130 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05100ade00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562c11e28840 con 0x562c11dc0260 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05077fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11d9fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05077fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11d9fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39194/0 (socket says 10.20.193.4:39194) 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05077fe640 1 -- 10.20.193.4:0/773037085 learned_addr learned my addr 10.20.193.4:0/773037085 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f0506ffd640 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7e130 0x562c11d9ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05077fe640 1 -- 10.20.193.4:0/773037085 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11dc0260 msgr2=0x562c11e28300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05077fe640 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11dc0260 0x562c11e28300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05077fe640 1 -- 10.20.193.4:0/773037085 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7e130 msgr2=0x562c11d9ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05077fe640 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7e130 0x562c11d9ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05077fe640 1 -- 10.20.193.4:0/773037085 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c11c14160 con 0x562c11d7d820 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05077fe640 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11d9fa40 secure :-1 s=READY pgs=990 gs=1 cs=0 l=1 c_cookie=10932184348736423867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04f40a96e0 tx=0x7f04f4010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b6ebbe758507bb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f04c97fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f04c97fa640 1 -- 10.20.193.4:0/773037085 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04f40d22d0 con 0x562c11d7d820 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f04c97fa640 1 -- 10.20.193.4:0/773037085 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f04f40b8060 con 0x562c11d7d820 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f04c97fa640 1 -- 10.20.193.4:0/773037085 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04f40b7ea0 con 0x562c11d7d820 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.467+0000 7f05100ade00 1 -- 10.20.193.4:0/773037085 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc00a650 con 0x562c11d7d820 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f04c97fa640 1 -- 10.20.193.4:0/773037085 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f04f40aaf00 con 0x562c11d7d820 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f04c97fa640 10 client.17268 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f05100ade00 10 client.17268 _ll_register_callbacks cb 0x562c11c1f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:10.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f05100ade00 1 -- 10.20.193.4:0/773037085 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c1190ef40 con 0x562c11d7d820 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f04c97fa640 1 -- 10.20.193.4:0/773037085 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f04f40ade60 con 0x562c11d7d820 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f05100ade00 10 client.17268 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f05100ade00 1 -- 10.20.193.4:0/773037085 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562c11c07bf0 con 0x562c11d7d820 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f04c97fa640 1 -- 10.20.193.4:0/773037085 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f04f40b1040 con 0x562c11d7d820 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f05100ade00 10 client.17268 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f05100ade00 10 client.17268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f05100ade00 20 client.17268 populate_metadata read hostname 'trial004' 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f05100ade00 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562c11dc2dd0 0x562c11e90360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f05100ade00 4 client.17268 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f05100ade00 1 -- 10.20.193.4:0/773037085 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f04fc03f040 con 0x562c11dc2dd0 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.468+0000 7f0506ffd640 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562c11dc2dd0 0x562c11e90360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:10.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.469+0000 7f04c97fa640 10 client.17268 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:10.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.469+0000 7f0506ffd640 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562c11dc2dd0 0x562c11e90360 crc :-1 s=READY pgs=150 gs=4 cs=0 l=0 c_cookie=16695472463061713831 s_cookie=7143497579887745362 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7b23bbfae1c03a7 server_cookie=6322cd3377125952 in_seq=0 out_seq=0 2026-02-24T09:16:10.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.469+0000 7f04c97fa640 1 -- 10.20.193.4:0/773037085 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x7f04fc03f040 con 0x562c11dc2dd0 2026-02-24T09:16:10.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.469+0000 7f04c97fa640 10 client.17268 handle_command_reply: tid=0 2026-02-24T09:16:10.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.469+0000 7f05100ade00 1 client.17268 shutdown 2026-02-24T09:16:10.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.470+0000 7f05100ade00 1 -- 10.20.193.4:0/773037085 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 msgr2=0x562c11d9fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.470+0000 7f05100ade00 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11d9fa40 secure :-1 s=READY pgs=990 gs=1 cs=0 l=1 c_cookie=10932184348736423867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04f40a96e0 tx=0x7f04f4010c70 comp rx=0 tx=0).stop 2026-02-24T09:16:10.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f05100ade00 1 -- 10.20.193.4:0/773037085 shutdown_connections 2026-02-24T09:16:10.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f05100ade00 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562c11dc2dd0 0x562c11e90360 crc :-1 s=READY pgs=150 gs=4 cs=0 l=0 c_cookie=16695472463061713831 s_cookie=7143497579887745362 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f05100ade00 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562c11dc0260 0x562c11e28300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f05100ade00 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562c11d7e130 0x562c11d9ff80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f04c97fa640 0 client.17268 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:10.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f05100ade00 1 --2- 10.20.193.4:0/773037085 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562c11d7d820 0x562c11d9fa40 unknown :-1 s=CLOSED pgs=990 gs=1 cs=0 l=1 c_cookie=10932184348736423867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f05100ade00 1 -- 10.20.193.4:0/773037085 >> 10.20.193.4:0/773037085 conn(0x562c11c9c6b0 msgr2=0x562c11d7c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:10.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f05100ade00 1 -- 10.20.193.4:0/773037085 shutdown_connections 2026-02-24T09:16:10.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f05100ade00 1 -- 10.20.193.4:0/773037085 wait complete. 2026-02-24T09:16:10.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f05100ade00 20 client.17268 trim_cache size 0 max 16384 2026-02-24T09:16:10.481 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:16:10.481 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:16:10.481 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "6a3e476f-236c-4f0d-be47-9df08723e765", 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.482 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.483 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.484 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.485 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:16:10.486 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.487 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.488 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:16:10.489 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:10.490 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 -- 10.20.193.4:0/3039206026 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04dc0b5750 msgr2=0x7f04dc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04dc0b5750 0x7f04dc0d5c00 secure :-1 s=READY pgs=388 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05080fc260 tx=0x7f04f8005f90 comp rx=0 tx=0).stop 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 -- 10.20.193.4:0/3039206026 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f050810d3d0 msgr2=0x7f05080f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f050810d3d0 0x7f05080f58c0 secure :-1 s=READY pgs=986 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04f4009fd0 tx=0x7f04f4002bc0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 -- 10.20.193.4:0/3039206026 shutdown_connections 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04dc0b5750 0x7f04dc0d5c00 unknown :-1 s=CLOSED pgs=388 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f05081135c0 0x7f05080f5fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f050810ddc0 0x7f0508173e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 --2- 10.20.193.4:0/3039206026 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f050810d3d0 0x7f05080f58c0 unknown :-1 s=CLOSED pgs=986 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:10.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 -- 10.20.193.4:0/3039206026 >> 10.20.193.4:0/3039206026 conn(0x7f05080eaca0 msgr2=0x7f050810c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:10.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 -- 10.20.193.4:0/3039206026 shutdown_connections 2026-02-24T09:16:10.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:10.473+0000 7f050e0b3640 1 -- 10.20.193.4:0/3039206026 wait complete. 2026-02-24T09:16:10.566 INFO:tasks.cephfs.filesystem:scrub status for tag:6a3e476f-236c-4f0d-be47-9df08723e765 - {'path': '/', 'tag': '6a3e476f-236c-4f0d-be47-9df08723e765', 'options': 'recursive,force'} 2026-02-24T09:16:11.145 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:10 trial014 ceph-mon[46941]: pgmap v343: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 896 MiB/s wr, 251 op/s 2026-02-24T09:16:11.146 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:10 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:16:11.146 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:10 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:11.146 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:10 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:16:11.146 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:10 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:11.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:10 trial004 ceph-mon[41596]: pgmap v343: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 896 MiB/s wr, 251 op/s 2026-02-24T09:16:11.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:10 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:16:11.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:10 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:11.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:10 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:16:11.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:10 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:10 trial090 ceph-mon[47278]: pgmap v343: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 896 MiB/s wr, 251 op/s 2026-02-24T09:16:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:10 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:16:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:10 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:10 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:16:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:10 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:13.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:12 trial090 ceph-mon[47278]: pgmap v344: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 869 MiB/s wr, 247 op/s 2026-02-24T09:16:13.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:12 trial004 ceph-mon[41596]: pgmap v344: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 869 MiB/s wr, 247 op/s 2026-02-24T09:16:13.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:12 trial014 ceph-mon[46941]: pgmap v344: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 869 MiB/s wr, 247 op/s 2026-02-24T09:16:14.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:13 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:16:14.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:13 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:16:14.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:13 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:16:15.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:14 trial004 ceph-mon[41596]: pgmap v345: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 715 MiB/s wr, 210 op/s 2026-02-24T09:16:15.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:14 trial090 ceph-mon[47278]: pgmap v345: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 715 MiB/s wr, 210 op/s 2026-02-24T09:16:15.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:14 trial014 ceph-mon[46941]: pgmap v345: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 715 MiB/s wr, 210 op/s 2026-02-24T09:16:17.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:16 trial004 ceph-mon[41596]: pgmap v346: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 643 MiB/s wr, 191 op/s 2026-02-24T09:16:17.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:16 trial090 ceph-mon[47278]: pgmap v346: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 643 MiB/s wr, 191 op/s 2026-02-24T09:16:17.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:16 trial014 ceph-mon[46941]: pgmap v346: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 643 MiB/s wr, 191 op/s 2026-02-24T09:16:19.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:18 trial004 ceph-mon[41596]: pgmap v347: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 740 MiB/s wr, 215 op/s 2026-02-24T09:16:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:18 trial090 ceph-mon[47278]: pgmap v347: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 740 MiB/s wr, 215 op/s 2026-02-24T09:16:19.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:18 trial014 ceph-mon[46941]: pgmap v347: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 740 MiB/s wr, 215 op/s 2026-02-24T09:16:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:20 trial004 ceph-mon[41596]: pgmap v348: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 673 MiB/s wr, 187 op/s 2026-02-24T09:16:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:20 trial090 ceph-mon[47278]: pgmap v348: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 673 MiB/s wr, 187 op/s 2026-02-24T09:16:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:20 trial014 ceph-mon[46941]: pgmap v348: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 673 MiB/s wr, 187 op/s 2026-02-24T09:16:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:22 trial004 ceph-mon[41596]: pgmap v349: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 828 MiB/s wr, 228 op/s 2026-02-24T09:16:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:22 trial090 ceph-mon[47278]: pgmap v349: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 828 MiB/s wr, 228 op/s 2026-02-24T09:16:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:22 trial014 ceph-mon[46941]: pgmap v349: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 828 MiB/s wr, 228 op/s 2026-02-24T09:16:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:24 trial004 ceph-mon[41596]: pgmap v350: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 891 MiB/s wr, 246 op/s 2026-02-24T09:16:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:24 trial090 ceph-mon[47278]: pgmap v350: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 891 MiB/s wr, 246 op/s 2026-02-24T09:16:25.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:24 trial014 ceph-mon[46941]: pgmap v350: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 891 MiB/s wr, 246 op/s 2026-02-24T09:16:26.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:25 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:26.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:25 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:26.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:25 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:16:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:26 trial004 ceph-mon[41596]: pgmap v351: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 850 MiB/s wr, 235 op/s 2026-02-24T09:16:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:16:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:26 trial090 ceph-mon[47278]: pgmap v351: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 850 MiB/s wr, 235 op/s 2026-02-24T09:16:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:16:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:26 trial014 ceph-mon[46941]: pgmap v351: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 850 MiB/s wr, 235 op/s 2026-02-24T09:16:27.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:16:27.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:16:27.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:16:27.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:16:29.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:28 trial004 ceph-mon[41596]: pgmap v352: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 817 MiB/s wr, 228 op/s 2026-02-24T09:16:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:28 trial090 ceph-mon[47278]: pgmap v352: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 817 MiB/s wr, 228 op/s 2026-02-24T09:16:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:28 trial014 ceph-mon[46941]: pgmap v352: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 817 MiB/s wr, 228 op/s 2026-02-24T09:16:31.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:30 trial004 ceph-mon[41596]: pgmap v353: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 669 MiB/s wr, 190 op/s 2026-02-24T09:16:31.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:30 trial090 ceph-mon[47278]: pgmap v353: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 669 MiB/s wr, 190 op/s 2026-02-24T09:16:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:30 trial014 ceph-mon[46941]: pgmap v353: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 669 MiB/s wr, 190 op/s 2026-02-24T09:16:33.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:32 trial004 ceph-mon[41596]: pgmap v354: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 795 MiB/s wr, 223 op/s 2026-02-24T09:16:33.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:32 trial090 ceph-mon[47278]: pgmap v354: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 795 MiB/s wr, 223 op/s 2026-02-24T09:16:33.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:32 trial014 ceph-mon[46941]: pgmap v354: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 795 MiB/s wr, 223 op/s 2026-02-24T09:16:35.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:34 trial004 ceph-mon[41596]: pgmap v355: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 766 MiB/s wr, 207 op/s 2026-02-24T09:16:35.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:34 trial090 ceph-mon[47278]: pgmap v355: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 766 MiB/s wr, 207 op/s 2026-02-24T09:16:35.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:34 trial014 ceph-mon[46941]: pgmap v355: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 766 MiB/s wr, 207 op/s 2026-02-24T09:16:37.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:36 trial004 ceph-mon[41596]: pgmap v356: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 819 MiB/s wr, 223 op/s 2026-02-24T09:16:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:36 trial090 ceph-mon[47278]: pgmap v356: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 819 MiB/s wr, 223 op/s 2026-02-24T09:16:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:36 trial014 ceph-mon[46941]: pgmap v356: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 819 MiB/s wr, 223 op/s 2026-02-24T09:16:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:38 trial004 ceph-mon[41596]: pgmap v357: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 56 KiB/s rd, 896 MiB/s wr, 249 op/s 2026-02-24T09:16:39.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:38 trial090 ceph-mon[47278]: pgmap v357: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 56 KiB/s rd, 896 MiB/s wr, 249 op/s 2026-02-24T09:16:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:38 trial014 ceph-mon[46941]: pgmap v357: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 56 KiB/s rd, 896 MiB/s wr, 249 op/s 2026-02-24T09:16:40.568 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:16:40.742 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:40.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.908+0000 7fd91e80e640 1 -- 10.20.193.4:0/3784983770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd918115840 msgr2=0x7fd918176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.908+0000 7fd91e80e640 1 --2- 10.20.193.4:0/3784983770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd918115840 0x7fd918176210 secure :-1 s=READY pgs=991 gs=1 cs=0 l=1 c_cookie=11106252637243067414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd900009950 tx=0x7fd90002f1b0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.909+0000 7fd91e80e640 1 -- 10.20.193.4:0/3784983770 shutdown_connections 2026-02-24T09:16:40.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.909+0000 7fd91e80e640 1 --2- 10.20.193.4:0/3784983770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd918115840 0x7fd918176210 unknown :-1 s=CLOSED pgs=991 gs=1 cs=0 l=1 c_cookie=11106252637243067414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.909+0000 7fd91e80e640 1 --2- 10.20.193.4:0/3784983770 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd918110040 0x7fd918115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.909+0000 7fd91e80e640 1 --2- 10.20.193.4:0/3784983770 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd91810f650 0x7fd91810fa20 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.909+0000 7fd91e80e640 1 -- 10.20.193.4:0/3784983770 >> 10.20.193.4:0/3784983770 conn(0x7fd9180ecf20 msgr2=0x7fd91810d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.909+0000 7fd91e80e640 1 -- 10.20.193.4:0/3784983770 shutdown_connections 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.909+0000 7fd91e80e640 1 -- 10.20.193.4:0/3784983770 wait complete. 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.909+0000 7fd91e80e640 1 Processor -- start 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.909+0000 7fd91e80e640 1 -- start start 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.909+0000 7fd91e80e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd91810f650 0x7fd91811dea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd91e80e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd918110040 0x7fd91811e3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd91e80e640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd918115840 0x7fd9181237b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd91e80e640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd918123dd0 con 0x7fd918110040 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd91e80e640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd918123f40 con 0x7fd918115840 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd91e80e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd918124100 con 0x7fd91810f650 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9177fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd918110040 0x7fd91811e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9177fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd918110040 0x7fd91811e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46670/0 (socket says 10.20.193.4:46670) 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9177fe640 1 -- 10.20.193.4:0/2171965510 learned_addr learned my addr 10.20.193.4:0/2171965510 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd917fff640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd91810f650 0x7fd91811dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd91cd84640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd918115840 0x7fd9181237b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9177fe640 1 -- 10.20.193.4:0/2171965510 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd91810f650 msgr2=0x7fd91811dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9177fe640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd91810f650 0x7fd91811dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9177fe640 1 -- 10.20.193.4:0/2171965510 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd918115840 msgr2=0x7fd9181237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9177fe640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd918115840 0x7fd9181237b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9177fe640 1 -- 10.20.193.4:0/2171965510 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd900009570 con 0x7fd918110040 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9177fe640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd918110040 0x7fd91811e3e0 secure :-1 s=READY pgs=992 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90800d950 tx=0x7fd90800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9157fa640 1 -- 10.20.193.4:0/2171965510 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd908004540 con 0x7fd918110040 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd91e80e640 1 -- 10.20.193.4:0/2171965510 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9181243e0 con 0x7fd918110040 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.910+0000 7fd9157fa640 1 -- 10.20.193.4:0/2171965510 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd908009d00 con 0x7fd918110040 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.911+0000 7fd9157fa640 1 -- 10.20.193.4:0/2171965510 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9080106e0 con 0x7fd918110040 2026-02-24T09:16:40.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.911+0000 7fd91e80e640 1 -- 10.20.193.4:0/2171965510 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd918164b60 con 0x7fd918110040 2026-02-24T09:16:40.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.913+0000 7fd9157fa640 1 -- 10.20.193.4:0/2171965510 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fd9080026a0 con 0x7fd918110040 2026-02-24T09:16:40.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.914+0000 7fd9157fa640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8f40b5660 0x7fd8f40d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.914+0000 7fd917fff640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8f40b5660 0x7fd8f40d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.914+0000 7fd9157fa640 1 -- 10.20.193.4:0/2171965510 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd9080e65a0 con 0x7fd918110040 2026-02-24T09:16:40.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.914+0000 7fd917fff640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8f40b5660 0x7fd8f40d5b10 secure :-1 s=READY pgs=389 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c005840 tx=0x7fd90c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd920808e00 1 Processor -- start 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd920808e00 1 -- start start 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd920808e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584a820 0x55685584abf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd920808e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584b130 0x55685588f890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd920808e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588fdd0 0x5568558b01b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd920808e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55685575ade0 con 0x55685584b130 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd920808e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556855756b10 con 0x55685588fdd0 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd920808e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556855750ab0 con 0x55685584a820 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd9177fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584b130 0x55685588f890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd9177fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584b130 0x55685588f890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46684/0 (socket says 10.20.193.4:46684) 2026-02-24T09:16:40.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd9177fe640 1 -- 10.20.193.4:0/835199750 learned_addr learned my addr 10.20.193.4:0/835199750 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd91cd84640 1 --2- 10.20.193.4:0/835199750 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588fdd0 0x5568558b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd917fff640 1 --2- 10.20.193.4:0/835199750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584a820 0x55685584abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd9177fe640 1 -- 10.20.193.4:0/835199750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584a820 msgr2=0x55685584abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd9177fe640 1 --2- 10.20.193.4:0/835199750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584a820 0x55685584abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd9177fe640 1 -- 10.20.193.4:0/835199750 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588fdd0 msgr2=0x5568558b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd9177fe640 1 --2- 10.20.193.4:0/835199750 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588fdd0 0x5568558b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd9177fe640 1 -- 10.20.193.4:0/835199750 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568556fc310 con 0x55685584b130 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd9177fe640 1 --2- 10.20.193.4:0/835199750 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584b130 0x55685588f890 secure :-1 s=READY pgs=993 gs=1 cs=0 l=1 c_cookie=6811341249536369594 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd908005a20 tx=0x7fd9080a8840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e86bec74694a3ba server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.916+0000 7fd8ecce3640 1 -- 10.20.193.4:0/835199750 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd908002980 con 0x55685584b130 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd8ecce3640 1 -- 10.20.193.4:0/835199750 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd9080ad2d0 con 0x55685584b130 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd8ecce3640 1 -- 10.20.193.4:0/835199750 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9080ad7e0 con 0x55685584b130 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd920808e00 1 -- 10.20.193.4:0/835199750 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584b130 msgr2=0x55685588f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd920808e00 1 --2- 10.20.193.4:0/835199750 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584b130 0x55685588f890 secure :-1 s=READY pgs=993 gs=1 cs=0 l=1 c_cookie=6811341249536369594 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd908005a20 tx=0x7fd9080a8840 comp rx=0 tx=0).stop 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd920808e00 1 -- 10.20.193.4:0/835199750 shutdown_connections 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd920808e00 1 --2- 10.20.193.4:0/835199750 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588fdd0 0x5568558b01b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd920808e00 1 --2- 10.20.193.4:0/835199750 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584b130 0x55685588f890 unknown :-1 s=CLOSED pgs=993 gs=1 cs=0 l=1 c_cookie=6811341249536369594 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd920808e00 1 --2- 10.20.193.4:0/835199750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584a820 0x55685584abf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd920808e00 1 -- 10.20.193.4:0/835199750 >> 10.20.193.4:0/835199750 conn(0x5568557696b0 msgr2=0x556855849100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:40.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd920808e00 1 -- 10.20.193.4:0/835199750 shutdown_connections 2026-02-24T09:16:40.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.917+0000 7fd920808e00 1 -- 10.20.193.4:0/835199750 wait complete. 2026-02-24T09:16:40.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd920808e00 1 -- start start 2026-02-24T09:16:40.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd920808e00 1 Processor -- start 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd920808e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855862e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd920808e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584b130 0x556855863350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd920808e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588fdd0 0x556855868340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd920808e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556855868880 con 0x55685584a820 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd920808e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5568558689f0 con 0x55685588fdd0 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd920808e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556855868bb0 con 0x55685584b130 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd917fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855862e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd9177fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584b130 0x556855863350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd917fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855862e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46698/0 (socket says 10.20.193.4:46698) 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.918+0000 7fd917fff640 1 -- 10.20.193.4:0/3093140706 learned_addr learned my addr 10.20.193.4:0/3093140706 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd91cd84640 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588fdd0 0x556855868340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd917fff640 1 -- 10.20.193.4:0/3093140706 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584b130 msgr2=0x556855863350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd917fff640 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584b130 0x556855863350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd917fff640 1 -- 10.20.193.4:0/3093140706 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588fdd0 msgr2=0x556855868340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd917fff640 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588fdd0 0x556855868340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd917fff640 1 -- 10.20.193.4:0/3093140706 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568556d48c0 con 0x55685584a820 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd917fff640 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855862e10 secure :-1 s=READY pgs=994 gs=1 cs=0 l=1 c_cookie=17882766553365706697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c00a240 tx=0x7fd90c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82c596eee9977c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd8d9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:40.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/3093140706 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd90c013640 con 0x55685584a820 2026-02-24T09:16:40.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd920808e00 1 -- 10.20.193.4:0/3093140706 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd918164b60 con 0x55685584a820 2026-02-24T09:16:40.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/3093140706 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd90c013c80 con 0x55685584a820 2026-02-24T09:16:40.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.919+0000 7fd920808e00 10 client.17280 _ll_register_callbacks cb 0x5568556ec160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:40.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.920+0000 7fd920808e00 1 -- 10.20.193.4:0/3093140706 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5568554a04a0 con 0x55685584a820 2026-02-24T09:16:40.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.920+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/3093140706 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd90c012d30 con 0x55685584a820 2026-02-24T09:16:40.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.920+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/3093140706 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd90c02b3b0 con 0x55685584a820 2026-02-24T09:16:40.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.920+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/3093140706 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd90c012e90 con 0x55685584a820 2026-02-24T09:16:40.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.920+0000 7fd920808e00 10 client.17280 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:40.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.920+0000 7fd920808e00 1 -- 10.20.193.4:0/3093140706 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5568556e66e0 con 0x55685584a820 2026-02-24T09:16:40.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.921+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/3093140706 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd90c012380 con 0x55685584a820 2026-02-24T09:16:40.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.921+0000 7fd920808e00 10 client.17280 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:40.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.921+0000 7fd920808e00 10 client.17280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:40.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.921+0000 7fd920808e00 20 client.17280 populate_metadata read hostname 'trial004' 2026-02-24T09:16:40.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.921+0000 7fd920808e00 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55685588d430 0x55685588d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.921+0000 7fd920808e00 4 client.17280 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:40.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.921+0000 7fd920808e00 1 -- 10.20.193.4:0/3093140706 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568557464f0 con 0x55685588d430 2026-02-24T09:16:40.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.923+0000 7fd9177fe640 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55685588d430 0x55685588d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.924+0000 7fd9177fe640 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55685588d430 0x55685588d890 crc :-1 s=READY pgs=151 gs=4 cs=0 l=0 c_cookie=8009702545703083337 s_cookie=16637025210254100423 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f282e07312c9d49 server_cookie=e6e29648306a07c7 in_seq=0 out_seq=0 2026-02-24T09:16:40.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.924+0000 7fd8d9ffb640 10 client.17280 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:40.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/3093140706 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5568557464f0 con 0x55685588d430 2026-02-24T09:16:40.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd8d9ffb640 10 client.17280 handle_command_reply: tid=0 2026-02-24T09:16:40.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd920808e00 1 client.17280 shutdown 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd920808e00 1 -- 10.20.193.4:0/3093140706 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 msgr2=0x556855862e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd920808e00 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855862e10 secure :-1 s=READY pgs=994 gs=1 cs=0 l=1 c_cookie=17882766553365706697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c00a240 tx=0x7fd90c005870 comp rx=0 tx=0).stop 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd920808e00 1 -- 10.20.193.4:0/3093140706 shutdown_connections 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd920808e00 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55685588d430 0x55685588d890 crc :-1 s=READY pgs=151 gs=4 cs=0 l=0 c_cookie=8009702545703083337 s_cookie=16637025210254100423 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd920808e00 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588fdd0 0x556855868340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd920808e00 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584b130 0x556855863350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd920808e00 1 --2- 10.20.193.4:0/3093140706 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855862e10 unknown :-1 s=CLOSED pgs=994 gs=1 cs=0 l=1 c_cookie=17882766553365706697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.925+0000 7fd8d9ffb640 0 client.17280 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.926+0000 7fd920808e00 1 -- 10.20.193.4:0/3093140706 >> 10.20.193.4:0/3093140706 conn(0x5568557696b0 msgr2=0x556855849810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.926+0000 7fd920808e00 1 -- 10.20.193.4:0/3093140706 shutdown_connections 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.926+0000 7fd920808e00 1 -- 10.20.193.4:0/3093140706 wait complete. 2026-02-24T09:16:40.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.926+0000 7fd920808e00 20 client.17280 trim_cache size 0 max 16384 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.939+0000 7fd920808e00 1 Processor -- start 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.939+0000 7fd920808e00 1 -- start start 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd920808e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x5568558678b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd920808e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685584b130 0x556855888820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd920808e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685588d430 0x556855888d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd920808e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55685574e6e0 con 0x55685584a820 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd920808e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556855419f50 con 0x55685584b130 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd920808e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5568557ba3d0 con 0x55685588d430 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd917fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x5568558678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd9177fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685584b130 0x556855888820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd9177fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685584b130 0x556855888820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:34486/0 (socket says 10.20.193.4:34486) 2026-02-24T09:16:40.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd91cd84640 1 --2- 10.20.193.4:0/993136660 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685588d430 0x556855888d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd9177fe640 1 -- 10.20.193.4:0/993136660 learned_addr learned my addr 10.20.193.4:0/993136660 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd917fff640 1 -- 10.20.193.4:0/993136660 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685588d430 msgr2=0x556855888d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd917fff640 1 --2- 10.20.193.4:0/993136660 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685588d430 0x556855888d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd917fff640 1 -- 10.20.193.4:0/993136660 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685584b130 msgr2=0x556855888820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd917fff640 1 --2- 10.20.193.4:0/993136660 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685584b130 0x556855888820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd917fff640 1 -- 10.20.193.4:0/993136660 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556855855310 con 0x55685584a820 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd9177fe640 1 --2- 10.20.193.4:0/993136660 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685584b130 0x556855888820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd91cd84640 1 --2- 10.20.193.4:0/993136660 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685588d430 0x556855888d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.940+0000 7fd917fff640 1 --2- 10.20.193.4:0/993136660 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x5568558678b0 secure :-1 s=READY pgs=995 gs=1 cs=0 l=1 c_cookie=8351105091727954172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c0225c0 tx=0x7fd90c02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e515d5ba6690fc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.941+0000 7fd8dbfff640 1 -- 10.20.193.4:0/993136660 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd90c032040 con 0x55685584a820 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.941+0000 7fd8dbfff640 1 -- 10.20.193.4:0/993136660 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5568554a04a0 con 0x55685584a820 2026-02-24T09:16:40.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.941+0000 7fd8dbfff640 1 -- 10.20.193.4:0/993136660 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd90c0213e0 con 0x55685584a820 2026-02-24T09:16:40.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.942+0000 7fd920808e00 1 -- 10.20.193.4:0/993136660 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 msgr2=0x5568558678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.942+0000 7fd920808e00 1 --2- 10.20.193.4:0/993136660 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x5568558678b0 secure :-1 s=READY pgs=995 gs=1 cs=0 l=1 c_cookie=8351105091727954172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c0225c0 tx=0x7fd90c02a000 comp rx=0 tx=0).stop 2026-02-24T09:16:40.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.943+0000 7fd920808e00 1 -- 10.20.193.4:0/993136660 shutdown_connections 2026-02-24T09:16:40.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.943+0000 7fd920808e00 1 --2- 10.20.193.4:0/993136660 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685588d430 0x556855888d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.943+0000 7fd920808e00 1 --2- 10.20.193.4:0/993136660 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685584b130 0x556855888820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.943+0000 7fd920808e00 1 --2- 10.20.193.4:0/993136660 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x5568558678b0 unknown :-1 s=CLOSED pgs=995 gs=1 cs=0 l=1 c_cookie=8351105091727954172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.943+0000 7fd920808e00 1 -- 10.20.193.4:0/993136660 >> 10.20.193.4:0/993136660 conn(0x5568557696b0 msgr2=0x5568558671a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:40.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.943+0000 7fd920808e00 1 -- 10.20.193.4:0/993136660 shutdown_connections 2026-02-24T09:16:40.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.943+0000 7fd920808e00 1 -- 10.20.193.4:0/993136660 wait complete. 2026-02-24T09:16:40.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd920808e00 1 -- start start 2026-02-24T09:16:40.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd920808e00 1 Processor -- start 2026-02-24T09:16:40.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd920808e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855869390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd920808e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584b130 0x5568558698d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd920808e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588d430 0x556855869e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd920808e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55685586e5a0 con 0x55685584a820 2026-02-24T09:16:40.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd920808e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55685586e710 con 0x55685588d430 2026-02-24T09:16:40.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd920808e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55685586e8d0 con 0x55685584b130 2026-02-24T09:16:40.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd917fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855869390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd917fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855869390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46714/0 (socket says 10.20.193.4:46714) 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd917fff640 1 -- 10.20.193.4:0/1398743348 learned_addr learned my addr 10.20.193.4:0/1398743348 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd9177fe640 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584b130 0x5568558698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd91cd84640 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588d430 0x556855869e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd917fff640 1 -- 10.20.193.4:0/1398743348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584b130 msgr2=0x5568558698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd917fff640 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584b130 0x5568558698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd917fff640 1 -- 10.20.193.4:0/1398743348 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588d430 msgr2=0x556855869e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd917fff640 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588d430 0x556855869e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd917fff640 1 -- 10.20.193.4:0/1398743348 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd918176a80 con 0x55685584a820 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd917fff640 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855869390 secure :-1 s=READY pgs=996 gs=1 cs=0 l=1 c_cookie=3028318624802838265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c003470 tx=0x7fd90c021ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a06bfbe9a1296f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.944+0000 7fd8d9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/1398743348 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd90c030070 con 0x55685584a820 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 1 -- 10.20.193.4:0/1398743348 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568556fc310 con 0x55685584a820 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/1398743348 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd90c0136b0 con 0x55685584a820 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/1398743348 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd90c032040 con 0x55685584a820 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 10 client.17286 _ll_register_callbacks cb 0x5568556ec160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:40.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 1 -- 10.20.193.4:0/1398743348 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9080ad2d0 con 0x55685584a820 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/1398743348 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd90c0217f0 con 0x55685584a820 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/1398743348 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd90c02c440 con 0x55685584a820 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 10 client.17286 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 1 -- 10.20.193.4:0/1398743348 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5568556e66e0 con 0x55685584a820 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/1398743348 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd90c047060 con 0x55685584a820 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 10 client.17286 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 20 client.17286 populate_metadata read hostname 'trial004' 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55685588fdd0 0x55685595d010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 4 client.17286 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd920808e00 1 -- 10.20.193.4:0/1398743348 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556855485160 con 0x55685588fdd0 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.945+0000 7fd9177fe640 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55685588fdd0 0x55685595d010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd9177fe640 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55685588fdd0 0x55685595d010 crc :-1 s=READY pgs=152 gs=4 cs=0 l=0 c_cookie=16161669572517089773 s_cookie=2515605805775792572 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e049c8d9171ed1ed server_cookie=22e93a26f02d29bc in_seq=0 out_seq=0 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd8d9ffb640 10 client.17286 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd8d9ffb640 1 -- 10.20.193.4:0/1398743348 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x556855485160 con 0x55685588fdd0 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd8d9ffb640 10 client.17286 handle_command_reply: tid=0 2026-02-24T09:16:40.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd920808e00 1 client.17286 shutdown 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd920808e00 1 -- 10.20.193.4:0/1398743348 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 msgr2=0x556855869390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd920808e00 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855869390 secure :-1 s=READY pgs=996 gs=1 cs=0 l=1 c_cookie=3028318624802838265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c003470 tx=0x7fd90c021ec0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd920808e00 1 -- 10.20.193.4:0/1398743348 shutdown_connections 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd920808e00 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55685588fdd0 0x55685595d010 crc :-1 s=READY pgs=152 gs=4 cs=0 l=0 c_cookie=16161669572517089773 s_cookie=2515605805775792572 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd920808e00 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55685588d430 0x556855869e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd920808e00 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55685584b130 0x5568558698d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd920808e00 1 --2- 10.20.193.4:0/1398743348 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55685584a820 0x556855869390 unknown :-1 s=CLOSED pgs=996 gs=1 cs=0 l=1 c_cookie=3028318624802838265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd8d9ffb640 0 client.17286 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.946+0000 7fd920808e00 1 -- 10.20.193.4:0/1398743348 >> 10.20.193.4:0/1398743348 conn(0x5568557696b0 msgr2=0x5568558491f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.947+0000 7fd920808e00 1 -- 10.20.193.4:0/1398743348 shutdown_connections 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.947+0000 7fd920808e00 1 -- 10.20.193.4:0/1398743348 wait complete. 2026-02-24T09:16:40.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.947+0000 7fd920808e00 20 client.17286 trim_cache size 0 max 16384 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.951 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.952 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:16:40.953 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 -- 10.20.193.4:0/2171965510 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8f40b5660 msgr2=0x7fd8f40d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8f40b5660 0x7fd8f40d5b10 secure :-1 s=READY pgs=389 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c005840 tx=0x7fd90c009040 comp rx=0 tx=0).stop 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 -- 10.20.193.4:0/2171965510 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd918110040 msgr2=0x7fd91811e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd918110040 0x7fd91811e3e0 secure :-1 s=READY pgs=992 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90800d950 tx=0x7fd90800de20 comp rx=0 tx=0).stop 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 -- 10.20.193.4:0/2171965510 shutdown_connections 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd8f40b5660 0x7fd8f40d5b10 unknown :-1 s=CLOSED pgs=389 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd918115840 0x7fd9181237b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd918110040 0x7fd91811e3e0 unknown :-1 s=CLOSED pgs=992 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 --2- 10.20.193.4:0/2171965510 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd91810f650 0x7fd91811dea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 -- 10.20.193.4:0/2171965510 >> 10.20.193.4:0/2171965510 conn(0x7fd9180ecf20 msgr2=0x7fd91810d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 -- 10.20.193.4:0/2171965510 shutdown_connections 2026-02-24T09:16:40.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:40.948+0000 7fd91e80e640 1 -- 10.20.193.4:0/2171965510 wait complete. 2026-02-24T09:16:40.954 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:40 trial004 ceph-mon[41596]: pgmap v358: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 812 MiB/s wr, 227 op/s 2026-02-24T09:16:41.044 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:16:41.044 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:16:41.223 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:41.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:40 trial090 ceph-mon[47278]: pgmap v358: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 812 MiB/s wr, 227 op/s 2026-02-24T09:16:41.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:40 trial014 ceph-mon[46941]: pgmap v358: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 812 MiB/s wr, 227 op/s 2026-02-24T09:16:41.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.422+0000 7ff771e3c640 1 -- 10.20.193.4:0/2579790302 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff76c153770 msgr2=0x7ff76c173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.422+0000 7ff771e3c640 1 --2- 10.20.193.4:0/2579790302 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff76c153770 0x7ff76c173bd0 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=11873069879769685808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff76000a970 tx=0x7ff7600301b0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.422+0000 7ff771e3c640 1 -- 10.20.193.4:0/2579790302 shutdown_connections 2026-02-24T09:16:41.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.422+0000 7ff771e3c640 1 --2- 10.20.193.4:0/2579790302 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff76c153770 0x7ff76c173bd0 unknown :-1 s=CLOSED pgs=103 gs=2 cs=0 l=1 c_cookie=11873069879769685808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.422+0000 7ff771e3c640 1 --2- 10.20.193.4:0/2579790302 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff76c10ebb0 0x7ff76c153230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.422+0000 7ff771e3c640 1 --2- 10.20.193.4:0/2579790302 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff76c10e1c0 0x7ff76c10e590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.422+0000 7ff771e3c640 1 -- 10.20.193.4:0/2579790302 >> 10.20.193.4:0/2579790302 conn(0x7ff76c0e9bf0 msgr2=0x7ff76c10a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.422+0000 7ff771e3c640 1 -- 10.20.193.4:0/2579790302 shutdown_connections 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.422+0000 7ff771e3c640 1 -- 10.20.193.4:0/2579790302 wait complete. 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff771e3c640 1 Processor -- start 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff771e3c640 1 -- start start 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff771e3c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff76c10e1c0 0x7ff76c15fe60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff771e3c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff76c10ebb0 0x7ff76c1603a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff771e3c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff76c153770 0x7ff76c165770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff771e3c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c165d90 con 0x7ff76c153770 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff771e3c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c165f00 con 0x7ff76c10e1c0 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff771e3c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1660c0 con 0x7ff76c10ebb0 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff76bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff76c153770 0x7ff76c165770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff76bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff76c153770 0x7ff76c165770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46734/0 (socket says 10.20.193.4:46734) 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff76bfff640 1 -- 10.20.193.4:0/533965197 learned_addr learned my addr 10.20.193.4:0/533965197 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff76b7fe640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff76c10e1c0 0x7ff76c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.423+0000 7ff76affd640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff76c10ebb0 0x7ff76c1603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff76bfff640 1 -- 10.20.193.4:0/533965197 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff76c10ebb0 msgr2=0x7ff76c1603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff76bfff640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff76c10ebb0 0x7ff76c1603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff76bfff640 1 -- 10.20.193.4:0/533965197 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff76c10e1c0 msgr2=0x7ff76c15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff76bfff640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff76c10e1c0 0x7ff76c15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff76bfff640 1 -- 10.20.193.4:0/533965197 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76000a590 con 0x7ff76c153770 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff76bfff640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff76c153770 0x7ff76c165770 secure :-1 s=READY pgs=997 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff760005820 tx=0x7ff7600039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff768ff9640 1 -- 10.20.193.4:0/533965197 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff76003e070 con 0x7ff76c153770 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff771e3c640 1 -- 10.20.193.4:0/533965197 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c166340 con 0x7ff76c153770 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff768ff9640 1 -- 10.20.193.4:0/533965197 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff760003e10 con 0x7ff76c153770 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff768ff9640 1 -- 10.20.193.4:0/533965197 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff760042a00 con 0x7ff76c153770 2026-02-24T09:16:41.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.424+0000 7ff771e3c640 1 -- 10.20.193.4:0/533965197 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c14f390 con 0x7ff76c153770 2026-02-24T09:16:41.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.425+0000 7ff771e3c640 1 -- 10.20.193.4:0/533965197 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76c166610 con 0x7ff76c153770 2026-02-24T09:16:41.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.428+0000 7ff768ff9640 1 -- 10.20.193.4:0/533965197 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff760042b90 con 0x7ff76c153770 2026-02-24T09:16:41.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.429+0000 7ff768ff9640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7400b5760 0x7ff7400d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.429+0000 7ff76b7fe640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7400b5760 0x7ff7400d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.430+0000 7ff768ff9640 1 -- 10.20.193.4:0/533965197 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff76010cac0 con 0x7ff76c153770 2026-02-24T09:16:41.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.430+0000 7ff76b7fe640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7400b5760 0x7ff7400d5c10 secure :-1 s=READY pgs=390 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff758005b30 tx=0x7ff758009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:41.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.432+0000 7ff768ff9640 1 -- 10.20.193.4:0/533965197 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff7600cf440 con 0x7ff76c153770 2026-02-24T09:16:41.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.589+0000 7ff771e3c640 1 -- 10.20.193.4:0/533965197 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff76c0603c0 con 0x7ff76c153770 2026-02-24T09:16:41.594 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:16:41.594 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:16:41.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.589+0000 7ff768ff9640 1 -- 10.20.193.4:0/533965197 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7ff7600d25f0 con 0x7ff76c153770 2026-02-24T09:16:41.595 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:16:41.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 -- 10.20.193.4:0/533965197 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7400b5760 msgr2=0x7ff7400d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7400b5760 0x7ff7400d5c10 secure :-1 s=READY pgs=390 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff758005b30 tx=0x7ff758009310 comp rx=0 tx=0).stop 2026-02-24T09:16:41.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 -- 10.20.193.4:0/533965197 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff76c153770 msgr2=0x7ff76c165770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff76c153770 0x7ff76c165770 secure :-1 s=READY pgs=997 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff760005820 tx=0x7ff7600039b0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.597 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 -- 10.20.193.4:0/533965197 shutdown_connections 2026-02-24T09:16:41.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7400b5760 0x7ff7400d5c10 unknown :-1 s=CLOSED pgs=390 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff76c153770 0x7ff76c165770 unknown :-1 s=CLOSED pgs=997 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff76c10ebb0 0x7ff76c1603a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 --2- 10.20.193.4:0/533965197 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff76c10e1c0 0x7ff76c15fe60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 -- 10.20.193.4:0/533965197 >> 10.20.193.4:0/533965197 conn(0x7ff76c0e9bf0 msgr2=0x7ff76c109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:41.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 -- 10.20.193.4:0/533965197 shutdown_connections 2026-02-24T09:16:41.598 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.593+0000 7ff771e3c640 1 -- 10.20.193.4:0/533965197 wait complete. 2026-02-24T09:16:41.658 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:16:41.831 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.963+0000 7f35d1922640 1 -- 10.20.193.4:0/3322060791 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35cc110040 msgr2=0x7f35cc115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.963+0000 7f35d1922640 1 --2- 10.20.193.4:0/3322060791 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35cc110040 0x7f35cc115090 secure :-1 s=READY pgs=998 gs=1 cs=0 l=1 c_cookie=9626384371557193893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35b4009950 tx=0x7f35b402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.963+0000 7f35d1922640 1 -- 10.20.193.4:0/3322060791 shutdown_connections 2026-02-24T09:16:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.963+0000 7f35d1922640 1 --2- 10.20.193.4:0/3322060791 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35cc115840 0x7f35cc176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.963+0000 7f35d1922640 1 --2- 10.20.193.4:0/3322060791 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35cc110040 0x7f35cc115090 unknown :-1 s=CLOSED pgs=998 gs=1 cs=0 l=1 c_cookie=9626384371557193893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.963+0000 7f35d1922640 1 --2- 10.20.193.4:0/3322060791 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35cc10f650 0x7f35cc10fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.963+0000 7f35d1922640 1 -- 10.20.193.4:0/3322060791 >> 10.20.193.4:0/3322060791 conn(0x7f35cc0ecf20 msgr2=0x7f35cc10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.963+0000 7f35d1922640 1 -- 10.20.193.4:0/3322060791 shutdown_connections 2026-02-24T09:16:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.963+0000 7f35d1922640 1 -- 10.20.193.4:0/3322060791 wait complete. 2026-02-24T09:16:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35d1922640 1 Processor -- start 2026-02-24T09:16:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35d1922640 1 -- start start 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35d1922640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35cc10f650 0x7f35cc0f5910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35d1922640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35cc110040 0x7f35cc176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35d1922640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35cc115840 0x7f35cc0f6010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35d1922640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc0fb220 con 0x7f35cc115840 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35d1922640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc0fb390 con 0x7f35cc10f650 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35d1922640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc0fb550 con 0x7f35cc110040 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35ca7fc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35cc110040 0x7f35cc176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35ca7fc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35cc110040 0x7f35cc176110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:39684/0 (socket says 10.20.193.4:39684) 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35ca7fc640 1 -- 10.20.193.4:0/2197699115 learned_addr learned my addr 10.20.193.4:0/2197699115 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35cb7fe640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35cc115840 0x7f35cc0f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35caffd640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35cc10f650 0x7f35cc0f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35cb7fe640 1 -- 10.20.193.4:0/2197699115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35cc110040 msgr2=0x7f35cc176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35cb7fe640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35cc110040 0x7f35cc176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35cb7fe640 1 -- 10.20.193.4:0/2197699115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35cc10f650 msgr2=0x7f35cc0f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35cb7fe640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35cc10f650 0x7f35cc0f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.964+0000 7f35cb7fe640 1 -- 10.20.193.4:0/2197699115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b4009570 con 0x7f35cc115840 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.965+0000 7f35cb7fe640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35cc115840 0x7f35cc0f6010 secure :-1 s=READY pgs=999 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35bc007fd0 tx=0x7f35bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.965+0000 7f35d0920640 1 -- 10.20.193.4:0/2197699115 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35bc0054a0 con 0x7f35cc115840 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.965+0000 7f35d1922640 1 -- 10.20.193.4:0/2197699115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35cc0fb830 con 0x7f35cc115840 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.965+0000 7f35d1922640 1 -- 10.20.193.4:0/2197699115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35cc0fbd50 con 0x7f35cc115840 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.965+0000 7f35d0920640 1 -- 10.20.193.4:0/2197699115 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f35bc005600 con 0x7f35cc115840 2026-02-24T09:16:41.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.965+0000 7f35d0920640 1 -- 10.20.193.4:0/2197699115 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35bc011cd0 con 0x7f35cc115840 2026-02-24T09:16:41.978 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.967+0000 7f35d0920640 1 -- 10.20.193.4:0/2197699115 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f35bc003780 con 0x7f35cc115840 2026-02-24T09:16:41.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.968+0000 7f35d0920640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35980b56d0 0x7f35980d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.968+0000 7f35d0920640 1 -- 10.20.193.4:0/2197699115 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f35bc0e72e0 con 0x7f35cc115840 2026-02-24T09:16:41.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.968+0000 7f35caffd640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35980b56d0 0x7f35980d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.968+0000 7f35caffd640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35980b56d0 0x7f35980d5b80 secure :-1 s=READY pgs=391 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35c0004740 tx=0x7f35c0004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:41.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.969+0000 7f35d391ce00 1 Processor -- start 2026-02-24T09:16:41.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 -- start start 2026-02-24T09:16:41.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d6f50 0x564a4f8d7320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d7860 0x564a4f91bfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f93c8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.979 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564a4f7e7ee0 con 0x564a4f8d7860 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564a4f7e3c10 con 0x564a4f91c500 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564a4f7ddd70 con 0x564a4f8d6f50 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35ca7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d7860 0x564a4f91bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35ca7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d7860 0x564a4f91bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46762/0 (socket says 10.20.193.4:46762) 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35ca7fc640 1 -- 10.20.193.4:0/699600264 learned_addr learned my addr 10.20.193.4:0/699600264 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35cb7fe640 1 --2- 10.20.193.4:0/699600264 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f93c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35caffd640 1 --2- 10.20.193.4:0/699600264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d6f50 0x564a4f8d7320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35ca7fc640 1 -- 10.20.193.4:0/699600264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d6f50 msgr2=0x564a4f8d7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35ca7fc640 1 --2- 10.20.193.4:0/699600264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d6f50 0x564a4f8d7320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35ca7fc640 1 -- 10.20.193.4:0/699600264 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 msgr2=0x564a4f93c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35ca7fc640 1 --2- 10.20.193.4:0/699600264 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f93c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.980 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35ca7fc640 1 -- 10.20.193.4:0/699600264 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4f789340 con 0x564a4f8d7860 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35ca7fc640 1 --2- 10.20.193.4:0/699600264 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d7860 0x564a4f91bfc0 secure :-1 s=READY pgs=1000 gs=1 cs=0 l=1 c_cookie=7541540424593930991 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35b4002cd0 tx=0x7f35b4002d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a8ef0f332b7aef server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f358ffff640 1 -- 10.20.193.4:0/699600264 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35b403d070 con 0x564a4f8d7860 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f358ffff640 1 -- 10.20.193.4:0/699600264 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f35b403e040 con 0x564a4f8d7860 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f358ffff640 1 -- 10.20.193.4:0/699600264 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35b402fe00 con 0x564a4f8d7860 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 -- 10.20.193.4:0/699600264 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d7860 msgr2=0x564a4f91bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 --2- 10.20.193.4:0/699600264 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d7860 0x564a4f91bfc0 secure :-1 s=READY pgs=1000 gs=1 cs=0 l=1 c_cookie=7541540424593930991 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35b4002cd0 tx=0x7f35b4002d00 comp rx=0 tx=0).stop 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 -- 10.20.193.4:0/699600264 shutdown_connections 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 --2- 10.20.193.4:0/699600264 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f93c8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 --2- 10.20.193.4:0/699600264 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d7860 0x564a4f91bfc0 unknown :-1 s=CLOSED pgs=1000 gs=1 cs=0 l=1 c_cookie=7541540424593930991 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 --2- 10.20.193.4:0/699600264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d6f50 0x564a4f8d7320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 -- 10.20.193.4:0/699600264 >> 10.20.193.4:0/699600264 conn(0x564a4f7f5db0 msgr2=0x564a4f8d5830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:41.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 -- 10.20.193.4:0/699600264 shutdown_connections 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.970+0000 7f35d391ce00 1 -- 10.20.193.4:0/699600264 wait complete. 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.971+0000 7f35d391ce00 1 -- start start 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.971+0000 7f35d391ce00 1 Processor -- start 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.971+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f933d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.971+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 0x564a4f934270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.971+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f939260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.971+0000 7f35d391ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564a4f9397a0 con 0x564a4f8d6f50 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.971+0000 7f35d391ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564a4f939910 con 0x564a4f91c500 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.971+0000 7f35d391ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564a4f939ad0 con 0x564a4f8d7860 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35caffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f933d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35caffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f933d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46778/0 (socket says 10.20.193.4:46778) 2026-02-24T09:16:41.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35caffd640 1 -- 10.20.193.4:0/2890088973 learned_addr learned my addr 10.20.193.4:0/2890088973 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35ca7fc640 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 0x564a4f934270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35caffd640 1 -- 10.20.193.4:0/2890088973 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 msgr2=0x564a4f934270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35caffd640 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 0x564a4f934270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35caffd640 1 -- 10.20.193.4:0/2890088973 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 msgr2=0x564a4f939260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35caffd640 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f939260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35caffd640 1 -- 10.20.193.4:0/2890088973 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4f7619d0 con 0x564a4f8d6f50 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35ca7fc640 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 0x564a4f934270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35caffd640 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f933d30 secure :-1 s=READY pgs=1001 gs=1 cs=0 l=1 c_cookie=11327401671261434364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35c0005d30 tx=0x7f35c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3303ce0bb431fc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f358d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f358d7fa640 1 -- 10.20.193.4:0/2890088973 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35c001f870 con 0x564a4f8d6f50 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 1 -- 10.20.193.4:0/2890088973 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35cc176a80 con 0x564a4f8d6f50 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f358d7fa640 1 -- 10.20.193.4:0/2890088973 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f35c001e3d0 con 0x564a4f8d6f50 2026-02-24T09:16:41.983 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f358d7fa640 1 -- 10.20.193.4:0/2890088973 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35c0010650 con 0x564a4f8d6f50 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 10 client.17304 _ll_register_callbacks cb 0x564a4f788080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 1 -- 10.20.193.4:0/2890088973 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a4f52d4a0 con 0x564a4f8d6f50 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f358d7fa640 1 -- 10.20.193.4:0/2890088973 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f35c00107e0 con 0x564a4f8d6f50 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f358d7fa640 1 -- 10.20.193.4:0/2890088973 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f35c00109c0 con 0x564a4f8d6f50 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 10 client.17304 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 1 -- 10.20.193.4:0/2890088973 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564a4f773710 con 0x564a4f8d6f50 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f358d7fa640 1 -- 10.20.193.4:0/2890088973 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f35c0010b60 con 0x564a4f8d6f50 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 10 client.17304 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 10 client.17304 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 20 client.17304 populate_metadata read hostname 'trial004' 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x564a4f9198d0 0x564a4f919d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 4 client.17304 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:41.984 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.972+0000 7f35d391ce00 1 -- 10.20.193.4:0/2890088973 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a4f7d37b0 con 0x564a4f9198d0 2026-02-24T09:16:41.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.974+0000 7f35ca7fc640 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x564a4f9198d0 0x564a4f919d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.975+0000 7f358d7fa640 10 client.17304 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:16:41.985 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.975+0000 7f35ca7fc640 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x564a4f9198d0 0x564a4f919d70 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=4353232597270206493 s_cookie=10410891165878890252 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3c69c9fb98f1181d server_cookie=907aea5b2976af0c in_seq=0 out_seq=0 2026-02-24T09:16:41.986 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f358d7fa640 1 -- 10.20.193.4:0/2890088973 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564a4f7d37b0 con 0x564a4f9198d0 2026-02-24T09:16:41.986 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f358d7fa640 10 client.17304 handle_command_reply: tid=0 2026-02-24T09:16:41.986 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 client.17304 shutdown 2026-02-24T09:16:41.986 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 -- 10.20.193.4:0/2890088973 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 msgr2=0x564a4f933d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.986 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f933d30 secure :-1 s=READY pgs=1001 gs=1 cs=0 l=1 c_cookie=11327401671261434364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35c0005d30 tx=0x7f35c0004770 comp rx=0 tx=0).stop 2026-02-24T09:16:41.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 -- 10.20.193.4:0/2890088973 shutdown_connections 2026-02-24T09:16:41.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x564a4f9198d0 0x564a4f919d70 crc :-1 s=READY pgs=46 gs=4 cs=0 l=0 c_cookie=4353232597270206493 s_cookie=10410891165878890252 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f939260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 0x564a4f934270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 --2- 10.20.193.4:0/2890088973 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f933d30 unknown :-1 s=CLOSED pgs=1001 gs=1 cs=0 l=1 c_cookie=11327401671261434364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f358d7fa640 0 client.17304 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:16:41.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 -- 10.20.193.4:0/2890088973 >> 10.20.193.4:0/2890088973 conn(0x564a4f7f5db0 msgr2=0x564a4f8d5040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:41.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 -- 10.20.193.4:0/2890088973 shutdown_connections 2026-02-24T09:16:41.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 1 -- 10.20.193.4:0/2890088973 wait complete. 2026-02-24T09:16:41.987 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.976+0000 7f35d391ce00 20 client.17304 trim_cache size 0 max 16384 2026-02-24T09:16:41.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35d391ce00 1 Processor -- start 2026-02-24T09:16:41.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35d391ce00 1 -- start start 2026-02-24T09:16:41.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f91b660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f8d7860 0x564a4f91bba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f91c500 0x564a4f917110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35d391ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564a4f7db9a0 con 0x564a4f8d6f50 2026-02-24T09:16:41.993 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35d391ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564a4f5b7df0 con 0x564a4f8d7860 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35d391ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564a4f921370 con 0x564a4f91c500 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35caffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f91b660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35caffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f91b660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46780/0 (socket says 10.20.193.4:46780) 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35caffd640 1 -- 10.20.193.4:0/4198435437 learned_addr learned my addr 10.20.193.4:0/4198435437 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.983+0000 7f35cb7fe640 1 --2- 10.20.193.4:0/4198435437 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f91c500 0x564a4f917110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.984+0000 7f35caffd640 1 -- 10.20.193.4:0/4198435437 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f91c500 msgr2=0x564a4f917110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.984+0000 7f35caffd640 1 --2- 10.20.193.4:0/4198435437 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f91c500 0x564a4f917110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.984+0000 7f35caffd640 1 -- 10.20.193.4:0/4198435437 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f8d7860 msgr2=0x564a4f91bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.984+0000 7f35caffd640 1 --2- 10.20.193.4:0/4198435437 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f8d7860 0x564a4f91bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.984+0000 7f35caffd640 1 -- 10.20.193.4:0/4198435437 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4f76e190 con 0x564a4f8d6f50 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.984+0000 7f35caffd640 1 --2- 10.20.193.4:0/4198435437 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f91b660 secure :-1 s=READY pgs=1002 gs=1 cs=0 l=1 c_cookie=12858731267700836787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35c0010f80 tx=0x7f35c002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27363f5a18449b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:41.994 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.984+0000 7f358f7fe640 1 -- 10.20.193.4:0/4198435437 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35c000fdb0 con 0x564a4f8d6f50 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.984+0000 7f358f7fe640 1 -- 10.20.193.4:0/4198435437 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x564a4f52d4a0 con 0x564a4f8d6f50 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.984+0000 7f358f7fe640 1 -- 10.20.193.4:0/4198435437 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35c0032e10 con 0x564a4f8d6f50 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.985+0000 7f35d391ce00 1 -- 10.20.193.4:0/4198435437 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 msgr2=0x564a4f91b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.985+0000 7f35d391ce00 1 --2- 10.20.193.4:0/4198435437 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f91b660 secure :-1 s=READY pgs=1002 gs=1 cs=0 l=1 c_cookie=12858731267700836787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35c0010f80 tx=0x7f35c002b000 comp rx=0 tx=0).stop 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.985+0000 7f35d391ce00 1 -- 10.20.193.4:0/4198435437 shutdown_connections 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.985+0000 7f35d391ce00 1 --2- 10.20.193.4:0/4198435437 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f91c500 0x564a4f917110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.985+0000 7f35d391ce00 1 --2- 10.20.193.4:0/4198435437 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f8d7860 0x564a4f91bba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.985+0000 7f35d391ce00 1 --2- 10.20.193.4:0/4198435437 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f91b660 unknown :-1 s=CLOSED pgs=1002 gs=1 cs=0 l=1 c_cookie=12858731267700836787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.985+0000 7f35d391ce00 1 -- 10.20.193.4:0/4198435437 >> 10.20.193.4:0/4198435437 conn(0x564a4f7f5db0 msgr2=0x564a4f9388b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.985+0000 7f35d391ce00 1 -- 10.20.193.4:0/4198435437 shutdown_connections 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.985+0000 7f35d391ce00 1 -- 10.20.193.4:0/4198435437 wait complete. 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35d391ce00 1 -- start start 2026-02-24T09:16:41.995 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35d391ce00 1 Processor -- start 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f8b51e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 0x564a4f8b5720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35d391ce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f8ba080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35d391ce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564a4f8b5ce0 con 0x564a4f8d6f50 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35d391ce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564a4f8b5e50 con 0x564a4f91c500 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35d391ce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564a4f8ba5c0 con 0x564a4f8d7860 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35caffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f8b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35caffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f8b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46786/0 (socket says 10.20.193.4:46786) 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35caffd640 1 -- 10.20.193.4:0/47601690 learned_addr learned my addr 10.20.193.4:0/47601690 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35cb7fe640 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f8ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35ca7fc640 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 0x564a4f8b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:41.996 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35caffd640 1 -- 10.20.193.4:0/47601690 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 msgr2=0x564a4f8b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35caffd640 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 0x564a4f8b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35caffd640 1 -- 10.20.193.4:0/47601690 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 msgr2=0x564a4f8ba080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35caffd640 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f8ba080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35caffd640 1 -- 10.20.193.4:0/47601690 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4f761d00 con 0x564a4f8d6f50 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.986+0000 7f35cb7fe640 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f8ba080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.987+0000 7f35caffd640 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f8b51e0 secure :-1 s=READY pgs=1003 gs=1 cs=0 l=1 c_cookie=13129222380240590565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35c00023d0 tx=0x7f35c000f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6345e31775956e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.987+0000 7f358d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.987+0000 7f358d7fa640 1 -- 10.20.193.4:0/47601690 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35c00106c0 con 0x564a4f8d6f50 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.987+0000 7f358d7fa640 1 -- 10.20.193.4:0/47601690 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f35c001d890 con 0x564a4f8d6f50 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.987+0000 7f358d7fa640 1 -- 10.20.193.4:0/47601690 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35c0032ba0 con 0x564a4f8d6f50 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.987+0000 7f35d391ce00 1 -- 10.20.193.4:0/47601690 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4f773710 con 0x564a4f8d6f50 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.987+0000 7f358d7fa640 1 -- 10.20.193.4:0/47601690 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f35c0032d30 con 0x564a4f8d6f50 2026-02-24T09:16:41.997 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.987+0000 7f358d7fa640 10 client.17310 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f35d391ce00 10 client.17310 _ll_register_callbacks cb 0x564a4f788080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f35d391ce00 1 -- 10.20.193.4:0/47601690 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35b403e040 con 0x564a4f8d6f50 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f358d7fa640 1 -- 10.20.193.4:0/47601690 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f35c0010820 con 0x564a4f8d6f50 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f35d391ce00 10 client.17310 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f35d391ce00 1 -- 10.20.193.4:0/47601690 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564a4f773970 con 0x564a4f8d6f50 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f358d7fa640 1 -- 10.20.193.4:0/47601690 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f35c003c040 con 0x564a4f8d6f50 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f35d391ce00 10 client.17310 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f35d391ce00 10 client.17310 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f35d391ce00 20 client.17310 populate_metadata read hostname 'trial004' 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f35d391ce00 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x564a4f9ca0b0 0x564a4f9ea560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f35d391ce00 4 client.17310 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.988+0000 7f35d391ce00 1 -- 10.20.193.4:0/47601690 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a4f512160 con 0x564a4f9ca0b0 2026-02-24T09:16:41.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.989+0000 7f35ca7fc640 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x564a4f9ca0b0 0x564a4f9ea560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.000 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35ca7fc640 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x564a4f9ca0b0 0x564a4f9ea560 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=4243300990356673958 s_cookie=3774344923297493923 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ae33bc4cd45d5a6 server_cookie=34612ab5dcf233a3 in_seq=0 out_seq=0 2026-02-24T09:16:42.000 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f358d7fa640 10 client.17310 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:16:42.000 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f358d7fa640 1 -- 10.20.193.4:0/47601690 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a4f512160 con 0x564a4f9ca0b0 2026-02-24T09:16:42.000 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f358d7fa640 10 client.17310 handle_command_reply: tid=0 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 client.17310 shutdown 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 -- 10.20.193.4:0/47601690 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 msgr2=0x564a4f8b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f8b51e0 secure :-1 s=READY pgs=1003 gs=1 cs=0 l=1 c_cookie=13129222380240590565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35c00023d0 tx=0x7f35c000f8d0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 -- 10.20.193.4:0/47601690 shutdown_connections 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x564a4f9ca0b0 0x564a4f9ea560 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=4243300990356673958 s_cookie=3774344923297493923 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564a4f91c500 0x564a4f8ba080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564a4f8d7860 0x564a4f8b5720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f358d7fa640 0 client.17310 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 --2- 10.20.193.4:0/47601690 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564a4f8d6f50 0x564a4f8b51e0 unknown :-1 s=CLOSED pgs=1003 gs=1 cs=0 l=1 c_cookie=13129222380240590565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 -- 10.20.193.4:0/47601690 >> 10.20.193.4:0/47601690 conn(0x564a4f7f5db0 msgr2=0x564a4f936f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 -- 10.20.193.4:0/47601690 shutdown_connections 2026-02-24T09:16:42.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 1 -- 10.20.193.4:0/47601690 wait complete. 2026-02-24T09:16:42.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.990+0000 7f35d391ce00 20 client.17310 trim_cache size 0 max 16384 2026-02-24T09:16:42.002 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:16:42.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 -- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35980b56d0 msgr2=0x7f35980d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35980b56d0 0x7f35980d5b80 secure :-1 s=READY pgs=391 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35c0004740 tx=0x7f35c0004420 comp rx=0 tx=0).stop 2026-02-24T09:16:42.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 -- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35cc115840 msgr2=0x7f35cc0f6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35cc115840 0x7f35cc0f6010 secure :-1 s=READY pgs=999 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35bc007fd0 tx=0x7f35bc00c9c0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 -- 10.20.193.4:0/2197699115 shutdown_connections 2026-02-24T09:16:42.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f35980b56d0 0x7f35980d5b80 unknown :-1 s=CLOSED pgs=391 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f35cc115840 0x7f35cc0f6010 unknown :-1 s=CLOSED pgs=999 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35cc110040 0x7f35cc176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 --2- 10.20.193.4:0/2197699115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f35cc10f650 0x7f35cc0f5910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 -- 10.20.193.4:0/2197699115 >> 10.20.193.4:0/2197699115 conn(0x7f35cc0ecf20 msgr2=0x7f35cc10dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 -- 10.20.193.4:0/2197699115 shutdown_connections 2026-02-24T09:16:42.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:41.991+0000 7f35d1922640 1 -- 10.20.193.4:0/2197699115 wait complete. 2026-02-24T09:16:42.036 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:16:42.167 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:42.190 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:41 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/533965197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:42.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.292+0000 7f3441d64640 1 -- 10.20.193.4:0/3143604926 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f343c110040 msgr2=0x7f343c115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.292+0000 7f3441d64640 1 --2- 10.20.193.4:0/3143604926 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f343c110040 0x7f343c115090 secure :-1 s=READY pgs=1004 gs=1 cs=0 l=1 c_cookie=11037646176124319195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f342c009950 tx=0x7f342c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.292+0000 7f3441d64640 1 -- 10.20.193.4:0/3143604926 shutdown_connections 2026-02-24T09:16:42.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.292+0000 7f3441d64640 1 --2- 10.20.193.4:0/3143604926 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f343c115840 0x7f343c176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.292+0000 7f3441d64640 1 --2- 10.20.193.4:0/3143604926 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f343c110040 0x7f343c115090 unknown :-1 s=CLOSED pgs=1004 gs=1 cs=0 l=1 c_cookie=11037646176124319195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.292+0000 7f3441d64640 1 --2- 10.20.193.4:0/3143604926 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f343c10f650 0x7f343c10fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.292+0000 7f3441d64640 1 -- 10.20.193.4:0/3143604926 >> 10.20.193.4:0/3143604926 conn(0x7f343c0ecf20 msgr2=0x7f343c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.292+0000 7f3441d64640 1 -- 10.20.193.4:0/3143604926 shutdown_connections 2026-02-24T09:16:42.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.292+0000 7f3441d64640 1 -- 10.20.193.4:0/3143604926 wait complete. 2026-02-24T09:16:42.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f3441d64640 1 Processor -- start 2026-02-24T09:16:42.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f3441d64640 1 -- start start 2026-02-24T09:16:42.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f3441d64640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f343c10f650 0x7f343c0f58d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f3441d64640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f343c110040 0x7f343c176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f3441d64640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f343c115840 0x7f343c0f5fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f3441d64640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f343c0fb190 con 0x7f343c115840 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f3441d64640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f343c0fb300 con 0x7f343c110040 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f3441d64640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f343c0fb4c0 con 0x7f343c10f650 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f343c115840 0x7f343c0f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f343c115840 0x7f343c0f5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46804/0 (socket says 10.20.193.4:46804) 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343bfff640 1 -- 10.20.193.4:0/2975658736 learned_addr learned my addr 10.20.193.4:0/2975658736 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f343c10f650 0x7f343c0f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343affd640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f343c110040 0x7f343c176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343bfff640 1 -- 10.20.193.4:0/2975658736 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f343c10f650 msgr2=0x7f343c0f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343bfff640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f343c10f650 0x7f343c0f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343bfff640 1 -- 10.20.193.4:0/2975658736 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f343c110040 msgr2=0x7f343c176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343bfff640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f343c110040 0x7f343c176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343bfff640 1 -- 10.20.193.4:0/2975658736 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342c009570 con 0x7f343c115840 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f343c10f650 0x7f343c0f58d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343affd640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f343c110040 0x7f343c176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.293+0000 7f343bfff640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f343c115840 0x7f343c0f5fd0 secure :-1 s=READY pgs=1005 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3430006e90 tx=0x7f343000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.294+0000 7f3438ff9640 1 -- 10.20.193.4:0/2975658736 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3430005500 con 0x7f343c115840 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.294+0000 7f3441d64640 1 -- 10.20.193.4:0/2975658736 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c0fb7a0 con 0x7f343c115840 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.294+0000 7f3441d64640 1 -- 10.20.193.4:0/2975658736 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c0fbc70 con 0x7f343c115840 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.294+0000 7f3438ff9640 1 -- 10.20.193.4:0/2975658736 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3430005e10 con 0x7f343c115840 2026-02-24T09:16:42.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.294+0000 7f3438ff9640 1 -- 10.20.193.4:0/2975658736 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3430003a90 con 0x7f343c115840 2026-02-24T09:16:42.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.296+0000 7f3438ff9640 1 -- 10.20.193.4:0/2975658736 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f3430003c20 con 0x7f343c115840 2026-02-24T09:16:42.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.297+0000 7f3438ff9640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34100b5750 0x7f34100d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.297+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34100b5750 0x7f34100d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.297+0000 7f3438ff9640 1 -- 10.20.193.4:0/2975658736 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f34300e8af0 con 0x7f343c115840 2026-02-24T09:16:42.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.297+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34100b5750 0x7f34100d5c00 secure :-1 s=READY pgs=392 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3428004740 tx=0x7f3428005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f3443d5ee00 1 Processor -- start 2026-02-24T09:16:42.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f3443d5ee00 1 -- start start 2026-02-24T09:16:42.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d7db320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7db860 0x55923d81ffc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d820500 0x55923d8408e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55923d6ebee0 con 0x55923d7daf50 2026-02-24T09:16:42.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55923d6e7c10 con 0x55923d820500 2026-02-24T09:16:42.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55923d6e1d70 con 0x55923d7db860 2026-02-24T09:16:42.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f343b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d7db320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f343b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d7db320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46814/0 (socket says 10.20.193.4:46814) 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f343b7fe640 1 -- 10.20.193.4:0/2285069389 learned_addr learned my addr 10.20.193.4:0/2285069389 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.299+0000 7f343bfff640 1 --2- 10.20.193.4:0/2285069389 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d820500 0x55923d8408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f343affd640 1 --2- 10.20.193.4:0/2285069389 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7db860 0x55923d81ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f343b7fe640 1 -- 10.20.193.4:0/2285069389 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7db860 msgr2=0x55923d81ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2285069389 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7db860 0x55923d81ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f343b7fe640 1 -- 10.20.193.4:0/2285069389 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d820500 msgr2=0x55923d8408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2285069389 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d820500 0x55923d8408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f343b7fe640 1 -- 10.20.193.4:0/2285069389 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923d68d340 con 0x55923d7daf50 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f343bfff640 1 --2- 10.20.193.4:0/2285069389 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d820500 0x55923d8408e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2285069389 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d7db320 secure :-1 s=READY pgs=1006 gs=1 cs=0 l=1 c_cookie=6531522926196035401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3428009c40 tx=0x7f3428013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa4a17ef23c0f49 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f33fffff640 1 -- 10.20.193.4:0/2285069389 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3428011e60 con 0x55923d7daf50 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f33fffff640 1 -- 10.20.193.4:0/2285069389 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f342801d940 con 0x55923d7daf50 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f33fffff640 1 -- 10.20.193.4:0/2285069389 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f342801ab30 con 0x55923d7daf50 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2285069389 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 msgr2=0x55923d7db320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/2285069389 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d7db320 secure :-1 s=READY pgs=1006 gs=1 cs=0 l=1 c_cookie=6531522926196035401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3428009c40 tx=0x7f3428013000 comp rx=0 tx=0).stop 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2285069389 shutdown_connections 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/2285069389 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d820500 0x55923d8408e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/2285069389 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7db860 0x55923d81ffc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/2285069389 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d7db320 unknown :-1 s=CLOSED pgs=1006 gs=1 cs=0 l=1 c_cookie=6531522926196035401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2285069389 >> 10.20.193.4:0/2285069389 conn(0x55923d6f9db0 msgr2=0x55923d7d9830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2285069389 shutdown_connections 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.300+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2285069389 wait complete. 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.301+0000 7f3443d5ee00 1 -- start start 2026-02-24T09:16:42.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.301+0000 7f3443d5ee00 1 Processor -- start 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.301+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d7daf50 0x55923d837cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.301+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7db860 0x55923d838210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.301+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d820500 0x55923d83d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.301+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55923d83d740 con 0x55923d820500 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.301+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55923d83d8b0 con 0x55923d7daf50 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.301+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55923d83da70 con 0x55923d7db860 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f343bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d820500 0x55923d83d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f343bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d820500 0x55923d83d200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46830/0 (socket says 10.20.193.4:46830) 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f343bfff640 1 -- 10.20.193.4:0/1243979049 learned_addr learned my addr 10.20.193.4:0/1243979049 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f343b7fe640 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d7daf50 0x55923d837cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f343bfff640 1 -- 10.20.193.4:0/1243979049 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7db860 msgr2=0x55923d838210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f343bfff640 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7db860 0x55923d838210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f343bfff640 1 -- 10.20.193.4:0/1243979049 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d7daf50 msgr2=0x55923d837cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f343bfff640 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d7daf50 0x55923d837cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f343bfff640 1 -- 10.20.193.4:0/1243979049 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923d6659d0 con 0x55923d820500 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f343bfff640 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d820500 0x55923d83d200 secure :-1 s=READY pgs=1007 gs=1 cs=0 l=1 c_cookie=9047313099180735734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34300e6590 tx=0x7f34300ab340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8e83543867fcf6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f33fd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f33fd7fa640 1 -- 10.20.193.4:0/1243979049 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34300aebe0 con 0x55923d820500 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f33fd7fa640 1 -- 10.20.193.4:0/1243979049 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f34300b2070 con 0x55923d820500 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1243979049 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34280098e0 con 0x55923d820500 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f33fd7fa640 1 -- 10.20.193.4:0/1243979049 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f34300b9ad0 con 0x55923d820500 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f33fd7fa640 1 -- 10.20.193.4:0/1243979049 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f34300b9c30 con 0x55923d820500 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f33fd7fa640 10 client.17322 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:16:42.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f3443d5ee00 10 client.17322 _ll_register_callbacks cb 0x55923d68c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1243979049 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55923d4314a0 con 0x55923d820500 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.302+0000 7f33fd7fa640 1 -- 10.20.193.4:0/1243979049 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f34300b9f60 con 0x55923d820500 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f3443d5ee00 10 client.17322 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1243979049 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55923d677710 con 0x55923d820500 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f33fd7fa640 1 -- 10.20.193.4:0/1243979049 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f343006dbd0 con 0x55923d820500 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f3443d5ee00 10 client.17322 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f3443d5ee00 10 client.17322 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f3443d5ee00 20 client.17322 populate_metadata read hostname 'trial004' 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55923d81d780 0x55923d81dbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f3443d5ee00 4 client.17322 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1243979049 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55923d6d77b0 con 0x55923d81d780 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f343b7fe640 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55923d81d780 0x55923d81dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f33fd7fa640 10 client.17322 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.303+0000 7f343b7fe640 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55923d81d780 0x55923d81dbf0 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=15350771399944189041 s_cookie=12749104184941575076 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d508e541a1e63471 server_cookie=b0edeab563e37ba4 in_seq=0 out_seq=0 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f33fd7fa640 1 -- 10.20.193.4:0/1243979049 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55923d6d77b0 con 0x55923d81d780 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f33fd7fa640 10 client.17322 handle_command_reply: tid=0 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 client.17322 shutdown 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1243979049 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d820500 msgr2=0x55923d83d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d820500 0x55923d83d200 secure :-1 s=READY pgs=1007 gs=1 cs=0 l=1 c_cookie=9047313099180735734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34300e6590 tx=0x7f34300ab340 comp rx=0 tx=0).stop 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1243979049 shutdown_connections 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55923d81d780 0x55923d81dbf0 crc :-1 s=READY pgs=47 gs=4 cs=0 l=0 c_cookie=15350771399944189041 s_cookie=12749104184941575076 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d820500 0x55923d83d200 unknown :-1 s=CLOSED pgs=1007 gs=1 cs=0 l=1 c_cookie=9047313099180735734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7db860 0x55923d838210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f33fd7fa640 0 client.17322 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:16:42.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/1243979049 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d7daf50 0x55923d837cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1243979049 >> 10.20.193.4:0/1243979049 conn(0x55923d6f9db0 msgr2=0x55923d7d9040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1243979049 shutdown_connections 2026-02-24T09:16:42.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1243979049 wait complete. 2026-02-24T09:16:42.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.304+0000 7f3443d5ee00 20 client.17322 trim_cache size 0 max 16384 2026-02-24T09:16:42.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.312+0000 7f3443d5ee00 1 Processor -- start 2026-02-24T09:16:42.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.312+0000 7f3443d5ee00 1 -- start start 2026-02-24T09:16:42.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.312+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d834fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.312+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d7db860 0x55923d8354f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.312+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d81d780 0x55923d81b160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.312+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55923d6df9a0 con 0x55923d7daf50 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.312+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55923d4bbdf0 con 0x55923d7db860 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.312+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55923d7daad0 con 0x55923d81d780 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.312+0000 7f343b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d834fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f343b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d834fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46838/0 (socket says 10.20.193.4:46838) 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f343b7fe640 1 -- 10.20.193.4:0/1791600024 learned_addr learned my addr 10.20.193.4:0/1791600024 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f343affd640 1 --2- 10.20.193.4:0/1791600024 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d7db860 0x55923d8354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f343bfff640 1 --2- 10.20.193.4:0/1791600024 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d81d780 0x55923d81b160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f343b7fe640 1 -- 10.20.193.4:0/1791600024 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d81d780 msgr2=0x55923d81b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f343b7fe640 1 --2- 10.20.193.4:0/1791600024 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d81d780 0x55923d81b160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f343b7fe640 1 -- 10.20.193.4:0/1791600024 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d7db860 msgr2=0x55923d8354f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f343b7fe640 1 --2- 10.20.193.4:0/1791600024 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d7db860 0x55923d8354f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f343b7fe640 1 -- 10.20.193.4:0/1791600024 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923d82a330 con 0x55923d7daf50 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f343b7fe640 1 --2- 10.20.193.4:0/1791600024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d834fb0 secure :-1 s=READY pgs=1008 gs=1 cs=0 l=1 c_cookie=9696992195723249910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3428004430 tx=0x7f342801a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8692a3066fd1c8f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f33ff7fe640 1 -- 10.20.193.4:0/1791600024 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f342802c040 con 0x55923d7daf50 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f33ff7fe640 1 -- 10.20.193.4:0/1791600024 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3428009dc0 con 0x55923d7daf50 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.313+0000 7f33ff7fe640 1 -- 10.20.193.4:0/1791600024 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3428005030 con 0x55923d7daf50 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1791600024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 msgr2=0x55923d834fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/1791600024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d834fb0 secure :-1 s=READY pgs=1008 gs=1 cs=0 l=1 c_cookie=9696992195723249910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3428004430 tx=0x7f342801a5e0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1791600024 shutdown_connections 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/1791600024 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d81d780 0x55923d81b160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/1791600024 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d7db860 0x55923d8354f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/1791600024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7daf50 0x55923d834fb0 unknown :-1 s=CLOSED pgs=1008 gs=1 cs=0 l=1 c_cookie=9696992195723249910 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1791600024 >> 10.20.193.4:0/1791600024 conn(0x55923d6f9db0 msgr2=0x55923d8348a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1791600024 shutdown_connections 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 -- 10.20.193.4:0/1791600024 wait complete. 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 -- start start 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 Processor -- start 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7daf50 0x55923d7baab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7db860 0x55923d7baff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d81d780 0x55923d886100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55923d886640 con 0x55923d7db860 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55923d8867b0 con 0x55923d81d780 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.314+0000 7f3443d5ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55923d886970 con 0x55923d7daf50 2026-02-24T09:16:42.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7db860 0x55923d7baff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7db860 0x55923d7baff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46842/0 (socket says 10.20.193.4:46842) 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343affd640 1 -- 10.20.193.4:0/2442660974 learned_addr learned my addr 10.20.193.4:0/2442660974 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7daf50 0x55923d7baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343affd640 1 -- 10.20.193.4:0/2442660974 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7daf50 msgr2=0x55923d7baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343affd640 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7daf50 0x55923d7baab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343affd640 1 -- 10.20.193.4:0/2442660974 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d81d780 msgr2=0x55923d886100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343bfff640 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d81d780 0x55923d886100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343affd640 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d81d780 0x55923d886100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343affd640 1 -- 10.20.193.4:0/2442660974 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55923d672190 con 0x55923d7db860 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7daf50 0x55923d7baab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343bfff640 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d81d780 0x55923d886100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:42.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f343affd640 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7db860 0x55923d7baff0 secure :-1 s=READY pgs=1009 gs=1 cs=0 l=1 c_cookie=4908222364357862863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f342c02f6e0 tx=0x7f342c0386a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441d823c4a2da5cf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f33fd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f33fd7fa640 1 -- 10.20.193.4:0/2442660974 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f342c0026a0 con 0x55923d7db860 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f33fd7fa640 1 -- 10.20.193.4:0/2442660974 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f342c002800 con 0x55923d7db860 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f33fd7fa640 1 -- 10.20.193.4:0/2442660974 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f342c0466f0 con 0x55923d7db860 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2442660974 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55923d68d340 con 0x55923d7db860 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f33fd7fa640 1 -- 10.20.193.4:0/2442660974 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f342c046880 con 0x55923d7db860 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.315+0000 7f33fd7fa640 10 client.17328 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f3443d5ee00 10 client.17328 _ll_register_callbacks cb 0x55923d68c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2442660974 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f342801d940 con 0x55923d7db860 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f33fd7fa640 1 -- 10.20.193.4:0/2442660974 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f342c002970 con 0x55923d7db860 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f3443d5ee00 10 client.17328 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:42.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2442660974 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55923d665d00 con 0x55923d7db860 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f33fd7fa640 1 -- 10.20.193.4:0/2442660974 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f342c038920 con 0x55923d7db860 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f3443d5ee00 10 client.17328 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f3443d5ee00 10 client.17328 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f3443d5ee00 20 client.17328 populate_metadata read hostname 'trial004' 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55923d820500 0x55923d8ee810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f3443d5ee00 4 client.17328 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2442660974 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55923d416160 con 0x55923d820500 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55923d820500 0x55923d8ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f343b7fe640 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55923d820500 0x55923d8ee810 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=9920305300308229850 s_cookie=12946560668953204403 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89ac011c504bfeda server_cookie=b3ab6c55a7ffd6b3 in_seq=0 out_seq=0 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.316+0000 7f33fd7fa640 10 client.17328 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f33fd7fa640 1 -- 10.20.193.4:0/2442660974 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55923d416160 con 0x55923d820500 2026-02-24T09:16:42.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f33fd7fa640 10 client.17328 handle_command_reply: tid=0 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 client.17328 shutdown 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2442660974 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7db860 msgr2=0x55923d7baff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7db860 0x55923d7baff0 secure :-1 s=READY pgs=1009 gs=1 cs=0 l=1 c_cookie=4908222364357862863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f342c02f6e0 tx=0x7f342c0386a0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2442660974 shutdown_connections 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55923d820500 0x55923d8ee810 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=9920305300308229850 s_cookie=12946560668953204403 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55923d81d780 0x55923d886100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55923d7db860 0x55923d7baff0 unknown :-1 s=CLOSED pgs=1009 gs=1 cs=0 l=1 c_cookie=4908222364357862863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f33fd7fa640 0 client.17328 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 --2- 10.20.193.4:0/2442660974 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55923d7daf50 0x55923d7baab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2442660974 >> 10.20.193.4:0/2442660974 conn(0x55923d6f9db0 msgr2=0x55923d834fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2442660974 shutdown_connections 2026-02-24T09:16:42.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.317+0000 7f3443d5ee00 1 -- 10.20.193.4:0/2442660974 wait complete. 2026-02-24T09:16:42.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3443d5ee00 20 client.17328 trim_cache size 0 max 16384 2026-02-24T09:16:42.330 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:16:42.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 -- 10.20.193.4:0/2975658736 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34100b5750 msgr2=0x7f34100d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34100b5750 0x7f34100d5c00 secure :-1 s=READY pgs=392 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3428004740 tx=0x7f3428005f90 comp rx=0 tx=0).stop 2026-02-24T09:16:42.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 -- 10.20.193.4:0/2975658736 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f343c115840 msgr2=0x7f343c0f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f343c115840 0x7f343c0f5fd0 secure :-1 s=READY pgs=1005 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3430006e90 tx=0x7f343000edf0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 -- 10.20.193.4:0/2975658736 shutdown_connections 2026-02-24T09:16:42.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f34100b5750 0x7f34100d5c00 unknown :-1 s=CLOSED pgs=392 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f343c115840 0x7f343c0f5fd0 unknown :-1 s=CLOSED pgs=1005 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f343c110040 0x7f343c176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 --2- 10.20.193.4:0/2975658736 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f343c10f650 0x7f343c0f58d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 -- 10.20.193.4:0/2975658736 >> 10.20.193.4:0/2975658736 conn(0x7f343c0ecf20 msgr2=0x7f343c10dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 -- 10.20.193.4:0/2975658736 shutdown_connections 2026-02-24T09:16:42.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.318+0000 7f3441d64640 1 -- 10.20.193.4:0/2975658736 wait complete. 2026-02-24T09:16:42.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:41 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/533965197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:42.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:41 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/533965197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:16:42.434 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:16:42.621 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:42.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 -- 10.20.193.4:0/3898183762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f748010bee0 msgr2=0x7f748010c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 --2- 10.20.193.4:0/3898183762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f748010bee0 0x7f748010c2b0 secure :-1 s=READY pgs=1010 gs=1 cs=0 l=1 c_cookie=10299863987986704366 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7470009950 tx=0x7f747002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 -- 10.20.193.4:0/3898183762 shutdown_connections 2026-02-24T09:16:42.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 --2- 10.20.193.4:0/3898183762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7480155c10 0x7f7480175ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 --2- 10.20.193.4:0/3898183762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f748010c7f0 0x7f74801556d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 --2- 10.20.193.4:0/3898183762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f748010bee0 0x7f748010c2b0 unknown :-1 s=CLOSED pgs=1010 gs=1 cs=0 l=1 c_cookie=10299863987986704366 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 -- 10.20.193.4:0/3898183762 >> 10.20.193.4:0/3898183762 conn(0x7f74800e9b80 msgr2=0x7f7480109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 -- 10.20.193.4:0/3898183762 shutdown_connections 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 -- 10.20.193.4:0/3898183762 wait complete. 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 Processor -- start 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 -- start start 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f748010bee0 0x7f74801608c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f748010c7f0 0x7f7480160e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7480155c10 0x7f74801661d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f74801667f0 con 0x7f748010bee0 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7480166960 con 0x7f7480155c10 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7488167640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7480166b20 con 0x7f748010c7f0 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7485edc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f748010bee0 0x7f74801608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7485edc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f748010bee0 0x7f74801608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46848/0 (socket says 10.20.193.4:46848) 2026-02-24T09:16:42.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7485edc640 1 -- 10.20.193.4:0/417987851 learned_addr learned my addr 10.20.193.4:0/417987851 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f74866dd640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7480155c10 0x7f74801661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7485edc640 1 -- 10.20.193.4:0/417987851 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f748010c7f0 msgr2=0x7f7480160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7485edc640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f748010c7f0 0x7f7480160e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7485edc640 1 -- 10.20.193.4:0/417987851 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7480155c10 msgr2=0x7f74801661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.824+0000 7f7485edc640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7480155c10 0x7f74801661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.825+0000 7f7485edc640 1 -- 10.20.193.4:0/417987851 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7470009570 con 0x7f748010bee0 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.825+0000 7f74866dd640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7480155c10 0x7f74801661d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.825+0000 7f7485edc640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f748010bee0 0x7f74801608c0 secure :-1 s=READY pgs=1011 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7470005b30 tx=0x7f7470004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.825+0000 7f746effd640 1 -- 10.20.193.4:0/417987851 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f747003d070 con 0x7f748010bee0 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.825+0000 7f7488167640 1 -- 10.20.193.4:0/417987851 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7480166da0 con 0x7f748010bee0 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.825+0000 7f746effd640 1 -- 10.20.193.4:0/417987851 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7470038920 con 0x7f748010bee0 2026-02-24T09:16:42.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.825+0000 7f746effd640 1 -- 10.20.193.4:0/417987851 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74700418a0 con 0x7f748010bee0 2026-02-24T09:16:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.825+0000 7f7488167640 1 -- 10.20.193.4:0/417987851 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7480152840 con 0x7f748010bee0 2026-02-24T09:16:42.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.828+0000 7f746effd640 1 -- 10.20.193.4:0/417987851 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f7470048020 con 0x7f748010bee0 2026-02-24T09:16:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.830+0000 7f746effd640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b56e0 0x7f745c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.830+0000 7f746effd640 1 -- 10.20.193.4:0/417987851 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f747010aff0 con 0x7f748010bee0 2026-02-24T09:16:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.830+0000 7f74856db640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b56e0 0x7f745c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.831+0000 7f74856db640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b56e0 0x7f745c0d5b90 secure :-1 s=READY pgs=393 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7480167260 tx=0x7f7474009690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.833+0000 7f748a161e00 1 Processor -- start 2026-02-24T09:16:42.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.833+0000 7f748a161e00 1 -- start start 2026-02-24T09:16:42.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f748a161e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e94430320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f748a161e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e94474fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f748a161e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944958e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f748a161e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556e94340ee0 con 0x556e94475500 2026-02-24T09:16:42.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f748a161e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556e9433cc10 con 0x556e94430860 2026-02-24T09:16:42.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f748a161e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556e94336d70 con 0x556e9442ff50 2026-02-24T09:16:42.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f74866dd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f74866dd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944958e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46864/0 (socket says 10.20.193.4:46864) 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f74856db640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e94474fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f74866dd640 1 -- 10.20.193.4:0/747101188 learned_addr learned my addr 10.20.193.4:0/747101188 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f7485edc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e94430320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f74866dd640 1 -- 10.20.193.4:0/747101188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 msgr2=0x556e94430320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f74866dd640 1 --2- 10.20.193.4:0/747101188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e94430320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f74866dd640 1 -- 10.20.193.4:0/747101188 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 msgr2=0x556e94474fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f74866dd640 1 --2- 10.20.193.4:0/747101188 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e94474fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f74866dd640 1 -- 10.20.193.4:0/747101188 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e942e2340 con 0x556e94475500 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f7485edc640 1 --2- 10.20.193.4:0/747101188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e94430320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f74866dd640 1 --2- 10.20.193.4:0/747101188 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944958e0 secure :-1 s=READY pgs=1012 gs=1 cs=0 l=1 c_cookie=14126614023389395208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f747c00cbc0 tx=0x7f747c00e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40bd09bb72d3908 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f744e4e6640 1 -- 10.20.193.4:0/747101188 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f747c018640 con 0x556e94475500 2026-02-24T09:16:42.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f744e4e6640 1 -- 10.20.193.4:0/747101188 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f747c018c80 con 0x556e94475500 2026-02-24T09:16:42.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.834+0000 7f744e4e6640 1 -- 10.20.193.4:0/747101188 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f747c010ea0 con 0x556e94475500 2026-02-24T09:16:42.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.835+0000 7f748a161e00 1 -- 10.20.193.4:0/747101188 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 msgr2=0x556e944958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.835+0000 7f748a161e00 1 --2- 10.20.193.4:0/747101188 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944958e0 secure :-1 s=READY pgs=1012 gs=1 cs=0 l=1 c_cookie=14126614023389395208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f747c00cbc0 tx=0x7f747c00e710 comp rx=0 tx=0).stop 2026-02-24T09:16:42.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.835+0000 7f748a161e00 1 -- 10.20.193.4:0/747101188 shutdown_connections 2026-02-24T09:16:42.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.835+0000 7f748a161e00 1 --2- 10.20.193.4:0/747101188 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944958e0 unknown :-1 s=CLOSED pgs=1012 gs=1 cs=0 l=1 c_cookie=14126614023389395208 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.835+0000 7f748a161e00 1 --2- 10.20.193.4:0/747101188 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e94474fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.835+0000 7f748a161e00 1 --2- 10.20.193.4:0/747101188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e94430320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.835+0000 7f748a161e00 1 -- 10.20.193.4:0/747101188 >> 10.20.193.4:0/747101188 conn(0x556e9434edb0 msgr2=0x556e9442e830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.835+0000 7f748a161e00 1 -- 10.20.193.4:0/747101188 shutdown_connections 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.835+0000 7f748a161e00 1 -- 10.20.193.4:0/747101188 wait complete. 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.836+0000 7f748a161e00 1 -- start start 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.836+0000 7f748a161e00 1 Processor -- start 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e9448cd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e9448d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e94492280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556e944927c0 con 0x556e94475500 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556e94492930 con 0x556e94430860 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556e94492af0 con 0x556e9442ff50 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f74866dd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e94492280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f74866dd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e94492280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46874/0 (socket says 10.20.193.4:46874) 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f74866dd640 1 -- 10.20.193.4:0/724561324 learned_addr learned my addr 10.20.193.4:0/724561324 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f74856db640 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e9448d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f7485edc640 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e9448cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f74866dd640 1 -- 10.20.193.4:0/724561324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 msgr2=0x556e9448cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f74866dd640 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e9448cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f74866dd640 1 -- 10.20.193.4:0/724561324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 msgr2=0x556e9448d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f74866dd640 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e9448d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f74866dd640 1 -- 10.20.193.4:0/724561324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e942ba9d0 con 0x556e94475500 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f74866dd640 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e94492280 secure :-1 s=READY pgs=1013 gs=1 cs=0 l=1 c_cookie=9058955850197397394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f747c0109f0 tx=0x7f747c0106a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db7e0596ef66f92 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f743b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f743b7fe640 1 -- 10.20.193.4:0/724561324 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f747c018640 con 0x556e94475500 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 1 -- 10.20.193.4:0/724561324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f747c00c7e0 con 0x556e94475500 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f743b7fe640 1 -- 10.20.193.4:0/724561324 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f747c00ced0 con 0x556e94475500 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f743b7fe640 1 -- 10.20.193.4:0/724561324 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f747c023e60 con 0x556e94475500 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 10 client.17340 _ll_register_callbacks cb 0x556e942e1080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 1 -- 10.20.193.4:0/724561324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556e940864a0 con 0x556e94475500 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f743b7fe640 1 -- 10.20.193.4:0/724561324 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f747c014070 con 0x556e94475500 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f743b7fe640 1 -- 10.20.193.4:0/724561324 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f747c021520 con 0x556e94475500 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 10 client.17340 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:42.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.837+0000 7f748a161e00 1 -- 10.20.193.4:0/724561324 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556e942cc710 con 0x556e94475500 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.838+0000 7f743b7fe640 1 -- 10.20.193.4:0/724561324 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f747c0217a0 con 0x556e94475500 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.838+0000 7f748a161e00 10 client.17340 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.838+0000 7f748a161e00 10 client.17340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.838+0000 7f748a161e00 20 client.17340 populate_metadata read hostname 'trial004' 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.838+0000 7f748a161e00 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556e94472700 0x556e94472ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.838+0000 7f748a161e00 4 client.17340 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.838+0000 7f748a161e00 1 -- 10.20.193.4:0/724561324 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e9432c7b0 con 0x556e94472700 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.838+0000 7f7485edc640 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556e94472700 0x556e94472ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.838+0000 7f7485edc640 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556e94472700 0x556e94472ba0 crc :-1 s=READY pgs=153 gs=4 cs=0 l=0 c_cookie=1842584483123006341 s_cookie=5143772321664893231 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19922cd331318b85 server_cookie=476259ac7652812f in_seq=0 out_seq=0 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.838+0000 7f743b7fe640 10 client.17340 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f743b7fe640 1 -- 10.20.193.4:0/724561324 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556e9432c7b0 con 0x556e94472700 2026-02-24T09:16:42.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f743b7fe640 10 client.17340 handle_command_reply: tid=0 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 client.17340 shutdown 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 -- 10.20.193.4:0/724561324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 msgr2=0x556e94492280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e94492280 secure :-1 s=READY pgs=1013 gs=1 cs=0 l=1 c_cookie=9058955850197397394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f747c0109f0 tx=0x7f747c0106a0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 -- 10.20.193.4:0/724561324 shutdown_connections 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556e94472700 0x556e94472ba0 crc :-1 s=READY pgs=153 gs=4 cs=0 l=0 c_cookie=1842584483123006341 s_cookie=5143772321664893231 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e94492280 unknown :-1 s=CLOSED pgs=1013 gs=1 cs=0 l=1 c_cookie=9058955850197397394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e9448d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 --2- 10.20.193.4:0/724561324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e9448cd50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f743b7fe640 0 client.17340 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 -- 10.20.193.4:0/724561324 >> 10.20.193.4:0/724561324 conn(0x556e9434edb0 msgr2=0x556e9442e040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 -- 10.20.193.4:0/724561324 shutdown_connections 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 1 -- 10.20.193.4:0/724561324 wait complete. 2026-02-24T09:16:42.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.839+0000 7f748a161e00 20 client.17340 trim_cache size 0 max 16384 2026-02-24T09:16:42.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f748a161e00 1 Processor -- start 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f748a161e00 1 -- start start 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f748a161e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e9442ff50 0x556e944741f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f748a161e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e94430860 0x556e94474730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f748a161e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94475500 0x556e94474c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f748a161e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556e943349a0 con 0x556e9442ff50 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f748a161e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556e94110df0 con 0x556e94475500 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f748a161e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556e94492c30 con 0x556e94430860 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f7485edc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e9442ff50 0x556e944741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f7485edc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e9442ff50 0x556e944741f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46890/0 (socket says 10.20.193.4:46890) 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f7485edc640 1 -- 10.20.193.4:0/838412894 learned_addr learned my addr 10.20.193.4:0/838412894 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:42.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f74856db640 1 --2- 10.20.193.4:0/838412894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e94430860 0x556e94474730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.847+0000 7f74866dd640 1 --2- 10.20.193.4:0/838412894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94475500 0x556e94474c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.848+0000 7f74856db640 1 -- 10.20.193.4:0/838412894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94475500 msgr2=0x556e94474c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.848+0000 7f74856db640 1 --2- 10.20.193.4:0/838412894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94475500 0x556e94474c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.848+0000 7f74856db640 1 -- 10.20.193.4:0/838412894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e9442ff50 msgr2=0x556e944741f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.848+0000 7f74856db640 1 --2- 10.20.193.4:0/838412894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e9442ff50 0x556e944741f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.848+0000 7f74856db640 1 -- 10.20.193.4:0/838412894 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e9447f3b0 con 0x556e94430860 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.848+0000 7f7485edc640 1 --2- 10.20.193.4:0/838412894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e9442ff50 0x556e944741f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.848+0000 7f74856db640 1 --2- 10.20.193.4:0/838412894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e94430860 0x556e94474730 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=11906793112332929839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7474009fa0 tx=0x7f7474011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a53d6d4032ac0b2f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.848+0000 7f744dce5640 1 -- 10.20.193.4:0/838412894 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7474022070 con 0x556e94430860 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.848+0000 7f744dce5640 1 -- 10.20.193.4:0/838412894 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7474010b30 con 0x556e94430860 2026-02-24T09:16:42.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.848+0000 7f744dce5640 1 -- 10.20.193.4:0/838412894 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7474026c30 con 0x556e94430860 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.849+0000 7f748a161e00 1 -- 10.20.193.4:0/838412894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e94430860 msgr2=0x556e94474730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.849+0000 7f748a161e00 1 --2- 10.20.193.4:0/838412894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e94430860 0x556e94474730 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=11906793112332929839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7474009fa0 tx=0x7f7474011000 comp rx=0 tx=0).stop 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.849+0000 7f748a161e00 1 -- 10.20.193.4:0/838412894 shutdown_connections 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.849+0000 7f748a161e00 1 --2- 10.20.193.4:0/838412894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94475500 0x556e94474c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.849+0000 7f748a161e00 1 --2- 10.20.193.4:0/838412894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e94430860 0x556e94474730 unknown :-1 s=CLOSED pgs=104 gs=2 cs=0 l=1 c_cookie=11906793112332929839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.849+0000 7f748a161e00 1 --2- 10.20.193.4:0/838412894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e9442ff50 0x556e944741f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.849+0000 7f748a161e00 1 -- 10.20.193.4:0/838412894 >> 10.20.193.4:0/838412894 conn(0x556e9434edb0 msgr2=0x556e9442e450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.849+0000 7f748a161e00 1 -- 10.20.193.4:0/838412894 shutdown_connections 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.849+0000 7f748a161e00 1 -- 10.20.193.4:0/838412894 wait complete. 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.850+0000 7f748a161e00 1 -- start start 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.850+0000 7f748a161e00 1 Processor -- start 2026-02-24T09:16:42.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.850+0000 7f748a161e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e9440fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.850+0000 7f748a161e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e94410190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.850+0000 7f748a161e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944bb0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.850+0000 7f748a161e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556e9440b2a0 con 0x556e94475500 2026-02-24T09:16:42.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.850+0000 7f748a161e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556e94472d30 con 0x556e94430860 2026-02-24T09:16:42.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.850+0000 7f748a161e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556e94410940 con 0x556e9442ff50 2026-02-24T09:16:42.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.851+0000 7f74866dd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944bb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.851+0000 7f74866dd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944bb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:46896/0 (socket says 10.20.193.4:46896) 2026-02-24T09:16:42.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.851+0000 7f74866dd640 1 -- 10.20.193.4:0/842091909 learned_addr learned my addr 10.20.193.4:0/842091909 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:42.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.851+0000 7f7485edc640 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e9440fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.851+0000 7f74856db640 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e94410190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f74866dd640 1 -- 10.20.193.4:0/842091909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 msgr2=0x556e9440fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f74866dd640 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e9440fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f74866dd640 1 -- 10.20.193.4:0/842091909 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 msgr2=0x556e94410190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f74866dd640 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e94410190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f74866dd640 1 -- 10.20.193.4:0/842091909 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7474009c40 con 0x556e94475500 2026-02-24T09:16:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f74856db640 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e94410190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f74866dd640 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944bb0f0 secure :-1 s=READY pgs=1014 gs=2 cs=0 l=1 c_cookie=11388196412649368298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f747c022900 tx=0x7f747c00efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0b004cd057eaea server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f743b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:42.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f743b7fe640 1 -- 10.20.193.4:0/842091909 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f747c00c4a0 con 0x556e94475500 2026-02-24T09:16:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f743b7fe640 1 -- 10.20.193.4:0/842091909 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x556e940864a0 con 0x556e94475500 2026-02-24T09:16:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f743b7fe640 1 -- 10.20.193.4:0/842091909 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f747c005d60 con 0x556e94475500 2026-02-24T09:16:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f748a161e00 1 -- 10.20.193.4:0/842091909 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7480152840 con 0x556e94475500 2026-02-24T09:16:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f743b7fe640 1 -- 10.20.193.4:0/842091909 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f747c014040 con 0x556e94475500 2026-02-24T09:16:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.853+0000 7f743b7fe640 10 client.17346 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:16:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.854+0000 7f748a161e00 10 client.17346 _ll_register_callbacks cb 0x556e942e1080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.854+0000 7f748a161e00 1 -- 10.20.193.4:0/842091909 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f747c018c80 con 0x556e94475500 2026-02-24T09:16:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.854+0000 7f743b7fe640 1 -- 10.20.193.4:0/842091909 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f747c0223d0 con 0x556e94475500 2026-02-24T09:16:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.854+0000 7f748a161e00 10 client.17346 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:42.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.854+0000 7f748a161e00 1 -- 10.20.193.4:0/842091909 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556e942c7190 con 0x556e94475500 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.855+0000 7f743b7fe640 1 -- 10.20.193.4:0/842091909 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f747c047060 con 0x556e94475500 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.855+0000 7f748a161e00 10 client.17346 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.855+0000 7f748a161e00 10 client.17346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.855+0000 7f748a161e00 20 client.17346 populate_metadata read hostname 'trial004' 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.855+0000 7f748a161e00 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556e94523330 0x556e945437e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.855+0000 7f748a161e00 4 client.17346 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.855+0000 7f748a161e00 1 -- 10.20.193.4:0/842091909 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e9406b160 con 0x556e94523330 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.855+0000 7f7485edc640 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556e94523330 0x556e945437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.855+0000 7f7485edc640 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556e94523330 0x556e945437e0 crc :-1 s=READY pgs=154 gs=4 cs=0 l=0 c_cookie=17793974970977823372 s_cookie=10974415954472469901 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6f0e5f5a7532a8c server_cookie=984cf52a67b6058d in_seq=0 out_seq=0 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.855+0000 7f743b7fe640 10 client.17346 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f743b7fe640 1 -- 10.20.193.4:0/842091909 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e9406b160 con 0x556e94523330 2026-02-24T09:16:42.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f743b7fe640 10 client.17346 handle_command_reply: tid=0 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 client.17346 shutdown 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 -- 10.20.193.4:0/842091909 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 msgr2=0x556e944bb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944bb0f0 secure :-1 s=READY pgs=1014 gs=2 cs=0 l=1 c_cookie=11388196412649368298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f747c022900 tx=0x7f747c00efd0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 -- 10.20.193.4:0/842091909 shutdown_connections 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556e94523330 0x556e945437e0 crc :-1 s=READY pgs=154 gs=4 cs=0 l=0 c_cookie=17793974970977823372 s_cookie=10974415954472469901 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556e94475500 0x556e944bb0f0 unknown :-1 s=CLOSED pgs=1014 gs=2 cs=0 l=1 c_cookie=11388196412649368298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556e94430860 0x556e94410190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f743b7fe640 0 client.17346 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 --2- 10.20.193.4:0/842091909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556e9442ff50 0x556e9440fc50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 -- 10.20.193.4:0/842091909 >> 10.20.193.4:0/842091909 conn(0x556e9434edb0 msgr2=0x556e9442ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 -- 10.20.193.4:0/842091909 shutdown_connections 2026-02-24T09:16:42.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 1 -- 10.20.193.4:0/842091909 wait complete. 2026-02-24T09:16:42.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.856+0000 7f748a161e00 20 client.17346 trim_cache size 0 max 16384 2026-02-24T09:16:42.866 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:16:42.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 -- 10.20.193.4:0/417987851 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b56e0 msgr2=0x7f745c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b56e0 0x7f745c0d5b90 secure :-1 s=READY pgs=393 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7480167260 tx=0x7f7474009690 comp rx=0 tx=0).stop 2026-02-24T09:16:42.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 -- 10.20.193.4:0/417987851 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f748010bee0 msgr2=0x7f74801608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:42.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f748010bee0 0x7f74801608c0 secure :-1 s=READY pgs=1011 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7470005b30 tx=0x7f7470004340 comp rx=0 tx=0).stop 2026-02-24T09:16:42.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 -- 10.20.193.4:0/417987851 shutdown_connections 2026-02-24T09:16:42.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f745c0b56e0 0x7f745c0d5b90 unknown :-1 s=CLOSED pgs=393 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7480155c10 0x7f74801661d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f748010c7f0 0x7f7480160e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 --2- 10.20.193.4:0/417987851 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f748010bee0 0x7f74801608c0 unknown :-1 s=CLOSED pgs=1011 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:42.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 -- 10.20.193.4:0/417987851 >> 10.20.193.4:0/417987851 conn(0x7f74800e9b80 msgr2=0x7f7480109f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:42.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 -- 10.20.193.4:0/417987851 shutdown_connections 2026-02-24T09:16:42.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:42.857+0000 7f7488167640 1 -- 10.20.193.4:0/417987851 wait complete. 2026-02-24T09:16:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:42 trial004 ceph-mon[41596]: pgmap v359: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 823 MiB/s wr, 231 op/s 2026-02-24T09:16:43.233 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:42 trial090 ceph-mon[47278]: pgmap v359: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 823 MiB/s wr, 231 op/s 2026-02-24T09:16:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:42 trial014 ceph-mon[46941]: pgmap v359: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 823 MiB/s wr, 231 op/s 2026-02-24T09:16:43.962 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:16:43.962 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:16:44.131 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 -- 10.20.193.4:0/1498176260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2dbc1100b0 msgr2=0x7f2dbc115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 --2- 10.20.193.4:0/1498176260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2dbc1100b0 0x7f2dbc115100 secure :-1 s=READY pgs=1015 gs=1 cs=0 l=1 c_cookie=3462568108103792886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2db0009950 tx=0x7f2db002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 -- 10.20.193.4:0/1498176260 shutdown_connections 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 --2- 10.20.193.4:0/1498176260 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2dbc1158b0 0x7f2dbc176280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 --2- 10.20.193.4:0/1498176260 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2dbc1100b0 0x7f2dbc115100 unknown :-1 s=CLOSED pgs=1015 gs=1 cs=0 l=1 c_cookie=3462568108103792886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 --2- 10.20.193.4:0/1498176260 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2dbc10f6c0 0x7f2dbc10fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 -- 10.20.193.4:0/1498176260 >> 10.20.193.4:0/1498176260 conn(0x7f2dbc0ecfd0 msgr2=0x7f2dbc10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 -- 10.20.193.4:0/1498176260 shutdown_connections 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 -- 10.20.193.4:0/1498176260 wait complete. 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 Processor -- start 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.264+0000 7f2dc3dba640 1 -- start start 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc3dba640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2dbc10f6c0 0x7f2dbc0f5a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.269 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc3dba640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2dbc1100b0 0x7f2dbc176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc3dba640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2dbc1158b0 0x7f2dbc0f6100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc3dba640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc0fb310 con 0x7f2dbc10f6c0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc3dba640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc0fb480 con 0x7f2dbc1158b0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc3dba640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc0fb640 con 0x7f2dbc1100b0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc1b2f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2dbc10f6c0 0x7f2dbc0f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc132e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2dbc1100b0 0x7f2dbc176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc1b2f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2dbc10f6c0 0x7f2dbc0f5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34816/0 (socket says 10.20.193.4:34816) 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/2428888246 learned_addr learned my addr 10.20.193.4:0/2428888246 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc2330640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2dbc1158b0 0x7f2dbc0f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/2428888246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2dbc1100b0 msgr2=0x7f2dbc176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2dbc1100b0 0x7f2dbc176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/2428888246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2dbc1158b0 msgr2=0x7f2dbc0f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2dbc1158b0 0x7f2dbc0f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/2428888246 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db0009570 con 0x7f2dbc10f6c0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2dbc10f6c0 0x7f2dbc0f5a00 secure :-1 s=READY pgs=1016 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dac00d950 tx=0x7f2dac00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2daaffd640 1 -- 10.20.193.4:0/2428888246 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dac004540 con 0x7f2dbc10f6c0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc3dba640 1 -- 10.20.193.4:0/2428888246 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dbc0fb920 con 0x7f2dbc10f6c0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2daaffd640 1 -- 10.20.193.4:0/2428888246 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2dac009d00 con 0x7f2dbc10f6c0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2daaffd640 1 -- 10.20.193.4:0/2428888246 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dac0106e0 con 0x7f2dbc10f6c0 2026-02-24T09:16:44.270 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.265+0000 7f2dc3dba640 1 -- 10.20.193.4:0/2428888246 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dbc0fbe40 con 0x7f2dbc10f6c0 2026-02-24T09:16:44.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.267+0000 7f2daaffd640 1 -- 10.20.193.4:0/2428888246 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f2dac0027c0 con 0x7f2dbc10f6c0 2026-02-24T09:16:44.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.268+0000 7f2daaffd640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2d980b5750 0x7f2d980d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.268+0000 7f2daaffd640 1 -- 10.20.193.4:0/2428888246 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2dac0e6d30 con 0x7f2dbc10f6c0 2026-02-24T09:16:44.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.268+0000 7f2dc132e640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2d980b5750 0x7f2d980d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.268+0000 7f2dc132e640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2d980b5750 0x7f2d980d5c00 secure :-1 s=READY pgs=394 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dbc0fc3a0 tx=0x7f2db003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.269+0000 7f2dc5db4e00 1 Processor -- start 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.269+0000 7f2dc5db4e00 1 -- start start 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.269+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfe300 0x562df0bfe6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.269+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfec10 0x562df0c43370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.269+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0c438b0 0x562df0c63c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.269+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562df0b0e520 con 0x562df0bfec10 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.269+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562df0b0a250 con 0x562df0bfe300 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.269+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562df0b043b0 con 0x562df0c438b0 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc132e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfec10 0x562df0c43370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc132e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfec10 0x562df0c43370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34820/0 (socket says 10.20.193.4:34820) 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc132e640 1 -- 10.20.193.4:0/1017000409 learned_addr learned my addr 10.20.193.4:0/1017000409 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc2330640 1 --2- 10.20.193.4:0/1017000409 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0c438b0 0x562df0c63c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/1017000409 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfe300 0x562df0bfe6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc132e640 1 -- 10.20.193.4:0/1017000409 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0c438b0 msgr2=0x562df0c63c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc132e640 1 --2- 10.20.193.4:0/1017000409 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0c438b0 0x562df0c63c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc132e640 1 -- 10.20.193.4:0/1017000409 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfe300 msgr2=0x562df0bfe6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc132e640 1 --2- 10.20.193.4:0/1017000409 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfe300 0x562df0bfe6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc132e640 1 -- 10.20.193.4:0/1017000409 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df0aaf6e0 con 0x562df0bfec10 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc132e640 1 --2- 10.20.193.4:0/1017000409 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfec10 0x562df0c43370 secure :-1 s=READY pgs=1017 gs=1 cs=0 l=1 c_cookie=14209663657720719167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2db0002e50 tx=0x7f2db0040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c532ddcf8838a73f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2d8a4e6640 1 -- 10.20.193.4:0/1017000409 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2db0002a00 con 0x562df0bfec10 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2d8a4e6640 1 -- 10.20.193.4:0/1017000409 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2db003e040 con 0x562df0bfec10 2026-02-24T09:16:44.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2d8a4e6640 1 -- 10.20.193.4:0/1017000409 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2db004f850 con 0x562df0bfec10 2026-02-24T09:16:44.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1017000409 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfec10 msgr2=0x562df0c43370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/1017000409 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfec10 0x562df0c43370 secure :-1 s=READY pgs=1017 gs=1 cs=0 l=1 c_cookie=14209663657720719167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2db0002e50 tx=0x7f2db0040000 comp rx=0 tx=0).stop 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1017000409 shutdown_connections 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/1017000409 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0c438b0 0x562df0c63c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/1017000409 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfec10 0x562df0c43370 unknown :-1 s=CLOSED pgs=1017 gs=1 cs=0 l=1 c_cookie=14209663657720719167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.270+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/1017000409 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfe300 0x562df0bfe6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.271+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1017000409 >> 10.20.193.4:0/1017000409 conn(0x562df0b1c4f0 msgr2=0x562df0bfcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.271+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1017000409 shutdown_connections 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.271+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1017000409 wait complete. 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.271+0000 7f2dc5db4e00 1 -- start start 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.271+0000 7f2dc5db4e00 1 Processor -- start 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfe300 0x562df0c16320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0bfec10 0x562df0c16860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0c438b0 0x562df0c1b850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562df0c1bd90 con 0x562df0c438b0 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562df0c1bf00 con 0x562df0bfe300 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562df0c1c0c0 con 0x562df0bfec10 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc2330640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0c438b0 0x562df0c1b850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc2330640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0c438b0 0x562df0c1b850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34822/0 (socket says 10.20.193.4:34822) 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc2330640 1 -- 10.20.193.4:0/1913912330 learned_addr learned my addr 10.20.193.4:0/1913912330 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfe300 0x562df0c16320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc132e640 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0bfec10 0x562df0c16860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc2330640 1 -- 10.20.193.4:0/1913912330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0bfec10 msgr2=0x562df0c16860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc2330640 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0bfec10 0x562df0c16860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc2330640 1 -- 10.20.193.4:0/1913912330 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfe300 msgr2=0x562df0c16320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc2330640 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfe300 0x562df0c16320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc2330640 1 -- 10.20.193.4:0/1913912330 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df0a87cd0 con 0x562df0c438b0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc2330640 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0c438b0 0x562df0c1b850 secure :-1 s=READY pgs=1018 gs=2 cs=0 l=1 c_cookie=16841884903575354851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2db8003c20 tx=0x7f2db800aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ba6516719f7de3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2d777fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2d777fe640 1 -- 10.20.193.4:0/1913912330 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2db8018070 con 0x562df0c438b0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1913912330 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dbc176af0 con 0x562df0c438b0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2d777fe640 1 -- 10.20.193.4:0/1913912330 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2db8011d40 con 0x562df0c438b0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2d777fe640 1 -- 10.20.193.4:0/1913912330 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2db80103c0 con 0x562df0c438b0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 10 client.17358 _ll_register_callbacks cb 0x562df0a80790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1913912330 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562df07919d0 con 0x562df0c438b0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2d777fe640 1 -- 10.20.193.4:0/1913912330 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2db8010550 con 0x562df0c438b0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2d777fe640 1 -- 10.20.193.4:0/1913912330 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2db8010710 con 0x562df0c438b0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 10 client.17358 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.272+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1913912330 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562df0a99ab0 con 0x562df0c438b0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.273+0000 7f2d777fe640 1 -- 10.20.193.4:0/1913912330 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2db8011860 con 0x562df0c438b0 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.273+0000 7f2dc5db4e00 10 client.17358 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.273+0000 7f2dc5db4e00 10 client.17358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.273+0000 7f2dc5db4e00 20 client.17358 populate_metadata read hostname 'trial004' 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.273+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562df0c40cf0 0x562df0c41190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.278 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.273+0000 7f2dc5db4e00 4 client.17358 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:44.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.273+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1913912330 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562df0b14b70 con 0x562df0c40cf0 2026-02-24T09:16:44.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.273+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562df0c40cf0 0x562df0c41190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.273+0000 7f2d777fe640 10 client.17358 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:44.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.273+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562df0c40cf0 0x562df0c41190 crc :-1 s=READY pgs=155 gs=4 cs=0 l=0 c_cookie=13689911151818264465 s_cookie=10469300573286020441 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdfc55a90ac94f91 server_cookie=914a6d671581b559 in_seq=0 out_seq=0 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2d777fe640 1 -- 10.20.193.4:0/1913912330 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562df0b14b70 con 0x562df0c40cf0 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2d777fe640 10 client.17358 handle_command_reply: tid=0 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 client.17358 shutdown 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1913912330 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0c438b0 msgr2=0x562df0c1b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0c438b0 0x562df0c1b850 secure :-1 s=READY pgs=1018 gs=2 cs=0 l=1 c_cookie=16841884903575354851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2db8003c20 tx=0x7f2db800aab0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1913912330 shutdown_connections 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562df0c40cf0 0x562df0c41190 crc :-1 s=READY pgs=155 gs=4 cs=0 l=0 c_cookie=13689911151818264465 s_cookie=10469300573286020441 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0c438b0 0x562df0c1b850 unknown :-1 s=CLOSED pgs=1018 gs=2 cs=0 l=1 c_cookie=16841884903575354851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2d777fe640 0 client.17358 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0bfec10 0x562df0c16860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/1913912330 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfe300 0x562df0c16320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1913912330 >> 10.20.193.4:0/1913912330 conn(0x562df0b1c4f0 msgr2=0x562df0bfd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1913912330 shutdown_connections 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/1913912330 wait complete. 2026-02-24T09:16:44.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.274+0000 7f2dc5db4e00 20 client.17358 trim_cache size 0 max 16384 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc5db4e00 1 Processor -- start 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc5db4e00 1 -- start start 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c3bd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0bfec10 0x562df0c3c270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0c438b0 0x562df0bfc4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562df0b01fe0 con 0x562df0bfe300 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562df07ccfe0 con 0x562df0c438b0 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562df0b724c0 con 0x562df0bfec10 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc1b2f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c3bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc1b2f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c3bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34830/0 (socket says 10.20.193.4:34830) 2026-02-24T09:16:44.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/443763622 learned_addr learned my addr 10.20.193.4:0/443763622 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc132e640 1 --2- 10.20.193.4:0/443763622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0bfec10 0x562df0c3c270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc2330640 1 --2- 10.20.193.4:0/443763622 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0c438b0 0x562df0bfc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/443763622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0bfec10 msgr2=0x562df0c3c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/443763622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0bfec10 0x562df0c3c270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/443763622 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0c438b0 msgr2=0x562df0bfc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/443763622 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0c438b0 0x562df0bfc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/443763622 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df0a94530 con 0x562df0bfe300 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.286+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/443763622 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c3bd30 secure :-1 s=READY pgs=1019 gs=1 cs=0 l=1 c_cookie=976464715093123429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dac002ba0 tx=0x7f2dac002c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d197c1ed42165 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.287+0000 7f2d89ce5640 1 -- 10.20.193.4:0/443763622 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dac0ac860 con 0x562df0bfe300 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.287+0000 7f2d89ce5640 1 -- 10.20.193.4:0/443763622 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2dac0ada60 con 0x562df0bfe300 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.287+0000 7f2d89ce5640 1 -- 10.20.193.4:0/443763622 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dac0acc00 con 0x562df0bfe300 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.287+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/443763622 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 msgr2=0x562df0c3bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.287+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/443763622 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c3bd30 secure :-1 s=READY pgs=1019 gs=1 cs=0 l=1 c_cookie=976464715093123429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dac002ba0 tx=0x7f2dac002c90 comp rx=0 tx=0).stop 2026-02-24T09:16:44.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.288+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/443763622 shutdown_connections 2026-02-24T09:16:44.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.288+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/443763622 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0c438b0 0x562df0bfc4e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.288+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/443763622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0bfec10 0x562df0c3c270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.288+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/443763622 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c3bd30 unknown :-1 s=CLOSED pgs=1019 gs=1 cs=0 l=1 c_cookie=976464715093123429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.288+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/443763622 >> 10.20.193.4:0/443763622 conn(0x562df0b1c4f0 msgr2=0x562df0c128e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.288+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/443763622 shutdown_connections 2026-02-24T09:16:44.292 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.288+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/443763622 wait complete. 2026-02-24T09:16:44.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc5db4e00 1 -- start start 2026-02-24T09:16:44.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc5db4e00 1 Processor -- start 2026-02-24T09:16:44.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c222d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfec10 0x562df0c1e930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc5db4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0c438b0 0x562df0c1ee70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562df0c1b960 con 0x562df0bfe300 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562df0c22a80 con 0x562df0bfec10 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc5db4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562df0c1f3b0 con 0x562df0c438b0 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc1b2f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc1b2f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c222d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34840/0 (socket says 10.20.193.4:34840) 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/2771344149 learned_addr learned my addr 10.20.193.4:0/2771344149 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc2330640 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0c438b0 0x562df0c1ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc132e640 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfec10 0x562df0c1e930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/2771344149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0c438b0 msgr2=0x562df0c1ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0c438b0 0x562df0c1ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/2771344149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfec10 msgr2=0x562df0c1e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfec10 0x562df0c1e930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc1b2f640 1 -- 10.20.193.4:0/2771344149 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df0a88000 con 0x562df0bfe300 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc132e640 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfec10 0x562df0c1e930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc1b2f640 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c222d0 secure :-1 s=READY pgs=1020 gs=1 cs=0 l=1 c_cookie=10409567650612136863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dac0aa2d0 tx=0x7f2dac002bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907636a040224b9f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2d777fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2d777fe640 1 -- 10.20.193.4:0/2771344149 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dac0b5360 con 0x562df0bfe300 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/2771344149 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dbc0fbe40 con 0x562df0bfe300 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.289+0000 7f2d777fe640 1 -- 10.20.193.4:0/2771344149 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2dac076070 con 0x562df0bfe300 2026-02-24T09:16:44.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2d777fe640 1 -- 10.20.193.4:0/2771344149 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dac0b7f90 con 0x562df0bfe300 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc5db4e00 10 client.17364 _ll_register_callbacks cb 0x562df0a80790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/2771344149 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562df0b167e0 con 0x562df0bfe300 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2d777fe640 1 -- 10.20.193.4:0/2771344149 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2dac096040 con 0x562df0bfe300 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2d777fe640 1 -- 10.20.193.4:0/2771344149 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2dac072280 con 0x562df0bfe300 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc5db4e00 10 client.17364 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/2771344149 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562df0a99d10 con 0x562df0bfe300 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2d777fe640 1 -- 10.20.193.4:0/2771344149 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2dac0d0d20 con 0x562df0bfe300 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc5db4e00 10 client.17364 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc5db4e00 10 client.17364 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc5db4e00 20 client.17364 populate_metadata read hostname 'trial004' 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562df0cf13f0 0x562df0d118a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc5db4e00 4 client.17364 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:16:44.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/2771344149 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562df078f220 con 0x562df0cf13f0 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc132e640 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562df0cf13f0 0x562df0d118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2d777fe640 10 client.17364 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.290+0000 7f2dc132e640 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562df0cf13f0 0x562df0d118a0 crc :-1 s=READY pgs=156 gs=4 cs=0 l=0 c_cookie=5846705239671650355 s_cookie=9116442255467276406 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5123ab70350b3833 server_cookie=7e841bee2c7ce876 in_seq=0 out_seq=0 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2d777fe640 1 -- 10.20.193.4:0/2771344149 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562df078f220 con 0x562df0cf13f0 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2d777fe640 10 client.17364 handle_command_reply: tid=0 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 client.17364 shutdown 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/2771344149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 msgr2=0x562df0c222d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c222d0 secure :-1 s=READY pgs=1020 gs=1 cs=0 l=1 c_cookie=10409567650612136863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dac0aa2d0 tx=0x7f2dac002bf0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/2771344149 shutdown_connections 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562df0cf13f0 0x562df0d118a0 crc :-1 s=READY pgs=156 gs=4 cs=0 l=0 c_cookie=5846705239671650355 s_cookie=9116442255467276406 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562df0c438b0 0x562df0c1ee70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2d777fe640 0 client.17364 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562df0bfec10 0x562df0c1e930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 --2- 10.20.193.4:0/2771344149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562df0bfe300 0x562df0c222d0 unknown :-1 s=CLOSED pgs=1020 gs=1 cs=0 l=1 c_cookie=10409567650612136863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/2771344149 >> 10.20.193.4:0/2771344149 conn(0x562df0b1c4f0 msgr2=0x562df0c130d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/2771344149 shutdown_connections 2026-02-24T09:16:44.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 1 -- 10.20.193.4:0/2771344149 wait complete. 2026-02-24T09:16:44.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.292+0000 7f2dc5db4e00 20 client.17364 trim_cache size 0 max 16384 2026-02-24T09:16:44.297 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:16:44.297 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:16:44.297 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "b6915c9c-aada-4229-b2d4-e708c7197df4", 2026-02-24T09:16:44.297 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:16:44.297 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 -- 10.20.193.4:0/2428888246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2d980b5750 msgr2=0x7f2d980d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2d980b5750 0x7f2d980d5c00 secure :-1 s=READY pgs=394 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dbc0fc3a0 tx=0x7f2db003a040 comp rx=0 tx=0).stop 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 -- 10.20.193.4:0/2428888246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2dbc10f6c0 msgr2=0x7f2dbc0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2dbc10f6c0 0x7f2dbc0f5a00 secure :-1 s=READY pgs=1016 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dac00d950 tx=0x7f2dac00de20 comp rx=0 tx=0).stop 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 -- 10.20.193.4:0/2428888246 shutdown_connections 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2d980b5750 0x7f2d980d5c00 unknown :-1 s=CLOSED pgs=394 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2dbc1158b0 0x7f2dbc0f6100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2dbc1100b0 0x7f2dbc176180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 --2- 10.20.193.4:0/2428888246 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2dbc10f6c0 0x7f2dbc0f5a00 unknown :-1 s=CLOSED pgs=1016 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 -- 10.20.193.4:0/2428888246 >> 10.20.193.4:0/2428888246 conn(0x7f2dbc0ecfd0 msgr2=0x7f2dbc112f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 -- 10.20.193.4:0/2428888246 shutdown_connections 2026-02-24T09:16:44.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.293+0000 7f2dc3dba640 1 -- 10.20.193.4:0/2428888246 wait complete. 2026-02-24T09:16:44.401 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:16:44.575 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:16:44.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.746+0000 7fcfce141640 1 -- 10.20.193.4:0/1407890170 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcfc810f650 msgr2=0x7fcfc810fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.746+0000 7fcfce141640 1 --2- 10.20.193.4:0/1407890170 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcfc810f650 0x7fcfc810fa20 secure :-1 s=READY pgs=1021 gs=1 cs=0 l=1 c_cookie=13289013566039689768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb4009890 tx=0x7fcfb402f0e0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.746+0000 7fcfce141640 1 -- 10.20.193.4:0/1407890170 shutdown_connections 2026-02-24T09:16:44.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.746+0000 7fcfce141640 1 --2- 10.20.193.4:0/1407890170 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcfc8115840 0x7fcfc8176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.746+0000 7fcfce141640 1 --2- 10.20.193.4:0/1407890170 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcfc8110040 0x7fcfc8115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.746+0000 7fcfce141640 1 --2- 10.20.193.4:0/1407890170 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcfc810f650 0x7fcfc810fa20 unknown :-1 s=CLOSED pgs=1021 gs=1 cs=0 l=1 c_cookie=13289013566039689768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.746+0000 7fcfce141640 1 -- 10.20.193.4:0/1407890170 >> 10.20.193.4:0/1407890170 conn(0x7fcfc80ecf20 msgr2=0x7fcfc810d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.747+0000 7fcfce141640 1 -- 10.20.193.4:0/1407890170 shutdown_connections 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.747+0000 7fcfce141640 1 -- 10.20.193.4:0/1407890170 wait complete. 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.747+0000 7fcfce141640 1 Processor -- start 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.747+0000 7fcfce141640 1 -- start start 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfce141640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcfc810f650 0x7fcfc80fe8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfce141640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcfc8110040 0x7fcfc8176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfce141640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcfc8115840 0x7fcfc80fefa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfce141640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8100910 con 0x7fcfc810f650 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfce141640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8100a80 con 0x7fcfc8115840 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfce141640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8100c40 con 0x7fcfc8110040 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcfc810f650 0x7fcfc80fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcfc810f650 0x7fcfc80fe8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34858/0 (socket says 10.20.193.4:34858) 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc77fe640 1 -- 10.20.193.4:0/1830402486 learned_addr learned my addr 10.20.193.4:0/1830402486 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc6ffd640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcfc8110040 0x7fcfc8176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc7fff640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcfc8115840 0x7fcfc80fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.752 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc77fe640 1 -- 10.20.193.4:0/1830402486 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcfc8110040 msgr2=0x7fcfc8176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcfc8110040 0x7fcfc8176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc77fe640 1 -- 10.20.193.4:0/1830402486 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcfc8115840 msgr2=0x7fcfc80fefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcfc8115840 0x7fcfc80fefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc77fe640 1 -- 10.20.193.4:0/1830402486 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb40094b0 con 0x7fcfc810f650 2026-02-24T09:16:44.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.748+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcfc810f650 0x7fcfc80fe8a0 secure :-1 s=READY pgs=1022 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb40023b0 tx=0x7fcfb40028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.749+0000 7fcfc4ff9640 1 -- 10.20.193.4:0/1830402486 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfb403d070 con 0x7fcfc810f650 2026-02-24T09:16:44.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.749+0000 7fcfce141640 1 -- 10.20.193.4:0/1830402486 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc8100ec0 con 0x7fcfc810f650 2026-02-24T09:16:44.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.749+0000 7fcfce141640 1 -- 10.20.193.4:0/1830402486 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc8101380 con 0x7fcfc810f650 2026-02-24T09:16:44.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.749+0000 7fcfc4ff9640 1 -- 10.20.193.4:0/1830402486 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcfb402fcb0 con 0x7fcfc810f650 2026-02-24T09:16:44.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.749+0000 7fcfc4ff9640 1 -- 10.20.193.4:0/1830402486 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfb4041a00 con 0x7fcfc810f650 2026-02-24T09:16:44.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.759+0000 7fcfc4ff9640 1 -- 10.20.193.4:0/1830402486 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fcfb40386b0 con 0x7fcfc810f650 2026-02-24T09:16:44.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.760+0000 7fcfd013be00 1 Processor -- start 2026-02-24T09:16:44.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.760+0000 7fcfd013be00 1 -- start start 2026-02-24T09:16:44.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 0x561abed20bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed21130 0x561abed65890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 0x561abed861b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfd013be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561abec30de0 con 0x561abed65dd0 2026-02-24T09:16:44.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfd013be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561abec2cb10 con 0x561abed20820 2026-02-24T09:16:44.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfd013be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561abec26ab0 con 0x561abed21130 2026-02-24T09:16:44.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc77fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed21130 0x561abed65890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc7fff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 0x561abed20bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc77fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed21130 0x561abed65890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:39368/0 (socket says 10.20.193.4:39368) 2026-02-24T09:16:44.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc77fe640 1 -- 10.20.193.4:0/891131729 learned_addr learned my addr 10.20.193.4:0/891131729 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:44.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc4ff9640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcf9c0b56d0 0x7fcf9c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc6ffd640 1 --2- 10.20.193.4:0/891131729 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 0x561abed861b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc77fe640 1 -- 10.20.193.4:0/891131729 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 msgr2=0x561abed20bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/891131729 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 0x561abed20bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc77fe640 1 -- 10.20.193.4:0/891131729 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 msgr2=0x561abed861b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/891131729 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 0x561abed861b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc77fe640 1 -- 10.20.193.4:0/891131729 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abebd2310 con 0x561abed21130 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.761+0000 7fcfc7fff640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcf9c0b56d0 0x7fcf9c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.762+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/891131729 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed21130 0x561abed65890 secure :-1 s=READY pgs=105 gs=3 cs=0 l=1 c_cookie=6762168432705704126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb4102630 tx=0x7fcfb4103140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dd80c5caec890be server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.762+0000 7fcf8bfff640 1 -- 10.20.193.4:0/891131729 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfb40bd050 con 0x561abed21130 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.762+0000 7fcf8bfff640 1 -- 10.20.193.4:0/891131729 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcfb40cb710 con 0x561abed21130 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.762+0000 7fcf8bfff640 1 -- 10.20.193.4:0/891131729 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfb40447c0 con 0x561abed21130 2026-02-24T09:16:44.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.762+0000 7fcfc4ff9640 1 -- 10.20.193.4:0/1830402486 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fcfb410b540 con 0x7fcfc810f650 2026-02-24T09:16:44.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.763+0000 7fcfd013be00 1 -- 10.20.193.4:0/891131729 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed21130 msgr2=0x561abed65890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.763+0000 7fcfc7fff640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcf9c0b56d0 0x7fcf9c0d5b80 secure :-1 s=READY pgs=395 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfbc005820 tx=0x7fcfbc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.763+0000 7fcfd013be00 1 --2- 10.20.193.4:0/891131729 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed21130 0x561abed65890 secure :-1 s=READY pgs=105 gs=3 cs=0 l=1 c_cookie=6762168432705704126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb4102630 tx=0x7fcfb4103140 comp rx=0 tx=0).stop 2026-02-24T09:16:44.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.763+0000 7fcfd013be00 1 -- 10.20.193.4:0/891131729 shutdown_connections 2026-02-24T09:16:44.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.763+0000 7fcfd013be00 1 --2- 10.20.193.4:0/891131729 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 0x561abed861b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.763+0000 7fcfd013be00 1 --2- 10.20.193.4:0/891131729 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed21130 0x561abed65890 unknown :-1 s=CLOSED pgs=105 gs=3 cs=0 l=1 c_cookie=6762168432705704126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.763+0000 7fcfd013be00 1 --2- 10.20.193.4:0/891131729 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 0x561abed20bf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.763+0000 7fcfd013be00 1 -- 10.20.193.4:0/891131729 >> 10.20.193.4:0/891131729 conn(0x561abec3f6b0 msgr2=0x561abed1f100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.763+0000 7fcfd013be00 1 -- 10.20.193.4:0/891131729 shutdown_connections 2026-02-24T09:16:44.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.763+0000 7fcfd013be00 1 -- 10.20.193.4:0/891131729 wait complete. 2026-02-24T09:16:44.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.764+0000 7fcfd013be00 1 -- start start 2026-02-24T09:16:44.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.764+0000 7fcfd013be00 1 Processor -- start 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 0x561abed38b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed21130 0x561abed39040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed65dd0 0x561abed3e030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfd013be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561abed3e570 con 0x561abed21130 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfd013be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561abed3e6e0 con 0x561abed20820 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfd013be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561abed3e8a0 con 0x561abed65dd0 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc77fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 0x561abed38b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed21130 0x561abed39040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc77fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 0x561abed38b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:58876/0 (socket says 10.20.193.4:58876) 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc77fe640 1 -- 10.20.193.4:0/877921684 learned_addr learned my addr 10.20.193.4:0/877921684 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc7fff640 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed65dd0 0x561abed3e030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc77fe640 1 -- 10.20.193.4:0/877921684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed65dd0 msgr2=0x561abed3e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed65dd0 0x561abed3e030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc77fe640 1 -- 10.20.193.4:0/877921684 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed21130 msgr2=0x561abed39040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed21130 0x561abed39040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc77fe640 1 -- 10.20.193.4:0/877921684 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abebaa8c0 con 0x561abed20820 2026-02-24T09:16:44.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 0x561abed38b00 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=10239172824840619528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb4002940 tx=0x7fcfb4041410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e18d96f4a754608 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcf897fa640 10 client.0 ms_handle_connect on v2:10.20.193.14:3300/0 2026-02-24T09:16:44.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcf897fa640 1 -- 10.20.193.4:0/877921684 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfb410b770 con 0x561abed20820 2026-02-24T09:16:44.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcf897fa640 1 -- 10.20.193.4:0/877921684 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcfb404e340 con 0x561abed20820 2026-02-24T09:16:44.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcf897fa640 1 -- 10.20.193.4:0/877921684 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfb40d7640 con 0x561abed20820 2026-02-24T09:16:44.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.765+0000 7fcfd013be00 1 -- 10.20.193.4:0/877921684 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc8101380 con 0x561abed20820 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcf897fa640 1 -- 10.20.193.4:0/877921684 <== mon.2 v2:10.20.193.14:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fcfb40d9bb0 con 0x561abed20820 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcf897fa640 10 client.26456 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcfd013be00 10 client.26456 _ll_register_callbacks cb 0x561abebc2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcfd013be00 1 -- 10.20.193.4:0/877921684 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561abe9764a0 con 0x561abed20820 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcf897fa640 1 -- 10.20.193.4:0/877921684 <== mon.2 v2:10.20.193.14:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcfb404e120 con 0x561abed20820 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcfd013be00 10 client.26456 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcfd013be00 1 -- 10.20.193.4:0/877921684 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561abebbc6e0 con 0x561abed20820 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcf897fa640 1 -- 10.20.193.4:0/877921684 <== mon.2 v2:10.20.193.14:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fcfb4107e00 con 0x561abed20820 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcfd013be00 10 client.26456 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcfd013be00 10 client.26456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcfd013be00 20 client.26456 populate_metadata read hostname 'trial004' 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcfd013be00 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561abed62f60 0x561abed63400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcfd013be00 4 client.26456 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.766+0000 7fcfd013be00 1 -- 10.20.193.4:0/877921684 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561abec1c4f0 con 0x561abed62f60 2026-02-24T09:16:44.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.767+0000 7fcfc6ffd640 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561abed62f60 0x561abed63400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.769+0000 7fcfc6ffd640 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561abed62f60 0x561abed63400 crc :-1 s=READY pgs=157 gs=4 cs=0 l=0 c_cookie=17480415305202924999 s_cookie=4152666253427372604 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f296e91ad8ebfdc7 server_cookie=39a13bf4aa4a723c in_seq=0 out_seq=0 2026-02-24T09:16:44.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.769+0000 7fcf897fa640 10 client.26456 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:44.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.769+0000 7fcf897fa640 1 -- 10.20.193.4:0/877921684 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561abec1c4f0 con 0x561abed62f60 2026-02-24T09:16:44.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.769+0000 7fcf897fa640 10 client.26456 handle_command_reply: tid=0 2026-02-24T09:16:44.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.769+0000 7fcfd013be00 1 client.26456 shutdown 2026-02-24T09:16:44.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 1 -- 10.20.193.4:0/877921684 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 msgr2=0x561abed38b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 0x561abed38b00 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=10239172824840619528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb4002940 tx=0x7fcfb4041410 comp rx=0 tx=0).stop 2026-02-24T09:16:44.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 1 -- 10.20.193.4:0/877921684 shutdown_connections 2026-02-24T09:16:44.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561abed62f60 0x561abed63400 crc :-1 s=READY pgs=157 gs=4 cs=0 l=0 c_cookie=17480415305202924999 s_cookie=4152666253427372604 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed65dd0 0x561abed3e030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed21130 0x561abed39040 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 1 --2- 10.20.193.4:0/877921684 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed20820 0x561abed38b00 unknown :-1 s=CLOSED pgs=94 gs=2 cs=0 l=1 c_cookie=10239172824840619528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 1 -- 10.20.193.4:0/877921684 >> 10.20.193.4:0/877921684 conn(0x561abec3f6b0 msgr2=0x561abed1f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcf897fa640 0 client.26456 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:44.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 1 -- 10.20.193.4:0/877921684 shutdown_connections 2026-02-24T09:16:44.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 1 -- 10.20.193.4:0/877921684 wait complete. 2026-02-24T09:16:44.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.770+0000 7fcfd013be00 20 client.26456 trim_cache size 0 max 16384 2026-02-24T09:16:44.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfd013be00 1 Processor -- start 2026-02-24T09:16:44.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfd013be00 1 -- start start 2026-02-24T09:16:44.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed20820 0x561abed36100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed21130 0x561abed3d5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 0x561abed1ea00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfd013be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561abec246e0 con 0x561abed65dd0 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfd013be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561abe8eff50 con 0x561abed21130 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfd013be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561abec93150 con 0x561abed20820 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfc7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 0x561abed1ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfc7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 0x561abed1ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34894/0 (socket says 10.20.193.4:34894) 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfc7fff640 1 -- 10.20.193.4:0/692244873 learned_addr learned my addr 10.20.193.4:0/692244873 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfc6ffd640 1 --2- 10.20.193.4:0/692244873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed21130 0x561abed3d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.781+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/692244873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed20820 0x561abed36100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.782+0000 7fcfc7fff640 1 -- 10.20.193.4:0/692244873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed20820 msgr2=0x561abed36100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.782+0000 7fcfc7fff640 1 --2- 10.20.193.4:0/692244873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed20820 0x561abed36100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.782+0000 7fcfc7fff640 1 -- 10.20.193.4:0/692244873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed21130 msgr2=0x561abed3d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.782+0000 7fcfc7fff640 1 --2- 10.20.193.4:0/692244873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed21130 0x561abed3d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.782+0000 7fcfc7fff640 1 -- 10.20.193.4:0/692244873 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abebb7160 con 0x561abed65dd0 2026-02-24T09:16:44.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.782+0000 7fcfc7fff640 1 --2- 10.20.193.4:0/692244873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 0x561abed1ea00 secure :-1 s=READY pgs=1023 gs=1 cs=0 l=1 c_cookie=424802323862571892 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfbc00af80 tx=0x7fcfbc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e533767d96cb74 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.782+0000 7fcf8b7fe640 1 -- 10.20.193.4:0/692244873 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfbc019070 con 0x561abed65dd0 2026-02-24T09:16:44.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.782+0000 7fcf8b7fe640 1 -- 10.20.193.4:0/692244873 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcfbc011b50 con 0x561abed65dd0 2026-02-24T09:16:44.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.782+0000 7fcf8b7fe640 1 -- 10.20.193.4:0/692244873 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfbc01f680 con 0x561abed65dd0 2026-02-24T09:16:44.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.783+0000 7fcfd013be00 1 -- 10.20.193.4:0/692244873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 msgr2=0x561abed1ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.783+0000 7fcfd013be00 1 --2- 10.20.193.4:0/692244873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 0x561abed1ea00 secure :-1 s=READY pgs=1023 gs=1 cs=0 l=1 c_cookie=424802323862571892 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfbc00af80 tx=0x7fcfbc019000 comp rx=0 tx=0).stop 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.783+0000 7fcfd013be00 1 -- 10.20.193.4:0/692244873 shutdown_connections 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.783+0000 7fcfd013be00 1 --2- 10.20.193.4:0/692244873 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed65dd0 0x561abed1ea00 unknown :-1 s=CLOSED pgs=1023 gs=1 cs=0 l=1 c_cookie=424802323862571892 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.783+0000 7fcfd013be00 1 --2- 10.20.193.4:0/692244873 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed21130 0x561abed3d5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.783+0000 7fcfd013be00 1 --2- 10.20.193.4:0/692244873 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed20820 0x561abed36100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.783+0000 7fcfd013be00 1 -- 10.20.193.4:0/692244873 >> 10.20.193.4:0/692244873 conn(0x561abec3f6b0 msgr2=0x561abed3ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.783+0000 7fcfd013be00 1 -- 10.20.193.4:0/692244873 shutdown_connections 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.783+0000 7fcfd013be00 1 -- 10.20.193.4:0/692244873 wait complete. 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfd013be00 1 -- start start 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfd013be00 1 Processor -- start 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed20820 0x561abed44ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed21130 0x561abed40250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfd013be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed65dd0 0x561abed409e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfd013be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561abed410e0 con 0x561abed20820 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfd013be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561abedcb2f0 con 0x561abed21130 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfd013be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561abedcb4b0 con 0x561abed65dd0 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfc77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed20820 0x561abed44ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfc77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed20820 0x561abed44ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:34910/0 (socket says 10.20.193.4:34910) 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfc77fe640 1 -- 10.20.193.4:0/3270613843 learned_addr learned my addr 10.20.193.4:0/3270613843 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.784+0000 7fcfc7fff640 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed65dd0 0x561abed409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfc77fe640 1 -- 10.20.193.4:0/3270613843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed65dd0 msgr2=0x561abed409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed65dd0 0x561abed409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfc77fe640 1 -- 10.20.193.4:0/3270613843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed21130 msgr2=0x561abed40250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed21130 0x561abed40250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.794 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfc77fe640 1 -- 10.20.193.4:0/3270613843 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abebaabf0 con 0x561abed20820 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfc77fe640 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed20820 0x561abed44ca0 secure :-1 s=READY pgs=1024 gs=1 cs=0 l=1 c_cookie=12329923196920137065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb40cd1c0 tx=0x7fcfb40cfd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1cafd224460569 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcf897fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcf897fa640 1 -- 10.20.193.4:0/3270613843 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfb403dee0 con 0x561abed20820 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 1 -- 10.20.193.4:0/3270613843 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc003c80 con 0x561abed20820 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcf897fa640 1 -- 10.20.193.4:0/3270613843 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x561abe9764a0 con 0x561abed20820 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcf897fa640 1 -- 10.20.193.4:0/3270613843 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcfb40d75d0 con 0x561abed20820 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 10 client.17382 _ll_register_callbacks cb 0x561abebc2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 1 -- 10.20.193.4:0/3270613843 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561abe8b1f40 con 0x561abed20820 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcf897fa640 1 -- 10.20.193.4:0/3270613843 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fcfb4041070 con 0x561abed20820 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcf897fa640 1 -- 10.20.193.4:0/3270613843 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcfb4041230 con 0x561abed20820 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 10 client.17382 fetch_fsmap learned FSMap version 19 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 1 -- 10.20.193.4:0/3270613843 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561abebbc940 con 0x561abed20820 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcf897fa640 1 -- 10.20.193.4:0/3270613843 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fcfb40d3770 con 0x561abed20820 2026-02-24T09:16:44.795 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 10 client.17382 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 10 client.17382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 20 client.17382 populate_metadata read hostname 'trial004' 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561abee12dd0 0x561abee33280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 4 client.17382 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.785+0000 7fcfd013be00 1 -- 10.20.193.4:0/3270613843 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fcfb40cb710 con 0x561abee12dd0 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfc6ffd640 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561abee12dd0 0x561abee33280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfc6ffd640 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561abee12dd0 0x561abee33280 crc :-1 s=READY pgs=158 gs=4 cs=0 l=0 c_cookie=4777421006588243851 s_cookie=8528334253939029684 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=424ccf17f82e6f8b server_cookie=765abad1a3d4f6b4 in_seq=0 out_seq=0 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcf897fa640 10 client.17382 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcf897fa640 1 -- 10.20.193.4:0/3270613843 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x7fcfb40cb710 con 0x561abee12dd0 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcf897fa640 10 client.17382 handle_command_reply: tid=0 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 client.17382 shutdown 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 -- 10.20.193.4:0/3270613843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed20820 msgr2=0x561abed44ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.796 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed20820 0x561abed44ca0 secure :-1 s=READY pgs=1024 gs=1 cs=0 l=1 c_cookie=12329923196920137065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb40cd1c0 tx=0x7fcfb40cfd10 comp rx=0 tx=0).stop 2026-02-24T09:16:44.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 -- 10.20.193.4:0/3270613843 shutdown_connections 2026-02-24T09:16:44.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561abee12dd0 0x561abee33280 crc :-1 s=READY pgs=158 gs=4 cs=0 l=0 c_cookie=4777421006588243851 s_cookie=8528334253939029684 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561abed65dd0 0x561abed409e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561abed21130 0x561abed40250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 --2- 10.20.193.4:0/3270613843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561abed20820 0x561abed44ca0 unknown :-1 s=CLOSED pgs=1024 gs=1 cs=0 l=1 c_cookie=12329923196920137065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcf897fa640 0 client.17382 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:16:44.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 -- 10.20.193.4:0/3270613843 >> 10.20.193.4:0/3270613843 conn(0x561abec3f6b0 msgr2=0x561abed1f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 -- 10.20.193.4:0/3270613843 shutdown_connections 2026-02-24T09:16:44.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 1 -- 10.20.193.4:0/3270613843 wait complete. 2026-02-24T09:16:44.797 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.786+0000 7fcfd013be00 20 client.17382 trim_cache size 0 max 16384 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "b6915c9c-aada-4229-b2d4-e708c7197df4", 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:16:44.798 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.799 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.800 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.801 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.802 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.803 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:16:44.804 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:16:44.805 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 -- 10.20.193.4:0/1830402486 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcf9c0b56d0 msgr2=0x7fcf9c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcf9c0b56d0 0x7fcf9c0d5b80 secure :-1 s=READY pgs=395 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfbc005820 tx=0x7fcfbc005850 comp rx=0 tx=0).stop 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 -- 10.20.193.4:0/1830402486 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcfc810f650 msgr2=0x7fcfc80fe8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcfc810f650 0x7fcfc80fe8a0 secure :-1 s=READY pgs=1022 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfb40023b0 tx=0x7fcfb40028d0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 -- 10.20.193.4:0/1830402486 shutdown_connections 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fcf9c0b56d0 0x7fcf9c0d5b80 unknown :-1 s=CLOSED pgs=395 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fcfc8115840 0x7fcfc80fefa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcfc8110040 0x7fcfc8176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 --2- 10.20.193.4:0/1830402486 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fcfc810f650 0x7fcfc80fe8a0 unknown :-1 s=CLOSED pgs=1022 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 -- 10.20.193.4:0/1830402486 >> 10.20.193.4:0/1830402486 conn(0x7fcfc80ecf20 msgr2=0x7fcfc8112ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 -- 10.20.193.4:0/1830402486 shutdown_connections 2026-02-24T09:16:44.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:16:44.787+0000 7fcfce141640 1 -- 10.20.193.4:0/1830402486 wait complete. 2026-02-24T09:16:44.858 INFO:tasks.cephfs.filesystem:scrub status for tag:b6915c9c-aada-4229-b2d4-e708c7197df4 - {'path': '/', 'tag': 'b6915c9c-aada-4229-b2d4-e708c7197df4', 'options': 'recursive,force'} 2026-02-24T09:16:45.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:44 trial004 ceph-mon[41596]: pgmap v360: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 693 MiB/s wr, 197 op/s 2026-02-24T09:16:45.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:44 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:16:45.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:44 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:45.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:44 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:16:45.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:44 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:44 trial090 ceph-mon[47278]: pgmap v360: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 693 MiB/s wr, 197 op/s 2026-02-24T09:16:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:44 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:16:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:44 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:44 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:16:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:44 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:44 trial014 ceph-mon[46941]: pgmap v360: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 693 MiB/s wr, 197 op/s 2026-02-24T09:16:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:44 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:16:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:44 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:44 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:16:45.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:44 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:16:47.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:46 trial004 ceph-mon[41596]: pgmap v361: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 660 MiB/s wr, 188 op/s 2026-02-24T09:16:47.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:46 trial090 ceph-mon[47278]: pgmap v361: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 660 MiB/s wr, 188 op/s 2026-02-24T09:16:47.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:46 trial014 ceph-mon[46941]: pgmap v361: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 660 MiB/s wr, 188 op/s 2026-02-24T09:16:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:48 trial004 ceph-mon[41596]: pgmap v362: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 63 KiB/s rd, 782 MiB/s wr, 214 op/s 2026-02-24T09:16:49.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:48 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:16:49.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:48 trial090 ceph-mon[47278]: pgmap v362: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 63 KiB/s rd, 782 MiB/s wr, 214 op/s 2026-02-24T09:16:49.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:48 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:16:49.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:48 trial014 ceph-mon[46941]: pgmap v362: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 63 KiB/s rd, 782 MiB/s wr, 214 op/s 2026-02-24T09:16:49.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:48 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:16:51.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:50 trial004 ceph-mon[41596]: pgmap v363: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 801 MiB/s wr, 213 op/s 2026-02-24T09:16:51.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:50 trial090 ceph-mon[47278]: pgmap v363: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 801 MiB/s wr, 213 op/s 2026-02-24T09:16:51.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:50 trial014 ceph-mon[46941]: pgmap v363: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 801 MiB/s wr, 213 op/s 2026-02-24T09:16:53.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:52 trial004 ceph-mon[41596]: pgmap v364: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 894 MiB/s wr, 247 op/s 2026-02-24T09:16:53.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:52 trial090 ceph-mon[47278]: pgmap v364: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 894 MiB/s wr, 247 op/s 2026-02-24T09:16:53.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:52 trial014 ceph-mon[46941]: pgmap v364: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 894 MiB/s wr, 247 op/s 2026-02-24T09:16:54.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:53 trial004 ceph-mon[41596]: pgmap v365: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 784 MiB/s wr, 219 op/s 2026-02-24T09:16:54.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:53 trial090 ceph-mon[47278]: pgmap v365: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 784 MiB/s wr, 219 op/s 2026-02-24T09:16:54.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:53 trial014 ceph-mon[46941]: pgmap v365: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 784 MiB/s wr, 219 op/s 2026-02-24T09:16:57.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:56 trial004 ceph-mon[41596]: pgmap v366: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 684 MiB/s wr, 195 op/s 2026-02-24T09:16:57.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:56 trial090 ceph-mon[47278]: pgmap v366: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 684 MiB/s wr, 195 op/s 2026-02-24T09:16:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:56 trial014 ceph-mon[46941]: pgmap v366: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 684 MiB/s wr, 195 op/s 2026-02-24T09:16:59.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:16:58 trial004 ceph-mon[41596]: pgmap v367: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 712 MiB/s wr, 202 op/s 2026-02-24T09:16:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:16:58 trial090 ceph-mon[47278]: pgmap v367: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 712 MiB/s wr, 202 op/s 2026-02-24T09:16:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:16:58 trial014 ceph-mon[46941]: pgmap v367: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 712 MiB/s wr, 202 op/s 2026-02-24T09:17:01.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:00 trial004 ceph-mon[41596]: pgmap v368: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 608 MiB/s wr, 173 op/s 2026-02-24T09:17:01.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:00 trial090 ceph-mon[47278]: pgmap v368: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 608 MiB/s wr, 173 op/s 2026-02-24T09:17:01.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:00 trial014 ceph-mon[46941]: pgmap v368: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 608 MiB/s wr, 173 op/s 2026-02-24T09:17:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:02 trial004 ceph-mon[41596]: pgmap v369: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 765 MiB/s wr, 212 op/s 2026-02-24T09:17:03.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:02 trial090 ceph-mon[47278]: pgmap v369: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 765 MiB/s wr, 212 op/s 2026-02-24T09:17:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:02 trial014 ceph-mon[46941]: pgmap v369: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 765 MiB/s wr, 212 op/s 2026-02-24T09:17:04.754 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.2 2026-02-24T09:17:04.754 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:04.902 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:05.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.042+0000 7f42045f4640 1 -- 10.20.193.4:0/4126133600 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41fc155750 msgr2=0x7f41fc175b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.042+0000 7f42045f4640 1 --2- 10.20.193.4:0/4126133600 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41fc155750 0x7f41fc175b30 secure :-1 s=READY pgs=1025 gs=1 cs=0 l=1 c_cookie=2395546687657828312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41f800aa30 tx=0x7f41f8030280 comp rx=0 tx=0).stop 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.042+0000 7f42045f4640 1 -- 10.20.193.4:0/4126133600 shutdown_connections 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.042+0000 7f42045f4640 1 --2- 10.20.193.4:0/4126133600 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41fc155750 0x7f41fc175b30 unknown :-1 s=CLOSED pgs=1025 gs=1 cs=0 l=1 c_cookie=2395546687657828312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.042+0000 7f42045f4640 1 --2- 10.20.193.4:0/4126133600 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41fc0618c0 0x7f41fc155210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.042+0000 7f42045f4640 1 --2- 10.20.193.4:0/4126133600 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41fc060fb0 0x7f41fc061380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.042+0000 7f42045f4640 1 -- 10.20.193.4:0/4126133600 >> 10.20.193.4:0/4126133600 conn(0x7f41fc05f830 msgr2=0x7f41fc10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.042+0000 7f42045f4640 1 -- 10.20.193.4:0/4126133600 shutdown_connections 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.042+0000 7f42045f4640 1 -- 10.20.193.4:0/4126133600 wait complete. 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f42045f4640 1 Processor -- start 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f42045f4640 1 -- start start 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f42045f4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41fc060fb0 0x7f41fc161eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f42045f4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41fc0618c0 0x7f41fc1623f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f42045f4640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41fc155750 0x7f41fc1677c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f42045f4640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc167de0 con 0x7f41fc060fb0 2026-02-24T09:17:05.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f42045f4640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc167f50 con 0x7f41fc155750 2026-02-24T09:17:05.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f42045f4640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc168110 con 0x7f41fc0618c0 2026-02-24T09:17:05.048 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:04 trial004 ceph-mon[41596]: pgmap v370: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 823 MiB/s wr, 224 op/s 2026-02-24T09:17:05.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202369640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41fc060fb0 0x7f41fc161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202369640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41fc060fb0 0x7f41fc161eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52654/0 (socket says 10.20.193.4:52654) 2026-02-24T09:17:05.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202369640 1 -- 10.20.193.4:0/2486930370 learned_addr learned my addr 10.20.193.4:0/2486930370 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:05.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4201b68640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41fc0618c0 0x7f41fc1623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202369640 1 -- 10.20.193.4:0/2486930370 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41fc0618c0 msgr2=0x7f41fc1623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202369640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41fc0618c0 0x7f41fc1623f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202b6a640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41fc155750 0x7f41fc1677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202369640 1 -- 10.20.193.4:0/2486930370 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41fc155750 msgr2=0x7f41fc1677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202369640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41fc155750 0x7f41fc1677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202369640 1 -- 10.20.193.4:0/2486930370 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f800a650 con 0x7f41fc060fb0 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202b6a640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41fc155750 0x7f41fc1677c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f4202369640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41fc060fb0 0x7f41fc161eb0 secure :-1 s=READY pgs=1026 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41ec005db0 tx=0x7f41ec00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f41e37fe640 1 -- 10.20.193.4:0/2486930370 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41ec004500 con 0x7f41fc060fb0 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.043+0000 7f42045f4640 1 -- 10.20.193.4:0/2486930370 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc1683f0 con 0x7f41fc060fb0 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.044+0000 7f41e37fe640 1 -- 10.20.193.4:0/2486930370 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f41ec004d30 con 0x7f41fc060fb0 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.044+0000 7f41e37fe640 1 -- 10.20.193.4:0/2486930370 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41ec002a40 con 0x7f41fc060fb0 2026-02-24T09:17:05.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.044+0000 7f42045f4640 1 -- 10.20.193.4:0/2486930370 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc151370 con 0x7f41fc060fb0 2026-02-24T09:17:05.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.044+0000 7f42045f4640 1 -- 10.20.193.4:0/2486930370 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41fc0624c0 con 0x7f41fc060fb0 2026-02-24T09:17:05.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.046+0000 7f41e37fe640 1 -- 10.20.193.4:0/2486930370 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f41ec0099b0 con 0x7f41fc060fb0 2026-02-24T09:17:05.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.047+0000 7f41e37fe640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41d80b56e0 0x7f41d80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.047+0000 7f41e37fe640 1 -- 10.20.193.4:0/2486930370 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f41ec0e70c0 con 0x7f41fc060fb0 2026-02-24T09:17:05.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.047+0000 7f4201b68640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41d80b56e0 0x7f41d80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.047+0000 7f4201b68640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41d80b56e0 0x7f41d80d5b90 secure :-1 s=READY pgs=396 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41f0005970 tx=0x7f41f0005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:05.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.047+0000 7f41e37fe640 1 -- 10.20.193.4:0/2486930370 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f41ec0a9a80 con 0x7f41fc060fb0 2026-02-24T09:17:05.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.206+0000 7f42045f4640 1 -- 10.20.193.4:0/2486930370 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41fc061380 con 0x7f41fc060fb0 2026-02-24T09:17:05.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.206+0000 7f41e37fe640 1 -- 10.20.193.4:0/2486930370 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f41ec0acc30 con 0x7f41fc060fb0 2026-02-24T09:17:05.210 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:17:05.211 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:17:05.211 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:17:05.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 -- 10.20.193.4:0/2486930370 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41d80b56e0 msgr2=0x7f41d80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41d80b56e0 0x7f41d80d5b90 secure :-1 s=READY pgs=396 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41f0005970 tx=0x7f41f0005900 comp rx=0 tx=0).stop 2026-02-24T09:17:05.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 -- 10.20.193.4:0/2486930370 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41fc060fb0 msgr2=0x7f41fc161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41fc060fb0 0x7f41fc161eb0 secure :-1 s=READY pgs=1026 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41ec005db0 tx=0x7f41ec00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 -- 10.20.193.4:0/2486930370 shutdown_connections 2026-02-24T09:17:05.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f41d80b56e0 0x7f41d80d5b90 unknown :-1 s=CLOSED pgs=396 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f41fc155750 0x7f41fc1677c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f41fc0618c0 0x7f41fc1623f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 --2- 10.20.193.4:0/2486930370 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f41fc060fb0 0x7f41fc161eb0 unknown :-1 s=CLOSED pgs=1026 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 -- 10.20.193.4:0/2486930370 >> 10.20.193.4:0/2486930370 conn(0x7f41fc05f830 msgr2=0x7f41fc10ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:05.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 -- 10.20.193.4:0/2486930370 shutdown_connections 2026-02-24T09:17:05.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.212+0000 7f42045f4640 1 -- 10.20.193.4:0/2486930370 wait complete. 2026-02-24T09:17:05.317 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 133.2 --await-for 45.0' 2026-02-24T09:17:05.318 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 133.2 --await-for 45.0 2026-02-24T09:17:05.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:04 trial090 ceph-mon[47278]: pgmap v370: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 823 MiB/s wr, 224 op/s 2026-02-24T09:17:05.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:04 trial014 ceph-mon[46941]: pgmap v370: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 823 MiB/s wr, 224 op/s 2026-02-24T09:17:05.485 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:05.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 -- 10.20.193.4:0/54496029 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb22c113200 msgr2=0x7fb22c173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 --2- 10.20.193.4:0/54496029 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb22c113200 0x7fb22c173bd0 secure :-1 s=READY pgs=1027 gs=1 cs=0 l=1 c_cookie=7165315684123947487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb21c00aa30 tx=0x7fb21c030280 comp rx=0 tx=0).stop 2026-02-24T09:17:05.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 -- 10.20.193.4:0/54496029 shutdown_connections 2026-02-24T09:17:05.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 --2- 10.20.193.4:0/54496029 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb22c113200 0x7fb22c173bd0 unknown :-1 s=CLOSED pgs=1027 gs=1 cs=0 l=1 c_cookie=7165315684123947487 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 --2- 10.20.193.4:0/54496029 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb22c10da00 0x7fb22c112a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 --2- 10.20.193.4:0/54496029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb22c10d010 0x7fb22c10d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 -- 10.20.193.4:0/54496029 >> 10.20.193.4:0/54496029 conn(0x7fb22c05f830 msgr2=0x7fb22c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 -- 10.20.193.4:0/54496029 shutdown_connections 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 -- 10.20.193.4:0/54496029 wait complete. 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 Processor -- start 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.625+0000 7fb2317cb640 1 -- start start 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb2317cb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb22c10d010 0x7fb22c11b940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb2317cb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb22c10da00 0x7fb22c11be80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb2317cb640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb22c113200 0x7fb22c121250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb2317cb640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c1217e0 con 0x7fb22c10da00 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb2317cb640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c121950 con 0x7fb22c113200 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb2317cb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c121b10 con 0x7fb22c10d010 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb22a7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb22c10da00 0x7fb22c11be80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb22a7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb22c10da00 0x7fb22c11be80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52674/0 (socket says 10.20.193.4:52674) 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb22a7fc640 1 -- 10.20.193.4:0/3710906918 learned_addr learned my addr 10.20.193.4:0/3710906918 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb22affd640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb22c10d010 0x7fb22c11b940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb22a7fc640 1 -- 10.20.193.4:0/3710906918 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb22c10d010 msgr2=0x7fb22c11b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb22c10d010 0x7fb22c11b940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb22a7fc640 1 -- 10.20.193.4:0/3710906918 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb22c113200 msgr2=0x7fb22c121250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb22c113200 0x7fb22c121250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb22a7fc640 1 -- 10.20.193.4:0/3710906918 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c00a650 con 0x7fb22c10da00 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb22c10da00 0x7fb22c11be80 secure :-1 s=READY pgs=1028 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb214009480 tx=0x7fb21400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb20bfff640 1 -- 10.20.193.4:0/3710906918 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb21400cd40 con 0x7fb22c10da00 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb2317cb640 1 -- 10.20.193.4:0/3710906918 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22c121df0 con 0x7fb22c10da00 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb20bfff640 1 -- 10.20.193.4:0/3710906918 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb214004d30 con 0x7fb22c10da00 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb20bfff640 1 -- 10.20.193.4:0/3710906918 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2140106b0 con 0x7fb22c10da00 2026-02-24T09:17:05.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.626+0000 7fb2317cb640 1 -- 10.20.193.4:0/3710906918 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22c162580 con 0x7fb22c10da00 2026-02-24T09:17:05.635 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.629+0000 7fb20bfff640 1 -- 10.20.193.4:0/3710906918 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fb21401f060 con 0x7fb22c10da00 2026-02-24T09:17:05.635 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.630+0000 7fb20bfff640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2000b56e0 0x7fb2000d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.630+0000 7fb20bfff640 1 -- 10.20.193.4:0/3710906918 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb214014070 con 0x7fb22c10da00 2026-02-24T09:17:05.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.630+0000 7fb22affd640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2000b56e0 0x7fb2000d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.630+0000 7fb22affd640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2000b56e0 0x7fb2000d5b90 secure :-1 s=READY pgs=397 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb220004740 tx=0x7fb220005f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:05.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb2337c5e00 1 Processor -- start 2026-02-24T09:17:05.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb2337c5e00 1 -- start start 2026-02-24T09:17:05.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b71415bd0 0x562b71415fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b714164e0 0x562b7145ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b7145b180 0x562b7147b560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562b71324f20 con 0x562b7145b180 2026-02-24T09:17:05.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562b71320c50 con 0x562b71415bd0 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562b7131adb0 con 0x562b714164e0 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b7145b180 0x562b7147b560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b7145b180 0x562b7147b560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52686/0 (socket says 10.20.193.4:52686) 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22b7fe640 1 -- 10.20.193.4:0/1620459206 learned_addr learned my addr 10.20.193.4:0/1620459206 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22b7fe640 1 -- 10.20.193.4:0/1620459206 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b714164e0 msgr2=0x562b7145ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22b7fe640 1 --2- 10.20.193.4:0/1620459206 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b714164e0 0x562b7145ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22affd640 1 --2- 10.20.193.4:0/1620459206 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b71415bd0 0x562b71415fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22b7fe640 1 -- 10.20.193.4:0/1620459206 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b71415bd0 msgr2=0x562b71415fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22b7fe640 1 --2- 10.20.193.4:0/1620459206 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b71415bd0 0x562b71415fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22b7fe640 1 -- 10.20.193.4:0/1620459206 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b712bb690 con 0x562b7145b180 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22affd640 1 --2- 10.20.193.4:0/1620459206 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b71415bd0 0x562b71415fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.631+0000 7fb22b7fe640 1 --2- 10.20.193.4:0/1620459206 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b7145b180 0x562b7147b560 secure :-1 s=READY pgs=1029 gs=1 cs=0 l=1 c_cookie=5344315788185401311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb21c0058d0 tx=0x7fb21c0069e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2ad2e4da4d77df server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:05.637 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb1f77fe640 1 -- 10.20.193.4:0/1620459206 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb21c03e070 con 0x562b7145b180 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb1f77fe640 1 -- 10.20.193.4:0/1620459206 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb21c006eb0 con 0x562b7145b180 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb1f77fe640 1 -- 10.20.193.4:0/1620459206 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb21c0050c0 con 0x562b7145b180 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb2337c5e00 1 -- 10.20.193.4:0/1620459206 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b7145b180 msgr2=0x562b7147b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/1620459206 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b7145b180 0x562b7147b560 secure :-1 s=READY pgs=1029 gs=1 cs=0 l=1 c_cookie=5344315788185401311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb21c0058d0 tx=0x7fb21c0069e0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb2337c5e00 1 -- 10.20.193.4:0/1620459206 shutdown_connections 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/1620459206 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b7145b180 0x562b7147b560 unknown :-1 s=CLOSED pgs=1029 gs=1 cs=0 l=1 c_cookie=5344315788185401311 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/1620459206 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b714164e0 0x562b7145ac40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/1620459206 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b71415bd0 0x562b71415fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb2337c5e00 1 -- 10.20.193.4:0/1620459206 >> 10.20.193.4:0/1620459206 conn(0x562b71333880 msgr2=0x562b714144b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb2337c5e00 1 -- 10.20.193.4:0/1620459206 shutdown_connections 2026-02-24T09:17:05.638 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.632+0000 7fb2337c5e00 1 -- 10.20.193.4:0/1620459206 wait complete. 2026-02-24T09:17:05.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.633+0000 7fb2337c5e00 1 -- start start 2026-02-24T09:17:05.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.633+0000 7fb2337c5e00 1 Processor -- start 2026-02-24T09:17:05.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.633+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71415bd0 0x562b7142da90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.633+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 0x562b7142dfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.633+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b7145b180 0x562b71432fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.633+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562b71433500 con 0x562b71415bd0 2026-02-24T09:17:05.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.633+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562b71433670 con 0x562b714164e0 2026-02-24T09:17:05.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562b71433830 con 0x562b7145b180 2026-02-24T09:17:05.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71415bd0 0x562b7142da90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71415bd0 0x562b7142da90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52702/0 (socket says 10.20.193.4:52702) 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22affd640 1 -- 10.20.193.4:0/2404017518 learned_addr learned my addr 10.20.193.4:0/2404017518 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22b7fe640 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b7145b180 0x562b71432fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 0x562b7142dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22affd640 1 -- 10.20.193.4:0/2404017518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b7145b180 msgr2=0x562b71432fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22affd640 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b7145b180 0x562b71432fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22affd640 1 -- 10.20.193.4:0/2404017518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 msgr2=0x562b7142dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22affd640 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 0x562b7142dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22affd640 1 -- 10.20.193.4:0/2404017518 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b712c63d0 con 0x562b71415bd0 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb22affd640 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71415bd0 0x562b7142da90 secure :-1 s=READY pgs=1030 gs=1 cs=0 l=1 c_cookie=10729883612660131393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb220005950 tx=0x7fb220004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e8344bdde46641 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb1f4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/2404017518 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb220010de0 con 0x562b71415bd0 2026-02-24T09:17:05.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2404017518 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22c174440 con 0x562b71415bd0 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb2337c5e00 10 client.17400 _ll_register_callbacks cb 0x562b7129ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/2404017518 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb2200044e0 con 0x562b71415bd0 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/2404017518 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb220019800 con 0x562b71415bd0 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2404017518 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b70fa8eb0 con 0x562b71415bd0 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/2404017518 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb220019990 con 0x562b71415bd0 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/2404017518 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb220019bb0 con 0x562b71415bd0 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb2337c5e00 10 client.17400 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.634+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2404017518 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562b7129e5c0 con 0x562b71415bd0 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.635+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/2404017518 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb220018070 con 0x562b71415bd0 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.635+0000 7fb2337c5e00 10 client.17400 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.635+0000 7fb2337c5e00 10 client.17400 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.635+0000 7fb2337c5e00 20 client.17400 populate_metadata read hostname 'trial004' 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.635+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562b71458320 0x562b714587c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.635+0000 7fb2337c5e00 4 client.17400 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.635+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2404017518 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b7132bf00 con 0x562b71458320 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.635+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562b71458320 0x562b714587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562b71458320 0x562b714587c0 crc :-1 s=READY pgs=159 gs=4 cs=0 l=0 c_cookie=16366719484985969582 s_cookie=523146885921176781 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e32244a8310d8bae server_cookie=74297522caefccd in_seq=0 out_seq=0 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb1f4ff9640 10 client.17400 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/2404017518 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x562b7132bf00 con 0x562b71458320 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb1f4ff9640 10 client.17400 handle_command_reply: tid=0 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 client.17400 shutdown 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2404017518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71415bd0 msgr2=0x562b7142da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71415bd0 0x562b7142da90 secure :-1 s=READY pgs=1030 gs=1 cs=0 l=1 c_cookie=10729883612660131393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb220005950 tx=0x7fb220004770 comp rx=0 tx=0).stop 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2404017518 shutdown_connections 2026-02-24T09:17:05.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562b71458320 0x562b714587c0 crc :-1 s=READY pgs=159 gs=4 cs=0 l=0 c_cookie=16366719484985969582 s_cookie=523146885921176781 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b7145b180 0x562b71432fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 0x562b7142dfd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb1f4ff9640 0 client.17400 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:05.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/2404017518 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71415bd0 0x562b7142da90 unknown :-1 s=CLOSED pgs=1030 gs=1 cs=0 l=1 c_cookie=10729883612660131393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2404017518 >> 10.20.193.4:0/2404017518 conn(0x562b71333880 msgr2=0x562b71414bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:05.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2404017518 shutdown_connections 2026-02-24T09:17:05.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.636+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2404017518 wait complete. 2026-02-24T09:17:05.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.637+0000 7fb2337c5e00 20 client.17400 trim_cache size 0 max 16384 2026-02-24T09:17:05.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb2337c5e00 1 Processor -- start 2026-02-24T09:17:05.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb2337c5e00 1 -- start start 2026-02-24T09:17:05.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 0x562b7142b070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 0x562b7142b5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71458320 0x562b714395a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562b713189e0 con 0x562b71458320 2026-02-24T09:17:05.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562b70fd0ec0 con 0x562b714164e0 2026-02-24T09:17:05.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562b71389290 con 0x562b71415bd0 2026-02-24T09:17:05.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71458320 0x562b714395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71458320 0x562b714395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52704/0 (socket says 10.20.193.4:52704) 2026-02-24T09:17:05.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22b7fe640 1 -- 10.20.193.4:0/2016992992 learned_addr learned my addr 10.20.193.4:0/2016992992 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 0x562b7142b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22b7fe640 1 -- 10.20.193.4:0/2016992992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 msgr2=0x562b7142b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22affd640 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 0x562b7142b070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22b7fe640 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 0x562b7142b070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22b7fe640 1 -- 10.20.193.4:0/2016992992 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 msgr2=0x562b7142b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22b7fe640 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 0x562b7142b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22b7fe640 1 -- 10.20.193.4:0/2016992992 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b712b0500 con 0x562b71458320 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22affd640 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 0x562b7142b070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 0x562b7142b5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb22b7fe640 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71458320 0x562b714395a0 secure :-1 s=READY pgs=1031 gs=1 cs=0 l=1 c_cookie=4869598278060515964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb21c0399d0 tx=0x7fb21c039aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439449d56aa6a27c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb1f6ffd640 1 -- 10.20.193.4:0/2016992992 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb21c03e040 con 0x562b71458320 2026-02-24T09:17:05.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb1f6ffd640 1 -- 10.20.193.4:0/2016992992 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb21c039690 con 0x562b71458320 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.646+0000 7fb1f6ffd640 1 -- 10.20.193.4:0/2016992992 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb21c005570 con 0x562b71458320 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2016992992 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71458320 msgr2=0x562b714395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71458320 0x562b714395a0 secure :-1 s=READY pgs=1031 gs=1 cs=0 l=1 c_cookie=4869598278060515964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb21c0399d0 tx=0x7fb21c039aa0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2016992992 shutdown_connections 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b71458320 0x562b714395a0 unknown :-1 s=CLOSED pgs=1031 gs=1 cs=0 l=1 c_cookie=4869598278060515964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b714164e0 0x562b7142b5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/2016992992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 0x562b7142b070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2016992992 >> 10.20.193.4:0/2016992992 conn(0x562b71333880 msgr2=0x562b71432610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2016992992 shutdown_connections 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 -- 10.20.193.4:0/2016992992 wait complete. 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 -- start start 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 Processor -- start 2026-02-24T09:17:05.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 0x562b7145a770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.647+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b714164e0 0x562b71458e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b71458320 0x562b71459460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x562b71425b10 con 0x562b714164e0 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562b7142e5b0 con 0x562b71458320 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562b71426d50 con 0x562b71415bd0 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22a7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b714164e0 0x562b71458e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22a7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b714164e0 0x562b71458e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52716/0 (socket says 10.20.193.4:52716) 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22a7fc640 1 -- 10.20.193.4:0/539457015 learned_addr learned my addr 10.20.193.4:0/539457015 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22affd640 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 0x562b7145a770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22a7fc640 1 -- 10.20.193.4:0/539457015 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 msgr2=0x562b7145a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:05.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 0x562b7145a770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22a7fc640 1 -- 10.20.193.4:0/539457015 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b71458320 msgr2=0x562b71459460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b71458320 0x562b71459460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22a7fc640 1 -- 10.20.193.4:0/539457015 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b712aaf80 con 0x562b714164e0 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22a7fc640 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b714164e0 0x562b71458e80 secure :-1 s=READY pgs=1032 gs=1 cs=0 l=1 c_cookie=11731649222454345388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb21400c6a0 tx=0x7fb214004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cf30cf95e0feac server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb1f4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/539457015 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2140adb50 con 0x562b714164e0 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 1 -- 10.20.193.4:0/539457015 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b712bb690 con 0x562b714164e0 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/539457015 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb2140b2e70 con 0x562b714164e0 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/539457015 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2140b7e00 con 0x562b714164e0 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 10 client.17406 _ll_register_callbacks cb 0x562b7129ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 1 -- 10.20.193.4:0/539457015 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b70fa6700 con 0x562b714164e0 2026-02-24T09:17:05.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/539457015 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb2140b7f60 con 0x562b714164e0 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/539457015 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb2140722e0 con 0x562b714164e0 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 10 client.17406 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 1 -- 10.20.193.4:0/539457015 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562b7129e8f0 con 0x562b714164e0 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/539457015 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb2140cb050 con 0x562b714164e0 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 10 client.17406 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 10 client.17406 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 20 client.17406 populate_metadata read hostname 'trial004' 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562b7145b180 0x562b714a7130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 4 client.17406 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.2, "await_for": 45.0}] 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb2337c5e00 1 -- 10.20.193.4:0/539457015 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.2, "await_for": 45.0}) -- 0x562b7132db70 con 0x562b7145b180 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.648+0000 7fb22affd640 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562b7145b180 0x562b714a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.649+0000 7fb1f4ff9640 10 client.17406 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:05.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.649+0000 7fb22affd640 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562b7145b180 0x562b714a7130 crc :-1 s=READY pgs=160 gs=4 cs=0 l=0 c_cookie=7012691398832092106 s_cookie=5085566097865639990 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=615215ac22d2f3ca server_cookie=46938f6be90d0836 in_seq=0 out_seq=0 2026-02-24T09:17:05.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb1f4ff9640 1 -- 10.20.193.4:0/539457015 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562b7132db70 con 0x562b7145b180 2026-02-24T09:17:05.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb1f4ff9640 10 client.17406 handle_command_reply: tid=0 2026-02-24T09:17:05.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 client.17406 shutdown 2026-02-24T09:17:05.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 -- 10.20.193.4:0/539457015 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b714164e0 msgr2=0x562b71458e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b714164e0 0x562b71458e80 secure :-1 s=READY pgs=1032 gs=1 cs=0 l=1 c_cookie=11731649222454345388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb21400c6a0 tx=0x7fb214004040 comp rx=0 tx=0).stop 2026-02-24T09:17:05.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 -- 10.20.193.4:0/539457015 shutdown_connections 2026-02-24T09:17:05.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x562b7145b180 0x562b714a7130 crc :-1 s=READY pgs=160 gs=4 cs=0 l=0 c_cookie=7012691398832092106 s_cookie=5085566097865639990 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x562b71458320 0x562b71459460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb1f4ff9640 0 client.17406 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:05.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x562b714164e0 0x562b71458e80 unknown :-1 s=CLOSED pgs=1032 gs=1 cs=0 l=1 c_cookie=11731649222454345388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 --2- 10.20.193.4:0/539457015 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x562b71415bd0 0x562b7145a770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 -- 10.20.193.4:0/539457015 >> 10.20.193.4:0/539457015 conn(0x562b71333880 msgr2=0x562b71430cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:05.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 -- 10.20.193.4:0/539457015 shutdown_connections 2026-02-24T09:17:05.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 1 -- 10.20.193.4:0/539457015 wait complete. 2026-02-24T09:17:05.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.663+0000 7fb2337c5e00 20 client.17406 trim_cache size 0 max 16384 2026-02-24T09:17:05.668 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:17:05.668 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 26, 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: "bf7150b9": { 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: "version": 26, 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:05.669 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 133.2, 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:05.670 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:05.671 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:17:05.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 -- 10.20.193.4:0/3710906918 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2000b56e0 msgr2=0x7fb2000d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2000b56e0 0x7fb2000d5b90 secure :-1 s=READY pgs=397 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb220004740 tx=0x7fb220005f70 comp rx=0 tx=0).stop 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 -- 10.20.193.4:0/3710906918 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb22c10da00 msgr2=0x7fb22c11be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb22c10da00 0x7fb22c11be80 secure :-1 s=READY pgs=1028 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb214009480 tx=0x7fb21400ee60 comp rx=0 tx=0).stop 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 -- 10.20.193.4:0/3710906918 shutdown_connections 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb2000b56e0 0x7fb2000d5b90 unknown :-1 s=CLOSED pgs=397 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb22c113200 0x7fb22c121250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb22c10da00 0x7fb22c11be80 unknown :-1 s=CLOSED pgs=1028 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 --2- 10.20.193.4:0/3710906918 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb22c10d010 0x7fb22c11b940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 -- 10.20.193.4:0/3710906918 >> 10.20.193.4:0/3710906918 conn(0x7fb22c05f830 msgr2=0x7fb22c10ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 -- 10.20.193.4:0/3710906918 shutdown_connections 2026-02-24T09:17:05.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:05.664+0000 7fb2317cb640 1 -- 10.20.193.4:0/3710906918 wait complete. 2026-02-24T09:17:05.705 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bf7150b9', quiesce took 1.0 seconds. Will release after: 12.2 2026-02-24T09:17:06.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:05 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2486930370' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:06.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:05 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2486930370' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:06.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:05 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2486930370' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:07.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:06 trial004 ceph-mon[41596]: pgmap v371: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 880 MiB/s wr, 241 op/s 2026-02-24T09:17:07.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:06 trial090 ceph-mon[47278]: pgmap v371: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 880 MiB/s wr, 241 op/s 2026-02-24T09:17:07.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:06 trial014 ceph-mon[46941]: pgmap v371: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 880 MiB/s wr, 241 op/s 2026-02-24T09:17:09.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:08 trial004 ceph-mon[41596]: pgmap v372: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 851 MiB/s wr, 238 op/s 2026-02-24T09:17:09.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:08 trial090 ceph-mon[47278]: pgmap v372: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 851 MiB/s wr, 238 op/s 2026-02-24T09:17:09.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:08 trial014 ceph-mon[46941]: pgmap v372: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 851 MiB/s wr, 238 op/s 2026-02-24T09:17:11.145 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:10 trial014 ceph-mon[46941]: pgmap v373: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 720 MiB/s wr, 204 op/s 2026-02-24T09:17:11.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:10 trial004 ceph-mon[41596]: pgmap v373: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 720 MiB/s wr, 204 op/s 2026-02-24T09:17:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:10 trial090 ceph-mon[47278]: pgmap v373: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 720 MiB/s wr, 204 op/s 2026-02-24T09:17:13.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:12 trial090 ceph-mon[47278]: pgmap v374: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 839 MiB/s wr, 239 op/s 2026-02-24T09:17:13.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:12 trial004 ceph-mon[41596]: pgmap v374: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 839 MiB/s wr, 239 op/s 2026-02-24T09:17:13.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:12 trial014 ceph-mon[46941]: pgmap v374: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 839 MiB/s wr, 239 op/s 2026-02-24T09:17:14.859 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:17:14.974 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.072+0000 7f028e43a640 1 -- 10.20.193.4:0/3550983860 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0288115840 msgr2=0x7f0288176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.072+0000 7f028e43a640 1 --2- 10.20.193.4:0/3550983860 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0288115840 0x7f0288176210 secure :-1 s=READY pgs=1033 gs=1 cs=0 l=1 c_cookie=15564561879777384184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f027c00aa30 tx=0x7f027c030280 comp rx=0 tx=0).stop 2026-02-24T09:17:15.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.072+0000 7f028e43a640 1 -- 10.20.193.4:0/3550983860 shutdown_connections 2026-02-24T09:17:15.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.072+0000 7f028e43a640 1 --2- 10.20.193.4:0/3550983860 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0288115840 0x7f0288176210 unknown :-1 s=CLOSED pgs=1033 gs=1 cs=0 l=1 c_cookie=15564561879777384184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.072+0000 7f028e43a640 1 --2- 10.20.193.4:0/3550983860 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0288110040 0x7f0288115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.072+0000 7f028e43a640 1 --2- 10.20.193.4:0/3550983860 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f028810f650 0x7f028810fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.072+0000 7f028e43a640 1 -- 10.20.193.4:0/3550983860 >> 10.20.193.4:0/3550983860 conn(0x7f02880ecf20 msgr2=0x7f028810d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.072+0000 7f028e43a640 1 -- 10.20.193.4:0/3550983860 shutdown_connections 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.072+0000 7f028e43a640 1 -- 10.20.193.4:0/3550983860 wait complete. 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028e43a640 1 Processor -- start 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028e43a640 1 -- start start 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028e43a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f028810f650 0x7f02880f5820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028e43a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0288110040 0x7f0288176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028e43a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0288115840 0x7f02880f5f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028e43a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f02880fb130 con 0x7f0288115840 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028e43a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f02880fb2a0 con 0x7f028810f650 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028e43a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02880fb460 con 0x7f0288110040 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028c9b0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0288115840 0x7f02880f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.078 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028c9b0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0288115840 0x7f02880f5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60218/0 (socket says 10.20.193.4:60218) 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028c9b0640 1 -- 10.20.193.4:0/715121114 learned_addr learned my addr 10.20.193.4:0/715121114 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f02877fe640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0288110040 0x7f0288176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f0287fff640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f028810f650 0x7f02880f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028c9b0640 1 -- 10.20.193.4:0/715121114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0288110040 msgr2=0x7f0288176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028c9b0640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0288110040 0x7f0288176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028c9b0640 1 -- 10.20.193.4:0/715121114 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f028810f650 msgr2=0x7f02880f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028c9b0640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f028810f650 0x7f02880f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028c9b0640 1 -- 10.20.193.4:0/715121114 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c00a650 con 0x7f0288115840 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028c9b0640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0288115840 0x7f02880f5f20 secure :-1 s=READY pgs=1034 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f027c00a330 tx=0x7f027c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f02857fa640 1 -- 10.20.193.4:0/715121114 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f027c03e070 con 0x7f0288115840 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028e43a640 1 -- 10.20.193.4:0/715121114 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02880fb6e0 con 0x7f0288115840 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f02857fa640 1 -- 10.20.193.4:0/715121114 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f027c0055a0 con 0x7f0288115840 2026-02-24T09:17:15.079 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f02857fa640 1 -- 10.20.193.4:0/715121114 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f027c042a70 con 0x7f0288115840 2026-02-24T09:17:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.073+0000 7f028e43a640 1 -- 10.20.193.4:0/715121114 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02880fbb80 con 0x7f0288115840 2026-02-24T09:17:15.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.075+0000 7f02857fa640 1 -- 10.20.193.4:0/715121114 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f027c0050c0 con 0x7f0288115840 2026-02-24T09:17:15.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.076+0000 7f02857fa640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f025c0b56d0 0x7f025c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.076+0000 7f0287fff640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f025c0b56d0 0x7f025c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.076+0000 7f02857fa640 1 -- 10.20.193.4:0/715121114 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f027c10ceb0 con 0x7f0288115840 2026-02-24T09:17:15.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.076+0000 7f0287fff640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f025c0b56d0 0x7f025c0d5b80 secure :-1 s=READY pgs=398 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0274005970 tx=0x7f0274005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0290434e00 1 Processor -- start 2026-02-24T09:17:15.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0290434e00 1 -- start start 2026-02-24T09:17:15.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0290434e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb34db820 0x55cdb34dbbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0290434e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb3520890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0290434e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb3520dd0 0x55cdb35411b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0290434e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55cdb33ebde0 con 0x55cdb34dc130 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0290434e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55cdb33e7b10 con 0x55cdb3520dd0 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0290434e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55cdb33e1ab0 con 0x55cdb34db820 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f02877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb3520890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f02877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb3520890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60224/0 (socket says 10.20.193.4:60224) 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f02877fe640 1 -- 10.20.193.4:0/1842183310 learned_addr learned my addr 10.20.193.4:0/1842183310 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f028c9b0640 1 --2- 10.20.193.4:0/1842183310 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb3520dd0 0x55cdb35411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f02877fe640 1 -- 10.20.193.4:0/1842183310 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb34db820 msgr2=0x55cdb34dbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f02877fe640 1 --2- 10.20.193.4:0/1842183310 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb34db820 0x55cdb34dbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f02877fe640 1 -- 10.20.193.4:0/1842183310 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb3520dd0 msgr2=0x55cdb35411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f02877fe640 1 --2- 10.20.193.4:0/1842183310 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb3520dd0 0x55cdb35411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f02877fe640 1 -- 10.20.193.4:0/1842183310 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb338d310 con 0x55cdb34dc130 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f028c9b0640 1 --2- 10.20.193.4:0/1842183310 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb3520dd0 0x55cdb35411b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f02877fe640 1 --2- 10.20.193.4:0/1842183310 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb3520890 secure :-1 s=READY pgs=1035 gs=1 cs=0 l=1 c_cookie=8398266714254238008 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0278006ec0 tx=0x7f0278007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748ca314a81c6138 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0258ce3640 1 -- 10.20.193.4:0/1842183310 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0278004500 con 0x55cdb34dc130 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0258ce3640 1 -- 10.20.193.4:0/1842183310 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f027800dc20 con 0x55cdb34dc130 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.077+0000 7f0258ce3640 1 -- 10.20.193.4:0/1842183310 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0278013700 con 0x55cdb34dc130 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.078+0000 7f0290434e00 1 -- 10.20.193.4:0/1842183310 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 msgr2=0x55cdb3520890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.078+0000 7f0290434e00 1 --2- 10.20.193.4:0/1842183310 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb3520890 secure :-1 s=READY pgs=1035 gs=1 cs=0 l=1 c_cookie=8398266714254238008 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0278006ec0 tx=0x7f0278007c50 comp rx=0 tx=0).stop 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.078+0000 7f0290434e00 1 -- 10.20.193.4:0/1842183310 shutdown_connections 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.078+0000 7f0290434e00 1 --2- 10.20.193.4:0/1842183310 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb3520dd0 0x55cdb35411b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.078+0000 7f0290434e00 1 --2- 10.20.193.4:0/1842183310 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb3520890 unknown :-1 s=CLOSED pgs=1035 gs=1 cs=0 l=1 c_cookie=8398266714254238008 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.078+0000 7f0290434e00 1 --2- 10.20.193.4:0/1842183310 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb34db820 0x55cdb34dbbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.078+0000 7f0290434e00 1 -- 10.20.193.4:0/1842183310 >> 10.20.193.4:0/1842183310 conn(0x55cdb33fa6b0 msgr2=0x55cdb34da100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.078+0000 7f0290434e00 1 -- 10.20.193.4:0/1842183310 shutdown_connections 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.078+0000 7f0290434e00 1 -- 10.20.193.4:0/1842183310 wait complete. 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 -- start start 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 Processor -- start 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb34db820 0x55cdb34f3e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f4370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 0x55cdb34f9360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55cdb34f98a0 con 0x55cdb34dc130 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55cdb34f9a10 con 0x55cdb34db820 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55cdb34f9bd0 con 0x55cdb3520dd0 2026-02-24T09:17:15.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f02877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f02877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60228/0 (socket says 10.20.193.4:60228) 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f02877fe640 1 -- 10.20.193.4:0/4163561819 learned_addr learned my addr 10.20.193.4:0/4163561819 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f028c9b0640 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 0x55cdb34f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f02877fe640 1 -- 10.20.193.4:0/4163561819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 msgr2=0x55cdb34f9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f02877fe640 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 0x55cdb34f9360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f02877fe640 1 -- 10.20.193.4:0/4163561819 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb34db820 msgr2=0x55cdb34f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f02877fe640 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb34db820 0x55cdb34f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f02877fe640 1 -- 10.20.193.4:0/4163561819 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb33658c0 con 0x55cdb34dc130 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f028c9b0640 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 0x55cdb34f9360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f02877fe640 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f4370 secure :-1 s=READY pgs=1036 gs=1 cs=0 l=1 c_cookie=58548385046463344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0278002c00 tx=0x7f0278007190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d001722cde0370 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0249ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:15.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0249ffb640 1 -- 10.20.193.4:0/4163561819 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0278004500 con 0x55cdb34dc130 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0249ffb640 1 -- 10.20.193.4:0/4163561819 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f02780026a0 con 0x55cdb34dc130 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 -- 10.20.193.4:0/4163561819 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027800e040 con 0x55cdb34dc130 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0249ffb640 1 -- 10.20.193.4:0/4163561819 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f027801f430 con 0x55cdb34dc130 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 10 client.17418 _ll_register_callbacks cb 0x55cdb337d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 -- 10.20.193.4:0/4163561819 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cdb31314a0 con 0x55cdb34dc130 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0249ffb640 1 -- 10.20.193.4:0/4163561819 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f027801f590 con 0x55cdb34dc130 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0249ffb640 1 -- 10.20.193.4:0/4163561819 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f027801f750 con 0x55cdb34dc130 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 10 client.17418 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.079+0000 7f0290434e00 1 -- 10.20.193.4:0/4163561819 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55cdb33776e0 con 0x55cdb34dc130 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.080+0000 7f0249ffb640 1 -- 10.20.193.4:0/4163561819 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f027801d040 con 0x55cdb34dc130 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.080+0000 7f0290434e00 10 client.17418 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.080+0000 7f0290434e00 10 client.17418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.080+0000 7f0290434e00 20 client.17418 populate_metadata read hostname 'trial004' 2026-02-24T09:17:15.091 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.080+0000 7f0290434e00 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55cdb351e5e0 0x55cdb351ea80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.080+0000 7f0290434e00 4 client.17418 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.080+0000 7f0290434e00 1 -- 10.20.193.4:0/4163561819 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdb33d74f0 con 0x55cdb351e5e0 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.080+0000 7f0287fff640 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55cdb351e5e0 0x55cdb351ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.080+0000 7f0249ffb640 10 client.17418 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.080+0000 7f0287fff640 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55cdb351e5e0 0x55cdb351ea80 crc :-1 s=READY pgs=161 gs=4 cs=0 l=0 c_cookie=8355581049612394660 s_cookie=17611447351766222983 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73f4fcb1e221e0a4 server_cookie=f4686e0e96850887 in_seq=0 out_seq=0 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0249ffb640 1 -- 10.20.193.4:0/4163561819 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55cdb33d74f0 con 0x55cdb351e5e0 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0249ffb640 10 client.17418 handle_command_reply: tid=0 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 client.17418 shutdown 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 -- 10.20.193.4:0/4163561819 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 msgr2=0x55cdb34f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f4370 secure :-1 s=READY pgs=1036 gs=1 cs=0 l=1 c_cookie=58548385046463344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0278002c00 tx=0x7f0278007190 comp rx=0 tx=0).stop 2026-02-24T09:17:15.092 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 -- 10.20.193.4:0/4163561819 shutdown_connections 2026-02-24T09:17:15.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55cdb351e5e0 0x55cdb351ea80 crc :-1 s=READY pgs=161 gs=4 cs=0 l=0 c_cookie=8355581049612394660 s_cookie=17611447351766222983 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 0x55cdb34f9360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f4370 unknown :-1 s=CLOSED pgs=1036 gs=1 cs=0 l=1 c_cookie=58548385046463344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 --2- 10.20.193.4:0/4163561819 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb34db820 0x55cdb34f3e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0249ffb640 0 client.17418 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:15.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 -- 10.20.193.4:0/4163561819 >> 10.20.193.4:0/4163561819 conn(0x55cdb33fa6b0 msgr2=0x55cdb34da810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 -- 10.20.193.4:0/4163561819 shutdown_connections 2026-02-24T09:17:15.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 1 -- 10.20.193.4:0/4163561819 wait complete. 2026-02-24T09:17:15.093 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.081+0000 7f0290434e00 20 client.17418 trim_cache size 0 max 16384 2026-02-24T09:17:15.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.089+0000 7f0290434e00 1 Processor -- start 2026-02-24T09:17:15.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.089+0000 7f0290434e00 1 -- start start 2026-02-24T09:17:15.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb34db820 0x55cdb34e1020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f88d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 0x55cdb3519790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55cdb33df6e0 con 0x55cdb34dc130 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55cdb30aaf50 con 0x55cdb34db820 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55cdb34f4950 con 0x55cdb3520dd0 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f02877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f02877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60242/0 (socket says 10.20.193.4:60242) 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f02877fe640 1 -- 10.20.193.4:0/794939103 learned_addr learned my addr 10.20.193.4:0/794939103 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f028c9b0640 1 --2- 10.20.193.4:0/794939103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 0x55cdb3519790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f02877fe640 1 -- 10.20.193.4:0/794939103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 msgr2=0x55cdb3519790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f02877fe640 1 --2- 10.20.193.4:0/794939103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 0x55cdb3519790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f02877fe640 1 -- 10.20.193.4:0/794939103 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb34db820 msgr2=0x55cdb34e1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f02877fe640 1 --2- 10.20.193.4:0/794939103 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb34db820 0x55cdb34e1020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f02877fe640 1 -- 10.20.193.4:0/794939103 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb3372160 con 0x55cdb34dc130 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f028c9b0640 1 --2- 10.20.193.4:0/794939103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 0x55cdb3519790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f02877fe640 1 --2- 10.20.193.4:0/794939103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f88d0 secure :-1 s=READY pgs=1037 gs=1 cs=0 l=1 c_cookie=1340152837547839947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0278031c00 tx=0x7f027802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12992de7c2c551cb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f024bfff640 1 -- 10.20.193.4:0/794939103 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0278006f70 con 0x55cdb34dc130 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f024bfff640 1 -- 10.20.193.4:0/794939103 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0278036060 con 0x55cdb34dc130 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f024bfff640 1 -- 10.20.193.4:0/794939103 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0278013870 con 0x55cdb34dc130 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 -- 10.20.193.4:0/794939103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 msgr2=0x55cdb34f88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 --2- 10.20.193.4:0/794939103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f88d0 secure :-1 s=READY pgs=1037 gs=1 cs=0 l=1 c_cookie=1340152837547839947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0278031c00 tx=0x7f027802a000 comp rx=0 tx=0).stop 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 -- 10.20.193.4:0/794939103 shutdown_connections 2026-02-24T09:17:15.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 --2- 10.20.193.4:0/794939103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb3520dd0 0x55cdb3519790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 --2- 10.20.193.4:0/794939103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34f88d0 unknown :-1 s=CLOSED pgs=1037 gs=1 cs=0 l=1 c_cookie=1340152837547839947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 --2- 10.20.193.4:0/794939103 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb34db820 0x55cdb34e1020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 -- 10.20.193.4:0/794939103 >> 10.20.193.4:0/794939103 conn(0x55cdb33fa6b0 msgr2=0x55cdb34f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.090+0000 7f0290434e00 1 -- 10.20.193.4:0/794939103 shutdown_connections 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f0290434e00 1 -- 10.20.193.4:0/794939103 wait complete. 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f0290434e00 1 -- start start 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f0290434e00 1 Processor -- start 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f0290434e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb34db820 0x55cdb34fa4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f0290434e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34faa20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f0290434e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb3520dd0 0x55cdb34ff380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f0290434e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55cdb34f9d10 con 0x55cdb34dc130 2026-02-24T09:17:15.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f0290434e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55cdb34ecee0 con 0x55cdb3520dd0 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f0290434e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55cdb34ff8c0 con 0x55cdb34db820 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f02877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f02877fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34faa20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60246/0 (socket says 10.20.193.4:60246) 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f02877fe640 1 -- 10.20.193.4:0/2726700994 learned_addr learned my addr 10.20.193.4:0/2726700994 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f02877fe640 1 -- 10.20.193.4:0/2726700994 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb34db820 msgr2=0x55cdb34fa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f02877fe640 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb34db820 0x55cdb34fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f02877fe640 1 -- 10.20.193.4:0/2726700994 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb3520dd0 msgr2=0x55cdb34ff380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f02877fe640 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb3520dd0 0x55cdb34ff380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f02877fe640 1 -- 10.20.193.4:0/2726700994 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb3365bf0 con 0x55cdb34dc130 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f02877fe640 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34faa20 secure :-1 s=READY pgs=1038 gs=1 cs=0 l=1 c_cookie=4488219268065456520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02780048c0 tx=0x7f0278006e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e495ba50b1af188 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.091+0000 7f0249ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:15.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0249ffb640 1 -- 10.20.193.4:0/2726700994 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0278002650 con 0x55cdb34dc130 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0249ffb640 1 -- 10.20.193.4:0/2726700994 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f027803f070 con 0x55cdb34dc130 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0249ffb640 1 -- 10.20.193.4:0/2726700994 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02780117a0 con 0x55cdb34dc130 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 1 -- 10.20.193.4:0/2726700994 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdb33776e0 con 0x55cdb34dc130 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0249ffb640 1 -- 10.20.193.4:0/2726700994 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0278041070 con 0x55cdb34dc130 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0249ffb640 10 client.17424 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 10 client.17424 _ll_register_callbacks cb 0x55cdb337d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 1 -- 10.20.193.4:0/2726700994 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f027800dc20 con 0x55cdb34dc130 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0249ffb640 1 -- 10.20.193.4:0/2726700994 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f02780072e0 con 0x55cdb34dc130 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 10 client.17424 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 1 -- 10.20.193.4:0/2726700994 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55cdb3377940 con 0x55cdb34dc130 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0249ffb640 1 -- 10.20.193.4:0/2726700994 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f02780313d0 con 0x55cdb34dc130 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 10 client.17424 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:15.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 10 client.17424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 20 client.17424 populate_metadata read hostname 'trial004' 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55cdb35ce130 0x55cdb35ee5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 4 client.17424 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.092+0000 7f0290434e00 1 -- 10.20.193.4:0/2726700994 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cdb3116160 con 0x55cdb35ce130 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.093+0000 7f0287fff640 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55cdb35ce130 0x55cdb35ee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.093+0000 7f0287fff640 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55cdb35ce130 0x55cdb35ee5b0 crc :-1 s=READY pgs=162 gs=4 cs=0 l=0 c_cookie=1232048266037325223 s_cookie=13795590907552130233 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11191d5ecb4a6da7 server_cookie=bf73c8d69740e4b9 in_seq=0 out_seq=0 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.093+0000 7f0249ffb640 10 client.17424 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0249ffb640 1 -- 10.20.193.4:0/2726700994 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x55cdb3116160 con 0x55cdb35ce130 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0249ffb640 10 client.17424 handle_command_reply: tid=0 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 client.17424 shutdown 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 -- 10.20.193.4:0/2726700994 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 msgr2=0x55cdb34faa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.104 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34faa20 secure :-1 s=READY pgs=1038 gs=1 cs=0 l=1 c_cookie=4488219268065456520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02780048c0 tx=0x7f0278006e10 comp rx=0 tx=0).stop 2026-02-24T09:17:15.105 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 -- 10.20.193.4:0/2726700994 shutdown_connections 2026-02-24T09:17:15.105 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55cdb35ce130 0x55cdb35ee5b0 crc :-1 s=READY pgs=162 gs=4 cs=0 l=0 c_cookie=1232048266037325223 s_cookie=13795590907552130233 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.105 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55cdb3520dd0 0x55cdb34ff380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.105 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55cdb34dc130 0x55cdb34faa20 unknown :-1 s=CLOSED pgs=1038 gs=1 cs=0 l=1 c_cookie=4488219268065456520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.105 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 --2- 10.20.193.4:0/2726700994 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55cdb34db820 0x55cdb34fa4e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.105 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0249ffb640 0 client.17424 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:15.105 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 -- 10.20.193.4:0/2726700994 >> 10.20.193.4:0/2726700994 conn(0x55cdb33fa6b0 msgr2=0x55cdb34f89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.105 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 -- 10.20.193.4:0/2726700994 shutdown_connections 2026-02-24T09:17:15.105 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 1 -- 10.20.193.4:0/2726700994 wait complete. 2026-02-24T09:17:15.105 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f0290434e00 20 client.17424 trim_cache size 0 max 16384 2026-02-24T09:17:15.106 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:17:15.106 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:17:15.106 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:17:15.106 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:17:15.106 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:17:15.106 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:17:15.106 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.106 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.106 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.107 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.108 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:17:15.109 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.110 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.111 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.112 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.113 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:17:15.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 -- 10.20.193.4:0/715121114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f025c0b56d0 msgr2=0x7f025c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f025c0b56d0 0x7f025c0d5b80 secure :-1 s=READY pgs=398 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0274005970 tx=0x7f0274005900 comp rx=0 tx=0).stop 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 -- 10.20.193.4:0/715121114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0288115840 msgr2=0x7f02880f5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0288115840 0x7f02880f5f20 secure :-1 s=READY pgs=1034 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f027c00a330 tx=0x7f027c0039b0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 -- 10.20.193.4:0/715121114 shutdown_connections 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f025c0b56d0 0x7f025c0d5b80 unknown :-1 s=CLOSED pgs=398 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0288115840 0x7f02880f5f20 unknown :-1 s=CLOSED pgs=1034 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0288110040 0x7f0288176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 --2- 10.20.193.4:0/715121114 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f028810f650 0x7f02880f5820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 -- 10.20.193.4:0/715121114 >> 10.20.193.4:0/715121114 conn(0x7f02880ecf20 msgr2=0x7f0288111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 -- 10.20.193.4:0/715121114 shutdown_connections 2026-02-24T09:17:15.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.094+0000 7f028e43a640 1 -- 10.20.193.4:0/715121114 wait complete. 2026-02-24T09:17:15.132 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:14 trial004 ceph-mon[41596]: pgmap v375: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 816 MiB/s wr, 239 op/s 2026-02-24T09:17:15.133 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:17:15.133 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:15.250 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:14 trial090 ceph-mon[47278]: pgmap v375: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 816 MiB/s wr, 239 op/s 2026-02-24T09:17:15.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:14 trial014 ceph-mon[46941]: pgmap v375: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 816 MiB/s wr, 239 op/s 2026-02-24T09:17:15.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 -- 10.20.193.4:0/2883834323 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f158c10fc70 msgr2=0x7f158c114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 --2- 10.20.193.4:0/2883834323 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f158c10fc70 0x7f158c114cc0 secure :-1 s=READY pgs=1039 gs=1 cs=0 l=1 c_cookie=13143786101243595007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1574009950 tx=0x7f157402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 -- 10.20.193.4:0/2883834323 shutdown_connections 2026-02-24T09:17:15.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 --2- 10.20.193.4:0/2883834323 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f158c115470 0x7f158c175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 --2- 10.20.193.4:0/2883834323 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f158c10fc70 0x7f158c114cc0 unknown :-1 s=CLOSED pgs=1039 gs=1 cs=0 l=1 c_cookie=13143786101243595007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 --2- 10.20.193.4:0/2883834323 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f158c10f280 0x7f158c10f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 -- 10.20.193.4:0/2883834323 >> 10.20.193.4:0/2883834323 conn(0x7f158c05f830 msgr2=0x7f158c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 -- 10.20.193.4:0/2883834323 shutdown_connections 2026-02-24T09:17:15.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 -- 10.20.193.4:0/2883834323 wait complete. 2026-02-24T09:17:15.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 Processor -- start 2026-02-24T09:17:15.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 -- start start 2026-02-24T09:17:15.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f158c10f280 0x7f158c0f5540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f158c10fc70 0x7f158c175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f158c115470 0x7f158c0f5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f158c0fae50 con 0x7f158c10f280 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f158c0fafc0 con 0x7f158c10fc70 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f15910fa640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f158c0fb180 con 0x7f158c115470 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f158ad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f158c10f280 0x7f158c0f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f158ad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f158c10f280 0x7f158c0f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60252/0 (socket says 10.20.193.4:60252) 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f158ad76640 1 -- 10.20.193.4:0/3347204790 learned_addr learned my addr 10.20.193.4:0/3347204790 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f158ad76640 1 -- 10.20.193.4:0/3347204790 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f158c115470 msgr2=0x7f158c0f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f158ad76640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f158c115470 0x7f158c0f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f158ad76640 1 -- 10.20.193.4:0/3347204790 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f158c10fc70 msgr2=0x7f158c175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f158ad76640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f158c10fc70 0x7f158c175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.345+0000 7f158ad76640 1 -- 10.20.193.4:0/3347204790 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1574009570 con 0x7f158c10f280 2026-02-24T09:17:15.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.346+0000 7f158ad76640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f158c10f280 0x7f158c0f5540 secure :-1 s=READY pgs=1040 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f158000d950 tx=0x7f158000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.346+0000 7f156bfff640 1 -- 10.20.193.4:0/3347204790 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1580004540 con 0x7f158c10f280 2026-02-24T09:17:15.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.346+0000 7f156bfff640 1 -- 10.20.193.4:0/3347204790 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1580009d00 con 0x7f158c10f280 2026-02-24T09:17:15.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.346+0000 7f15910fa640 1 -- 10.20.193.4:0/3347204790 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c0fb460 con 0x7f158c10f280 2026-02-24T09:17:15.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.346+0000 7f156bfff640 1 -- 10.20.193.4:0/3347204790 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15800106e0 con 0x7f158c10f280 2026-02-24T09:17:15.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.346+0000 7f15910fa640 1 -- 10.20.193.4:0/3347204790 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c0fb980 con 0x7f158c10f280 2026-02-24T09:17:15.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.346+0000 7f15910fa640 1 -- 10.20.193.4:0/3347204790 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158c110560 con 0x7f158c10f280 2026-02-24T09:17:15.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.347+0000 7f156bfff640 1 -- 10.20.193.4:0/3347204790 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f15800097c0 con 0x7f158c10f280 2026-02-24T09:17:15.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.348+0000 7f156bfff640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f15600b5750 0x7f15600d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.348+0000 7f158a575640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f15600b5750 0x7f15600d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.348+0000 7f156bfff640 1 -- 10.20.193.4:0/3347204790 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f15800e72a0 con 0x7f158c10f280 2026-02-24T09:17:15.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.348+0000 7f158a575640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f15600b5750 0x7f15600d5c00 secure :-1 s=READY pgs=399 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f157402f6e0 tx=0x7f1574005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.349+0000 7f156bfff640 1 -- 10.20.193.4:0/3347204790 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f15800a9c20 con 0x7f158c10f280 2026-02-24T09:17:15.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.481+0000 7f15910fa640 1 -- 10.20.193.4:0/3347204790 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f158c10f650 con 0x7f158c10f280 2026-02-24T09:17:15.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.481+0000 7f156bfff640 1 -- 10.20.193.4:0/3347204790 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f15800acdd0 con 0x7f158c10f280 2026-02-24T09:17:15.485 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:17:15.485 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:17:15.486 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:17:15.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 -- 10.20.193.4:0/3347204790 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f15600b5750 msgr2=0x7f15600d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f15600b5750 0x7f15600d5c00 secure :-1 s=READY pgs=399 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f157402f6e0 tx=0x7f1574005900 comp rx=0 tx=0).stop 2026-02-24T09:17:15.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 -- 10.20.193.4:0/3347204790 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f158c10f280 msgr2=0x7f158c0f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f158c10f280 0x7f158c0f5540 secure :-1 s=READY pgs=1040 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f158000d950 tx=0x7f158000de20 comp rx=0 tx=0).stop 2026-02-24T09:17:15.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 -- 10.20.193.4:0/3347204790 shutdown_connections 2026-02-24T09:17:15.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f15600b5750 0x7f15600d5c00 unknown :-1 s=CLOSED pgs=399 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f158c115470 0x7f158c0f5c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f158c10fc70 0x7f158c175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 --2- 10.20.193.4:0/3347204790 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f158c10f280 0x7f158c0f5540 unknown :-1 s=CLOSED pgs=1040 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 -- 10.20.193.4:0/3347204790 >> 10.20.193.4:0/3347204790 conn(0x7f158c05f830 msgr2=0x7f158c111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 -- 10.20.193.4:0/3347204790 shutdown_connections 2026-02-24T09:17:15.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.483+0000 7f15910fa640 1 -- 10.20.193.4:0/3347204790 wait complete. 2026-02-24T09:17:15.522 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:17:15.637 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.741+0000 7f640f270640 1 -- 10.20.193.4:0/1905264577 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6408115930 msgr2=0x7f6408176300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.741+0000 7f640f270640 1 --2- 10.20.193.4:0/1905264577 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6408115930 0x7f6408176300 secure :-1 s=READY pgs=1041 gs=1 cs=0 l=1 c_cookie=6961012081750030115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f640400aa30 tx=0x7f6404030280 comp rx=0 tx=0).stop 2026-02-24T09:17:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.741+0000 7f640f270640 1 -- 10.20.193.4:0/1905264577 shutdown_connections 2026-02-24T09:17:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.741+0000 7f640f270640 1 --2- 10.20.193.4:0/1905264577 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6408115930 0x7f6408176300 unknown :-1 s=CLOSED pgs=1041 gs=1 cs=0 l=1 c_cookie=6961012081750030115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.741+0000 7f640f270640 1 --2- 10.20.193.4:0/1905264577 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6408110130 0x7f6408115180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.741+0000 7f640f270640 1 --2- 10.20.193.4:0/1905264577 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f640810f740 0x7f640810fb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.741+0000 7f640f270640 1 -- 10.20.193.4:0/1905264577 >> 10.20.193.4:0/1905264577 conn(0x7f64080ed050 msgr2=0x7f640810d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.741+0000 7f640f270640 1 -- 10.20.193.4:0/1905264577 shutdown_connections 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.741+0000 7f640f270640 1 -- 10.20.193.4:0/1905264577 wait complete. 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640f270640 1 Processor -- start 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640f270640 1 -- start start 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640f270640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f640810f740 0x7f64080f59e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640f270640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6408110130 0x7f6408176200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640f270640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6408115930 0x7f64080f60e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640f270640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f64080fb2f0 con 0x7f640810f740 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640f270640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f64080fb460 con 0x7f6408115930 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640f270640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64080fb620 con 0x7f6408110130 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640cfe5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f640810f740 0x7f64080f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640cfe5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f640810f740 0x7f64080f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60264/0 (socket says 10.20.193.4:60264) 2026-02-24T09:17:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640cfe5640 1 -- 10.20.193.4:0/79965339 learned_addr learned my addr 10.20.193.4:0/79965339 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640cfe5640 1 -- 10.20.193.4:0/79965339 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6408110130 msgr2=0x7f6408176200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640cfe5640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6408110130 0x7f6408176200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640cfe5640 1 -- 10.20.193.4:0/79965339 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6408115930 msgr2=0x7f64080f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640cfe5640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6408115930 0x7f64080f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640cfe5640 1 -- 10.20.193.4:0/79965339 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640400a650 con 0x7f640810f740 2026-02-24T09:17:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640cfe5640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f640810f740 0x7f64080f59e0 secure :-1 s=READY pgs=1042 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63f8005db0 tx=0x7f63f800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f63fdffb640 1 -- 10.20.193.4:0/79965339 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63f8004500 con 0x7f640810f740 2026-02-24T09:17:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640f270640 1 -- 10.20.193.4:0/79965339 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64080fb900 con 0x7f640810f740 2026-02-24T09:17:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f63fdffb640 1 -- 10.20.193.4:0/79965339 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f63f8004d30 con 0x7f640810f740 2026-02-24T09:17:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f63fdffb640 1 -- 10.20.193.4:0/79965339 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63f8005310 con 0x7f640810f740 2026-02-24T09:17:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.742+0000 7f640f270640 1 -- 10.20.193.4:0/79965339 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64080fbd80 con 0x7f640810f740 2026-02-24T09:17:15.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.744+0000 7f63fdffb640 1 -- 10.20.193.4:0/79965339 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f63f80054a0 con 0x7f640810f740 2026-02-24T09:17:15.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.744+0000 7f63fdffb640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63e40b56d0 0x7f63e40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.745+0000 7f63fdffb640 1 -- 10.20.193.4:0/79965339 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f63f80e6d30 con 0x7f640810f740 2026-02-24T09:17:15.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.745+0000 7f63fffff640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63e40b56d0 0x7f63e40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.745+0000 7f63fffff640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63e40b56d0 0x7f63e40d5b80 secure :-1 s=READY pgs=400 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64080fc380 tx=0x7f63f0006d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f641126ae00 1 Processor -- start 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f641126ae00 1 -- start start 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f641126ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6df50 0x55bc00f6e320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f641126ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00fb2fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f641126ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00fd38e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f641126ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bc00e7eee0 con 0x55bc00f6e860 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f641126ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bc00e7ac10 con 0x55bc00f6df50 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f641126ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bc00e74d70 con 0x55bc00fb3500 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63fffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00fb2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63fffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00fb2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60270/0 (socket says 10.20.193.4:60270) 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63fffff640 1 -- 10.20.193.4:0/1515509151 learned_addr learned my addr 10.20.193.4:0/1515509151 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f640cfe5640 1 --2- 10.20.193.4:0/1515509151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6df50 0x55bc00f6e320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f640d7e6640 1 --2- 10.20.193.4:0/1515509151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00fd38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63fffff640 1 -- 10.20.193.4:0/1515509151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 msgr2=0x55bc00fd38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63fffff640 1 --2- 10.20.193.4:0/1515509151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00fd38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63fffff640 1 -- 10.20.193.4:0/1515509151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6df50 msgr2=0x55bc00f6e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63fffff640 1 --2- 10.20.193.4:0/1515509151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6df50 0x55bc00f6e320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63fffff640 1 -- 10.20.193.4:0/1515509151 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc00e20340 con 0x55bc00f6e860 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f640d7e6640 1 --2- 10.20.193.4:0/1515509151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00fd38e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63fffff640 1 --2- 10.20.193.4:0/1515509151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00fb2fc0 secure :-1 s=READY pgs=1043 gs=1 cs=0 l=1 c_cookie=14534091271381289553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63f00043a0 tx=0x7f63f000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b37701a3c98a51 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63d54e4640 1 -- 10.20.193.4:0/1515509151 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63f0002ad0 con 0x55bc00f6e860 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63d54e4640 1 -- 10.20.193.4:0/1515509151 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f63f000c040 con 0x55bc00f6e860 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.746+0000 7f63d54e4640 1 -- 10.20.193.4:0/1515509151 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63f001d680 con 0x55bc00f6e860 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.747+0000 7f641126ae00 1 -- 10.20.193.4:0/1515509151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 msgr2=0x55bc00fb2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.747+0000 7f641126ae00 1 --2- 10.20.193.4:0/1515509151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00fb2fc0 secure :-1 s=READY pgs=1043 gs=1 cs=0 l=1 c_cookie=14534091271381289553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63f00043a0 tx=0x7f63f000e000 comp rx=0 tx=0).stop 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.747+0000 7f641126ae00 1 -- 10.20.193.4:0/1515509151 shutdown_connections 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.747+0000 7f641126ae00 1 --2- 10.20.193.4:0/1515509151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00fd38e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.747+0000 7f641126ae00 1 --2- 10.20.193.4:0/1515509151 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00fb2fc0 unknown :-1 s=CLOSED pgs=1043 gs=1 cs=0 l=1 c_cookie=14534091271381289553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.747+0000 7f641126ae00 1 --2- 10.20.193.4:0/1515509151 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6df50 0x55bc00f6e320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.747+0000 7f641126ae00 1 -- 10.20.193.4:0/1515509151 >> 10.20.193.4:0/1515509151 conn(0x55bc00e8cdb0 msgr2=0x55bc00f6c830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.747+0000 7f641126ae00 1 -- 10.20.193.4:0/1515509151 shutdown_connections 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.747+0000 7f641126ae00 1 -- 10.20.193.4:0/1515509151 wait complete. 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 1 -- start start 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 1 Processor -- start 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fcad60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00f6e860 0x55bc00fcb2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00fb3500 0x55bc00fd0290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bc00fd07d0 con 0x55bc00f6df50 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bc00fd0940 con 0x55bc00fb3500 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bc00fd0b00 con 0x55bc00f6e860 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f640cfe5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fcad60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f640cfe5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fcad60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60276/0 (socket says 10.20.193.4:60276) 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f640cfe5640 1 -- 10.20.193.4:0/3907702162 learned_addr learned my addr 10.20.193.4:0/3907702162 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f640d7e6640 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00fb3500 0x55bc00fd0290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f640cfe5640 1 -- 10.20.193.4:0/3907702162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00f6e860 msgr2=0x55bc00fcb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f640cfe5640 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00f6e860 0x55bc00fcb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f640cfe5640 1 -- 10.20.193.4:0/3907702162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00fb3500 msgr2=0x55bc00fd0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f640cfe5640 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00fb3500 0x55bc00fd0290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f640cfe5640 1 -- 10.20.193.4:0/3907702162 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc00df89d0 con 0x55bc00f6df50 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f640cfe5640 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fcad60 secure :-1 s=READY pgs=1044 gs=1 cs=0 l=1 c_cookie=11609135973031031463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63f800bfd0 tx=0x7f63f80aca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11befa8ddb932a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f63c67fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f63c67fc640 1 -- 10.20.193.4:0/3907702162 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63f80adaa0 con 0x55bc00f6df50 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 1 -- 10.20.193.4:0/3907702162 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f00040d0 con 0x55bc00f6df50 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f63c67fc640 1 -- 10.20.193.4:0/3907702162 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f63f80b2dc0 con 0x55bc00f6df50 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f63c67fc640 1 -- 10.20.193.4:0/3907702162 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63f80adfb0 con 0x55bc00f6df50 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 10 client.17442 _ll_register_callbacks cb 0x55bc00e1f080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f641126ae00 1 -- 10.20.193.4:0/3907702162 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc00bc44a0 con 0x55bc00f6df50 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.748+0000 7f63c67fc640 1 -- 10.20.193.4:0/3907702162 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f63f80b7d50 con 0x55bc00f6df50 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f63c67fc640 1 -- 10.20.193.4:0/3907702162 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f63f80b7f50 con 0x55bc00f6df50 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f641126ae00 10 client.17442 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f641126ae00 1 -- 10.20.193.4:0/3907702162 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55bc00e0a710 con 0x55bc00f6df50 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f63c67fc640 1 -- 10.20.193.4:0/3907702162 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f63f800e5e0 con 0x55bc00f6df50 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f641126ae00 10 client.17442 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f641126ae00 10 client.17442 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f641126ae00 20 client.17442 populate_metadata read hostname 'trial004' 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f641126ae00 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bc00fb0760 0x55bc00fb0c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f641126ae00 4 client.17442 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f641126ae00 1 -- 10.20.193.4:0/3907702162 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc00e6a7b0 con 0x55bc00fb0760 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f63fffff640 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bc00fb0760 0x55bc00fb0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f63fffff640 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bc00fb0760 0x55bc00fb0c00 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=7720800031303448827 s_cookie=17568393586219197746 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6b25cab8cfaab8fb server_cookie=f3cf78e2a4d8a532 in_seq=0 out_seq=0 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.749+0000 7f63c67fc640 10 client.17442 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f63c67fc640 1 -- 10.20.193.4:0/3907702162 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bc00e6a7b0 con 0x55bc00fb0760 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f63c67fc640 10 client.17442 handle_command_reply: tid=0 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 client.17442 shutdown 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 -- 10.20.193.4:0/3907702162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 msgr2=0x55bc00fcad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fcad60 secure :-1 s=READY pgs=1044 gs=1 cs=0 l=1 c_cookie=11609135973031031463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63f800bfd0 tx=0x7f63f80aca80 comp rx=0 tx=0).stop 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 -- 10.20.193.4:0/3907702162 shutdown_connections 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bc00fb0760 0x55bc00fb0c00 crc :-1 s=READY pgs=48 gs=4 cs=0 l=0 c_cookie=7720800031303448827 s_cookie=17568393586219197746 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00fb3500 0x55bc00fd0290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00f6e860 0x55bc00fcb2a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 --2- 10.20.193.4:0/3907702162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fcad60 unknown :-1 s=CLOSED pgs=1044 gs=1 cs=0 l=1 c_cookie=11609135973031031463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f63c67fc640 0 client.17442 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:17:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 -- 10.20.193.4:0/3907702162 >> 10.20.193.4:0/3907702162 conn(0x55bc00e8cdb0 msgr2=0x55bc00f6c040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 -- 10.20.193.4:0/3907702162 shutdown_connections 2026-02-24T09:17:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 1 -- 10.20.193.4:0/3907702162 wait complete. 2026-02-24T09:17:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.750+0000 7f641126ae00 20 client.17442 trim_cache size 0 max 16384 2026-02-24T09:17:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f641126ae00 1 Processor -- start 2026-02-24T09:17:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f641126ae00 1 -- start start 2026-02-24T09:17:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f641126ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fc7120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f641126ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6e860 0x55bc00fc7660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f641126ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00fc7ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f641126ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bc00fd0690 con 0x55bc00f6df50 2026-02-24T09:17:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f641126ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bc00e729a0 con 0x55bc00f6e860 2026-02-24T09:17:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f641126ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bc00c4edf0 con 0x55bc00fb3500 2026-02-24T09:17:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f640cfe5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fc7120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f640cfe5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fc7120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60284/0 (socket says 10.20.193.4:60284) 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f640cfe5640 1 -- 10.20.193.4:0/2443442636 learned_addr learned my addr 10.20.193.4:0/2443442636 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f640d7e6640 1 --2- 10.20.193.4:0/2443442636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00fc7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f640cfe5640 1 -- 10.20.193.4:0/2443442636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 msgr2=0x55bc00fc7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f640cfe5640 1 --2- 10.20.193.4:0/2443442636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00fc7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f640cfe5640 1 -- 10.20.193.4:0/2443442636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6e860 msgr2=0x55bc00fc7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f63fffff640 1 --2- 10.20.193.4:0/2443442636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6e860 0x55bc00fc7660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f640cfe5640 1 --2- 10.20.193.4:0/2443442636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6e860 0x55bc00fc7660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f640cfe5640 1 -- 10.20.193.4:0/2443442636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc00e05190 con 0x55bc00f6df50 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f63fffff640 1 --2- 10.20.193.4:0/2443442636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6e860 0x55bc00fc7660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f640cfe5640 1 --2- 10.20.193.4:0/2443442636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fc7120 secure :-1 s=READY pgs=1045 gs=1 cs=0 l=1 c_cookie=15767783131185403261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63f80040a0 tx=0x7f63f80b2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad26b376db3d57d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f63d4ce3640 1 -- 10.20.193.4:0/2443442636 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63f80ad8b0 con 0x55bc00f6df50 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f63d4ce3640 1 -- 10.20.193.4:0/2443442636 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55bc00bc44a0 con 0x55bc00f6df50 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.757+0000 7f63d4ce3640 1 -- 10.20.193.4:0/2443442636 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63f80b2e50 con 0x55bc00f6df50 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 -- 10.20.193.4:0/2443442636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 msgr2=0x55bc00fc7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 --2- 10.20.193.4:0/2443442636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fc7120 secure :-1 s=READY pgs=1045 gs=1 cs=0 l=1 c_cookie=15767783131185403261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63f80040a0 tx=0x7f63f80b2000 comp rx=0 tx=0).stop 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 -- 10.20.193.4:0/2443442636 shutdown_connections 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 --2- 10.20.193.4:0/2443442636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00fc7ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 --2- 10.20.193.4:0/2443442636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6e860 0x55bc00fc7660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 --2- 10.20.193.4:0/2443442636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6df50 0x55bc00fc7120 unknown :-1 s=CLOSED pgs=1045 gs=1 cs=0 l=1 c_cookie=15767783131185403261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 -- 10.20.193.4:0/2443442636 >> 10.20.193.4:0/2443442636 conn(0x55bc00e8cdb0 msgr2=0x55bc00fcf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 -- 10.20.193.4:0/2443442636 shutdown_connections 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 -- 10.20.193.4:0/2443442636 wait complete. 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 -- start start 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 Processor -- start 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6df50 0x55bc00f4dc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00f4e160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00ff90f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bc00fd0690 con 0x55bc00f6e860 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bc00e729a0 con 0x55bc00f6df50 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f641126ae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bc00c4edf0 con 0x55bc00fb3500 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f63fffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00f4e160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f63fffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00f4e160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60300/0 (socket says 10.20.193.4:60300) 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.758+0000 7f63fffff640 1 -- 10.20.193.4:0/4140783891 learned_addr learned my addr 10.20.193.4:0/4140783891 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f640d7e6640 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00ff90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f640cfe5640 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6df50 0x55bc00f4dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63fffff640 1 -- 10.20.193.4:0/4140783891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 msgr2=0x55bc00ff90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.767 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63fffff640 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00ff90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63fffff640 1 -- 10.20.193.4:0/4140783891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6df50 msgr2=0x55bc00f4dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63fffff640 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6df50 0x55bc00f4dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63fffff640 1 -- 10.20.193.4:0/4140783891 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc00df8d00 con 0x55bc00f6e860 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63fffff640 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00f4e160 secure :-1 s=READY pgs=1046 gs=1 cs=0 l=1 c_cookie=12682595413002937164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55bc00fd1320 tx=0x7f63f0009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b001a1553609e34c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63c67fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63c67fc640 1 -- 10.20.193.4:0/4140783891 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63f00118b0 con 0x55bc00f6e860 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63c67fc640 1 -- 10.20.193.4:0/4140783891 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f63f0016040 con 0x55bc00f6e860 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63c67fc640 1 -- 10.20.193.4:0/4140783891 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63f002ed90 con 0x55bc00f6e860 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 1 -- 10.20.193.4:0/4140783891 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc00e0a710 con 0x55bc00f6e860 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63c67fc640 1 -- 10.20.193.4:0/4140783891 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f63f0029460 con 0x55bc00f6e860 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63c67fc640 10 client.17448 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 10 client.17448 _ll_register_callbacks cb 0x55bc00e1f080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 1 -- 10.20.193.4:0/4140783891 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63f000c040 con 0x55bc00f6e860 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63c67fc640 1 -- 10.20.193.4:0/4140783891 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f63f0011a10 con 0x55bc00f6e860 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 10 client.17448 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 1 -- 10.20.193.4:0/4140783891 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55bc00e0a970 con 0x55bc00f6e860 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f63c67fc640 1 -- 10.20.193.4:0/4140783891 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f63f00028b0 con 0x55bc00f6e860 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 10 client.17448 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 10 client.17448 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:17:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 20 client.17448 populate_metadata read hostname 'trial004' 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bc01061750 0x55bc01081bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 4 client.17448 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.759+0000 7f641126ae00 1 -- 10.20.193.4:0/4140783891 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc00ba9160 con 0x55bc01061750 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f640cfe5640 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bc01061750 0x55bc01081bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f640cfe5640 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bc01061750 0x55bc01081bd0 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=15468733801699748203 s_cookie=7214489080779735265 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6abfb6f8f64296b server_cookie=641f03984fcf80e1 in_seq=0 out_seq=0 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f63c67fc640 10 client.17448 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f63c67fc640 1 -- 10.20.193.4:0/4140783891 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc00ba9160 con 0x55bc01061750 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f63c67fc640 10 client.17448 handle_command_reply: tid=0 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 client.17448 shutdown 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 -- 10.20.193.4:0/4140783891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 msgr2=0x55bc00f4e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00f4e160 secure :-1 s=READY pgs=1046 gs=1 cs=0 l=1 c_cookie=12682595413002937164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55bc00fd1320 tx=0x7f63f0009630 comp rx=0 tx=0).stop 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 -- 10.20.193.4:0/4140783891 shutdown_connections 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bc01061750 0x55bc01081bd0 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=15468733801699748203 s_cookie=7214489080779735265 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bc00fb3500 0x55bc00ff90f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bc00f6e860 0x55bc00f4e160 unknown :-1 s=CLOSED pgs=1046 gs=1 cs=0 l=1 c_cookie=12682595413002937164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f63c67fc640 0 client.17448 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 --2- 10.20.193.4:0/4140783891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bc00f6df50 0x55bc00f4dc20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 -- 10.20.193.4:0/4140783891 >> 10.20.193.4:0/4140783891 conn(0x55bc00e8cdb0 msgr2=0x55bc00fcdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 -- 10.20.193.4:0/4140783891 shutdown_connections 2026-02-24T09:17:15.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 1 -- 10.20.193.4:0/4140783891 wait complete. 2026-02-24T09:17:15.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.760+0000 7f641126ae00 20 client.17448 trim_cache size 0 max 16384 2026-02-24T09:17:15.770 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:17:15.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 -- 10.20.193.4:0/79965339 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63e40b56d0 msgr2=0x7f63e40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63e40b56d0 0x7f63e40d5b80 secure :-1 s=READY pgs=400 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64080fc380 tx=0x7f63f0006d40 comp rx=0 tx=0).stop 2026-02-24T09:17:15.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 -- 10.20.193.4:0/79965339 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f640810f740 msgr2=0x7f64080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:15.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f640810f740 0x7f64080f59e0 secure :-1 s=READY pgs=1042 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63f8005db0 tx=0x7f63f800ddf0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 -- 10.20.193.4:0/79965339 shutdown_connections 2026-02-24T09:17:15.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f63e40b56d0 0x7f63e40d5b80 unknown :-1 s=CLOSED pgs=400 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6408115930 0x7f64080f60e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6408110130 0x7f6408176200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 --2- 10.20.193.4:0/79965339 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f640810f740 0x7f64080f59e0 unknown :-1 s=CLOSED pgs=1042 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:15.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 -- 10.20.193.4:0/79965339 >> 10.20.193.4:0/79965339 conn(0x7f64080ed050 msgr2=0x7f640810dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:15.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 -- 10.20.193.4:0/79965339 shutdown_connections 2026-02-24T09:17:15.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:15.761+0000 7f640f270640 1 -- 10.20.193.4:0/79965339 wait complete. 2026-02-24T09:17:15.797 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:17:15.913 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:15.999 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:15 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3347204790' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2847772725 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3dc10ddc0 msgr2=0x7ff3dc112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 --2- 10.20.193.4:0/2847772725 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3dc10ddc0 0x7ff3dc112e10 secure :-1 s=READY pgs=1047 gs=1 cs=0 l=1 c_cookie=204976446478399486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3cc009950 tx=0x7ff3cc02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2847772725 shutdown_connections 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 --2- 10.20.193.4:0/2847772725 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3dc1135c0 0x7ff3dc173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 --2- 10.20.193.4:0/2847772725 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3dc10ddc0 0x7ff3dc112e10 unknown :-1 s=CLOSED pgs=1047 gs=1 cs=0 l=1 c_cookie=204976446478399486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 --2- 10.20.193.4:0/2847772725 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff3dc10d3d0 0x7ff3dc10d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2847772725 >> 10.20.193.4:0/2847772725 conn(0x7ff3dc0eaca0 msgr2=0x7ff3dc10b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2847772725 shutdown_connections 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2847772725 wait complete. 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 Processor -- start 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 -- start start 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3dc10d3d0 0x7ff3dc116c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff3dc10ddc0 0x7ff3dc1171b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3dc1135c0 0x7ff3dc11c580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc11cba0 con 0x7ff3dc10d3d0 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc11cd10 con 0x7ff3dc10ddc0 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3e1c6a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc11ced0 con 0x7ff3dc1135c0 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3db7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3dc10d3d0 0x7ff3dc116c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3db7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3dc10d3d0 0x7ff3dc116c70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60318/0 (socket says 10.20.193.4:60318) 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3db7fe640 1 -- 10.20.193.4:0/2458947792 learned_addr learned my addr 10.20.193.4:0/2458947792 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.015+0000 7ff3daffd640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff3dc10ddc0 0x7ff3dc1171b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3db7fe640 1 -- 10.20.193.4:0/2458947792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3dc1135c0 msgr2=0x7ff3dc11c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3dbfff640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3dc1135c0 0x7ff3dc11c580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3dc1135c0 0x7ff3dc11c580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3db7fe640 1 -- 10.20.193.4:0/2458947792 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff3dc10ddc0 msgr2=0x7ff3dc1171b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff3dc10ddc0 0x7ff3dc1171b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3db7fe640 1 -- 10.20.193.4:0/2458947792 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc009570 con 0x7ff3dc10d3d0 2026-02-24T09:17:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3dbfff640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3dc1135c0 0x7ff3dc11c580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3dc10d3d0 0x7ff3dc116c70 secure :-1 s=READY pgs=1048 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3c800b500 tx=0x7ff3c800b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3d8ff9640 1 -- 10.20.193.4:0/2458947792 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3c80044a0 con 0x7ff3dc10d3d0 2026-02-24T09:17:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2458947792 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc11d1b0 con 0x7ff3dc10d3d0 2026-02-24T09:17:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3d8ff9640 1 -- 10.20.193.4:0/2458947792 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff3c8002b80 con 0x7ff3dc10d3d0 2026-02-24T09:17:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3d8ff9640 1 -- 10.20.193.4:0/2458947792 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3c800fd90 con 0x7ff3dc10d3d0 2026-02-24T09:17:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.016+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2458947792 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc15d930 con 0x7ff3dc10d3d0 2026-02-24T09:17:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.017+0000 7ff3d8ff9640 1 -- 10.20.193.4:0/2458947792 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff3c80026a0 con 0x7ff3dc10d3d0 2026-02-24T09:17:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.018+0000 7ff3d8ff9640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff3b00b5760 0x7ff3b00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.018+0000 7ff3daffd640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff3b00b5760 0x7ff3b00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.018+0000 7ff3d8ff9640 1 -- 10.20.193.4:0/2458947792 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff3c80e5fe0 con 0x7ff3dc10d3d0 2026-02-24T09:17:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.019+0000 7ff3daffd640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff3b00b5760 0x7ff3b00d5c10 secure :-1 s=READY pgs=401 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3cc0023d0 tx=0x7ff3cc031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3e3c64e00 1 Processor -- start 2026-02-24T09:17:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3e3c64e00 1 -- start start 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 0x5619746e9320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x56197472dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x56197474e8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5619745f9ee0 con 0x5619746e9860 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5619745f5c10 con 0x56197472e500 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5619745efd70 con 0x5619746e8f50 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3daffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x56197472dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3daffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x56197472dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60332/0 (socket says 10.20.193.4:60332) 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.020+0000 7ff3daffd640 1 -- 10.20.193.4:0/3368789023 learned_addr learned my addr 10.20.193.4:0/3368789023 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/3368789023 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 0x5619746e9320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3daffd640 1 -- 10.20.193.4:0/3368789023 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 msgr2=0x5619746e9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3daffd640 1 --2- 10.20.193.4:0/3368789023 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 0x5619746e9320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3daffd640 1 -- 10.20.193.4:0/3368789023 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 msgr2=0x56197474e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3daffd640 1 --2- 10.20.193.4:0/3368789023 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x56197474e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3daffd640 1 -- 10.20.193.4:0/3368789023 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56197459b340 con 0x5619746e9860 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3daffd640 1 --2- 10.20.193.4:0/3368789023 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x56197472dfc0 secure :-1 s=READY pgs=1049 gs=1 cs=0 l=1 c_cookie=16798528132156895867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3cc009950 tx=0x7ff3cc040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9205c55729e327b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff39ffff640 1 -- 10.20.193.4:0/3368789023 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3cc02f9f0 con 0x5619746e9860 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff39ffff640 1 -- 10.20.193.4:0/3368789023 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff3cc038e00 con 0x5619746e9860 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff39ffff640 1 -- 10.20.193.4:0/3368789023 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3cc04fa80 con 0x5619746e9860 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3368789023 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 msgr2=0x56197472dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/3368789023 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x56197472dfc0 secure :-1 s=READY pgs=1049 gs=1 cs=0 l=1 c_cookie=16798528132156895867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3cc009950 tx=0x7ff3cc040000 comp rx=0 tx=0).stop 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3368789023 shutdown_connections 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/3368789023 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x56197474e8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/3368789023 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x56197472dfc0 unknown :-1 s=CLOSED pgs=1049 gs=1 cs=0 l=1 c_cookie=16798528132156895867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/3368789023 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 0x5619746e9320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3368789023 >> 10.20.193.4:0/3368789023 conn(0x561974607db0 msgr2=0x5619746e7830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3368789023 shutdown_connections 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.021+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3368789023 wait complete. 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3e3c64e00 1 -- start start 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3e3c64e00 1 Processor -- start 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e8f50 0x561974745e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 0x561974746370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x56197474b360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56197474b8a0 con 0x5619746e8f50 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56197474ba10 con 0x56197472e500 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56197474bbd0 con 0x5619746e9860 2026-02-24T09:17:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3db7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e8f50 0x561974745e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3db7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e8f50 0x561974745e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60334/0 (socket says 10.20.193.4:60334) 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3db7fe640 1 -- 10.20.193.4:0/3907019357 learned_addr learned my addr 10.20.193.4:0/3907019357 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3daffd640 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 0x561974746370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3db7fe640 1 -- 10.20.193.4:0/3907019357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 msgr2=0x561974746370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 0x561974746370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3db7fe640 1 -- 10.20.193.4:0/3907019357 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 msgr2=0x56197474b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x56197474b360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.022+0000 7ff3db7fe640 1 -- 10.20.193.4:0/3907019357 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619745739d0 con 0x5619746e8f50 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e8f50 0x561974745e30 secure :-1 s=READY pgs=1050 gs=1 cs=0 l=1 c_cookie=11552661448499668745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3c80e3a80 tx=0x7ff3c800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0534c60f82c2709 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff39d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff39d7fa640 1 -- 10.20.193.4:0/3907019357 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3c80b2030 con 0x5619746e8f50 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff39d7fa640 1 -- 10.20.193.4:0/3907019357 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff3c80b4610 con 0x5619746e8f50 2026-02-24T09:17:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3907019357 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc174800 con 0x5619746e8f50 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff39d7fa640 1 -- 10.20.193.4:0/3907019357 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3c80aa2f0 con 0x5619746e8f50 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 10 client.17460 _ll_register_callbacks cb 0x56197459a080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3907019357 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56197433f4a0 con 0x5619746e8f50 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff39d7fa640 1 -- 10.20.193.4:0/3907019357 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff3c80aa480 con 0x5619746e8f50 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff39d7fa640 1 -- 10.20.193.4:0/3907019357 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff3c80add00 con 0x5619746e8f50 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 10 client.17460 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3907019357 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561974585710 con 0x5619746e8f50 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff39d7fa640 1 -- 10.20.193.4:0/3907019357 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff3c80ade60 con 0x5619746e8f50 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 10 client.17460 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 10 client.17460 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 20 client.17460 populate_metadata read hostname 'trial004' 2026-02-24T09:17:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56197474e430 0x56197474e8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 4 client.17460 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3907019357 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619745e57b0 con 0x56197474e430 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.023+0000 7ff3daffd640 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56197474e430 0x56197474e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3daffd640 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56197474e430 0x56197474e8d0 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=8047714246476218238 s_cookie=7921944755000838265 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6faf3977f310bf7e server_cookie=6df066c84c180879 in_seq=0 out_seq=0 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff39d7fa640 10 client.17460 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff39d7fa640 1 -- 10.20.193.4:0/3907019357 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5619745e57b0 con 0x56197474e430 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff39d7fa640 10 client.17460 handle_command_reply: tid=0 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 client.17460 shutdown 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3907019357 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e8f50 msgr2=0x561974745e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e8f50 0x561974745e30 secure :-1 s=READY pgs=1050 gs=1 cs=0 l=1 c_cookie=11552661448499668745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3c80e3a80 tx=0x7ff3c800bf90 comp rx=0 tx=0).stop 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3907019357 shutdown_connections 2026-02-24T09:17:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56197474e430 0x56197474e8d0 crc :-1 s=READY pgs=49 gs=4 cs=0 l=0 c_cookie=8047714246476218238 s_cookie=7921944755000838265 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x56197474b360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 0x561974746370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff39d7fa640 0 client.17460 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:17:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/3907019357 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e8f50 0x561974745e30 unknown :-1 s=CLOSED pgs=1050 gs=1 cs=0 l=1 c_cookie=11552661448499668745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3907019357 >> 10.20.193.4:0/3907019357 conn(0x561974607db0 msgr2=0x5619746e7040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3907019357 shutdown_connections 2026-02-24T09:17:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/3907019357 wait complete. 2026-02-24T09:17:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.024+0000 7ff3e3c64e00 20 client.17460 trim_cache size 0 max 16384 2026-02-24T09:17:16.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3e3c64e00 1 Processor -- start 2026-02-24T09:17:16.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3e3c64e00 1 -- start start 2026-02-24T09:17:16.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 0x561974730ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x5619746e8460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x5619746e89a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5619745ed9a0 con 0x5619746e9860 2026-02-24T09:17:16.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5619743c9df0 con 0x56197472e500 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561974659270 con 0x5619746e8f50 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3daffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x5619746e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3daffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x5619746e8460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60344/0 (socket says 10.20.193.4:60344) 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3daffd640 1 -- 10.20.193.4:0/2101380171 learned_addr learned my addr 10.20.193.4:0/2101380171 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 0x561974730ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3dbfff640 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x5619746e89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3daffd640 1 -- 10.20.193.4:0/2101380171 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 msgr2=0x561974730ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3daffd640 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 0x561974730ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3daffd640 1 -- 10.20.193.4:0/2101380171 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 msgr2=0x5619746e89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3daffd640 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x5619746e89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3daffd640 1 -- 10.20.193.4:0/2101380171 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561974580190 con 0x5619746e9860 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 0x561974730ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3dbfff640 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x5619746e89a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.031+0000 7ff3daffd640 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x5619746e8460 secure :-1 s=READY pgs=1051 gs=1 cs=0 l=1 c_cookie=15440143649274610360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3cc02f6e0 tx=0x7ff3cc04f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64668d7f80442b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff39f7fe640 1 -- 10.20.193.4:0/2101380171 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3cc038600 con 0x5619746e9860 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff39f7fe640 1 -- 10.20.193.4:0/2101380171 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff3cc048070 con 0x5619746e9860 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff39f7fe640 1 -- 10.20.193.4:0/2101380171 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3cc04fa50 con 0x5619746e9860 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/2101380171 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 msgr2=0x5619746e8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x5619746e8460 secure :-1 s=READY pgs=1051 gs=1 cs=0 l=1 c_cookie=15440143649274610360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3cc02f6e0 tx=0x7ff3cc04f5d0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/2101380171 shutdown_connections 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56197472e500 0x5619746e89a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619746e9860 0x5619746e8460 unknown :-1 s=CLOSED pgs=1051 gs=1 cs=0 l=1 c_cookie=15440143649274610360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/2101380171 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e8f50 0x561974730ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.044 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/2101380171 >> 10.20.193.4:0/2101380171 conn(0x561974607db0 msgr2=0x5619747308e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/2101380171 shutdown_connections 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/2101380171 wait complete. 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 -- start start 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.032+0000 7ff3e3c64e00 1 Processor -- start 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619746e8f50 0x56197474ab60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 0x5619746c7030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56197472e500 0x5619746c7570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56197474ea60 con 0x56197472e500 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5619747951f0 con 0x5619746e8f50 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5619746c7ab0 con 0x5619746e9860 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3dbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56197472e500 0x5619746c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3dbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56197472e500 0x5619746c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60354/0 (socket says 10.20.193.4:60354) 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3dbfff640 1 -- 10.20.193.4:0/1875766338 learned_addr learned my addr 10.20.193.4:0/1875766338 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3daffd640 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 0x5619746c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3dbfff640 1 -- 10.20.193.4:0/1875766338 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 msgr2=0x5619746c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3dbfff640 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 0x5619746c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3dbfff640 1 -- 10.20.193.4:0/1875766338 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619746e8f50 msgr2=0x56197474ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3dbfff640 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619746e8f50 0x56197474ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3dbfff640 1 -- 10.20.193.4:0/1875766338 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561974573d00 con 0x56197472e500 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3daffd640 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 0x5619746c7030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3dbfff640 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56197472e500 0x5619746c7570 secure :-1 s=READY pgs=1052 gs=1 cs=0 l=1 c_cookie=10967685091047238623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3d0006910 tx=0x7ff3d0010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98350b7b2437ebdf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff39d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff39d7fa640 1 -- 10.20.193.4:0/1875766338 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3d0004ea0 con 0x56197472e500 2026-02-24T09:17:16.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff39d7fa640 1 -- 10.20.193.4:0/1875766338 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff3d0006020 con 0x56197472e500 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/1875766338 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56197459b340 con 0x56197472e500 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff39d7fa640 1 -- 10.20.193.4:0/1875766338 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3d00128f0 con 0x56197472e500 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 10 client.17466 _ll_register_callbacks cb 0x56197459a080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/1875766338 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3cc038e00 con 0x56197472e500 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff39d7fa640 1 -- 10.20.193.4:0/1875766338 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff3d0012a80 con 0x56197472e500 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff39d7fa640 1 -- 10.20.193.4:0/1875766338 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff3d0012c40 con 0x56197472e500 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 10 client.17466 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/1875766338 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561974585970 con 0x56197472e500 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff39d7fa640 1 -- 10.20.193.4:0/1875766338 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff3d0018030 con 0x56197472e500 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 10 client.17466 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 10 client.17466 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 20 client.17466 populate_metadata read hostname 'trial004' 2026-02-24T09:17:16.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5619747dbfb0 0x5619747fc460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 4 client.17466 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/1875766338 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561974324160 con 0x5619747dbfb0 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.033+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5619747dbfb0 0x5619747fc460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3db7fe640 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5619747dbfb0 0x5619747fc460 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=2516192857237177335 s_cookie=11819298439828687686 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=22eb501281ff43f7 server_cookie=a406954f48514b46 in_seq=0 out_seq=0 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff39d7fa640 10 client.17466 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff39d7fa640 1 -- 10.20.193.4:0/1875766338 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561974324160 con 0x5619747dbfb0 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff39d7fa640 10 client.17466 handle_command_reply: tid=0 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 client.17466 shutdown 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/1875766338 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56197472e500 msgr2=0x5619746c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56197472e500 0x5619746c7570 secure :-1 s=READY pgs=1052 gs=1 cs=0 l=1 c_cookie=10967685091047238623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3d0006910 tx=0x7ff3d0010730 comp rx=0 tx=0).stop 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/1875766338 shutdown_connections 2026-02-24T09:17:16.048 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5619747dbfb0 0x5619747fc460 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=2516192857237177335 s_cookie=11819298439828687686 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56197472e500 0x5619746c7570 unknown :-1 s=CLOSED pgs=1052 gs=1 cs=0 l=1 c_cookie=10967685091047238623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff39d7fa640 0 client.17466 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619746e9860 0x5619746c7030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 --2- 10.20.193.4:0/1875766338 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619746e8f50 0x56197474ab60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/1875766338 >> 10.20.193.4:0/1875766338 conn(0x561974607db0 msgr2=0x5619746e7450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/1875766338 shutdown_connections 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 1 -- 10.20.193.4:0/1875766338 wait complete. 2026-02-24T09:17:16.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e3c64e00 20 client.17466 trim_cache size 0 max 16384 2026-02-24T09:17:16.050 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:17:16.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2458947792 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff3b00b5760 msgr2=0x7ff3b00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff3b00b5760 0x7ff3b00d5c10 secure :-1 s=READY pgs=401 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3cc0023d0 tx=0x7ff3cc031040 comp rx=0 tx=0).stop 2026-02-24T09:17:16.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2458947792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3dc10d3d0 msgr2=0x7ff3dc116c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3dc10d3d0 0x7ff3dc116c70 secure :-1 s=READY pgs=1048 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3c800b500 tx=0x7ff3c800b9d0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2458947792 shutdown_connections 2026-02-24T09:17:16.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff3b00b5760 0x7ff3b00d5c10 unknown :-1 s=CLOSED pgs=401 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff3dc1135c0 0x7ff3dc11c580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff3dc10ddc0 0x7ff3dc1171b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 --2- 10.20.193.4:0/2458947792 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff3dc10d3d0 0x7ff3dc116c70 unknown :-1 s=CLOSED pgs=1048 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2458947792 >> 10.20.193.4:0/2458947792 conn(0x7ff3dc0eaca0 msgr2=0x7ff3dc10b080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.034+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2458947792 shutdown_connections 2026-02-24T09:17:16.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.035+0000 7ff3e1c6a640 1 -- 10.20.193.4:0/2458947792 wait complete. 2026-02-24T09:17:16.072 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:17:16.201 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.298+0000 7f16e6af0640 1 -- 10.20.193.4:0/1205329119 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e010ddc0 msgr2=0x7f16e0112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.298+0000 7f16e6af0640 1 --2- 10.20.193.4:0/1205329119 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e010ddc0 0x7f16e0112e10 secure :-1 s=READY pgs=1053 gs=1 cs=0 l=1 c_cookie=8722130673470892678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c8009950 tx=0x7f16c802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 -- 10.20.193.4:0/1205329119 shutdown_connections 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 --2- 10.20.193.4:0/1205329119 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e01135c0 0x7f16e0173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 --2- 10.20.193.4:0/1205329119 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e010ddc0 0x7f16e0112e10 unknown :-1 s=CLOSED pgs=1053 gs=1 cs=0 l=1 c_cookie=8722130673470892678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 --2- 10.20.193.4:0/1205329119 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010d3d0 0x7f16e010d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 -- 10.20.193.4:0/1205329119 >> 10.20.193.4:0/1205329119 conn(0x7f16e00eaca0 msgr2=0x7f16e010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 -- 10.20.193.4:0/1205329119 shutdown_connections 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 -- 10.20.193.4:0/1205329119 wait complete. 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 Processor -- start 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 -- start start 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010d3d0 0x7f16e00f58e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e010ddc0 0x7f16e0173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e00f5fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f16e00fb1a0 con 0x7f16e01135c0 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f16e00fb310 con 0x7f16e010d3d0 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e6af0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16e00fb4d0 con 0x7f16e010ddc0 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e5066640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e00f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e5066640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e00f5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60374/0 (socket says 10.20.193.4:60374) 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e5066640 1 -- 10.20.193.4:0/1052656454 learned_addr learned my addr 10.20.193.4:0/1052656454 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.299+0000 7f16e4865640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010d3d0 0x7f16e00f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16e5066640 1 -- 10.20.193.4:0/1052656454 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e010ddc0 msgr2=0x7f16e0173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16e5066640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e010ddc0 0x7f16e0173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16e5066640 1 -- 10.20.193.4:0/1052656454 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010d3d0 msgr2=0x7f16e00f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16e5066640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010d3d0 0x7f16e00f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16e5066640 1 -- 10.20.193.4:0/1052656454 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c8009570 con 0x7f16e01135c0 2026-02-24T09:17:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16e5066640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e00f5fe0 secure :-1 s=READY pgs=1054 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16dc006e90 tx=0x7f16dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16d5ffb640 1 -- 10.20.193.4:0/1052656454 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16dc005500 con 0x7f16e01135c0 2026-02-24T09:17:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16e6af0640 1 -- 10.20.193.4:0/1052656454 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e00fb7b0 con 0x7f16e01135c0 2026-02-24T09:17:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16d5ffb640 1 -- 10.20.193.4:0/1052656454 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16dc005e10 con 0x7f16e01135c0 2026-02-24T09:17:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16d5ffb640 1 -- 10.20.193.4:0/1052656454 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16dc003a90 con 0x7f16e01135c0 2026-02-24T09:17:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.300+0000 7f16e6af0640 1 -- 10.20.193.4:0/1052656454 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e00fbc80 con 0x7f16e01135c0 2026-02-24T09:17:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.301+0000 7f16d5ffb640 1 -- 10.20.193.4:0/1052656454 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f16dc00c840 con 0x7f16e01135c0 2026-02-24T09:17:16.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.302+0000 7f16d5ffb640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16bc0b56d0 0x7f16bc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.302+0000 7f16e4865640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16bc0b56d0 0x7f16bc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.302+0000 7f16d5ffb640 1 -- 10.20.193.4:0/1052656454 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f16dc0e79c0 con 0x7f16e01135c0 2026-02-24T09:17:16.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.302+0000 7f16e4865640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16bc0b56d0 0x7f16bc0d5b80 secure :-1 s=READY pgs=402 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d0004740 tx=0x7f16d0005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16e8aeae00 1 Processor -- start 2026-02-24T09:17:16.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16e8aeae00 1 -- start start 2026-02-24T09:17:16.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab93bb320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fffc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab94208e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561ab92cbee0 con 0x561ab93bb860 2026-02-24T09:17:16.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561ab92c7c10 con 0x561ab9400500 2026-02-24T09:17:16.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561ab92c1d70 con 0x561ab93baf50 2026-02-24T09:17:16.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16d7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16d7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60386/0 (socket says 10.20.193.4:60386) 2026-02-24T09:17:16.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16d7fff640 1 -- 10.20.193.4:0/1176841722 learned_addr learned my addr 10.20.193.4:0/1176841722 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:16.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16e4865640 1 --2- 10.20.193.4:0/1176841722 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab93bb320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16d7fff640 1 -- 10.20.193.4:0/1176841722 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 msgr2=0x561ab93bb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16d7fff640 1 --2- 10.20.193.4:0/1176841722 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab93bb320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16d7fff640 1 -- 10.20.193.4:0/1176841722 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 msgr2=0x561ab94208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16d7fff640 1 --2- 10.20.193.4:0/1176841722 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab94208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16d7fff640 1 -- 10.20.193.4:0/1176841722 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ab926d340 con 0x561ab93bb860 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16d7fff640 1 --2- 10.20.193.4:0/1176841722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fffc0 secure :-1 s=READY pgs=1055 gs=1 cs=0 l=1 c_cookie=13543301261522956007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c80092b0 tx=0x7f16c8005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf378bdeb2ceee7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16ad4e4640 1 -- 10.20.193.4:0/1176841722 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c803d070 con 0x561ab93bb860 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16ad4e4640 1 -- 10.20.193.4:0/1176841722 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16c8038470 con 0x561ab93bb860 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.304+0000 7f16ad4e4640 1 -- 10.20.193.4:0/1176841722 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c802fea0 con 0x561ab93bb860 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.305+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1176841722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 msgr2=0x561ab93fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.305+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/1176841722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fffc0 secure :-1 s=READY pgs=1055 gs=1 cs=0 l=1 c_cookie=13543301261522956007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c80092b0 tx=0x7f16c8005990 comp rx=0 tx=0).stop 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.305+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1176841722 shutdown_connections 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.305+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/1176841722 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab94208e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.305+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/1176841722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fffc0 unknown :-1 s=CLOSED pgs=1055 gs=1 cs=0 l=1 c_cookie=13543301261522956007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.305+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/1176841722 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab93bb320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.305+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1176841722 >> 10.20.193.4:0/1176841722 conn(0x561ab92d9db0 msgr2=0x561ab93b9830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.305+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1176841722 shutdown_connections 2026-02-24T09:17:16.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.305+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1176841722 wait complete. 2026-02-24T09:17:16.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.305+0000 7f16e8aeae00 1 -- start start 2026-02-24T09:17:16.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16e8aeae00 1 Processor -- start 2026-02-24T09:17:16.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab9417de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab9418320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab941d310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561ab941d850 con 0x561ab93bb860 2026-02-24T09:17:16.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561ab941d9c0 con 0x561ab9400500 2026-02-24T09:17:16.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561ab941db80 con 0x561ab93baf50 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16d7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab9418320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16d7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab9418320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60390/0 (socket says 10.20.193.4:60390) 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16d7fff640 1 -- 10.20.193.4:0/1506456646 learned_addr learned my addr 10.20.193.4:0/1506456646 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16e5066640 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab941d310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16d7fff640 1 -- 10.20.193.4:0/1506456646 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 msgr2=0x561ab9417de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16d7fff640 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab9417de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16d7fff640 1 -- 10.20.193.4:0/1506456646 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 msgr2=0x561ab941d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16d7fff640 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab941d310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16d7fff640 1 -- 10.20.193.4:0/1506456646 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ab92459d0 con 0x561ab93bb860 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16d7fff640 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab9418320 secure :-1 s=READY pgs=1056 gs=1 cs=0 l=1 c_cookie=2359568049186187942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c8002c20 tx=0x7f16c8002a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bedea3a31aaaa6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f169e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:16.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f169e7fc640 1 -- 10.20.193.4:0/1506456646 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c803d070 con 0x561ab93bb860 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f169e7fc640 1 -- 10.20.193.4:0/1506456646 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16c8038e00 con 0x561ab93bb860 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f169e7fc640 1 -- 10.20.193.4:0/1506456646 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c8041c10 con 0x561ab93bb860 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1506456646 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e0174800 con 0x561ab93bb860 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f169e7fc640 1 -- 10.20.193.4:0/1506456646 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f16c8041da0 con 0x561ab93bb860 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.306+0000 7f169e7fc640 10 client.17478 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e8aeae00 10 client.17478 _ll_register_callbacks cb 0x561ab926c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1506456646 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561ab90114a0 con 0x561ab93bb860 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f169e7fc640 1 -- 10.20.193.4:0/1506456646 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f16c802fcb0 con 0x561ab93bb860 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e8aeae00 10 client.17478 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1506456646 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561ab9257710 con 0x561ab93bb860 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f169e7fc640 1 -- 10.20.193.4:0/1506456646 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f16c8048070 con 0x561ab93bb860 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e8aeae00 10 client.17478 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:16.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e8aeae00 10 client.17478 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e8aeae00 20 client.17478 populate_metadata read hostname 'trial004' 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561ab93fd360 0x561ab93fd800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e8aeae00 4 client.17478 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1506456646 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ab92b77b0 con 0x561ab93fd360 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.307+0000 7f16e4865640 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561ab93fd360 0x561ab93fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.308+0000 7f16e4865640 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561ab93fd360 0x561ab93fd800 crc :-1 s=READY pgs=163 gs=4 cs=0 l=0 c_cookie=11363972163005455599 s_cookie=15658723789563436131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9db4f0792d5e1cef server_cookie=d94ef652b8e31c63 in_seq=0 out_seq=0 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.308+0000 7f169e7fc640 10 client.17478 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.308+0000 7f169e7fc640 1 -- 10.20.193.4:0/1506456646 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561ab92b77b0 con 0x561ab93fd360 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.308+0000 7f169e7fc640 10 client.17478 handle_command_reply: tid=0 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.308+0000 7f16e8aeae00 1 client.17478 shutdown 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1506456646 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 msgr2=0x561ab9418320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab9418320 secure :-1 s=READY pgs=1056 gs=1 cs=0 l=1 c_cookie=2359568049186187942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c8002c20 tx=0x7f16c8002a90 comp rx=0 tx=0).stop 2026-02-24T09:17:16.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1506456646 shutdown_connections 2026-02-24T09:17:16.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561ab93fd360 0x561ab93fd800 crc :-1 s=READY pgs=163 gs=4 cs=0 l=0 c_cookie=11363972163005455599 s_cookie=15658723789563436131 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab941d310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab9418320 unknown :-1 s=CLOSED pgs=1056 gs=1 cs=0 l=1 c_cookie=2359568049186187942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f169e7fc640 0 client.17478 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:16.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/1506456646 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab9417de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1506456646 >> 10.20.193.4:0/1506456646 conn(0x561ab92d9db0 msgr2=0x561ab93b9040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1506456646 shutdown_connections 2026-02-24T09:17:16.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 1 -- 10.20.193.4:0/1506456646 wait complete. 2026-02-24T09:17:16.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.309+0000 7f16e8aeae00 20 client.17478 trim_cache size 0 max 16384 2026-02-24T09:17:16.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16e8aeae00 1 Processor -- start 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16e8aeae00 1 -- start start 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab941c880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fb110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab93fb650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561ab92bf9a0 con 0x561ab93bb860 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561ab909bdf0 con 0x561ab9400500 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561ab94053a0 con 0x561ab93baf50 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16d7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16d7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fb110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60392/0 (socket says 10.20.193.4:60392) 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16d7fff640 1 -- 10.20.193.4:0/85038816 learned_addr learned my addr 10.20.193.4:0/85038816 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.315+0000 7f16e4865640 1 --2- 10.20.193.4:0/85038816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab941c880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16d7fff640 1 -- 10.20.193.4:0/85038816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 msgr2=0x561ab941c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16d7fff640 1 --2- 10.20.193.4:0/85038816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab941c880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16d7fff640 1 -- 10.20.193.4:0/85038816 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 msgr2=0x561ab93fb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16d7fff640 1 --2- 10.20.193.4:0/85038816 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab93fb650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16d7fff640 1 -- 10.20.193.4:0/85038816 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ab940a440 con 0x561ab93bb860 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e4865640 1 --2- 10.20.193.4:0/85038816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab941c880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16d7fff640 1 --2- 10.20.193.4:0/85038816 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fb110 secure :-1 s=READY pgs=1057 gs=1 cs=0 l=1 c_cookie=891978937686271237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c8002bf0 tx=0x7f16c8050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60f21e2feba505 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16acce3640 1 -- 10.20.193.4:0/85038816 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c803d040 con 0x561ab93bb860 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16acce3640 1 -- 10.20.193.4:0/85038816 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16c8056020 con 0x561ab93bb860 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16acce3640 1 -- 10.20.193.4:0/85038816 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c8049690 con 0x561ab93bb860 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 -- 10.20.193.4:0/85038816 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 msgr2=0x561ab93fb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/85038816 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fb110 secure :-1 s=READY pgs=1057 gs=1 cs=0 l=1 c_cookie=891978937686271237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c8002bf0 tx=0x7f16c8050000 comp rx=0 tx=0).stop 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 -- 10.20.193.4:0/85038816 shutdown_connections 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/85038816 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab93fb650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/85038816 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab93fb110 unknown :-1 s=CLOSED pgs=1057 gs=1 cs=0 l=1 c_cookie=891978937686271237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/85038816 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab941c880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 -- 10.20.193.4:0/85038816 >> 10.20.193.4:0/85038816 conn(0x561ab92d9db0 msgr2=0x561ab941c170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 -- 10.20.193.4:0/85038816 shutdown_connections 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 -- 10.20.193.4:0/85038816 wait complete. 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 -- start start 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.316+0000 7f16e8aeae00 1 Processor -- start 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab941c660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab941cba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab9399030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561ab909bdf0 con 0x561ab93bb860 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561ab94672f0 con 0x561ab9400500 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561ab93995f0 con 0x561ab93baf50 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16d7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab941cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16d7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab941cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60406/0 (socket says 10.20.193.4:60406) 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16d7fff640 1 -- 10.20.193.4:0/348571496 learned_addr learned my addr 10.20.193.4:0/348571496 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:16.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e4865640 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab941c660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e5066640 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab9399030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16d7fff640 1 -- 10.20.193.4:0/348571496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 msgr2=0x561ab941c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16d7fff640 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab941c660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16d7fff640 1 -- 10.20.193.4:0/348571496 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 msgr2=0x561ab9399030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16d7fff640 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab9399030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16d7fff640 1 -- 10.20.193.4:0/348571496 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ab9252190 con 0x561ab93bb860 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16d7fff640 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab941cba0 secure :-1 s=READY pgs=1058 gs=1 cs=0 l=1 c_cookie=9176083668851856748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c8009880 tx=0x7f16c8002a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f57ff7ad72d956c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f169e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f169e7fc640 1 -- 10.20.193.4:0/348571496 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c803d040 con 0x561ab93bb860 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f169e7fc640 1 -- 10.20.193.4:0/348571496 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x561ab90114a0 con 0x561ab93bb860 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 -- 10.20.193.4:0/348571496 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ab9257710 con 0x561ab93bb860 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f169e7fc640 1 -- 10.20.193.4:0/348571496 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c8037d90 con 0x561ab93bb860 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 10 client.17484 _ll_register_callbacks cb 0x561ab926c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 -- 10.20.193.4:0/348571496 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16c8038470 con 0x561ab93bb860 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f169e7fc640 1 -- 10.20.193.4:0/348571496 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f16c8057030 con 0x561ab93bb860 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f169e7fc640 1 -- 10.20.193.4:0/348571496 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f16c80413f0 con 0x561ab93bb860 2026-02-24T09:17:16.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 10 client.17484 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 -- 10.20.193.4:0/348571496 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561ab9245d00 con 0x561ab93bb860 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f169e7fc640 1 -- 10.20.193.4:0/348571496 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f16c8062070 con 0x561ab93bb860 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 10 client.17484 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 10 client.17484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 20 client.17484 populate_metadata read hostname 'trial004' 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561ab939ebe0 0x561ab94cd7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 4 client.17484 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.317+0000 7f16e8aeae00 1 -- 10.20.193.4:0/348571496 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561ab8ff6160 con 0x561ab939ebe0 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.318+0000 7f16e4865640 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561ab939ebe0 0x561ab94cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.318+0000 7f16e4865640 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561ab939ebe0 0x561ab94cd7a0 crc :-1 s=READY pgs=164 gs=4 cs=0 l=0 c_cookie=9257386485512101065 s_cookie=4507256260429834747 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8078d7f5f9735cc9 server_cookie=3e8cfdb03a9369fb in_seq=0 out_seq=0 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.318+0000 7f169e7fc640 10 client.17484 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.318+0000 7f169e7fc640 1 -- 10.20.193.4:0/348571496 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561ab8ff6160 con 0x561ab939ebe0 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.318+0000 7f169e7fc640 10 client.17484 handle_command_reply: tid=0 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.318+0000 7f16e8aeae00 1 client.17484 shutdown 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.318+0000 7f16e8aeae00 1 -- 10.20.193.4:0/348571496 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 msgr2=0x561ab941cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.318+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab941cba0 secure :-1 s=READY pgs=1058 gs=1 cs=0 l=1 c_cookie=9176083668851856748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c8009880 tx=0x7f16c8002a90 comp rx=0 tx=0).stop 2026-02-24T09:17:16.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e8aeae00 1 -- 10.20.193.4:0/348571496 shutdown_connections 2026-02-24T09:17:16.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561ab939ebe0 0x561ab94cd7a0 crc :-1 s=READY pgs=164 gs=4 cs=0 l=0 c_cookie=9257386485512101065 s_cookie=4507256260429834747 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561ab9400500 0x561ab9399030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f169e7fc640 0 client.17484 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:16.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561ab93bb860 0x561ab941cba0 unknown :-1 s=CLOSED pgs=1058 gs=1 cs=0 l=1 c_cookie=9176083668851856748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e8aeae00 1 --2- 10.20.193.4:0/348571496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561ab93baf50 0x561ab941c660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e8aeae00 1 -- 10.20.193.4:0/348571496 >> 10.20.193.4:0/348571496 conn(0x561ab92d9db0 msgr2=0x561ab93b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e8aeae00 1 -- 10.20.193.4:0/348571496 shutdown_connections 2026-02-24T09:17:16.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e8aeae00 1 -- 10.20.193.4:0/348571496 wait complete. 2026-02-24T09:17:16.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e8aeae00 20 client.17484 trim_cache size 0 max 16384 2026-02-24T09:17:16.332 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:17:16.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 -- 10.20.193.4:0/1052656454 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16bc0b56d0 msgr2=0x7f16bc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16bc0b56d0 0x7f16bc0d5b80 secure :-1 s=READY pgs=402 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d0004740 tx=0x7f16d0005d00 comp rx=0 tx=0).stop 2026-02-24T09:17:16.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 -- 10.20.193.4:0/1052656454 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 msgr2=0x7f16e00f5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:16.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e00f5fe0 secure :-1 s=READY pgs=1054 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16dc006e90 tx=0x7f16dc00edf0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 -- 10.20.193.4:0/1052656454 shutdown_connections 2026-02-24T09:17:16.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f16bc0b56d0 0x7f16bc0d5b80 unknown :-1 s=CLOSED pgs=402 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f16e01135c0 0x7f16e00f5fe0 unknown :-1 s=CLOSED pgs=1054 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16e010ddc0 0x7f16e0173e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 --2- 10.20.193.4:0/1052656454 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f16e010d3d0 0x7f16e00f58e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:16.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 -- 10.20.193.4:0/1052656454 >> 10.20.193.4:0/1052656454 conn(0x7f16e00eaca0 msgr2=0x7f16e0111470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:16.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 -- 10.20.193.4:0/1052656454 shutdown_connections 2026-02-24T09:17:16.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:16.319+0000 7f16e6af0640 1 -- 10.20.193.4:0/1052656454 wait complete. 2026-02-24T09:17:16.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:15 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3347204790' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:16.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:15 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3347204790' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:16 trial004 ceph-mon[41596]: pgmap v376: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 815 MiB/s wr, 240 op/s 2026-02-24T09:17:17.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:16 trial090 ceph-mon[47278]: pgmap v376: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 815 MiB/s wr, 240 op/s 2026-02-24T09:17:17.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:16 trial014 ceph-mon[46941]: pgmap v376: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 815 MiB/s wr, 240 op/s 2026-02-24T09:17:17.355 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:17:17.356 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:17:17.470 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:17.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 -- 10.20.193.4:0/2044713362 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e04115470 msgr2=0x7f2e04175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 --2- 10.20.193.4:0/2044713362 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e04115470 0x7f2e04175e40 secure :-1 s=READY pgs=1059 gs=1 cs=0 l=1 c_cookie=13456181248390279205 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e0000aa30 tx=0x7f2e00030280 comp rx=0 tx=0).stop 2026-02-24T09:17:17.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 -- 10.20.193.4:0/2044713362 shutdown_connections 2026-02-24T09:17:17.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 --2- 10.20.193.4:0/2044713362 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e04115470 0x7f2e04175e40 unknown :-1 s=CLOSED pgs=1059 gs=1 cs=0 l=1 c_cookie=13456181248390279205 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 --2- 10.20.193.4:0/2044713362 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e0410fc70 0x7f2e04114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 --2- 10.20.193.4:0/2044713362 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e0410f280 0x7f2e0410f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 -- 10.20.193.4:0/2044713362 >> 10.20.193.4:0/2044713362 conn(0x7f2e0405f830 msgr2=0x7f2e0410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 -- 10.20.193.4:0/2044713362 shutdown_connections 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 -- 10.20.193.4:0/2044713362 wait complete. 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 Processor -- start 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.571+0000 7f2e0bb00640 1 -- start start 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e0bb00640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e0410f280 0x7f2e0411db40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e0bb00640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e0410fc70 0x7f2e0411e080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e0bb00640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e04115470 0x7f2e04123450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e0bb00640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2e04123a70 con 0x7f2e0410f280 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e0bb00640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2e04123be0 con 0x7f2e04115470 2026-02-24T09:17:17.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e0bb00640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2e04123da0 con 0x7f2e0410fc70 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e09875640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e0410f280 0x7f2e0411db40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e09875640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e0410f280 0x7f2e0411db40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60414/0 (socket says 10.20.193.4:60414) 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e09875640 1 -- 10.20.193.4:0/240572069 learned_addr learned my addr 10.20.193.4:0/240572069 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e0a076640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e04115470 0x7f2e04123450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e09074640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e0410fc70 0x7f2e0411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e09875640 1 -- 10.20.193.4:0/240572069 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e0410fc70 msgr2=0x7f2e0411e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e09875640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e0410fc70 0x7f2e0411e080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e09875640 1 -- 10.20.193.4:0/240572069 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e04115470 msgr2=0x7f2e04123450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e09875640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e04115470 0x7f2e04123450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e09875640 1 -- 10.20.193.4:0/240572069 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0000a650 con 0x7f2e0410f280 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e09875640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e0410f280 0x7f2e0411db40 secure :-1 s=READY pgs=1060 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df400d950 tx=0x7f2df400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2df2ffd640 1 -- 10.20.193.4:0/240572069 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2df4004540 con 0x7f2e0410f280 2026-02-24T09:17:17.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2df2ffd640 1 -- 10.20.193.4:0/240572069 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2df4009d00 con 0x7f2e0410f280 2026-02-24T09:17:17.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e0bb00640 1 -- 10.20.193.4:0/240572069 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e04124080 con 0x7f2e0410f280 2026-02-24T09:17:17.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2df2ffd640 1 -- 10.20.193.4:0/240572069 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2df40106e0 con 0x7f2e0410f280 2026-02-24T09:17:17.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.572+0000 7f2e0bb00640 1 -- 10.20.193.4:0/240572069 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e04164780 con 0x7f2e0410f280 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.574+0000 7f2df2ffd640 1 -- 10.20.193.4:0/240572069 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f2df40097c0 con 0x7f2e0410f280 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.574+0000 7f2df2ffd640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2de00b5760 0x7f2de00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.574+0000 7f2df2ffd640 1 -- 10.20.193.4:0/240572069 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2df40e6dc0 con 0x7f2e0410f280 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.574+0000 7f2e09074640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2de00b5760 0x7f2de00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.575+0000 7f2e09074640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2de00b5760 0x7f2de00d5c10 secure :-1 s=READY pgs=403 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e041244e0 tx=0x7f2df8004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 Processor -- start 2026-02-24T09:17:17.586 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 -- start start 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c5d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c5dc10 0x559177ca2370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177ca28b0 0x559177cc2c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559177b6d520 con 0x559177ca28b0 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559177b69250 con 0x559177c5dc10 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559177b633b0 con 0x559177c5d300 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0a076640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177ca28b0 0x559177cc2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0a076640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177ca28b0 0x559177cc2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60430/0 (socket says 10.20.193.4:60430) 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0a076640 1 -- 10.20.193.4:0/723197387 learned_addr learned my addr 10.20.193.4:0/723197387 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:17.587 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e09875640 1 --2- 10.20.193.4:0/723197387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c5d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0a076640 1 -- 10.20.193.4:0/723197387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 msgr2=0x559177c5d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0a076640 1 --2- 10.20.193.4:0/723197387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c5d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0a076640 1 -- 10.20.193.4:0/723197387 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c5dc10 msgr2=0x559177ca2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0a076640 1 --2- 10.20.193.4:0/723197387 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c5dc10 0x559177ca2370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0a076640 1 -- 10.20.193.4:0/723197387 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559177b0e6e0 con 0x559177ca28b0 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0a076640 1 --2- 10.20.193.4:0/723197387 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177ca28b0 0x559177cc2c90 secure :-1 s=READY pgs=1061 gs=1 cs=0 l=1 c_cookie=18145652106218150996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e00006a90 tx=0x7f2e00006cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd24e7368f39c54 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2dd24e6640 1 -- 10.20.193.4:0/723197387 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e0003e040 con 0x559177ca28b0 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2dd24e6640 1 -- 10.20.193.4:0/723197387 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2e00039470 con 0x559177ca28b0 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2dd24e6640 1 -- 10.20.193.4:0/723197387 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e00039ea0 con 0x559177ca28b0 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 -- 10.20.193.4:0/723197387 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177ca28b0 msgr2=0x559177cc2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/723197387 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177ca28b0 0x559177cc2c90 secure :-1 s=READY pgs=1061 gs=1 cs=0 l=1 c_cookie=18145652106218150996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e00006a90 tx=0x7f2e00006cb0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.588 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.576+0000 7f2e0dafae00 1 -- 10.20.193.4:0/723197387 shutdown_connections 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.577+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/723197387 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177ca28b0 0x559177cc2c90 unknown :-1 s=CLOSED pgs=1061 gs=1 cs=0 l=1 c_cookie=18145652106218150996 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.577+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/723197387 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c5dc10 0x559177ca2370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.577+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/723197387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c5d6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.577+0000 7f2e0dafae00 1 -- 10.20.193.4:0/723197387 >> 10.20.193.4:0/723197387 conn(0x559177b7b4f0 msgr2=0x559177c5bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.577+0000 7f2e0dafae00 1 -- 10.20.193.4:0/723197387 shutdown_connections 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.577+0000 7f2e0dafae00 1 -- 10.20.193.4:0/723197387 wait complete. 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.577+0000 7f2e0dafae00 1 -- start start 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e0dafae00 1 Processor -- start 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c75300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c75840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177ca28b0 0x559177c7a830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.589 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559177c7ad70 con 0x559177c5dc10 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559177c7aee0 con 0x559177ca28b0 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559177c7b0a0 con 0x559177c5d300 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e09074640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c75840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e09074640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c75840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60442/0 (socket says 10.20.193.4:60442) 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e09074640 1 -- 10.20.193.4:0/1391606016 learned_addr learned my addr 10.20.193.4:0/1391606016 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e09875640 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c75300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e09074640 1 -- 10.20.193.4:0/1391606016 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 msgr2=0x559177c75300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e09074640 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c75300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e09074640 1 -- 10.20.193.4:0/1391606016 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177ca28b0 msgr2=0x559177c7a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e09074640 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177ca28b0 0x559177c7a830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e09074640 1 -- 10.20.193.4:0/1391606016 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559177ae6cd0 con 0x559177c5dc10 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e09074640 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c75840 secure :-1 s=READY pgs=1062 gs=1 cs=0 l=1 c_cookie=6841293121261336502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df8002700 tx=0x7f2df8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef127d8d91af7b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2dbf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/1391606016 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2df8023030 con 0x559177c5dc10 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/1391606016 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2df8011e50 con 0x559177c5dc10 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/1391606016 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2df801ee50 con 0x559177c5dc10 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1391606016 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e041766b0 con 0x559177c5dc10 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/1391606016 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2df8024070 con 0x559177c5dc10 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.578+0000 7f2dbf7fe640 10 client.17496 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e0dafae00 10 client.17496 _ll_register_callbacks cb 0x559177adf790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1391606016 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5591777f09d0 con 0x559177c5dc10 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/1391606016 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2df801e460 con 0x559177c5dc10 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e0dafae00 10 client.17496 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1391606016 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559177af8ab0 con 0x559177c5dc10 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/1391606016 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2df801e600 con 0x559177c5dc10 2026-02-24T09:17:17.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e0dafae00 10 client.17496 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e0dafae00 10 client.17496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e0dafae00 20 client.17496 populate_metadata read hostname 'trial004' 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559177c9fbe0 0x559177ca0080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e0dafae00 4 client.17496 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1391606016 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559177b73b70 con 0x559177c9fbe0 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e09875640 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559177c9fbe0 0x559177ca0080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2e09875640 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559177c9fbe0 0x559177ca0080 crc :-1 s=READY pgs=165 gs=4 cs=0 l=0 c_cookie=5979610759187778628 s_cookie=1809406655544845238 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52fbd84ddc7dcc44 server_cookie=191c4dc43dfa63b6 in_seq=0 out_seq=0 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.579+0000 7f2dbf7fe640 10 client.17496 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/1391606016 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559177b73b70 con 0x559177c9fbe0 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2dbf7fe640 10 client.17496 handle_command_reply: tid=0 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2e0dafae00 1 client.17496 shutdown 2026-02-24T09:17:17.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1391606016 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 msgr2=0x559177c75840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c75840 secure :-1 s=READY pgs=1062 gs=1 cs=0 l=1 c_cookie=6841293121261336502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df8002700 tx=0x7f2df8011810 comp rx=0 tx=0).stop 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1391606016 shutdown_connections 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559177c9fbe0 0x559177ca0080 crc :-1 s=READY pgs=165 gs=4 cs=0 l=0 c_cookie=5979610759187778628 s_cookie=1809406655544845238 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177ca28b0 0x559177c7a830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2dbf7fe640 0 client.17496 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c75840 unknown :-1 s=CLOSED pgs=1062 gs=1 cs=0 l=1 c_cookie=6841293121261336502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/1391606016 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c75300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1391606016 >> 10.20.193.4:0/1391606016 conn(0x559177b7b4f0 msgr2=0x559177c5c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.580+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1391606016 shutdown_connections 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.581+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1391606016 wait complete. 2026-02-24T09:17:17.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.581+0000 7f2e0dafae00 20 client.17496 trim_cache size 0 max 16384 2026-02-24T09:17:17.599 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0dafae00 1 Processor -- start 2026-02-24T09:17:17.599 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0dafae00 1 -- start start 2026-02-24T09:17:17.599 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c9ac60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.599 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c5dc10 0x559177c9b1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.599 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c9fbe0 0x559177c5b4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559177b60fe0 con 0x559177c9fbe0 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55917782bfe0 con 0x559177c5dc10 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559177c67610 con 0x559177c5d300 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0a076640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c9fbe0 0x559177c5b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0a076640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c9fbe0 0x559177c5b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60456/0 (socket says 10.20.193.4:60456) 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0a076640 1 -- 10.20.193.4:0/1239132253 learned_addr learned my addr 10.20.193.4:0/1239132253 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e09074640 1 --2- 10.20.193.4:0/1239132253 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c5dc10 0x559177c9b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e09875640 1 --2- 10.20.193.4:0/1239132253 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c9ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0a076640 1 -- 10.20.193.4:0/1239132253 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 msgr2=0x559177c9ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0a076640 1 --2- 10.20.193.4:0/1239132253 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c9ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0a076640 1 -- 10.20.193.4:0/1239132253 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c5dc10 msgr2=0x559177c9b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0a076640 1 --2- 10.20.193.4:0/1239132253 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c5dc10 0x559177c9b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0a076640 1 -- 10.20.193.4:0/1239132253 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559177af3530 con 0x559177c9fbe0 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2e0a076640 1 --2- 10.20.193.4:0/1239132253 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c9fbe0 0x559177c5b4e0 secure :-1 s=READY pgs=1063 gs=1 cs=0 l=1 c_cookie=11320314387185985064 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e0000a980 tx=0x7f2e0000a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d19d5f521f6e628 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2dd1ce5640 1 -- 10.20.193.4:0/1239132253 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e0003e040 con 0x559177c9fbe0 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2dd1ce5640 1 -- 10.20.193.4:0/1239132253 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2e00039470 con 0x559177c9fbe0 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.591+0000 7f2dd1ce5640 1 -- 10.20.193.4:0/1239132253 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e000052f0 con 0x559177c9fbe0 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1239132253 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c9fbe0 msgr2=0x559177c5b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/1239132253 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c9fbe0 0x559177c5b4e0 secure :-1 s=READY pgs=1063 gs=1 cs=0 l=1 c_cookie=11320314387185985064 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e0000a980 tx=0x7f2e0000a390 comp rx=0 tx=0).stop 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1239132253 shutdown_connections 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/1239132253 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c9fbe0 0x559177c5b4e0 unknown :-1 s=CLOSED pgs=1063 gs=1 cs=0 l=1 c_cookie=11320314387185985064 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/1239132253 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c5dc10 0x559177c9b1a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/1239132253 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c9ac60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1239132253 >> 10.20.193.4:0/1239132253 conn(0x559177b7b4f0 msgr2=0x559177c718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1239132253 shutdown_connections 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 -- 10.20.193.4:0/1239132253 wait complete. 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 -- start start 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 Processor -- start 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c7d120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c7d660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c9fbe0 0x559177d07dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559177c7dfb0 con 0x559177c5dc10 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559177d08310 con 0x559177c9fbe0 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e0dafae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559177d084d0 con 0x559177c5d300 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e09074640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c7d660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e09074640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c7d660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60462/0 (socket says 10.20.193.4:60462) 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e09074640 1 -- 10.20.193.4:0/3252830231 learned_addr learned my addr 10.20.193.4:0/3252830231 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e09875640 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c7d120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e09074640 1 -- 10.20.193.4:0/3252830231 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 msgr2=0x559177c7d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e09074640 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c7d120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e09074640 1 -- 10.20.193.4:0/3252830231 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c9fbe0 msgr2=0x559177d07dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.592+0000 7f2e09074640 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c9fbe0 0x559177d07dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e09074640 1 -- 10.20.193.4:0/3252830231 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559177ae7000 con 0x559177c5dc10 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e09074640 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c7d660 secure :-1 s=READY pgs=1064 gs=1 cs=0 l=1 c_cookie=4630676107234456189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df8028420 tx=0x7f2df80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404377629999327d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2dbf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/3252830231 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2df8023040 con 0x559177c5dc10 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 1 -- 10.20.193.4:0/3252830231 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559177b0e6e0 con 0x559177c5dc10 2026-02-24T09:17:17.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/3252830231 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5591777f09d0 con 0x559177c5dc10 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/3252830231 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2df8032600 con 0x559177c5dc10 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 10 client.17502 _ll_register_callbacks cb 0x559177adf790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 1 -- 10.20.193.4:0/3252830231 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559177b757e0 con 0x559177c5dc10 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/3252830231 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2df801e700 con 0x559177c5dc10 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/3252830231 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2df801ea40 con 0x559177c5dc10 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 10 client.17502 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 1 -- 10.20.193.4:0/3252830231 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559177af8d10 con 0x559177c5dc10 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/3252830231 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2df803c070 con 0x559177c5dc10 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 10 client.17502 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 10 client.17502 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 20 client.17502 populate_metadata read hostname 'trial004' 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559177ca28b0 0x559177d70490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 4 client.17502 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e0dafae00 1 -- 10.20.193.4:0/3252830231 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5591777ee220 con 0x559177ca28b0 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.593+0000 7f2e09875640 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559177ca28b0 0x559177d70490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e09875640 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559177ca28b0 0x559177d70490 crc :-1 s=READY pgs=166 gs=4 cs=0 l=0 c_cookie=5215486948236971789 s_cookie=10955721514200367416 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=486121bf2059cf0d server_cookie=980a8aabd8048138 in_seq=0 out_seq=0 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2dbf7fe640 10 client.17502 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2dbf7fe640 1 -- 10.20.193.4:0/3252830231 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5591777ee220 con 0x559177ca28b0 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2dbf7fe640 10 client.17502 handle_command_reply: tid=0 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e0dafae00 1 client.17502 shutdown 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e0dafae00 1 -- 10.20.193.4:0/3252830231 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 msgr2=0x559177c7d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c7d660 secure :-1 s=READY pgs=1064 gs=1 cs=0 l=1 c_cookie=4630676107234456189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df8028420 tx=0x7f2df80047e0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e0dafae00 1 -- 10.20.193.4:0/3252830231 shutdown_connections 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559177ca28b0 0x559177d70490 crc :-1 s=READY pgs=166 gs=4 cs=0 l=0 c_cookie=5215486948236971789 s_cookie=10955721514200367416 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559177c9fbe0 0x559177d07dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559177c5dc10 0x559177c7d660 unknown :-1 s=CLOSED pgs=1064 gs=1 cs=0 l=1 c_cookie=4630676107234456189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e0dafae00 1 --2- 10.20.193.4:0/3252830231 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559177c5d300 0x559177c7d120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2dbf7fe640 0 client.17502 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:17.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e0dafae00 1 -- 10.20.193.4:0/3252830231 >> 10.20.193.4:0/3252830231 conn(0x559177b7b4f0 msgr2=0x559177c720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.594+0000 7f2e0dafae00 1 -- 10.20.193.4:0/3252830231 shutdown_connections 2026-02-24T09:17:17.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0dafae00 1 -- 10.20.193.4:0/3252830231 wait complete. 2026-02-24T09:17:17.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0dafae00 20 client.17502 trim_cache size 0 max 16384 2026-02-24T09:17:17.606 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:17:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:17:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "771efb4b-4e74-4728-bdd5-b424e1f6ef1d", 2026-02-24T09:17:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:17:17.607 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:17:17.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 -- 10.20.193.4:0/240572069 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2de00b5760 msgr2=0x7f2de00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2de00b5760 0x7f2de00d5c10 secure :-1 s=READY pgs=403 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e041244e0 tx=0x7f2df8004420 comp rx=0 tx=0).stop 2026-02-24T09:17:17.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 -- 10.20.193.4:0/240572069 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e0410f280 msgr2=0x7f2e0411db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e0410f280 0x7f2e0411db40 secure :-1 s=READY pgs=1060 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df400d950 tx=0x7f2df400de20 comp rx=0 tx=0).stop 2026-02-24T09:17:17.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 -- 10.20.193.4:0/240572069 shutdown_connections 2026-02-24T09:17:17.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2de00b5760 0x7f2de00d5c10 unknown :-1 s=CLOSED pgs=403 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2e04115470 0x7f2e04123450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2e0410fc70 0x7f2e0411e080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 --2- 10.20.193.4:0/240572069 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2e0410f280 0x7f2e0411db40 unknown :-1 s=CLOSED pgs=1060 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 -- 10.20.193.4:0/240572069 >> 10.20.193.4:0/240572069 conn(0x7f2e0405f830 msgr2=0x7f2e0410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 -- 10.20.193.4:0/240572069 shutdown_connections 2026-02-24T09:17:17.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.595+0000 7f2e0bb00640 1 -- 10.20.193.4:0/240572069 wait complete. 2026-02-24T09:17:17.632 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:17:17.746 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:17.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 -- 10.20.193.4:0/3984094769 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6124110040 msgr2=0x7f6124115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 --2- 10.20.193.4:0/3984094769 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6124110040 0x7f6124115090 secure :-1 s=READY pgs=1065 gs=1 cs=0 l=1 c_cookie=15173983954953807452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6114009950 tx=0x7f611402f190 comp rx=0 tx=0).stop 2026-02-24T09:17:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 -- 10.20.193.4:0/3984094769 shutdown_connections 2026-02-24T09:17:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 --2- 10.20.193.4:0/3984094769 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6124115840 0x7f6124176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 --2- 10.20.193.4:0/3984094769 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6124110040 0x7f6124115090 unknown :-1 s=CLOSED pgs=1065 gs=1 cs=0 l=1 c_cookie=15173983954953807452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 --2- 10.20.193.4:0/3984094769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f612410f650 0x7f612410fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 -- 10.20.193.4:0/3984094769 >> 10.20.193.4:0/3984094769 conn(0x7f61240ecf20 msgr2=0x7f612410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 -- 10.20.193.4:0/3984094769 shutdown_connections 2026-02-24T09:17:17.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 -- 10.20.193.4:0/3984094769 wait complete. 2026-02-24T09:17:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 Processor -- start 2026-02-24T09:17:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 -- start start 2026-02-24T09:17:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f612410f650 0x7f61240f58e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6124110040 0x7f6124176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6124115840 0x7f61240f5fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f61240fb1f0 con 0x7f612410f650 2026-02-24T09:17:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f61240fb360 con 0x7f6124115840 2026-02-24T09:17:17.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6129d1f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f61240fb520 con 0x7f6124110040 2026-02-24T09:17:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f61237fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f612410f650 0x7f61240f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f61237fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f612410f650 0x7f61240f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60490/0 (socket says 10.20.193.4:60490) 2026-02-24T09:17:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f61237fe640 1 -- 10.20.193.4:0/636845346 learned_addr learned my addr 10.20.193.4:0/636845346 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6122ffd640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6124110040 0x7f6124176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f6123fff640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6124115840 0x7f61240f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f61237fe640 1 -- 10.20.193.4:0/636845346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6124110040 msgr2=0x7f6124176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f61237fe640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6124110040 0x7f6124176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.851+0000 7f61237fe640 1 -- 10.20.193.4:0/636845346 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6124115840 msgr2=0x7f61240f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.852+0000 7f61237fe640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6124115840 0x7f61240f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.852+0000 7f61237fe640 1 -- 10.20.193.4:0/636845346 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6114009570 con 0x7f612410f650 2026-02-24T09:17:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.852+0000 7f6122ffd640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6124110040 0x7f6124176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.852+0000 7f6123fff640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6124115840 0x7f61240f5fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.852+0000 7f61237fe640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f612410f650 0x7f61240f58e0 secure :-1 s=READY pgs=1066 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f611000c8c0 tx=0x7f611000cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.852+0000 7f6120ff9640 1 -- 10.20.193.4:0/636845346 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61100044a0 con 0x7f612410f650 2026-02-24T09:17:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.852+0000 7f6120ff9640 1 -- 10.20.193.4:0/636845346 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6110007c80 con 0x7f612410f650 2026-02-24T09:17:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.852+0000 7f6129d1f640 1 -- 10.20.193.4:0/636845346 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61240fb800 con 0x7f612410f650 2026-02-24T09:17:17.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.852+0000 7f6120ff9640 1 -- 10.20.193.4:0/636845346 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f611000f6d0 con 0x7f612410f650 2026-02-24T09:17:17.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.852+0000 7f6129d1f640 1 -- 10.20.193.4:0/636845346 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61240fbc80 con 0x7f612410f650 2026-02-24T09:17:17.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.853+0000 7f6120ff9640 1 -- 10.20.193.4:0/636845346 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f611000f8a0 con 0x7f612410f650 2026-02-24T09:17:17.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.854+0000 7f6120ff9640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f60f80b56e0 0x7f60f80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.854+0000 7f6120ff9640 1 -- 10.20.193.4:0/636845346 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f61100e6bf0 con 0x7f612410f650 2026-02-24T09:17:17.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.854+0000 7f6122ffd640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f60f80b56e0 0x7f60f80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.854+0000 7f6122ffd640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f60f80b56e0 0x7f60f80d5b90 secure :-1 s=READY pgs=404 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61140098a0 tx=0x7f6114031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.855+0000 7f612bd19e00 1 Processor -- start 2026-02-24T09:17:17.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f612bd19e00 1 -- start start 2026-02-24T09:17:17.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef36698820 0x55ef36698bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36699130 0x55ef366dd890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef366dddd0 0x55ef366fe1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f612bd19e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ef365a8de0 con 0x55ef36698820 2026-02-24T09:17:17.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f612bd19e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ef365a4b10 con 0x55ef36699130 2026-02-24T09:17:17.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f612bd19e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ef3659eab0 con 0x55ef366dddd0 2026-02-24T09:17:17.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f61237fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef36698820 0x55ef36698bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f61237fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef36698820 0x55ef36698bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60502/0 (socket says 10.20.193.4:60502) 2026-02-24T09:17:17.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f61237fe640 1 -- 10.20.193.4:0/3211307494 learned_addr learned my addr 10.20.193.4:0/3211307494 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:17.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f6123fff640 1 --2- 10.20.193.4:0/3211307494 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef366dddd0 0x55ef366fe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f6122ffd640 1 --2- 10.20.193.4:0/3211307494 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36699130 0x55ef366dd890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f61237fe640 1 -- 10.20.193.4:0/3211307494 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef366dddd0 msgr2=0x55ef366fe1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f61237fe640 1 --2- 10.20.193.4:0/3211307494 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef366dddd0 0x55ef366fe1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f61237fe640 1 -- 10.20.193.4:0/3211307494 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36699130 msgr2=0x55ef366dd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f61237fe640 1 --2- 10.20.193.4:0/3211307494 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36699130 0x55ef366dd890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f61237fe640 1 -- 10.20.193.4:0/3211307494 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef3654a310 con 0x55ef36698820 2026-02-24T09:17:17.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f61237fe640 1 --2- 10.20.193.4:0/3211307494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef36698820 0x55ef36698bf0 secure :-1 s=READY pgs=1067 gs=1 cs=0 l=1 c_cookie=4021623443591787378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61100e4780 tx=0x7f61100ad010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cfad36e7abf372 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f60e7fff640 1 -- 10.20.193.4:0/3211307494 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6110007df0 con 0x55ef36698820 2026-02-24T09:17:17.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f60e7fff640 1 -- 10.20.193.4:0/3211307494 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f61100ad960 con 0x55ef36698820 2026-02-24T09:17:17.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f60e7fff640 1 -- 10.20.193.4:0/3211307494 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6110073200 con 0x55ef36698820 2026-02-24T09:17:17.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f612bd19e00 1 -- 10.20.193.4:0/3211307494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef36698820 msgr2=0x55ef36698bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.856+0000 7f612bd19e00 1 --2- 10.20.193.4:0/3211307494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef36698820 0x55ef36698bf0 secure :-1 s=READY pgs=1067 gs=1 cs=0 l=1 c_cookie=4021623443591787378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61100e4780 tx=0x7f61100ad010 comp rx=0 tx=0).stop 2026-02-24T09:17:17.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.857+0000 7f612bd19e00 1 -- 10.20.193.4:0/3211307494 shutdown_connections 2026-02-24T09:17:17.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.857+0000 7f612bd19e00 1 --2- 10.20.193.4:0/3211307494 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef366dddd0 0x55ef366fe1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.857+0000 7f612bd19e00 1 --2- 10.20.193.4:0/3211307494 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36699130 0x55ef366dd890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.857+0000 7f612bd19e00 1 --2- 10.20.193.4:0/3211307494 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef36698820 0x55ef36698bf0 unknown :-1 s=CLOSED pgs=1067 gs=1 cs=0 l=1 c_cookie=4021623443591787378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.857+0000 7f612bd19e00 1 -- 10.20.193.4:0/3211307494 >> 10.20.193.4:0/3211307494 conn(0x55ef365b76b0 msgr2=0x55ef36697100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.857+0000 7f612bd19e00 1 -- 10.20.193.4:0/3211307494 shutdown_connections 2026-02-24T09:17:17.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.857+0000 7f612bd19e00 1 -- 10.20.193.4:0/3211307494 wait complete. 2026-02-24T09:17:17.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.857+0000 7f612bd19e00 1 -- start start 2026-02-24T09:17:17.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.857+0000 7f612bd19e00 1 Processor -- start 2026-02-24T09:17:17.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.857+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 0x55ef366b0e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36699130 0x55ef366b13d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b63c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ef366b6900 con 0x55ef366dddd0 2026-02-24T09:17:17.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ef366b6a70 con 0x55ef36698820 2026-02-24T09:17:17.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ef366b6c30 con 0x55ef36699130 2026-02-24T09:17:17.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f6123fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f6123fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60512/0 (socket says 10.20.193.4:60512) 2026-02-24T09:17:17.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f6123fff640 1 -- 10.20.193.4:0/4141008269 learned_addr learned my addr 10.20.193.4:0/4141008269 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:17.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f6122ffd640 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36699130 0x55ef366b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f61237fe640 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 0x55ef366b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f6123fff640 1 -- 10.20.193.4:0/4141008269 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36699130 msgr2=0x55ef366b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f6123fff640 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36699130 0x55ef366b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f6123fff640 1 -- 10.20.193.4:0/4141008269 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 msgr2=0x55ef366b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f6123fff640 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 0x55ef366b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f6123fff640 1 -- 10.20.193.4:0/4141008269 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef365228c0 con 0x55ef366dddd0 2026-02-24T09:17:17.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f61237fe640 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 0x55ef366b0e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:17.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f6123fff640 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b63c0 secure :-1 s=READY pgs=1068 gs=1 cs=0 l=1 c_cookie=15776019349478279315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118006a50 tx=0x7f6118010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daefae036f578893 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f60e57fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:17.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f60e57fa640 1 -- 10.20.193.4:0/4141008269 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f611800ed50 con 0x55ef366dddd0 2026-02-24T09:17:17.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f60e57fa640 1 -- 10.20.193.4:0/4141008269 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f61180055b0 con 0x55ef366dddd0 2026-02-24T09:17:17.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 1 -- 10.20.193.4:0/4141008269 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61240fbc80 con 0x55ef366dddd0 2026-02-24T09:17:17.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f60e57fa640 1 -- 10.20.193.4:0/4141008269 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f611801a6d0 con 0x55ef366dddd0 2026-02-24T09:17:17.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 10 client.17514 _ll_register_callbacks cb 0x55ef3653a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:17.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 1 -- 10.20.193.4:0/4141008269 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ef362ee4a0 con 0x55ef366dddd0 2026-02-24T09:17:17.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f60e57fa640 1 -- 10.20.193.4:0/4141008269 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6118011430 con 0x55ef366dddd0 2026-02-24T09:17:17.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f60e57fa640 1 -- 10.20.193.4:0/4141008269 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f61180115f0 con 0x55ef366dddd0 2026-02-24T09:17:17.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 10 client.17514 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:17.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 1 -- 10.20.193.4:0/4141008269 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55ef365346e0 con 0x55ef366dddd0 2026-02-24T09:17:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f60e57fa640 1 -- 10.20.193.4:0/4141008269 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f61180050d0 con 0x55ef366dddd0 2026-02-24T09:17:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 10 client.17514 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 10 client.17514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 20 client.17514 populate_metadata read hostname 'trial004' 2026-02-24T09:17:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ef366db730 0x55ef366dbbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 4 client.17514 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.858+0000 7f612bd19e00 1 -- 10.20.193.4:0/4141008269 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef365944f0 con 0x55ef366db730 2026-02-24T09:17:17.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f61237fe640 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ef366db730 0x55ef366dbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f61237fe640 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ef366db730 0x55ef366dbbd0 crc :-1 s=READY pgs=167 gs=4 cs=0 l=0 c_cookie=15321048720205085364 s_cookie=2050278200579746134 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d49f4ca2fa46fab4 server_cookie=1c740d291c486956 in_seq=0 out_seq=0 2026-02-24T09:17:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f60e57fa640 10 client.17514 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f60e57fa640 1 -- 10.20.193.4:0/4141008269 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ef365944f0 con 0x55ef366db730 2026-02-24T09:17:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f60e57fa640 10 client.17514 handle_command_reply: tid=0 2026-02-24T09:17:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 client.17514 shutdown 2026-02-24T09:17:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 -- 10.20.193.4:0/4141008269 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 msgr2=0x55ef366b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b63c0 secure :-1 s=READY pgs=1068 gs=1 cs=0 l=1 c_cookie=15776019349478279315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118006a50 tx=0x7f6118010ed0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 -- 10.20.193.4:0/4141008269 shutdown_connections 2026-02-24T09:17:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ef366db730 0x55ef366dbbd0 crc :-1 s=READY pgs=167 gs=4 cs=0 l=0 c_cookie=15321048720205085364 s_cookie=2050278200579746134 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b63c0 unknown :-1 s=CLOSED pgs=1068 gs=1 cs=0 l=1 c_cookie=15776019349478279315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36699130 0x55ef366b13d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 --2- 10.20.193.4:0/4141008269 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 0x55ef366b0e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f60e57fa640 0 client.17514 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 -- 10.20.193.4:0/4141008269 >> 10.20.193.4:0/4141008269 conn(0x55ef365b76b0 msgr2=0x55ef36697810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 -- 10.20.193.4:0/4141008269 shutdown_connections 2026-02-24T09:17:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 1 -- 10.20.193.4:0/4141008269 wait complete. 2026-02-24T09:17:17.881 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.859+0000 7f612bd19e00 20 client.17514 trim_cache size 0 max 16384 2026-02-24T09:17:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f612bd19e00 1 Processor -- start 2026-02-24T09:17:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f612bd19e00 1 -- start start 2026-02-24T09:17:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36698820 0x55ef366d68a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36699130 0x55ef366d6de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366dc290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f612bd19e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ef3659c6e0 con 0x55ef366dddd0 2026-02-24T09:17:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f612bd19e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ef36267f50 con 0x55ef36699130 2026-02-24T09:17:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f612bd19e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ef3660b150 con 0x55ef36698820 2026-02-24T09:17:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f6123fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366dc290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f6123fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366dc290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60518/0 (socket says 10.20.193.4:60518) 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f6123fff640 1 -- 10.20.193.4:0/3402838913 learned_addr learned my addr 10.20.193.4:0/3402838913 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f6123fff640 1 -- 10.20.193.4:0/3402838913 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36698820 msgr2=0x55ef366d68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f6123fff640 1 --2- 10.20.193.4:0/3402838913 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36698820 0x55ef366d68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f6123fff640 1 -- 10.20.193.4:0/3402838913 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36699130 msgr2=0x55ef366d6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f6123fff640 1 --2- 10.20.193.4:0/3402838913 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36699130 0x55ef366d6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f6123fff640 1 -- 10.20.193.4:0/3402838913 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef366a3390 con 0x55ef366dddd0 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f6123fff640 1 --2- 10.20.193.4:0/3402838913 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366dc290 secure :-1 s=READY pgs=1069 gs=1 cs=0 l=1 c_cookie=1699646135697419113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118022440 tx=0x7f611801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17965b27c21c2b69 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.868+0000 7f60e77fe640 1 -- 10.20.193.4:0/3402838913 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6118003ea0 con 0x55ef366dddd0 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f60e77fe640 1 -- 10.20.193.4:0/3402838913 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55ef362ee4a0 con 0x55ef366dddd0 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f60e77fe640 1 -- 10.20.193.4:0/3402838913 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f611800c390 con 0x55ef366dddd0 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 -- 10.20.193.4:0/3402838913 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 msgr2=0x55ef366dc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 --2- 10.20.193.4:0/3402838913 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366dc290 secure :-1 s=READY pgs=1069 gs=1 cs=0 l=1 c_cookie=1699646135697419113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118022440 tx=0x7f611801e000 comp rx=0 tx=0).stop 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 -- 10.20.193.4:0/3402838913 shutdown_connections 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 --2- 10.20.193.4:0/3402838913 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366dc290 unknown :-1 s=CLOSED pgs=1069 gs=1 cs=0 l=1 c_cookie=1699646135697419113 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 --2- 10.20.193.4:0/3402838913 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36699130 0x55ef366d6de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 --2- 10.20.193.4:0/3402838913 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36698820 0x55ef366d68a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 -- 10.20.193.4:0/3402838913 >> 10.20.193.4:0/3402838913 conn(0x55ef365b76b0 msgr2=0x55ef36696a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 -- 10.20.193.4:0/3402838913 shutdown_connections 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 -- 10.20.193.4:0/3402838913 wait complete. 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 -- start start 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.869+0000 7f612bd19e00 1 Processor -- start 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 0x55ef366bce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36699130 0x55ef366b9350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b9890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ef366bd590 con 0x55ef366dddd0 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ef366b9dd0 con 0x55ef36698820 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ef366b9f90 con 0x55ef36699130 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f6123fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f6123fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b9890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60524/0 (socket says 10.20.193.4:60524) 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f6123fff640 1 -- 10.20.193.4:0/1935058449 learned_addr learned my addr 10.20.193.4:0/1935058449 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f6122ffd640 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36699130 0x55ef366b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f6123fff640 1 -- 10.20.193.4:0/1935058449 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36699130 msgr2=0x55ef366b9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f6123fff640 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36699130 0x55ef366b9350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f6123fff640 1 -- 10.20.193.4:0/1935058449 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 msgr2=0x55ef366bce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f61237fe640 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 0x55ef366bce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f6123fff640 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 0x55ef366bce10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f6123fff640 1 -- 10.20.193.4:0/1935058449 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef3652f160 con 0x55ef366dddd0 2026-02-24T09:17:17.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f61237fe640 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 0x55ef366bce10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f6123fff640 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b9890 secure :-1 s=READY pgs=1070 gs=1 cs=0 l=1 c_cookie=2783392536634908142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118005230 tx=0x7f6118005290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a098c3d898ddee server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f60e57fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f60e57fa640 1 -- 10.20.193.4:0/1935058449 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6118003ea0 con 0x55ef366dddd0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f60e57fa640 1 -- 10.20.193.4:0/1935058449 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f611800c520 con 0x55ef366dddd0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f60e57fa640 1 -- 10.20.193.4:0/1935058449 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f611801aab0 con 0x55ef366dddd0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 1 -- 10.20.193.4:0/1935058449 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef365346e0 con 0x55ef366dddd0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f60e57fa640 1 -- 10.20.193.4:0/1935058449 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6118003c80 con 0x55ef366dddd0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f60e57fa640 10 client.17520 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 10 client.17520 _ll_register_callbacks cb 0x55ef3653a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 1 -- 10.20.193.4:0/1935058449 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61100ad960 con 0x55ef366dddd0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f60e57fa640 1 -- 10.20.193.4:0/1935058449 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6118003af0 con 0x55ef366dddd0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 10 client.17520 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.870+0000 7f612bd19e00 1 -- 10.20.193.4:0/1935058449 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55ef36522bf0 con 0x55ef366dddd0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f60e57fa640 1 -- 10.20.193.4:0/1935058449 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6118032070 con 0x55ef366dddd0 2026-02-24T09:17:17.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 10 client.17520 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 10 client.17520 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 20 client.17520 populate_metadata read hostname 'trial004' 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ef3678ba30 0x55ef367abee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 4 client.17520 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 -- 10.20.193.4:0/1935058449 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ef362d3160 con 0x55ef3678ba30 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f61237fe640 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ef3678ba30 0x55ef367abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f61237fe640 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ef3678ba30 0x55ef367abee0 crc :-1 s=READY pgs=168 gs=4 cs=0 l=0 c_cookie=17242434411742954625 s_cookie=3385633416887742569 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef496ebe3ee90481 server_cookie=2efc2fa7a1493069 in_seq=0 out_seq=0 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f60e57fa640 10 client.17520 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f60e57fa640 1 -- 10.20.193.4:0/1935058449 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x55ef362d3160 con 0x55ef3678ba30 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f60e57fa640 10 client.17520 handle_command_reply: tid=0 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 client.17520 shutdown 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 -- 10.20.193.4:0/1935058449 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 msgr2=0x55ef366b9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b9890 secure :-1 s=READY pgs=1070 gs=1 cs=0 l=1 c_cookie=2783392536634908142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6118005230 tx=0x7f6118005290 comp rx=0 tx=0).stop 2026-02-24T09:17:17.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 -- 10.20.193.4:0/1935058449 shutdown_connections 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ef3678ba30 0x55ef367abee0 crc :-1 s=READY pgs=168 gs=4 cs=0 l=0 c_cookie=17242434411742954625 s_cookie=3385633416887742569 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ef366dddd0 0x55ef366b9890 unknown :-1 s=CLOSED pgs=1070 gs=1 cs=0 l=1 c_cookie=2783392536634908142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ef36699130 0x55ef366b9350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f60e57fa640 0 client.17520 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 --2- 10.20.193.4:0/1935058449 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ef36698820 0x55ef366bce10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 -- 10.20.193.4:0/1935058449 >> 10.20.193.4:0/1935058449 conn(0x55ef365b76b0 msgr2=0x55ef366971f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 -- 10.20.193.4:0/1935058449 shutdown_connections 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 1 -- 10.20.193.4:0/1935058449 wait complete. 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.871+0000 7f612bd19e00 20 client.17520 trim_cache size 0 max 16384 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:17:17.894 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "771efb4b-4e74-4728-bdd5-b424e1f6ef1d", 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.895 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.896 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.897 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.898 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.899 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.900 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.901 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:17:17.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 -- 10.20.193.4:0/636845346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f60f80b56e0 msgr2=0x7f60f80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f60f80b56e0 0x7f60f80d5b90 secure :-1 s=READY pgs=404 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61140098a0 tx=0x7f6114031040 comp rx=0 tx=0).stop 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 -- 10.20.193.4:0/636845346 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f612410f650 msgr2=0x7f61240f58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f612410f650 0x7f61240f58e0 secure :-1 s=READY pgs=1066 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f611000c8c0 tx=0x7f611000cd90 comp rx=0 tx=0).stop 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 -- 10.20.193.4:0/636845346 shutdown_connections 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f60f80b56e0 0x7f60f80d5b90 unknown :-1 s=CLOSED pgs=404 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6124115840 0x7f61240f5fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6124110040 0x7f6124176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 --2- 10.20.193.4:0/636845346 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f612410f650 0x7f61240f58e0 unknown :-1 s=CLOSED pgs=1066 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 -- 10.20.193.4:0/636845346 >> 10.20.193.4:0/636845346 conn(0x7f61240ecf20 msgr2=0x7f6124111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 -- 10.20.193.4:0/636845346 shutdown_connections 2026-02-24T09:17:17.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:17.872+0000 7f6129d1f640 1 -- 10.20.193.4:0/636845346 wait complete. 2026-02-24T09:17:17.905 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:17.909 INFO:tasks.cephfs.filesystem:scrub status for tag:771efb4b-4e74-4728-bdd5-b424e1f6ef1d - {'path': '/', 'tag': '771efb4b-4e74-4728-bdd5-b424e1f6ef1d', 'options': 'recursive,force'} 2026-02-24T09:17:18.020 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:18.134 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:17 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:17:18.134 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:17 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:18.134 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:17 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:17:18.134 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:17 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:18.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 -- 10.20.193.4:0/2253626908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f80a010fc70 msgr2=0x7f80a0114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 --2- 10.20.193.4:0/2253626908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f80a010fc70 0x7f80a0114cc0 secure :-1 s=READY pgs=1071 gs=1 cs=0 l=1 c_cookie=655022483547483107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8088009950 tx=0x7f808802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 -- 10.20.193.4:0/2253626908 shutdown_connections 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 --2- 10.20.193.4:0/2253626908 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f80a0115470 0x7f80a0175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 --2- 10.20.193.4:0/2253626908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f80a010fc70 0x7f80a0114cc0 unknown :-1 s=CLOSED pgs=1071 gs=1 cs=0 l=1 c_cookie=655022483547483107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 --2- 10.20.193.4:0/2253626908 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80a010f280 0x7f80a010f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 -- 10.20.193.4:0/2253626908 >> 10.20.193.4:0/2253626908 conn(0x7f80a005f830 msgr2=0x7f80a010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 -- 10.20.193.4:0/2253626908 shutdown_connections 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 -- 10.20.193.4:0/2253626908 wait complete. 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 Processor -- start 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 -- start start 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f80a010f280 0x7f80a00f5540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f80a010fc70 0x7f80a0175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80a0115470 0x7f80a00f5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f80a00fae50 con 0x7f80a010f280 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f80a00fafc0 con 0x7f80a010fc70 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f80a4ad5640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80a00fb180 con 0x7f80a0115470 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f80a010f280 0x7f80a00f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f80a010f280 0x7f80a00f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60548/0 (socket says 10.20.193.4:60548) 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809e575640 1 -- 10.20.193.4:0/1018224044 learned_addr learned my addr 10.20.193.4:0/1018224044 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809dd74640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f80a010fc70 0x7f80a0175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809e575640 1 -- 10.20.193.4:0/1018224044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80a0115470 msgr2=0x7f80a00f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809ed76640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80a0115470 0x7f80a00f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809e575640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80a0115470 0x7f80a00f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809e575640 1 -- 10.20.193.4:0/1018224044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f80a010fc70 msgr2=0x7f80a0175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809e575640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f80a010fc70 0x7f80a0175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809e575640 1 -- 10.20.193.4:0/1018224044 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8088009570 con 0x7f80a010f280 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.187+0000 7f809ed76640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80a0115470 0x7f80a00f5c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.188+0000 7f809e575640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f80a010f280 0x7f80a00f5540 secure :-1 s=READY pgs=1072 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f809400d950 tx=0x7f809400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.188+0000 7f80877fe640 1 -- 10.20.193.4:0/1018224044 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8094004540 con 0x7f80a010f280 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.188+0000 7f80877fe640 1 -- 10.20.193.4:0/1018224044 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8094009d00 con 0x7f80a010f280 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.188+0000 7f80a4ad5640 1 -- 10.20.193.4:0/1018224044 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a00fb460 con 0x7f80a010f280 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.188+0000 7f80877fe640 1 -- 10.20.193.4:0/1018224044 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80940106e0 con 0x7f80a010f280 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.188+0000 7f80a4ad5640 1 -- 10.20.193.4:0/1018224044 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a00fb930 con 0x7f80a010f280 2026-02-24T09:17:18.192 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.188+0000 7f80a4ad5640 1 -- 10.20.193.4:0/1018224044 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a0110560 con 0x7f80a010f280 2026-02-24T09:17:18.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.189+0000 7f80877fe640 1 -- 10.20.193.4:0/1018224044 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f80940097c0 con 0x7f80a010f280 2026-02-24T09:17:18.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.190+0000 7f80877fe640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80780b56d0 0x7f80780d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.190+0000 7f809dd74640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80780b56d0 0x7f80780d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.190+0000 7f80877fe640 1 -- 10.20.193.4:0/1018224044 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f80940e72e0 con 0x7f80a010f280 2026-02-24T09:17:18.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.190+0000 7f809dd74640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80780b56d0 0x7f80780d5b80 secure :-1 s=READY pgs=405 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80880023d0 tx=0x7f8088031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.193 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.191+0000 7f80877fe640 1 -- 10.20.193.4:0/1018224044 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f80940a9ca0 con 0x7f80a010f280 2026-02-24T09:17:18.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.323+0000 7f80a4ad5640 1 -- 10.20.193.4:0/1018224044 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80a010f650 con 0x7f80a010f280 2026-02-24T09:17:18.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.324+0000 7f80877fe640 1 -- 10.20.193.4:0/1018224044 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f80940ace50 con 0x7f80a010f280 2026-02-24T09:17:18.327 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:17:18.327 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:17:18.328 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:17:18.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.324+0000 7f80a4ad5640 1 -- 10.20.193.4:0/1018224044 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80780b56d0 msgr2=0x7f80780d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.324+0000 7f80a4ad5640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80780b56d0 0x7f80780d5b80 secure :-1 s=READY pgs=405 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80880023d0 tx=0x7f8088031040 comp rx=0 tx=0).stop 2026-02-24T09:17:18.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.324+0000 7f80a4ad5640 1 -- 10.20.193.4:0/1018224044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f80a010f280 msgr2=0x7f80a00f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.324+0000 7f80a4ad5640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f80a010f280 0x7f80a00f5540 secure :-1 s=READY pgs=1072 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f809400d950 tx=0x7f809400de20 comp rx=0 tx=0).stop 2026-02-24T09:17:18.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.325+0000 7f80a4ad5640 1 -- 10.20.193.4:0/1018224044 shutdown_connections 2026-02-24T09:17:18.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.325+0000 7f80a4ad5640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80780b56d0 0x7f80780d5b80 unknown :-1 s=CLOSED pgs=405 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.325+0000 7f80a4ad5640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80a0115470 0x7f80a00f5c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.325+0000 7f80a4ad5640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f80a010fc70 0x7f80a0175d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.325+0000 7f80a4ad5640 1 --2- 10.20.193.4:0/1018224044 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f80a010f280 0x7f80a00f5540 unknown :-1 s=CLOSED pgs=1072 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.325+0000 7f80a4ad5640 1 -- 10.20.193.4:0/1018224044 >> 10.20.193.4:0/1018224044 conn(0x7f80a005f830 msgr2=0x7f80a0111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.325+0000 7f80a4ad5640 1 -- 10.20.193.4:0/1018224044 shutdown_connections 2026-02-24T09:17:18.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.325+0000 7f80a4ad5640 1 -- 10.20.193.4:0/1018224044 wait complete. 2026-02-24T09:17:18.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:17 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:17:18.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:17 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:18.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:17 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:17:18.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:17 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:18.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:17 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:17:18.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:17 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:18.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:17 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:17:18.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:17 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:18.363 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id bf7150b9 --release --await' 2026-02-24T09:17:18.363 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id bf7150b9 --release --await 2026-02-24T09:17:18.479 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:18.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.588+0000 7fb4440b0640 1 -- 10.20.193.4:0/695845574 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb43c10fc70 msgr2=0x7fb43c114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.588+0000 7fb4440b0640 1 --2- 10.20.193.4:0/695845574 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb43c10fc70 0x7fb43c114cc0 secure :-1 s=READY pgs=1073 gs=1 cs=0 l=1 c_cookie=16942880161950773401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb430009950 tx=0x7fb43002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.588+0000 7fb4440b0640 1 -- 10.20.193.4:0/695845574 shutdown_connections 2026-02-24T09:17:18.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.588+0000 7fb4440b0640 1 --2- 10.20.193.4:0/695845574 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb43c115470 0x7fb43c175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.588+0000 7fb4440b0640 1 --2- 10.20.193.4:0/695845574 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb43c10fc70 0x7fb43c114cc0 unknown :-1 s=CLOSED pgs=1073 gs=1 cs=0 l=1 c_cookie=16942880161950773401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.588+0000 7fb4440b0640 1 --2- 10.20.193.4:0/695845574 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb43c10f280 0x7fb43c10f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.588+0000 7fb4440b0640 1 -- 10.20.193.4:0/695845574 >> 10.20.193.4:0/695845574 conn(0x7fb43c05f830 msgr2=0x7fb43c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.588+0000 7fb4440b0640 1 -- 10.20.193.4:0/695845574 shutdown_connections 2026-02-24T09:17:18.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.588+0000 7fb4440b0640 1 -- 10.20.193.4:0/695845574 wait complete. 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb4440b0640 1 Processor -- start 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb4440b0640 1 -- start start 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb4440b0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb43c10f280 0x7fb43c0f5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb4440b0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb43c10fc70 0x7fb43c175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb4440b0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb43c115470 0x7fb43c0f5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb4440b0640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0fae90 con 0x7fb43c10f280 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb4440b0640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0fb000 con 0x7fb43c10fc70 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb4440b0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0fb1c0 con 0x7fb43c115470 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441e25640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb43c10f280 0x7fb43c0f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441e25640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb43c10f280 0x7fb43c0f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60558/0 (socket says 10.20.193.4:60558) 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441e25640 1 -- 10.20.193.4:0/1302719207 learned_addr learned my addr 10.20.193.4:0/1302719207 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441624640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb43c10fc70 0x7fb43c175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441e25640 1 -- 10.20.193.4:0/1302719207 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb43c115470 msgr2=0x7fb43c0f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441e25640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb43c115470 0x7fb43c0f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441e25640 1 -- 10.20.193.4:0/1302719207 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb43c10fc70 msgr2=0x7fb43c175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441e25640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb43c10fc70 0x7fb43c175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441e25640 1 -- 10.20.193.4:0/1302719207 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb430009570 con 0x7fb43c10f280 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441624640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb43c10fc70 0x7fb43c175d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb441e25640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb43c10f280 0x7fb43c0f5580 secure :-1 s=READY pgs=1074 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb42c009480 tx=0x7fb42c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb42affd640 1 -- 10.20.193.4:0/1302719207 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb42c00cd40 con 0x7fb43c10f280 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb42affd640 1 -- 10.20.193.4:0/1302719207 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb42c004d30 con 0x7fb43c10f280 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb42affd640 1 -- 10.20.193.4:0/1302719207 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb42c010740 con 0x7fb43c10f280 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.589+0000 7fb4440b0640 1 -- 10.20.193.4:0/1302719207 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c0fb4a0 con 0x7fb43c10f280 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.590+0000 7fb4440b0640 1 -- 10.20.193.4:0/1302719207 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c0fb920 con 0x7fb43c10f280 2026-02-24T09:17:18.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.591+0000 7fb42affd640 1 -- 10.20.193.4:0/1302719207 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fb42c01f060 con 0x7fb43c10f280 2026-02-24T09:17:18.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.592+0000 7fb42affd640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4180b56d0 0x7fb4180d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.592+0000 7fb441624640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4180b56d0 0x7fb4180d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.592+0000 7fb42affd640 1 -- 10.20.193.4:0/1302719207 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb42c014070 con 0x7fb43c10f280 2026-02-24T09:17:18.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.592+0000 7fb441624640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4180b56d0 0x7fb4180d5b80 secure :-1 s=READY pgs=406 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4300098a0 tx=0x7fb430031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb4460aae00 1 Processor -- start 2026-02-24T09:17:18.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb4460aae00 1 -- start start 2026-02-24T09:17:18.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c8fb0 0x564df61c9380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c98c0 0x564df620e020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df620e560 0x564df622e940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb4460aae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564df60da050 con 0x564df61c8fb0 2026-02-24T09:17:18.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb4460aae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564df60d5d80 con 0x564df61c98c0 2026-02-24T09:17:18.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb4460aae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564df60cfee0 con 0x564df620e560 2026-02-24T09:17:18.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb441e25640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c8fb0 0x564df61c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb441e25640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c8fb0 0x564df61c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60564/0 (socket says 10.20.193.4:60564) 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb441e25640 1 -- 10.20.193.4:0/3736872162 learned_addr learned my addr 10.20.193.4:0/3736872162 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb442626640 1 --2- 10.20.193.4:0/3736872162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df620e560 0x564df622e940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.593+0000 7fb441624640 1 --2- 10.20.193.4:0/3736872162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c98c0 0x564df620e020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb441e25640 1 -- 10.20.193.4:0/3736872162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df620e560 msgr2=0x564df622e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb441e25640 1 --2- 10.20.193.4:0/3736872162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df620e560 0x564df622e940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb441e25640 1 -- 10.20.193.4:0/3736872162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c98c0 msgr2=0x564df620e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb441e25640 1 --2- 10.20.193.4:0/3736872162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c98c0 0x564df620e020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb441e25640 1 -- 10.20.193.4:0/3736872162 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df607b540 con 0x564df61c8fb0 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb441e25640 1 --2- 10.20.193.4:0/3736872162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c8fb0 0x564df61c9380 secure :-1 s=READY pgs=1075 gs=1 cs=0 l=1 c_cookie=98905474144475737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb42c0058d0 tx=0x7fb42c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f620134b91a59 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb40a4e6640 1 -- 10.20.193.4:0/3736872162 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb42c0adb30 con 0x564df61c8fb0 2026-02-24T09:17:18.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb40a4e6640 1 -- 10.20.193.4:0/3736872162 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb42c0152d0 con 0x564df61c8fb0 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb40a4e6640 1 -- 10.20.193.4:0/3736872162 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb42c005260 con 0x564df61c8fb0 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb4460aae00 1 -- 10.20.193.4:0/3736872162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c8fb0 msgr2=0x564df61c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb4460aae00 1 --2- 10.20.193.4:0/3736872162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c8fb0 0x564df61c9380 secure :-1 s=READY pgs=1075 gs=1 cs=0 l=1 c_cookie=98905474144475737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb42c0058d0 tx=0x7fb42c00cf50 comp rx=0 tx=0).stop 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb4460aae00 1 -- 10.20.193.4:0/3736872162 shutdown_connections 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb4460aae00 1 --2- 10.20.193.4:0/3736872162 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df620e560 0x564df622e940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb4460aae00 1 --2- 10.20.193.4:0/3736872162 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c98c0 0x564df620e020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb4460aae00 1 --2- 10.20.193.4:0/3736872162 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c8fb0 0x564df61c9380 unknown :-1 s=CLOSED pgs=1075 gs=1 cs=0 l=1 c_cookie=98905474144475737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb4460aae00 1 -- 10.20.193.4:0/3736872162 >> 10.20.193.4:0/3736872162 conn(0x564df61a74b0 msgr2=0x564df61c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb4460aae00 1 -- 10.20.193.4:0/3736872162 shutdown_connections 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.594+0000 7fb4460aae00 1 -- 10.20.193.4:0/3736872162 wait complete. 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.595+0000 7fb4460aae00 1 -- start start 2026-02-24T09:17:18.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.595+0000 7fb4460aae00 1 Processor -- start 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.595+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c8fb0 0x564df6225d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.595+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 0x564df62262a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.595+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df622b290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.595+0000 7fb4460aae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564df622b7d0 con 0x564df620e560 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.595+0000 7fb4460aae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564df622b940 con 0x564df61c8fb0 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.595+0000 7fb4460aae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564df622bb00 con 0x564df61c98c0 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb442626640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df622b290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb442626640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df622b290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60568/0 (socket says 10.20.193.4:60568) 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb442626640 1 -- 10.20.193.4:0/3656830580 learned_addr learned my addr 10.20.193.4:0/3656830580 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb441e25640 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c8fb0 0x564df6225d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb441624640 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 0x564df62262a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb442626640 1 -- 10.20.193.4:0/3656830580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 msgr2=0x564df62262a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb442626640 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 0x564df62262a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb442626640 1 -- 10.20.193.4:0/3656830580 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c8fb0 msgr2=0x564df6225d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb442626640 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c8fb0 0x564df6225d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb442626640 1 -- 10.20.193.4:0/3656830580 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df6053bd0 con 0x564df620e560 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb441624640 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 0x564df62262a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb442626640 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df622b290 secure :-1 s=READY pgs=1076 gs=1 cs=0 l=1 c_cookie=8794172130284430565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb438008e40 tx=0x7fb4380117a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0b2cf57f3e64e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb3f77fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb3f77fe640 1 -- 10.20.193.4:0/3656830580 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb438005500 con 0x564df620e560 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 1 -- 10.20.193.4:0/3656830580 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c0fb920 con 0x564df620e560 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb3f77fe640 1 -- 10.20.193.4:0/3656830580 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb438003c60 con 0x564df620e560 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb3f77fe640 1 -- 10.20.193.4:0/3656830580 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb438012ce0 con 0x564df620e560 2026-02-24T09:17:18.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb3f77fe640 1 -- 10.20.193.4:0/3656830580 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb43801a3d0 con 0x564df620e560 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb3f77fe640 10 client.17538 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 10 client.17538 _ll_register_callbacks cb 0x564df60be290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 1 -- 10.20.193.4:0/3656830580 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564df5e1f700 con 0x564df620e560 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb3f77fe640 1 -- 10.20.193.4:0/3656830580 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb438012e70 con 0x564df620e560 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 10 client.17538 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 1 -- 10.20.193.4:0/3656830580 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564df6065910 con 0x564df620e560 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb3f77fe640 1 -- 10.20.193.4:0/3656830580 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb438003780 con 0x564df620e560 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 10 client.17538 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 10 client.17538 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 20 client.17538 populate_metadata read hostname 'trial004' 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564df620b730 0x564df620bba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 4 client.17538 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.596+0000 7fb4460aae00 1 -- 10.20.193.4:0/3656830580 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564df60c5920 con 0x564df620b730 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.597+0000 7fb441e25640 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564df620b730 0x564df620bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb3f77fe640 10 client.17538 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb441e25640 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564df620b730 0x564df620bba0 crc :-1 s=READY pgs=169 gs=4 cs=0 l=0 c_cookie=16127134045759947621 s_cookie=2935691170663052891 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfcf16f82aa14365 server_cookie=28bdab90d59f365b in_seq=0 out_seq=0 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb3f77fe640 1 -- 10.20.193.4:0/3656830580 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564df60c5920 con 0x564df620b730 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb3f77fe640 10 client.17538 handle_command_reply: tid=0 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 client.17538 shutdown 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 -- 10.20.193.4:0/3656830580 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 msgr2=0x564df622b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df622b290 secure :-1 s=READY pgs=1076 gs=1 cs=0 l=1 c_cookie=8794172130284430565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb438008e40 tx=0x7fb4380117a0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 -- 10.20.193.4:0/3656830580 shutdown_connections 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564df620b730 0x564df620bba0 crc :-1 s=READY pgs=169 gs=4 cs=0 l=0 c_cookie=16127134045759947621 s_cookie=2935691170663052891 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df622b290 unknown :-1 s=CLOSED pgs=1076 gs=1 cs=0 l=1 c_cookie=8794172130284430565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 0x564df62262a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb3f77fe640 0 client.17538 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:18.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 --2- 10.20.193.4:0/3656830580 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c8fb0 0x564df6225d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 -- 10.20.193.4:0/3656830580 >> 10.20.193.4:0/3656830580 conn(0x564df61a74b0 msgr2=0x564df61c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 -- 10.20.193.4:0/3656830580 shutdown_connections 2026-02-24T09:17:18.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 1 -- 10.20.193.4:0/3656830580 wait complete. 2026-02-24T09:17:18.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.598+0000 7fb4460aae00 20 client.17538 trim_cache size 0 max 16384 2026-02-24T09:17:18.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.607+0000 7fb4460aae00 1 Processor -- start 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.607+0000 7fb4460aae00 1 -- start start 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.607+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c8fb0 0x564df6223040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.607+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 0x564df6223580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.607+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df62091a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.607+0000 7fb4460aae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564df60cdb10 con 0x564df620e560 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564df5d991b0 con 0x564df61c8fb0 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564df61c9dd0 con 0x564df61c98c0 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb442626640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df62091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb442626640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df62091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60570/0 (socket says 10.20.193.4:60570) 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb442626640 1 -- 10.20.193.4:0/413688587 learned_addr learned my addr 10.20.193.4:0/413688587 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb441e25640 1 --2- 10.20.193.4:0/413688587 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c8fb0 0x564df6223040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb441624640 1 --2- 10.20.193.4:0/413688587 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 0x564df6223580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb442626640 1 -- 10.20.193.4:0/413688587 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 msgr2=0x564df6223580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb442626640 1 --2- 10.20.193.4:0/413688587 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 0x564df6223580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb442626640 1 -- 10.20.193.4:0/413688587 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c8fb0 msgr2=0x564df6223040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb442626640 1 --2- 10.20.193.4:0/413688587 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c8fb0 0x564df6223040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb442626640 1 -- 10.20.193.4:0/413688587 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df6060390 con 0x564df620e560 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb442626640 1 --2- 10.20.193.4:0/413688587 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df62091a0 secure :-1 s=READY pgs=1077 gs=1 cs=0 l=1 c_cookie=10978994996673672101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb438008670 tx=0x7fb438014030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985d39c7bf8673a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb409ce5640 1 -- 10.20.193.4:0/413688587 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb438012e70 con 0x564df620e560 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb409ce5640 1 -- 10.20.193.4:0/413688587 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x564df5e1f700 con 0x564df620e560 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb409ce5640 1 -- 10.20.193.4:0/413688587 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4380235f0 con 0x564df620e560 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 -- 10.20.193.4:0/413688587 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 msgr2=0x564df62091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 --2- 10.20.193.4:0/413688587 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df62091a0 secure :-1 s=READY pgs=1077 gs=1 cs=0 l=1 c_cookie=10978994996673672101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb438008670 tx=0x7fb438014030 comp rx=0 tx=0).stop 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 -- 10.20.193.4:0/413688587 shutdown_connections 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 --2- 10.20.193.4:0/413688587 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df620e560 0x564df62091a0 unknown :-1 s=CLOSED pgs=1077 gs=1 cs=0 l=1 c_cookie=10978994996673672101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 --2- 10.20.193.4:0/413688587 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c98c0 0x564df6223580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 --2- 10.20.193.4:0/413688587 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df61c8fb0 0x564df6223040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 -- 10.20.193.4:0/413688587 >> 10.20.193.4:0/413688587 conn(0x564df61a74b0 msgr2=0x564df6222930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 -- 10.20.193.4:0/413688587 shutdown_connections 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.608+0000 7fb4460aae00 1 -- 10.20.193.4:0/413688587 wait complete. 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb4460aae00 1 -- start start 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb4460aae00 1 Processor -- start 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c8fb0 0x564df61a8d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c98c0 0x564df61a92c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb4460aae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df620e560 0x564df61a9800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb4460aae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564df6274500 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb4460aae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564df6274670 con 0x564df620e560 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb4460aae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564df6274830 con 0x564df61c8fb0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb441624640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c98c0 0x564df61a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb441624640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c98c0 0x564df61a92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60580/0 (socket says 10.20.193.4:60580) 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb441624640 1 -- 10.20.193.4:0/4254374776 learned_addr learned my addr 10.20.193.4:0/4254374776 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb441e25640 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c8fb0 0x564df61a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb442626640 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df620e560 0x564df61a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb441624640 1 -- 10.20.193.4:0/4254374776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c8fb0 msgr2=0x564df61a8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb441624640 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c8fb0 0x564df61a8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb441624640 1 -- 10.20.193.4:0/4254374776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df620e560 msgr2=0x564df61a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb441624640 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df620e560 0x564df61a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb441624640 1 -- 10.20.193.4:0/4254374776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df6053f00 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.609+0000 7fb442626640 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df620e560 0x564df61a9800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb441624640 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c98c0 0x564df61a92c0 secure :-1 s=READY pgs=1078 gs=1 cs=0 l=1 c_cookie=16488031164955736917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb43c0fbf20 tx=0x7fb43003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d140fcb8c1bb55 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb3f77fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb3f77fe640 1 -- 10.20.193.4:0/4254374776 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb43003f070 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 1 -- 10.20.193.4:0/4254374776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43802a040 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb3f77fe640 1 -- 10.20.193.4:0/4254374776 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb4300043a0 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb3f77fe640 1 -- 10.20.193.4:0/4254374776 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb430043670 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 10 client.17544 _ll_register_callbacks cb 0x564df60be290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 1 -- 10.20.193.4:0/4254374776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb42c0152d0 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb3f77fe640 1 -- 10.20.193.4:0/4254374776 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb430043800 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb3f77fe640 1 -- 10.20.193.4:0/4254374776 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb4300439c0 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 10 client.17544 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 1 -- 10.20.193.4:0/4254374776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564df6065b70 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb3f77fe640 1 -- 10.20.193.4:0/4254374776 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb430043b20 con 0x564df61c98c0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 10 client.17544 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 10 client.17544 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 20 client.17544 populate_metadata read hostname 'trial004' 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564df62bc990 0x564df62dce40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 4 client.17544 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bf7150b9", "release": true, "await": true}] 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb4460aae00 1 -- 10.20.193.4:0/4254374776 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bf7150b9", "release": true, "await": true}) -- 0x564df5e043c0 con 0x564df62bc990 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb441e25640 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564df62bc990 0x564df62dce40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb441e25640 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564df62bc990 0x564df62dce40 crc :-1 s=READY pgs=170 gs=4 cs=0 l=0 c_cookie=12128227117513926242 s_cookie=10076636137022191267 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8501e4e26ad6662 server_cookie=8bd7672da61276a3 in_seq=0 out_seq=0 2026-02-24T09:17:18.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.610+0000 7fb3f77fe640 10 client.17544 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:18.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb3f77fe640 1 -- 10.20.193.4:0/4254374776 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564df5e043c0 con 0x564df62bc990 2026-02-24T09:17:18.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb3f77fe640 10 client.17544 handle_command_reply: tid=0 2026-02-24T09:17:18.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 client.17544 shutdown 2026-02-24T09:17:18.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 -- 10.20.193.4:0/4254374776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c98c0 msgr2=0x564df61a92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c98c0 0x564df61a92c0 secure :-1 s=READY pgs=1078 gs=1 cs=0 l=1 c_cookie=16488031164955736917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb43c0fbf20 tx=0x7fb43003f000 comp rx=0 tx=0).stop 2026-02-24T09:17:18.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 -- 10.20.193.4:0/4254374776 shutdown_connections 2026-02-24T09:17:18.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564df62bc990 0x564df62dce40 crc :-1 s=READY pgs=170 gs=4 cs=0 l=0 c_cookie=12128227117513926242 s_cookie=10076636137022191267 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564df620e560 0x564df61a9800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564df61c98c0 0x564df61a92c0 unknown :-1 s=CLOSED pgs=1078 gs=1 cs=0 l=1 c_cookie=16488031164955736917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 --2- 10.20.193.4:0/4254374776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564df61c8fb0 0x564df61a8d80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb3f77fe640 0 client.17544 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 -- 10.20.193.4:0/4254374776 >> 10.20.193.4:0/4254374776 conn(0x564df61a74b0 msgr2=0x564df6223040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 -- 10.20.193.4:0/4254374776 shutdown_connections 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 1 -- 10.20.193.4:0/4254374776 wait complete. 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4460aae00 20 client.17544 trim_cache size 0 max 16384 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 28, 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "bf7150b9": { 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "version": 28, 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 133.2, 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:18.618 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 -- 10.20.193.4:0/1302719207 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4180b56d0 msgr2=0x7fb4180d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4180b56d0 0x7fb4180d5b80 secure :-1 s=READY pgs=406 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4300098a0 tx=0x7fb430031040 comp rx=0 tx=0).stop 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 -- 10.20.193.4:0/1302719207 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb43c10f280 msgr2=0x7fb43c0f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb43c10f280 0x7fb43c0f5580 secure :-1 s=READY pgs=1074 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb42c009480 tx=0x7fb42c00ee60 comp rx=0 tx=0).stop 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 -- 10.20.193.4:0/1302719207 shutdown_connections 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb4180b56d0 0x7fb4180d5b80 unknown :-1 s=CLOSED pgs=406 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb43c115470 0x7fb43c0f5c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb43c10fc70 0x7fb43c175d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 --2- 10.20.193.4:0/1302719207 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb43c10f280 0x7fb43c0f5580 unknown :-1 s=CLOSED pgs=1074 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 -- 10.20.193.4:0/1302719207 >> 10.20.193.4:0/1302719207 conn(0x7fb43c05f830 msgr2=0x7fb43c111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 -- 10.20.193.4:0/1302719207 shutdown_connections 2026-02-24T09:17:18.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:18.615+0000 7fb4440b0640 1 -- 10.20.193.4:0/1302719207 wait complete. 2026-02-24T09:17:18.675 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bf7150b9', total seconds elapsed: 13.9 2026-02-24T09:17:18.889 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:18 trial004 ceph-mon[41596]: pgmap v377: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 867 MiB/s wr, 264 op/s 2026-02-24T09:17:18.890 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:18 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1018224044' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:18 trial090 ceph-mon[47278]: pgmap v377: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 867 MiB/s wr, 264 op/s 2026-02-24T09:17:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:18 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1018224044' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:19.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:18 trial014 ceph-mon[46941]: pgmap v377: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 867 MiB/s wr, 264 op/s 2026-02-24T09:17:19.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:18 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1018224044' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:20 trial004 ceph-mon[41596]: pgmap v378: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 851 MiB/s wr, 255 op/s 2026-02-24T09:17:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:20 trial090 ceph-mon[47278]: pgmap v378: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 851 MiB/s wr, 255 op/s 2026-02-24T09:17:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:20 trial014 ceph-mon[46941]: pgmap v378: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 851 MiB/s wr, 255 op/s 2026-02-24T09:17:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:22 trial004 ceph-mon[41596]: pgmap v379: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 801 MiB/s wr, 245 op/s 2026-02-24T09:17:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:22 trial090 ceph-mon[47278]: pgmap v379: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 801 MiB/s wr, 245 op/s 2026-02-24T09:17:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:22 trial014 ceph-mon[46941]: pgmap v379: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 801 MiB/s wr, 245 op/s 2026-02-24T09:17:24.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:23 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:17:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:23 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:17:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:23 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:17:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:24 trial004 ceph-mon[41596]: pgmap v380: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 532 MiB/s wr, 172 op/s 2026-02-24T09:17:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:24 trial090 ceph-mon[47278]: pgmap v380: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 532 MiB/s wr, 172 op/s 2026-02-24T09:17:25.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:24 trial014 ceph-mon[46941]: pgmap v380: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 532 MiB/s wr, 172 op/s 2026-02-24T09:17:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: pgmap v381: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 293 MiB/s wr, 105 op/s 2026-02-24T09:17:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:17:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:17:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:17:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:17:27.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: pgmap v381: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 293 MiB/s wr, 105 op/s 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: pgmap v381: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 293 MiB/s wr, 105 op/s 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:17:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:17:29.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:28 trial004 ceph-mon[41596]: pgmap v382: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 151 MiB/s wr, 62 op/s 2026-02-24T09:17:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:28 trial090 ceph-mon[47278]: pgmap v382: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 151 MiB/s wr, 62 op/s 2026-02-24T09:17:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:28 trial014 ceph-mon[46941]: pgmap v382: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 151 MiB/s wr, 62 op/s 2026-02-24T09:17:31.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:30 trial004 ceph-mon[41596]: pgmap v383: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 33 MiB/s wr, 17 op/s 2026-02-24T09:17:31.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:30 trial090 ceph-mon[47278]: pgmap v383: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 33 MiB/s wr, 17 op/s 2026-02-24T09:17:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:30 trial014 ceph-mon[46941]: pgmap v383: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 33 MiB/s wr, 17 op/s 2026-02-24T09:17:33.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:32 trial004 ceph-mon[41596]: pgmap v384: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 115 MiB/s wr, 38 op/s 2026-02-24T09:17:33.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:32 trial090 ceph-mon[47278]: pgmap v384: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 115 MiB/s wr, 38 op/s 2026-02-24T09:17:33.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:32 trial014 ceph-mon[46941]: pgmap v384: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 115 MiB/s wr, 38 op/s 2026-02-24T09:17:35.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:34 trial004 ceph-mon[41596]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 238 MiB/s wr, 67 op/s 2026-02-24T09:17:35.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:34 trial090 ceph-mon[47278]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 238 MiB/s wr, 67 op/s 2026-02-24T09:17:35.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:34 trial014 ceph-mon[46941]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 238 MiB/s wr, 67 op/s 2026-02-24T09:17:37.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:36 trial004 ceph-mon[41596]: pgmap v386: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 395 MiB/s wr, 107 op/s 2026-02-24T09:17:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:36 trial090 ceph-mon[47278]: pgmap v386: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 395 MiB/s wr, 107 op/s 2026-02-24T09:17:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:36 trial014 ceph-mon[46941]: pgmap v386: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 395 MiB/s wr, 107 op/s 2026-02-24T09:17:39.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:38 trial004 ceph-mon[41596]: pgmap v387: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 650 MiB/s wr, 171 op/s 2026-02-24T09:17:39.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:38 trial090 ceph-mon[47278]: pgmap v387: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 650 MiB/s wr, 171 op/s 2026-02-24T09:17:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:38 trial014 ceph-mon[46941]: pgmap v387: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 650 MiB/s wr, 171 op/s 2026-02-24T09:17:41.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:40 trial004 ceph-mon[41596]: pgmap v388: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 766 MiB/s wr, 203 op/s 2026-02-24T09:17:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:40 trial090 ceph-mon[47278]: pgmap v388: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 766 MiB/s wr, 203 op/s 2026-02-24T09:17:41.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:40 trial014 ceph-mon[46941]: pgmap v388: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 766 MiB/s wr, 203 op/s 2026-02-24T09:17:43.190 INFO:tasks.quiescer.fs.[cephfs]:Total duration (45.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-24T09:17:43.190 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.8 2026-02-24T09:17:43.191 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:42 trial004 ceph-mon[41596]: pgmap v389: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 54 KiB/s rd, 892 MiB/s wr, 247 op/s 2026-02-24T09:17:43.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:42 trial090 ceph-mon[47278]: pgmap v389: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 54 KiB/s rd, 892 MiB/s wr, 247 op/s 2026-02-24T09:17:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:42 trial014 ceph-mon[46941]: pgmap v389: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 54 KiB/s rd, 892 MiB/s wr, 247 op/s 2026-02-24T09:17:43.381 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:43.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.526+0000 7f64a1673640 1 -- 10.20.193.4:0/2503378247 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f649c10b2e0 msgr2=0x7f649c10b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:43.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.526+0000 7f64a1673640 1 --2- 10.20.193.4:0/2503378247 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f649c10b2e0 0x7f649c10b6b0 secure :-1 s=READY pgs=1079 gs=1 cs=0 l=1 c_cookie=4318227573226493604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f649000fc10 tx=0x7f649002ef10 comp rx=0 tx=0).stop 2026-02-24T09:17:43.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.527+0000 7f64a1673640 1 -- 10.20.193.4:0/2503378247 shutdown_connections 2026-02-24T09:17:43.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.527+0000 7f64a1673640 1 --2- 10.20.193.4:0/2503378247 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f649c1135a0 0x7f649c173f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:43.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.527+0000 7f64a1673640 1 --2- 10.20.193.4:0/2503378247 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f649c10bcd0 0x7f649c112df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:43.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.527+0000 7f64a1673640 1 --2- 10.20.193.4:0/2503378247 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f649c10b2e0 0x7f649c10b6b0 unknown :-1 s=CLOSED pgs=1079 gs=1 cs=0 l=1 c_cookie=4318227573226493604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:43.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.527+0000 7f64a1673640 1 -- 10.20.193.4:0/2503378247 >> 10.20.193.4:0/2503378247 conn(0x7f649c0e8e50 msgr2=0x7f649c109260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.527+0000 7f64a1673640 1 -- 10.20.193.4:0/2503378247 shutdown_connections 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.527+0000 7f64a1673640 1 -- 10.20.193.4:0/2503378247 wait complete. 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.527+0000 7f64a1673640 1 Processor -- start 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.527+0000 7f64a1673640 1 -- start start 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.527+0000 7f64a1673640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f649c10b2e0 0x7f649c11b2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f64a1673640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f649c10bcd0 0x7f649c11b7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f64a1673640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f649c1135a0 0x7f649c120bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f64a1673640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f649c1211e0 con 0x7f649c10b2e0 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f64a1673640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f649c121350 con 0x7f649c10bcd0 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f64a1673640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f649c121510 con 0x7f649c1135a0 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f649c10b2e0 0x7f649c11b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:43.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f649c10b2e0 0x7f649c11b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36402/0 (socket says 10.20.193.4:36402) 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649affd640 1 -- 10.20.193.4:0/2887118358 learned_addr learned my addr 10.20.193.4:0/2887118358 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649a7fc640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f649c10bcd0 0x7f649c11b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649b7fe640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f649c1135a0 0x7f649c120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649a7fc640 1 -- 10.20.193.4:0/2887118358 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f649c1135a0 msgr2=0x7f649c120bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649a7fc640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f649c1135a0 0x7f649c120bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649a7fc640 1 -- 10.20.193.4:0/2887118358 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f649c10b2e0 msgr2=0x7f649c11b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649a7fc640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f649c10b2e0 0x7f649c11b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649a7fc640 1 -- 10.20.193.4:0/2887118358 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649000f830 con 0x7f649c10bcd0 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649b7fe640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f649c1135a0 0x7f649c120bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f649a7fc640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f649c10bcd0 0x7f649c11b7f0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f648400e9c0 tx=0x7f648400ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f647bfff640 1 -- 10.20.193.4:0/2887118358 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f648400ccb0 con 0x7f649c10bcd0 2026-02-24T09:17:43.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f647bfff640 1 -- 10.20.193.4:0/2887118358 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f648400ce10 con 0x7f649c10bcd0 2026-02-24T09:17:43.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.528+0000 7f647bfff640 1 -- 10.20.193.4:0/2887118358 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f64840106b0 con 0x7f649c10bcd0 2026-02-24T09:17:43.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.529+0000 7f64a1673640 1 -- 10.20.193.4:0/2887118358 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c1217f0 con 0x7f649c10bcd0 2026-02-24T09:17:43.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.529+0000 7f64a1673640 1 -- 10.20.193.4:0/2887118358 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c161ef0 con 0x7f649c10bcd0 2026-02-24T09:17:43.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.530+0000 7f64a1673640 1 -- 10.20.193.4:0/2887118358 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649c121a10 con 0x7f649c10bcd0 2026-02-24T09:17:43.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.531+0000 7f647bfff640 1 -- 10.20.193.4:0/2887118358 <== mon.2 v2:10.20.193.14:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f648401f060 con 0x7f649c10bcd0 2026-02-24T09:17:43.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.532+0000 7f647bfff640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f646c0b5760 0x7f646c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:43.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.533+0000 7f647bfff640 1 -- 10.20.193.4:0/2887118358 <== mon.2 v2:10.20.193.14:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6484014070 con 0x7f649c10bcd0 2026-02-24T09:17:43.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.533+0000 7f649affd640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f646c0b5760 0x7f646c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:43.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.533+0000 7f649affd640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f646c0b5760 0x7f646c0d5c10 secure :-1 s=READY pgs=407 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6490004820 tx=0x7f649003b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:43.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.534+0000 7f647bfff640 1 -- 10.20.193.4:0/2887118358 <== mon.2 v2:10.20.193.14:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f64840a95a0 con 0x7f649c10bcd0 2026-02-24T09:17:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.714+0000 7f64a1673640 1 -- 10.20.193.4:0/2887118358 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f649c10c400 con 0x7f649c10bcd0 2026-02-24T09:17:43.718 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.714+0000 7f647bfff640 1 -- 10.20.193.4:0/2887118358 <== mon.2 v2:10.20.193.14:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f64840ac750 con 0x7f649c10bcd0 2026-02-24T09:17:43.718 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:17:43.718 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:17:43.718 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:17:43.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 -- 10.20.193.4:0/2887118358 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f646c0b5760 msgr2=0x7f646c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f646c0b5760 0x7f646c0d5c10 secure :-1 s=READY pgs=407 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6490004820 tx=0x7f649003b040 comp rx=0 tx=0).stop 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 -- 10.20.193.4:0/2887118358 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f649c10bcd0 msgr2=0x7f649c11b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f649c10bcd0 0x7f649c11b7f0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f648400e9c0 tx=0x7f648400ee90 comp rx=0 tx=0).stop 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 -- 10.20.193.4:0/2887118358 shutdown_connections 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f646c0b5760 0x7f646c0d5c10 unknown :-1 s=CLOSED pgs=407 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f649c1135a0 0x7f649c120bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f649c10bcd0 0x7f649c11b7f0 unknown :-1 s=CLOSED pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 --2- 10.20.193.4:0/2887118358 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f649c10b2e0 0x7f649c11b2b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 -- 10.20.193.4:0/2887118358 >> 10.20.193.4:0/2887118358 conn(0x7f649c0e8e50 msgr2=0x7f649c109230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 -- 10.20.193.4:0/2887118358 shutdown_connections 2026-02-24T09:17:43.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:43.717+0000 7f64a1673640 1 -- 10.20.193.4:0/2887118358 wait complete. 2026-02-24T09:17:43.765 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 142.8 --await-for 45.0' 2026-02-24T09:17:43.765 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 142.8 --await-for 45.0 2026-02-24T09:17:43.996 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:44.041 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:43 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2887118358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:44.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.190+0000 7f9fa2621640 1 -- 10.20.193.4:0/1831267421 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c113610 msgr2=0x7f9f9c173fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:44.197 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.190+0000 7f9fa2621640 1 --2- 10.20.193.4:0/1831267421 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c113610 0x7f9f9c173fe0 secure :-1 s=READY pgs=1080 gs=1 cs=0 l=1 c_cookie=10615569771224428649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f9000aa30 tx=0x7f9f90030280 comp rx=0 tx=0).stop 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.191+0000 7f9fa2621640 1 -- 10.20.193.4:0/1831267421 shutdown_connections 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.191+0000 7f9fa2621640 1 --2- 10.20.193.4:0/1831267421 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c113610 0x7f9f9c173fe0 unknown :-1 s=CLOSED pgs=1080 gs=1 cs=0 l=1 c_cookie=10615569771224428649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.191+0000 7f9fa2621640 1 --2- 10.20.193.4:0/1831267421 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10de10 0x7f9f9c112e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.191+0000 7f9fa2621640 1 --2- 10.20.193.4:0/1831267421 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c10d420 0x7f9f9c10d7f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.191+0000 7f9fa2621640 1 -- 10.20.193.4:0/1831267421 >> 10.20.193.4:0/1831267421 conn(0x7f9f9c0ead10 msgr2=0x7f9f9c10b120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.191+0000 7f9fa2621640 1 -- 10.20.193.4:0/1831267421 shutdown_connections 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.191+0000 7f9fa2621640 1 -- 10.20.193.4:0/1831267421 wait complete. 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.191+0000 7f9fa2621640 1 Processor -- start 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9fa2621640 1 -- start start 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9fa2621640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10d420 0x7f9f9c060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9fa2621640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c10de10 0x7f9f9c0614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9fa2621640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c113610 0x7f9f9c061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9fa2621640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c1640b0 con 0x7f9f9c113610 2026-02-24T09:17:44.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9fa2621640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c164220 con 0x7f9f9c10d420 2026-02-24T09:17:44.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9fa2621640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c1643e0 con 0x7f9f9c10de10 2026-02-24T09:17:44.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9f9b7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c10de10 0x7f9f9c0614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9f9b7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c10de10 0x7f9f9c0614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:54822/0 (socket says 10.20.193.4:54822) 2026-02-24T09:17:44.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/3013255848 learned_addr learned my addr 10.20.193.4:0/3013255848 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:44.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10d420 0x7f9f9c060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/3013255848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10d420 msgr2=0x7f9f9c060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:44.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10d420 0x7f9f9c060f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/3013255848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c113610 msgr2=0x7f9f9c061a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c113610 0x7f9f9c061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/3013255848 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9000a650 con 0x7f9f9c10de10 2026-02-24T09:17:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.192+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10d420 0x7f9f9c060f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.193+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c10de10 0x7f9f9c0614d0 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f8c009480 tx=0x7f9f8c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.193+0000 7f9f997fa640 1 -- 10.20.193.4:0/3013255848 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f8c00cd40 con 0x7f9f9c10de10 2026-02-24T09:17:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.193+0000 7f9f997fa640 1 -- 10.20.193.4:0/3013255848 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f8c004d30 con 0x7f9f9c10de10 2026-02-24T09:17:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.193+0000 7f9fa2621640 1 -- 10.20.193.4:0/3013255848 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9c1646c0 con 0x7f9f9c10de10 2026-02-24T09:17:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.193+0000 7f9f997fa640 1 -- 10.20.193.4:0/3013255848 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f8c0106b0 con 0x7f9f9c10de10 2026-02-24T09:17:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.193+0000 7f9fa2621640 1 -- 10.20.193.4:0/3013255848 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9c164be0 con 0x7f9f9c10de10 2026-02-24T09:17:44.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.195+0000 7f9f997fa640 1 -- 10.20.193.4:0/3013255848 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9f8c01f060 con 0x7f9f9c10de10 2026-02-24T09:17:44.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.197+0000 7f9f997fa640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f700b5760 0x7f9f700d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.197+0000 7f9f997fa640 1 -- 10.20.193.4:0/3013255848 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9f8c014070 con 0x7f9f9c10de10 2026-02-24T09:17:44.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.197+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f700b5760 0x7f9f700d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.201+0000 7f9fa461be00 1 Processor -- start 2026-02-24T09:17:44.205 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.201+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f700b5760 0x7f9f700d5c10 secure :-1 s=READY pgs=408 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f88004740 tx=0x7f9f88005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:44.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.201+0000 7f9fa461be00 1 -- start start 2026-02-24T09:17:44.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.201+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 0x5619b17e8fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.201+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 0x5619b182dc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.206 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.201+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 0x5619b184e560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9fa461be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5619b16f7f20 con 0x5619b182e180 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9fa461be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5619b16f3c50 con 0x5619b17e94e0 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9fa461be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5619b16eddb0 con 0x5619b17e8bd0 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f9bfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 0x5619b17e8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f9bfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 0x5619b17e8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:54832/0 (socket says 10.20.193.4:54832) 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f9bfff640 1 -- 10.20.193.4:0/3835461149 learned_addr learned my addr 10.20.193.4:0/3835461149 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/3835461149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 0x5619b182dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9fa0b97640 1 --2- 10.20.193.4:0/3835461149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 0x5619b184e560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f9bfff640 1 -- 10.20.193.4:0/3835461149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 msgr2=0x5619b182dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/3835461149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 0x5619b182dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f9bfff640 1 -- 10.20.193.4:0/3835461149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 msgr2=0x5619b184e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:44.207 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/3835461149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 0x5619b184e560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f9bfff640 1 -- 10.20.193.4:0/3835461149 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b168e690 con 0x5619b17e8bd0 2026-02-24T09:17:44.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/3835461149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 0x5619b17e8fa0 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=5104511211570637065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f88005d90 tx=0x7f9f88013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d6dde6edaaa909 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:44.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f6cce3640 1 -- 10.20.193.4:0/3835461149 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f88018040 con 0x5619b17e8bd0 2026-02-24T09:17:44.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f6cce3640 1 -- 10.20.193.4:0/3835461149 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f880045a0 con 0x5619b17e8bd0 2026-02-24T09:17:44.208 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.202+0000 7f9f6cce3640 1 -- 10.20.193.4:0/3835461149 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f88012740 con 0x5619b17e8bd0 2026-02-24T09:17:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.204+0000 7f9fa461be00 1 -- 10.20.193.4:0/3835461149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 msgr2=0x5619b17e8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.204+0000 7f9fa461be00 1 --2- 10.20.193.4:0/3835461149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 0x5619b17e8fa0 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=5104511211570637065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f88005d90 tx=0x7f9f88013000 comp rx=0 tx=0).stop 2026-02-24T09:17:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.204+0000 7f9fa461be00 1 -- 10.20.193.4:0/3835461149 shutdown_connections 2026-02-24T09:17:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.204+0000 7f9fa461be00 1 --2- 10.20.193.4:0/3835461149 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 0x5619b184e560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.204+0000 7f9fa461be00 1 --2- 10.20.193.4:0/3835461149 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 0x5619b182dc40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.204+0000 7f9fa461be00 1 --2- 10.20.193.4:0/3835461149 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 0x5619b17e8fa0 unknown :-1 s=CLOSED pgs=107 gs=2 cs=0 l=1 c_cookie=5104511211570637065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.204+0000 7f9fa461be00 1 -- 10.20.193.4:0/3835461149 >> 10.20.193.4:0/3835461149 conn(0x5619b1706880 msgr2=0x5619b17e74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.204+0000 7f9fa461be00 1 -- 10.20.193.4:0/3835461149 shutdown_connections 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.204+0000 7f9fa461be00 1 -- 10.20.193.4:0/3835461149 wait complete. 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa461be00 1 -- start start 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa461be00 1 Processor -- start 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 0x5619b1800970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 0x5619b1800eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 0x5619b1805f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa461be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5619b1806480 con 0x5619b182e180 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa461be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5619b18065f0 con 0x5619b17e94e0 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa461be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5619b18067b0 con 0x5619b17e8bd0 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa0b97640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 0x5619b1805f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa0b97640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 0x5619b1805f40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36440/0 (socket says 10.20.193.4:36440) 2026-02-24T09:17:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa0b97640 1 -- 10.20.193.4:0/2602395345 learned_addr learned my addr 10.20.193.4:0/2602395345 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 0x5619b1800eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa0b97640 1 -- 10.20.193.4:0/2602395345 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 msgr2=0x5619b1800970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa0b97640 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 0x5619b1800970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa0b97640 1 -- 10.20.193.4:0/2602395345 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 msgr2=0x5619b1800eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa0b97640 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 0x5619b1800eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9fa0b97640 1 -- 10.20.193.4:0/2602395345 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b16993d0 con 0x5619b182e180 2026-02-24T09:17:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.205+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 0x5619b1800eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa0b97640 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 0x5619b1805f40 secure :-1 s=READY pgs=1081 gs=1 cs=0 l=1 c_cookie=4976722397501660855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f90003f90 tx=0x7f9f90006d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4510dea718d11eb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9f5dffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9f5dffb640 1 -- 10.20.193.4:0/2602395345 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f90040040 con 0x5619b182e180 2026-02-24T09:17:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 1 -- 10.20.193.4:0/2602395345 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f88009c40 con 0x5619b182e180 2026-02-24T09:17:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9f5dffb640 1 -- 10.20.193.4:0/2602395345 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f90039e40 con 0x5619b182e180 2026-02-24T09:17:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9f5dffb640 1 -- 10.20.193.4:0/2602395345 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f90045480 con 0x5619b182e180 2026-02-24T09:17:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 10 client.17559 _ll_register_callbacks cb 0x5619b166ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 1 -- 10.20.193.4:0/2602395345 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5619b137beb0 con 0x5619b182e180 2026-02-24T09:17:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9f5dffb640 1 -- 10.20.193.4:0/2602395345 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9f900443e0 con 0x5619b182e180 2026-02-24T09:17:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9f5dffb640 1 -- 10.20.193.4:0/2602395345 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9f900445e0 con 0x5619b182e180 2026-02-24T09:17:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 10 client.17559 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 1 -- 10.20.193.4:0/2602395345 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5619b16715c0 con 0x5619b182e180 2026-02-24T09:17:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9f5dffb640 1 -- 10.20.193.4:0/2602395345 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9f900447e0 con 0x5619b182e180 2026-02-24T09:17:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 10 client.17559 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 10 client.17559 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:17:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 20 client.17559 populate_metadata read hostname 'trial004' 2026-02-24T09:17:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5619b182b310 0x5619b182b7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 4 client.17559 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.206+0000 7f9fa461be00 1 -- 10.20.193.4:0/2602395345 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619b16fef00 con 0x5619b182b310 2026-02-24T09:17:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.207+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5619b182b310 0x5619b182b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.207+0000 7f9f5dffb640 10 client.17559 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.207+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5619b182b310 0x5619b182b7b0 crc :-1 s=READY pgs=171 gs=4 cs=0 l=0 c_cookie=1519095183277917022 s_cookie=5808689933245271673 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1514e9054b49835e server_cookie=509c9cb7f178ce79 in_seq=0 out_seq=0 2026-02-24T09:17:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9f5dffb640 1 -- 10.20.193.4:0/2602395345 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5619b16fef00 con 0x5619b182b310 2026-02-24T09:17:44.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9f5dffb640 10 client.17559 handle_command_reply: tid=0 2026-02-24T09:17:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 client.17559 shutdown 2026-02-24T09:17:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 -- 10.20.193.4:0/2602395345 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 msgr2=0x5619b1805f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 0x5619b1805f40 secure :-1 s=READY pgs=1081 gs=1 cs=0 l=1 c_cookie=4976722397501660855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f90003f90 tx=0x7f9f90006d80 comp rx=0 tx=0).stop 2026-02-24T09:17:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 -- 10.20.193.4:0/2602395345 shutdown_connections 2026-02-24T09:17:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5619b182b310 0x5619b182b7b0 crc :-1 s=READY pgs=171 gs=4 cs=0 l=0 c_cookie=1519095183277917022 s_cookie=5808689933245271673 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b182e180 0x5619b1805f40 unknown :-1 s=CLOSED pgs=1081 gs=1 cs=0 l=1 c_cookie=4976722397501660855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9f5dffb640 0 client.17559 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b17e94e0 0x5619b1800eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 --2- 10.20.193.4:0/2602395345 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e8bd0 0x5619b1800970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 -- 10.20.193.4:0/2602395345 >> 10.20.193.4:0/2602395345 conn(0x5619b1706880 msgr2=0x5619b17e7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 -- 10.20.193.4:0/2602395345 shutdown_connections 2026-02-24T09:17:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 1 -- 10.20.193.4:0/2602395345 wait complete. 2026-02-24T09:17:44.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.208+0000 7f9fa461be00 20 client.17559 trim_cache size 0 max 16384 2026-02-24T09:17:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.221+0000 7f9fa461be00 1 Processor -- start 2026-02-24T09:17:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.221+0000 7f9fa461be00 1 -- start start 2026-02-24T09:17:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.221+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b17e8bd0 0x5619b1805410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.221+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b17e7dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.221+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 0x5619b17e8300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.221+0000 7f9fa461be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5619b16eb9e0 con 0x5619b17e8bd0 2026-02-24T09:17:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.221+0000 7f9fa461be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5619b13a3ec0 con 0x5619b182b310 2026-02-24T09:17:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.221+0000 7f9fa461be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5619b1757580 con 0x5619b17e94e0 2026-02-24T09:17:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.221+0000 7f9f9b7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b17e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9f9b7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b17e7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:54840/0 (socket says 10.20.193.4:54840) 2026-02-24T09:17:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/1345117204 learned_addr learned my addr 10.20.193.4:0/1345117204 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9fa0b97640 1 --2- 10.20.193.4:0/1345117204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 0x5619b17e8300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/1345117204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b17e8bd0 0x5619b1805410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/1345117204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 msgr2=0x5619b17e8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/1345117204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 0x5619b17e8300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/1345117204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b17e8bd0 msgr2=0x5619b1805410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/1345117204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b17e8bd0 0x5619b1805410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/1345117204 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b1683500 con 0x5619b17e94e0 2026-02-24T09:17:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9fa0b97640 1 --2- 10.20.193.4:0/1345117204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 0x5619b17e8300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.222+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/1345117204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b17e7dc0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=3871719405713916969 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f8c0aa320 tx=0x7f9f8c0054e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35bb1c4947908429 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:44.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.224+0000 7f9f5ffff640 1 -- 10.20.193.4:0/1345117204 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f8c0adab0 con 0x5619b17e94e0 2026-02-24T09:17:44.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.224+0000 7f9f5ffff640 1 -- 10.20.193.4:0/1345117204 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f8c0b2dd0 con 0x5619b17e94e0 2026-02-24T09:17:44.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.224+0000 7f9f5ffff640 1 -- 10.20.193.4:0/1345117204 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f8c0adfc0 con 0x5619b17e94e0 2026-02-24T09:17:44.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.225+0000 7f9fa461be00 1 -- 10.20.193.4:0/1345117204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 msgr2=0x5619b17e7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:44.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.225+0000 7f9fa461be00 1 --2- 10.20.193.4:0/1345117204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b17e7dc0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=3871719405713916969 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f8c0aa320 tx=0x7f9f8c0054e0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.225+0000 7f9fa461be00 1 -- 10.20.193.4:0/1345117204 shutdown_connections 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.225+0000 7f9fa461be00 1 --2- 10.20.193.4:0/1345117204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 0x5619b17e8300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.225+0000 7f9fa461be00 1 --2- 10.20.193.4:0/1345117204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b17e7dc0 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=3871719405713916969 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.225+0000 7f9fa461be00 1 --2- 10.20.193.4:0/1345117204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b17e8bd0 0x5619b1805410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.225+0000 7f9fa461be00 1 -- 10.20.193.4:0/1345117204 >> 10.20.193.4:0/1345117204 conn(0x5619b1706880 msgr2=0x5619b18044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.225+0000 7f9fa461be00 1 -- 10.20.193.4:0/1345117204 shutdown_connections 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.225+0000 7f9fa461be00 1 -- 10.20.193.4:0/1345117204 wait complete. 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.226+0000 7f9fa461be00 1 -- start start 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.226+0000 7f9fa461be00 1 Processor -- start 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.226+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b17e8bd0 0x5619b1808260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.226+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b18087a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.226+0000 7f9fa461be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 0x5619b1808ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.226+0000 7f9fa461be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5619b17c3f20 con 0x5619b17e8bd0 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.226+0000 7f9fa461be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5619b18068f0 con 0x5619b182b310 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.226+0000 7f9fa461be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5619b175c290 con 0x5619b17e94e0 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f9b7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b18087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f9bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b17e8bd0 0x5619b1808260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f9b7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b18087a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:54844/0 (socket says 10.20.193.4:54844) 2026-02-24T09:17:44.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/3881129157 learned_addr learned my addr 10.20.193.4:0/3881129157 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9fa0b97640 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 0x5619b1808ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/3881129157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 msgr2=0x5619b1808ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 0x5619b1808ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/3881129157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b17e8bd0 msgr2=0x5619b1808260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b17e8bd0 0x5619b1808260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f9b7fe640 1 -- 10.20.193.4:0/3881129157 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b167df80 con 0x5619b17e94e0 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f9b7fe640 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b18087a0 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=12378242511170711795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f8c0a9680 tx=0x7f9f8c0052c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abc859fb2df830f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f5dffb640 10 client.0 ms_handle_connect on v2:10.20.193.90:3300/0 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f5dffb640 1 -- 10.20.193.4:0/3881129157 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f8c0adf60 con 0x5619b17e94e0 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f5dffb640 1 -- 10.20.193.4:0/3881129157 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f8c0b2dd0 con 0x5619b17e94e0 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9f5dffb640 1 -- 10.20.193.4:0/3881129157 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f8c0ab310 con 0x5619b17e94e0 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.227+0000 7f9fa461be00 1 -- 10.20.193.4:0/3881129157 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9c164be0 con 0x5619b17e94e0 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.228+0000 7f9f5dffb640 1 -- 10.20.193.4:0/3881129157 <== mon.1 v2:10.20.193.90:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9f8c0aeaa0 con 0x5619b17e94e0 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.228+0000 7f9f5dffb640 10 client.26710 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9fa461be00 10 client.26710 _ll_register_callbacks cb 0x5619b166ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:44.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9fa461be00 1 -- 10.20.193.4:0/3881129157 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5619b1379700 con 0x5619b17e94e0 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9f5dffb640 1 -- 10.20.193.4:0/3881129157 <== mon.1 v2:10.20.193.90:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9f8c0b81f0 con 0x5619b17e94e0 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9fa461be00 10 client.26710 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9fa461be00 1 -- 10.20.193.4:0/3881129157 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5619b16718f0 con 0x5619b17e94e0 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9f5dffb640 1 -- 10.20.193.4:0/3881129157 <== mon.1 v2:10.20.193.90:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9f8c0ac3a0 con 0x5619b17e94e0 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9fa461be00 10 client.26710 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9fa461be00 10 client.26710 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9fa461be00 20 client.26710 populate_metadata read hostname 'trial004' 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9fa461be00 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5619b182e180 0x5619b18fc600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9fa461be00 4 client.26710 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.8, "await_for": 45.0}] 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9fa461be00 1 -- 10.20.193.4:0/3881129157 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.8, "await_for": 45.0}) -- 0x5619b1700b70 con 0x5619b182e180 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.229+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5619b182e180 0x5619b18fc600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.230+0000 7f9f9bfff640 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5619b182e180 0x5619b18fc600 crc :-1 s=READY pgs=172 gs=4 cs=0 l=0 c_cookie=12215693651319732736 s_cookie=6047476639742756208 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a986dca783e83a00 server_cookie=53ecf3f683570570 in_seq=0 out_seq=0 2026-02-24T09:17:44.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.230+0000 7f9f5dffb640 10 client.26710 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:44.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9f5dffb640 1 -- 10.20.193.4:0/3881129157 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5619b1700b70 con 0x5619b182e180 2026-02-24T09:17:44.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9f5dffb640 10 client.26710 handle_command_reply: tid=0 2026-02-24T09:17:44.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9fa461be00 1 client.26710 shutdown 2026-02-24T09:17:44.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9fa461be00 1 -- 10.20.193.4:0/3881129157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 msgr2=0x5619b18087a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:44.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9fa461be00 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b18087a0 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=12378242511170711795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f8c0a9680 tx=0x7f9f8c0052c0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9fa461be00 1 -- 10.20.193.4:0/3881129157 shutdown_connections 2026-02-24T09:17:44.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9fa461be00 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5619b182e180 0x5619b18fc600 crc :-1 s=READY pgs=172 gs=4 cs=0 l=0 c_cookie=12215693651319732736 s_cookie=6047476639742756208 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9fa461be00 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5619b182b310 0x5619b1808ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9fa461be00 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5619b17e94e0 0x5619b18087a0 unknown :-1 s=CLOSED pgs=109 gs=2 cs=0 l=1 c_cookie=12378242511170711795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9f5dffb640 0 client.26710 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:44.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9fa461be00 1 --2- 10.20.193.4:0/3881129157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5619b17e8bd0 0x5619b1808260 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.249+0000 7f9fa461be00 1 -- 10.20.193.4:0/3881129157 >> 10.20.193.4:0/3881129157 conn(0x5619b1706880 msgr2=0x5619b17e6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:44.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.250+0000 7f9fa461be00 1 -- 10.20.193.4:0/3881129157 shutdown_connections 2026-02-24T09:17:44.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.250+0000 7f9fa461be00 1 -- 10.20.193.4:0/3881129157 wait complete. 2026-02-24T09:17:44.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.250+0000 7f9fa461be00 20 client.26710 trim_cache size 0 max 16384 2026-02-24T09:17:44.256 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:17:44.256 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:17:44.256 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:17:44.256 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 30, 2026-02-24T09:17:44.256 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:17:44.256 INFO:teuthology.orchestra.run.trial004.stdout: "e54b9686": { 2026-02-24T09:17:44.256 INFO:teuthology.orchestra.run.trial004.stdout: "version": 30, 2026-02-24T09:17:44.256 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:17:44.256 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 142.8, 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:17:44.257 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:44.258 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:44.258 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:44.258 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:44.258 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:44.258 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:17:44.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 -- 10.20.193.4:0/3013255848 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f700b5760 msgr2=0x7f9f700d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:44.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f700b5760 0x7f9f700d5c10 secure :-1 s=READY pgs=408 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f88004740 tx=0x7f9f88005f90 comp rx=0 tx=0).stop 2026-02-24T09:17:44.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 -- 10.20.193.4:0/3013255848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c10de10 msgr2=0x7f9f9c0614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:44.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c10de10 0x7f9f9c0614d0 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f8c009480 tx=0x7f9f8c00ee60 comp rx=0 tx=0).stop 2026-02-24T09:17:44.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 -- 10.20.193.4:0/3013255848 shutdown_connections 2026-02-24T09:17:44.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f700b5760 0x7f9f700d5c10 unknown :-1 s=CLOSED pgs=408 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c113610 0x7f9f9c061a10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c10de10 0x7f9f9c0614d0 unknown :-1 s=CLOSED pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 --2- 10.20.193.4:0/3013255848 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10d420 0x7f9f9c060f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:44.259 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 -- 10.20.193.4:0/3013255848 >> 10.20.193.4:0/3013255848 conn(0x7f9f9c0ead10 msgr2=0x7f9f9c10b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:44.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 -- 10.20.193.4:0/3013255848 shutdown_connections 2026-02-24T09:17:44.260 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:44.251+0000 7f9fa2621640 1 -- 10.20.193.4:0/3013255848 wait complete. 2026-02-24T09:17:44.307 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e54b9686', quiesce took 1.1 seconds. Will release after: 21.7 2026-02-24T09:17:44.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:43 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2887118358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:44.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:43 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2887118358' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:45.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:44 trial004 ceph-mon[41596]: pgmap v390: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 821 MiB/s wr, 231 op/s 2026-02-24T09:17:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:44 trial090 ceph-mon[47278]: pgmap v390: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 821 MiB/s wr, 231 op/s 2026-02-24T09:17:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:44 trial014 ceph-mon[46941]: pgmap v390: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 821 MiB/s wr, 231 op/s 2026-02-24T09:17:47.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:46 trial004 ceph-mon[41596]: pgmap v391: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 755 MiB/s wr, 215 op/s 2026-02-24T09:17:47.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:46 trial090 ceph-mon[47278]: pgmap v391: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 755 MiB/s wr, 215 op/s 2026-02-24T09:17:47.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:46 trial014 ceph-mon[46941]: pgmap v391: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 755 MiB/s wr, 215 op/s 2026-02-24T09:17:47.910 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:17:48.068 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:48.192 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:47 trial004 ceph-mon[41596]: pgmap v392: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 819 MiB/s wr, 233 op/s 2026-02-24T09:17:48.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 -- 10.20.193.4:0/3757070671 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d7410f650 msgr2=0x7f1d7410fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 --2- 10.20.193.4:0/3757070671 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d7410f650 0x7f1d7410fa20 secure :-1 s=READY pgs=1082 gs=1 cs=0 l=1 c_cookie=7529008552554648329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d68009950 tx=0x7f1d6802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 -- 10.20.193.4:0/3757070671 shutdown_connections 2026-02-24T09:17:48.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 --2- 10.20.193.4:0/3757070671 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d74115840 0x7f1d74176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 --2- 10.20.193.4:0/3757070671 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d74110040 0x7f1d74115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 --2- 10.20.193.4:0/3757070671 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d7410f650 0x7f1d7410fa20 unknown :-1 s=CLOSED pgs=1082 gs=1 cs=0 l=1 c_cookie=7529008552554648329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 -- 10.20.193.4:0/3757070671 >> 10.20.193.4:0/3757070671 conn(0x7f1d740ecf20 msgr2=0x7f1d7410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:48.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 -- 10.20.193.4:0/3757070671 shutdown_connections 2026-02-24T09:17:48.209 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 -- 10.20.193.4:0/3757070671 wait complete. 2026-02-24T09:17:48.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 Processor -- start 2026-02-24T09:17:48.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.203+0000 7f1d795a7640 1 -- start start 2026-02-24T09:17:48.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d795a7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d7410f650 0x7f1d7411df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d795a7640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d74110040 0x7f1d7411e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d795a7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d74115840 0x7f1d74123810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d795a7640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f1d74123e30 con 0x7f1d7410f650 2026-02-24T09:17:48.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d795a7640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f1d74123fa0 con 0x7f1d74110040 2026-02-24T09:17:48.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d795a7640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d74124160 con 0x7f1d74115840 2026-02-24T09:17:48.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d72ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d7410f650 0x7f1d7411df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d72ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d7410f650 0x7f1d7411df00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36460/0 (socket says 10.20.193.4:36460) 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d72ffd640 1 -- 10.20.193.4:0/4196937879 learned_addr learned my addr 10.20.193.4:0/4196937879 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d737fe640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d74115840 0x7f1d74123810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d727fc640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d74110040 0x7f1d7411e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d72ffd640 1 -- 10.20.193.4:0/4196937879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d74115840 msgr2=0x7f1d74123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d72ffd640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d74115840 0x7f1d74123810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d72ffd640 1 -- 10.20.193.4:0/4196937879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d74110040 msgr2=0x7f1d7411e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d72ffd640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d74110040 0x7f1d7411e440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d72ffd640 1 -- 10.20.193.4:0/4196937879 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d68009570 con 0x7f1d7410f650 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d72ffd640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d7410f650 0x7f1d7411df00 secure :-1 s=READY pgs=1083 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d680023d0 tx=0x7f1d680043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d53fff640 1 -- 10.20.193.4:0/4196937879 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d6803d070 con 0x7f1d7410f650 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d795a7640 1 -- 10.20.193.4:0/4196937879 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d741243e0 con 0x7f1d7410f650 2026-02-24T09:17:48.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d53fff640 1 -- 10.20.193.4:0/4196937879 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1d68038920 con 0x7f1d7410f650 2026-02-24T09:17:48.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d53fff640 1 -- 10.20.193.4:0/4196937879 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d680419d0 con 0x7f1d7410f650 2026-02-24T09:17:48.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.204+0000 7f1d795a7640 1 -- 10.20.193.4:0/4196937879 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d74164b40 con 0x7f1d7410f650 2026-02-24T09:17:48.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.208+0000 7f1d7b5a1e00 1 Processor -- start 2026-02-24T09:17:48.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.208+0000 7f1d7b5a1e00 1 -- start start 2026-02-24T09:17:48.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b69bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b6a130 0x55b2c9bae890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9bcf1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9a79de0 con 0x55b2c9b69820 2026-02-24T09:17:48.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9a75b10 con 0x55b2c9baedd0 2026-02-24T09:17:48.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9a6fab0 con 0x55b2c9b6a130 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d737fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b69bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d737fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b69bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36476/0 (socket says 10.20.193.4:36476) 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d737fe640 1 -- 10.20.193.4:0/2192150645 learned_addr learned my addr 10.20.193.4:0/2192150645 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d737fe640 1 -- 10.20.193.4:0/2192150645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b6a130 msgr2=0x55b2c9bae890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d737fe640 1 --2- 10.20.193.4:0/2192150645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b6a130 0x55b2c9bae890 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d737fe640 1 -- 10.20.193.4:0/2192150645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 msgr2=0x55b2c9bcf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d737fe640 1 --2- 10.20.193.4:0/2192150645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9bcf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d737fe640 1 -- 10.20.193.4:0/2192150645 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c9a1b310 con 0x55b2c9b69820 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d53fff640 1 -- 10.20.193.4:0/4196937879 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f1d68038a90 con 0x7f1d7410f650 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d737fe640 1 --2- 10.20.193.4:0/2192150645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b69bf0 secure :-1 s=READY pgs=1084 gs=1 cs=0 l=1 c_cookie=8573197718117915663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d64008d10 tx=0x7f1d640117a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fa1de6e19b9c0f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d3f7fe640 1 -- 10.20.193.4:0/2192150645 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d640052f0 con 0x55b2c9b69820 2026-02-24T09:17:48.218 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d3f7fe640 1 -- 10.20.193.4:0/2192150645 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1d64008e10 con 0x55b2c9b69820 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d3f7fe640 1 -- 10.20.193.4:0/2192150645 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d64012990 con 0x55b2c9b69820 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/2192150645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 msgr2=0x55b2c9b69bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.209+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/2192150645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b69bf0 secure :-1 s=READY pgs=1084 gs=1 cs=0 l=1 c_cookie=8573197718117915663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d64008d10 tx=0x7f1d640117a0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/2192150645 shutdown_connections 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/2192150645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9bcf1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/2192150645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b6a130 0x55b2c9bae890 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/2192150645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b69bf0 unknown :-1 s=CLOSED pgs=1084 gs=1 cs=0 l=1 c_cookie=8573197718117915663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/2192150645 >> 10.20.193.4:0/2192150645 conn(0x55b2c9a886b0 msgr2=0x55b2c9b68100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/2192150645 shutdown_connections 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/2192150645 wait complete. 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d53fff640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d480b5640 0x7f1d480d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.219 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d727fc640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d480b5640 0x7f1d480d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d53fff640 1 -- 10.20.193.4:0/4196937879 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1d6810b1d0 con 0x7f1d7410f650 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.210+0000 7f1d727fc640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d480b5640 0x7f1d480d5af0 secure :-1 s=READY pgs=409 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55b2c9aead30 tx=0x7f1d5c004770 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d7b5a1e00 1 -- start start 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d7b5a1e00 1 Processor -- start 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b69820 0x55b2c9b81ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b82420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9b87410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9b87950 con 0x55b2c9b6a130 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9b87ac0 con 0x55b2c9baedd0 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9b87c80 con 0x55b2c9b69820 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d727fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b82420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.220 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d727fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b82420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36480/0 (socket says 10.20.193.4:36480) 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d727fc640 1 -- 10.20.193.4:0/1893313874 learned_addr learned my addr 10.20.193.4:0/1893313874 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d737fe640 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9b87410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d727fc640 1 -- 10.20.193.4:0/1893313874 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b69820 msgr2=0x55b2c9b81ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d727fc640 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b69820 0x55b2c9b81ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d727fc640 1 -- 10.20.193.4:0/1893313874 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 msgr2=0x55b2c9b87410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d727fc640 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9b87410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d727fc640 1 -- 10.20.193.4:0/1893313874 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c99f38c0 con 0x55b2c9b6a130 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d727fc640 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b82420 secure :-1 s=READY pgs=1085 gs=1 cs=0 l=1 c_cookie=12761118515814152485 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d5c011440 tx=0x7f1d5c00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11899adc7c33925 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d3cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d3cff9640 1 -- 10.20.193.4:0/1893313874 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d5c004a70 con 0x55b2c9b6a130 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d3cff9640 1 -- 10.20.193.4:0/1893313874 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1d5c015070 con 0x55b2c9b6a130 2026-02-24T09:17:48.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/1893313874 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d64008930 con 0x55b2c9b6a130 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d3cff9640 1 -- 10.20.193.4:0/1893313874 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d5c01eba0 con 0x55b2c9b6a130 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.211+0000 7f1d7b5a1e00 10 client.17574 _ll_register_callbacks cb 0x55b2c9a0b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.212+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/1893313874 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b2c97bf4a0 con 0x55b2c9b6a130 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.212+0000 7f1d3cff9640 1 -- 10.20.193.4:0/1893313874 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1d5c017070 con 0x55b2c9b6a130 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.212+0000 7f1d3cff9640 1 -- 10.20.193.4:0/1893313874 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1d5c01ed30 con 0x55b2c9b6a130 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.212+0000 7f1d7b5a1e00 10 client.17574 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.212+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/1893313874 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55b2c9a056e0 con 0x55b2c9b6a130 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.213+0000 7f1d3cff9640 1 -- 10.20.193.4:0/1893313874 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f1d5c024030 con 0x55b2c9b6a130 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.213+0000 7f1d7b5a1e00 10 client.17574 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.213+0000 7f1d7b5a1e00 10 client.17574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.213+0000 7f1d7b5a1e00 20 client.17574 populate_metadata read hostname 'trial004' 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.213+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2c9bac820 0x55b2c9baccc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.213+0000 7f1d7b5a1e00 4 client.17574 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:48.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.213+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/1893313874 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2c9a654f0 con 0x55b2c9bac820 2026-02-24T09:17:48.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.213+0000 7f1d72ffd640 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2c9bac820 0x55b2c9baccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.213+0000 7f1d3cff9640 10 client.17574 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:48.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.213+0000 7f1d72ffd640 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2c9bac820 0x55b2c9baccc0 crc :-1 s=READY pgs=173 gs=4 cs=0 l=0 c_cookie=8949943023435242244 s_cookie=7062068977683467477 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c3495c2cfd7db04 server_cookie=620182519a210cd5 in_seq=0 out_seq=0 2026-02-24T09:17:48.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d3cff9640 1 -- 10.20.193.4:0/1893313874 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b2c9a654f0 con 0x55b2c9bac820 2026-02-24T09:17:48.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d3cff9640 10 client.17574 handle_command_reply: tid=0 2026-02-24T09:17:48.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 client.17574 shutdown 2026-02-24T09:17:48.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/1893313874 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 msgr2=0x55b2c9b82420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b82420 secure :-1 s=READY pgs=1085 gs=1 cs=0 l=1 c_cookie=12761118515814152485 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d5c011440 tx=0x7f1d5c00b410 comp rx=0 tx=0).stop 2026-02-24T09:17:48.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/1893313874 shutdown_connections 2026-02-24T09:17:48.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2c9bac820 0x55b2c9baccc0 crc :-1 s=READY pgs=173 gs=4 cs=0 l=0 c_cookie=8949943023435242244 s_cookie=7062068977683467477 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9b87410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b82420 unknown :-1 s=CLOSED pgs=1085 gs=1 cs=0 l=1 c_cookie=12761118515814152485 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d3cff9640 0 client.17574 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:48.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/1893313874 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b69820 0x55b2c9b81ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/1893313874 >> 10.20.193.4:0/1893313874 conn(0x55b2c9a886b0 msgr2=0x55b2c9b68810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:48.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/1893313874 shutdown_connections 2026-02-24T09:17:48.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/1893313874 wait complete. 2026-02-24T09:17:48.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.214+0000 7f1d7b5a1e00 20 client.17574 trim_cache size 0 max 16384 2026-02-24T09:17:48.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.226+0000 7f1d7b5a1e00 1 Processor -- start 2026-02-24T09:17:48.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.226+0000 7f1d7b5a1e00 1 -- start start 2026-02-24T09:17:48.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b69820 0x55b2c9b6f160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b86980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9b68a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9a6d6e0 con 0x55b2c9b6a130 2026-02-24T09:17:48.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9738f50 con 0x55b2c9baedd0 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9b87520 con 0x55b2c9b69820 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d727fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b86980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d727fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b86980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36482/0 (socket says 10.20.193.4:36482) 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d727fc640 1 -- 10.20.193.4:0/2628613017 learned_addr learned my addr 10.20.193.4:0/2628613017 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d737fe640 1 --2- 10.20.193.4:0/2628613017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9b68a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d72ffd640 1 --2- 10.20.193.4:0/2628613017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b69820 0x55b2c9b6f160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d727fc640 1 -- 10.20.193.4:0/2628613017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b69820 msgr2=0x55b2c9b6f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d727fc640 1 --2- 10.20.193.4:0/2628613017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b69820 0x55b2c9b6f160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d727fc640 1 -- 10.20.193.4:0/2628613017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 msgr2=0x55b2c9b68a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d727fc640 1 --2- 10.20.193.4:0/2628613017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9b68a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d727fc640 1 -- 10.20.193.4:0/2628613017 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c9a00160 con 0x55b2c9b6a130 2026-02-24T09:17:48.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d727fc640 1 --2- 10.20.193.4:0/2628613017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b86980 secure :-1 s=READY pgs=1086 gs=1 cs=0 l=1 c_cookie=1460058763720989452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d5c00b870 tx=0x7f1d5c029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14432bb5bac91b0c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d3effd640 1 -- 10.20.193.4:0/2628613017 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d5c01ed30 con 0x55b2c9b6a130 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d3effd640 1 -- 10.20.193.4:0/2628613017 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1d5c035070 con 0x55b2c9b6a130 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.227+0000 7f1d3effd640 1 -- 10.20.193.4:0/2628613017 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d5c025c20 con 0x55b2c9b6a130 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.228+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/2628613017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 msgr2=0x55b2c9b86980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.228+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/2628613017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b86980 secure :-1 s=READY pgs=1086 gs=1 cs=0 l=1 c_cookie=1460058763720989452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d5c00b870 tx=0x7f1d5c029000 comp rx=0 tx=0).stop 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.228+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/2628613017 shutdown_connections 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.228+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/2628613017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9baedd0 0x55b2c9b68a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.228+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/2628613017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b6a130 0x55b2c9b86980 unknown :-1 s=CLOSED pgs=1086 gs=1 cs=0 l=1 c_cookie=1460058763720989452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.228+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/2628613017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9b69820 0x55b2c9b6f160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.228+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/2628613017 >> 10.20.193.4:0/2628613017 conn(0x55b2c9a886b0 msgr2=0x55b2c9b86270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.228+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/2628613017 shutdown_connections 2026-02-24T09:17:48.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.228+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/2628613017 wait complete. 2026-02-24T09:17:48.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.228+0000 7f1d7b5a1e00 1 -- start start 2026-02-24T09:17:48.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 1 Processor -- start 2026-02-24T09:17:48.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b8daf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9b6a130 0x55b2c9b8e030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9baedd0 0x55b2c9b881d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9b82a00 con 0x55b2c9b69820 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9b88710 con 0x55b2c9b6a130 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b2c9b888d0 con 0x55b2c9baedd0 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d72ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b8daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d72ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b8daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36490/0 (socket says 10.20.193.4:36490) 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d72ffd640 1 -- 10.20.193.4:0/487957534 learned_addr learned my addr 10.20.193.4:0/487957534 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d727fc640 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9b6a130 0x55b2c9b8e030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d737fe640 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9baedd0 0x55b2c9b881d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d72ffd640 1 -- 10.20.193.4:0/487957534 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9baedd0 msgr2=0x55b2c9b881d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d72ffd640 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9baedd0 0x55b2c9b881d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d72ffd640 1 -- 10.20.193.4:0/487957534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9b6a130 msgr2=0x55b2c9b8e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:48.239 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d72ffd640 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9b6a130 0x55b2c9b8e030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d72ffd640 1 -- 10.20.193.4:0/487957534 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c99f3bf0 con 0x55b2c9b69820 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d727fc640 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9b6a130 0x55b2c9b8e030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d72ffd640 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b8daf0 secure :-1 s=READY pgs=1087 gs=1 cs=0 l=1 c_cookie=608646556274469728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d680cdc50 tx=0x7f1d68002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87258d174812b60 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d3cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d3cff9640 1 -- 10.20.193.4:0/487957534 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d680d3620 con 0x55b2c9b69820 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/487957534 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2c9a056e0 con 0x55b2c9b69820 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d3cff9640 1 -- 10.20.193.4:0/487957534 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1d680d0df0 con 0x55b2c9b69820 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d3cff9640 1 -- 10.20.193.4:0/487957534 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d680dc470 con 0x55b2c9b69820 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 10 client.17580 _ll_register_callbacks cb 0x55b2c9a0b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/487957534 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d64008e10 con 0x55b2c9b69820 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d3cff9640 1 -- 10.20.193.4:0/487957534 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1d680d2f30 con 0x55b2c9b69820 2026-02-24T09:17:48.240 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d3cff9640 1 -- 10.20.193.4:0/487957534 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1d680d1400 con 0x55b2c9b69820 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 10 client.17580 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/487957534 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55b2c9a05940 con 0x55b2c9b69820 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.229+0000 7f1d3cff9640 1 -- 10.20.193.4:0/487957534 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f1d68041b30 con 0x55b2c9b69820 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d7b5a1e00 10 client.17580 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d7b5a1e00 10 client.17580 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d7b5a1e00 20 client.17580 populate_metadata read hostname 'trial004' 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2c9c5ca00 0x55b2c9c7ceb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d7b5a1e00 4 client.17580 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/487957534 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2c97a4160 con 0x55b2c9c5ca00 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d727fc640 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2c9c5ca00 0x55b2c9c7ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d3cff9640 10 client.17580 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:48.241 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d727fc640 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2c9c5ca00 0x55b2c9c7ceb0 crc :-1 s=READY pgs=174 gs=4 cs=0 l=0 c_cookie=942272530708440529 s_cookie=10011974140310751948 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d139fdfd27c25d1 server_cookie=8af1ad6f559e8acc in_seq=0 out_seq=0 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d3cff9640 1 -- 10.20.193.4:0/487957534 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x55b2c97a4160 con 0x55b2c9c5ca00 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d3cff9640 10 client.17580 handle_command_reply: tid=0 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d7b5a1e00 1 client.17580 shutdown 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/487957534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 msgr2=0x55b2c9b8daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.230+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b8daf0 secure :-1 s=READY pgs=1087 gs=1 cs=0 l=1 c_cookie=608646556274469728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d680cdc50 tx=0x7f1d68002b90 comp rx=0 tx=0).stop 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/487957534 shutdown_connections 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b2c9c5ca00 0x55b2c9c7ceb0 crc :-1 s=READY pgs=174 gs=4 cs=0 l=0 c_cookie=942272530708440529 s_cookie=10011974140310751948 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b2c9baedd0 0x55b2c9b881d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b2c9b6a130 0x55b2c9b8e030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d7b5a1e00 1 --2- 10.20.193.4:0/487957534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b2c9b69820 0x55b2c9b8daf0 unknown :-1 s=CLOSED pgs=1087 gs=1 cs=0 l=1 c_cookie=608646556274469728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d3cff9640 0 client.17580 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:48.242 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/487957534 >> 10.20.193.4:0/487957534 conn(0x55b2c9a886b0 msgr2=0x55b2c9b86a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:48.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/487957534 shutdown_connections 2026-02-24T09:17:48.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d7b5a1e00 1 -- 10.20.193.4:0/487957534 wait complete. 2026-02-24T09:17:48.243 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d7b5a1e00 20 client.17580 trim_cache size 0 max 16384 2026-02-24T09:17:48.243 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:17:48.243 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:17:48.243 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:17:48.243 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:17:48.243 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.244 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.245 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.246 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:17:48.247 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.248 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.249 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.250 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:17:48.251 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:48.252 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:48.253 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:48.253 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:17:48.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 -- 10.20.193.4:0/4196937879 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d480b5640 msgr2=0x7f1d480d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d480b5640 0x7f1d480d5af0 secure :-1 s=READY pgs=409 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55b2c9aead30 tx=0x7f1d5c004770 comp rx=0 tx=0).stop 2026-02-24T09:17:48.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 -- 10.20.193.4:0/4196937879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d7410f650 msgr2=0x7f1d7411df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d7410f650 0x7f1d7411df00 secure :-1 s=READY pgs=1083 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d680023d0 tx=0x7f1d680043d0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 -- 10.20.193.4:0/4196937879 shutdown_connections 2026-02-24T09:17:48.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d480b5640 0x7f1d480d5af0 unknown :-1 s=CLOSED pgs=409 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d74115840 0x7f1d74123810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d74110040 0x7f1d7411e440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 --2- 10.20.193.4:0/4196937879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d7410f650 0x7f1d7411df00 unknown :-1 s=CLOSED pgs=1083 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 -- 10.20.193.4:0/4196937879 >> 10.20.193.4:0/4196937879 conn(0x7f1d740ecf20 msgr2=0x7f1d7410d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:48.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 -- 10.20.193.4:0/4196937879 shutdown_connections 2026-02-24T09:17:48.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.231+0000 7f1d795a7640 1 -- 10.20.193.4:0/4196937879 wait complete. 2026-02-24T09:17:48.291 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:17:48.291 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:17:48.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:47 trial090 ceph-mon[47278]: pgmap v392: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 819 MiB/s wr, 233 op/s 2026-02-24T09:17:48.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:47 trial014 ceph-mon[46941]: pgmap v392: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 819 MiB/s wr, 233 op/s 2026-02-24T09:17:48.465 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 -- 10.20.193.4:0/2199114080 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f505c114a10 msgr2=0x7f505c119560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 --2- 10.20.193.4:0/2199114080 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f505c114a10 0x7f505c119560 secure :-1 s=READY pgs=1088 gs=1 cs=0 l=1 c_cookie=14800020833111030816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f504c009950 tx=0x7f504c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 -- 10.20.193.4:0/2199114080 shutdown_connections 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 --2- 10.20.193.4:0/2199114080 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f505c119d10 0x7f505c17a6e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 --2- 10.20.193.4:0/2199114080 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f505c114a10 0x7f505c119560 unknown :-1 s=CLOSED pgs=1088 gs=1 cs=0 l=1 c_cookie=14800020833111030816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 --2- 10.20.193.4:0/2199114080 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f505c114020 0x7f505c1143f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 -- 10.20.193.4:0/2199114080 >> 10.20.193.4:0/2199114080 conn(0x7f505c064c40 msgr2=0x7f505c065040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 -- 10.20.193.4:0/2199114080 shutdown_connections 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 -- 10.20.193.4:0/2199114080 wait complete. 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 Processor -- start 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 -- start start 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f505c114020 0x7f505c122430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f505c114a10 0x7f505c122970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f505c119d10 0x7f505c127d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f505c128360 con 0x7f505c114a10 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f505c1284d0 con 0x7f505c114020 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5062884640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f505c128690 con 0x7f505c119d10 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f505b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f505c114a10 0x7f505c122970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f505b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f505c114a10 0x7f505c122970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36518/0 (socket says 10.20.193.4:36518) 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f505b7fe640 1 -- 10.20.193.4:0/3544154469 learned_addr learned my addr 10.20.193.4:0/3544154469 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f505bfff640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f505c114020 0x7f505c122430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.604+0000 7f5060dfa640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f505c119d10 0x7f505c127d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f505b7fe640 1 -- 10.20.193.4:0/3544154469 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f505c119d10 msgr2=0x7f505c127d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f505b7fe640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f505c119d10 0x7f505c127d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f505b7fe640 1 -- 10.20.193.4:0/3544154469 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f505c114020 msgr2=0x7f505c122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f505b7fe640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f505c114020 0x7f505c122430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f505b7fe640 1 -- 10.20.193.4:0/3544154469 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504c009570 con 0x7f505c114a10 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f5060dfa640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f505c119d10 0x7f505c127d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f505b7fe640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f505c114a10 0x7f505c122970 secure :-1 s=READY pgs=1089 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f504c038820 tx=0x7f504c0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f50597fa640 1 -- 10.20.193.4:0/3544154469 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f504c03d070 con 0x7f505c114a10 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f5062884640 1 -- 10.20.193.4:0/3544154469 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505c128910 con 0x7f505c114a10 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f50597fa640 1 -- 10.20.193.4:0/3544154469 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f504c038920 con 0x7f505c114a10 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f50597fa640 1 -- 10.20.193.4:0/3544154469 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f504c041960 con 0x7f505c114a10 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f5062884640 1 -- 10.20.193.4:0/3544154469 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f505c169070 con 0x7f505c114a10 2026-02-24T09:17:48.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.605+0000 7f5062884640 1 -- 10.20.193.4:0/3544154469 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f505c128be0 con 0x7f505c114a10 2026-02-24T09:17:48.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.607+0000 7f50597fa640 1 -- 10.20.193.4:0/3544154469 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f504c038a90 con 0x7f505c114a10 2026-02-24T09:17:48.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.607+0000 7f50597fa640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50300b56e0 0x7f50300d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:48.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.608+0000 7f50597fa640 1 -- 10.20.193.4:0/3544154469 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f504c10b530 con 0x7f505c114a10 2026-02-24T09:17:48.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.608+0000 7f505bfff640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50300b56e0 0x7f50300d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:48.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.608+0000 7f505bfff640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50300b56e0 0x7f50300d5b90 secure :-1 s=READY pgs=410 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5048004740 tx=0x7f504800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:48.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.608+0000 7f50597fa640 1 -- 10.20.193.4:0/3544154469 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f504c0cdf80 con 0x7f505c114a10 2026-02-24T09:17:48.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.768+0000 7f5062884640 1 -- 10.20.193.4:0/3544154469 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f505c114e00 con 0x7f505c114a10 2026-02-24T09:17:48.773 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:17:48.773 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:17:48.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.768+0000 7f50597fa640 1 -- 10.20.193.4:0/3544154469 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f504c0d10a0 con 0x7f505c114a10 2026-02-24T09:17:48.773 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:17:48.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 -- 10.20.193.4:0/3544154469 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50300b56e0 msgr2=0x7f50300d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50300b56e0 0x7f50300d5b90 secure :-1 s=READY pgs=410 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5048004740 tx=0x7f504800b410 comp rx=0 tx=0).stop 2026-02-24T09:17:48.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 -- 10.20.193.4:0/3544154469 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f505c114a10 msgr2=0x7f505c122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:48.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f505c114a10 0x7f505c122970 secure :-1 s=READY pgs=1089 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f504c038820 tx=0x7f504c0043d0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 -- 10.20.193.4:0/3544154469 shutdown_connections 2026-02-24T09:17:48.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50300b56e0 0x7f50300d5b90 unknown :-1 s=CLOSED pgs=410 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f505c119d10 0x7f505c127d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f505c114a10 0x7f505c122970 unknown :-1 s=CLOSED pgs=1089 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 --2- 10.20.193.4:0/3544154469 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f505c114020 0x7f505c122430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:48.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 -- 10.20.193.4:0/3544154469 >> 10.20.193.4:0/3544154469 conn(0x7f505c064c40 msgr2=0x7f505c117b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:48.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 -- 10.20.193.4:0/3544154469 shutdown_connections 2026-02-24T09:17:48.779 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:48.774+0000 7f5062884640 1 -- 10.20.193.4:0/3544154469 wait complete. 2026-02-24T09:17:48.827 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:17:48.975 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:49.024 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:48 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3544154469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:49.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.119+0000 7fed184aa640 1 -- 10.20.193.4:0/3742527830 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fed101135c0 msgr2=0x7fed10173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.119+0000 7fed184aa640 1 --2- 10.20.193.4:0/3742527830 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fed101135c0 0x7fed10173f90 secure :-1 s=READY pgs=1090 gs=3 cs=0 l=1 c_cookie=4864019258715825255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed0c00a970 tx=0x7fed0c0301b0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.121+0000 7fed184aa640 1 -- 10.20.193.4:0/3742527830 shutdown_connections 2026-02-24T09:17:49.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.121+0000 7fed184aa640 1 --2- 10.20.193.4:0/3742527830 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fed101135c0 0x7fed10173f90 unknown :-1 s=CLOSED pgs=1090 gs=3 cs=0 l=1 c_cookie=4864019258715825255 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.121+0000 7fed184aa640 1 --2- 10.20.193.4:0/3742527830 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fed1010ddc0 0x7fed10112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.121+0000 7fed184aa640 1 --2- 10.20.193.4:0/3742527830 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fed1010d3d0 0x7fed1010d7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.121+0000 7fed184aa640 1 -- 10.20.193.4:0/3742527830 >> 10.20.193.4:0/3742527830 conn(0x7fed100eaca0 msgr2=0x7fed1010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.121+0000 7fed184aa640 1 -- 10.20.193.4:0/3742527830 shutdown_connections 2026-02-24T09:17:49.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.121+0000 7fed184aa640 1 -- 10.20.193.4:0/3742527830 wait complete. 2026-02-24T09:17:49.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed184aa640 1 Processor -- start 2026-02-24T09:17:49.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed184aa640 1 -- start start 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed184aa640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fed1010d3d0 0x7fed100f5630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed184aa640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fed1010ddc0 0x7fed10173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed184aa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fed101135c0 0x7fed100f5d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed184aa640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fed100faf40 con 0x7fed101135c0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed184aa640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fed100fb0b0 con 0x7fed1010d3d0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed184aa640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fed100fb270 con 0x7fed1010ddc0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed16a20640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fed101135c0 0x7fed100f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed16a20640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fed101135c0 0x7fed100f5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36540/0 (socket says 10.20.193.4:36540) 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed16a20640 1 -- 10.20.193.4:0/1645371839 learned_addr learned my addr 10.20.193.4:0/1645371839 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed15a1e640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fed1010ddc0 0x7fed10173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed1621f640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fed1010d3d0 0x7fed100f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed16a20640 1 -- 10.20.193.4:0/1645371839 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fed1010ddc0 msgr2=0x7fed10173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed16a20640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fed1010ddc0 0x7fed10173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed16a20640 1 -- 10.20.193.4:0/1645371839 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fed1010d3d0 msgr2=0x7fed100f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed16a20640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fed1010d3d0 0x7fed100f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed16a20640 1 -- 10.20.193.4:0/1645371839 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed00009570 con 0x7fed101135c0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed16a20640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fed101135c0 0x7fed100f5d30 secure :-1 s=READY pgs=1091 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed0c00a2b0 tx=0x7fed0c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fecf77fe640 1 -- 10.20.193.4:0/1645371839 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed0c03e070 con 0x7fed101135c0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.123+0000 7fed184aa640 1 -- 10.20.193.4:0/1645371839 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed040094b0 con 0x7fed101135c0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.124+0000 7fed184aa640 1 -- 10.20.193.4:0/1645371839 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed0c00a590 con 0x7fed101135c0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.124+0000 7fecf77fe640 1 -- 10.20.193.4:0/1645371839 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fed0c003aa0 con 0x7fed101135c0 2026-02-24T09:17:49.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.124+0000 7fecf77fe640 1 -- 10.20.193.4:0/1645371839 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed0c042a90 con 0x7fed101135c0 2026-02-24T09:17:49.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.126+0000 7fecf77fe640 1 -- 10.20.193.4:0/1645371839 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fed0c04a060 con 0x7fed101135c0 2026-02-24T09:17:49.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.126+0000 7fecf77fe640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fecec0b5750 0x7fecec0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.126+0000 7fecf77fe640 1 -- 10.20.193.4:0/1645371839 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fed0c10d470 con 0x7fed101135c0 2026-02-24T09:17:49.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.126+0000 7fed1621f640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fecec0b5750 0x7fecec0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.127+0000 7fed1621f640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fecec0b5750 0x7fecec0d5c00 secure :-1 s=READY pgs=411 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed00005b30 tx=0x7fed00009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.128+0000 7fed1a4a4e00 1 Processor -- start 2026-02-24T09:17:49.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.128+0000 7fed1a4a4e00 1 -- start start 2026-02-24T09:17:49.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.128+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e81f50 0x561c16e82320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec6fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16ec7500 0x561c16ee78e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c16d92ee0 con 0x561c16e82860 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c16d8ec10 con 0x561c16e81f50 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c16d88d70 con 0x561c16ec7500 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed15a1e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed15a1e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36554/0 (socket says 10.20.193.4:36554) 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed15a1e640 1 -- 10.20.193.4:0/791911879 learned_addr learned my addr 10.20.193.4:0/791911879 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed16a20640 1 --2- 10.20.193.4:0/791911879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16ec7500 0x561c16ee78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed1621f640 1 --2- 10.20.193.4:0/791911879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e81f50 0x561c16e82320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed15a1e640 1 -- 10.20.193.4:0/791911879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16ec7500 msgr2=0x561c16ee78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed15a1e640 1 --2- 10.20.193.4:0/791911879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16ec7500 0x561c16ee78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed15a1e640 1 -- 10.20.193.4:0/791911879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e81f50 msgr2=0x561c16e82320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed15a1e640 1 --2- 10.20.193.4:0/791911879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e81f50 0x561c16e82320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed15a1e640 1 -- 10.20.193.4:0/791911879 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c16d34340 con 0x561c16e82860 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fed15a1e640 1 --2- 10.20.193.4:0/791911879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec6fc0 secure :-1 s=READY pgs=1092 gs=1 cs=0 l=1 c_cookie=12114691080705271721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed04009880 tx=0x7fed04009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8200759fd07e7a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fecf4a6d640 1 -- 10.20.193.4:0/791911879 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed04002c20 con 0x561c16e82860 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fecf4a6d640 1 -- 10.20.193.4:0/791911879 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fed04002d80 con 0x561c16e82860 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.129+0000 7fecf4a6d640 1 -- 10.20.193.4:0/791911879 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed04010a20 con 0x561c16e82860 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.130+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/791911879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 msgr2=0x561c16ec6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.130+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/791911879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec6fc0 secure :-1 s=READY pgs=1092 gs=1 cs=0 l=1 c_cookie=12114691080705271721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed04009880 tx=0x7fed04009d50 comp rx=0 tx=0).stop 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.130+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/791911879 shutdown_connections 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.130+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/791911879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16ec7500 0x561c16ee78e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.136 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.130+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/791911879 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec6fc0 unknown :-1 s=CLOSED pgs=1092 gs=1 cs=0 l=1 c_cookie=12114691080705271721 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.130+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/791911879 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e81f50 0x561c16e82320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.130+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/791911879 >> 10.20.193.4:0/791911879 conn(0x561c16da0db0 msgr2=0x561c16e80830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.130+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/791911879 shutdown_connections 2026-02-24T09:17:49.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.130+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/791911879 wait complete. 2026-02-24T09:17:49.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1a4a4e00 1 -- start start 2026-02-24T09:17:49.137 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1a4a4e00 1 Processor -- start 2026-02-24T09:17:49.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e81f50 0x561c16ededf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16e82860 0x561c16edf330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16ec7500 0x561c16ee4320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c16ee4860 con 0x561c16e81f50 2026-02-24T09:17:49.141 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c16ee49d0 con 0x561c16ec7500 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c16ee4b90 con 0x561c16e82860 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1621f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e81f50 0x561c16ededf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1621f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e81f50 0x561c16ededf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36556/0 (socket says 10.20.193.4:36556) 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1621f640 1 -- 10.20.193.4:0/2464858833 learned_addr learned my addr 10.20.193.4:0/2464858833 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed16a20640 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16ec7500 0x561c16ee4320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed15a1e640 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16e82860 0x561c16edf330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1621f640 1 -- 10.20.193.4:0/2464858833 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16e82860 msgr2=0x561c16edf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1621f640 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16e82860 0x561c16edf330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1621f640 1 -- 10.20.193.4:0/2464858833 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16ec7500 msgr2=0x561c16ee4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1621f640 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16ec7500 0x561c16ee4320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1621f640 1 -- 10.20.193.4:0/2464858833 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c16d0c9d0 con 0x561c16e81f50 2026-02-24T09:17:49.142 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fed1621f640 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e81f50 0x561c16ededf0 secure :-1 s=READY pgs=1093 gs=1 cs=0 l=1 c_cookie=3452742032947946959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed00011740 tx=0x7fed000047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fea9a95e6ec25cf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fecbbfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.131+0000 7fecbbfff640 1 -- 10.20.193.4:0/2464858833 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed00021070 con 0x561c16e81f50 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2464858833 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed04004480 con 0x561c16e81f50 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fecbbfff640 1 -- 10.20.193.4:0/2464858833 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fed0001a450 con 0x561c16e81f50 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fecbbfff640 1 -- 10.20.193.4:0/2464858833 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed00025690 con 0x561c16e81f50 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 10 client.17598 _ll_register_callbacks cb 0x561c16d33080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2464858833 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c16ad84a0 con 0x561c16e81f50 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fecbbfff640 1 -- 10.20.193.4:0/2464858833 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fed000257f0 con 0x561c16e81f50 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fecbbfff640 1 -- 10.20.193.4:0/2464858833 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fed000259f0 con 0x561c16e81f50 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 10 client.17598 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2464858833 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561c16d1e710 con 0x561c16e81f50 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fecbbfff640 1 -- 10.20.193.4:0/2464858833 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fed00025c50 con 0x561c16e81f50 2026-02-24T09:17:49.143 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 10 client.17598 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 10 client.17598 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 20 client.17598 populate_metadata read hostname 'trial004' 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561c16ec48a0 0x561c16ec4d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 4 client.17598 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.132+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2464858833 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c16d7e7b0 con 0x561c16ec48a0 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.133+0000 7fed15a1e640 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561c16ec48a0 0x561c16ec4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.133+0000 7fed15a1e640 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561c16ec48a0 0x561c16ec4d10 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=14651525710150445053 s_cookie=274238219507914720 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb54ad019b0527fd server_cookie=3ce4a35299ad7e0 in_seq=0 out_seq=0 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.133+0000 7fecbbfff640 10 client.17598 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fecbbfff640 1 -- 10.20.193.4:0/2464858833 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561c16d7e7b0 con 0x561c16ec48a0 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fecbbfff640 10 client.17598 handle_command_reply: tid=0 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 client.17598 shutdown 2026-02-24T09:17:49.144 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2464858833 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e81f50 msgr2=0x561c16ededf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e81f50 0x561c16ededf0 secure :-1 s=READY pgs=1093 gs=1 cs=0 l=1 c_cookie=3452742032947946959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed00011740 tx=0x7fed000047e0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2464858833 shutdown_connections 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561c16ec48a0 0x561c16ec4d10 crc :-1 s=READY pgs=50 gs=4 cs=0 l=0 c_cookie=14651525710150445053 s_cookie=274238219507914720 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16ec7500 0x561c16ee4320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16e82860 0x561c16edf330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2464858833 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e81f50 0x561c16ededf0 unknown :-1 s=CLOSED pgs=1093 gs=1 cs=0 l=1 c_cookie=3452742032947946959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fecbbfff640 0 client.17598 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2464858833 >> 10.20.193.4:0/2464858833 conn(0x561c16da0db0 msgr2=0x561c16e80040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2464858833 shutdown_connections 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2464858833 wait complete. 2026-02-24T09:17:49.145 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.134+0000 7fed1a4a4e00 20 client.17598 trim_cache size 0 max 16384 2026-02-24T09:17:49.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.144+0000 7fed1a4a4e00 1 Processor -- start 2026-02-24T09:17:49.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.144+0000 7fed1a4a4e00 1 -- start start 2026-02-24T09:17:49.149 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e81f50 0x561c16ee3890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec2160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16ec7500 0x561c16ec26a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c16d869a0 con 0x561c16e82860 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c16b62df0 con 0x561c16e81f50 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c16e1bf70 con 0x561c16ec7500 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed15a1e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec2160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed1621f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e81f50 0x561c16ee3890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed15a1e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec2160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36570/0 (socket says 10.20.193.4:36570) 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed15a1e640 1 -- 10.20.193.4:0/826784095 learned_addr learned my addr 10.20.193.4:0/826784095 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed16a20640 1 --2- 10.20.193.4:0/826784095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16ec7500 0x561c16ec26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed15a1e640 1 -- 10.20.193.4:0/826784095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16ec7500 msgr2=0x561c16ec26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.150 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed15a1e640 1 --2- 10.20.193.4:0/826784095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16ec7500 0x561c16ec26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed15a1e640 1 -- 10.20.193.4:0/826784095 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e81f50 msgr2=0x561c16ee3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed15a1e640 1 --2- 10.20.193.4:0/826784095 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e81f50 0x561c16ee3890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed15a1e640 1 -- 10.20.193.4:0/826784095 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c16ed1450 con 0x561c16e82860 2026-02-24T09:17:49.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fed15a1e640 1 --2- 10.20.193.4:0/826784095 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec2160 secure :-1 s=READY pgs=1094 gs=2 cs=0 l=1 c_cookie=7362012567160310760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed04009fd0 tx=0x7fed04009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662b1f6c998d4be8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fecde4e6640 1 -- 10.20.193.4:0/826784095 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed0401aea0 con 0x561c16e82860 2026-02-24T09:17:49.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fecde4e6640 1 -- 10.20.193.4:0/826784095 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fed04005520 con 0x561c16e82860 2026-02-24T09:17:49.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.145+0000 7fecde4e6640 1 -- 10.20.193.4:0/826784095 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed040105e0 con 0x561c16e82860 2026-02-24T09:17:49.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.146+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/826784095 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 msgr2=0x561c16ec2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.146+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/826784095 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec2160 secure :-1 s=READY pgs=1094 gs=2 cs=0 l=1 c_cookie=7362012567160310760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed04009fd0 tx=0x7fed04009790 comp rx=0 tx=0).stop 2026-02-24T09:17:49.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.146+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/826784095 shutdown_connections 2026-02-24T09:17:49.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.146+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/826784095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16ec7500 0x561c16ec26a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.146+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/826784095 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16e82860 0x561c16ec2160 unknown :-1 s=CLOSED pgs=1094 gs=2 cs=0 l=1 c_cookie=7362012567160310760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.146+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/826784095 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e81f50 0x561c16ee3890 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.146+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/826784095 >> 10.20.193.4:0/826784095 conn(0x561c16da0db0 msgr2=0x561c16ee3180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.146+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/826784095 shutdown_connections 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.147+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/826784095 wait complete. 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.147+0000 7fed1a4a4e00 1 -- start start 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.147+0000 7fed1a4a4e00 1 Processor -- start 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.147+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16e81f50 0x561c16e60030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e82860 0x561c16e60570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed1a4a4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16ec7500 0x561c16e60ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561c16ec7040 con 0x561c16ec7500 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561c16ec7180 con 0x561c16e82860 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed1a4a4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561c16ec7340 con 0x561c16e81f50 2026-02-24T09:17:49.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed16a20640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16ec7500 0x561c16e60ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed16a20640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16ec7500 0x561c16e60ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36578/0 (socket says 10.20.193.4:36578) 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed16a20640 1 -- 10.20.193.4:0/2049927824 learned_addr learned my addr 10.20.193.4:0/2049927824 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed1621f640 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16e81f50 0x561c16e60030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed16a20640 1 -- 10.20.193.4:0/2049927824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16e81f50 msgr2=0x561c16e60030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed16a20640 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16e81f50 0x561c16e60030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed16a20640 1 -- 10.20.193.4:0/2049927824 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e82860 msgr2=0x561c16e60570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed16a20640 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e82860 0x561c16e60570 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed16a20640 1 -- 10.20.193.4:0/2049927824 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c16d19190 con 0x561c16ec7500 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed16a20640 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16ec7500 0x561c16e60ab0 secure :-1 s=READY pgs=1095 gs=1 cs=0 l=1 c_cookie=9756716010847712315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed0c0cfd70 tx=0x7fed0c006fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8766d184c0f1b43b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fecc3fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fecc3fff640 1 -- 10.20.193.4:0/2049927824 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed0c0d2fa0 con 0x561c16ec7500 2026-02-24T09:17:49.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2049927824 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c16d34340 con 0x561c16ec7500 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed1a4a4e00 10 client.17604 _ll_register_callbacks cb 0x561c16d33080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fecc3fff640 1 -- 10.20.193.4:0/2049927824 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fed0c00c0b0 con 0x561c16ec7500 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fecc3fff640 1 -- 10.20.193.4:0/2049927824 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed0c042e70 con 0x561c16ec7500 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2049927824 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed04002d80 con 0x561c16ec7500 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.148+0000 7fecc3fff640 1 -- 10.20.193.4:0/2049927824 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fed0c0de8e0 con 0x561c16ec7500 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.149+0000 7fecc3fff640 1 -- 10.20.193.4:0/2049927824 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fed0c006c00 con 0x561c16ec7500 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.149+0000 7fed1a4a4e00 10 client.17604 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.149+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2049927824 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561c16d0cd00 con 0x561c16ec7500 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.149+0000 7fecc3fff640 1 -- 10.20.193.4:0/2049927824 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fed0c0d3340 con 0x561c16ec7500 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.149+0000 7fed1a4a4e00 10 client.17604 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.149+0000 7fed1a4a4e00 10 client.17604 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:17:49.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.149+0000 7fed1a4a4e00 20 client.17604 populate_metadata read hostname 'trial004' 2026-02-24T09:17:49.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.149+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561c16f74d90 0x561c16f95240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.149+0000 7fed1a4a4e00 4 client.17604 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:17:49.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.149+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2049927824 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c16abd160 con 0x561c16f74d90 2026-02-24T09:17:49.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.151+0000 7fed1621f640 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561c16f74d90 0x561c16f95240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1621f640 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561c16f74d90 0x561c16f95240 crc :-1 s=READY pgs=51 gs=3 cs=0 l=0 c_cookie=7669610924149843564 s_cookie=10525615467666193504 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6a6fee800b68266c server_cookie=92127f803099bc60 in_seq=0 out_seq=0 2026-02-24T09:17:49.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fecc3fff640 10 client.17604 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fecc3fff640 1 -- 10.20.193.4:0/2049927824 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c16abd160 con 0x561c16f74d90 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fecc3fff640 10 client.17604 handle_command_reply: tid=0 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 client.17604 shutdown 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2049927824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16ec7500 msgr2=0x561c16e60ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16ec7500 0x561c16e60ab0 secure :-1 s=READY pgs=1095 gs=1 cs=0 l=1 c_cookie=9756716010847712315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed0c0cfd70 tx=0x7fed0c006fa0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2049927824 shutdown_connections 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x561c16f74d90 0x561c16f95240 crc :-1 s=READY pgs=51 gs=3 cs=0 l=0 c_cookie=7669610924149843564 s_cookie=10525615467666193504 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561c16ec7500 0x561c16e60ab0 unknown :-1 s=CLOSED pgs=1095 gs=1 cs=0 l=1 c_cookie=9756716010847712315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fecc3fff640 0 client.17604 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561c16e82860 0x561c16e60570 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 --2- 10.20.193.4:0/2049927824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561c16e81f50 0x561c16e60030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2049927824 >> 10.20.193.4:0/2049927824 conn(0x561c16da0db0 msgr2=0x561c16ee3970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2049927824 shutdown_connections 2026-02-24T09:17:49.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 1 -- 10.20.193.4:0/2049927824 wait complete. 2026-02-24T09:17:49.161 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.153+0000 7fed1a4a4e00 20 client.17604 trim_cache size 0 max 16384 2026-02-24T09:17:49.161 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:17:49.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 -- 10.20.193.4:0/1645371839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fecec0b5750 msgr2=0x7fecec0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fecec0b5750 0x7fecec0d5c00 secure :-1 s=READY pgs=411 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed00005b30 tx=0x7fed00009310 comp rx=0 tx=0).stop 2026-02-24T09:17:49.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 -- 10.20.193.4:0/1645371839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fed101135c0 msgr2=0x7fed100f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fed101135c0 0x7fed100f5d30 secure :-1 s=READY pgs=1091 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed0c00a2b0 tx=0x7fed0c0039b0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 -- 10.20.193.4:0/1645371839 shutdown_connections 2026-02-24T09:17:49.162 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fecec0b5750 0x7fecec0d5c00 unknown :-1 s=CLOSED pgs=411 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fed101135c0 0x7fed100f5d30 unknown :-1 s=CLOSED pgs=1091 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fed1010ddc0 0x7fed10173e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 --2- 10.20.193.4:0/1645371839 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fed1010d3d0 0x7fed100f5630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 -- 10.20.193.4:0/1645371839 >> 10.20.193.4:0/1645371839 conn(0x7fed100eaca0 msgr2=0x7fed101103c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 -- 10.20.193.4:0/1645371839 shutdown_connections 2026-02-24T09:17:49.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.154+0000 7fed184aa640 1 -- 10.20.193.4:0/1645371839 wait complete. 2026-02-24T09:17:49.219 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:17:49.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:48 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3544154469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:49.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:48 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3544154469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:17:49.365 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.505+0000 7f36482aa640 1 -- 10.20.193.4:0/3846191966 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f364010d470 msgr2=0x7f364010d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.505+0000 7f36482aa640 1 --2- 10.20.193.4:0/3846191966 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f364010d470 0x7f364010d840 secure :-1 s=READY pgs=1096 gs=1 cs=0 l=1 c_cookie=14538002872589149388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3630009950 tx=0x7f363002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.505+0000 7f36482aa640 1 -- 10.20.193.4:0/3846191966 shutdown_connections 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.505+0000 7f36482aa640 1 --2- 10.20.193.4:0/3846191966 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3640113660 0x7f3640174030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.505+0000 7f36482aa640 1 --2- 10.20.193.4:0/3846191966 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f364010de60 0x7f3640112eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.505+0000 7f36482aa640 1 --2- 10.20.193.4:0/3846191966 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f364010d470 0x7f364010d840 unknown :-1 s=CLOSED pgs=1096 gs=1 cs=0 l=1 c_cookie=14538002872589149388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.505+0000 7f36482aa640 1 -- 10.20.193.4:0/3846191966 >> 10.20.193.4:0/3846191966 conn(0x7f36400ead40 msgr2=0x7f364010b150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.505+0000 7f36482aa640 1 -- 10.20.193.4:0/3846191966 shutdown_connections 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.505+0000 7f36482aa640 1 -- 10.20.193.4:0/3846191966 wait complete. 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f36482aa640 1 Processor -- start 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f36482aa640 1 -- start start 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f36482aa640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f364010d470 0x7f36400f5990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f36482aa640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f364010de60 0x7f3640173f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f36482aa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3640113660 0x7f36400f6090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f36482aa640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f36400fb2a0 con 0x7f3640113660 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f36482aa640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f36400fb410 con 0x7f364010d470 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f36482aa640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f36400fb5d0 con 0x7f364010de60 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f3646820640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3640113660 0x7f36400f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f364581e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f364010de60 0x7f3640173f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f3646820640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3640113660 0x7f36400f6090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36592/0 (socket says 10.20.193.4:36592) 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f3646820640 1 -- 10.20.193.4:0/2490536332 learned_addr learned my addr 10.20.193.4:0/2490536332 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f3646820640 1 -- 10.20.193.4:0/2490536332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f364010de60 msgr2=0x7f3640173f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f3646820640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f364010de60 0x7f3640173f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f3646820640 1 -- 10.20.193.4:0/2490536332 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f364010d470 msgr2=0x7f36400f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f3646820640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f364010d470 0x7f36400f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.510 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f3646820640 1 -- 10.20.193.4:0/2490536332 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3630009570 con 0x7f3640113660 2026-02-24T09:17:49.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f3646820640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3640113660 0x7f36400f6090 secure :-1 s=READY pgs=1097 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f363c006e90 tx=0x7f363c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f36277fe640 1 -- 10.20.193.4:0/2490536332 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f363c005500 con 0x7f3640113660 2026-02-24T09:17:49.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.506+0000 7f36277fe640 1 -- 10.20.193.4:0/2490536332 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f363c005e10 con 0x7f3640113660 2026-02-24T09:17:49.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.507+0000 7f36277fe640 1 -- 10.20.193.4:0/2490536332 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f363c003a90 con 0x7f3640113660 2026-02-24T09:17:49.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.507+0000 7f36482aa640 1 -- 10.20.193.4:0/2490536332 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36400fb8b0 con 0x7f3640113660 2026-02-24T09:17:49.511 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.507+0000 7f36482aa640 1 -- 10.20.193.4:0/2490536332 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36400fbd30 con 0x7f3640113660 2026-02-24T09:17:49.512 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.509+0000 7f36277fe640 1 -- 10.20.193.4:0/2490536332 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f363c00c840 con 0x7f3640113660 2026-02-24T09:17:49.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.509+0000 7f36277fe640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f361c0b56d0 0x7f361c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.509+0000 7f36277fe640 1 -- 10.20.193.4:0/2490536332 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f363c0e7630 con 0x7f3640113660 2026-02-24T09:17:49.513 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.509+0000 7f364601f640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f361c0b56d0 0x7f361c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.514 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.510+0000 7f364601f640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f361c0b56d0 0x7f361c0d5b80 secure :-1 s=READY pgs=412 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f363002f6e0 tx=0x7f3630005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.512+0000 7f364a2a4e00 1 Processor -- start 2026-02-24T09:17:49.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.512+0000 7f364a2a4e00 1 -- start start 2026-02-24T09:17:49.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6a9f50 0x55bebf6aa320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf6eefc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.518 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 0x55bebf70f8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bebf5baee0 con 0x55bebf6aa860 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bebf5b6c10 con 0x55bebf6a9f50 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bebf5b0d70 con 0x55bebf6ef500 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364581e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf6eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364581e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf6eefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36596/0 (socket says 10.20.193.4:36596) 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364581e640 1 -- 10.20.193.4:0/1530851723 learned_addr learned my addr 10.20.193.4:0/1530851723 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f3646820640 1 --2- 10.20.193.4:0/1530851723 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 0x55bebf70f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364601f640 1 --2- 10.20.193.4:0/1530851723 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6a9f50 0x55bebf6aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364581e640 1 -- 10.20.193.4:0/1530851723 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 msgr2=0x55bebf70f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364581e640 1 --2- 10.20.193.4:0/1530851723 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 0x55bebf70f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364581e640 1 -- 10.20.193.4:0/1530851723 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6a9f50 msgr2=0x55bebf6aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.519 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364581e640 1 --2- 10.20.193.4:0/1530851723 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6a9f50 0x55bebf6aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364581e640 1 -- 10.20.193.4:0/1530851723 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bebf55c340 con 0x55bebf6aa860 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f364581e640 1 --2- 10.20.193.4:0/1530851723 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf6eefc0 secure :-1 s=READY pgs=1098 gs=1 cs=0 l=1 c_cookie=13418079988258252392 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f363400bd10 tx=0x7f36340107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3698a843e92668 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f3624884640 1 -- 10.20.193.4:0/1530851723 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36340042f0 con 0x55bebf6aa860 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f3624884640 1 -- 10.20.193.4:0/1530851723 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f363400be10 con 0x55bebf6aa860 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.513+0000 7f3624884640 1 -- 10.20.193.4:0/1530851723 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f363401a9c0 con 0x55bebf6aa860 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.514+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1530851723 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 msgr2=0x55bebf6eefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.514+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/1530851723 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf6eefc0 secure :-1 s=READY pgs=1098 gs=1 cs=0 l=1 c_cookie=13418079988258252392 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f363400bd10 tx=0x7f36340107a0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.514+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1530851723 shutdown_connections 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.514+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/1530851723 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 0x55bebf70f8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.514+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/1530851723 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf6eefc0 unknown :-1 s=CLOSED pgs=1098 gs=1 cs=0 l=1 c_cookie=13418079988258252392 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.514+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/1530851723 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6a9f50 0x55bebf6aa320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.520 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.514+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1530851723 >> 10.20.193.4:0/1530851723 conn(0x55bebf5c8db0 msgr2=0x55bebf6a8830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.514+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1530851723 shutdown_connections 2026-02-24T09:17:49.521 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.514+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1530851723 wait complete. 2026-02-24T09:17:49.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364a2a4e00 1 -- start start 2026-02-24T09:17:49.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364a2a4e00 1 Processor -- start 2026-02-24T09:17:49.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6a9f50 0x55bebf706d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6aa860 0x55bebf707270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 0x55bebf70c260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bebf70c7a0 con 0x55bebf6a9f50 2026-02-24T09:17:49.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bebf70c910 con 0x55bebf6aa860 2026-02-24T09:17:49.524 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bebf70cad0 con 0x55bebf6ef500 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364601f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6a9f50 0x55bebf706d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364601f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6a9f50 0x55bebf706d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36602/0 (socket says 10.20.193.4:36602) 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.515+0000 7f364601f640 1 -- 10.20.193.4:0/1791395512 learned_addr learned my addr 10.20.193.4:0/1791395512 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364581e640 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6aa860 0x55bebf707270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364601f640 1 -- 10.20.193.4:0/1791395512 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 msgr2=0x55bebf70c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f3646820640 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 0x55bebf70c260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364601f640 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 0x55bebf70c260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364601f640 1 -- 10.20.193.4:0/1791395512 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6aa860 msgr2=0x55bebf707270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364601f640 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6aa860 0x55bebf707270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364601f640 1 -- 10.20.193.4:0/1791395512 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bebf5349d0 con 0x55bebf6a9f50 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364581e640 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6aa860 0x55bebf707270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:49.525 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f3646820640 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 0x55bebf70c260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364601f640 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6a9f50 0x55bebf706d30 secure :-1 s=READY pgs=1099 gs=1 cs=0 l=1 c_cookie=5871446225169615238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3630038750 tx=0x7f3630009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517b913bc90b0986 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f35f3fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f35f3fff640 1 -- 10.20.193.4:0/1791395512 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f363004b070 con 0x55bebf6a9f50 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1791395512 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f363400b930 con 0x55bebf6a9f50 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f35f3fff640 1 -- 10.20.193.4:0/1791395512 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f363002fe20 con 0x55bebf6a9f50 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f35f3fff640 1 -- 10.20.193.4:0/1791395512 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f363003d070 con 0x55bebf6a9f50 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 10 client.17616 _ll_register_callbacks cb 0x55bebf55b080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1791395512 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bebf3004a0 con 0x55bebf6a9f50 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f35f3fff640 1 -- 10.20.193.4:0/1791395512 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f363004f410 con 0x55bebf6a9f50 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f35f3fff640 1 -- 10.20.193.4:0/1791395512 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3630045ea0 con 0x55bebf6a9f50 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 10 client.17616 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:49.526 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1791395512 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55bebf546710 con 0x55bebf6a9f50 2026-02-24T09:17:49.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f35f3fff640 1 -- 10.20.193.4:0/1791395512 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f363004f5d0 con 0x55bebf6a9f50 2026-02-24T09:17:49.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 10 client.17616 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:49.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 10 client.17616 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:17:49.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 20 client.17616 populate_metadata read hostname 'trial004' 2026-02-24T09:17:49.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55bebf6ec720 0x55bebf6ecbc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 4 client.17616 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:49.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.516+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1791395512 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bebf5a67b0 con 0x55bebf6ec720 2026-02-24T09:17:49.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.518+0000 7f364581e640 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55bebf6ec720 0x55bebf6ecbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.520+0000 7f364581e640 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55bebf6ec720 0x55bebf6ecbc0 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=16636006990094246873 s_cookie=1165770681112471379 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e6def837557ba3d9 server_cookie=102da64209462753 in_seq=0 out_seq=0 2026-02-24T09:17:49.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.520+0000 7f35f3fff640 10 client.17616 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:17:49.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f35f3fff640 1 -- 10.20.193.4:0/1791395512 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bebf5a67b0 con 0x55bebf6ec720 2026-02-24T09:17:49.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f35f3fff640 10 client.17616 handle_command_reply: tid=0 2026-02-24T09:17:49.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 client.17616 shutdown 2026-02-24T09:17:49.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1791395512 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6a9f50 msgr2=0x55bebf706d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6a9f50 0x55bebf706d30 secure :-1 s=READY pgs=1099 gs=1 cs=0 l=1 c_cookie=5871446225169615238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3630038750 tx=0x7f3630009310 comp rx=0 tx=0).stop 2026-02-24T09:17:49.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1791395512 shutdown_connections 2026-02-24T09:17:49.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55bebf6ec720 0x55bebf6ecbc0 crc :-1 s=READY pgs=51 gs=4 cs=0 l=0 c_cookie=16636006990094246873 s_cookie=1165770681112471379 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6ef500 0x55bebf70c260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6aa860 0x55bebf707270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/1791395512 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6a9f50 0x55bebf706d30 unknown :-1 s=CLOSED pgs=1099 gs=1 cs=0 l=1 c_cookie=5871446225169615238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f35f3fff640 0 client.17616 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:17:49.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1791395512 >> 10.20.193.4:0/1791395512 conn(0x55bebf5c8db0 msgr2=0x55bebf6a8040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1791395512 shutdown_connections 2026-02-24T09:17:49.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 1 -- 10.20.193.4:0/1791395512 wait complete. 2026-02-24T09:17:49.530 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.521+0000 7f364a2a4e00 20 client.17616 trim_cache size 0 max 16384 2026-02-24T09:17:49.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.529+0000 7f364a2a4e00 1 Processor -- start 2026-02-24T09:17:49.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.529+0000 7f364a2a4e00 1 -- start start 2026-02-24T09:17:49.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6a9f50 0x55bebf6f1ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6aa860 0x55bebf6a9460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6ef500 0x55bebf6a99a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bebf5ae9a0 con 0x55bebf6ef500 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bebf38adf0 con 0x55bebf6a9f50 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bebf70c370 con 0x55bebf6aa860 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f3646820640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6ef500 0x55bebf6a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f3646820640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6ef500 0x55bebf6a99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36608/0 (socket says 10.20.193.4:36608) 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f3646820640 1 -- 10.20.193.4:0/3151310483 learned_addr learned my addr 10.20.193.4:0/3151310483 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f364581e640 1 --2- 10.20.193.4:0/3151310483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6aa860 0x55bebf6a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f364601f640 1 --2- 10.20.193.4:0/3151310483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6a9f50 0x55bebf6f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f3646820640 1 -- 10.20.193.4:0/3151310483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6aa860 msgr2=0x55bebf6a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f3646820640 1 --2- 10.20.193.4:0/3151310483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6aa860 0x55bebf6a9460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f3646820640 1 -- 10.20.193.4:0/3151310483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6a9f50 msgr2=0x55bebf6f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f3646820640 1 --2- 10.20.193.4:0/3151310483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6a9f50 0x55bebf6f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f3646820640 1 -- 10.20.193.4:0/3151310483 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bebf541190 con 0x55bebf6ef500 2026-02-24T09:17:49.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f3646820640 1 --2- 10.20.193.4:0/3151310483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6ef500 0x55bebf6a99a0 secure :-1 s=READY pgs=1100 gs=1 cs=0 l=1 c_cookie=12633795060798374081 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f363c0e50a0 tx=0x7f363c0ada10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5441abcbf8c0c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f360e4e6640 1 -- 10.20.193.4:0/3151310483 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f363c0ae360 con 0x55bebf6ef500 2026-02-24T09:17:49.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f360e4e6640 1 -- 10.20.193.4:0/3151310483 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f363c0b3680 con 0x55bebf6ef500 2026-02-24T09:17:49.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.530+0000 7f360e4e6640 1 -- 10.20.193.4:0/3151310483 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f363c0ad760 con 0x55bebf6ef500 2026-02-24T09:17:49.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.531+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3151310483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6ef500 msgr2=0x55bebf6a99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.531+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/3151310483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6ef500 0x55bebf6a99a0 secure :-1 s=READY pgs=1100 gs=1 cs=0 l=1 c_cookie=12633795060798374081 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f363c0e50a0 tx=0x7f363c0ada10 comp rx=0 tx=0).stop 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.531+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3151310483 shutdown_connections 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.531+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/3151310483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6ef500 0x55bebf6a99a0 unknown :-1 s=CLOSED pgs=1100 gs=1 cs=0 l=1 c_cookie=12633795060798374081 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.531+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/3151310483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6aa860 0x55bebf6a9460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.531+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/3151310483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6a9f50 0x55bebf6f1ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.531+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3151310483 >> 10.20.193.4:0/3151310483 conn(0x55bebf5c8db0 msgr2=0x55bebf6f18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.531+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3151310483 shutdown_connections 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.531+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3151310483 wait complete. 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364a2a4e00 1 -- start start 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364a2a4e00 1 Processor -- start 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6a9f50 0x55bebf68d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf68de00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364a2a4e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6ef500 0x55bebf6e9e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bebf6ea440 con 0x55bebf6aa860 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bebf6ea5b0 con 0x55bebf6ef500 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364a2a4e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bebf6ea770 con 0x55bebf6a9f50 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364581e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf68de00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364581e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf68de00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36614/0 (socket says 10.20.193.4:36614) 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364581e640 1 -- 10.20.193.4:0/3242101058 learned_addr learned my addr 10.20.193.4:0/3242101058 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f3646820640 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6ef500 0x55bebf6e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364581e640 1 -- 10.20.193.4:0/3242101058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6a9f50 msgr2=0x55bebf68d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364581e640 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6a9f50 0x55bebf68d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364581e640 1 -- 10.20.193.4:0/3242101058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6ef500 msgr2=0x55bebf6e9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364581e640 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6ef500 0x55bebf6e9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.532+0000 7f364581e640 1 -- 10.20.193.4:0/3242101058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bebf534d00 con 0x55bebf6aa860 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364581e640 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf68de00 secure :-1 s=READY pgs=1101 gs=1 cs=0 l=1 c_cookie=16108698132329896347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55bebf70d2f0 tx=0x7f363401a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8d979a9385999b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f35f3fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f35f3fff640 1 -- 10.20.193.4:0/3242101058 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f363401f040 con 0x55bebf6aa860 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3242101058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36400fbd30 con 0x55bebf6aa860 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 10 client.17622 _ll_register_callbacks cb 0x55bebf55b080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3242101058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f363400be10 con 0x55bebf6aa860 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f35f3fff640 1 -- 10.20.193.4:0/3242101058 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f363400be10 con 0x55bebf6aa860 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f35f3fff640 1 -- 10.20.193.4:0/3242101058 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3634005690 con 0x55bebf6aa860 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f35f3fff640 1 -- 10.20.193.4:0/3242101058 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3634027560 con 0x55bebf6aa860 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f35f3fff640 1 -- 10.20.193.4:0/3242101058 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f36340277b0 con 0x55bebf6aa860 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 10 client.17622 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:49.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3242101058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55bebf546970 con 0x55bebf6aa860 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f35f3fff640 1 -- 10.20.193.4:0/3242101058 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f3634027940 con 0x55bebf6aa860 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 10 client.17622 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 10 client.17622 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 20 client.17622 populate_metadata read hostname 'trial004' 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55bebf79cf00 0x55bebf7bd360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 4 client.17622 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.533+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3242101058 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bebf2e5160 con 0x55bebf79cf00 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364601f640 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55bebf79cf00 0x55bebf7bd360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f35f3fff640 10 client.17622 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364601f640 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55bebf79cf00 0x55bebf7bd360 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=2897889534089263156 s_cookie=16024089210804550970 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=28375f2d75b67834 server_cookie=de61003ceb2cbd3a in_seq=0 out_seq=0 2026-02-24T09:17:49.544 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f35f3fff640 1 -- 10.20.193.4:0/3242101058 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bebf2e5160 con 0x55bebf79cf00 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f35f3fff640 10 client.17622 handle_command_reply: tid=0 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 client.17622 shutdown 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3242101058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 msgr2=0x55bebf68de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf68de00 secure :-1 s=READY pgs=1101 gs=1 cs=0 l=1 c_cookie=16108698132329896347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55bebf70d2f0 tx=0x7f363401a470 comp rx=0 tx=0).stop 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3242101058 shutdown_connections 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55bebf79cf00 0x55bebf7bd360 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=2897889534089263156 s_cookie=16024089210804550970 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bebf6ef500 0x55bebf6e9e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bebf6aa860 0x55bebf68de00 unknown :-1 s=CLOSED pgs=1101 gs=1 cs=0 l=1 c_cookie=16108698132329896347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 --2- 10.20.193.4:0/3242101058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bebf6a9f50 0x55bebf68d8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f35f3fff640 0 client.17622 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3242101058 >> 10.20.193.4:0/3242101058 conn(0x55bebf5c8db0 msgr2=0x55bebf70b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3242101058 shutdown_connections 2026-02-24T09:17:49.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.534+0000 7f364a2a4e00 1 -- 10.20.193.4:0/3242101058 wait complete. 2026-02-24T09:17:49.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f364a2a4e00 20 client.17622 trim_cache size 0 max 16384 2026-02-24T09:17:49.546 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:17:49.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 -- 10.20.193.4:0/2490536332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f361c0b56d0 msgr2=0x7f361c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f361c0b56d0 0x7f361c0d5b80 secure :-1 s=READY pgs=412 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f363002f6e0 tx=0x7f3630005900 comp rx=0 tx=0).stop 2026-02-24T09:17:49.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 -- 10.20.193.4:0/2490536332 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3640113660 msgr2=0x7f36400f6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3640113660 0x7f36400f6090 secure :-1 s=READY pgs=1097 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f363c006e90 tx=0x7f363c00edf0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 -- 10.20.193.4:0/2490536332 shutdown_connections 2026-02-24T09:17:49.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f361c0b56d0 0x7f361c0d5b80 unknown :-1 s=CLOSED pgs=412 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3640113660 0x7f36400f6090 unknown :-1 s=CLOSED pgs=1097 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f364010de60 0x7f3640173f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 --2- 10.20.193.4:0/2490536332 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f364010d470 0x7f36400f5990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 -- 10.20.193.4:0/2490536332 >> 10.20.193.4:0/2490536332 conn(0x7f36400ead40 msgr2=0x7f364010f670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 -- 10.20.193.4:0/2490536332 shutdown_connections 2026-02-24T09:17:49.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.535+0000 7f36482aa640 1 -- 10.20.193.4:0/2490536332 wait complete. 2026-02-24T09:17:49.578 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:17:49.721 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:49.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 -- 10.20.193.4:0/4269128290 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c6c10f650 msgr2=0x7f0c6c10fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 --2- 10.20.193.4:0/4269128290 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c6c10f650 0x7f0c6c10fa20 secure :-1 s=READY pgs=1102 gs=1 cs=0 l=1 c_cookie=9832778200547147397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c009950 tx=0x7f0c5c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 -- 10.20.193.4:0/4269128290 shutdown_connections 2026-02-24T09:17:49.828 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 --2- 10.20.193.4:0/4269128290 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c6c115840 0x7f0c6c176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 --2- 10.20.193.4:0/4269128290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c6c110040 0x7f0c6c115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 --2- 10.20.193.4:0/4269128290 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c6c10f650 0x7f0c6c10fa20 unknown :-1 s=CLOSED pgs=1102 gs=1 cs=0 l=1 c_cookie=9832778200547147397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 -- 10.20.193.4:0/4269128290 >> 10.20.193.4:0/4269128290 conn(0x7f0c6c0ecf20 msgr2=0x7f0c6c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 -- 10.20.193.4:0/4269128290 shutdown_connections 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 -- 10.20.193.4:0/4269128290 wait complete. 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 Processor -- start 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 -- start start 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c6c10f650 0x7f0c6c11df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c6c110040 0x7f0c6c11e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c6c115840 0x7f0c6c123810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c123e30 con 0x7f0c6c110040 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c123fa0 con 0x7f0c6c10f650 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c737a4640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c124160 con 0x7f0c6c115840 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c70d18640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c6c110040 0x7f0c6c11e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c70d18640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c6c110040 0x7f0c6c11e440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36638/0 (socket says 10.20.193.4:36638) 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c70d18640 1 -- 10.20.193.4:0/2222559602 learned_addr learned my addr 10.20.193.4:0/2222559602 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c71d1a640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c6c115840 0x7f0c6c123810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c71519640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c6c10f650 0x7f0c6c11df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c70d18640 1 -- 10.20.193.4:0/2222559602 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c6c115840 msgr2=0x7f0c6c123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c70d18640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c6c115840 0x7f0c6c123810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c70d18640 1 -- 10.20.193.4:0/2222559602 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c6c10f650 msgr2=0x7f0c6c11df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c70d18640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c6c10f650 0x7f0c6c11df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c70d18640 1 -- 10.20.193.4:0/2222559602 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5c009570 con 0x7f0c6c110040 2026-02-24T09:17:49.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c71519640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c6c10f650 0x7f0c6c11df00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:49.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.825+0000 7f0c70d18640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c6c110040 0x7f0c6c11e440 secure :-1 s=READY pgs=1103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c6000c8f0 tx=0x7f0c6000cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.826+0000 7f0c5a7fc640 1 -- 10.20.193.4:0/2222559602 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c600044a0 con 0x7f0c6c110040 2026-02-24T09:17:49.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.826+0000 7f0c5a7fc640 1 -- 10.20.193.4:0/2222559602 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c60007d40 con 0x7f0c6c110040 2026-02-24T09:17:49.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.826+0000 7f0c737a4640 1 -- 10.20.193.4:0/2222559602 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c124440 con 0x7f0c6c110040 2026-02-24T09:17:49.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.826+0000 7f0c5a7fc640 1 -- 10.20.193.4:0/2222559602 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c6000f4b0 con 0x7f0c6c110040 2026-02-24T09:17:49.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.826+0000 7f0c737a4640 1 -- 10.20.193.4:0/2222559602 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c164b40 con 0x7f0c6c110040 2026-02-24T09:17:49.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.828+0000 7f0c5a7fc640 1 -- 10.20.193.4:0/2222559602 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f0c600026a0 con 0x7f0c6c110040 2026-02-24T09:17:49.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.828+0000 7f0c5a7fc640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0c480b5760 0x7f0c480d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.828+0000 7f0c5a7fc640 1 -- 10.20.193.4:0/2222559602 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0c600e6ab0 con 0x7f0c6c110040 2026-02-24T09:17:49.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.828+0000 7f0c71519640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0c480b5760 0x7f0c480d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.829+0000 7f0c71519640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0c480b5760 0x7f0c480d5c10 secure :-1 s=READY pgs=413 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c0023d0 tx=0x7f0c5c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.832 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.829+0000 7f0c7579ee00 1 Processor -- start 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.829+0000 7f0c7579ee00 1 -- start start 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.829+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e2f50 0x55bcd14e3320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.829+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd1527fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.829+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd15488e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bcd13f3ee0 con 0x55bcd1528500 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bcd13efc10 con 0x55bcd14e3860 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bcd13e9d70 con 0x55bcd14e2f50 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c71d1a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd15488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c71d1a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd15488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36646/0 (socket says 10.20.193.4:36646) 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c71d1a640 1 -- 10.20.193.4:0/3341046946 learned_addr learned my addr 10.20.193.4:0/3341046946 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c70d18640 1 --2- 10.20.193.4:0/3341046946 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd1527fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c71519640 1 --2- 10.20.193.4:0/3341046946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e2f50 0x55bcd14e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c71d1a640 1 -- 10.20.193.4:0/3341046946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e2f50 msgr2=0x55bcd14e3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c71d1a640 1 --2- 10.20.193.4:0/3341046946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e2f50 0x55bcd14e3320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c71d1a640 1 -- 10.20.193.4:0/3341046946 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 msgr2=0x55bcd1527fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c71d1a640 1 --2- 10.20.193.4:0/3341046946 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd1527fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.833 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c71d1a640 1 -- 10.20.193.4:0/3341046946 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd1395340 con 0x55bcd1528500 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c71d1a640 1 --2- 10.20.193.4:0/3341046946 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd15488e0 secure :-1 s=READY pgs=1104 gs=1 cs=0 l=1 c_cookie=13085311731947761568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c68006a50 tx=0x7f0c68004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5985db0f5ff6fa0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c39ce5640 1 -- 10.20.193.4:0/3341046946 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c6800fbe0 con 0x55bcd1528500 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c39ce5640 1 -- 10.20.193.4:0/3341046946 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c68005e10 con 0x55bcd1528500 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c39ce5640 1 -- 10.20.193.4:0/3341046946 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c680126f0 con 0x55bcd1528500 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 -- 10.20.193.4:0/3341046946 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 msgr2=0x55bcd15488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/3341046946 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd15488e0 secure :-1 s=READY pgs=1104 gs=1 cs=0 l=1 c_cookie=13085311731947761568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c68006a50 tx=0x7f0c68004ea0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 -- 10.20.193.4:0/3341046946 shutdown_connections 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/3341046946 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd15488e0 unknown :-1 s=CLOSED pgs=1104 gs=1 cs=0 l=1 c_cookie=13085311731947761568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/3341046946 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd1527fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/3341046946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e2f50 0x55bcd14e3320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 -- 10.20.193.4:0/3341046946 >> 10.20.193.4:0/3341046946 conn(0x55bcd1401db0 msgr2=0x55bcd14e1830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 -- 10.20.193.4:0/3341046946 shutdown_connections 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.830+0000 7f0c7579ee00 1 -- 10.20.193.4:0/3341046946 wait complete. 2026-02-24T09:17:49.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.831+0000 7f0c7579ee00 1 -- start start 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.831+0000 7f0c7579ee00 1 Processor -- start 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd14e2f50 0x55bcd153fd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd1540250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd1528500 0x55bcd1545240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bcd1545780 con 0x55bcd14e2f50 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bcd15458f0 con 0x55bcd14e3860 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bcd1545ab0 con 0x55bcd1528500 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c71519640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd14e2f50 0x55bcd153fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c71519640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd14e2f50 0x55bcd153fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36660/0 (socket says 10.20.193.4:36660) 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c71519640 1 -- 10.20.193.4:0/2316362827 learned_addr learned my addr 10.20.193.4:0/2316362827 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.835 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c71519640 1 -- 10.20.193.4:0/2316362827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd1528500 msgr2=0x55bcd1545240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c71519640 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd1528500 0x55bcd1545240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c71519640 1 -- 10.20.193.4:0/2316362827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 msgr2=0x55bcd1540250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c71519640 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd1540250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c71519640 1 -- 10.20.193.4:0/2316362827 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd136d9d0 con 0x55bcd14e2f50 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c71519640 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd14e2f50 0x55bcd153fd10 secure :-1 s=READY pgs=1105 gs=1 cs=0 l=1 c_cookie=13360306691960338945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c0042d0 tx=0x7f0c5c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96958268091fa01 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c26ffd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c26ffd640 1 -- 10.20.193.4:0/2316362827 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c5c03f070 con 0x55bcd14e2f50 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c26ffd640 1 -- 10.20.193.4:0/2316362827 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c5c0043d0 con 0x55bcd14e2f50 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 -- 10.20.193.4:0/2316362827 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c68005660 con 0x55bcd14e2f50 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c26ffd640 1 -- 10.20.193.4:0/2316362827 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c5c0433f0 con 0x55bcd14e2f50 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 10 client.17634 _ll_register_callbacks cb 0x55bcd1394080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 -- 10.20.193.4:0/2316362827 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bcd11394a0 con 0x55bcd14e2f50 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c26ffd640 1 -- 10.20.193.4:0/2316362827 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0c5c043550 con 0x55bcd14e2f50 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c26ffd640 1 -- 10.20.193.4:0/2316362827 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0c5c043750 con 0x55bcd14e2f50 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 10 client.17634 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 -- 10.20.193.4:0/2316362827 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55bcd137f710 con 0x55bcd14e2f50 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c26ffd640 1 -- 10.20.193.4:0/2316362827 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0c5c043970 con 0x55bcd14e2f50 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 10 client.17634 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 10 client.17634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 20 client.17634 populate_metadata read hostname 'trial004' 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55bcd15257d0 0x55bcd1525c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 4 client.17634 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.832+0000 7f0c7579ee00 1 -- 10.20.193.4:0/2316362827 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcd13df7b0 con 0x55bcd15257d0 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.833+0000 7f0c70d18640 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55bcd15257d0 0x55bcd1525c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.833+0000 7f0c26ffd640 10 client.17634 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:49.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.833+0000 7f0c70d18640 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55bcd15257d0 0x55bcd1525c40 crc :-1 s=READY pgs=175 gs=4 cs=0 l=0 c_cookie=8176564675246684963 s_cookie=7896760357904322042 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7178fe403715fb23 server_cookie=6d96edb4e9460dfa in_seq=0 out_seq=0 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c26ffd640 1 -- 10.20.193.4:0/2316362827 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bcd13df7b0 con 0x55bcd15257d0 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c26ffd640 10 client.17634 handle_command_reply: tid=0 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 client.17634 shutdown 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 -- 10.20.193.4:0/2316362827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd14e2f50 msgr2=0x55bcd153fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd14e2f50 0x55bcd153fd10 secure :-1 s=READY pgs=1105 gs=1 cs=0 l=1 c_cookie=13360306691960338945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c0042d0 tx=0x7f0c5c009310 comp rx=0 tx=0).stop 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 -- 10.20.193.4:0/2316362827 shutdown_connections 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55bcd15257d0 0x55bcd1525c40 crc :-1 s=READY pgs=175 gs=4 cs=0 l=0 c_cookie=8176564675246684963 s_cookie=7896760357904322042 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd1528500 0x55bcd1545240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd1540250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c26ffd640 0 client.17634 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/2316362827 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd14e2f50 0x55bcd153fd10 unknown :-1 s=CLOSED pgs=1105 gs=1 cs=0 l=1 c_cookie=13360306691960338945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 -- 10.20.193.4:0/2316362827 >> 10.20.193.4:0/2316362827 conn(0x55bcd1401db0 msgr2=0x55bcd14e1040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 -- 10.20.193.4:0/2316362827 shutdown_connections 2026-02-24T09:17:49.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 1 -- 10.20.193.4:0/2316362827 wait complete. 2026-02-24T09:17:49.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.834+0000 7f0c7579ee00 20 client.17634 trim_cache size 0 max 16384 2026-02-24T09:17:49.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c7579ee00 1 Processor -- start 2026-02-24T09:17:49.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c7579ee00 1 -- start start 2026-02-24T09:17:49.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e2f50 0x55bcd153c0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd153c630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd153cb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bcd13e79a0 con 0x55bcd1528500 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bcd11c3df0 con 0x55bcd14e3860 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bcd14b7ea0 con 0x55bcd14e2f50 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c71d1a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd153cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c71d1a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd153cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36666/0 (socket says 10.20.193.4:36666) 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c71d1a640 1 -- 10.20.193.4:0/4089398294 learned_addr learned my addr 10.20.193.4:0/4089398294 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c71519640 1 --2- 10.20.193.4:0/4089398294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e2f50 0x55bcd153c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c70d18640 1 --2- 10.20.193.4:0/4089398294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd153c630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c71d1a640 1 -- 10.20.193.4:0/4089398294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e2f50 msgr2=0x55bcd153c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c71d1a640 1 --2- 10.20.193.4:0/4089398294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e2f50 0x55bcd153c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c71d1a640 1 -- 10.20.193.4:0/4089398294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 msgr2=0x55bcd153c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c71d1a640 1 --2- 10.20.193.4:0/4089398294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd153c630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c71d1a640 1 -- 10.20.193.4:0/4089398294 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd1532370 con 0x55bcd1528500 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c71d1a640 1 --2- 10.20.193.4:0/4089398294 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd153cb70 secure :-1 s=READY pgs=1106 gs=1 cs=0 l=1 c_cookie=7253230055526738954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c68007010 tx=0x7f0c680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a8a64e65dbac0a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c394e4640 1 -- 10.20.193.4:0/4089398294 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c68005b80 con 0x55bcd1528500 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c394e4640 1 -- 10.20.193.4:0/4089398294 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c6800fea0 con 0x55bcd1528500 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.841+0000 7f0c394e4640 1 -- 10.20.193.4:0/4089398294 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c68012780 con 0x55bcd1528500 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 -- 10.20.193.4:0/4089398294 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 msgr2=0x55bcd153cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/4089398294 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd153cb70 secure :-1 s=READY pgs=1106 gs=1 cs=0 l=1 c_cookie=7253230055526738954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c68007010 tx=0x7f0c680057f0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 -- 10.20.193.4:0/4089398294 shutdown_connections 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/4089398294 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd153cb70 unknown :-1 s=CLOSED pgs=1106 gs=1 cs=0 l=1 c_cookie=7253230055526738954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/4089398294 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e3860 0x55bcd153c630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/4089398294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e2f50 0x55bcd153c0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 -- 10.20.193.4:0/4089398294 >> 10.20.193.4:0/4089398294 conn(0x55bcd1401db0 msgr2=0x55bcd1544890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 -- 10.20.193.4:0/4089398294 shutdown_connections 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 -- 10.20.193.4:0/4089398294 wait complete. 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 -- start start 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 Processor -- start 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e2f50 0x55bcd14c2870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e3860 0x55bcd14c2db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd158e100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bcd14c35c0 con 0x55bcd1528500 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bcd14c3730 con 0x55bcd14e2f50 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c7579ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bcd158e6c0 con 0x55bcd14e3860 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c71d1a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd158e100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c71d1a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd158e100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36674/0 (socket says 10.20.193.4:36674) 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.842+0000 7f0c71d1a640 1 -- 10.20.193.4:0/1152533954 learned_addr learned my addr 10.20.193.4:0/1152533954 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c70d18640 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e3860 0x55bcd14c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c71d1a640 1 -- 10.20.193.4:0/1152533954 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e3860 msgr2=0x55bcd14c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c71d1a640 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e3860 0x55bcd14c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c71d1a640 1 -- 10.20.193.4:0/1152533954 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e2f50 msgr2=0x55bcd14c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c71d1a640 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e2f50 0x55bcd14c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c71d1a640 1 -- 10.20.193.4:0/1152533954 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd137a190 con 0x55bcd1528500 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c71d1a640 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd158e100 secure :-1 s=READY pgs=1107 gs=1 cs=0 l=1 c_cookie=5426771819031458404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c68010010 tx=0x7f0c68006a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4fc43796787264 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c26ffd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c26ffd640 1 -- 10.20.193.4:0/1152533954 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c68005cb0 con 0x55bcd1528500 2026-02-24T09:17:49.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 1 -- 10.20.193.4:0/1152533954 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd1395340 con 0x55bcd1528500 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c26ffd640 1 -- 10.20.193.4:0/1152533954 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c6801e040 con 0x55bcd1528500 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c26ffd640 1 -- 10.20.193.4:0/1152533954 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c6802e720 con 0x55bcd1528500 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 10 client.17640 _ll_register_callbacks cb 0x55bcd1394080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 1 -- 10.20.193.4:0/1152533954 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c68005e10 con 0x55bcd1528500 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c26ffd640 1 -- 10.20.193.4:0/1152533954 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0c6802e8b0 con 0x55bcd1528500 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c26ffd640 1 -- 10.20.193.4:0/1152533954 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0c6802ead0 con 0x55bcd1528500 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 10 client.17640 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 1 -- 10.20.193.4:0/1152533954 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55bcd136dd00 con 0x55bcd1528500 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c26ffd640 1 -- 10.20.193.4:0/1152533954 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0c6800d070 con 0x55bcd1528500 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 10 client.17640 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 10 client.17640 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 20 client.17640 populate_metadata read hostname 'trial004' 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55bcd15d6160 0x55bcd15f6610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 4 client.17640 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c7579ee00 1 -- 10.20.193.4:0/1152533954 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bcd111e160 con 0x55bcd15d6160 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.843+0000 7f0c71519640 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55bcd15d6160 0x55bcd15f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c71519640 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55bcd15d6160 0x55bcd15f6610 crc :-1 s=READY pgs=176 gs=4 cs=0 l=0 c_cookie=12971170798658549378 s_cookie=11358569283795420403 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b402db1dfef67682 server_cookie=9da1be95554a04f3 in_seq=0 out_seq=0 2026-02-24T09:17:49.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c26ffd640 10 client.17640 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c26ffd640 1 -- 10.20.193.4:0/1152533954 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bcd111e160 con 0x55bcd15d6160 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c26ffd640 10 client.17640 handle_command_reply: tid=0 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 client.17640 shutdown 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 -- 10.20.193.4:0/1152533954 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 msgr2=0x55bcd158e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd158e100 secure :-1 s=READY pgs=1107 gs=1 cs=0 l=1 c_cookie=5426771819031458404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c68010010 tx=0x7f0c68006a00 comp rx=0 tx=0).stop 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 -- 10.20.193.4:0/1152533954 shutdown_connections 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55bcd15d6160 0x55bcd15f6610 crc :-1 s=READY pgs=176 gs=4 cs=0 l=0 c_cookie=12971170798658549378 s_cookie=11358569283795420403 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bcd1528500 0x55bcd158e100 unknown :-1 s=CLOSED pgs=1107 gs=1 cs=0 l=1 c_cookie=5426771819031458404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c26ffd640 0 client.17640 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bcd14e3860 0x55bcd14c2db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 --2- 10.20.193.4:0/1152533954 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bcd14e2f50 0x55bcd14c2870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 -- 10.20.193.4:0/1152533954 >> 10.20.193.4:0/1152533954 conn(0x55bcd1401db0 msgr2=0x55bcd153cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 -- 10.20.193.4:0/1152533954 shutdown_connections 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 1 -- 10.20.193.4:0/1152533954 wait complete. 2026-02-24T09:17:49.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c7579ee00 20 client.17640 trim_cache size 0 max 16384 2026-02-24T09:17:49.856 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:17:49.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c737a4640 1 -- 10.20.193.4:0/2222559602 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0c480b5760 msgr2=0x7f0c480d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c737a4640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0c480b5760 0x7f0c480d5c10 secure :-1 s=READY pgs=413 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c5c0023d0 tx=0x7f0c5c031040 comp rx=0 tx=0).stop 2026-02-24T09:17:49.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c737a4640 1 -- 10.20.193.4:0/2222559602 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c6c110040 msgr2=0x7f0c6c11e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:49.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c737a4640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c6c110040 0x7f0c6c11e440 secure :-1 s=READY pgs=1103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c6000c8f0 tx=0x7f0c6000cdc0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c737a4640 1 -- 10.20.193.4:0/2222559602 shutdown_connections 2026-02-24T09:17:49.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c737a4640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0c480b5760 0x7f0c480d5c10 unknown :-1 s=CLOSED pgs=413 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c737a4640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0c6c115840 0x7f0c6c123810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c737a4640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0c6c110040 0x7f0c6c11e440 unknown :-1 s=CLOSED pgs=1103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c737a4640 1 --2- 10.20.193.4:0/2222559602 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0c6c10f650 0x7f0c6c11df00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:49.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.844+0000 7f0c737a4640 1 -- 10.20.193.4:0/2222559602 >> 10.20.193.4:0/2222559602 conn(0x7f0c6c0ecf20 msgr2=0x7f0c6c10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:49.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.845+0000 7f0c737a4640 1 -- 10.20.193.4:0/2222559602 shutdown_connections 2026-02-24T09:17:49.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:49.845+0000 7f0c737a4640 1 -- 10.20.193.4:0/2222559602 wait complete. 2026-02-24T09:17:50.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:49 trial004 ceph-mon[41596]: pgmap v393: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 754 MiB/s wr, 216 op/s 2026-02-24T09:17:50.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:49 trial090 ceph-mon[47278]: pgmap v393: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 754 MiB/s wr, 216 op/s 2026-02-24T09:17:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:49 trial014 ceph-mon[46941]: pgmap v393: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 34 KiB/s rd, 754 MiB/s wr, 216 op/s 2026-02-24T09:17:50.883 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:17:50.883 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:17:50.997 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.093+0000 7f0099158640 1 -- 10.20.193.4:0/414647751 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0094155c80 msgr2=0x7f0094176060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.093+0000 7f0099158640 1 --2- 10.20.193.4:0/414647751 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0094155c80 0x7f0094176060 secure :-1 s=READY pgs=1108 gs=1 cs=0 l=1 c_cookie=1776157795094200254 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f008400aa30 tx=0x7f0084030280 comp rx=0 tx=0).stop 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.093+0000 7f0099158640 1 -- 10.20.193.4:0/414647751 shutdown_connections 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.093+0000 7f0099158640 1 --2- 10.20.193.4:0/414647751 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0094155c80 0x7f0094176060 unknown :-1 s=CLOSED pgs=1108 gs=1 cs=0 l=1 c_cookie=1776157795094200254 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.093+0000 7f0099158640 1 --2- 10.20.193.4:0/414647751 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f009410c860 0x7f0094155740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.093+0000 7f0099158640 1 --2- 10.20.193.4:0/414647751 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f009410bf50 0x7f009410c320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.093+0000 7f0099158640 1 -- 10.20.193.4:0/414647751 >> 10.20.193.4:0/414647751 conn(0x7f00940e9bf0 msgr2=0x7f009410a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.093+0000 7f0099158640 1 -- 10.20.193.4:0/414647751 shutdown_connections 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.093+0000 7f0099158640 1 -- 10.20.193.4:0/414647751 wait complete. 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0099158640 1 Processor -- start 2026-02-24T09:17:51.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0099158640 1 -- start start 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0099158640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f009410bf50 0x7f0094161350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0099158640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f009410c860 0x7f0094161890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0099158640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0094155c80 0x7f0094166c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0099158640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0094167280 con 0x7f0094155c80 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0099158640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f00941673f0 con 0x7f009410bf50 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0099158640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f00941675b0 con 0x7f009410c860 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0093577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0094155c80 0x7f0094166c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0093577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0094155c80 0x7f0094166c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36692/0 (socket says 10.20.193.4:36692) 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0093577640 1 -- 10.20.193.4:0/4108837159 learned_addr learned my addr 10.20.193.4:0/4108837159 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0092d76640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f009410bf50 0x7f0094161350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0092575640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f009410c860 0x7f0094161890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0093577640 1 -- 10.20.193.4:0/4108837159 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f009410c860 msgr2=0x7f0094161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0093577640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f009410c860 0x7f0094161890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0093577640 1 -- 10.20.193.4:0/4108837159 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f009410bf50 msgr2=0x7f0094161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0093577640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f009410bf50 0x7f0094161350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0093577640 1 -- 10.20.193.4:0/4108837159 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008400a650 con 0x7f0094155c80 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0092d76640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f009410bf50 0x7f0094161350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0093577640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0094155c80 0x7f0094166c60 secure :-1 s=READY pgs=1109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f008400a310 tx=0x7f00840039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0073fff640 1 -- 10.20.193.4:0/4108837159 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f008403e070 con 0x7f0094155c80 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0073fff640 1 -- 10.20.193.4:0/4108837159 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00840055a0 con 0x7f0094155c80 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0099158640 1 -- 10.20.193.4:0/4108837159 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0094167830 con 0x7f0094155c80 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0073fff640 1 -- 10.20.193.4:0/4108837159 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00840429d0 con 0x7f0094155c80 2026-02-24T09:17:51.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.094+0000 7f0099158640 1 -- 10.20.193.4:0/4108837159 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0094152710 con 0x7f0094155c80 2026-02-24T09:17:51.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.096+0000 7f0073fff640 1 -- 10.20.193.4:0/4108837159 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f0084039c80 con 0x7f0094155c80 2026-02-24T09:17:51.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.097+0000 7f0073fff640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00680b56e0 0x7f00680d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.097+0000 7f0073fff640 1 -- 10.20.193.4:0/4108837159 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f008410c7b0 con 0x7f0094155c80 2026-02-24T09:17:51.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.097+0000 7f0092d76640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00680b56e0 0x7f00680d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.097+0000 7f0092d76640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00680b56e0 0x7f00680d5b90 secure :-1 s=READY pgs=414 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0088005970 tx=0x7f0088005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f009b152e00 1 Processor -- start 2026-02-24T09:17:51.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f009b152e00 1 -- start start 2026-02-24T09:17:51.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f009b152e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bc9f46d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f009b152e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca39370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f009b152e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca59c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f009b152e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5591bc904520 con 0x5591bca398b0 2026-02-24T09:17:51.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f009b152e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5591bc900250 con 0x5591bc9f4300 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f009b152e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5591bc8fa3b0 con 0x5591bc9f4c10 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f0093577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca59c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f0093577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca59c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36708/0 (socket says 10.20.193.4:36708) 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f0093577640 1 -- 10.20.193.4:0/610715933 learned_addr learned my addr 10.20.193.4:0/610715933 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.098+0000 7f0092575640 1 --2- 10.20.193.4:0/610715933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca39370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f0092d76640 1 --2- 10.20.193.4:0/610715933 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bc9f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f0093577640 1 -- 10.20.193.4:0/610715933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 msgr2=0x5591bca39370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f0093577640 1 --2- 10.20.193.4:0/610715933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca39370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f0093577640 1 -- 10.20.193.4:0/610715933 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 msgr2=0x5591bc9f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f0093577640 1 --2- 10.20.193.4:0/610715933 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bc9f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f0093577640 1 -- 10.20.193.4:0/610715933 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591bc8a56e0 con 0x5591bca398b0 2026-02-24T09:17:51.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f0093577640 1 --2- 10.20.193.4:0/610715933 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca59c90 secure :-1 s=READY pgs=1110 gs=1 cs=0 l=1 c_cookie=15086121858007042911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00840d2b00 tx=0x7f0084003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15cabe670c40b5f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f005f7fe640 1 -- 10.20.193.4:0/610715933 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00840d2500 con 0x5591bca398b0 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f005f7fe640 1 -- 10.20.193.4:0/610715933 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00840d2320 con 0x5591bca398b0 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f005f7fe640 1 -- 10.20.193.4:0/610715933 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00840d37b0 con 0x5591bca398b0 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f009b152e00 1 -- 10.20.193.4:0/610715933 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 msgr2=0x5591bca59c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f009b152e00 1 --2- 10.20.193.4:0/610715933 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca59c90 secure :-1 s=READY pgs=1110 gs=1 cs=0 l=1 c_cookie=15086121858007042911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00840d2b00 tx=0x7f0084003f60 comp rx=0 tx=0).stop 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f009b152e00 1 -- 10.20.193.4:0/610715933 shutdown_connections 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f009b152e00 1 --2- 10.20.193.4:0/610715933 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca59c90 unknown :-1 s=CLOSED pgs=1110 gs=1 cs=0 l=1 c_cookie=15086121858007042911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f009b152e00 1 --2- 10.20.193.4:0/610715933 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca39370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f009b152e00 1 --2- 10.20.193.4:0/610715933 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bc9f46d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f009b152e00 1 -- 10.20.193.4:0/610715933 >> 10.20.193.4:0/610715933 conn(0x5591bc9124f0 msgr2=0x5591bc9f2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f009b152e00 1 -- 10.20.193.4:0/610715933 shutdown_connections 2026-02-24T09:17:51.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.099+0000 7f009b152e00 1 -- 10.20.193.4:0/610715933 wait complete. 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f009b152e00 1 -- start start 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f009b152e00 1 Processor -- start 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f009b152e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bca0c130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f009b152e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca0c670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f009b152e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca11660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f009b152e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5591bca11ba0 con 0x5591bca398b0 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f009b152e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5591bca11d10 con 0x5591bc9f4300 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f009b152e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5591bca11ed0 con 0x5591bc9f4c10 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f0093577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca11660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f0093577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca11660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36712/0 (socket says 10.20.193.4:36712) 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f0093577640 1 -- 10.20.193.4:0/1697528693 learned_addr learned my addr 10.20.193.4:0/1697528693 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:51.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f0092575640 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca0c670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f0093577640 1 -- 10.20.193.4:0/1697528693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 msgr2=0x5591bca0c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f0093577640 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca0c670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f0093577640 1 -- 10.20.193.4:0/1697528693 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 msgr2=0x5591bca0c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f0093577640 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bca0c130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.100+0000 7f0093577640 1 -- 10.20.193.4:0/1697528693 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591bc87dcd0 con 0x5591bca398b0 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f0093577640 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca11660 secure :-1 s=READY pgs=1111 gs=1 cs=0 l=1 c_cookie=14600055823755077787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0084039820 tx=0x7f00840dda00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9dd16ad3cb689b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f005cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f005cff9640 1 -- 10.20.193.4:0/1697528693 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00840dda70 con 0x5591bca398b0 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f005cff9640 1 -- 10.20.193.4:0/1697528693 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00840d8840 con 0x5591bca398b0 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f005cff9640 1 -- 10.20.193.4:0/1697528693 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0084097f30 con 0x5591bca398b0 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 1 -- 10.20.193.4:0/1697528693 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0094152710 con 0x5591bca398b0 2026-02-24T09:17:51.110 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f005cff9640 1 -- 10.20.193.4:0/1697528693 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f00840d4e40 con 0x5591bca398b0 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f005cff9640 10 client.17652 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 10 client.17652 _ll_register_callbacks cb 0x5591bc876790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 1 -- 10.20.193.4:0/1697528693 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5591bc5879d0 con 0x5591bca398b0 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f005cff9640 1 -- 10.20.193.4:0/1697528693 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f00840dae20 con 0x5591bca398b0 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 10 client.17652 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 1 -- 10.20.193.4:0/1697528693 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5591bc88fab0 con 0x5591bca398b0 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f005cff9640 1 -- 10.20.193.4:0/1697528693 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f00840d0b00 con 0x5591bca398b0 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 10 client.17652 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 10 client.17652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 20 client.17652 populate_metadata read hostname 'trial004' 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5591bca363c0 0x5591bca36860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 4 client.17652 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:51.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f009b152e00 1 -- 10.20.193.4:0/1697528693 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591bc90ab70 con 0x5591bca363c0 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.101+0000 7f0092d76640 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5591bca363c0 0x5591bca36860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.102+0000 7f005cff9640 10 client.17652 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.102+0000 7f0092d76640 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5591bca363c0 0x5591bca36860 crc :-1 s=READY pgs=177 gs=4 cs=0 l=0 c_cookie=13863229363514134208 s_cookie=2351966142397149016 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c06415a7d4064ec0 server_cookie=20a3dcbec953ef58 in_seq=0 out_seq=0 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f005cff9640 1 -- 10.20.193.4:0/1697528693 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5591bc90ab70 con 0x5591bca363c0 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f005cff9640 10 client.17652 handle_command_reply: tid=0 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 client.17652 shutdown 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 -- 10.20.193.4:0/1697528693 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 msgr2=0x5591bca11660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca11660 secure :-1 s=READY pgs=1111 gs=1 cs=0 l=1 c_cookie=14600055823755077787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0084039820 tx=0x7f00840dda00 comp rx=0 tx=0).stop 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 -- 10.20.193.4:0/1697528693 shutdown_connections 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5591bca363c0 0x5591bca36860 crc :-1 s=READY pgs=177 gs=4 cs=0 l=0 c_cookie=13863229363514134208 s_cookie=2351966142397149016 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca11660 unknown :-1 s=CLOSED pgs=1111 gs=1 cs=0 l=1 c_cookie=14600055823755077787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca0c670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 --2- 10.20.193.4:0/1697528693 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bca0c130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f005cff9640 0 client.17652 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:51.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 -- 10.20.193.4:0/1697528693 >> 10.20.193.4:0/1697528693 conn(0x5591bc9124f0 msgr2=0x5591bc9f32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 -- 10.20.193.4:0/1697528693 shutdown_connections 2026-02-24T09:17:51.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 1 -- 10.20.193.4:0/1697528693 wait complete. 2026-02-24T09:17:51.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.103+0000 7f009b152e00 20 client.17652 trim_cache size 0 max 16384 2026-02-24T09:17:51.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f009b152e00 1 Processor -- start 2026-02-24T09:17:51.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f009b152e00 1 -- start start 2026-02-24T09:17:51.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f009b152e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4300 0x5591bca09700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f009b152e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4c10 0x5591bc9f34f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f009b152e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bc9f3a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f009b152e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5591bc8f7fe0 con 0x5591bca398b0 2026-02-24T09:17:51.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f009b152e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5591bc5c2fe0 con 0x5591bc9f4c10 2026-02-24T09:17:51.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f009b152e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5591bc900250 con 0x5591bc9f4300 2026-02-24T09:17:51.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f0093577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bc9f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f0093577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bc9f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36716/0 (socket says 10.20.193.4:36716) 2026-02-24T09:17:51.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f0093577640 1 -- 10.20.193.4:0/973938440 learned_addr learned my addr 10.20.193.4:0/973938440 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f0092d76640 1 --2- 10.20.193.4:0/973938440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4300 0x5591bca09700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f0093577640 1 -- 10.20.193.4:0/973938440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4300 msgr2=0x5591bca09700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f0093577640 1 --2- 10.20.193.4:0/973938440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4300 0x5591bca09700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f0093577640 1 -- 10.20.193.4:0/973938440 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4c10 msgr2=0x5591bc9f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f0093577640 1 --2- 10.20.193.4:0/973938440 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4c10 0x5591bc9f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f0093577640 1 -- 10.20.193.4:0/973938440 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591bc88a530 con 0x5591bca398b0 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f0093577640 1 --2- 10.20.193.4:0/973938440 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bc9f3a30 secure :-1 s=READY pgs=1112 gs=1 cs=0 l=1 c_cookie=8547534814970428368 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00840d8a00 tx=0x7f0084096000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769ef1a09f98bbd0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f005effd640 1 -- 10.20.193.4:0/973938440 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00840d8840 con 0x5591bca398b0 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f005effd640 1 -- 10.20.193.4:0/973938440 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5591bc5879d0 con 0x5591bca398b0 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.112+0000 7f005effd640 1 -- 10.20.193.4:0/973938440 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00840ce470 con 0x5591bca398b0 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 -- 10.20.193.4:0/973938440 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 msgr2=0x5591bc9f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 --2- 10.20.193.4:0/973938440 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bc9f3a30 secure :-1 s=READY pgs=1112 gs=1 cs=0 l=1 c_cookie=8547534814970428368 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00840d8a00 tx=0x7f0084096000 comp rx=0 tx=0).stop 2026-02-24T09:17:51.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 -- 10.20.193.4:0/973938440 shutdown_connections 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 --2- 10.20.193.4:0/973938440 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bc9f3a30 unknown :-1 s=CLOSED pgs=1112 gs=1 cs=0 l=1 c_cookie=8547534814970428368 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 --2- 10.20.193.4:0/973938440 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4c10 0x5591bc9f34f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 --2- 10.20.193.4:0/973938440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4300 0x5591bca09700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 -- 10.20.193.4:0/973938440 >> 10.20.193.4:0/973938440 conn(0x5591bc9124f0 msgr2=0x5591bca10cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 -- 10.20.193.4:0/973938440 shutdown_connections 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 -- 10.20.193.4:0/973938440 wait complete. 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 -- start start 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.113+0000 7f009b152e00 1 Processor -- start 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bca12720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca12c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca131a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.122 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5591bc985dd0 con 0x5591bca398b0 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5591bc8f7fe0 con 0x5591bc9f4300 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5591bc5c2fe0 con 0x5591bc9f4c10 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0093577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0093577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca131a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36720/0 (socket says 10.20.193.4:36720) 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0093577640 1 -- 10.20.193.4:0/2573275581 learned_addr learned my addr 10.20.193.4:0/2573275581 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0092575640 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca12c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0092d76640 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bca12720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0093577640 1 -- 10.20.193.4:0/2573275581 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 msgr2=0x5591bca12c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0093577640 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca12c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0093577640 1 -- 10.20.193.4:0/2573275581 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 msgr2=0x5591bca12720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0093577640 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bca12720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.123 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0093577640 1 -- 10.20.193.4:0/2573275581 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591bc87e000 con 0x5591bca398b0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0093577640 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca131a0 secure :-1 s=READY pgs=1113 gs=1 cs=0 l=1 c_cookie=15977843903099107669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f008410ca80 tx=0x7f008404a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbcb46028dcf955 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f005cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f005cff9640 1 -- 10.20.193.4:0/2573275581 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00840d8840 con 0x5591bca398b0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f005cff9640 1 -- 10.20.193.4:0/2573275581 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00840d3520 con 0x5591bca398b0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 -- 10.20.193.4:0/2573275581 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0094152710 con 0x5591bca398b0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f005cff9640 1 -- 10.20.193.4:0/2573275581 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00840d4790 con 0x5591bca398b0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 10 client.17658 _ll_register_callbacks cb 0x5591bc876790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 -- 10.20.193.4:0/2573275581 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5591bc90c7e0 con 0x5591bca398b0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f005cff9640 1 -- 10.20.193.4:0/2573275581 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f00840d4e40 con 0x5591bca398b0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f005cff9640 1 -- 10.20.193.4:0/2573275581 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0084042b30 con 0x5591bca398b0 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 10 client.17658 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:51.124 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 -- 10.20.193.4:0/2573275581 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5591bc88fd10 con 0x5591bca398b0 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f005cff9640 1 -- 10.20.193.4:0/2573275581 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f00840d1e10 con 0x5591bca398b0 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 10 client.17658 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 10 client.17658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 20 client.17658 populate_metadata read hostname 'trial004' 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5591bcae6480 0x5591bcb06930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 4 client.17658 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f009b152e00 1 -- 10.20.193.4:0/2573275581 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5591bc585220 con 0x5591bcae6480 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.114+0000 7f0092d76640 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5591bcae6480 0x5591bcb06930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.115+0000 7f005cff9640 10 client.17658 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.115+0000 7f0092d76640 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5591bcae6480 0x5591bcb06930 crc :-1 s=READY pgs=178 gs=4 cs=0 l=0 c_cookie=1374979275453864550 s_cookie=13314052506488022942 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1314e85db6f39a66 server_cookie=b8c50436ba1e279e in_seq=0 out_seq=0 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f005cff9640 1 -- 10.20.193.4:0/2573275581 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5591bc585220 con 0x5591bcae6480 2026-02-24T09:17:51.125 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f005cff9640 10 client.17658 handle_command_reply: tid=0 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 client.17658 shutdown 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 -- 10.20.193.4:0/2573275581 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 msgr2=0x5591bca131a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca131a0 secure :-1 s=READY pgs=1113 gs=1 cs=0 l=1 c_cookie=15977843903099107669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f008410ca80 tx=0x7f008404a000 comp rx=0 tx=0).stop 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 -- 10.20.193.4:0/2573275581 shutdown_connections 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5591bcae6480 0x5591bcb06930 crc :-1 s=READY pgs=178 gs=4 cs=0 l=0 c_cookie=1374979275453864550 s_cookie=13314052506488022942 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5591bca398b0 0x5591bca131a0 unknown :-1 s=CLOSED pgs=1113 gs=1 cs=0 l=1 c_cookie=15977843903099107669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5591bc9f4c10 0x5591bca12c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 --2- 10.20.193.4:0/2573275581 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5591bc9f4300 0x5591bca12720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f005cff9640 0 client.17658 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 -- 10.20.193.4:0/2573275581 >> 10.20.193.4:0/2573275581 conn(0x5591bc9124f0 msgr2=0x5591bca086f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 -- 10.20.193.4:0/2573275581 shutdown_connections 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 1 -- 10.20.193.4:0/2573275581 wait complete. 2026-02-24T09:17:51.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f009b152e00 20 client.17658 trim_cache size 0 max 16384 2026-02-24T09:17:51.127 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:17:51.127 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:17:51.127 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "8a74e81b-c932-4485-9cf4-fe6952a41dd1", 2026-02-24T09:17:51.127 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:17:51.127 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:17:51.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 -- 10.20.193.4:0/4108837159 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00680b56e0 msgr2=0x7f00680d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00680b56e0 0x7f00680d5b90 secure :-1 s=READY pgs=414 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0088005970 tx=0x7f0088005900 comp rx=0 tx=0).stop 2026-02-24T09:17:51.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 -- 10.20.193.4:0/4108837159 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0094155c80 msgr2=0x7f0094166c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0094155c80 0x7f0094166c60 secure :-1 s=READY pgs=1109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f008400a310 tx=0x7f00840039b0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 -- 10.20.193.4:0/4108837159 shutdown_connections 2026-02-24T09:17:51.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f00680b56e0 0x7f00680d5b90 unknown :-1 s=CLOSED pgs=414 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0094155c80 0x7f0094166c60 unknown :-1 s=CLOSED pgs=1109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f009410c860 0x7f0094161890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 --2- 10.20.193.4:0/4108837159 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f009410bf50 0x7f0094161350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 -- 10.20.193.4:0/4108837159 >> 10.20.193.4:0/4108837159 conn(0x7f00940e9bf0 msgr2=0x7f0094109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 -- 10.20.193.4:0/4108837159 shutdown_connections 2026-02-24T09:17:51.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.116+0000 7f0099158640 1 -- 10.20.193.4:0/4108837159 wait complete. 2026-02-24T09:17:51.155 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:17:51.271 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 -- 10.20.193.4:0/3238786007 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56fc115840 msgr2=0x7f56fc176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 --2- 10.20.193.4:0/3238786007 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56fc115840 0x7f56fc176210 secure :-1 s=READY pgs=1114 gs=1 cs=0 l=1 c_cookie=8749903128590992652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f000aa30 tx=0x7f56f0030280 comp rx=0 tx=0).stop 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 -- 10.20.193.4:0/3238786007 shutdown_connections 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 --2- 10.20.193.4:0/3238786007 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56fc115840 0x7f56fc176210 unknown :-1 s=CLOSED pgs=1114 gs=1 cs=0 l=1 c_cookie=8749903128590992652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 --2- 10.20.193.4:0/3238786007 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56fc110040 0x7f56fc115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 --2- 10.20.193.4:0/3238786007 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f56fc10f650 0x7f56fc10fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 -- 10.20.193.4:0/3238786007 >> 10.20.193.4:0/3238786007 conn(0x7f56fc0ecf20 msgr2=0x7f56fc10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 -- 10.20.193.4:0/3238786007 shutdown_connections 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 -- 10.20.193.4:0/3238786007 wait complete. 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 Processor -- start 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 -- start start 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56fc10f650 0x7f56fc11deb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56fc110040 0x7f56fc11e3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f56fc115840 0x7f56fc1237c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc123de0 con 0x7f56fc110040 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc123f50 con 0x7f56fc115840 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.374+0000 7f57026f3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56fc124110 con 0x7f56fc10f650 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56fc110040 0x7f56fc11e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fb7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56fc110040 0x7f56fc11e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36728/0 (socket says 10.20.193.4:36728) 2026-02-24T09:17:51.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fb7fe640 1 -- 10.20.193.4:0/537547341 learned_addr learned my addr 10.20.193.4:0/537547341 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f5700c69640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f56fc115840 0x7f56fc1237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fbfff640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56fc10f650 0x7f56fc11deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fb7fe640 1 -- 10.20.193.4:0/537547341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56fc10f650 msgr2=0x7f56fc11deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fb7fe640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56fc10f650 0x7f56fc11deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fb7fe640 1 -- 10.20.193.4:0/537547341 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f56fc115840 msgr2=0x7f56fc1237c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fb7fe640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f56fc115840 0x7f56fc1237c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fb7fe640 1 -- 10.20.193.4:0/537547341 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f000a650 con 0x7f56fc110040 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fbfff640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56fc10f650 0x7f56fc11deb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56fb7fe640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56fc110040 0x7f56fc11e3f0 secure :-1 s=READY pgs=1115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56ec00c8c0 tx=0x7f56ec00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56f97fa640 1 -- 10.20.193.4:0/537547341 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56ec0044a0 con 0x7f56fc110040 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56f97fa640 1 -- 10.20.193.4:0/537547341 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56ec007c80 con 0x7f56fc110040 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f57026f3640 1 -- 10.20.193.4:0/537547341 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56fc1243f0 con 0x7f56fc110040 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f56f97fa640 1 -- 10.20.193.4:0/537547341 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56ec00f6d0 con 0x7f56fc110040 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.375+0000 7f57026f3640 1 -- 10.20.193.4:0/537547341 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56fc164af0 con 0x7f56fc110040 2026-02-24T09:17:51.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.376+0000 7f56f97fa640 1 -- 10.20.193.4:0/537547341 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f56ec0026a0 con 0x7f56fc110040 2026-02-24T09:17:51.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.377+0000 7f56f97fa640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56d00b5760 0x7f56d00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.377+0000 7f56fbfff640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56d00b5760 0x7f56d00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.377+0000 7f56f97fa640 1 -- 10.20.193.4:0/537547341 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f56ec0e6b40 con 0x7f56fc110040 2026-02-24T09:17:51.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.378+0000 7f56fbfff640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56d00b5760 0x7f56d00d5c10 secure :-1 s=READY pgs=415 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e8004740 tx=0x7f56e8005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.378+0000 7f57046ede00 1 Processor -- start 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.378+0000 7f57046ede00 1 -- start start 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.378+0000 7f57046ede00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5910bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5955890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5955dd0 0x55eac59761b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55eac5820de0 con 0x55eac5910820 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55eac581cb10 con 0x55eac5911130 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55eac5816ab0 con 0x55eac5955dd0 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5910bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5910bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36738/0 (socket says 10.20.193.4:36738) 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fbfff640 1 -- 10.20.193.4:0/2761840983 learned_addr learned my addr 10.20.193.4:0/2761840983 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fb7fe640 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5955890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fbfff640 1 -- 10.20.193.4:0/2761840983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5955dd0 msgr2=0x55eac59761b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.381 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f5700c69640 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5955dd0 0x55eac59761b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fbfff640 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5955dd0 0x55eac59761b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fbfff640 1 -- 10.20.193.4:0/2761840983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 msgr2=0x55eac5955890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fbfff640 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5955890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fbfff640 1 -- 10.20.193.4:0/2761840983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eac57c2310 con 0x55eac5910820 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fb7fe640 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5955890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f5700c69640 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5955dd0 0x55eac59761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56fbfff640 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5910bf0 secure :-1 s=READY pgs=1116 gs=1 cs=0 l=1 c_cookie=9024500176097116400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e800af50 tx=0x7f56e8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3d7718a7b800f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56ccce3640 1 -- 10.20.193.4:0/2761840983 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56e8010ea0 con 0x55eac5910820 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56ccce3640 1 -- 10.20.193.4:0/2761840983 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56e801cb10 con 0x55eac5910820 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f56ccce3640 1 -- 10.20.193.4:0/2761840983 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56e801ae50 con 0x55eac5910820 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 -- 10.20.193.4:0/2761840983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 msgr2=0x55eac5910bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5910bf0 secure :-1 s=READY pgs=1116 gs=1 cs=0 l=1 c_cookie=9024500176097116400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e800af50 tx=0x7f56e8011000 comp rx=0 tx=0).stop 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 -- 10.20.193.4:0/2761840983 shutdown_connections 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5955dd0 0x55eac59761b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5955890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 --2- 10.20.193.4:0/2761840983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5910bf0 unknown :-1 s=CLOSED pgs=1116 gs=1 cs=0 l=1 c_cookie=9024500176097116400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 -- 10.20.193.4:0/2761840983 >> 10.20.193.4:0/2761840983 conn(0x55eac582f6b0 msgr2=0x55eac590f100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 -- 10.20.193.4:0/2761840983 shutdown_connections 2026-02-24T09:17:51.382 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.379+0000 7f57046ede00 1 -- 10.20.193.4:0/2761840983 wait complete. 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f57046ede00 1 -- start start 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f57046ede00 1 Processor -- start 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f57046ede00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5910820 0x55eac5929070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f57046ede00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac59295b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f57046ede00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5955dd0 0x55eac592e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f57046ede00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55eac592eae0 con 0x55eac5955dd0 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f57046ede00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55eac592ec50 con 0x55eac5911130 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f57046ede00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55eac592ee10 con 0x55eac5910820 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f5700c69640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5955dd0 0x55eac592e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f5700c69640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5955dd0 0x55eac592e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36752/0 (socket says 10.20.193.4:36752) 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f5700c69640 1 -- 10.20.193.4:0/3172010428 learned_addr learned my addr 10.20.193.4:0/3172010428 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f56fbfff640 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5910820 0x55eac5929070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.380+0000 7f56fb7fe640 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac59295b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f5700c69640 1 -- 10.20.193.4:0/3172010428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5910820 msgr2=0x55eac5929070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f5700c69640 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5910820 0x55eac5929070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f5700c69640 1 -- 10.20.193.4:0/3172010428 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 msgr2=0x55eac59295b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f5700c69640 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac59295b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f5700c69640 1 -- 10.20.193.4:0/3172010428 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eac579a8c0 con 0x55eac5955dd0 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f5700c69640 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5955dd0 0x55eac592e5a0 secure :-1 s=READY pgs=1117 gs=1 cs=0 l=1 c_cookie=17642936543903077572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f0005900 tx=0x7f56f0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d84d4f7619d4c4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f56bdffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f56bdffb640 1 -- 10.20.193.4:0/3172010428 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56f00039a0 con 0x55eac5955dd0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f56bdffb640 1 -- 10.20.193.4:0/3172010428 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56f0039e40 con 0x55eac5955dd0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 1 -- 10.20.193.4:0/3172010428 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e800ac40 con 0x55eac5955dd0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f56bdffb640 1 -- 10.20.193.4:0/3172010428 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56f0044710 con 0x55eac5955dd0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 10 client.17670 _ll_register_callbacks cb 0x55eac57b2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 1 -- 10.20.193.4:0/3172010428 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eac55664a0 con 0x55eac5955dd0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f56bdffb640 1 -- 10.20.193.4:0/3172010428 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f56f004e440 con 0x55eac5955dd0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f56bdffb640 1 -- 10.20.193.4:0/3172010428 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f56f004e640 con 0x55eac5955dd0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 10 client.17670 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 1 -- 10.20.193.4:0/3172010428 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55eac57ac6e0 con 0x55eac5955dd0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f56bdffb640 1 -- 10.20.193.4:0/3172010428 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f56f0039960 con 0x55eac5955dd0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 10 client.17670 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 10 client.17670 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 20 client.17670 populate_metadata read hostname 'trial004' 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55eac5953900 0x55eac5953da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 4 client.17670 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f57046ede00 1 -- 10.20.193.4:0/3172010428 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eac580c4f0 con 0x55eac5953900 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.381+0000 7f56fbfff640 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55eac5953900 0x55eac5953da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f56fbfff640 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55eac5953900 0x55eac5953da0 crc :-1 s=READY pgs=179 gs=4 cs=0 l=0 c_cookie=14441566938065773592 s_cookie=12655713470485734930 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c86ac09d8f6fa418 server_cookie=afa220593b6da612 in_seq=0 out_seq=0 2026-02-24T09:17:51.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f56bdffb640 10 client.17670 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f56bdffb640 1 -- 10.20.193.4:0/3172010428 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55eac580c4f0 con 0x55eac5953900 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f56bdffb640 10 client.17670 handle_command_reply: tid=0 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 client.17670 shutdown 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 -- 10.20.193.4:0/3172010428 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5955dd0 msgr2=0x55eac592e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5955dd0 0x55eac592e5a0 secure :-1 s=READY pgs=1117 gs=1 cs=0 l=1 c_cookie=17642936543903077572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f0005900 tx=0x7f56f0003f90 comp rx=0 tx=0).stop 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 -- 10.20.193.4:0/3172010428 shutdown_connections 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55eac5953900 0x55eac5953da0 crc :-1 s=READY pgs=179 gs=4 cs=0 l=0 c_cookie=14441566938065773592 s_cookie=12655713470485734930 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5955dd0 0x55eac592e5a0 unknown :-1 s=CLOSED pgs=1117 gs=1 cs=0 l=1 c_cookie=17642936543903077572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac59295b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f56bdffb640 0 client.17670 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 --2- 10.20.193.4:0/3172010428 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5910820 0x55eac5929070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 -- 10.20.193.4:0/3172010428 >> 10.20.193.4:0/3172010428 conn(0x55eac582f6b0 msgr2=0x55eac590f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 -- 10.20.193.4:0/3172010428 shutdown_connections 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 1 -- 10.20.193.4:0/3172010428 wait complete. 2026-02-24T09:17:51.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.382+0000 7f57046ede00 20 client.17670 trim_cache size 0 max 16384 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.391+0000 7f57046ede00 1 Processor -- start 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.391+0000 7f57046ede00 1 -- start start 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5910820 0x55eac59295a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5955690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5953900 0x55eac594ea80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55eac58146e0 con 0x55eac5953900 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55eac54dff50 con 0x55eac5911130 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55eac5884410 con 0x55eac5910820 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f5700c69640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5953900 0x55eac594ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f5700c69640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5953900 0x55eac594ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36760/0 (socket says 10.20.193.4:36760) 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f5700c69640 1 -- 10.20.193.4:0/2407040157 learned_addr learned my addr 10.20.193.4:0/2407040157 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:51.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f56fbfff640 1 --2- 10.20.193.4:0/2407040157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5910820 0x55eac59295a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f56fb7fe640 1 --2- 10.20.193.4:0/2407040157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5955690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f5700c69640 1 -- 10.20.193.4:0/2407040157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5910820 msgr2=0x55eac59295a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f5700c69640 1 --2- 10.20.193.4:0/2407040157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5910820 0x55eac59295a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f5700c69640 1 -- 10.20.193.4:0/2407040157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 msgr2=0x55eac5955690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f5700c69640 1 --2- 10.20.193.4:0/2407040157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5955690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f5700c69640 1 -- 10.20.193.4:0/2407040157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eac57a7160 con 0x55eac5953900 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f56fb7fe640 1 --2- 10.20.193.4:0/2407040157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5955690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f5700c69640 1 --2- 10.20.193.4:0/2407040157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5953900 0x55eac594ea80 secure :-1 s=READY pgs=1118 gs=1 cs=0 l=1 c_cookie=5508247535248174656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f00302a0 tx=0x7f56f004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7139f309636e40 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f56bffff640 1 -- 10.20.193.4:0/2407040157 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56f000a310 con 0x55eac5953900 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f56bffff640 1 -- 10.20.193.4:0/2407040157 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55eac55664a0 con 0x55eac5953900 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f56bffff640 1 -- 10.20.193.4:0/2407040157 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56f0044680 con 0x55eac5953900 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 -- 10.20.193.4:0/2407040157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5953900 msgr2=0x55eac594ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 --2- 10.20.193.4:0/2407040157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5953900 0x55eac594ea80 secure :-1 s=READY pgs=1118 gs=1 cs=0 l=1 c_cookie=5508247535248174656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f00302a0 tx=0x7f56f004c000 comp rx=0 tx=0).stop 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 -- 10.20.193.4:0/2407040157 shutdown_connections 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 --2- 10.20.193.4:0/2407040157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5953900 0x55eac594ea80 unknown :-1 s=CLOSED pgs=1118 gs=1 cs=0 l=1 c_cookie=5508247535248174656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 --2- 10.20.193.4:0/2407040157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5955690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 --2- 10.20.193.4:0/2407040157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5910820 0x55eac59295a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 -- 10.20.193.4:0/2407040157 >> 10.20.193.4:0/2407040157 conn(0x55eac582f6b0 msgr2=0x55eac5928e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 -- 10.20.193.4:0/2407040157 shutdown_connections 2026-02-24T09:17:51.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.392+0000 7f57046ede00 1 -- 10.20.193.4:0/2407040157 wait complete. 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f57046ede00 1 -- start start 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f57046ede00 1 Processor -- start 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f57046ede00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5930e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f57046ede00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5931380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f57046ede00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5953900 0x55eac59bb2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f57046ede00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55eac5883150 con 0x55eac5910820 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f57046ede00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55eac5931bf0 con 0x55eac5911130 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f57046ede00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55eac59bb830 con 0x55eac5953900 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f56fbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5930e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f56fbfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5930e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36768/0 (socket says 10.20.193.4:36768) 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f56fbfff640 1 -- 10.20.193.4:0/117488445 learned_addr learned my addr 10.20.193.4:0/117488445 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f56fbfff640 1 -- 10.20.193.4:0/117488445 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5953900 msgr2=0x55eac59bb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f56fbfff640 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5953900 0x55eac59bb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f56fbfff640 1 -- 10.20.193.4:0/117488445 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 msgr2=0x55eac5931380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f56fbfff640 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5931380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f56fbfff640 1 -- 10.20.193.4:0/117488445 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eac579abf0 con 0x55eac5910820 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f56fbfff640 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5930e40 secure :-1 s=READY pgs=1119 gs=1 cs=0 l=1 c_cookie=3540380877895101267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e8010d70 tx=0x7f56e801a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3121f5a69485eb53 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.393+0000 7f56bdffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f56bdffb640 1 -- 10.20.193.4:0/117488445 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56e801ad40 con 0x55eac5910820 2026-02-24T09:17:51.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 1 -- 10.20.193.4:0/117488445 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eac57ac6e0 con 0x55eac5910820 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f56bdffb640 1 -- 10.20.193.4:0/117488445 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56e801aea0 con 0x55eac5910820 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f56bdffb640 1 -- 10.20.193.4:0/117488445 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56e8025450 con 0x55eac5910820 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 10 client.17676 _ll_register_callbacks cb 0x55eac5927140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 1 -- 10.20.193.4:0/117488445 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e801cb10 con 0x55eac5910820 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f56bdffb640 1 -- 10.20.193.4:0/117488445 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f56e80255e0 con 0x55eac5910820 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f56bdffb640 1 -- 10.20.193.4:0/117488445 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f56e80257e0 con 0x55eac5910820 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 10 client.17676 fetch_fsmap learned FSMap version 19 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 1 -- 10.20.193.4:0/117488445 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55eac57ac940 con 0x55eac5910820 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f56bdffb640 1 -- 10.20.193.4:0/117488445 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f56e8030070 con 0x55eac5910820 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 10 client.17676 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 10 client.17676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 20 client.17676 populate_metadata read hostname 'trial004' 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55eac5955dd0 0x55eac5a23590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 4 client.17676 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f57046ede00 1 -- 10.20.193.4:0/117488445 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eac554b160 con 0x55eac5955dd0 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.394+0000 7f56fb7fe640 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55eac5955dd0 0x55eac5a23590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f56bdffb640 10 client.17676 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:51.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f56fb7fe640 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55eac5955dd0 0x55eac5a23590 crc :-1 s=READY pgs=180 gs=4 cs=0 l=0 c_cookie=11952672518173671929 s_cookie=1539256978397131642 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5e06c53ca50c1f9 server_cookie=155c8a110766f37a in_seq=0 out_seq=0 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f56bdffb640 1 -- 10.20.193.4:0/117488445 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x55eac554b160 con 0x55eac5955dd0 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f56bdffb640 10 client.17676 handle_command_reply: tid=0 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 client.17676 shutdown 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 -- 10.20.193.4:0/117488445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 msgr2=0x55eac5930e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5930e40 secure :-1 s=READY pgs=1119 gs=1 cs=0 l=1 c_cookie=3540380877895101267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e8010d70 tx=0x7f56e801a430 comp rx=0 tx=0).stop 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 -- 10.20.193.4:0/117488445 shutdown_connections 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55eac5955dd0 0x55eac5a23590 crc :-1 s=READY pgs=180 gs=4 cs=0 l=0 c_cookie=11952672518173671929 s_cookie=1539256978397131642 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55eac5953900 0x55eac59bb2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f56bdffb640 0 client.17676 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55eac5911130 0x55eac5931380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 --2- 10.20.193.4:0/117488445 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55eac5910820 0x55eac5930e40 unknown :-1 s=CLOSED pgs=1119 gs=1 cs=0 l=1 c_cookie=3540380877895101267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 -- 10.20.193.4:0/117488445 >> 10.20.193.4:0/117488445 conn(0x55eac582f6b0 msgr2=0x55eac5954680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 -- 10.20.193.4:0/117488445 shutdown_connections 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.395+0000 7f57046ede00 1 -- 10.20.193.4:0/117488445 wait complete. 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57046ede00 20 client.17676 trim_cache size 0 max 16384 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "8a74e81b-c932-4485-9cf4-fe6952a41dd1", 2026-02-24T09:17:51.398 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.399 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:17:51.400 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:17:51.401 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 -- 10.20.193.4:0/537547341 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56d00b5760 msgr2=0x7f56d00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56d00b5760 0x7f56d00d5c10 secure :-1 s=READY pgs=415 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e8004740 tx=0x7f56e8005f00 comp rx=0 tx=0).stop 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 -- 10.20.193.4:0/537547341 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56fc110040 msgr2=0x7f56fc11e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56fc110040 0x7f56fc11e3f0 secure :-1 s=READY pgs=1115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56ec00c8c0 tx=0x7f56ec00cd90 comp rx=0 tx=0).stop 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 -- 10.20.193.4:0/537547341 shutdown_connections 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f56d00b5760 0x7f56d00d5c10 unknown :-1 s=CLOSED pgs=415 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f56fc115840 0x7f56fc1237c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f56fc110040 0x7f56fc11e3f0 unknown :-1 s=CLOSED pgs=1115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 --2- 10.20.193.4:0/537547341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56fc10f650 0x7f56fc11deb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 -- 10.20.193.4:0/537547341 >> 10.20.193.4:0/537547341 conn(0x7f56fc0ecf20 msgr2=0x7f56fc10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 -- 10.20.193.4:0/537547341 shutdown_connections 2026-02-24T09:17:51.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:17:51.396+0000 7f57026f3640 1 -- 10.20.193.4:0/537547341 wait complete. 2026-02-24T09:17:51.431 INFO:tasks.cephfs.filesystem:scrub status for tag:8a74e81b-c932-4485-9cf4-fe6952a41dd1 - {'path': '/', 'tag': '8a74e81b-c932-4485-9cf4-fe6952a41dd1', 'options': 'recursive,force'} 2026-02-24T09:17:51.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:51 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:17:51.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:51 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:51.714 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:51 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:17:51.715 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:51 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:52.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:51 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:17:52.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:51 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:52.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:51 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:17:52.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:51 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:52.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:51 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:17:52.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:51 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:52.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:51 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:17:52.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:51 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:17:52.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:52 trial004 ceph-mon[41596]: pgmap v394: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 914 MiB/s wr, 409 op/s 2026-02-24T09:17:53.083 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:52 trial090 ceph-mon[47278]: pgmap v394: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 914 MiB/s wr, 409 op/s 2026-02-24T09:17:53.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:52 trial014 ceph-mon[46941]: pgmap v394: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 914 MiB/s wr, 409 op/s 2026-02-24T09:17:55.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:54 trial004 ceph-mon[41596]: pgmap v395: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 883 MiB/s wr, 487 op/s 2026-02-24T09:17:55.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:54 trial090 ceph-mon[47278]: pgmap v395: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 883 MiB/s wr, 487 op/s 2026-02-24T09:17:55.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:54 trial014 ceph-mon[46941]: pgmap v395: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 883 MiB/s wr, 487 op/s 2026-02-24T09:17:57.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:56 trial004 ceph-mon[41596]: pgmap v396: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 875 MiB/s wr, 511 op/s 2026-02-24T09:17:57.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:56 trial090 ceph-mon[47278]: pgmap v396: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 875 MiB/s wr, 511 op/s 2026-02-24T09:17:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:56 trial014 ceph-mon[46941]: pgmap v396: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 875 MiB/s wr, 511 op/s 2026-02-24T09:17:59.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:17:58 trial004 ceph-mon[41596]: pgmap v397: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 818 MiB/s wr, 498 op/s 2026-02-24T09:17:59.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:17:58 trial090 ceph-mon[47278]: pgmap v397: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 818 MiB/s wr, 498 op/s 2026-02-24T09:17:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:17:58 trial014 ceph-mon[46941]: pgmap v397: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 818 MiB/s wr, 498 op/s 2026-02-24T09:18:01.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:00 trial004 ceph-mon[41596]: pgmap v398: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 597 MiB/s wr, 440 op/s 2026-02-24T09:18:01.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:00 trial090 ceph-mon[47278]: pgmap v398: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 597 MiB/s wr, 440 op/s 2026-02-24T09:18:01.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:00 trial014 ceph-mon[46941]: pgmap v398: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 597 MiB/s wr, 440 op/s 2026-02-24T09:18:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:02 trial004 ceph-mon[41596]: pgmap v399: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 398 MiB/s wr, 391 op/s 2026-02-24T09:18:03.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:02 trial090 ceph-mon[47278]: pgmap v399: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 398 MiB/s wr, 391 op/s 2026-02-24T09:18:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:02 trial014 ceph-mon[46941]: pgmap v399: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 398 MiB/s wr, 391 op/s 2026-02-24T09:18:05.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:04 trial004 ceph-mon[41596]: pgmap v400: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 107 MiB/s wr, 160 op/s 2026-02-24T09:18:05.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:04 trial090 ceph-mon[47278]: pgmap v400: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 107 MiB/s wr, 160 op/s 2026-02-24T09:18:05.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:04 trial014 ceph-mon[46941]: pgmap v400: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 107 MiB/s wr, 160 op/s 2026-02-24T09:18:06.008 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:18:06.123 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:06.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 -- 10.20.193.4:0/413279562 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa4810f280 msgr2=0x7ffa4810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 --2- 10.20.193.4:0/413279562 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa4810f280 0x7ffa4810f650 secure :-1 s=READY pgs=1120 gs=1 cs=0 l=1 c_cookie=17776960477360194563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa38009950 tx=0x7ffa3802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 -- 10.20.193.4:0/413279562 shutdown_connections 2026-02-24T09:18:06.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 --2- 10.20.193.4:0/413279562 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa48115470 0x7ffa48175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 --2- 10.20.193.4:0/413279562 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa4810fc70 0x7ffa48114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 --2- 10.20.193.4:0/413279562 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa4810f280 0x7ffa4810f650 unknown :-1 s=CLOSED pgs=1120 gs=1 cs=0 l=1 c_cookie=17776960477360194563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 -- 10.20.193.4:0/413279562 >> 10.20.193.4:0/413279562 conn(0x7ffa4805f830 msgr2=0x7ffa4810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:06.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 -- 10.20.193.4:0/413279562 shutdown_connections 2026-02-24T09:18:06.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 -- 10.20.193.4:0/413279562 wait complete. 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 Processor -- start 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 -- start start 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa4810f280 0x7ffa480f55e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa4810fc70 0x7ffa48175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa48115470 0x7ffa480f5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480faef0 con 0x7ffa4810fc70 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480fb060 con 0x7ffa48115470 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4eca3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480fb220 con 0x7ffa4810f280 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa3ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa4810fc70 0x7ffa48175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa3ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa4810fc70 0x7ffa48175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33160/0 (socket says 10.20.193.4:33160) 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa3ffff640 1 -- 10.20.193.4:0/3964312566 learned_addr learned my addr 10.20.193.4:0/3964312566 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4ca18640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa4810f280 0x7ffa480f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.225+0000 7ffa4d219640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa48115470 0x7ffa480f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa3ffff640 1 -- 10.20.193.4:0/3964312566 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa4810f280 msgr2=0x7ffa480f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa3ffff640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa4810f280 0x7ffa480f55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa3ffff640 1 -- 10.20.193.4:0/3964312566 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa48115470 msgr2=0x7ffa480f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa3ffff640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa48115470 0x7ffa480f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa3ffff640 1 -- 10.20.193.4:0/3964312566 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa38009570 con 0x7ffa4810fc70 2026-02-24T09:18:06.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa3ffff640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa4810fc70 0x7ffa48175d40 secure :-1 s=READY pgs=1121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa3000b500 tx=0x7ffa3000b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:06.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa3dffb640 1 -- 10.20.193.4:0/3964312566 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa300044a0 con 0x7ffa4810fc70 2026-02-24T09:18:06.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa4eca3640 1 -- 10.20.193.4:0/3964312566 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa480fb500 con 0x7ffa4810fc70 2026-02-24T09:18:06.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa3dffb640 1 -- 10.20.193.4:0/3964312566 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa30002b80 con 0x7ffa4810fc70 2026-02-24T09:18:06.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa3dffb640 1 -- 10.20.193.4:0/3964312566 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa3000fd90 con 0x7ffa4810fc70 2026-02-24T09:18:06.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa4eca3640 1 -- 10.20.193.4:0/3964312566 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa480fba20 con 0x7ffa4810fc70 2026-02-24T09:18:06.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.226+0000 7ffa4eca3640 1 -- 10.20.193.4:0/3964312566 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa48110560 con 0x7ffa4810fc70 2026-02-24T09:18:06.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.228+0000 7ffa3dffb640 1 -- 10.20.193.4:0/3964312566 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ffa30002cf0 con 0x7ffa4810fc70 2026-02-24T09:18:06.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.228+0000 7ffa3dffb640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa240b56d0 0x7ffa240d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.228+0000 7ffa3dffb640 1 -- 10.20.193.4:0/3964312566 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ffa300e67b0 con 0x7ffa4810fc70 2026-02-24T09:18:06.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.228+0000 7ffa4ca18640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa240b56d0 0x7ffa240d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.229+0000 7ffa4ca18640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa240b56d0 0x7ffa240d5b80 secure :-1 s=READY pgs=416 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa380098a0 tx=0x7ffa38031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:06.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.229+0000 7ffa3dffb640 1 -- 10.20.193.4:0/3964312566 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ffa300a9170 con 0x7ffa4810fc70 2026-02-24T09:18:06.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.361+0000 7ffa4eca3640 1 -- 10.20.193.4:0/3964312566 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa480f6770 con 0x7ffa4810fc70 2026-02-24T09:18:06.363 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.361+0000 7ffa3dffb640 1 -- 10.20.193.4:0/3964312566 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7ffa300ac320 con 0x7ffa4810fc70 2026-02-24T09:18:06.364 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:18:06.364 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:18:06.364 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 -- 10.20.193.4:0/3964312566 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa240b56d0 msgr2=0x7ffa240d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa240b56d0 0x7ffa240d5b80 secure :-1 s=READY pgs=416 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa380098a0 tx=0x7ffa38031040 comp rx=0 tx=0).stop 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 -- 10.20.193.4:0/3964312566 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa4810fc70 msgr2=0x7ffa48175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa4810fc70 0x7ffa48175d40 secure :-1 s=READY pgs=1121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa3000b500 tx=0x7ffa3000b9d0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 -- 10.20.193.4:0/3964312566 shutdown_connections 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa240b56d0 0x7ffa240d5b80 unknown :-1 s=CLOSED pgs=416 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa48115470 0x7ffa480f5ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa4810fc70 0x7ffa48175d40 unknown :-1 s=CLOSED pgs=1121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 --2- 10.20.193.4:0/3964312566 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa4810f280 0x7ffa480f55e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 -- 10.20.193.4:0/3964312566 >> 10.20.193.4:0/3964312566 conn(0x7ffa4805f830 msgr2=0x7ffa4810d730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 -- 10.20.193.4:0/3964312566 shutdown_connections 2026-02-24T09:18:06.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.362+0000 7ffa4eca3640 1 -- 10.20.193.4:0/3964312566 wait complete. 2026-02-24T09:18:06.402 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id e54b9686 --release --await' 2026-02-24T09:18:06.402 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id e54b9686 --release --await 2026-02-24T09:18:06.516 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:06.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 -- 10.20.193.4:0/2876161638 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb68c115470 msgr2=0x7fb68c175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 --2- 10.20.193.4:0/2876161638 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb68c115470 0x7fb68c175e40 secure :-1 s=READY pgs=1122 gs=1 cs=0 l=1 c_cookie=17524207104378166811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb68000aa30 tx=0x7fb680030280 comp rx=0 tx=0).stop 2026-02-24T09:18:06.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 -- 10.20.193.4:0/2876161638 shutdown_connections 2026-02-24T09:18:06.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 --2- 10.20.193.4:0/2876161638 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb68c115470 0x7fb68c175e40 unknown :-1 s=CLOSED pgs=1122 gs=1 cs=0 l=1 c_cookie=17524207104378166811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 --2- 10.20.193.4:0/2876161638 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb68c10fc70 0x7fb68c114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 --2- 10.20.193.4:0/2876161638 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb68c10f280 0x7fb68c10f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 -- 10.20.193.4:0/2876161638 >> 10.20.193.4:0/2876161638 conn(0x7fb68c05f830 msgr2=0x7fb68c10cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 -- 10.20.193.4:0/2876161638 shutdown_connections 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 -- 10.20.193.4:0/2876161638 wait complete. 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 Processor -- start 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.614+0000 7fb691e89640 1 -- start start 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb691e89640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb68c10f280 0x7fb68c11db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb691e89640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb68c10fc70 0x7fb68c11e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb691e89640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb68c115470 0x7fb68c123480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb691e89640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c123aa0 con 0x7fb68c10f280 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb691e89640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c123c10 con 0x7fb68c10fc70 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb691e89640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c123dd0 con 0x7fb68c115470 2026-02-24T09:18:06.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb68b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb68c10f280 0x7fb68c11db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb68b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb68c10f280 0x7fb68c11db70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33172/0 (socket says 10.20.193.4:33172) 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb68b7fe640 1 -- 10.20.193.4:0/3982134730 learned_addr learned my addr 10.20.193.4:0/3982134730 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb68bfff640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb68c115470 0x7fb68c123480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb68b7fe640 1 -- 10.20.193.4:0/3982134730 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb68c115470 msgr2=0x7fb68c123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb68c115470 0x7fb68c123480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb68b7fe640 1 -- 10.20.193.4:0/3982134730 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb68c10fc70 msgr2=0x7fb68c11e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb68c10fc70 0x7fb68c11e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb68b7fe640 1 -- 10.20.193.4:0/3982134730 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68000a650 con 0x7fb68c10f280 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb68c10f280 0x7fb68c11db70 secure :-1 s=READY pgs=1123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb67800d950 tx=0x7fb67800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb688ff9640 1 -- 10.20.193.4:0/3982134730 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb678004540 con 0x7fb68c10f280 2026-02-24T09:18:06.621 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb688ff9640 1 -- 10.20.193.4:0/3982134730 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb678009d00 con 0x7fb68c10f280 2026-02-24T09:18:06.622 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb691e89640 1 -- 10.20.193.4:0/3982134730 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68c1240b0 con 0x7fb68c10f280 2026-02-24T09:18:06.622 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb688ff9640 1 -- 10.20.193.4:0/3982134730 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6780106e0 con 0x7fb68c10f280 2026-02-24T09:18:06.622 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.615+0000 7fb691e89640 1 -- 10.20.193.4:0/3982134730 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68c1647b0 con 0x7fb68c10f280 2026-02-24T09:18:06.628 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.617+0000 7fb688ff9640 1 -- 10.20.193.4:0/3982134730 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fb6780097c0 con 0x7fb68c10f280 2026-02-24T09:18:06.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.617+0000 7fb688ff9640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6600b56e0 0x7fb6600d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.617+0000 7fb688ff9640 1 -- 10.20.193.4:0/3982134730 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb6780e6e60 con 0x7fb68c10f280 2026-02-24T09:18:06.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.617+0000 7fb68affd640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6600b56e0 0x7fb6600d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.618+0000 7fb68affd640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6600b56e0 0x7fb6600d5b90 secure :-1 s=READY pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb67c005970 tx=0x7fb67c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:06.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb693e83e00 1 Processor -- start 2026-02-24T09:18:06.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb693e83e00 1 -- start start 2026-02-24T09:18:06.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a2e5fb0 0x563c7a2e6380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e68c0 0x563c7a32b020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a32b560 0x563c7a34b940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.629 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb693e83e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c7a1f7050 con 0x563c7a2e5fb0 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb693e83e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c7a1f2d80 con 0x563c7a32b560 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb693e83e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c7a1ecee0 con 0x563c7a2e68c0 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a2e5fb0 0x563c7a2e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a2e5fb0 0x563c7a2e6380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33188/0 (socket says 10.20.193.4:33188) 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68b7fe640 1 -- 10.20.193.4:0/1844429037 learned_addr learned my addr 10.20.193.4:0/1844429037 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68affd640 1 --2- 10.20.193.4:0/1844429037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e68c0 0x563c7a32b020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68bfff640 1 --2- 10.20.193.4:0/1844429037 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a32b560 0x563c7a34b940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68b7fe640 1 -- 10.20.193.4:0/1844429037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e68c0 msgr2=0x563c7a32b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/1844429037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e68c0 0x563c7a32b020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68b7fe640 1 -- 10.20.193.4:0/1844429037 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a32b560 msgr2=0x563c7a34b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/1844429037 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a32b560 0x563c7a34b940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68b7fe640 1 -- 10.20.193.4:0/1844429037 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7a198540 con 0x563c7a2e5fb0 2026-02-24T09:18:06.630 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/1844429037 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a2e5fb0 0x563c7a2e6380 secure :-1 s=READY pgs=1124 gs=1 cs=0 l=1 c_cookie=17311195054804243238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6780a9760 tx=0x7fb678002cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03db82f071b1326 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb64ffff640 1 -- 10.20.193.4:0/1844429037 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb67805b110 con 0x563c7a2e5fb0 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb64ffff640 1 -- 10.20.193.4:0/1844429037 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb6780acb70 con 0x563c7a2e5fb0 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.619+0000 7fb64ffff640 1 -- 10.20.193.4:0/1844429037 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6780ade20 con 0x563c7a2e5fb0 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.620+0000 7fb693e83e00 1 -- 10.20.193.4:0/1844429037 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a2e5fb0 msgr2=0x563c7a2e6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.620+0000 7fb693e83e00 1 --2- 10.20.193.4:0/1844429037 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a2e5fb0 0x563c7a2e6380 secure :-1 s=READY pgs=1124 gs=1 cs=0 l=1 c_cookie=17311195054804243238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6780a9760 tx=0x7fb678002cc0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.620+0000 7fb693e83e00 1 -- 10.20.193.4:0/1844429037 shutdown_connections 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.620+0000 7fb693e83e00 1 --2- 10.20.193.4:0/1844429037 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a32b560 0x563c7a34b940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.620+0000 7fb693e83e00 1 --2- 10.20.193.4:0/1844429037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e68c0 0x563c7a32b020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.620+0000 7fb693e83e00 1 --2- 10.20.193.4:0/1844429037 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a2e5fb0 0x563c7a2e6380 unknown :-1 s=CLOSED pgs=1124 gs=1 cs=0 l=1 c_cookie=17311195054804243238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.620+0000 7fb693e83e00 1 -- 10.20.193.4:0/1844429037 >> 10.20.193.4:0/1844429037 conn(0x563c7a2c44b0 msgr2=0x563c7a2e4890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.620+0000 7fb693e83e00 1 -- 10.20.193.4:0/1844429037 shutdown_connections 2026-02-24T09:18:06.631 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.620+0000 7fb693e83e00 1 -- 10.20.193.4:0/1844429037 wait complete. 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 -- start start 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 Processor -- start 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 0x563c7a342ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 0x563c7a3433e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3483d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c7a348910 con 0x563c7a32b560 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c7a348a80 con 0x563c7a2e68c0 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c7a348c40 con 0x563c7a2e5fb0 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33192/0 (socket says 10.20.193.4:33192) 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68bfff640 1 -- 10.20.193.4:0/4225844011 learned_addr learned my addr 10.20.193.4:0/4225844011 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:06.632 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68affd640 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 0x563c7a3433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 0x563c7a342ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68bfff640 1 -- 10.20.193.4:0/4225844011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 msgr2=0x563c7a342ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68bfff640 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 0x563c7a342ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68bfff640 1 -- 10.20.193.4:0/4225844011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 msgr2=0x563c7a3433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68bfff640 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 0x563c7a3433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68bfff640 1 -- 10.20.193.4:0/4225844011 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7a170bd0 con 0x563c7a32b560 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68affd640 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 0x563c7a3433e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb68bfff640 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3483d0 secure :-1 s=READY pgs=1125 gs=1 cs=0 l=1 c_cookie=2364053943555224461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb680005900 tx=0x7fb6800396a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cece894f78738d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb64d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb64d7fa640 1 -- 10.20.193.4:0/4225844011 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb680003bb0 con 0x563c7a32b560 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb64d7fa640 1 -- 10.20.193.4:0/4225844011 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb68003f050 con 0x563c7a32b560 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 -- 10.20.193.4:0/4225844011 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68c1647b0 con 0x563c7a32b560 2026-02-24T09:18:06.633 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb64d7fa640 1 -- 10.20.193.4:0/4225844011 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb680044690 con 0x563c7a32b560 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 10 client.17694 _ll_register_callbacks cb 0x563c7a1db290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 -- 10.20.193.4:0/4225844011 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c79f3c700 con 0x563c7a32b560 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb64d7fa640 1 -- 10.20.193.4:0/4225844011 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb680044820 con 0x563c7a32b560 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb64d7fa640 1 -- 10.20.193.4:0/4225844011 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb680044a60 con 0x563c7a32b560 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 10 client.17694 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.621+0000 7fb693e83e00 1 -- 10.20.193.4:0/4225844011 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563c7a182910 con 0x563c7a32b560 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.622+0000 7fb64d7fa640 1 -- 10.20.193.4:0/4225844011 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb680046cf0 con 0x563c7a32b560 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.622+0000 7fb693e83e00 10 client.17694 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.622+0000 7fb693e83e00 10 client.17694 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.622+0000 7fb693e83e00 20 client.17694 populate_metadata read hostname 'trial004' 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.622+0000 7fb693e83e00 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563c7a3287e0 0x563c7a328c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.622+0000 7fb693e83e00 4 client.17694 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:06.634 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.622+0000 7fb693e83e00 1 -- 10.20.193.4:0/4225844011 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c7a1e2920 con 0x563c7a3287e0 2026-02-24T09:18:06.635 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.622+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563c7a3287e0 0x563c7a328c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.635 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.622+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563c7a3287e0 0x563c7a328c80 crc :-1 s=READY pgs=181 gs=4 cs=0 l=0 c_cookie=3396542392769585953 s_cookie=6546924915410916999 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f22f14f81962321 server_cookie=5adb59860238d687 in_seq=0 out_seq=0 2026-02-24T09:18:06.635 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.622+0000 7fb64d7fa640 10 client.17694 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:06.635 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb64d7fa640 1 -- 10.20.193.4:0/4225844011 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563c7a1e2920 con 0x563c7a3287e0 2026-02-24T09:18:06.635 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb64d7fa640 10 client.17694 handle_command_reply: tid=0 2026-02-24T09:18:06.635 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 client.17694 shutdown 2026-02-24T09:18:06.635 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 -- 10.20.193.4:0/4225844011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 msgr2=0x563c7a3483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.635 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3483d0 secure :-1 s=READY pgs=1125 gs=1 cs=0 l=1 c_cookie=2364053943555224461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb680005900 tx=0x7fb6800396a0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 -- 10.20.193.4:0/4225844011 shutdown_connections 2026-02-24T09:18:06.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563c7a3287e0 0x563c7a328c80 crc :-1 s=READY pgs=181 gs=4 cs=0 l=0 c_cookie=3396542392769585953 s_cookie=6546924915410916999 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3483d0 unknown :-1 s=CLOSED pgs=1125 gs=1 cs=0 l=1 c_cookie=2364053943555224461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 0x563c7a3433e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb64d7fa640 0 client.17694 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:06.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 --2- 10.20.193.4:0/4225844011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 0x563c7a342ea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 -- 10.20.193.4:0/4225844011 >> 10.20.193.4:0/4225844011 conn(0x563c7a2c44b0 msgr2=0x563c7a2e4890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:06.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 -- 10.20.193.4:0/4225844011 shutdown_connections 2026-02-24T09:18:06.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 1 -- 10.20.193.4:0/4225844011 wait complete. 2026-02-24T09:18:06.636 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.623+0000 7fb693e83e00 20 client.17694 trim_cache size 0 max 16384 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb693e83e00 1 Processor -- start 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb693e83e00 1 -- start start 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 0x563c7a340180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 0x563c7a3406c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3261a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb693e83e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c7a1eab10 con 0x563c7a32b560 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb693e83e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c79eb61b0 con 0x563c7a2e68c0 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb693e83e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c7a2e6dd0 con 0x563c7a2e5fb0 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3261a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3261a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33208/0 (socket says 10.20.193.4:33208) 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68bfff640 1 -- 10.20.193.4:0/2600152956 learned_addr learned my addr 10.20.193.4:0/2600152956 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68affd640 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 0x563c7a3406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.640 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68bfff640 1 -- 10.20.193.4:0/2600152956 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 msgr2=0x563c7a340180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 0x563c7a340180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68bfff640 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 0x563c7a340180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68bfff640 1 -- 10.20.193.4:0/2600152956 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 msgr2=0x563c7a3406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68bfff640 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 0x563c7a3406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68bfff640 1 -- 10.20.193.4:0/2600152956 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7a3353a0 con 0x563c7a32b560 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68affd640 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 0x563c7a3406c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 0x563c7a340180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb68bfff640 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3261a0 secure :-1 s=READY pgs=1126 gs=1 cs=0 l=1 c_cookie=3737388190711964308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6800587e0 tx=0x7fb68004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dddec207206294 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb64f7fe640 1 -- 10.20.193.4:0/2600152956 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb680044820 con 0x563c7a32b560 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb64f7fe640 1 -- 10.20.193.4:0/2600152956 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb68003f070 con 0x563c7a32b560 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.632+0000 7fb64f7fe640 1 -- 10.20.193.4:0/2600152956 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb680044690 con 0x563c7a32b560 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 -- 10.20.193.4:0/2600152956 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 msgr2=0x563c7a3261a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3261a0 secure :-1 s=READY pgs=1126 gs=1 cs=0 l=1 c_cookie=3737388190711964308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6800587e0 tx=0x7fb68004e000 comp rx=0 tx=0).stop 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 -- 10.20.193.4:0/2600152956 shutdown_connections 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a3261a0 unknown :-1 s=CLOSED pgs=1126 gs=1 cs=0 l=1 c_cookie=3737388190711964308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e68c0 0x563c7a3406c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 --2- 10.20.193.4:0/2600152956 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e5fb0 0x563c7a340180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 -- 10.20.193.4:0/2600152956 >> 10.20.193.4:0/2600152956 conn(0x563c7a2c44b0 msgr2=0x563c7a33fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 -- 10.20.193.4:0/2600152956 shutdown_connections 2026-02-24T09:18:06.641 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 -- 10.20.193.4:0/2600152956 wait complete. 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 -- start start 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 Processor -- start 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e5fb0 0x563c7a2ca4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e68c0 0x563c7a2c5bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a2c61e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c7a328e10 con 0x563c7a32b560 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c7a2c6910 con 0x563c7a2e5fb0 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb693e83e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c7a3914d0 con 0x563c7a2e68c0 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb68bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a2c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb68bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a2c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33210/0 (socket says 10.20.193.4:33210) 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb68bfff640 1 -- 10.20.193.4:0/1162038030 learned_addr learned my addr 10.20.193.4:0/1162038030 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e5fb0 0x563c7a2ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb68affd640 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e68c0 0x563c7a2c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb68bfff640 1 -- 10.20.193.4:0/1162038030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e68c0 msgr2=0x563c7a2c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb68bfff640 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e68c0 0x563c7a2c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb68bfff640 1 -- 10.20.193.4:0/1162038030 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e5fb0 msgr2=0x563c7a2ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb68bfff640 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e5fb0 0x563c7a2ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.633+0000 7fb68bfff640 1 -- 10.20.193.4:0/1162038030 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7a17d390 con 0x563c7a32b560 2026-02-24T09:18:06.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb68bfff640 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a2c61e0 secure :-1 s=READY pgs=1127 gs=1 cs=0 l=1 c_cookie=3214656581985920921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb680006b60 tx=0x7fb6800443e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9cc1211c246799 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb64d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb64d7fa640 1 -- 10.20.193.4:0/1162038030 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb680005300 con 0x563c7a32b560 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb64d7fa640 1 -- 10.20.193.4:0/1162038030 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x563c79f3c700 con 0x563c7a32b560 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 1 -- 10.20.193.4:0/1162038030 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7a182910 con 0x563c7a32b560 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb64d7fa640 1 -- 10.20.193.4:0/1162038030 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6800577a0 con 0x563c7a32b560 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 10 client.17700 _ll_register_callbacks cb 0x563c7a1db290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 1 -- 10.20.193.4:0/1162038030 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6780acb70 con 0x563c7a32b560 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb64d7fa640 1 -- 10.20.193.4:0/1162038030 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb680057930 con 0x563c7a32b560 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb64d7fa640 1 -- 10.20.193.4:0/1162038030 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb680057b10 con 0x563c7a32b560 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 10 client.17700 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 1 -- 10.20.193.4:0/1162038030 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563c7a170f00 con 0x563c7a32b560 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb64d7fa640 1 -- 10.20.193.4:0/1162038030 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb6800054b0 con 0x563c7a32b560 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 10 client.17700 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 10 client.17700 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 20 client.17700 populate_metadata read hostname 'trial004' 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563c7a3d8eb0 0x563c7a3f9330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 4 client.17700 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e54b9686", "release": true, "await": true}] 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb693e83e00 1 -- 10.20.193.4:0/1162038030 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e54b9686", "release": true, "await": true}) -- 0x563c79f213c0 con 0x563c7a3d8eb0 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563c7a3d8eb0 0x563c7a3f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb68b7fe640 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563c7a3d8eb0 0x563c7a3f9330 crc :-1 s=READY pgs=182 gs=4 cs=0 l=0 c_cookie=4821661757913222549 s_cookie=12174680822958346375 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42e9fbd29380cd95 server_cookie=a8f527b44a315087 in_seq=0 out_seq=0 2026-02-24T09:18:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.634+0000 7fb64d7fa640 10 client.17700 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb64d7fa640 1 -- 10.20.193.4:0/1162038030 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563c79f213c0 con 0x563c7a3d8eb0 2026-02-24T09:18:06.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb64d7fa640 10 client.17700 handle_command_reply: tid=0 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 client.17700 shutdown 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 -- 10.20.193.4:0/1162038030 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 msgr2=0x563c7a2c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a2c61e0 secure :-1 s=READY pgs=1127 gs=1 cs=0 l=1 c_cookie=3214656581985920921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb680006b60 tx=0x7fb6800443e0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 -- 10.20.193.4:0/1162038030 shutdown_connections 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563c7a3d8eb0 0x563c7a3f9330 crc :-1 s=READY pgs=182 gs=4 cs=0 l=0 c_cookie=4821661757913222549 s_cookie=12174680822958346375 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c7a32b560 0x563c7a2c61e0 unknown :-1 s=CLOSED pgs=1127 gs=1 cs=0 l=1 c_cookie=3214656581985920921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c7a2e68c0 0x563c7a2c5bb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb64d7fa640 0 client.17700 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 --2- 10.20.193.4:0/1162038030 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c7a2e5fb0 0x563c7a2ca4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 -- 10.20.193.4:0/1162038030 >> 10.20.193.4:0/1162038030 conn(0x563c7a2c44b0 msgr2=0x563c7a340180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 -- 10.20.193.4:0/1162038030 shutdown_connections 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 1 -- 10.20.193.4:0/1162038030 wait complete. 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb693e83e00 20 client.17700 trim_cache size 0 max 16384 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:18:06.645 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 32, 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "e54b9686": { 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "version": 32, 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 142.8, 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:06.646 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:18:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 -- 10.20.193.4:0/3982134730 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6600b56e0 msgr2=0x7fb6600d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6600b56e0 0x7fb6600d5b90 secure :-1 s=READY pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb67c005970 tx=0x7fb67c005900 comp rx=0 tx=0).stop 2026-02-24T09:18:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 -- 10.20.193.4:0/3982134730 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb68c10f280 msgr2=0x7fb68c11db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb68c10f280 0x7fb68c11db70 secure :-1 s=READY pgs=1123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb67800d950 tx=0x7fb67800de20 comp rx=0 tx=0).stop 2026-02-24T09:18:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 -- 10.20.193.4:0/3982134730 shutdown_connections 2026-02-24T09:18:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb6600b56e0 0x7fb6600d5b90 unknown :-1 s=CLOSED pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb68c115470 0x7fb68c123480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb68c10fc70 0x7fb68c11e0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 --2- 10.20.193.4:0/3982134730 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb68c10f280 0x7fb68c11db70 unknown :-1 s=CLOSED pgs=1123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 -- 10.20.193.4:0/3982134730 >> 10.20.193.4:0/3982134730 conn(0x7fb68c05f830 msgr2=0x7fb68c10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:06.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 -- 10.20.193.4:0/3982134730 shutdown_connections 2026-02-24T09:18:06.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.638+0000 7fb691e89640 1 -- 10.20.193.4:0/3982134730 wait complete. 2026-02-24T09:18:06.701 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e54b9686', total seconds elapsed: 23.5 2026-02-24T09:18:06.701 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.8 2026-02-24T09:18:06.701 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:18:06.865 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.994+0000 7f5d377ce640 1 -- 10.20.193.4:0/326806780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d30115470 msgr2=0x7f5d30175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.994+0000 7f5d377ce640 1 --2- 10.20.193.4:0/326806780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d30115470 0x7f5d30175e40 secure :-1 s=READY pgs=1128 gs=1 cs=0 l=1 c_cookie=1216031342215177110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d2c00a970 tx=0x7f5d2c0301b0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.994+0000 7f5d377ce640 1 -- 10.20.193.4:0/326806780 shutdown_connections 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.994+0000 7f5d377ce640 1 --2- 10.20.193.4:0/326806780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d30115470 0x7f5d30175e40 unknown :-1 s=CLOSED pgs=1128 gs=1 cs=0 l=1 c_cookie=1216031342215177110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.994+0000 7f5d377ce640 1 --2- 10.20.193.4:0/326806780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d3010fc70 0x7f5d30114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.994+0000 7f5d377ce640 1 --2- 10.20.193.4:0/326806780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d3010f280 0x7f5d3010f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.994+0000 7f5d377ce640 1 -- 10.20.193.4:0/326806780 >> 10.20.193.4:0/326806780 conn(0x7f5d3005f830 msgr2=0x7f5d3010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.994+0000 7f5d377ce640 1 -- 10.20.193.4:0/326806780 shutdown_connections 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.994+0000 7f5d377ce640 1 -- 10.20.193.4:0/326806780 wait complete. 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d377ce640 1 Processor -- start 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d377ce640 1 -- start start 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d377ce640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d3010f280 0x7f5d3011db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d377ce640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d3010fc70 0x7f5d3011e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d377ce640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d30115470 0x7f5d30123480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:06.998 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d377ce640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30123aa0 con 0x7f5d3010f280 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d377ce640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30123c10 con 0x7f5d3010fc70 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d377ce640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30123dd0 con 0x7f5d30115470 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d35543640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d3010f280 0x7f5d3011db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d35543640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d3010f280 0x7f5d3011db70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33242/0 (socket says 10.20.193.4:33242) 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d35543640 1 -- 10.20.193.4:0/3214725996 learned_addr learned my addr 10.20.193.4:0/3214725996 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d34d42640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d3010fc70 0x7f5d3011e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d35d44640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d30115470 0x7f5d30123480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d35543640 1 -- 10.20.193.4:0/3214725996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d30115470 msgr2=0x7f5d30123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d35543640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d30115470 0x7f5d30123480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d35543640 1 -- 10.20.193.4:0/3214725996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d3010fc70 msgr2=0x7f5d3011e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d35543640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d3010fc70 0x7f5d3011e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d35543640 1 -- 10.20.193.4:0/3214725996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d240094b0 con 0x7f5d3010f280 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.995+0000 7f5d34d42640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d3010fc70 0x7f5d3011e0b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.996+0000 7f5d35543640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d3010f280 0x7f5d3011db70 secure :-1 s=READY pgs=1129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d20005940 tx=0x7f5d2000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.996+0000 7f5d1e7fc640 1 -- 10.20.193.4:0/3214725996 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d2000cd10 con 0x7f5d3010f280 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.996+0000 7f5d377ce640 1 -- 10.20.193.4:0/3214725996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c00a590 con 0x7f5d3010f280 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.996+0000 7f5d377ce640 1 -- 10.20.193.4:0/3214725996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d30164610 con 0x7f5d3010f280 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.996+0000 7f5d1e7fc640 1 -- 10.20.193.4:0/3214725996 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5d2000ce70 con 0x7f5d3010f280 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.996+0000 7f5d1e7fc640 1 -- 10.20.193.4:0/3214725996 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d20005330 con 0x7f5d3010f280 2026-02-24T09:18:06.999 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:06.997+0000 7f5d377ce640 1 -- 10.20.193.4:0/3214725996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d30110560 con 0x7f5d3010f280 2026-02-24T09:18:07.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.000+0000 7f5d1e7fc640 1 -- 10.20.193.4:0/3214725996 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f5d20004950 con 0x7f5d3010f280 2026-02-24T09:18:07.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.001+0000 7f5d1e7fc640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d0c0b56e0 0x7f5d0c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.001+0000 7f5d34d42640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d0c0b56e0 0x7f5d0c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.001+0000 7f5d1e7fc640 1 -- 10.20.193.4:0/3214725996 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f5d20014070 con 0x7f5d3010f280 2026-02-24T09:18:07.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.002+0000 7f5d34d42640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d0c0b56e0 0x7f5d0c0d5b90 secure :-1 s=READY pgs=418 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d30124510 tx=0x7f5d24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:07.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.002+0000 7f5d1e7fc640 1 -- 10.20.193.4:0/3214725996 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f5d200a9630 con 0x7f5d3010f280 2026-02-24T09:18:07.175 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.172+0000 7f5d377ce640 1 -- 10.20.193.4:0/3214725996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d3010f650 con 0x7f5d3010f280 2026-02-24T09:18:07.175 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:06 trial004 ceph-mon[41596]: pgmap v401: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 8.2 MiB/s wr, 37 op/s 2026-02-24T09:18:07.176 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:06 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3964312566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:07.176 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.173+0000 7f5d1e7fc640 1 -- 10.20.193.4:0/3214725996 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f5d200ac750 con 0x7f5d3010f280 2026-02-24T09:18:07.177 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:18:07.177 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:18:07.177 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:18:07.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.178+0000 7f5d377ce640 1 -- 10.20.193.4:0/3214725996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d0c0b56e0 msgr2=0x7f5d0c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.178+0000 7f5d377ce640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d0c0b56e0 0x7f5d0c0d5b90 secure :-1 s=READY pgs=418 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d30124510 tx=0x7f5d24005f90 comp rx=0 tx=0).stop 2026-02-24T09:18:07.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.178+0000 7f5d377ce640 1 -- 10.20.193.4:0/3214725996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d3010f280 msgr2=0x7f5d3011db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.178+0000 7f5d377ce640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d3010f280 0x7f5d3011db70 secure :-1 s=READY pgs=1129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d20005940 tx=0x7f5d2000ee60 comp rx=0 tx=0).stop 2026-02-24T09:18:07.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.178+0000 7f5d377ce640 1 -- 10.20.193.4:0/3214725996 shutdown_connections 2026-02-24T09:18:07.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.179+0000 7f5d377ce640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5d0c0b56e0 0x7f5d0c0d5b90 unknown :-1 s=CLOSED pgs=418 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.179+0000 7f5d377ce640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5d30115470 0x7f5d30123480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.179+0000 7f5d377ce640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5d3010fc70 0x7f5d3011e0b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.179+0000 7f5d377ce640 1 --2- 10.20.193.4:0/3214725996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5d3010f280 0x7f5d3011db70 unknown :-1 s=CLOSED pgs=1129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.179+0000 7f5d377ce640 1 -- 10.20.193.4:0/3214725996 >> 10.20.193.4:0/3214725996 conn(0x7f5d3005f830 msgr2=0x7f5d3010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:07.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.179+0000 7f5d377ce640 1 -- 10.20.193.4:0/3214725996 shutdown_connections 2026-02-24T09:18:07.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.179+0000 7f5d377ce640 1 -- 10.20.193.4:0/3214725996 wait complete. 2026-02-24T09:18:07.284 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 142.8 --await-for 45.0' 2026-02-24T09:18:07.284 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 142.8 --await-for 45.0 2026-02-24T09:18:07.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:06 trial090 ceph-mon[47278]: pgmap v401: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 8.2 MiB/s wr, 37 op/s 2026-02-24T09:18:07.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:06 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3964312566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:07.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:06 trial014 ceph-mon[46941]: pgmap v401: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 8.2 MiB/s wr, 37 op/s 2026-02-24T09:18:07.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:06 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3964312566' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:07.443 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:07.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.571+0000 7f7237491640 1 -- 10.20.193.4:0/3435561429 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7230061940 msgr2=0x7f7230155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.571+0000 7f7237491640 1 --2- 10.20.193.4:0/3435561429 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7230061940 0x7f7230155190 secure :-1 s=READY pgs=1130 gs=1 cs=0 l=1 c_cookie=9814125819071416917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7224009950 tx=0x7f722402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.571+0000 7f7237491640 1 -- 10.20.193.4:0/3435561429 shutdown_connections 2026-02-24T09:18:07.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.571+0000 7f7237491640 1 --2- 10.20.193.4:0/3435561429 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72301556d0 0x7f7230175ab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.571+0000 7f7237491640 1 --2- 10.20.193.4:0/3435561429 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7230061940 0x7f7230155190 unknown :-1 s=CLOSED pgs=1130 gs=1 cs=0 l=1 c_cookie=9814125819071416917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.571+0000 7f7237491640 1 --2- 10.20.193.4:0/3435561429 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7230061030 0x7f7230061400 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.571+0000 7f7237491640 1 -- 10.20.193.4:0/3435561429 >> 10.20.193.4:0/3435561429 conn(0x7f723005f830 msgr2=0x7f723010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.571+0000 7f7237491640 1 -- 10.20.193.4:0/3435561429 shutdown_connections 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.571+0000 7f7237491640 1 -- 10.20.193.4:0/3435561429 wait complete. 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7237491640 1 Processor -- start 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7237491640 1 -- start start 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7237491640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7230061030 0x7f7230161d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7237491640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7230061940 0x7f72301622d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7237491640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72301556d0 0x7f72301676a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7237491640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7230167cc0 con 0x7f7230061940 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7237491640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7230167e30 con 0x7f7230061030 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7237491640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7230167ff0 con 0x7f72301556d0 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7234a05640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7230061940 0x7f72301622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7234a05640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7230061940 0x7f72301622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33258/0 (socket says 10.20.193.4:33258) 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7234a05640 1 -- 10.20.193.4:0/3391487025 learned_addr learned my addr 10.20.193.4:0/3391487025 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7235206640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7230061030 0x7f7230161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7235a07640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72301556d0 0x7f72301676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7234a05640 1 -- 10.20.193.4:0/3391487025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72301556d0 msgr2=0x7f72301676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7234a05640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72301556d0 0x7f72301676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7234a05640 1 -- 10.20.193.4:0/3391487025 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7230061030 msgr2=0x7f7230161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7234a05640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7230061030 0x7f7230161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7234a05640 1 -- 10.20.193.4:0/3391487025 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7224009570 con 0x7f7230061940 2026-02-24T09:18:07.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.572+0000 7f7234a05640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7230061940 0x7f72301622d0 secure :-1 s=READY pgs=1131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72240023d0 tx=0x7f72240043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:07.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.573+0000 7f721e7fc640 1 -- 10.20.193.4:0/3391487025 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f722403d070 con 0x7f7230061940 2026-02-24T09:18:07.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.573+0000 7f7237491640 1 -- 10.20.193.4:0/3391487025 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7230168270 con 0x7f7230061940 2026-02-24T09:18:07.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.573+0000 7f7237491640 1 -- 10.20.193.4:0/3391487025 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72301512f0 con 0x7f7230061940 2026-02-24T09:18:07.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.573+0000 7f721e7fc640 1 -- 10.20.193.4:0/3391487025 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7224038920 con 0x7f7230061940 2026-02-24T09:18:07.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.573+0000 7f721e7fc640 1 -- 10.20.193.4:0/3391487025 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72240419a0 con 0x7f7230061940 2026-02-24T09:18:07.580 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.576+0000 7f721e7fc640 1 -- 10.20.193.4:0/3391487025 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f7224038a90 con 0x7f7230061940 2026-02-24T09:18:07.581 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.577+0000 7f721e7fc640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f720c0b5760 0x7f720c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.581 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.577+0000 7f721e7fc640 1 -- 10.20.193.4:0/3391487025 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f722410b290 con 0x7f7230061940 2026-02-24T09:18:07.581 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.577+0000 7f7235206640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f720c0b5760 0x7f720c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.581 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.577+0000 7f7235206640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f720c0b5760 0x7f720c0d5c10 secure :-1 s=READY pgs=419 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7220004740 tx=0x7f722000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:07.583 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.579+0000 7f723948be00 1 Processor -- start 2026-02-24T09:18:07.583 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.579+0000 7f723948be00 1 -- start start 2026-02-24T09:18:07.583 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f723948be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e844fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f723948be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e8454e0 0x561a9e889c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f723948be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e88a180 0x561a9e8aa560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f723948be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561a9e753f20 con 0x561a9e844bd0 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f723948be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561a9e74fc50 con 0x561a9e88a180 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f723948be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561a9e749db0 con 0x561a9e8454e0 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235206640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e844fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235206640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e844fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33260/0 (socket says 10.20.193.4:33260) 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235206640 1 -- 10.20.193.4:0/3468925492 learned_addr learned my addr 10.20.193.4:0/3468925492 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7234a05640 1 --2- 10.20.193.4:0/3468925492 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e8454e0 0x561a9e889c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235a07640 1 --2- 10.20.193.4:0/3468925492 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e88a180 0x561a9e8aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.584 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235206640 1 -- 10.20.193.4:0/3468925492 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e8454e0 msgr2=0x561a9e889c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:07.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235206640 1 --2- 10.20.193.4:0/3468925492 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e8454e0 0x561a9e889c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235206640 1 -- 10.20.193.4:0/3468925492 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e88a180 msgr2=0x561a9e8aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:07.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235206640 1 --2- 10.20.193.4:0/3468925492 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e88a180 0x561a9e8aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235206640 1 -- 10.20.193.4:0/3468925492 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a9e6ea690 con 0x561a9e844bd0 2026-02-24T09:18:07.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235a07640 1 --2- 10.20.193.4:0/3468925492 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e88a180 0x561a9e8aa560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:07.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f7235206640 1 --2- 10.20.193.4:0/3468925492 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e844fa0 secure :-1 s=READY pgs=1132 gs=1 cs=0 l=1 c_cookie=14328561405446133350 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7220005db0 tx=0x7f7220013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d946aea9fd1666 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:07.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f71fdce5640 1 -- 10.20.193.4:0/3468925492 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f722001e640 con 0x561a9e844bd0 2026-02-24T09:18:07.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f71fdce5640 1 -- 10.20.193.4:0/3468925492 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7220015070 con 0x561a9e844bd0 2026-02-24T09:18:07.585 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.580+0000 7f71fdce5640 1 -- 10.20.193.4:0/3468925492 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7220026d50 con 0x561a9e844bd0 2026-02-24T09:18:07.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.581+0000 7f723948be00 1 -- 10.20.193.4:0/3468925492 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 msgr2=0x561a9e844fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.581+0000 7f723948be00 1 --2- 10.20.193.4:0/3468925492 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e844fa0 secure :-1 s=READY pgs=1132 gs=1 cs=0 l=1 c_cookie=14328561405446133350 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7220005db0 tx=0x7f7220013000 comp rx=0 tx=0).stop 2026-02-24T09:18:07.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.581+0000 7f723948be00 1 -- 10.20.193.4:0/3468925492 shutdown_connections 2026-02-24T09:18:07.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.581+0000 7f723948be00 1 --2- 10.20.193.4:0/3468925492 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e88a180 0x561a9e8aa560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.581+0000 7f723948be00 1 --2- 10.20.193.4:0/3468925492 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e8454e0 0x561a9e889c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.581+0000 7f723948be00 1 --2- 10.20.193.4:0/3468925492 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e844fa0 unknown :-1 s=CLOSED pgs=1132 gs=1 cs=0 l=1 c_cookie=14328561405446133350 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.581+0000 7f723948be00 1 -- 10.20.193.4:0/3468925492 >> 10.20.193.4:0/3468925492 conn(0x561a9e762880 msgr2=0x561a9e8434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:07.590 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.581+0000 7f723948be00 1 -- 10.20.193.4:0/3468925492 shutdown_connections 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.581+0000 7f723948be00 1 -- 10.20.193.4:0/3468925492 wait complete. 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.582+0000 7f723948be00 1 -- start start 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.582+0000 7f723948be00 1 Processor -- start 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e85cad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e8454e0 0x561a9e85d010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e862000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561a9e862540 con 0x561a9e844bd0 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561a9e8626b0 con 0x561a9e8454e0 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561a9e862870 con 0x561a9e88a180 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7235206640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e85cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7235206640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e85cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33270/0 (socket says 10.20.193.4:33270) 2026-02-24T09:18:07.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7235206640 1 -- 10.20.193.4:0/3075452694 learned_addr learned my addr 10.20.193.4:0/3075452694 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7235a07640 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e862000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7234a05640 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e8454e0 0x561a9e85d010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7235206640 1 -- 10.20.193.4:0/3075452694 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 msgr2=0x561a9e862000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7235206640 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e862000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7235206640 1 -- 10.20.193.4:0/3075452694 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e8454e0 msgr2=0x561a9e85d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7235206640 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e8454e0 0x561a9e85d010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7235206640 1 -- 10.20.193.4:0/3075452694 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a9e6f53d0 con 0x561a9e844bd0 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f7235206640 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e85cad0 secure :-1 s=READY pgs=1133 gs=1 cs=0 l=1 c_cookie=15398727129483051347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7220020040 tx=0x7f72200266d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b344bd02020153 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f71eaffd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f71eaffd640 1 -- 10.20.193.4:0/3075452694 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f722002c070 con 0x561a9e844bd0 2026-02-24T09:18:07.592 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 1 -- 10.20.193.4:0/3075452694 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722000bd10 con 0x561a9e844bd0 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f71eaffd640 1 -- 10.20.193.4:0/3075452694 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7220015050 con 0x561a9e844bd0 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f71eaffd640 1 -- 10.20.193.4:0/3075452694 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72200316f0 con 0x561a9e844bd0 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 10 client.17718 _ll_register_callbacks cb 0x561a9e6caa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 1 -- 10.20.193.4:0/3075452694 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a9e3d7eb0 con 0x561a9e844bd0 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f71eaffd640 1 -- 10.20.193.4:0/3075452694 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f7220017070 con 0x561a9e844bd0 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f71eaffd640 1 -- 10.20.193.4:0/3075452694 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7220004e10 con 0x561a9e844bd0 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 10 client.17718 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.583+0000 7f723948be00 1 -- 10.20.193.4:0/3075452694 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561a9e6cd5c0 con 0x561a9e844bd0 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.586+0000 7f71eaffd640 1 -- 10.20.193.4:0/3075452694 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f7220024020 con 0x561a9e844bd0 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.586+0000 7f723948be00 10 client.17718 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.586+0000 7f723948be00 10 client.17718 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.586+0000 7f723948be00 20 client.17718 populate_metadata read hostname 'trial004' 2026-02-24T09:18:07.593 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.586+0000 7f723948be00 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561a9e8872c0 0x561a9e887760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.586+0000 7f723948be00 4 client.17718 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.586+0000 7f723948be00 1 -- 10.20.193.4:0/3075452694 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a9e75af00 con 0x561a9e8872c0 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.586+0000 7f7234a05640 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561a9e8872c0 0x561a9e887760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.586+0000 7f7234a05640 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561a9e8872c0 0x561a9e887760 crc :-1 s=READY pgs=183 gs=4 cs=0 l=0 c_cookie=490733201281756633 s_cookie=10570119182569176117 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cf6f3f1de3add9 server_cookie=92b09b64c693fc35 in_seq=0 out_seq=0 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.586+0000 7f71eaffd640 10 client.17718 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f71eaffd640 1 -- 10.20.193.4:0/3075452694 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561a9e75af00 con 0x561a9e8872c0 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f71eaffd640 10 client.17718 handle_command_reply: tid=0 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 client.17718 shutdown 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 -- 10.20.193.4:0/3075452694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 msgr2=0x561a9e85cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e85cad0 secure :-1 s=READY pgs=1133 gs=1 cs=0 l=1 c_cookie=15398727129483051347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7220020040 tx=0x7f72200266d0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 -- 10.20.193.4:0/3075452694 shutdown_connections 2026-02-24T09:18:07.594 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561a9e8872c0 0x561a9e887760 crc :-1 s=READY pgs=183 gs=4 cs=0 l=0 c_cookie=490733201281756633 s_cookie=10570119182569176117 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e862000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e8454e0 0x561a9e85d010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 --2- 10.20.193.4:0/3075452694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e85cad0 unknown :-1 s=CLOSED pgs=1133 gs=1 cs=0 l=1 c_cookie=15398727129483051347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f71eaffd640 0 client.17718 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:07.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 -- 10.20.193.4:0/3075452694 >> 10.20.193.4:0/3075452694 conn(0x561a9e762880 msgr2=0x561a9e843bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:07.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 -- 10.20.193.4:0/3075452694 shutdown_connections 2026-02-24T09:18:07.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 1 -- 10.20.193.4:0/3075452694 wait complete. 2026-02-24T09:18:07.595 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.587+0000 7f723948be00 20 client.17718 trim_cache size 0 max 16384 2026-02-24T09:18:07.604 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f723948be00 1 Processor -- start 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f723948be00 1 -- start start 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f723948be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e844bd0 0x561a9e8824e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f723948be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e8454e0 0x561a9e882a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f723948be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e888e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f723948be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561a9e7479e0 con 0x561a9e8454e0 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f723948be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561a9e3ffec0 con 0x561a9e844bd0 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f723948be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561a9e7b3580 con 0x561a9e88a180 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f7234a05640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e8454e0 0x561a9e882a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f7234a05640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e8454e0 0x561a9e882a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33272/0 (socket says 10.20.193.4:33272) 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f7234a05640 1 -- 10.20.193.4:0/454882140 learned_addr learned my addr 10.20.193.4:0/454882140 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:07.605 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f7235206640 1 --2- 10.20.193.4:0/454882140 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e844bd0 0x561a9e8824e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f7235a07640 1 --2- 10.20.193.4:0/454882140 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e888e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f7234a05640 1 -- 10.20.193.4:0/454882140 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 msgr2=0x561a9e888e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f7234a05640 1 --2- 10.20.193.4:0/454882140 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e888e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f7234a05640 1 -- 10.20.193.4:0/454882140 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e844bd0 msgr2=0x561a9e8824e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f7234a05640 1 --2- 10.20.193.4:0/454882140 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e844bd0 0x561a9e8824e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.597+0000 7f7234a05640 1 -- 10.20.193.4:0/454882140 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a9e84f4a0 con 0x561a9e8454e0 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f7234a05640 1 --2- 10.20.193.4:0/454882140 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e8454e0 0x561a9e882a20 secure :-1 s=READY pgs=1134 gs=1 cs=0 l=1 c_cookie=14251001417933147599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7224005b30 tx=0x7f7224108cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c5ba48d97e4dcf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f71fd4e4640 1 -- 10.20.193.4:0/454882140 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72240d7320 con 0x561a9e8454e0 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f71fd4e4640 1 -- 10.20.193.4:0/454882140 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f72240d7070 con 0x561a9e8454e0 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f71fd4e4640 1 -- 10.20.193.4:0/454882140 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72240d2290 con 0x561a9e8454e0 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f723948be00 1 -- 10.20.193.4:0/454882140 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e8454e0 msgr2=0x561a9e882a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.606 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f723948be00 1 --2- 10.20.193.4:0/454882140 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e8454e0 0x561a9e882a20 secure :-1 s=READY pgs=1134 gs=1 cs=0 l=1 c_cookie=14251001417933147599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7224005b30 tx=0x7f7224108cd0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f723948be00 1 -- 10.20.193.4:0/454882140 shutdown_connections 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f723948be00 1 --2- 10.20.193.4:0/454882140 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e888e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f723948be00 1 --2- 10.20.193.4:0/454882140 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e8454e0 0x561a9e882a20 unknown :-1 s=CLOSED pgs=1134 gs=1 cs=0 l=1 c_cookie=14251001417933147599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f723948be00 1 --2- 10.20.193.4:0/454882140 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e844bd0 0x561a9e8824e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f723948be00 1 -- 10.20.193.4:0/454882140 >> 10.20.193.4:0/454882140 conn(0x561a9e762880 msgr2=0x561a9e861650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f723948be00 1 -- 10.20.193.4:0/454882140 shutdown_connections 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.598+0000 7f723948be00 1 -- 10.20.193.4:0/454882140 wait complete. 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 1 -- start start 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 1 Processor -- start 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e868b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e8454e0 0x561a9e8645c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.607 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e864b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561a9e854b70 con 0x561a9e844bd0 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561a9e883b80 con 0x561a9e8454e0 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561a9e865040 con 0x561a9e88a180 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7235206640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e868b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7235206640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e868b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:33276/0 (socket says 10.20.193.4:33276) 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7235206640 1 -- 10.20.193.4:0/332899296 learned_addr learned my addr 10.20.193.4:0/332899296 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7234a05640 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e8454e0 0x561a9e8645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7235a07640 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e864b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7235206640 1 -- 10.20.193.4:0/332899296 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 msgr2=0x561a9e864b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7235206640 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e864b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7235206640 1 -- 10.20.193.4:0/332899296 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e8454e0 msgr2=0x561a9e8645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:07.608 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7235206640 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e8454e0 0x561a9e8645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7235206640 1 -- 10.20.193.4:0/332899296 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a9e6df500 con 0x561a9e844bd0 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f7235206640 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e868b40 secure :-1 s=READY pgs=1135 gs=1 cs=0 l=1 c_cookie=6913469915700939708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7220011010 tx=0x7f7220011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff194425ab44bbc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f71eaffd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f71eaffd640 1 -- 10.20.193.4:0/332899296 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f722002c040 con 0x561a9e844bd0 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 1 -- 10.20.193.4:0/332899296 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72301512f0 con 0x561a9e844bd0 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 10 client.17724 _ll_register_callbacks cb 0x561a9e6caa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f723948be00 1 -- 10.20.193.4:0/332899296 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a9e3d5700 con 0x561a9e844bd0 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f71eaffd640 1 -- 10.20.193.4:0/332899296 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7220015030 con 0x561a9e844bd0 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f71eaffd640 1 -- 10.20.193.4:0/332899296 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7220004cd0 con 0x561a9e844bd0 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.599+0000 7f71eaffd640 1 -- 10.20.193.4:0/332899296 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f7220017070 con 0x561a9e844bd0 2026-02-24T09:18:07.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f71eaffd640 1 -- 10.20.193.4:0/332899296 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7220004e60 con 0x561a9e844bd0 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f723948be00 10 client.17724 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f723948be00 1 -- 10.20.193.4:0/332899296 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561a9e6d9f80 con 0x561a9e844bd0 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f71eaffd640 1 -- 10.20.193.4:0/332899296 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f7220024050 con 0x561a9e844bd0 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f723948be00 10 client.17724 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f723948be00 10 client.17724 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f723948be00 20 client.17724 populate_metadata read hostname 'trial004' 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f723948be00 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561a9e937da0 0x561a9e958250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f723948be00 4 client.17724 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.8, "await_for": 45.0}] 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f723948be00 1 -- 10.20.193.4:0/332899296 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.8, "await_for": 45.0}) -- 0x561a9e75cb70 con 0x561a9e937da0 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f7234a05640 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561a9e937da0 0x561a9e958250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:07.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f7234a05640 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561a9e937da0 0x561a9e958250 crc :-1 s=READY pgs=184 gs=4 cs=0 l=0 c_cookie=15032335127862819429 s_cookie=13161880628674116518 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d09d952770e3ba65 server_cookie=b6a864b278373ba6 in_seq=0 out_seq=0 2026-02-24T09:18:07.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.600+0000 7f71eaffd640 10 client.17724 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:07.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f71eaffd640 1 -- 10.20.193.4:0/332899296 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561a9e75cb70 con 0x561a9e937da0 2026-02-24T09:18:07.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f71eaffd640 10 client.17724 handle_command_reply: tid=0 2026-02-24T09:18:07.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f723948be00 1 client.17724 shutdown 2026-02-24T09:18:07.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f723948be00 1 -- 10.20.193.4:0/332899296 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 msgr2=0x561a9e868b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f723948be00 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e868b40 secure :-1 s=READY pgs=1135 gs=1 cs=0 l=1 c_cookie=6913469915700939708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7220011010 tx=0x7f7220011440 comp rx=0 tx=0).stop 2026-02-24T09:18:07.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f723948be00 1 -- 10.20.193.4:0/332899296 shutdown_connections 2026-02-24T09:18:07.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f723948be00 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561a9e937da0 0x561a9e958250 crc :-1 s=READY pgs=184 gs=4 cs=0 l=0 c_cookie=15032335127862819429 s_cookie=13161880628674116518 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f723948be00 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561a9e88a180 0x561a9e864b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f723948be00 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561a9e8454e0 0x561a9e8645c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f71eaffd640 0 client.17724 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:07.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f723948be00 1 --2- 10.20.193.4:0/332899296 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561a9e844bd0 0x561a9e868b40 unknown :-1 s=CLOSED pgs=1135 gs=1 cs=0 l=1 c_cookie=6913469915700939708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.611+0000 7f723948be00 1 -- 10.20.193.4:0/332899296 >> 10.20.193.4:0/332899296 conn(0x561a9e762880 msgr2=0x561a9e85fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:07.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f723948be00 1 -- 10.20.193.4:0/332899296 shutdown_connections 2026-02-24T09:18:07.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f723948be00 1 -- 10.20.193.4:0/332899296 wait complete. 2026-02-24T09:18:07.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f723948be00 20 client.17724 trim_cache size 0 max 16384 2026-02-24T09:18:07.616 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:18:07.616 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:18:07.616 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 34, 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "af9a5827": { 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "version": 34, 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 142.8, 2026-02-24T09:18:07.617 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:18:07.618 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:18:07.618 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:18:07.618 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:18:07.618 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:18:07.618 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:18:07.618 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:07.618 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:07.618 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:07.618 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:07.618 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:07.619 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:18:07.619 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 -- 10.20.193.4:0/3391487025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f720c0b5760 msgr2=0x7f720c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f720c0b5760 0x7f720c0d5c10 secure :-1 s=READY pgs=419 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7220004740 tx=0x7f722000b410 comp rx=0 tx=0).stop 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 -- 10.20.193.4:0/3391487025 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7230061940 msgr2=0x7f72301622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7230061940 0x7f72301622d0 secure :-1 s=READY pgs=1131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72240023d0 tx=0x7f72240043d0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 -- 10.20.193.4:0/3391487025 shutdown_connections 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f720c0b5760 0x7f720c0d5c10 unknown :-1 s=CLOSED pgs=419 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f72301556d0 0x7f72301676a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7230061940 0x7f72301622d0 unknown :-1 s=CLOSED pgs=1131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 --2- 10.20.193.4:0/3391487025 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7230061030 0x7f7230161d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 -- 10.20.193.4:0/3391487025 >> 10.20.193.4:0/3391487025 conn(0x7f723005f830 msgr2=0x7f723010ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 -- 10.20.193.4:0/3391487025 shutdown_connections 2026-02-24T09:18:07.620 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:07.612+0000 7f7237491640 1 -- 10.20.193.4:0/3391487025 wait complete. 2026-02-24T09:18:07.655 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'af9a5827', quiesce took 1.0 seconds. Will release after: 21.8 2026-02-24T09:18:08.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:07 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3214725996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:08.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:07 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3214725996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:08.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:07 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3214725996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:08 trial004 ceph-mon[41596]: pgmap v402: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2026-02-24T09:18:09.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:08 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:18:09.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:08 trial090 ceph-mon[47278]: pgmap v402: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2026-02-24T09:18:09.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:08 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:18:09.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:08 trial014 ceph-mon[46941]: pgmap v402: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 2.4 KiB/s wr, 7 op/s 2026-02-24T09:18:09.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:08 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:18:11.145 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:10 trial014 ceph-mon[46941]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2026-02-24T09:18:11.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:10 trial004 ceph-mon[41596]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2026-02-24T09:18:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:10 trial090 ceph-mon[47278]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2026-02-24T09:18:13.135 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:12 trial090 ceph-mon[47278]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2026-02-24T09:18:13.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:12 trial004 ceph-mon[41596]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2026-02-24T09:18:13.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:12 trial014 ceph-mon[46941]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2026-02-24T09:18:15.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:14 trial004 ceph-mon[41596]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2026-02-24T09:18:15.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:14 trial090 ceph-mon[47278]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2026-02-24T09:18:15.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:14 trial014 ceph-mon[46941]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2026-02-24T09:18:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:16 trial004 ceph-mon[41596]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2026-02-24T09:18:17.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:16 trial090 ceph-mon[47278]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2026-02-24T09:18:17.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:16 trial014 ceph-mon[46941]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2026-02-24T09:18:19.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:18 trial004 ceph-mon[41596]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2026-02-24T09:18:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:18 trial090 ceph-mon[47278]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2026-02-24T09:18:19.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:18 trial014 ceph-mon[46941]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2026-02-24T09:18:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:20 trial004 ceph-mon[41596]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2026-02-24T09:18:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:20 trial090 ceph-mon[47278]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2026-02-24T09:18:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:20 trial014 ceph-mon[46941]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 2.3 KiB/s wr, 6 op/s 2026-02-24T09:18:21.433 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:18:21.547 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:21.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.644+0000 7f585976d640 1 -- 10.20.193.4:0/581934722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f585410d3d0 msgr2=0x7f585410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.644+0000 7f585976d640 1 --2- 10.20.193.4:0/581934722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f585410d3d0 0x7f585410d7a0 secure :-1 s=READY pgs=1136 gs=1 cs=0 l=1 c_cookie=13710487919187548152 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5848009950 tx=0x7f584802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.644+0000 7f585976d640 1 -- 10.20.193.4:0/581934722 shutdown_connections 2026-02-24T09:18:21.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.644+0000 7f585976d640 1 --2- 10.20.193.4:0/581934722 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f58541135c0 0x7f5854173f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.644+0000 7f585976d640 1 --2- 10.20.193.4:0/581934722 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f585410ddc0 0x7f5854112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.644+0000 7f585976d640 1 --2- 10.20.193.4:0/581934722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f585410d3d0 0x7f585410d7a0 unknown :-1 s=CLOSED pgs=1136 gs=1 cs=0 l=1 c_cookie=13710487919187548152 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.644+0000 7f585976d640 1 -- 10.20.193.4:0/581934722 >> 10.20.193.4:0/581934722 conn(0x7f58540eaca0 msgr2=0x7f585410b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.644+0000 7f585976d640 1 -- 10.20.193.4:0/581934722 shutdown_connections 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.644+0000 7f585976d640 1 -- 10.20.193.4:0/581934722 wait complete. 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f585976d640 1 Processor -- start 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f585976d640 1 -- start start 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f585976d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f585410d3d0 0x7f58540f58b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f585976d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f585410ddc0 0x7f5854173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f585976d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f58541135c0 0x7f58540f5fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f585976d640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f58540fb170 con 0x7f585410ddc0 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f585976d640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f58540fb2e0 con 0x7f585410d3d0 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f585976d640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58540fb4a0 con 0x7f58541135c0 2026-02-24T09:18:21.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f58527fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f585410ddc0 0x7f5854173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f58527fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f585410ddc0 0x7f5854173e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36688/0 (socket says 10.20.193.4:36688) 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f58527fc640 1 -- 10.20.193.4:0/1148501275 learned_addr learned my addr 10.20.193.4:0/1148501275 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f5852ffd640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f585410d3d0 0x7f58540f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f58537fe640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f58541135c0 0x7f58540f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f58527fc640 1 -- 10.20.193.4:0/1148501275 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f58541135c0 msgr2=0x7f58540f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f58527fc640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f58541135c0 0x7f58540f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f58527fc640 1 -- 10.20.193.4:0/1148501275 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f585410d3d0 msgr2=0x7f58540f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f58527fc640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f585410d3d0 0x7f58540f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f58527fc640 1 -- 10.20.193.4:0/1148501275 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5848009570 con 0x7f585410ddc0 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f58527fc640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f585410ddc0 0x7f5854173e90 secure :-1 s=READY pgs=1137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f583c005db0 tx=0x7f583c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f5833fff640 1 -- 10.20.193.4:0/1148501275 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f583c004500 con 0x7f585410ddc0 2026-02-24T09:18:21.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f5833fff640 1 -- 10.20.193.4:0/1148501275 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f583c004d30 con 0x7f585410ddc0 2026-02-24T09:18:21.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f585976d640 1 -- 10.20.193.4:0/1148501275 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58540fb780 con 0x7f585410ddc0 2026-02-24T09:18:21.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f5833fff640 1 -- 10.20.193.4:0/1148501275 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f583c005310 con 0x7f585410ddc0 2026-02-24T09:18:21.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.645+0000 7f585976d640 1 -- 10.20.193.4:0/1148501275 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58540fbc00 con 0x7f585410ddc0 2026-02-24T09:18:21.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.647+0000 7f5833fff640 1 -- 10.20.193.4:0/1148501275 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f583c0054a0 con 0x7f585410ddc0 2026-02-24T09:18:21.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.647+0000 7f5833fff640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58280b56d0 0x7f58280d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.647+0000 7f5833fff640 1 -- 10.20.193.4:0/1148501275 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f583c0e6cd0 con 0x7f585410ddc0 2026-02-24T09:18:21.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.648+0000 7f5852ffd640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58280b56d0 0x7f58280d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.648+0000 7f5852ffd640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58280b56d0 0x7f58280d5b80 secure :-1 s=READY pgs=420 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5848005b30 tx=0x7f584803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:21.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f585b767e00 1 Processor -- start 2026-02-24T09:18:21.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f585b767e00 1 -- start start 2026-02-24T09:18:21.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f585b767e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 0x563107156bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f585b767e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 0x56310719b890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f585b767e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071bc1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f585b767e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563107066de0 con 0x56310719bdd0 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f585b767e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563107062b10 con 0x563107157130 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f585b767e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56310705cab0 con 0x563107156820 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f58537fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071bc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f58537fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071bc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36694/0 (socket says 10.20.193.4:36694) 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f58537fe640 1 -- 10.20.193.4:0/1900442532 learned_addr learned my addr 10.20.193.4:0/1900442532 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f5852ffd640 1 --2- 10.20.193.4:0/1900442532 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 0x563107156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f58537fe640 1 -- 10.20.193.4:0/1900442532 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 msgr2=0x563107156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:21.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f58537fe640 1 --2- 10.20.193.4:0/1900442532 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 0x563107156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f58537fe640 1 -- 10.20.193.4:0/1900442532 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 msgr2=0x56310719b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f58537fe640 1 --2- 10.20.193.4:0/1900442532 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 0x56310719b890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f58537fe640 1 -- 10.20.193.4:0/1900442532 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563107008310 con 0x56310719bdd0 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.649+0000 7f58537fe640 1 --2- 10.20.193.4:0/1900442532 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071bc1b0 secure :-1 s=READY pgs=1138 gs=1 cs=0 l=1 c_cookie=3893927964187516260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5844006d50 tx=0x7f5844003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360a02da3e5b5d64 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f581f7fe640 1 -- 10.20.193.4:0/1900442532 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5844010c50 con 0x56310719bdd0 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f581f7fe640 1 -- 10.20.193.4:0/1900442532 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5844010db0 con 0x56310719bdd0 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f581f7fe640 1 -- 10.20.193.4:0/1900442532 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58440119c0 con 0x56310719bdd0 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f585b767e00 1 -- 10.20.193.4:0/1900442532 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 msgr2=0x5631071bc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f585b767e00 1 --2- 10.20.193.4:0/1900442532 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071bc1b0 secure :-1 s=READY pgs=1138 gs=1 cs=0 l=1 c_cookie=3893927964187516260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5844006d50 tx=0x7f5844003ea0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f585b767e00 1 -- 10.20.193.4:0/1900442532 shutdown_connections 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f585b767e00 1 --2- 10.20.193.4:0/1900442532 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071bc1b0 unknown :-1 s=CLOSED pgs=1138 gs=1 cs=0 l=1 c_cookie=3893927964187516260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f585b767e00 1 --2- 10.20.193.4:0/1900442532 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 0x56310719b890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f585b767e00 1 --2- 10.20.193.4:0/1900442532 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 0x563107156bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f585b767e00 1 -- 10.20.193.4:0/1900442532 >> 10.20.193.4:0/1900442532 conn(0x5631070756b0 msgr2=0x563107155100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f585b767e00 1 -- 10.20.193.4:0/1900442532 shutdown_connections 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.650+0000 7f585b767e00 1 -- 10.20.193.4:0/1900442532 wait complete. 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 1 -- start start 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 1 Processor -- start 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107156820 0x56310716ee80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107157130 0x56310716f3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071743b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5631071748f0 con 0x56310719bdd0 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563107174a60 con 0x563107156820 2026-02-24T09:18:21.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563107174c20 con 0x563107157130 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f58537fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f58537fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071743b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36698/0 (socket says 10.20.193.4:36698) 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f58537fe640 1 -- 10.20.193.4:0/376854780 learned_addr learned my addr 10.20.193.4:0/376854780 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f58527fc640 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107157130 0x56310716f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f58537fe640 1 -- 10.20.193.4:0/376854780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107157130 msgr2=0x56310716f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f58537fe640 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107157130 0x56310716f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f58537fe640 1 -- 10.20.193.4:0/376854780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107156820 msgr2=0x56310716ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f58537fe640 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107156820 0x56310716ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f58537fe640 1 -- 10.20.193.4:0/376854780 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563106fe08c0 con 0x56310719bdd0 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f58537fe640 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071743b0 secure :-1 s=READY pgs=1139 gs=1 cs=0 l=1 c_cookie=6718029165809632849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58440050f0 tx=0x7f5844010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3b3beec2cc0651 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f581cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f581cff9640 1 -- 10.20.193.4:0/376854780 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5844011d70 con 0x56310719bdd0 2026-02-24T09:18:21.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 1 -- 10.20.193.4:0/376854780 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5844005550 con 0x56310719bdd0 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f581cff9640 1 -- 10.20.193.4:0/376854780 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5844011ed0 con 0x56310719bdd0 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f581cff9640 1 -- 10.20.193.4:0/376854780 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f584401ba40 con 0x56310719bdd0 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 10 client.17736 _ll_register_callbacks cb 0x563106ff8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f585b767e00 1 -- 10.20.193.4:0/376854780 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563106dac4a0 con 0x56310719bdd0 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f581cff9640 1 -- 10.20.193.4:0/376854780 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f584401bc10 con 0x56310719bdd0 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.651+0000 7f581cff9640 1 -- 10.20.193.4:0/376854780 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f584401be30 con 0x56310719bdd0 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.652+0000 7f585b767e00 10 client.17736 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.652+0000 7f585b767e00 1 -- 10.20.193.4:0/376854780 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563106ff26e0 con 0x56310719bdd0 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.652+0000 7f581cff9640 1 -- 10.20.193.4:0/376854780 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f5844012440 con 0x56310719bdd0 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.652+0000 7f585b767e00 10 client.17736 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.652+0000 7f585b767e00 10 client.17736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.652+0000 7f585b767e00 20 client.17736 populate_metadata read hostname 'trial004' 2026-02-24T09:18:21.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.652+0000 7f585b767e00 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563107199530 0x5631071999d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.652+0000 7f585b767e00 4 client.17736 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.652+0000 7f585b767e00 1 -- 10.20.193.4:0/376854780 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631070524f0 con 0x563107199530 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.652+0000 7f5852ffd640 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563107199530 0x5631071999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.653+0000 7f5852ffd640 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563107199530 0x5631071999d0 crc :-1 s=READY pgs=185 gs=4 cs=0 l=0 c_cookie=3763944666650494868 s_cookie=3522346673752304526 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=343c37bb69edc794 server_cookie=30e1e3a338c8eb8e in_seq=0 out_seq=0 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.653+0000 7f581cff9640 10 client.17736 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.653+0000 7f581cff9640 1 -- 10.20.193.4:0/376854780 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5631070524f0 con 0x563107199530 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.653+0000 7f581cff9640 10 client.17736 handle_command_reply: tid=0 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.653+0000 7f585b767e00 1 client.17736 shutdown 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 1 -- 10.20.193.4:0/376854780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 msgr2=0x5631071743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071743b0 secure :-1 s=READY pgs=1139 gs=1 cs=0 l=1 c_cookie=6718029165809632849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58440050f0 tx=0x7f5844010ce0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 1 -- 10.20.193.4:0/376854780 shutdown_connections 2026-02-24T09:18:21.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x563107199530 0x5631071999d0 crc :-1 s=READY pgs=185 gs=4 cs=0 l=0 c_cookie=3763944666650494868 s_cookie=3522346673752304526 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56310719bdd0 0x5631071743b0 unknown :-1 s=CLOSED pgs=1139 gs=1 cs=0 l=1 c_cookie=6718029165809632849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107157130 0x56310716f3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f581cff9640 0 client.17736 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:21.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 1 --2- 10.20.193.4:0/376854780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107156820 0x56310716ee80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 1 -- 10.20.193.4:0/376854780 >> 10.20.193.4:0/376854780 conn(0x5631070756b0 msgr2=0x563107155810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:21.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 1 -- 10.20.193.4:0/376854780 shutdown_connections 2026-02-24T09:18:21.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 1 -- 10.20.193.4:0/376854780 wait complete. 2026-02-24T09:18:21.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.654+0000 7f585b767e00 20 client.17736 trim_cache size 0 max 16384 2026-02-24T09:18:21.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f585b767e00 1 Processor -- start 2026-02-24T09:18:21.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f585b767e00 1 -- start start 2026-02-24T09:18:21.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f585b767e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107156820 0x563107173920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f585b767e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 0x56310719b2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f585b767e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107199530 0x56310719b800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f585b767e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56310705a6e0 con 0x563107156820 2026-02-24T09:18:21.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f585b767e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563106d25f50 con 0x563107157130 2026-02-24T09:18:21.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f585b767e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5631070c63d0 con 0x563107199530 2026-02-24T09:18:21.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f5852ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107156820 0x563107173920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f5852ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107156820 0x563107173920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36714/0 (socket says 10.20.193.4:36714) 2026-02-24T09:18:21.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f5852ffd640 1 -- 10.20.193.4:0/1946876781 learned_addr learned my addr 10.20.193.4:0/1946876781 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f5852ffd640 1 -- 10.20.193.4:0/1946876781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107199530 msgr2=0x56310719b800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f5852ffd640 1 --2- 10.20.193.4:0/1946876781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107199530 0x56310719b800 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f5852ffd640 1 -- 10.20.193.4:0/1946876781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 msgr2=0x56310719b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f5852ffd640 1 --2- 10.20.193.4:0/1946876781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 0x56310719b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f5852ffd640 1 -- 10.20.193.4:0/1946876781 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563107161380 con 0x563107156820 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f5852ffd640 1 --2- 10.20.193.4:0/1946876781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107156820 0x563107173920 secure :-1 s=READY pgs=1140 gs=1 cs=0 l=1 c_cookie=7786900131758346774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5848004820 tx=0x7f5848040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c10a069bee61216 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f581effd640 1 -- 10.20.193.4:0/1946876781 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58480028c0 con 0x563107156820 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f581effd640 1 -- 10.20.193.4:0/1946876781 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f584803e040 con 0x563107156820 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.663+0000 7f581effd640 1 -- 10.20.193.4:0/1946876781 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58480568f0 con 0x563107156820 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 -- 10.20.193.4:0/1946876781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107156820 msgr2=0x563107173920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 --2- 10.20.193.4:0/1946876781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107156820 0x563107173920 secure :-1 s=READY pgs=1140 gs=1 cs=0 l=1 c_cookie=7786900131758346774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5848004820 tx=0x7f5848040000 comp rx=0 tx=0).stop 2026-02-24T09:18:21.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 -- 10.20.193.4:0/1946876781 shutdown_connections 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 --2- 10.20.193.4:0/1946876781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107199530 0x56310719b800 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 --2- 10.20.193.4:0/1946876781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 0x56310719b2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 --2- 10.20.193.4:0/1946876781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107156820 0x563107173920 unknown :-1 s=CLOSED pgs=1140 gs=1 cs=0 l=1 c_cookie=7786900131758346774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 -- 10.20.193.4:0/1946876781 >> 10.20.193.4:0/1946876781 conn(0x5631070756b0 msgr2=0x563107173210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 -- 10.20.193.4:0/1946876781 shutdown_connections 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 -- 10.20.193.4:0/1946876781 wait complete. 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 -- start start 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 Processor -- start 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 0x563107176aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 0x563107176fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107199530 0x563107177520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5631072012f0 con 0x563107199530 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563107201460 con 0x563107157130 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f585b767e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563107201620 con 0x563107156820 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.664+0000 7f58537fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107199530 0x563107177520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f58537fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107199530 0x563107177520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36730/0 (socket says 10.20.193.4:36730) 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f58537fe640 1 -- 10.20.193.4:0/3872041087 learned_addr learned my addr 10.20.193.4:0/3872041087 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f58527fc640 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 0x563107176fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f5852ffd640 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 0x563107176aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f58537fe640 1 -- 10.20.193.4:0/3872041087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 msgr2=0x563107176aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f58537fe640 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 0x563107176aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f58537fe640 1 -- 10.20.193.4:0/3872041087 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 msgr2=0x563107176fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f58537fe640 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 0x563107176fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f58537fe640 1 -- 10.20.193.4:0/3872041087 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563106fed160 con 0x563107199530 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f5852ffd640 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 0x563107176aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f58537fe640 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107199530 0x563107177520 secure :-1 s=READY pgs=1141 gs=1 cs=0 l=1 c_cookie=11484743654268740343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5844003950 tx=0x7f5844003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f620181391c22f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f581cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f581cff9640 1 -- 10.20.193.4:0/3872041087 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58440036f0 con 0x563107199530 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f581cff9640 1 -- 10.20.193.4:0/3872041087 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f584401f070 con 0x563107199530 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f581cff9640 1 -- 10.20.193.4:0/3872041087 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5844011c40 con 0x563107199530 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 1 -- 10.20.193.4:0/3872041087 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f584804c040 con 0x563107199530 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f581cff9640 1 -- 10.20.193.4:0/3872041087 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f5844011dd0 con 0x563107199530 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f581cff9640 10 client.17742 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 10 client.17742 _ll_register_callbacks cb 0x563106ff8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 1 -- 10.20.193.4:0/3872041087 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5844010db0 con 0x563107199530 2026-02-24T09:18:21.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f581cff9640 1 -- 10.20.193.4:0/3872041087 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5844010c50 con 0x563107199530 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 10 client.17742 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 1 -- 10.20.193.4:0/3872041087 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563106fe0bf0 con 0x563107199530 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f581cff9640 1 -- 10.20.193.4:0/3872041087 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f5844040050 con 0x563107199530 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 10 client.17742 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 10 client.17742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 20 client.17742 populate_metadata read hostname 'trial004' 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56310719bdd0 0x563107268e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 4 client.17742 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.665+0000 7f585b767e00 1 -- 10.20.193.4:0/3872041087 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563106d91160 con 0x56310719bdd0 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.666+0000 7f5852ffd640 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56310719bdd0 0x563107268e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.666+0000 7f5852ffd640 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56310719bdd0 0x563107268e90 crc :-1 s=READY pgs=186 gs=4 cs=0 l=0 c_cookie=14176229409998451246 s_cookie=1411796794175011181 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4bc158a1d67322e server_cookie=1397b5b44bd6396d in_seq=0 out_seq=0 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.666+0000 7f581cff9640 10 client.17742 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:21.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f581cff9640 1 -- 10.20.193.4:0/3872041087 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x563106d91160 con 0x56310719bdd0 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f581cff9640 10 client.17742 handle_command_reply: tid=0 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 client.17742 shutdown 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 -- 10.20.193.4:0/3872041087 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107199530 msgr2=0x563107177520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107199530 0x563107177520 secure :-1 s=READY pgs=1141 gs=1 cs=0 l=1 c_cookie=11484743654268740343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5844003950 tx=0x7f5844003ea0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 -- 10.20.193.4:0/3872041087 shutdown_connections 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56310719bdd0 0x563107268e90 crc :-1 s=READY pgs=186 gs=4 cs=0 l=0 c_cookie=14176229409998451246 s_cookie=1411796794175011181 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563107199530 0x563107177520 unknown :-1 s=CLOSED pgs=1141 gs=1 cs=0 l=1 c_cookie=11484743654268740343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563107157130 0x563107176fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 --2- 10.20.193.4:0/3872041087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563107156820 0x563107176aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f581cff9640 0 client.17742 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 -- 10.20.193.4:0/3872041087 >> 10.20.193.4:0/3872041087 conn(0x5631070756b0 msgr2=0x5631071551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:21.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 -- 10.20.193.4:0/3872041087 shutdown_connections 2026-02-24T09:18:21.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 1 -- 10.20.193.4:0/3872041087 wait complete. 2026-02-24T09:18:21.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585b767e00 20 client.17742 trim_cache size 0 max 16384 2026-02-24T09:18:21.680 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:18:21.680 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:18:21.680 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:18:21.680 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:18:21.680 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.681 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.682 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.683 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:18:21.684 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.685 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.686 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.687 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.688 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:18:21.689 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:21.690 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:21.691 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:18:21.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 -- 10.20.193.4:0/1148501275 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58280b56d0 msgr2=0x7f58280d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58280b56d0 0x7f58280d5b80 secure :-1 s=READY pgs=420 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5848005b30 tx=0x7f584803a040 comp rx=0 tx=0).stop 2026-02-24T09:18:21.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 -- 10.20.193.4:0/1148501275 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f585410ddc0 msgr2=0x7f5854173e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f585410ddc0 0x7f5854173e90 secure :-1 s=READY pgs=1137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f583c005db0 tx=0x7f583c00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 -- 10.20.193.4:0/1148501275 shutdown_connections 2026-02-24T09:18:21.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f58280b56d0 0x7f58280d5b80 unknown :-1 s=CLOSED pgs=420 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f58541135c0 0x7f58540f5fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f585410ddc0 0x7f5854173e90 unknown :-1 s=CLOSED pgs=1137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.691 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 --2- 10.20.193.4:0/1148501275 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f585410d3d0 0x7f58540f58b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 -- 10.20.193.4:0/1148501275 >> 10.20.193.4:0/1148501275 conn(0x7f58540eaca0 msgr2=0x7f585410f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:21.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 -- 10.20.193.4:0/1148501275 shutdown_connections 2026-02-24T09:18:21.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.667+0000 7f585976d640 1 -- 10.20.193.4:0/1148501275 wait complete. 2026-02-24T09:18:21.709 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:18:21.709 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:18:21.825 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:21.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.919+0000 7f89db89b640 1 -- 10.20.193.4:0/1234085534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89d4115470 msgr2=0x7f89d4175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.919+0000 7f89db89b640 1 --2- 10.20.193.4:0/1234085534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89d4115470 0x7f89d4175e40 secure :-1 s=READY pgs=1142 gs=1 cs=0 l=1 c_cookie=1702649926186232293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89d000aa30 tx=0x7f89d0030280 comp rx=0 tx=0).stop 2026-02-24T09:18:21.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.919+0000 7f89db89b640 1 -- 10.20.193.4:0/1234085534 shutdown_connections 2026-02-24T09:18:21.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.919+0000 7f89db89b640 1 --2- 10.20.193.4:0/1234085534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89d4115470 0x7f89d4175e40 unknown :-1 s=CLOSED pgs=1142 gs=1 cs=0 l=1 c_cookie=1702649926186232293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.919+0000 7f89db89b640 1 --2- 10.20.193.4:0/1234085534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89d410fc70 0x7f89d4114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.919+0000 7f89db89b640 1 --2- 10.20.193.4:0/1234085534 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89d410f280 0x7f89d410f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.919+0000 7f89db89b640 1 -- 10.20.193.4:0/1234085534 >> 10.20.193.4:0/1234085534 conn(0x7f89d405f830 msgr2=0x7f89d410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:21.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.919+0000 7f89db89b640 1 -- 10.20.193.4:0/1234085534 shutdown_connections 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.919+0000 7f89db89b640 1 -- 10.20.193.4:0/1234085534 wait complete. 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89db89b640 1 Processor -- start 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89db89b640 1 -- start start 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89db89b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89d410f280 0x7f89d411db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89db89b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89d410fc70 0x7f89d411e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89db89b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89d4115470 0x7f89d4123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89db89b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4123a60 con 0x7f89d4115470 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89db89b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4123bd0 con 0x7f89d410fc70 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89db89b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4123d90 con 0x7f89d410f280 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9e11640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89d4115470 0x7f89d4123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9e11640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89d4115470 0x7f89d4123440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36748/0 (socket says 10.20.193.4:36748) 2026-02-24T09:18:21.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9e11640 1 -- 10.20.193.4:0/4248251824 learned_addr learned my addr 10.20.193.4:0/4248251824 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9610640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89d410f280 0x7f89d411db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d8e0f640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89d410fc70 0x7f89d411e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9e11640 1 -- 10.20.193.4:0/4248251824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89d410f280 msgr2=0x7f89d411db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9e11640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89d410f280 0x7f89d411db30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9e11640 1 -- 10.20.193.4:0/4248251824 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89d410fc70 msgr2=0x7f89d411e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9e11640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89d410fc70 0x7f89d411e070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9e11640 1 -- 10.20.193.4:0/4248251824 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d000a650 con 0x7f89d4115470 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9610640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89d410f280 0x7f89d411db30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d8e0f640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89d410fc70 0x7f89d411e070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89d9e11640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89d4115470 0x7f89d4123440 secure :-1 s=READY pgs=1143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89d000a330 tx=0x7f89d00039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89c27fc640 1 -- 10.20.193.4:0/4248251824 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89d003e070 con 0x7f89d4115470 2026-02-24T09:18:21.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89c27fc640 1 -- 10.20.193.4:0/4248251824 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f89d00055a0 con 0x7f89d4115470 2026-02-24T09:18:21.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89db89b640 1 -- 10.20.193.4:0/4248251824 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d4124010 con 0x7f89d4115470 2026-02-24T09:18:21.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89c27fc640 1 -- 10.20.193.4:0/4248251824 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89d0042a70 con 0x7f89d4115470 2026-02-24T09:18:21.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.920+0000 7f89db89b640 1 -- 10.20.193.4:0/4248251824 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d41645d0 con 0x7f89d4115470 2026-02-24T09:18:21.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.921+0000 7f89db89b640 1 -- 10.20.193.4:0/4248251824 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d4110560 con 0x7f89d4115470 2026-02-24T09:18:21.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.922+0000 7f89c27fc640 1 -- 10.20.193.4:0/4248251824 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f89d00050c0 con 0x7f89d4115470 2026-02-24T09:18:21.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.923+0000 7f89c27fc640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f89b00b56e0 0x7f89b00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:21.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.923+0000 7f89c27fc640 1 -- 10.20.193.4:0/4248251824 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f89d010d500 con 0x7f89d4115470 2026-02-24T09:18:21.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.923+0000 7f89d9610640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f89b00b56e0 0x7f89b00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:21.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.923+0000 7f89d9610640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f89b00b56e0 0x7f89b00d5b90 secure :-1 s=READY pgs=421 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89c4004740 tx=0x7f89c4005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:21.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:21.923+0000 7f89c27fc640 1 -- 10.20.193.4:0/4248251824 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f89d00cfe80 con 0x7f89d4115470 2026-02-24T09:18:22.062 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.059+0000 7f89db89b640 1 -- 10.20.193.4:0/4248251824 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89d410f650 con 0x7f89d4115470 2026-02-24T09:18:22.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.059+0000 7f89c27fc640 1 -- 10.20.193.4:0/4248251824 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f89d00d3030 con 0x7f89d4115470 2026-02-24T09:18:22.063 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:18:22.064 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:18:22.064 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 -- 10.20.193.4:0/4248251824 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f89b00b56e0 msgr2=0x7f89b00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f89b00b56e0 0x7f89b00d5b90 secure :-1 s=READY pgs=421 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89c4004740 tx=0x7f89c4005f00 comp rx=0 tx=0).stop 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 -- 10.20.193.4:0/4248251824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89d4115470 msgr2=0x7f89d4123440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89d4115470 0x7f89d4123440 secure :-1 s=READY pgs=1143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89d000a330 tx=0x7f89d00039b0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 -- 10.20.193.4:0/4248251824 shutdown_connections 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f89b00b56e0 0x7f89b00d5b90 unknown :-1 s=CLOSED pgs=421 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f89d4115470 0x7f89d4123440 unknown :-1 s=CLOSED pgs=1143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f89d410fc70 0x7f89d411e070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 --2- 10.20.193.4:0/4248251824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f89d410f280 0x7f89d411db30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 -- 10.20.193.4:0/4248251824 >> 10.20.193.4:0/4248251824 conn(0x7f89d405f830 msgr2=0x7f89d410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.060+0000 7f89db89b640 1 -- 10.20.193.4:0/4248251824 shutdown_connections 2026-02-24T09:18:22.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.061+0000 7f89db89b640 1 -- 10.20.193.4:0/4248251824 wait complete. 2026-02-24T09:18:22.101 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:18:22.218 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:22.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.315+0000 7f2de90cc640 1 -- 10.20.193.4:0/2557955557 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2de4115930 msgr2=0x7f2de4176300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.315+0000 7f2de90cc640 1 --2- 10.20.193.4:0/2557955557 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2de4115930 0x7f2de4176300 secure :-1 s=READY pgs=1144 gs=1 cs=0 l=1 c_cookie=6499508972995969379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd400aa30 tx=0x7f2dd4030280 comp rx=0 tx=0).stop 2026-02-24T09:18:22.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.315+0000 7f2de90cc640 1 -- 10.20.193.4:0/2557955557 shutdown_connections 2026-02-24T09:18:22.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.315+0000 7f2de90cc640 1 --2- 10.20.193.4:0/2557955557 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2de4115930 0x7f2de4176300 unknown :-1 s=CLOSED pgs=1144 gs=1 cs=0 l=1 c_cookie=6499508972995969379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.315+0000 7f2de90cc640 1 --2- 10.20.193.4:0/2557955557 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2de4110130 0x7f2de4115180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.315+0000 7f2de90cc640 1 --2- 10.20.193.4:0/2557955557 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2de410f740 0x7f2de410fb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.315+0000 7f2de90cc640 1 -- 10.20.193.4:0/2557955557 >> 10.20.193.4:0/2557955557 conn(0x7f2de40ed050 msgr2=0x7f2de410d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.315+0000 7f2de90cc640 1 -- 10.20.193.4:0/2557955557 shutdown_connections 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.315+0000 7f2de90cc640 1 -- 10.20.193.4:0/2557955557 wait complete. 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de90cc640 1 Processor -- start 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de90cc640 1 -- start start 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de90cc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2de410f740 0x7f2de411e060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de90cc640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2de4110130 0x7f2de411e5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de90cc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2de4115930 0x7f2de4123970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de90cc640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4123f90 con 0x7f2de4115930 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de90cc640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f2de4124100 con 0x7f2de4110130 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de90cc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2de41242c0 con 0x7f2de410f740 2026-02-24T09:18:22.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de3577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2de4115930 0x7f2de4123970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de3577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2de4115930 0x7f2de4123970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36766/0 (socket says 10.20.193.4:36766) 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de3577640 1 -- 10.20.193.4:0/491958819 learned_addr learned my addr 10.20.193.4:0/491958819 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de2575640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2de4110130 0x7f2de411e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de2d76640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2de410f740 0x7f2de411e060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de3577640 1 -- 10.20.193.4:0/491958819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2de410f740 msgr2=0x7f2de411e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de3577640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2de410f740 0x7f2de411e060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de3577640 1 -- 10.20.193.4:0/491958819 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2de4110130 msgr2=0x7f2de411e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de3577640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2de4110130 0x7f2de411e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de3577640 1 -- 10.20.193.4:0/491958819 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd400a650 con 0x7f2de4115930 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de2575640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2de4110130 0x7f2de411e5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de3577640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2de4115930 0x7f2de4123970 secure :-1 s=READY pgs=1145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd400a330 tx=0x7f2dd40039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2dc3fff640 1 -- 10.20.193.4:0/491958819 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dd403e070 con 0x7f2de4115930 2026-02-24T09:18:22.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de90cc640 1 -- 10.20.193.4:0/491958819 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de4124540 con 0x7f2de4115930 2026-02-24T09:18:22.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2dc3fff640 1 -- 10.20.193.4:0/491958819 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2dd40055a0 con 0x7f2de4115930 2026-02-24T09:18:22.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2dc3fff640 1 -- 10.20.193.4:0/491958819 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dd4042a70 con 0x7f2de4115930 2026-02-24T09:18:22.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.316+0000 7f2de90cc640 1 -- 10.20.193.4:0/491958819 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de4164b00 con 0x7f2de4115930 2026-02-24T09:18:22.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.318+0000 7f2dc3fff640 1 -- 10.20.193.4:0/491958819 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f2dd40050c0 con 0x7f2de4115930 2026-02-24T09:18:22.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.319+0000 7f2dc3fff640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2db80b56e0 0x7f2db80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.319+0000 7f2de2d76640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2db80b56e0 0x7f2db80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.319+0000 7f2dc3fff640 1 -- 10.20.193.4:0/491958819 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2dd410cde0 con 0x7f2de4115930 2026-02-24T09:18:22.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.319+0000 7f2de2d76640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2db80b56e0 0x7f2db80d5b90 secure :-1 s=READY pgs=422 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd8005970 tx=0x7f2dd8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2deb0c6e00 1 Processor -- start 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2deb0c6e00 1 -- start start 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939ef1320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939ef1860 0x55a939f35fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939f36500 0x55a939f568e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a939e01ee0 con 0x55a939ef0f50 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a939dfdc10 con 0x55a939f36500 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a939df7d70 con 0x55a939ef1860 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939ef1320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939ef1320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36770/0 (socket says 10.20.193.4:36770) 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de2d76640 1 -- 10.20.193.4:0/3435463986 learned_addr learned my addr 10.20.193.4:0/3435463986 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de3577640 1 --2- 10.20.193.4:0/3435463986 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939f36500 0x55a939f568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de2d76640 1 -- 10.20.193.4:0/3435463986 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939ef1860 msgr2=0x55a939f35fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de2575640 1 --2- 10.20.193.4:0/3435463986 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939ef1860 0x55a939f35fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de2d76640 1 --2- 10.20.193.4:0/3435463986 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939ef1860 0x55a939f35fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de2d76640 1 -- 10.20.193.4:0/3435463986 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939f36500 msgr2=0x55a939f568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de2d76640 1 --2- 10.20.193.4:0/3435463986 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939f36500 0x55a939f568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de2d76640 1 -- 10.20.193.4:0/3435463986 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a939da3340 con 0x55a939ef0f50 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.321+0000 7f2de2575640 1 --2- 10.20.193.4:0/3435463986 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939ef1860 0x55a939f35fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2de2d76640 1 --2- 10.20.193.4:0/3435463986 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939ef1320 secure :-1 s=READY pgs=1146 gs=1 cs=0 l=1 c_cookie=2288091249699277322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd80041c0 tx=0x7f2dd8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc0eede68014a0a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2daf7fe640 1 -- 10.20.193.4:0/3435463986 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dd801e680 con 0x55a939ef0f50 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2daf7fe640 1 -- 10.20.193.4:0/3435463986 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2dd800fe60 con 0x55a939ef0f50 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2daf7fe640 1 -- 10.20.193.4:0/3435463986 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dd8010c10 con 0x55a939ef0f50 2026-02-24T09:18:22.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/3435463986 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 msgr2=0x55a939ef1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/3435463986 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939ef1320 secure :-1 s=READY pgs=1146 gs=1 cs=0 l=1 c_cookie=2288091249699277322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd80041c0 tx=0x7f2dd8012000 comp rx=0 tx=0).stop 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/3435463986 shutdown_connections 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/3435463986 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939f36500 0x55a939f568e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/3435463986 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939ef1860 0x55a939f35fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/3435463986 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939ef1320 unknown :-1 s=CLOSED pgs=1146 gs=1 cs=0 l=1 c_cookie=2288091249699277322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/3435463986 >> 10.20.193.4:0/3435463986 conn(0x55a939e0fdb0 msgr2=0x55a939eef830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/3435463986 shutdown_connections 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.322+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/3435463986 wait complete. 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2deb0c6e00 1 -- start start 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2deb0c6e00 1 Processor -- start 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef0f50 0x55a939f4dcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939ef1860 0x55a939f4e210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939f36500 0x55a939f53200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a939f53740 con 0x55a939f36500 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a939f538b0 con 0x55a939ef0f50 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a939f53a70 con 0x55a939ef1860 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2de3577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939f36500 0x55a939f53200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2de3577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939f36500 0x55a939f53200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36776/0 (socket says 10.20.193.4:36776) 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2de3577640 1 -- 10.20.193.4:0/1592844167 learned_addr learned my addr 10.20.193.4:0/1592844167 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2de3577640 1 -- 10.20.193.4:0/1592844167 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939ef1860 msgr2=0x55a939f4e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2de3577640 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939ef1860 0x55a939f4e210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2de3577640 1 -- 10.20.193.4:0/1592844167 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef0f50 msgr2=0x55a939f4dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2de3577640 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef0f50 0x55a939f4dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2de3577640 1 -- 10.20.193.4:0/1592844167 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a939d7b9d0 con 0x55a939f36500 2026-02-24T09:18:22.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2de3577640 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939f36500 0x55a939f53200 secure :-1 s=READY pgs=1147 gs=1 cs=0 l=1 c_cookie=3735104465715094258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd4003fd0 tx=0x7f2dd4030280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d5c1b8ddec62f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2dacff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2dacff9640 1 -- 10.20.193.4:0/1592844167 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dd40d3b10 con 0x55a939f36500 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/1592844167 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd800fa30 con 0x55a939f36500 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2dacff9640 1 -- 10.20.193.4:0/1592844167 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2dd40d8e30 con 0x55a939f36500 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2dacff9640 1 -- 10.20.193.4:0/1592844167 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dd40dddc0 con 0x55a939f36500 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.323+0000 7f2deb0c6e00 10 client.17760 _ll_register_callbacks cb 0x55a939da2080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/1592844167 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a939b474a0 con 0x55a939f36500 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2dacff9640 1 -- 10.20.193.4:0/1592844167 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2dd40ddf50 con 0x55a939f36500 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2dacff9640 1 -- 10.20.193.4:0/1592844167 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2dd4041370 con 0x55a939f36500 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2deb0c6e00 10 client.17760 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/1592844167 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55a939d8d710 con 0x55a939f36500 2026-02-24T09:18:22.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2dacff9640 1 -- 10.20.193.4:0/1592844167 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2dd410ad20 con 0x55a939f36500 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2deb0c6e00 10 client.17760 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2deb0c6e00 10 client.17760 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2deb0c6e00 20 client.17760 populate_metadata read hostname 'trial004' 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55a939f33600 0x55a939f33a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2deb0c6e00 4 client.17760 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/1592844167 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a939ded7b0 con 0x55a939f33600 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.324+0000 7f2de2d76640 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55a939f33600 0x55a939f33a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2de2d76640 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55a939f33600 0x55a939f33a70 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=13052181922479729545 s_cookie=7258232266987239322 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b522aa4e192deb89 server_cookie=64ba6bca830d779a in_seq=0 out_seq=0 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2dacff9640 10 client.17760 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2dacff9640 1 -- 10.20.193.4:0/1592844167 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55a939ded7b0 con 0x55a939f33600 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2dacff9640 10 client.17760 handle_command_reply: tid=0 2026-02-24T09:18:22.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 client.17760 shutdown 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/1592844167 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939f36500 msgr2=0x55a939f53200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939f36500 0x55a939f53200 secure :-1 s=READY pgs=1147 gs=1 cs=0 l=1 c_cookie=3735104465715094258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd4003fd0 tx=0x7f2dd4030280 comp rx=0 tx=0).stop 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/1592844167 shutdown_connections 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55a939f33600 0x55a939f33a70 crc :-1 s=READY pgs=52 gs=4 cs=0 l=0 c_cookie=13052181922479729545 s_cookie=7258232266987239322 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939f36500 0x55a939f53200 unknown :-1 s=CLOSED pgs=1147 gs=1 cs=0 l=1 c_cookie=3735104465715094258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2dacff9640 0 client.17760 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939ef1860 0x55a939f4e210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/1592844167 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef0f50 0x55a939f4dcd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/1592844167 >> 10.20.193.4:0/1592844167 conn(0x55a939e0fdb0 msgr2=0x55a939eef040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/1592844167 shutdown_connections 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/1592844167 wait complete. 2026-02-24T09:18:22.337 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.325+0000 7f2deb0c6e00 20 client.17760 trim_cache size 0 max 16384 2026-02-24T09:18:22.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.332+0000 7f2deb0c6e00 1 Processor -- start 2026-02-24T09:18:22.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.332+0000 7f2deb0c6e00 1 -- start start 2026-02-24T09:18:22.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939f52770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef1860 0x55a939f31160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939f33600 0x55a939f316a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a939f4e610 con 0x55a939ef0f50 2026-02-24T09:18:22.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a939df59a0 con 0x55a939ef1860 2026-02-24T09:18:22.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a939bd1df0 con 0x55a939f33600 2026-02-24T09:18:22.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939f52770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939f52770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36780/0 (socket says 10.20.193.4:36780) 2026-02-24T09:18:22.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de2d76640 1 -- 10.20.193.4:0/3224025092 learned_addr learned my addr 10.20.193.4:0/3224025092 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de3577640 1 --2- 10.20.193.4:0/3224025092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939f33600 0x55a939f316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de2575640 1 --2- 10.20.193.4:0/3224025092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef1860 0x55a939f31160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de2d76640 1 -- 10.20.193.4:0/3224025092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939f33600 msgr2=0x55a939f316a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de2d76640 1 --2- 10.20.193.4:0/3224025092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939f33600 0x55a939f316a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de2d76640 1 -- 10.20.193.4:0/3224025092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef1860 msgr2=0x55a939f31160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de2d76640 1 --2- 10.20.193.4:0/3224025092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef1860 0x55a939f31160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de2d76640 1 -- 10.20.193.4:0/3224025092 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a939ef0dc0 con 0x55a939ef0f50 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2de2d76640 1 --2- 10.20.193.4:0/3224025092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939f52770 secure :-1 s=READY pgs=1148 gs=1 cs=0 l=1 c_cookie=5959185837280525665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd8010730 tx=0x7f2dd800fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b347f225a4fd61 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2daeffd640 1 -- 10.20.193.4:0/3224025092 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dd8030070 con 0x55a939ef0f50 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2daeffd640 1 -- 10.20.193.4:0/3224025092 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2dd8031040 con 0x55a939ef0f50 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2daeffd640 1 -- 10.20.193.4:0/3224025092 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dd801ed40 con 0x55a939ef0f50 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/3224025092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 msgr2=0x55a939f52770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/3224025092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939f52770 secure :-1 s=READY pgs=1148 gs=1 cs=0 l=1 c_cookie=5959185837280525665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd8010730 tx=0x7f2dd800fd20 comp rx=0 tx=0).stop 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/3224025092 shutdown_connections 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/3224025092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939f33600 0x55a939f316a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/3224025092 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef1860 0x55a939f31160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/3224025092 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef0f50 0x55a939f52770 unknown :-1 s=CLOSED pgs=1148 gs=1 cs=0 l=1 c_cookie=5959185837280525665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/3224025092 >> 10.20.193.4:0/3224025092 conn(0x55a939e0fdb0 msgr2=0x55a939f52060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/3224025092 shutdown_connections 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.333+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/3224025092 wait complete. 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2deb0c6e00 1 -- start start 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2deb0c6e00 1 Processor -- start 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef0f50 0x55a939f4b660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef1860 0x55a939ecf030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2deb0c6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939f33600 0x55a939ecf570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55a939f9d1a0 con 0x55a939ef1860 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55a939ecfab0 con 0x55a939ef0f50 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2deb0c6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55a939ecfc70 con 0x55a939f33600 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2de2575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef1860 0x55a939ecf030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2de2575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef1860 0x55a939ecf030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36794/0 (socket says 10.20.193.4:36794) 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2de2575640 1 -- 10.20.193.4:0/189148031 learned_addr learned my addr 10.20.193.4:0/189148031 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.334+0000 7f2de2d76640 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef0f50 0x55a939f4b660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2de2575640 1 -- 10.20.193.4:0/189148031 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939f33600 msgr2=0x55a939ecf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2de2575640 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939f33600 0x55a939ecf570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2de2575640 1 -- 10.20.193.4:0/189148031 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef0f50 msgr2=0x55a939f4b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2de2575640 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef0f50 0x55a939f4b660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2de2575640 1 -- 10.20.193.4:0/189148031 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a939d88190 con 0x55a939ef1860 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2de2575640 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef1860 0x55a939ecf030 secure :-1 s=READY pgs=1149 gs=1 cs=0 l=1 c_cookie=3056656652084775290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2de4124a00 tx=0x7f2dcc0127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6b6d07bbd9097a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2dacff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2dacff9640 1 -- 10.20.193.4:0/189148031 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dcc005300 con 0x55a939ef1860 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2dacff9640 1 -- 10.20.193.4:0/189148031 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2dcc004cc0 con 0x55a939ef1860 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/189148031 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a939da3340 con 0x55a939ef1860 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2dacff9640 1 -- 10.20.193.4:0/189148031 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dcc01bb30 con 0x55a939ef1860 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 10 client.17766 _ll_register_callbacks cb 0x55a939da2080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/189148031 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dd800fe60 con 0x55a939ef1860 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2dacff9640 1 -- 10.20.193.4:0/189148031 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f2dcc01bcc0 con 0x55a939ef1860 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2dacff9640 1 -- 10.20.193.4:0/189148031 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2dcc01be80 con 0x55a939ef1860 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 10 client.17766 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/189148031 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55a939d7bd00 con 0x55a939ef1860 2026-02-24T09:18:22.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2dacff9640 1 -- 10.20.193.4:0/189148031 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2dcc01b440 con 0x55a939ef1860 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 10 client.17766 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 10 client.17766 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 20 client.17766 populate_metadata read hostname 'trial004' 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55a939f36500 0x55a93a003ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 4 client.17766 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/189148031 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a939b2c160 con 0x55a939f36500 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.335+0000 7f2de2d76640 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55a939f36500 0x55a93a003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2de2d76640 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55a939f36500 0x55a93a003ff0 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=18174575095443532015 s_cookie=2169178291228154540 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fc390fc19b92a8ef server_cookie=1e1a7829bf249aac in_seq=0 out_seq=0 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2dacff9640 10 client.17766 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2dacff9640 1 -- 10.20.193.4:0/189148031 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a939b2c160 con 0x55a939f36500 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2dacff9640 10 client.17766 handle_command_reply: tid=0 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 client.17766 shutdown 2026-02-24T09:18:22.349 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/189148031 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef1860 msgr2=0x55a939ecf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef1860 0x55a939ecf030 secure :-1 s=READY pgs=1149 gs=1 cs=0 l=1 c_cookie=3056656652084775290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2de4124a00 tx=0x7f2dcc0127c0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/189148031 shutdown_connections 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55a939f36500 0x55a93a003ff0 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=18174575095443532015 s_cookie=2169178291228154540 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55a939f33600 0x55a939ecf570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2dacff9640 0 client.17766 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55a939ef1860 0x55a939ecf030 unknown :-1 s=CLOSED pgs=1149 gs=1 cs=0 l=1 c_cookie=3056656652084775290 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 --2- 10.20.193.4:0/189148031 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55a939ef0f50 0x55a939f4b660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/189148031 >> 10.20.193.4:0/189148031 conn(0x55a939e0fdb0 msgr2=0x55a939f4a880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/189148031 shutdown_connections 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 1 -- 10.20.193.4:0/189148031 wait complete. 2026-02-24T09:18:22.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.336+0000 7f2deb0c6e00 20 client.17766 trim_cache size 0 max 16384 2026-02-24T09:18:22.351 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:18:22.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 -- 10.20.193.4:0/491958819 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2db80b56e0 msgr2=0x7f2db80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2db80b56e0 0x7f2db80d5b90 secure :-1 s=READY pgs=422 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd8005970 tx=0x7f2dd8005900 comp rx=0 tx=0).stop 2026-02-24T09:18:22.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 -- 10.20.193.4:0/491958819 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2de4115930 msgr2=0x7f2de4123970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2de4115930 0x7f2de4123970 secure :-1 s=READY pgs=1145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd400a330 tx=0x7f2dd40039b0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 -- 10.20.193.4:0/491958819 shutdown_connections 2026-02-24T09:18:22.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f2db80b56e0 0x7f2db80d5b90 unknown :-1 s=CLOSED pgs=422 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f2de4115930 0x7f2de4123970 unknown :-1 s=CLOSED pgs=1145 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f2de4110130 0x7f2de411e5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 --2- 10.20.193.4:0/491958819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2de410f740 0x7f2de411e060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 -- 10.20.193.4:0/491958819 >> 10.20.193.4:0/491958819 conn(0x7f2de40ed050 msgr2=0x7f2de410d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 -- 10.20.193.4:0/491958819 shutdown_connections 2026-02-24T09:18:22.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.337+0000 7f2de90cc640 1 -- 10.20.193.4:0/491958819 wait complete. 2026-02-24T09:18:22.377 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:18:22.493 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:22.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 -- 10.20.193.4:0/1374887657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7910060fd0 msgr2=0x7f79100613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 --2- 10.20.193.4:0/1374887657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7910060fd0 0x7f79100613a0 secure :-1 s=READY pgs=1150 gs=1 cs=0 l=1 c_cookie=2276175757535066044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7900009950 tx=0x7f790002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 -- 10.20.193.4:0/1374887657 shutdown_connections 2026-02-24T09:18:22.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 --2- 10.20.193.4:0/1374887657 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7910155c10 0x7f7910175ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 --2- 10.20.193.4:0/1374887657 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79100618e0 0x7f79101556d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.600 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 --2- 10.20.193.4:0/1374887657 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7910060fd0 0x7f79100613a0 unknown :-1 s=CLOSED pgs=1150 gs=1 cs=0 l=1 c_cookie=2276175757535066044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 -- 10.20.193.4:0/1374887657 >> 10.20.193.4:0/1374887657 conn(0x7f79100eade0 msgr2=0x7f791010b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 -- 10.20.193.4:0/1374887657 shutdown_connections 2026-02-24T09:18:22.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 -- 10.20.193.4:0/1374887657 wait complete. 2026-02-24T09:18:22.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 Processor -- start 2026-02-24T09:18:22.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 -- start start 2026-02-24T09:18:22.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7910060fd0 0x7f7910162410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79100618e0 0x7f7910162950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7910155c10 0x7f7910167cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7910168260 con 0x7f7910060fd0 2026-02-24T09:18:22.601 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f79101683d0 con 0x7f79100618e0 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f791860d640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7910168590 con 0x7f7910155c10 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.594+0000 7f7916382640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7910060fd0 0x7f7910162410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7916382640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7910060fd0 0x7f7910162410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36818/0 (socket says 10.20.193.4:36818) 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7916382640 1 -- 10.20.193.4:0/4105001911 learned_addr learned my addr 10.20.193.4:0/4105001911 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7915b81640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79100618e0 0x7f7910162950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7916382640 1 -- 10.20.193.4:0/4105001911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7910155c10 msgr2=0x7f7910167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7916b83640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7910155c10 0x7f7910167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7916382640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7910155c10 0x7f7910167cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7916382640 1 -- 10.20.193.4:0/4105001911 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79100618e0 msgr2=0x7f7910162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7916382640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79100618e0 0x7f7910162950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.602 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7916382640 1 -- 10.20.193.4:0/4105001911 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7900009570 con 0x7f7910060fd0 2026-02-24T09:18:22.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7916b83640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7910155c10 0x7f7910167cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:22.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f7916382640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7910060fd0 0x7f7910162410 secure :-1 s=READY pgs=1151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7900004820 tx=0x7f79000028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f78f77fe640 1 -- 10.20.193.4:0/4105001911 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f790003d070 con 0x7f7910060fd0 2026-02-24T09:18:22.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f78f77fe640 1 -- 10.20.193.4:0/4105001911 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7900002e80 con 0x7f7910060fd0 2026-02-24T09:18:22.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f791860d640 1 -- 10.20.193.4:0/4105001911 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7910168810 con 0x7f7910060fd0 2026-02-24T09:18:22.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f78f77fe640 1 -- 10.20.193.4:0/4105001911 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7900041a00 con 0x7f7910060fd0 2026-02-24T09:18:22.603 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.595+0000 7f791860d640 1 -- 10.20.193.4:0/4105001911 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7910151690 con 0x7f7910060fd0 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.597+0000 7f78f77fe640 1 -- 10.20.193.4:0/4105001911 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f7900041bd0 con 0x7f7910060fd0 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.597+0000 7f78f77fe640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78ec0b5760 0x7f78ec0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.597+0000 7f78f77fe640 1 -- 10.20.193.4:0/4105001911 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f790010b330 con 0x7f7910060fd0 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.597+0000 7f7915b81640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78ec0b5760 0x7f78ec0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.598+0000 7f7915b81640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78ec0b5760 0x7f78ec0d5c10 secure :-1 s=READY pgs=423 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7910168d60 tx=0x7f7904005f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f791a607e00 1 Processor -- start 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f791a607e00 1 -- start start 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f791a607e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95facf50 0x558f95fad320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f791a607e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95fad860 0x558f95ff1fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f791a607e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 0x558f960128e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f791a607e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558f95ebdee0 con 0x558f95fad860 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f791a607e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558f95eb9c10 con 0x558f95facf50 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f791a607e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558f95eb3d70 con 0x558f95ff2500 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7915b81640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95fad860 0x558f95ff1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7915b81640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95fad860 0x558f95ff1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36822/0 (socket says 10.20.193.4:36822) 2026-02-24T09:18:22.609 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7915b81640 1 -- 10.20.193.4:0/876465019 learned_addr learned my addr 10.20.193.4:0/876465019 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7916b83640 1 --2- 10.20.193.4:0/876465019 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 0x558f960128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7916382640 1 --2- 10.20.193.4:0/876465019 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95facf50 0x558f95fad320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7915b81640 1 -- 10.20.193.4:0/876465019 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 msgr2=0x558f960128e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7915b81640 1 --2- 10.20.193.4:0/876465019 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 0x558f960128e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7915b81640 1 -- 10.20.193.4:0/876465019 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95facf50 msgr2=0x558f95fad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7915b81640 1 --2- 10.20.193.4:0/876465019 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95facf50 0x558f95fad320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7915b81640 1 -- 10.20.193.4:0/876465019 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f95e5f340 con 0x558f95fad860 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f7915b81640 1 --2- 10.20.193.4:0/876465019 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95fad860 0x558f95ff1fc0 secure :-1 s=READY pgs=1152 gs=1 cs=0 l=1 c_cookie=16075376976276484312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f790400ef60 tx=0x7f7904011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1736305d73f0d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f78f4b0a640 1 -- 10.20.193.4:0/876465019 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f790401d680 con 0x558f95fad860 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f78f4b0a640 1 -- 10.20.193.4:0/876465019 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f790400a7e0 con 0x558f95fad860 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.599+0000 7f78f4b0a640 1 -- 10.20.193.4:0/876465019 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7904010c30 con 0x558f95fad860 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.600+0000 7f791a607e00 1 -- 10.20.193.4:0/876465019 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95fad860 msgr2=0x558f95ff1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.600+0000 7f791a607e00 1 --2- 10.20.193.4:0/876465019 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95fad860 0x558f95ff1fc0 secure :-1 s=READY pgs=1152 gs=1 cs=0 l=1 c_cookie=16075376976276484312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f790400ef60 tx=0x7f7904011000 comp rx=0 tx=0).stop 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.600+0000 7f791a607e00 1 -- 10.20.193.4:0/876465019 shutdown_connections 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.600+0000 7f791a607e00 1 --2- 10.20.193.4:0/876465019 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 0x558f960128e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.600+0000 7f791a607e00 1 --2- 10.20.193.4:0/876465019 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95fad860 0x558f95ff1fc0 unknown :-1 s=CLOSED pgs=1152 gs=1 cs=0 l=1 c_cookie=16075376976276484312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.600+0000 7f791a607e00 1 --2- 10.20.193.4:0/876465019 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95facf50 0x558f95fad320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.600+0000 7f791a607e00 1 -- 10.20.193.4:0/876465019 >> 10.20.193.4:0/876465019 conn(0x558f95ecbdb0 msgr2=0x558f95fab830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.600+0000 7f791a607e00 1 -- 10.20.193.4:0/876465019 shutdown_connections 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.600+0000 7f791a607e00 1 -- 10.20.193.4:0/876465019 wait complete. 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.600+0000 7f791a607e00 1 -- start start 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 1 Processor -- start 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f96009db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95fad860 0x558f9600a2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 0x558f9600f2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558f9600f820 con 0x558f95facf50 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558f9600f990 con 0x558f95fad860 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558f9600fb50 con 0x558f95ff2500 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f7916382640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f96009db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f7916382640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f96009db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36838/0 (socket says 10.20.193.4:36838) 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f7916382640 1 -- 10.20.193.4:0/635965073 learned_addr learned my addr 10.20.193.4:0/635965073 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f7916382640 1 -- 10.20.193.4:0/635965073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 msgr2=0x558f9600f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f7916382640 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 0x558f9600f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f7916382640 1 -- 10.20.193.4:0/635965073 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95fad860 msgr2=0x558f9600a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f7916382640 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95fad860 0x558f9600a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f7916382640 1 -- 10.20.193.4:0/635965073 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f95e379d0 con 0x558f95facf50 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f7916382640 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f96009db0 secure :-1 s=READY pgs=1153 gs=1 cs=0 l=1 c_cookie=15656288713029622741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7900108e10 tx=0x7f7900038f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9464fa249169bd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f78c3fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f78c3fff640 1 -- 10.20.193.4:0/635965073 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79000dc570 con 0x558f95facf50 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f78c3fff640 1 -- 10.20.193.4:0/635965073 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79000cbe90 con 0x558f95facf50 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f78c3fff640 1 -- 10.20.193.4:0/635965073 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7900096ab0 con 0x558f95facf50 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 1 -- 10.20.193.4:0/635965073 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790400ac60 con 0x558f95facf50 2026-02-24T09:18:22.610 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f78c3fff640 1 -- 10.20.193.4:0/635965073 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f79000d99a0 con 0x558f95facf50 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f78c3fff640 10 client.17778 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 10 client.17778 _ll_register_callbacks cb 0x558f95e5e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 1 -- 10.20.193.4:0/635965073 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558f95c034a0 con 0x558f95facf50 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f78c3fff640 1 -- 10.20.193.4:0/635965073 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f79000d20a0 con 0x558f95facf50 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 10 client.17778 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.601+0000 7f791a607e00 1 -- 10.20.193.4:0/635965073 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x558f95e49710 con 0x558f95facf50 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.602+0000 7f78c3fff640 1 -- 10.20.193.4:0/635965073 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f79000f1070 con 0x558f95facf50 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.602+0000 7f791a607e00 10 client.17778 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.602+0000 7f791a607e00 10 client.17778 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.602+0000 7f791a607e00 20 client.17778 populate_metadata read hostname 'trial004' 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.602+0000 7f791a607e00 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x558f95fef550 0x558f95fef9f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.602+0000 7f791a607e00 4 client.17778 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.602+0000 7f791a607e00 1 -- 10.20.193.4:0/635965073 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f95ea97b0 con 0x558f95fef550 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.602+0000 7f7915b81640 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x558f95fef550 0x558f95fef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.602+0000 7f7915b81640 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x558f95fef550 0x558f95fef9f0 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=7775726923125765364 s_cookie=259919180411540998 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6be8ee70635a34f4 server_cookie=39b6b1e12bd9606 in_seq=0 out_seq=0 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.602+0000 7f78c3fff640 10 client.17778 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f78c3fff640 1 -- 10.20.193.4:0/635965073 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558f95ea97b0 con 0x558f95fef550 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f78c3fff640 10 client.17778 handle_command_reply: tid=0 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 client.17778 shutdown 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 -- 10.20.193.4:0/635965073 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 msgr2=0x558f96009db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f96009db0 secure :-1 s=READY pgs=1153 gs=1 cs=0 l=1 c_cookie=15656288713029622741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7900108e10 tx=0x7f7900038f10 comp rx=0 tx=0).stop 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 -- 10.20.193.4:0/635965073 shutdown_connections 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x558f95fef550 0x558f95fef9f0 crc :-1 s=READY pgs=53 gs=4 cs=0 l=0 c_cookie=7775726923125765364 s_cookie=259919180411540998 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 0x558f9600f2e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f78c3fff640 0 client.17778 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95fad860 0x558f9600a2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 --2- 10.20.193.4:0/635965073 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f96009db0 unknown :-1 s=CLOSED pgs=1153 gs=1 cs=0 l=1 c_cookie=15656288713029622741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 -- 10.20.193.4:0/635965073 >> 10.20.193.4:0/635965073 conn(0x558f95ecbdb0 msgr2=0x558f95fab040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 -- 10.20.193.4:0/635965073 shutdown_connections 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 1 -- 10.20.193.4:0/635965073 wait complete. 2026-02-24T09:18:22.611 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.603+0000 7f791a607e00 20 client.17778 trim_cache size 0 max 16384 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 Processor -- start 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 -- start start 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95fed110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95fad860 0x558f95fed650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95ff2500 0x558f95fab450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558f95eb19a0 con 0x558f95facf50 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558f95c8ddf0 con 0x558f95ff2500 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558f95ff7370 con 0x558f95fad860 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f7916382640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95fed110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f7916382640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95fed110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36848/0 (socket says 10.20.193.4:36848) 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f7916382640 1 -- 10.20.193.4:0/666747112 learned_addr learned my addr 10.20.193.4:0/666747112 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f7916382640 1 -- 10.20.193.4:0/666747112 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95fad860 msgr2=0x558f95fed650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f7916382640 1 --2- 10.20.193.4:0/666747112 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95fad860 0x558f95fed650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f7916382640 1 -- 10.20.193.4:0/666747112 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95ff2500 msgr2=0x558f95fab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f7916382640 1 --2- 10.20.193.4:0/666747112 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95ff2500 0x558f95fab450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f7916382640 1 -- 10.20.193.4:0/666747112 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f95e44190 con 0x558f95facf50 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f7916382640 1 --2- 10.20.193.4:0/666747112 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95fed110 secure :-1 s=READY pgs=1154 gs=1 cs=0 l=1 c_cookie=4486396609268361923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79000d3930 tx=0x7f79000ec000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e42e1f238f52ac3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f78de4e6640 1 -- 10.20.193.4:0/666747112 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79000d20a0 con 0x558f95facf50 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f78de4e6640 1 -- 10.20.193.4:0/666747112 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79000cbe90 con 0x558f95facf50 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f78de4e6640 1 -- 10.20.193.4:0/666747112 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79000dc7e0 con 0x558f95facf50 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 -- 10.20.193.4:0/666747112 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 msgr2=0x558f95fed110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 --2- 10.20.193.4:0/666747112 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95fed110 secure :-1 s=READY pgs=1154 gs=1 cs=0 l=1 c_cookie=4486396609268361923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79000d3930 tx=0x7f79000ec000 comp rx=0 tx=0).stop 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 -- 10.20.193.4:0/666747112 shutdown_connections 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 --2- 10.20.193.4:0/666747112 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95ff2500 0x558f95fab450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 --2- 10.20.193.4:0/666747112 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95fad860 0x558f95fed650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 --2- 10.20.193.4:0/666747112 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95fed110 unknown :-1 s=CLOSED pgs=1154 gs=1 cs=0 l=1 c_cookie=4486396609268361923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 -- 10.20.193.4:0/666747112 >> 10.20.193.4:0/666747112 conn(0x558f95ecbdb0 msgr2=0x558f9600e930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 -- 10.20.193.4:0/666747112 shutdown_connections 2026-02-24T09:18:22.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.610+0000 7f791a607e00 1 -- 10.20.193.4:0/666747112 wait complete. 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 1 -- start start 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 1 Processor -- start 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95f8b030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95fad860 0x558f95f8b570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 0x558f95f8bab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558f95f90080 con 0x558f95facf50 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558f95f901f0 con 0x558f95fad860 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558f95f903b0 con 0x558f95ff2500 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f7916382640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95f8b030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f7916382640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95f8b030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36858/0 (socket says 10.20.193.4:36858) 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f7916382640 1 -- 10.20.193.4:0/3685465831 learned_addr learned my addr 10.20.193.4:0/3685465831 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f7915b81640 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95fad860 0x558f95f8b570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f7916382640 1 -- 10.20.193.4:0/3685465831 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 msgr2=0x558f95f8bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f7916382640 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 0x558f95f8bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f7916382640 1 -- 10.20.193.4:0/3685465831 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95fad860 msgr2=0x558f95f8b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f7916382640 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95fad860 0x558f95f8b570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f7916382640 1 -- 10.20.193.4:0/3685465831 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f95e37d00 con 0x558f95facf50 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f7916382640 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95f8b030 secure :-1 s=READY pgs=1155 gs=1 cs=0 l=1 c_cookie=3919142589500408911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79000d1910 tx=0x7f7900038f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3663976baf46c44f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f78c3fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f78c3fff640 1 -- 10.20.193.4:0/3685465831 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79000dc7e0 con 0x558f95facf50 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f78c3fff640 1 -- 10.20.193.4:0/3685465831 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x558f95c034a0 con 0x558f95facf50 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 1 -- 10.20.193.4:0/3685465831 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f95e49710 con 0x558f95facf50 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f78c3fff640 1 -- 10.20.193.4:0/3685465831 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79000dc590 con 0x558f95facf50 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 10 client.17784 _ll_register_callbacks cb 0x558f95e5e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f791a607e00 1 -- 10.20.193.4:0/3685465831 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f790400a7e0 con 0x558f95facf50 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.611+0000 7f78c3fff640 1 -- 10.20.193.4:0/3685465831 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f79000d0770 con 0x558f95facf50 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f78c3fff640 1 -- 10.20.193.4:0/3685465831 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f79000d73c0 con 0x558f95facf50 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f791a607e00 10 client.17784 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:22.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f791a607e00 1 -- 10.20.193.4:0/3685465831 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x558f95e49970 con 0x558f95facf50 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f78c3fff640 1 -- 10.20.193.4:0/3685465831 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f790010a040 con 0x558f95facf50 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f791a607e00 10 client.17784 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f791a607e00 10 client.17784 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f791a607e00 20 client.17784 populate_metadata read hostname 'trial004' 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f791a607e00 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x558f9609fe00 0x558f960c0240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f791a607e00 4 client.17784 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f791a607e00 1 -- 10.20.193.4:0/3685465831 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558f95be8160 con 0x558f9609fe00 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f7915b81640 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x558f9609fe00 0x558f960c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f78c3fff640 10 client.17784 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f7915b81640 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x558f9609fe00 0x558f960c0240 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=16025477666485019885 s_cookie=4629005805004516936 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=de65ef07f2cba4ed server_cookie=403d88410e83ee48 in_seq=0 out_seq=0 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f78c3fff640 1 -- 10.20.193.4:0/3685465831 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558f95be8160 con 0x558f9609fe00 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f78c3fff640 10 client.17784 handle_command_reply: tid=0 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.612+0000 7f791a607e00 1 client.17784 shutdown 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 1 -- 10.20.193.4:0/3685465831 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 msgr2=0x558f95f8b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95f8b030 secure :-1 s=READY pgs=1155 gs=1 cs=0 l=1 c_cookie=3919142589500408911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79000d1910 tx=0x7f7900038f10 comp rx=0 tx=0).stop 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 1 -- 10.20.193.4:0/3685465831 shutdown_connections 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x558f9609fe00 0x558f960c0240 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=16025477666485019885 s_cookie=4629005805004516936 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558f95ff2500 0x558f95f8bab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f78c3fff640 0 client.17784 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558f95fad860 0x558f95f8b570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 1 --2- 10.20.193.4:0/3685465831 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558f95facf50 0x558f95f8b030 unknown :-1 s=CLOSED pgs=1155 gs=1 cs=0 l=1 c_cookie=3919142589500408911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 1 -- 10.20.193.4:0/3685465831 >> 10.20.193.4:0/3685465831 conn(0x558f95ecbdb0 msgr2=0x558f9600d010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 1 -- 10.20.193.4:0/3685465831 shutdown_connections 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 1 -- 10.20.193.4:0/3685465831 wait complete. 2026-02-24T09:18:22.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791a607e00 20 client.17784 trim_cache size 0 max 16384 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 -- 10.20.193.4:0/4105001911 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78ec0b5760 msgr2=0x7f78ec0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78ec0b5760 0x7f78ec0d5c10 secure :-1 s=READY pgs=423 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7910168d60 tx=0x7f7904005f70 comp rx=0 tx=0).stop 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 -- 10.20.193.4:0/4105001911 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7910060fd0 msgr2=0x7f7910162410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7910060fd0 0x7f7910162410 secure :-1 s=READY pgs=1151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7900004820 tx=0x7f79000028d0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 -- 10.20.193.4:0/4105001911 shutdown_connections 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f78ec0b5760 0x7f78ec0d5c10 unknown :-1 s=CLOSED pgs=423 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7910155c10 0x7f7910167cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79100618e0 0x7f7910162950 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 --2- 10.20.193.4:0/4105001911 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7910060fd0 0x7f7910162410 unknown :-1 s=CLOSED pgs=1151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 -- 10.20.193.4:0/4105001911 >> 10.20.193.4:0/4105001911 conn(0x7f79100eade0 msgr2=0x7f791010b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 -- 10.20.193.4:0/4105001911 shutdown_connections 2026-02-24T09:18:22.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.613+0000 7f791860d640 1 -- 10.20.193.4:0/4105001911 wait complete. 2026-02-24T09:18:22.651 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:18:22.767 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:22.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 -- 10.20.193.4:0/753864381 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c0c10d3d0 msgr2=0x7f4c0c10d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 --2- 10.20.193.4:0/753864381 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c0c10d3d0 0x7f4c0c10d7a0 secure :-1 s=READY pgs=1156 gs=1 cs=0 l=1 c_cookie=9404213561118240031 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c00009950 tx=0x7f4c0002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 -- 10.20.193.4:0/753864381 shutdown_connections 2026-02-24T09:18:22.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 --2- 10.20.193.4:0/753864381 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c0c1135c0 0x7f4c0c173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 --2- 10.20.193.4:0/753864381 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c0c10ddc0 0x7f4c0c112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 --2- 10.20.193.4:0/753864381 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c0c10d3d0 0x7f4c0c10d7a0 unknown :-1 s=CLOSED pgs=1156 gs=1 cs=0 l=1 c_cookie=9404213561118240031 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 -- 10.20.193.4:0/753864381 >> 10.20.193.4:0/753864381 conn(0x7f4c0c0eaca0 msgr2=0x7f4c0c10b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 -- 10.20.193.4:0/753864381 shutdown_connections 2026-02-24T09:18:22.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 -- 10.20.193.4:0/753864381 wait complete. 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 Processor -- start 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 -- start start 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c0c10d3d0 0x7f4c0c0f5900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c0c10ddc0 0x7f4c0c173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c0c1135c0 0x7f4c0c0f6000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0fb210 con 0x7f4c0c10ddc0 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0fb380 con 0x7f4c0c1135c0 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c10a28640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0fb540 con 0x7f4c0c10d3d0 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.866+0000 7f4c09d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c0c10ddc0 0x7f4c0c173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c09d74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c0c10ddc0 0x7f4c0c173e90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36884/0 (socket says 10.20.193.4:36884) 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c09d74640 1 -- 10.20.193.4:0/2116675077 learned_addr learned my addr 10.20.193.4:0/2116675077 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c0a575640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c0c10d3d0 0x7f4c0c0f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c0ad76640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c0c1135c0 0x7f4c0c0f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c09d74640 1 -- 10.20.193.4:0/2116675077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c0c10d3d0 msgr2=0x7f4c0c0f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c09d74640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c0c10d3d0 0x7f4c0c0f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c09d74640 1 -- 10.20.193.4:0/2116675077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c0c1135c0 msgr2=0x7f4c0c0f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c09d74640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c0c1135c0 0x7f4c0c0f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c09d74640 1 -- 10.20.193.4:0/2116675077 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c00009570 con 0x7f4c0c10ddc0 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c0a575640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c0c10d3d0 0x7f4c0c0f5900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c09d74640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c0c10ddc0 0x7f4c0c173e90 secure :-1 s=READY pgs=1157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bf4005db0 tx=0x7f4bf400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4bf37fe640 1 -- 10.20.193.4:0/2116675077 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bf4004500 con 0x7f4c0c10ddc0 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4bf37fe640 1 -- 10.20.193.4:0/2116675077 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4bf4004d30 con 0x7f4c0c10ddc0 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c10a28640 1 -- 10.20.193.4:0/2116675077 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0c0fb820 con 0x7f4c0c10ddc0 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4bf37fe640 1 -- 10.20.193.4:0/2116675077 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bf4005310 con 0x7f4c0c10ddc0 2026-02-24T09:18:22.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.867+0000 7f4c10a28640 1 -- 10.20.193.4:0/2116675077 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0c0fbca0 con 0x7f4c0c10ddc0 2026-02-24T09:18:22.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.869+0000 7f4bf37fe640 1 -- 10.20.193.4:0/2116675077 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f4bf40054a0 con 0x7f4c0c10ddc0 2026-02-24T09:18:22.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.869+0000 7f4bf37fe640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4be40b56d0 0x7f4be40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.869+0000 7f4c0a575640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4be40b56d0 0x7f4be40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.869+0000 7f4bf37fe640 1 -- 10.20.193.4:0/2116675077 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4bf40e6d70 con 0x7f4c0c10ddc0 2026-02-24T09:18:22.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.870+0000 7f4c0a575640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4be40b56d0 0x7f4be40d5b80 secure :-1 s=READY pgs=424 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c000023d0 tx=0x7f4c00031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.871+0000 7f4c12a22e00 1 Processor -- start 2026-02-24T09:18:22.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.871+0000 7f4c12a22e00 1 -- start start 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.871+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f054f50 0x55665f055320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.871+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f055860 0x55665f099fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.871+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0ba8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.871+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55665ef65ee0 con 0x55665f09a500 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.871+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55665ef61c10 con 0x55665f054f50 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.871+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55665ef5bd70 con 0x55665f055860 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c0ad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0ba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c0ad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0ba8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36892/0 (socket says 10.20.193.4:36892) 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c0ad76640 1 -- 10.20.193.4:0/3766745623 learned_addr learned my addr 10.20.193.4:0/3766745623 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c09d74640 1 --2- 10.20.193.4:0/3766745623 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f055860 0x55665f099fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c0ad76640 1 -- 10.20.193.4:0/3766745623 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f055860 msgr2=0x55665f099fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c0ad76640 1 --2- 10.20.193.4:0/3766745623 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f055860 0x55665f099fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c0ad76640 1 -- 10.20.193.4:0/3766745623 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f054f50 msgr2=0x55665f055320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c0ad76640 1 --2- 10.20.193.4:0/3766745623 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f054f50 0x55665f055320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c0ad76640 1 -- 10.20.193.4:0/3766745623 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665ef07340 con 0x55665f09a500 2026-02-24T09:18:22.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c09d74640 1 --2- 10.20.193.4:0/3766745623 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f055860 0x55665f099fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c0ad76640 1 --2- 10.20.193.4:0/3766745623 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0ba8e0 secure :-1 s=READY pgs=1158 gs=1 cs=0 l=1 c_cookie=11085776349272479144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bfc00a2e0 tx=0x7f4bfc003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d896dacdd015a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4bf0ff9640 1 -- 10.20.193.4:0/3766745623 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bfc00ae30 con 0x55665f09a500 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4bf0ff9640 1 -- 10.20.193.4:0/3766745623 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4bfc003e30 con 0x55665f09a500 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4bf0ff9640 1 -- 10.20.193.4:0/3766745623 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bfc011a50 con 0x55665f09a500 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3766745623 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 msgr2=0x55665f0ba8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/3766745623 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0ba8e0 secure :-1 s=READY pgs=1158 gs=1 cs=0 l=1 c_cookie=11085776349272479144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bfc00a2e0 tx=0x7f4bfc003c30 comp rx=0 tx=0).stop 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3766745623 shutdown_connections 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/3766745623 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0ba8e0 unknown :-1 s=CLOSED pgs=1158 gs=1 cs=0 l=1 c_cookie=11085776349272479144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/3766745623 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f055860 0x55665f099fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/3766745623 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f054f50 0x55665f055320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3766745623 >> 10.20.193.4:0/3766745623 conn(0x55665ef73db0 msgr2=0x55665f053830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3766745623 shutdown_connections 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.872+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3766745623 wait complete. 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c12a22e00 1 -- start start 2026-02-24T09:18:22.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c12a22e00 1 Processor -- start 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f054f50 0x55665f0b1d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f0b2280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0b7270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55665f0b77b0 con 0x55665f09a500 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55665f0b7920 con 0x55665f055860 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55665f0b7ae0 con 0x55665f054f50 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c0ad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c0ad76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0b7270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36902/0 (socket says 10.20.193.4:36902) 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c0ad76640 1 -- 10.20.193.4:0/1727454981 learned_addr learned my addr 10.20.193.4:0/1727454981 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.873+0000 7f4c0a575640 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f054f50 0x55665f0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c09d74640 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f0b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c0ad76640 1 -- 10.20.193.4:0/1727454981 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f054f50 msgr2=0x55665f0b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c0ad76640 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f054f50 0x55665f0b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c0ad76640 1 -- 10.20.193.4:0/1727454981 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 msgr2=0x55665f0b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c0ad76640 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f0b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c0ad76640 1 -- 10.20.193.4:0/1727454981 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665eedf9d0 con 0x55665f09a500 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c0ad76640 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0b7270 secure :-1 s=READY pgs=1159 gs=1 cs=0 l=1 c_cookie=2492167281450173478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bfc0115e0 tx=0x7f4bfc006ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2295f4f03bb04426 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4bbbfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4bbbfff640 1 -- 10.20.193.4:0/1727454981 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bfc023070 con 0x55665f09a500 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4bbbfff640 1 -- 10.20.193.4:0/1727454981 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4bfc011e00 con 0x55665f09a500 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 1 -- 10.20.193.4:0/1727454981 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc0052d0 con 0x55665f09a500 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4bbbfff640 1 -- 10.20.193.4:0/1727454981 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bfc0059e0 con 0x55665f09a500 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 10 client.17796 _ll_register_callbacks cb 0x55665ef06080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 1 -- 10.20.193.4:0/1727454981 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55665ecab4a0 con 0x55665f09a500 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4bbbfff640 1 -- 10.20.193.4:0/1727454981 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4bfc005b70 con 0x55665f09a500 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4bbbfff640 1 -- 10.20.193.4:0/1727454981 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4bfc005d50 con 0x55665f09a500 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 10 client.17796 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 1 -- 10.20.193.4:0/1727454981 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55665eef1710 con 0x55665f09a500 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4bbbfff640 1 -- 10.20.193.4:0/1727454981 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4bfc011640 con 0x55665f09a500 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 10 client.17796 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 10 client.17796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 20 client.17796 populate_metadata read hostname 'trial004' 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55665f097590 0x55665f097a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 4 client.17796 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c12a22e00 1 -- 10.20.193.4:0/1727454981 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55665ef517b0 con 0x55665f097590 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.874+0000 7f4c0a575640 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55665f097590 0x55665f097a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.875+0000 7f4c0a575640 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55665f097590 0x55665f097a30 crc :-1 s=READY pgs=187 gs=4 cs=0 l=0 c_cookie=8118714839885142949 s_cookie=2080531149720739995 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70ab7821d00bdba5 server_cookie=1cdf880ebb3d609b in_seq=0 out_seq=0 2026-02-24T09:18:22.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.875+0000 7f4bbbfff640 10 client.17796 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4bbbfff640 1 -- 10.20.193.4:0/1727454981 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55665ef517b0 con 0x55665f097590 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4bbbfff640 10 client.17796 handle_command_reply: tid=0 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 client.17796 shutdown 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 -- 10.20.193.4:0/1727454981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 msgr2=0x55665f0b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0b7270 secure :-1 s=READY pgs=1159 gs=1 cs=0 l=1 c_cookie=2492167281450173478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bfc0115e0 tx=0x7f4bfc006ec0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 -- 10.20.193.4:0/1727454981 shutdown_connections 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55665f097590 0x55665f097a30 crc :-1 s=READY pgs=187 gs=4 cs=0 l=0 c_cookie=8118714839885142949 s_cookie=2080531149720739995 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f09a500 0x55665f0b7270 unknown :-1 s=CLOSED pgs=1159 gs=1 cs=0 l=1 c_cookie=2492167281450173478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f0b2280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/1727454981 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f054f50 0x55665f0b1d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4bbbfff640 0 client.17796 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 -- 10.20.193.4:0/1727454981 >> 10.20.193.4:0/1727454981 conn(0x55665ef73db0 msgr2=0x55665f053040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 -- 10.20.193.4:0/1727454981 shutdown_connections 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 1 -- 10.20.193.4:0/1727454981 wait complete. 2026-02-24T09:18:22.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.876+0000 7f4c12a22e00 20 client.17796 trim_cache size 0 max 16384 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.882+0000 7f4c12a22e00 1 Processor -- start 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.882+0000 7f4c12a22e00 1 -- start start 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f0af000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f0af540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f09a500 0x55665f094fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55665ef599a0 con 0x55665f054f50 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55665ed35df0 con 0x55665f055860 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55665f0aadf0 con 0x55665f09a500 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c0a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c0a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f0af000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36908/0 (socket says 10.20.193.4:36908) 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c0a575640 1 -- 10.20.193.4:0/2543182120 learned_addr learned my addr 10.20.193.4:0/2543182120 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c0ad76640 1 --2- 10.20.193.4:0/2543182120 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f09a500 0x55665f094fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c0a575640 1 -- 10.20.193.4:0/2543182120 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f09a500 msgr2=0x55665f094fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c0a575640 1 --2- 10.20.193.4:0/2543182120 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f09a500 0x55665f094fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c0a575640 1 -- 10.20.193.4:0/2543182120 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 msgr2=0x55665f0af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c09d74640 1 --2- 10.20.193.4:0/2543182120 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f0af540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c0a575640 1 --2- 10.20.193.4:0/2543182120 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f0af540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c0a575640 1 -- 10.20.193.4:0/2543182120 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665eeec190 con 0x55665f054f50 2026-02-24T09:18:22.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c09d74640 1 --2- 10.20.193.4:0/2543182120 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f0af540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c0a575640 1 --2- 10.20.193.4:0/2543182120 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f0af000 secure :-1 s=READY pgs=1160 gs=1 cs=0 l=1 c_cookie=11060221641492831701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c0002f6e0 tx=0x7f4c00040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997dccfbbe449dd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4bd64e6640 1 -- 10.20.193.4:0/2543182120 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c00002760 con 0x55665f054f50 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4bd64e6640 1 -- 10.20.193.4:0/2543182120 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4c000028c0 con 0x55665f054f50 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4bd64e6640 1 -- 10.20.193.4:0/2543182120 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c00054590 con 0x55665f054f50 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 -- 10.20.193.4:0/2543182120 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 msgr2=0x55665f0af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/2543182120 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f0af000 secure :-1 s=READY pgs=1160 gs=1 cs=0 l=1 c_cookie=11060221641492831701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c0002f6e0 tx=0x7f4c00040000 comp rx=0 tx=0).stop 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 -- 10.20.193.4:0/2543182120 shutdown_connections 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/2543182120 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f09a500 0x55665f094fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/2543182120 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f0af540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/2543182120 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f0af000 unknown :-1 s=CLOSED pgs=1160 gs=1 cs=0 l=1 c_cookie=11060221641492831701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.883+0000 7f4c12a22e00 1 -- 10.20.193.4:0/2543182120 >> 10.20.193.4:0/2543182120 conn(0x55665ef73db0 msgr2=0x55665f0ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.884+0000 7f4c12a22e00 1 -- 10.20.193.4:0/2543182120 shutdown_connections 2026-02-24T09:18:22.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.884+0000 7f4c12a22e00 1 -- 10.20.193.4:0/2543182120 wait complete. 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.884+0000 7f4c12a22e00 1 -- start start 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.884+0000 7f4c12a22e00 1 Processor -- start 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f034870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f034db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c12a22e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f09a500 0x55665f100100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55665f035700 con 0x55665f054f50 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55665f100640 con 0x55665f055860 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c12a22e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55665f100800 con 0x55665f09a500 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c0a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f034870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c0a575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f034870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:36918/0 (socket says 10.20.193.4:36918) 2026-02-24T09:18:22.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c0a575640 1 -- 10.20.193.4:0/3542522804 learned_addr learned my addr 10.20.193.4:0/3542522804 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c0ad76640 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f09a500 0x55665f100100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c09d74640 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f034db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c0a575640 1 -- 10.20.193.4:0/3542522804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f09a500 msgr2=0x55665f100100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c0a575640 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f09a500 0x55665f100100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c0a575640 1 -- 10.20.193.4:0/3542522804 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 msgr2=0x55665f034db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c0a575640 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f034db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c0a575640 1 -- 10.20.193.4:0/3542522804 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665eedfd00 con 0x55665f054f50 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4c0a575640 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f034870 secure :-1 s=READY pgs=1161 gs=1 cs=0 l=1 c_cookie=3202753893219410429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c00038d10 tx=0x7f4c00005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7277b26c57a1fd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.885+0000 7f4bbbfff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4bbbfff640 1 -- 10.20.193.4:0/3542522804 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c00002760 con 0x55665f054f50 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3542522804 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0004c040 con 0x55665f054f50 2026-02-24T09:18:22.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4bbbfff640 1 -- 10.20.193.4:0/3542522804 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4c00002a30 con 0x55665f054f50 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4bbbfff640 1 -- 10.20.193.4:0/3542522804 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c00054ea0 con 0x55665f054f50 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 10 client.17802 _ll_register_callbacks cb 0x55665ef06080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3542522804 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bfc003e30 con 0x55665f054f50 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4bbbfff640 1 -- 10.20.193.4:0/3542522804 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4c000526a0 con 0x55665f054f50 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4bbbfff640 1 -- 10.20.193.4:0/3542522804 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4c00052880 con 0x55665f054f50 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 10 client.17802 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3542522804 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55665eef1970 con 0x55665f054f50 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4bbbfff640 1 -- 10.20.193.4:0/3542522804 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4c0005b030 con 0x55665f054f50 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 10 client.17802 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 10 client.17802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 20 client.17802 populate_metadata read hostname 'trial004' 2026-02-24T09:18:22.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55665f148310 0x55665f1687c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 4 client.17802 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.886+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3542522804 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55665ec90160 con 0x55665f148310 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c09d74640 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55665f148310 0x55665f1687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4bbbfff640 10 client.17802 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c09d74640 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55665f148310 0x55665f1687c0 crc :-1 s=READY pgs=188 gs=4 cs=0 l=0 c_cookie=11909338338459978505 s_cookie=1281929130947382027 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a546781ed5d90b09 server_cookie=11ca53c0ad580b0b in_seq=0 out_seq=0 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4bbbfff640 1 -- 10.20.193.4:0/3542522804 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55665ec90160 con 0x55665f148310 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4bbbfff640 10 client.17802 handle_command_reply: tid=0 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 client.17802 shutdown 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3542522804 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 msgr2=0x55665f034870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f034870 secure :-1 s=READY pgs=1161 gs=1 cs=0 l=1 c_cookie=3202753893219410429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c00038d10 tx=0x7f4c00005ee0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3542522804 shutdown_connections 2026-02-24T09:18:22.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55665f148310 0x55665f1687c0 crc :-1 s=READY pgs=188 gs=4 cs=0 l=0 c_cookie=11909338338459978505 s_cookie=1281929130947382027 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55665f09a500 0x55665f100100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55665f055860 0x55665f034db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4bbbfff640 0 client.17802 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:22.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 --2- 10.20.193.4:0/3542522804 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55665f054f50 0x55665f034870 unknown :-1 s=CLOSED pgs=1161 gs=1 cs=0 l=1 c_cookie=3202753893219410429 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3542522804 >> 10.20.193.4:0/3542522804 conn(0x55665ef73db0 msgr2=0x55665f0af000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3542522804 shutdown_connections 2026-02-24T09:18:22.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 1 -- 10.20.193.4:0/3542522804 wait complete. 2026-02-24T09:18:22.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.887+0000 7f4c12a22e00 20 client.17802 trim_cache size 0 max 16384 2026-02-24T09:18:22.897 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:18:22.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 -- 10.20.193.4:0/2116675077 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4be40b56d0 msgr2=0x7f4be40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4be40b56d0 0x7f4be40d5b80 secure :-1 s=READY pgs=424 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c000023d0 tx=0x7f4c00031040 comp rx=0 tx=0).stop 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 -- 10.20.193.4:0/2116675077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c0c10ddc0 msgr2=0x7f4c0c173e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c0c10ddc0 0x7f4c0c173e90 secure :-1 s=READY pgs=1157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bf4005db0 tx=0x7f4bf400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 -- 10.20.193.4:0/2116675077 shutdown_connections 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4be40b56d0 0x7f4be40d5b80 unknown :-1 s=CLOSED pgs=424 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4c0c1135c0 0x7f4c0c0f6000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4c0c10ddc0 0x7f4c0c173e90 unknown :-1 s=CLOSED pgs=1157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 --2- 10.20.193.4:0/2116675077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4c0c10d3d0 0x7f4c0c0f5900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 -- 10.20.193.4:0/2116675077 >> 10.20.193.4:0/2116675077 conn(0x7f4c0c0eaca0 msgr2=0x7f4c0c10f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 -- 10.20.193.4:0/2116675077 shutdown_connections 2026-02-24T09:18:22.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:22.888+0000 7f4c10a28640 1 -- 10.20.193.4:0/2116675077 wait complete. 2026-02-24T09:18:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:22 trial004 ceph-mon[41596]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2026-02-24T09:18:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:22 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4248251824' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:23.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:22 trial090 ceph-mon[47278]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2026-02-24T09:18:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:22 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4248251824' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:22 trial014 ceph-mon[46941]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2026-02-24T09:18:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:22 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4248251824' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:23.926 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:18:23.926 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:18:24.044 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:24.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.147+0000 7fb9c6056640 1 -- 10.20.193.4:0/1009023908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9c010da00 msgr2=0x7fb9c0112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.147+0000 7fb9c6056640 1 --2- 10.20.193.4:0/1009023908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9c010da00 0x7fb9c0112a50 secure :-1 s=READY pgs=1162 gs=1 cs=0 l=1 c_cookie=2617375744874674948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9b0009950 tx=0x7fb9b002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.147+0000 7fb9c6056640 1 -- 10.20.193.4:0/1009023908 shutdown_connections 2026-02-24T09:18:24.153 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.147+0000 7fb9c6056640 1 --2- 10.20.193.4:0/1009023908 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9c0113200 0x7fb9c0173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.147+0000 7fb9c6056640 1 --2- 10.20.193.4:0/1009023908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9c010da00 0x7fb9c0112a50 unknown :-1 s=CLOSED pgs=1162 gs=1 cs=0 l=1 c_cookie=2617375744874674948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.147+0000 7fb9c6056640 1 --2- 10.20.193.4:0/1009023908 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9c010d010 0x7fb9c010d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.147+0000 7fb9c6056640 1 -- 10.20.193.4:0/1009023908 >> 10.20.193.4:0/1009023908 conn(0x7fb9c005f830 msgr2=0x7fb9c010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.147+0000 7fb9c6056640 1 -- 10.20.193.4:0/1009023908 shutdown_connections 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.147+0000 7fb9c6056640 1 -- 10.20.193.4:0/1009023908 wait complete. 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9c6056640 1 Processor -- start 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9c6056640 1 -- start start 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9c6056640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9c010d010 0x7fb9c00f56f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9c6056640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9c010da00 0x7fb9c0173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9c6056640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9c0113200 0x7fb9c00f5df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9c6056640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c00fb000 con 0x7fb9c010da00 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9c6056640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c00fb170 con 0x7fb9c0113200 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9c6056640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c00fb330 con 0x7fb9c010d010 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9beffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9c010da00 0x7fb9c0173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9beffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9c010da00 0x7fb9c0173ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44316/0 (socket says 10.20.193.4:44316) 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9beffd640 1 -- 10.20.193.4:0/1050655242 learned_addr learned my addr 10.20.193.4:0/1050655242 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9c010d010 0x7fb9c00f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9bffff640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9c0113200 0x7fb9c00f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9beffd640 1 -- 10.20.193.4:0/1050655242 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9c010d010 msgr2=0x7fb9c00f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9beffd640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9c010d010 0x7fb9c00f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9beffd640 1 -- 10.20.193.4:0/1050655242 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9c0113200 msgr2=0x7fb9c00f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9beffd640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9c0113200 0x7fb9c00f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9beffd640 1 -- 10.20.193.4:0/1050655242 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b0009570 con 0x7fb9c010da00 2026-02-24T09:18:24.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9beffd640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9c010da00 0x7fb9c0173ad0 secure :-1 s=READY pgs=1163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9b00023d0 tx=0x7fb9b00043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9bcff9640 1 -- 10.20.193.4:0/1050655242 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9b003d070 con 0x7fb9c010da00 2026-02-24T09:18:24.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9bcff9640 1 -- 10.20.193.4:0/1050655242 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9b0038920 con 0x7fb9c010da00 2026-02-24T09:18:24.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9bcff9640 1 -- 10.20.193.4:0/1050655242 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9b00419d0 con 0x7fb9c010da00 2026-02-24T09:18:24.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9c6056640 1 -- 10.20.193.4:0/1050655242 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c00fb5b0 con 0x7fb9c010da00 2026-02-24T09:18:24.156 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.148+0000 7fb9c6056640 1 -- 10.20.193.4:0/1050655242 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c00fb9d0 con 0x7fb9c010da00 2026-02-24T09:18:24.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.150+0000 7fb9bcff9640 1 -- 10.20.193.4:0/1050655242 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fb9b0038a90 con 0x7fb9c010da00 2026-02-24T09:18:24.163 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.151+0000 7fb9bcff9640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9940b5750 0x7fb9940d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.151+0000 7fb9bcff9640 1 -- 10.20.193.4:0/1050655242 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb9b010b3c0 con 0x7fb9c010da00 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.151+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9940b5750 0x7fb9940d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.151+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9940b5750 0x7fb9940d5c00 secure :-1 s=READY pgs=425 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9ac004740 tx=0x7fb9ac004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.152+0000 7fb9c8050e00 1 Processor -- start 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 -- start start 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5300 0x5623bbac56d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5c10 0x5623bbb0a370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbb2ac90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5623bb9d5520 con 0x5623bbb0a8b0 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5623bb9d1250 con 0x5623bbac5300 2026-02-24T09:18:24.164 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5623bb9cb3b0 con 0x5623bbac5c10 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbb2ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbb2ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44318/0 (socket says 10.20.193.4:44318) 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bffff640 1 -- 10.20.193.4:0/3193406353 learned_addr learned my addr 10.20.193.4:0/3193406353 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5300 0x5623bbac56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9beffd640 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5c10 0x5623bbb0a370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bffff640 1 -- 10.20.193.4:0/3193406353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5c10 msgr2=0x5623bbb0a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bffff640 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5c10 0x5623bbb0a370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bffff640 1 -- 10.20.193.4:0/3193406353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5300 msgr2=0x5623bbac56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bffff640 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5300 0x5623bbac56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bffff640 1 -- 10.20.193.4:0/3193406353 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bb9766e0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9beffd640 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5c10 0x5623bbb0a370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:24.165 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5300 0x5623bbac56d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9bffff640 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbb2ac90 secure :-1 s=READY pgs=1164 gs=1 cs=0 l=1 c_cookie=13792679981425406132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9b4006a50 tx=0x7fb9b4003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf69715dc980b0b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb983fff640 1 -- 10.20.193.4:0/3193406353 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9b4010c20 con 0x5623bbb0a8b0 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb983fff640 1 -- 10.20.193.4:0/3193406353 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9b4010d80 con 0x5623bbb0a8b0 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb983fff640 1 -- 10.20.193.4:0/3193406353 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9b401a8b0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3193406353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 msgr2=0x5623bbb2ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbb2ac90 secure :-1 s=READY pgs=1164 gs=1 cs=0 l=1 c_cookie=13792679981425406132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9b4006a50 tx=0x7fb9b4003e70 comp rx=0 tx=0).stop 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3193406353 shutdown_connections 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbb2ac90 unknown :-1 s=CLOSED pgs=1164 gs=1 cs=0 l=1 c_cookie=13792679981425406132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5c10 0x5623bbb0a370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/3193406353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5300 0x5623bbac56d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.153+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3193406353 >> 10.20.193.4:0/3193406353 conn(0x5623bb9e34f0 msgr2=0x5623bbac3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.166 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.154+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3193406353 shutdown_connections 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.154+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3193406353 wait complete. 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.154+0000 7fb9c8050e00 1 -- start start 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.154+0000 7fb9c8050e00 1 Processor -- start 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.154+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5300 0x5623bbadd360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.154+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbadd8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.154+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbae2890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5623bbae2dd0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5623bbae2f40 con 0x5623bbac5c10 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5623bbae3100 con 0x5623bbac5300 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbae2890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbae2890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44320/0 (socket says 10.20.193.4:44320) 2026-02-24T09:18:24.167 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9bffff640 1 -- 10.20.193.4:0/2032748908 learned_addr learned my addr 10.20.193.4:0/2032748908 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9beffd640 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbadd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5300 0x5623bbadd360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9bffff640 1 -- 10.20.193.4:0/2032748908 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5300 msgr2=0x5623bbadd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9bffff640 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5300 0x5623bbadd360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9bffff640 1 -- 10.20.193.4:0/2032748908 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 msgr2=0x5623bbadd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9bffff640 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbadd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9bffff640 1 -- 10.20.193.4:0/2032748908 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bb94ecd0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9beffd640 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbadd8a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9bffff640 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbae2890 secure :-1 s=READY pgs=1165 gs=1 cs=0 l=1 c_cookie=4194622562490329950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9b4014010 tx=0x7fb9b401a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a364aff1c132b5e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9817fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9817fa640 1 -- 10.20.193.4:0/2032748908 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9b401ae70 con 0x5623bbb0a8b0 2026-02-24T09:18:24.168 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9817fa640 1 -- 10.20.193.4:0/2032748908 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9b401f070 con 0x5623bbb0a8b0 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9817fa640 1 -- 10.20.193.4:0/2032748908 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9b4005a40 con 0x5623bbb0a8b0 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9c8050e00 1 -- 10.20.193.4:0/2032748908 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b40055b0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9817fa640 1 -- 10.20.193.4:0/2032748908 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb9b4005bd0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9817fa640 10 client.17814 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9c8050e00 10 client.17814 _ll_register_callbacks cb 0x5623bb947790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9c8050e00 1 -- 10.20.193.4:0/2032748908 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5623bb6589d0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9817fa640 1 -- 10.20.193.4:0/2032748908 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb9b401a840 con 0x5623bbb0a8b0 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9c8050e00 10 client.17814 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.155+0000 7fb9c8050e00 1 -- 10.20.193.4:0/2032748908 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5623bb960ab0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.156+0000 7fb9817fa640 1 -- 10.20.193.4:0/2032748908 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb9b4018020 con 0x5623bbb0a8b0 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.156+0000 7fb9c8050e00 10 client.17814 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:24.169 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.156+0000 7fb9c8050e00 10 client.17814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.156+0000 7fb9c8050e00 20 client.17814 populate_metadata read hostname 'trial004' 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.156+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5623bbb07a00 0x5623bbb07ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.156+0000 7fb9c8050e00 4 client.17814 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.156+0000 7fb9c8050e00 1 -- 10.20.193.4:0/2032748908 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623bb9dbb70 con 0x5623bbb07a00 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.156+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5623bbb07a00 0x5623bbb07ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5623bbb07a00 0x5623bbb07ea0 crc :-1 s=READY pgs=189 gs=4 cs=0 l=0 c_cookie=969537286656411349 s_cookie=15073249628620947473 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d747d067fa6c6d5 server_cookie=d12ef0acfcbd8011 in_seq=0 out_seq=0 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9817fa640 10 client.17814 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9817fa640 1 -- 10.20.193.4:0/2032748908 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5623bb9dbb70 con 0x5623bbb07a00 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9817fa640 10 client.17814 handle_command_reply: tid=0 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 client.17814 shutdown 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 -- 10.20.193.4:0/2032748908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 msgr2=0x5623bbae2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.170 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbae2890 secure :-1 s=READY pgs=1165 gs=1 cs=0 l=1 c_cookie=4194622562490329950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9b4014010 tx=0x7fb9b401a6d0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 -- 10.20.193.4:0/2032748908 shutdown_connections 2026-02-24T09:18:24.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5623bbb07a00 0x5623bbb07ea0 crc :-1 s=READY pgs=189 gs=4 cs=0 l=0 c_cookie=969537286656411349 s_cookie=15073249628620947473 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbae2890 unknown :-1 s=CLOSED pgs=1165 gs=1 cs=0 l=1 c_cookie=4194622562490329950 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9817fa640 0 client.17814 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:24.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbadd8a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/2032748908 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5300 0x5623bbadd360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 -- 10.20.193.4:0/2032748908 >> 10.20.193.4:0/2032748908 conn(0x5623bb9e34f0 msgr2=0x5623bbac42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 -- 10.20.193.4:0/2032748908 shutdown_connections 2026-02-24T09:18:24.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 1 -- 10.20.193.4:0/2032748908 wait complete. 2026-02-24T09:18:24.171 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.157+0000 7fb9c8050e00 20 client.17814 trim_cache size 0 max 16384 2026-02-24T09:18:24.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9c8050e00 1 Processor -- start 2026-02-24T09:18:24.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9c8050e00 1 -- start start 2026-02-24T09:18:24.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5300 0x5623bbae1e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbada940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.177 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbadae80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5623bb9c8fe0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5623bb693fe0 con 0x5623bbac5c10 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5623bbad6620 con 0x5623bbac5300 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbadae80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9bffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbadae80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44334/0 (socket says 10.20.193.4:44334) 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9bffff640 1 -- 10.20.193.4:0/556806891 learned_addr learned my addr 10.20.193.4:0/556806891 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.166+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/556806891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5300 0x5623bbae1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9beffd640 1 --2- 10.20.193.4:0/556806891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbada940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9bffff640 1 -- 10.20.193.4:0/556806891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5300 msgr2=0x5623bbae1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9bffff640 1 --2- 10.20.193.4:0/556806891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5300 0x5623bbae1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9bffff640 1 -- 10.20.193.4:0/556806891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 msgr2=0x5623bbada940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.178 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9bffff640 1 --2- 10.20.193.4:0/556806891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbada940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9bffff640 1 -- 10.20.193.4:0/556806891 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bb95b530 con 0x5623bbb0a8b0 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9bffff640 1 --2- 10.20.193.4:0/556806891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbadae80 secure :-1 s=READY pgs=1166 gs=2 cs=0 l=1 c_cookie=16219014599242129177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9b4012f50 tx=0x7fb9b402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11583d892b39f19 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9837fe640 1 -- 10.20.193.4:0/556806891 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9b403c070 con 0x5623bbb0a8b0 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9837fe640 1 -- 10.20.193.4:0/556806891 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9b401f070 con 0x5623bbb0a8b0 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9837fe640 1 -- 10.20.193.4:0/556806891 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9b401a7c0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9c8050e00 1 -- 10.20.193.4:0/556806891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 msgr2=0x5623bbadae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/556806891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbadae80 secure :-1 s=READY pgs=1166 gs=2 cs=0 l=1 c_cookie=16219014599242129177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9b4012f50 tx=0x7fb9b402c000 comp rx=0 tx=0).stop 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9c8050e00 1 -- 10.20.193.4:0/556806891 shutdown_connections 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/556806891 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbb0a8b0 0x5623bbadae80 unknown :-1 s=CLOSED pgs=1166 gs=2 cs=0 l=1 c_cookie=16219014599242129177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/556806891 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbada940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/556806891 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbac5300 0x5623bbae1e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.179 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9c8050e00 1 -- 10.20.193.4:0/556806891 >> 10.20.193.4:0/556806891 conn(0x5623bb9e34f0 msgr2=0x5623bbae16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9c8050e00 1 -- 10.20.193.4:0/556806891 shutdown_connections 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.167+0000 7fb9c8050e00 1 -- 10.20.193.4:0/556806891 wait complete. 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9c8050e00 1 -- start start 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9c8050e00 1 Processor -- start 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbac5300 0x5623bbae3870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbae3db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9c8050e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbb0a8b0 0x5623bbae42f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5623bbacf920 con 0x5623bbac5300 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5623bbaa0650 con 0x5623bbac5c10 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9c8050e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5623bbae8ae0 con 0x5623bbb0a8b0 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9bf7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbac5300 0x5623bbae3870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.180 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9bf7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbac5300 0x5623bbae3870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44344/0 (socket says 10.20.193.4:44344) 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9bf7fe640 1 -- 10.20.193.4:0/3213587178 learned_addr learned my addr 10.20.193.4:0/3213587178 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9beffd640 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbae3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9bffff640 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbb0a8b0 0x5623bbae42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9bf7fe640 1 -- 10.20.193.4:0/3213587178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbb0a8b0 msgr2=0x5623bbae42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbb0a8b0 0x5623bbae42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9bf7fe640 1 -- 10.20.193.4:0/3213587178 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 msgr2=0x5623bbae3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbae3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9bf7fe640 1 -- 10.20.193.4:0/3213587178 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bb94f000 con 0x5623bbac5300 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9bf7fe640 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbac5300 0x5623bbae3870 secure :-1 s=READY pgs=1167 gs=1 cs=0 l=1 c_cookie=16903653444076272030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5623bbb08750 tx=0x7fb9ac0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea95d73f7c79799e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9817fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9817fa640 1 -- 10.20.193.4:0/3213587178 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9ac011660 con 0x5623bbac5300 2026-02-24T09:18:24.181 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9817fa640 1 -- 10.20.193.4:0/3213587178 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9ac011ca0 con 0x5623bbac5300 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9817fa640 1 -- 10.20.193.4:0/3213587178 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9ac029ea0 con 0x5623bbac5300 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3213587178 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623bb960ab0 con 0x5623bbac5300 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9817fa640 1 -- 10.20.193.4:0/3213587178 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb9ac02e020 con 0x5623bbac5300 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.168+0000 7fb9817fa640 10 client.17820 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9c8050e00 10 client.17820 _ll_register_callbacks cb 0x5623bb947790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3213587178 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5623bb9dd7e0 con 0x5623bbac5300 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9817fa640 1 -- 10.20.193.4:0/3213587178 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb9ac011e10 con 0x5623bbac5300 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9c8050e00 10 client.17820 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3213587178 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5623bb960d10 con 0x5623bbac5300 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9817fa640 1 -- 10.20.193.4:0/3213587178 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb9ac0117c0 con 0x5623bbac5300 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9c8050e00 10 client.17820 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9c8050e00 10 client.17820 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9c8050e00 20 client.17820 populate_metadata read hostname 'trial004' 2026-02-24T09:18:24.182 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5623bbbb8260 0x5623bbbd8710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9c8050e00 4 client.17820 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3213587178 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5623bb656220 con 0x5623bbbb8260 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.169+0000 7fb9beffd640 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5623bbbb8260 0x5623bbbd8710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.170+0000 7fb9817fa640 10 client.17820 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.170+0000 7fb9beffd640 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5623bbbb8260 0x5623bbbd8710 crc :-1 s=READY pgs=190 gs=4 cs=0 l=0 c_cookie=3368916261887852040 s_cookie=562667371120163093 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ec0cb7dabdcbe08 server_cookie=7cefefe2e51f915 in_seq=0 out_seq=0 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9817fa640 1 -- 10.20.193.4:0/3213587178 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5623bb656220 con 0x5623bbbb8260 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9817fa640 10 client.17820 handle_command_reply: tid=0 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 client.17820 shutdown 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3213587178 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbac5300 msgr2=0x5623bbae3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbac5300 0x5623bbae3870 secure :-1 s=READY pgs=1167 gs=1 cs=0 l=1 c_cookie=16903653444076272030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x5623bbb08750 tx=0x7fb9ac0047e0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3213587178 shutdown_connections 2026-02-24T09:18:24.183 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5623bbbb8260 0x5623bbbd8710 crc :-1 s=READY pgs=190 gs=4 cs=0 l=0 c_cookie=3368916261887852040 s_cookie=562667371120163093 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5623bbb0a8b0 0x5623bbae42f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9817fa640 0 client.17820 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:24.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5623bbac5c10 0x5623bbae3db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 --2- 10.20.193.4:0/3213587178 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5623bbac5300 0x5623bbae3870 unknown :-1 s=CLOSED pgs=1167 gs=1 cs=0 l=1 c_cookie=16903653444076272030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3213587178 >> 10.20.193.4:0/3213587178 conn(0x5623bb9e34f0 msgr2=0x5623bbb02550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3213587178 shutdown_connections 2026-02-24T09:18:24.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 1 -- 10.20.193.4:0/3213587178 wait complete. 2026-02-24T09:18:24.184 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c8050e00 20 client.17820 trim_cache size 0 max 16384 2026-02-24T09:18:24.184 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:18:24.185 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:18:24.185 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "1e753e7d-de39-4483-82a7-d40f8a0cf87e", 2026-02-24T09:18:24.185 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:18:24.185 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:18:24.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 -- 10.20.193.4:0/1050655242 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9940b5750 msgr2=0x7fb9940d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9940b5750 0x7fb9940d5c00 secure :-1 s=READY pgs=425 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9ac004740 tx=0x7fb9ac004420 comp rx=0 tx=0).stop 2026-02-24T09:18:24.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 -- 10.20.193.4:0/1050655242 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9c010da00 msgr2=0x7fb9c0173ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9c010da00 0x7fb9c0173ad0 secure :-1 s=READY pgs=1163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9b00023d0 tx=0x7fb9b00043d0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 -- 10.20.193.4:0/1050655242 shutdown_connections 2026-02-24T09:18:24.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb9940b5750 0x7fb9940d5c00 unknown :-1 s=CLOSED pgs=425 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb9c0113200 0x7fb9c00f5df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb9c010da00 0x7fb9c0173ad0 unknown :-1 s=CLOSED pgs=1163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 --2- 10.20.193.4:0/1050655242 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb9c010d010 0x7fb9c00f56f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 -- 10.20.193.4:0/1050655242 >> 10.20.193.4:0/1050655242 conn(0x7fb9c005f830 msgr2=0x7fb9c010f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 -- 10.20.193.4:0/1050655242 shutdown_connections 2026-02-24T09:18:24.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.171+0000 7fb9c6056640 1 -- 10.20.193.4:0/1050655242 wait complete. 2026-02-24T09:18:24.209 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:18:24.327 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:24.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.425+0000 7efd2f174640 1 -- 10.20.193.4:0/3216945682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efd281135c0 msgr2=0x7efd28173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.425+0000 7efd2f174640 1 --2- 10.20.193.4:0/3216945682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efd281135c0 0x7efd28173f90 secure :-1 s=READY pgs=1168 gs=1 cs=0 l=1 c_cookie=15947779914670473731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd2400aa30 tx=0x7efd24030280 comp rx=0 tx=0).stop 2026-02-24T09:18:24.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.425+0000 7efd2f174640 1 -- 10.20.193.4:0/3216945682 shutdown_connections 2026-02-24T09:18:24.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.425+0000 7efd2f174640 1 --2- 10.20.193.4:0/3216945682 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efd281135c0 0x7efd28173f90 unknown :-1 s=CLOSED pgs=1168 gs=1 cs=0 l=1 c_cookie=15947779914670473731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.425+0000 7efd2f174640 1 --2- 10.20.193.4:0/3216945682 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efd2810ddc0 0x7efd28112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.425+0000 7efd2f174640 1 --2- 10.20.193.4:0/3216945682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd2810d3d0 0x7efd2810d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.425+0000 7efd2f174640 1 -- 10.20.193.4:0/3216945682 >> 10.20.193.4:0/3216945682 conn(0x7efd280eaca0 msgr2=0x7efd2810b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.425+0000 7efd2f174640 1 -- 10.20.193.4:0/3216945682 shutdown_connections 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.425+0000 7efd2f174640 1 -- 10.20.193.4:0/3216945682 wait complete. 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2f174640 1 Processor -- start 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2f174640 1 -- start start 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2f174640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efd2810d3d0 0x7efd2811bc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2f174640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efd2810ddc0 0x7efd2811c1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2f174640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd281135c0 0x7efd28121580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2f174640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7efd28121ba0 con 0x7efd2810ddc0 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2f174640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7efd28121d10 con 0x7efd2810d3d0 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2f174640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7efd28121ed0 con 0x7efd281135c0 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efd2810ddc0 0x7efd2811c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efd2810ddc0 0x7efd2811c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44364/0 (socket says 10.20.193.4:44364) 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1ffff640 1 -- 10.20.193.4:0/3096340166 learned_addr learned my addr 10.20.193.4:0/3096340166 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2d6ea640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd281135c0 0x7efd28121580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2cee9640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efd2810d3d0 0x7efd2811bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1ffff640 1 -- 10.20.193.4:0/3096340166 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd281135c0 msgr2=0x7efd28121580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1ffff640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd281135c0 0x7efd28121580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1ffff640 1 -- 10.20.193.4:0/3096340166 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efd2810d3d0 msgr2=0x7efd2811bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1ffff640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efd2810d3d0 0x7efd2811bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1ffff640 1 -- 10.20.193.4:0/3096340166 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2400a650 con 0x7efd2810ddc0 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1ffff640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efd2810ddc0 0x7efd2811c1b0 secure :-1 s=READY pgs=1169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1000d950 tx=0x7efd1000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1dffb640 1 -- 10.20.193.4:0/3096340166 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd10004540 con 0x7efd2810ddc0 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1dffb640 1 -- 10.20.193.4:0/3096340166 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efd10009d00 con 0x7efd2810ddc0 2026-02-24T09:18:24.433 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2f174640 1 -- 10.20.193.4:0/3096340166 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd281221b0 con 0x7efd2810ddc0 2026-02-24T09:18:24.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd1dffb640 1 -- 10.20.193.4:0/3096340166 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd100106e0 con 0x7efd2810ddc0 2026-02-24T09:18:24.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.426+0000 7efd2f174640 1 -- 10.20.193.4:0/3096340166 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd281628b0 con 0x7efd2810ddc0 2026-02-24T09:18:24.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.428+0000 7efd1dffb640 1 -- 10.20.193.4:0/3096340166 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7efd100097c0 con 0x7efd2810ddc0 2026-02-24T09:18:24.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.428+0000 7efd1dffb640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efd040b56e0 0x7efd040d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.428+0000 7efd2cee9640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efd040b56e0 0x7efd040d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.429+0000 7efd1dffb640 1 -- 10.20.193.4:0/3096340166 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7efd100e6e20 con 0x7efd2810ddc0 2026-02-24T09:18:24.440 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.429+0000 7efd2cee9640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efd040b56e0 0x7efd040d5b90 secure :-1 s=READY pgs=426 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd18005970 tx=0x7efd18005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd3116ee00 1 Processor -- start 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd3116ee00 1 -- start start 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72ba0bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72be5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 0x557b72c061b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd3116ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557b72ab0de0 con 0x557b72ba1130 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd3116ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557b72aacb10 con 0x557b72ba0820 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd3116ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557b72aa6ab0 con 0x557b72be5dd0 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72be5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72be5890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44378/0 (socket says 10.20.193.4:44378) 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd1ffff640 1 -- 10.20.193.4:0/3668433058 learned_addr learned my addr 10.20.193.4:0/3668433058 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:24.441 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd2cee9640 1 --2- 10.20.193.4:0/3668433058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72ba0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd2d6ea640 1 --2- 10.20.193.4:0/3668433058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 0x557b72c061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd1ffff640 1 -- 10.20.193.4:0/3668433058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 msgr2=0x557b72c061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd1ffff640 1 --2- 10.20.193.4:0/3668433058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 0x557b72c061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd1ffff640 1 -- 10.20.193.4:0/3668433058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 msgr2=0x557b72ba0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd1ffff640 1 --2- 10.20.193.4:0/3668433058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72ba0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd1ffff640 1 -- 10.20.193.4:0/3668433058 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b72a52310 con 0x557b72ba1130 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efd1ffff640 1 --2- 10.20.193.4:0/3668433058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72be5890 secure :-1 s=READY pgs=1170 gs=1 cs=0 l=1 c_cookie=16164163157700745148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd100e49b0 tx=0x7efd10002cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e052a4c0223597bc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efcf54e4640 1 -- 10.20.193.4:0/3668433058 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd1005b110 con 0x557b72ba1130 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efcf54e4640 1 -- 10.20.193.4:0/3668433058 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efd100acb70 con 0x557b72ba1130 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.430+0000 7efcf54e4640 1 -- 10.20.193.4:0/3668433058 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd100ade20 con 0x557b72ba1130 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.431+0000 7efd3116ee00 1 -- 10.20.193.4:0/3668433058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 msgr2=0x557b72be5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.442 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.431+0000 7efd3116ee00 1 --2- 10.20.193.4:0/3668433058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72be5890 secure :-1 s=READY pgs=1170 gs=1 cs=0 l=1 c_cookie=16164163157700745148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd100e49b0 tx=0x7efd10002cc0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.431+0000 7efd3116ee00 1 -- 10.20.193.4:0/3668433058 shutdown_connections 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.431+0000 7efd3116ee00 1 --2- 10.20.193.4:0/3668433058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 0x557b72c061b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.431+0000 7efd3116ee00 1 --2- 10.20.193.4:0/3668433058 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72be5890 unknown :-1 s=CLOSED pgs=1170 gs=1 cs=0 l=1 c_cookie=16164163157700745148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.431+0000 7efd3116ee00 1 --2- 10.20.193.4:0/3668433058 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72ba0bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.431+0000 7efd3116ee00 1 -- 10.20.193.4:0/3668433058 >> 10.20.193.4:0/3668433058 conn(0x557b72abf6b0 msgr2=0x557b72b9f100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.431+0000 7efd3116ee00 1 -- 10.20.193.4:0/3668433058 shutdown_connections 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.431+0000 7efd3116ee00 1 -- 10.20.193.4:0/3668433058 wait complete. 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd3116ee00 1 -- start start 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd3116ee00 1 Processor -- start 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72ba0820 0x557b72b9c460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba1130 0x557b72b9c9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72be5dd0 0x557b72bc2970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd3116ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557b72bc2eb0 con 0x557b72be5dd0 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd3116ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557b72bc3020 con 0x557b72ba1130 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd3116ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557b72bc31e0 con 0x557b72ba0820 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd2d6ea640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72be5dd0 0x557b72bc2970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd2d6ea640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72be5dd0 0x557b72bc2970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44386/0 (socket says 10.20.193.4:44386) 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd2d6ea640 1 -- 10.20.193.4:0/922005942 learned_addr learned my addr 10.20.193.4:0/922005942 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd1ffff640 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba1130 0x557b72b9c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd2cee9640 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72ba0820 0x557b72b9c460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd2d6ea640 1 -- 10.20.193.4:0/922005942 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72ba0820 msgr2=0x557b72b9c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd2d6ea640 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72ba0820 0x557b72b9c460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd2d6ea640 1 -- 10.20.193.4:0/922005942 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba1130 msgr2=0x557b72b9c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd2d6ea640 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba1130 0x557b72b9c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd2d6ea640 1 -- 10.20.193.4:0/922005942 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b72a2a8c0 con 0x557b72be5dd0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd2d6ea640 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72be5dd0 0x557b72bc2970 secure :-1 s=READY pgs=1171 gs=1 cs=0 l=1 c_cookie=8532724990415493320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd2400a230 tx=0x7efd24003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766a542ba3d058c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efce67fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efce67fc640 1 -- 10.20.193.4:0/922005942 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd240039a0 con 0x557b72be5dd0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efce67fc640 1 -- 10.20.193.4:0/922005942 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efd2403f050 con 0x557b72be5dd0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd3116ee00 1 -- 10.20.193.4:0/922005942 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd281628b0 con 0x557b72be5dd0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efce67fc640 1 -- 10.20.193.4:0/922005942 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd24044690 con 0x557b72be5dd0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.432+0000 7efd3116ee00 10 client.17832 _ll_register_callbacks cb 0x557b72a42160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efd3116ee00 1 -- 10.20.193.4:0/922005942 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557b727f64a0 con 0x557b72be5dd0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efce67fc640 1 -- 10.20.193.4:0/922005942 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7efd24044820 con 0x557b72be5dd0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efce67fc640 1 -- 10.20.193.4:0/922005942 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efd240449e0 con 0x557b72be5dd0 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efd3116ee00 10 client.17832 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:24.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efd3116ee00 1 -- 10.20.193.4:0/922005942 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557b72a3c6e0 con 0x557b72be5dd0 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efce67fc640 1 -- 10.20.193.4:0/922005942 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7efd24044bc0 con 0x557b72be5dd0 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efd3116ee00 10 client.17832 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efd3116ee00 10 client.17832 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efd3116ee00 20 client.17832 populate_metadata read hostname 'trial004' 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efd3116ee00 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557b72be5950 0x557b72c484f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efd3116ee00 4 client.17832 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efd3116ee00 1 -- 10.20.193.4:0/922005942 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b72a9c4f0 con 0x557b72be5950 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.433+0000 7efd2cee9640 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557b72be5950 0x557b72c484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd2cee9640 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557b72be5950 0x557b72c484f0 crc :-1 s=READY pgs=191 gs=4 cs=0 l=0 c_cookie=7999454993518313012 s_cookie=8042610288591755183 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f03c5ef05623e34 server_cookie=6f9d17722669d7af in_seq=0 out_seq=0 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efce67fc640 10 client.17832 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efce67fc640 1 -- 10.20.193.4:0/922005942 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557b72a9c4f0 con 0x557b72be5950 2026-02-24T09:18:24.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efce67fc640 10 client.17832 handle_command_reply: tid=0 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 client.17832 shutdown 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 -- 10.20.193.4:0/922005942 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72be5dd0 msgr2=0x557b72bc2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72be5dd0 0x557b72bc2970 secure :-1 s=READY pgs=1171 gs=1 cs=0 l=1 c_cookie=8532724990415493320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd2400a230 tx=0x7efd24003f90 comp rx=0 tx=0).stop 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 -- 10.20.193.4:0/922005942 shutdown_connections 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557b72be5950 0x557b72c484f0 crc :-1 s=READY pgs=191 gs=4 cs=0 l=0 c_cookie=7999454993518313012 s_cookie=8042610288591755183 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72be5dd0 0x557b72bc2970 unknown :-1 s=CLOSED pgs=1171 gs=1 cs=0 l=1 c_cookie=8532724990415493320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba1130 0x557b72b9c9a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 --2- 10.20.193.4:0/922005942 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72ba0820 0x557b72b9c460 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efce67fc640 0 client.17832 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 -- 10.20.193.4:0/922005942 >> 10.20.193.4:0/922005942 conn(0x557b72abf6b0 msgr2=0x557b72b83d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 -- 10.20.193.4:0/922005942 shutdown_connections 2026-02-24T09:18:24.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 1 -- 10.20.193.4:0/922005942 wait complete. 2026-02-24T09:18:24.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.434+0000 7efd3116ee00 20 client.17832 trim_cache size 0 max 16384 2026-02-24T09:18:24.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 Processor -- start 2026-02-24T09:18:24.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 -- start start 2026-02-24T09:18:24.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72b86d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72b87270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 0x557b72b99850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557b72aa46e0 con 0x557b72ba1130 2026-02-24T09:18:24.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557b7276ff50 con 0x557b72ba0820 2026-02-24T09:18:24.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557b72b9cfa0 con 0x557b72be5dd0 2026-02-24T09:18:24.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72b87270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72b87270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44402/0 (socket says 10.20.193.4:44402) 2026-02-24T09:18:24.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd1ffff640 1 -- 10.20.193.4:0/150747385 learned_addr learned my addr 10.20.193.4:0/150747385 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd1ffff640 1 -- 10.20.193.4:0/150747385 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 msgr2=0x557b72b99850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd1ffff640 1 --2- 10.20.193.4:0/150747385 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 0x557b72b99850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd2cee9640 1 --2- 10.20.193.4:0/150747385 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72b86d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd1ffff640 1 -- 10.20.193.4:0/150747385 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 msgr2=0x557b72b86d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd1ffff640 1 --2- 10.20.193.4:0/150747385 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72b86d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd1ffff640 1 -- 10.20.193.4:0/150747385 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b72a37160 con 0x557b72ba1130 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd2cee9640 1 --2- 10.20.193.4:0/150747385 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72b86d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd1ffff640 1 --2- 10.20.193.4:0/150747385 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72b87270 secure :-1 s=READY pgs=1172 gs=1 cs=0 l=1 c_cookie=1134583335196805917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd100acce0 tx=0x7efd10002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbed988367bcb1d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efcf4ce3640 1 -- 10.20.193.4:0/150747385 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd1005b110 con 0x557b72ba1130 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efcf4ce3640 1 -- 10.20.193.4:0/150747385 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efd100ac990 con 0x557b72ba1130 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efcf4ce3640 1 -- 10.20.193.4:0/150747385 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd100b7e40 con 0x557b72ba1130 2026-02-24T09:18:24.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 -- 10.20.193.4:0/150747385 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 msgr2=0x557b72b87270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 --2- 10.20.193.4:0/150747385 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72b87270 secure :-1 s=READY pgs=1172 gs=1 cs=0 l=1 c_cookie=1134583335196805917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd100acce0 tx=0x7efd10002390 comp rx=0 tx=0).stop 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 -- 10.20.193.4:0/150747385 shutdown_connections 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 --2- 10.20.193.4:0/150747385 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 0x557b72b99850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 --2- 10.20.193.4:0/150747385 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72b87270 unknown :-1 s=CLOSED pgs=1172 gs=1 cs=0 l=1 c_cookie=1134583335196805917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 --2- 10.20.193.4:0/150747385 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72b86d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 -- 10.20.193.4:0/150747385 >> 10.20.193.4:0/150747385 conn(0x557b72abf6b0 msgr2=0x557b72bc1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.444+0000 7efd3116ee00 1 -- 10.20.193.4:0/150747385 shutdown_connections 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd3116ee00 1 -- 10.20.193.4:0/150747385 wait complete. 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd3116ee00 1 -- start start 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd3116ee00 1 Processor -- start 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72bc3ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72bc3ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd3116ee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 0x557b72bc8950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd3116ee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557b72bc3320 con 0x557b72ba1130 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd3116ee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557b72bc8ef0 con 0x557b72ba0820 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd3116ee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557b72bc90b0 con 0x557b72be5dd0 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72bc3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72bc3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44404/0 (socket says 10.20.193.4:44404) 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd1ffff640 1 -- 10.20.193.4:0/1888393583 learned_addr learned my addr 10.20.193.4:0/1888393583 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd1ffff640 1 -- 10.20.193.4:0/1888393583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 msgr2=0x557b72bc8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd1ffff640 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 0x557b72bc8950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd1ffff640 1 -- 10.20.193.4:0/1888393583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 msgr2=0x557b72bc3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd1ffff640 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72bc3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.445+0000 7efd1ffff640 1 -- 10.20.193.4:0/1888393583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b72a2abf0 con 0x557b72ba1130 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd1ffff640 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72bc3ff0 secure :-1 s=READY pgs=1173 gs=1 cs=0 l=1 c_cookie=11312416713749539454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd100ad120 tx=0x7efd10002c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfdc710be3baa7e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efce67fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efce67fc640 1 -- 10.20.193.4:0/1888393583 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd100ae040 con 0x557b72ba1130 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 1 -- 10.20.193.4:0/1888393583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b72a52310 con 0x557b72ba1130 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efce67fc640 1 -- 10.20.193.4:0/1888393583 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efd100b5490 con 0x557b72ba1130 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efce67fc640 1 -- 10.20.193.4:0/1888393583 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd100725a0 con 0x557b72ba1130 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 10 client.17838 _ll_register_callbacks cb 0x557b72a42160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 1 -- 10.20.193.4:0/1888393583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd100acb70 con 0x557b72ba1130 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efce67fc640 1 -- 10.20.193.4:0/1888393583 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7efd100ab170 con 0x557b72ba1130 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efce67fc640 1 -- 10.20.193.4:0/1888393583 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efd100ab350 con 0x557b72ba1130 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 10 client.17838 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 1 -- 10.20.193.4:0/1888393583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557b72a3c940 con 0x557b72ba1130 2026-02-24T09:18:24.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efce67fc640 1 -- 10.20.193.4:0/1888393583 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7efd100aeb80 con 0x557b72ba1130 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 10 client.17838 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 10 client.17838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 20 client.17838 populate_metadata read hostname 'trial004' 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557b72c08e80 0x557b72c092f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 4 client.17838 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd3116ee00 1 -- 10.20.193.4:0/1888393583 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557b727db160 con 0x557b72c08e80 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.446+0000 7efd2cee9640 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557b72c08e80 0x557b72c092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efce67fc640 10 client.17838 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2cee9640 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557b72c08e80 0x557b72c092f0 crc :-1 s=READY pgs=192 gs=4 cs=0 l=0 c_cookie=1641780750285080120 s_cookie=12720595968248720995 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16c8c6e4d3d10638 server_cookie=b088a2a2f2bb2e63 in_seq=0 out_seq=0 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efce67fc640 1 -- 10.20.193.4:0/1888393583 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x557b727db160 con 0x557b72c08e80 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efce67fc640 10 client.17838 handle_command_reply: tid=0 2026-02-24T09:18:24.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 client.17838 shutdown 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 -- 10.20.193.4:0/1888393583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 msgr2=0x557b72bc3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72bc3ff0 secure :-1 s=READY pgs=1173 gs=1 cs=0 l=1 c_cookie=11312416713749539454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd100ad120 tx=0x7efd10002c20 comp rx=0 tx=0).stop 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 -- 10.20.193.4:0/1888393583 shutdown_connections 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557b72c08e80 0x557b72c092f0 crc :-1 s=READY pgs=192 gs=4 cs=0 l=0 c_cookie=1641780750285080120 s_cookie=12720595968248720995 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557b72be5dd0 0x557b72bc8950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efce67fc640 0 client.17838 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557b72ba1130 0x557b72bc3ff0 unknown :-1 s=CLOSED pgs=1173 gs=1 cs=0 l=1 c_cookie=11312416713749539454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 --2- 10.20.193.4:0/1888393583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557b72ba0820 0x557b72bc3ab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 -- 10.20.193.4:0/1888393583 >> 10.20.193.4:0/1888393583 conn(0x557b72abf6b0 msgr2=0x557b72b9f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 -- 10.20.193.4:0/1888393583 shutdown_connections 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 1 -- 10.20.193.4:0/1888393583 wait complete. 2026-02-24T09:18:24.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd3116ee00 20 client.17838 trim_cache size 0 max 16384 2026-02-24T09:18:24.461 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:18:24.461 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:18:24.461 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:18:24.461 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:18:24.461 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.461 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "1e753e7d-de39-4483-82a7-d40f8a0cf87e", 2026-02-24T09:18:24.461 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.462 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.463 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.464 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.465 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:18:24.466 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:18:24.467 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.468 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.469 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.470 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:24.471 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2f174640 1 -- 10.20.193.4:0/3096340166 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efd040b56e0 msgr2=0x7efd040d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2f174640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efd040b56e0 0x7efd040d5b90 secure :-1 s=READY pgs=426 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd18005970 tx=0x7efd18005900 comp rx=0 tx=0).stop 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2f174640 1 -- 10.20.193.4:0/3096340166 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efd2810ddc0 msgr2=0x7efd2811c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2f174640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efd2810ddc0 0x7efd2811c1b0 secure :-1 s=READY pgs=1169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1000d950 tx=0x7efd1000de20 comp rx=0 tx=0).stop 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2f174640 1 -- 10.20.193.4:0/3096340166 shutdown_connections 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2f174640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efd040b56e0 0x7efd040d5b90 unknown :-1 s=CLOSED pgs=426 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2f174640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd281135c0 0x7efd28121580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2f174640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efd2810ddc0 0x7efd2811c1b0 unknown :-1 s=CLOSED pgs=1169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2f174640 1 --2- 10.20.193.4:0/3096340166 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efd2810d3d0 0x7efd2811bc70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:24.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.447+0000 7efd2f174640 1 -- 10.20.193.4:0/3096340166 >> 10.20.193.4:0/3096340166 conn(0x7efd280eaca0 msgr2=0x7efd2810b080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:24.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.448+0000 7efd2f174640 1 -- 10.20.193.4:0/3096340166 shutdown_connections 2026-02-24T09:18:24.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:24.448+0000 7efd2f174640 1 -- 10.20.193.4:0/3096340166 wait complete. 2026-02-24T09:18:24.487 INFO:tasks.cephfs.filesystem:scrub status for tag:1e753e7d-de39-4483-82a7-d40f8a0cf87e - {'path': '/', 'tag': '1e753e7d-de39-4483-82a7-d40f8a0cf87e', 'options': 'recursive,force'} 2026-02-24T09:18:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:24 trial004 ceph-mon[41596]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2026-02-24T09:18:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:24 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:18:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:24 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:24 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:18:25.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:24 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:24 trial090 ceph-mon[47278]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2026-02-24T09:18:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:24 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:18:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:24 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:24 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:18:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:24 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:25.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:24 trial014 ceph-mon[46941]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2026-02-24T09:18:25.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:24 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:18:25.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:24 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:25.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:24 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:18:25.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:24 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:27.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:26 trial004 ceph-mon[41596]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2026-02-24T09:18:27.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:26 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:18:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:26 trial090 ceph-mon[47278]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2026-02-24T09:18:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:26 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:18:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:26 trial014 ceph-mon[46941]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2026-02-24T09:18:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:26 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:18:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:18:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:18:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:18:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:18:28.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:18:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:18:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:18:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:18:28.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:18:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:18:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:18:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:18:29.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:28 trial004 ceph-mon[41596]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 2.3 MiB/s wr, 21 op/s 2026-02-24T09:18:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:28 trial090 ceph-mon[47278]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 2.3 MiB/s wr, 21 op/s 2026-02-24T09:18:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:28 trial014 ceph-mon[46941]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 2.3 MiB/s wr, 21 op/s 2026-02-24T09:18:29.455 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:18:29.575 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:29.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.669+0000 7fa9acbc0640 1 -- 10.20.193.4:0/654310054 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa9a810f280 msgr2=0x7fa9a810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:29.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.669+0000 7fa9acbc0640 1 --2- 10.20.193.4:0/654310054 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa9a810f280 0x7fa9a810f650 secure :-1 s=READY pgs=1174 gs=1 cs=0 l=1 c_cookie=14886086812218816193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa99c009950 tx=0x7fa99c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.669+0000 7fa9acbc0640 1 -- 10.20.193.4:0/654310054 shutdown_connections 2026-02-24T09:18:29.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.669+0000 7fa9acbc0640 1 --2- 10.20.193.4:0/654310054 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa9a8115470 0x7fa9a8175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.669+0000 7fa9acbc0640 1 --2- 10.20.193.4:0/654310054 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa9a810fc70 0x7fa9a8114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.669+0000 7fa9acbc0640 1 --2- 10.20.193.4:0/654310054 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa9a810f280 0x7fa9a810f650 unknown :-1 s=CLOSED pgs=1174 gs=1 cs=0 l=1 c_cookie=14886086812218816193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.669+0000 7fa9acbc0640 1 -- 10.20.193.4:0/654310054 >> 10.20.193.4:0/654310054 conn(0x7fa9a805f830 msgr2=0x7fa9a810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.669+0000 7fa9acbc0640 1 -- 10.20.193.4:0/654310054 shutdown_connections 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.669+0000 7fa9acbc0640 1 -- 10.20.193.4:0/654310054 wait complete. 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9acbc0640 1 Processor -- start 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9acbc0640 1 -- start start 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9acbc0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa9a810f280 0x7fa9a811db30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9acbc0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa9a810fc70 0x7fa9a811e070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9acbc0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa9a8115470 0x7fa9a8123440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9acbc0640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81239d0 con 0x7fa9a810f280 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9acbc0640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8123b40 con 0x7fa9a8115470 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9acbc0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8123d00 con 0x7fa9a810fc70 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a6575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa9a810f280 0x7fa9a811db30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a6575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa9a810f280 0x7fa9a811db30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44428/0 (socket says 10.20.193.4:44428) 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a6575640 1 -- 10.20.193.4:0/1266253174 learned_addr learned my addr 10.20.193.4:0/1266253174 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:29.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a5d74640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa9a810fc70 0x7fa9a811e070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a6d76640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa9a8115470 0x7fa9a8123440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a6575640 1 -- 10.20.193.4:0/1266253174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa9a810fc70 msgr2=0x7fa9a811e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a6575640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa9a810fc70 0x7fa9a811e070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a6575640 1 -- 10.20.193.4:0/1266253174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa9a8115470 msgr2=0x7fa9a8123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a6575640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa9a8115470 0x7fa9a8123440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a6575640 1 -- 10.20.193.4:0/1266253174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99c009570 con 0x7fa9a810f280 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9a6575640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa9a810f280 0x7fa9a811db30 secure :-1 s=READY pgs=1175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa99c0023d0 tx=0x7fa99c0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa98f7fe640 1 -- 10.20.193.4:0/1266253174 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa99c03d070 con 0x7fa9a810f280 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa98f7fe640 1 -- 10.20.193.4:0/1266253174 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa99c038920 con 0x7fa9a810f280 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9acbc0640 1 -- 10.20.193.4:0/1266253174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a8123f80 con 0x7fa9a810f280 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa98f7fe640 1 -- 10.20.193.4:0/1266253174 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa99c0419d0 con 0x7fa9a810f280 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.670+0000 7fa9acbc0640 1 -- 10.20.193.4:0/1266253174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a81645d0 con 0x7fa9a810f280 2026-02-24T09:18:29.677 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.671+0000 7fa9acbc0640 1 -- 10.20.193.4:0/1266253174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a8110560 con 0x7fa9a810f280 2026-02-24T09:18:29.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.672+0000 7fa98f7fe640 1 -- 10.20.193.4:0/1266253174 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fa99c038a90 con 0x7fa9a810f280 2026-02-24T09:18:29.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.673+0000 7fa98f7fe640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9800b56e0 0x7fa9800d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:29.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.673+0000 7fa9a5d74640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9800b56e0 0x7fa9800d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:29.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.673+0000 7fa98f7fe640 1 -- 10.20.193.4:0/1266253174 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fa99c10b950 con 0x7fa9a810f280 2026-02-24T09:18:29.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.673+0000 7fa9a5d74640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9800b56e0 0x7fa9800d5b90 secure :-1 s=READY pgs=427 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a81244d0 tx=0x7fa990005f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:29.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.674+0000 7fa98f7fe640 1 -- 10.20.193.4:0/1266253174 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fa99c0ce3a0 con 0x7fa9a810f280 2026-02-24T09:18:29.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.806+0000 7fa9acbc0640 1 -- 10.20.193.4:0/1266253174 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9a810f650 con 0x7fa9a810f280 2026-02-24T09:18:29.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.807+0000 7fa98f7fe640 1 -- 10.20.193.4:0/1266253174 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fa99c0d14c0 con 0x7fa9a810f280 2026-02-24T09:18:29.811 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:18:29.811 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:18:29.812 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 -- 10.20.193.4:0/1266253174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9800b56e0 msgr2=0x7fa9800d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9800b56e0 0x7fa9800d5b90 secure :-1 s=READY pgs=427 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9a81244d0 tx=0x7fa990005f70 comp rx=0 tx=0).stop 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 -- 10.20.193.4:0/1266253174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa9a810f280 msgr2=0x7fa9a811db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa9a810f280 0x7fa9a811db30 secure :-1 s=READY pgs=1175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa99c0023d0 tx=0x7fa99c0043d0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 -- 10.20.193.4:0/1266253174 shutdown_connections 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fa9800b56e0 0x7fa9800d5b90 unknown :-1 s=CLOSED pgs=427 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fa9a8115470 0x7fa9a8123440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa9a810fc70 0x7fa9a811e070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 --2- 10.20.193.4:0/1266253174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fa9a810f280 0x7fa9a811db30 unknown :-1 s=CLOSED pgs=1175 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 -- 10.20.193.4:0/1266253174 >> 10.20.193.4:0/1266253174 conn(0x7fa9a805f830 msgr2=0x7fa9a810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:29.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 -- 10.20.193.4:0/1266253174 shutdown_connections 2026-02-24T09:18:29.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:29.808+0000 7fa9acbc0640 1 -- 10.20.193.4:0/1266253174 wait complete. 2026-02-24T09:18:29.849 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id af9a5827 --release --await' 2026-02-24T09:18:29.849 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id af9a5827 --release --await 2026-02-24T09:18:29.964 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:30.072 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.068+0000 7fbe55b2b640 1 -- 10.20.193.4:0/4029173506 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbe50115470 msgr2=0x7fbe50175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:30.072 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.068+0000 7fbe55b2b640 1 --2- 10.20.193.4:0/4029173506 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbe50115470 0x7fbe50175e40 secure :-1 s=READY pgs=1176 gs=1 cs=0 l=1 c_cookie=11939955145045259127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4400aa30 tx=0x7fbe44030280 comp rx=0 tx=0).stop 2026-02-24T09:18:30.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.068+0000 7fbe55b2b640 1 -- 10.20.193.4:0/4029173506 shutdown_connections 2026-02-24T09:18:30.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.068+0000 7fbe55b2b640 1 --2- 10.20.193.4:0/4029173506 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbe50115470 0x7fbe50175e40 unknown :-1 s=CLOSED pgs=1176 gs=1 cs=0 l=1 c_cookie=11939955145045259127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.068+0000 7fbe55b2b640 1 --2- 10.20.193.4:0/4029173506 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbe5010fc70 0x7fbe50114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.068+0000 7fbe55b2b640 1 --2- 10.20.193.4:0/4029173506 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbe5010f280 0x7fbe5010f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.068+0000 7fbe55b2b640 1 -- 10.20.193.4:0/4029173506 >> 10.20.193.4:0/4029173506 conn(0x7fbe5005f830 msgr2=0x7fbe5010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:30.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.068+0000 7fbe55b2b640 1 -- 10.20.193.4:0/4029173506 shutdown_connections 2026-02-24T09:18:30.073 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.068+0000 7fbe55b2b640 1 -- 10.20.193.4:0/4029173506 wait complete. 2026-02-24T09:18:30.073 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:29 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1266253174' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:30.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe55b2b640 1 Processor -- start 2026-02-24T09:18:30.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe55b2b640 1 -- start start 2026-02-24T09:18:30.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe55b2b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbe5010f280 0x7fbe50066fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe55b2b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbe5010fc70 0x7fbe50063220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe55b2b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbe50115470 0x7fbe500638d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe55b2b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbe50064060 con 0x7fbe5010f280 2026-02-24T09:18:30.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe55b2b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbe50168310 con 0x7fbe5010fc70 2026-02-24T09:18:30.075 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe55b2b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbe501684d0 con 0x7fbe50115470 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbe5010f280 0x7fbe50066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbe5010f280 0x7fbe50066fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44440/0 (socket says 10.20.193.4:44440) 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4f7fe640 1 -- 10.20.193.4:0/2838218398 learned_addr learned my addr 10.20.193.4:0/2838218398 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4effd640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbe5010fc70 0x7fbe50063220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4ffff640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbe50115470 0x7fbe500638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4f7fe640 1 -- 10.20.193.4:0/2838218398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbe50115470 msgr2=0x7fbe500638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbe50115470 0x7fbe500638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4f7fe640 1 -- 10.20.193.4:0/2838218398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbe5010fc70 msgr2=0x7fbe50063220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbe5010fc70 0x7fbe50063220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4f7fe640 1 -- 10.20.193.4:0/2838218398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4400a650 con 0x7fbe5010f280 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4ffff640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbe50115470 0x7fbe500638d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:30.076 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbe5010f280 0x7fbe50066fb0 secure :-1 s=READY pgs=1177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe3c00d950 tx=0x7fbe3c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:30.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4cff9640 1 -- 10.20.193.4:0/2838218398 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe3c004540 con 0x7fbe5010f280 2026-02-24T09:18:30.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe55b2b640 1 -- 10.20.193.4:0/2838218398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe50168750 con 0x7fbe5010f280 2026-02-24T09:18:30.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4cff9640 1 -- 10.20.193.4:0/2838218398 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbe3c009d00 con 0x7fbe5010f280 2026-02-24T09:18:30.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe4cff9640 1 -- 10.20.193.4:0/2838218398 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe3c0106e0 con 0x7fbe5010f280 2026-02-24T09:18:30.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.069+0000 7fbe55b2b640 1 -- 10.20.193.4:0/2838218398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe50168c70 con 0x7fbe5010f280 2026-02-24T09:18:30.077 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.071+0000 7fbe4cff9640 1 -- 10.20.193.4:0/2838218398 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fbe3c0027c0 con 0x7fbe5010f280 2026-02-24T09:18:30.082 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.072+0000 7fbe4cff9640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbe240b56e0 0x7fbe240d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.072+0000 7fbe4effd640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbe240b56e0 0x7fbe240d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.072+0000 7fbe4cff9640 1 -- 10.20.193.4:0/2838218398 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fbe3c0e6e60 con 0x7fbe5010f280 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.072+0000 7fbe4effd640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbe240b56e0 0x7fbe240d5b90 secure :-1 s=READY pgs=428 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe40005970 tx=0x7fbe40005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe57b25e00 1 Processor -- start 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe57b25e00 1 -- start start 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c124fb0 0x55f33c125380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c16a020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c16a560 0x55f33c18a940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f33c036050 con 0x55f33c1258c0 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f33c031d80 con 0x55f33c16a560 2026-02-24T09:18:30.083 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f33c02bee0 con 0x55f33c124fb0 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe4effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c16a020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe4effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c16a020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44442/0 (socket says 10.20.193.4:44442) 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe4effd640 1 -- 10.20.193.4:0/2184059795 learned_addr learned my addr 10.20.193.4:0/2184059795 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe4ffff640 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c16a560 0x55f33c18a940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.073+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c124fb0 0x55f33c125380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe4effd640 1 -- 10.20.193.4:0/2184059795 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c124fb0 msgr2=0x55f33c125380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe4effd640 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c124fb0 0x55f33c125380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe4effd640 1 -- 10.20.193.4:0/2184059795 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c16a560 msgr2=0x55f33c18a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe4effd640 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c16a560 0x55f33c18a940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe4effd640 1 -- 10.20.193.4:0/2184059795 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33bfd7540 con 0x55f33c1258c0 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe4ffff640 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c16a560 0x55f33c18a940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:30.084 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c124fb0 0x55f33c125380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe4effd640 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c16a020 secure :-1 s=READY pgs=1178 gs=1 cs=0 l=1 c_cookie=8070479400559761040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4000ee50 tx=0x7fbe40011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70001a416d78d690 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe13fff640 1 -- 10.20.193.4:0/2184059795 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe4001c630 con 0x55f33c1258c0 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe13fff640 1 -- 10.20.193.4:0/2184059795 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbe40010e50 con 0x55f33c1258c0 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe13fff640 1 -- 10.20.193.4:0/2184059795 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe4001bcd0 con 0x55f33c1258c0 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2184059795 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 msgr2=0x55f33c16a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c16a020 secure :-1 s=READY pgs=1178 gs=1 cs=0 l=1 c_cookie=8070479400559761040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4000ee50 tx=0x7fbe40011000 comp rx=0 tx=0).stop 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2184059795 shutdown_connections 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c16a560 0x55f33c18a940 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c16a020 unknown :-1 s=CLOSED pgs=1178 gs=1 cs=0 l=1 c_cookie=8070479400559761040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/2184059795 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c124fb0 0x55f33c125380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2184059795 >> 10.20.193.4:0/2184059795 conn(0x55f33c1034b0 msgr2=0x55f33c123890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:30.085 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2184059795 shutdown_connections 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.074+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2184059795 wait complete. 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe57b25e00 1 -- start start 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe57b25e00 1 Processor -- start 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c124fb0 0x55f33c182080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c1258c0 0x55f33c1825c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c16a560 0x55f33c1875b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f33c187af0 con 0x55f33c124fb0 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f33c187c60 con 0x55f33c1258c0 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f33c187e20 con 0x55f33c16a560 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe4f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c124fb0 0x55f33c182080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe4f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c124fb0 0x55f33c182080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44452/0 (socket says 10.20.193.4:44452) 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe4f7fe640 1 -- 10.20.193.4:0/1860574076 learned_addr learned my addr 10.20.193.4:0/1860574076 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:30.086 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe4ffff640 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c16a560 0x55f33c1875b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe4f7fe640 1 -- 10.20.193.4:0/1860574076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c16a560 msgr2=0x55f33c1875b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c16a560 0x55f33c1875b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe4f7fe640 1 -- 10.20.193.4:0/1860574076 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c1258c0 msgr2=0x55f33c1825c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c1258c0 0x55f33c1825c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe4f7fe640 1 -- 10.20.193.4:0/1860574076 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33bfafbd0 con 0x55f33c124fb0 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c124fb0 0x55f33c182080 secure :-1 s=READY pgs=1179 gs=1 cs=0 l=1 c_cookie=12115305742579963899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe3c009610 tx=0x7fbe3c0a9140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82236621bba97fb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe117fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe117fa640 1 -- 10.20.193.4:0/1860574076 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe3c0adbd0 con 0x55f33c124fb0 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe117fa640 1 -- 10.20.193.4:0/1860574076 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbe3c0d0e90 con 0x55f33c124fb0 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe117fa640 1 -- 10.20.193.4:0/1860574076 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe3c0b8100 con 0x55f33c124fb0 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.075+0000 7fbe57b25e00 1 -- 10.20.193.4:0/1860574076 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4000eaf0 con 0x55f33c124fb0 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe117fa640 1 -- 10.20.193.4:0/1860574076 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fbe3c072360 con 0x55f33c124fb0 2026-02-24T09:18:30.087 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe117fa640 10 client.17856 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe57b25e00 10 client.17856 _ll_register_callbacks cb 0x55f33c01a290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe57b25e00 1 -- 10.20.193.4:0/1860574076 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f33bd7b700 con 0x55f33c124fb0 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe117fa640 1 -- 10.20.193.4:0/1860574076 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbe3c0ae100 con 0x55f33c124fb0 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe57b25e00 10 client.17856 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe57b25e00 1 -- 10.20.193.4:0/1860574076 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f33bfc1910 con 0x55f33c124fb0 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe117fa640 1 -- 10.20.193.4:0/1860574076 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fbe3c0ab1b0 con 0x55f33c124fb0 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe57b25e00 10 client.17856 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe57b25e00 10 client.17856 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe57b25e00 20 client.17856 populate_metadata read hostname 'trial004' 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f33c18a670 0x55f33c1682c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe57b25e00 4 client.17856 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:30.088 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe57b25e00 1 -- 10.20.193.4:0/1860574076 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f33c021920 con 0x55f33c18a670 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.076+0000 7fbe4effd640 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f33c18a670 0x55f33c1682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe117fa640 10 client.17856 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe4effd640 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f33c18a670 0x55f33c1682c0 crc :-1 s=READY pgs=193 gs=4 cs=0 l=0 c_cookie=5008989143717568578 s_cookie=11231660002159542550 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=458381166312e042 server_cookie=9bdedf439aaec116 in_seq=0 out_seq=0 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe117fa640 1 -- 10.20.193.4:0/1860574076 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f33c021920 con 0x55f33c18a670 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe117fa640 10 client.17856 handle_command_reply: tid=0 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 client.17856 shutdown 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 -- 10.20.193.4:0/1860574076 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c124fb0 msgr2=0x55f33c182080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c124fb0 0x55f33c182080 secure :-1 s=READY pgs=1179 gs=1 cs=0 l=1 c_cookie=12115305742579963899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe3c009610 tx=0x7fbe3c0a9140 comp rx=0 tx=0).stop 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 -- 10.20.193.4:0/1860574076 shutdown_connections 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f33c18a670 0x55f33c1682c0 crc :-1 s=READY pgs=193 gs=4 cs=0 l=0 c_cookie=5008989143717568578 s_cookie=11231660002159542550 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c16a560 0x55f33c1875b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c1258c0 0x55f33c1825c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.089 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/1860574076 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c124fb0 0x55f33c182080 unknown :-1 s=CLOSED pgs=1179 gs=1 cs=0 l=1 c_cookie=12115305742579963899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe117fa640 0 client.17856 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:30.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 -- 10.20.193.4:0/1860574076 >> 10.20.193.4:0/1860574076 conn(0x55f33c1034b0 msgr2=0x55f33c123890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:30.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 -- 10.20.193.4:0/1860574076 shutdown_connections 2026-02-24T09:18:30.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 1 -- 10.20.193.4:0/1860574076 wait complete. 2026-02-24T09:18:30.090 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.077+0000 7fbe57b25e00 20 client.17856 trim_cache size 0 max 16384 2026-02-24T09:18:30.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe57b25e00 1 Processor -- start 2026-02-24T09:18:30.094 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe57b25e00 1 -- start start 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c124fb0 0x55f33c17fc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c1258c0 0x55f33c1814a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c16a560 0x55f33c1819e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f33c029b10 con 0x55f33c16a560 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f33bcf51b0 con 0x55f33c124fb0 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f33c17ae00 con 0x55f33c1258c0 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c16a560 0x55f33c1819e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c16a560 0x55f33c1819e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44464/0 (socket says 10.20.193.4:44464) 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4ffff640 1 -- 10.20.193.4:0/3977242152 learned_addr learned my addr 10.20.193.4:0/3977242152 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4effd640 1 --2- 10.20.193.4:0/3977242152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c1258c0 0x55f33c1814a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/3977242152 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c124fb0 0x55f33c17fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.095 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4ffff640 1 -- 10.20.193.4:0/3977242152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c1258c0 msgr2=0x55f33c1814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4ffff640 1 --2- 10.20.193.4:0/3977242152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c1258c0 0x55f33c1814a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4ffff640 1 -- 10.20.193.4:0/3977242152 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c124fb0 msgr2=0x55f33c17fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4ffff640 1 --2- 10.20.193.4:0/3977242152 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c124fb0 0x55f33c17fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4ffff640 1 -- 10.20.193.4:0/3977242152 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33bfbc390 con 0x55f33c16a560 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe4ffff640 1 --2- 10.20.193.4:0/3977242152 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c16a560 0x55f33c1819e0 secure :-1 s=READY pgs=1180 gs=1 cs=0 l=1 c_cookie=14471345377654139414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4400aa30 tx=0x7fbe440069e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d48bf2d110ea16 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe137fe640 1 -- 10.20.193.4:0/3977242152 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe44030ae0 con 0x55f33c16a560 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe137fe640 1 -- 10.20.193.4:0/3977242152 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbe44041040 con 0x55f33c16a560 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.086+0000 7fbe137fe640 1 -- 10.20.193.4:0/3977242152 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe440050c0 con 0x55f33c16a560 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 -- 10.20.193.4:0/3977242152 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c16a560 msgr2=0x55f33c1819e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/3977242152 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c16a560 0x55f33c1819e0 secure :-1 s=READY pgs=1180 gs=1 cs=0 l=1 c_cookie=14471345377654139414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4400aa30 tx=0x7fbe440069e0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 -- 10.20.193.4:0/3977242152 shutdown_connections 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/3977242152 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c16a560 0x55f33c1819e0 unknown :-1 s=CLOSED pgs=1180 gs=1 cs=0 l=1 c_cookie=14471345377654139414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.096 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/3977242152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c1258c0 0x55f33c1814a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/3977242152 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c124fb0 0x55f33c17fc80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 -- 10.20.193.4:0/3977242152 >> 10.20.193.4:0/3977242152 conn(0x55f33c1034b0 msgr2=0x55f33c186c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 -- 10.20.193.4:0/3977242152 shutdown_connections 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 -- 10.20.193.4:0/3977242152 wait complete. 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 -- start start 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 Processor -- start 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c124fb0 0x55f33c105580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c105ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c16a560 0x55f33c1b0530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f33c106240 con 0x55f33c1258c0 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f33c1b0a70 con 0x55f33c124fb0 2026-02-24T09:18:30.097 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe57b25e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f33c1b0c00 con 0x55f33c16a560 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe4effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c105ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe4effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c105ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:44468/0 (socket says 10.20.193.4:44468) 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe4effd640 1 -- 10.20.193.4:0/2953965740 learned_addr learned my addr 10.20.193.4:0/2953965740 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe4effd640 1 -- 10.20.193.4:0/2953965740 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c16a560 msgr2=0x55f33c1b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe4effd640 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c16a560 0x55f33c1b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe4effd640 1 -- 10.20.193.4:0/2953965740 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c124fb0 msgr2=0x55f33c105580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe4effd640 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c124fb0 0x55f33c105580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.087+0000 7fbe4effd640 1 -- 10.20.193.4:0/2953965740 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33bfaff00 con 0x55f33c1258c0 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe4effd640 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c105ac0 secure :-1 s=READY pgs=1181 gs=1 cs=0 l=1 c_cookie=32589489764021800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4001b890 tx=0x7fbe4001b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c7f7e0cbb628 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe117fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe117fa640 1 -- 10.20.193.4:0/2953965740 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe4001bdd0 con 0x55f33c1258c0 2026-02-24T09:18:30.098 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe117fa640 1 -- 10.20.193.4:0/2953965740 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbe40005520 con 0x55f33c1258c0 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe117fa640 1 -- 10.20.193.4:0/2953965740 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe40004d10 con 0x55f33c1258c0 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2953965740 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe501766b0 con 0x55f33c1258c0 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe117fa640 1 -- 10.20.193.4:0/2953965740 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fbe40033510 con 0x55f33c1258c0 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe117fa640 10 client.17862 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 10 client.17862 _ll_register_callbacks cb 0x55f33c01a290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2953965740 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f33bcb73f0 con 0x55f33c1258c0 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe117fa640 1 -- 10.20.193.4:0/2953965740 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbe40004ea0 con 0x55f33c1258c0 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 10 client.17862 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2953965740 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f33bfc1b70 con 0x55f33c1258c0 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe117fa640 1 -- 10.20.193.4:0/2953965740 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fbe40043070 con 0x55f33c1258c0 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 10 client.17862 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 10 client.17862 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:18:30.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 20 client.17862 populate_metadata read hostname 'trial004' 2026-02-24T09:18:30.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f33c218f40 0x55f33c2393c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:30.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 4 client.17862 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "af9a5827", "release": true, "await": true}] 2026-02-24T09:18:30.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2953965740 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "af9a5827", "release": true, "await": true}) -- 0x7fbe40010e50 con 0x55f33c218f40 2026-02-24T09:18:30.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.088+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f33c218f40 0x55f33c2393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:30.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.089+0000 7fbe4f7fe640 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f33c218f40 0x55f33c2393c0 crc :-1 s=READY pgs=194 gs=4 cs=0 l=0 c_cookie=8168409132103343566 s_cookie=18433972323722420491 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=715c04d3db139dce server_cookie=ffd2a0293adb610b in_seq=0 out_seq=0 2026-02-24T09:18:30.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.089+0000 7fbe117fa640 10 client.17862 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:30.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe117fa640 1 -- 10.20.193.4:0/2953965740 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fbe40010e50 con 0x55f33c218f40 2026-02-24T09:18:30.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe117fa640 10 client.17862 handle_command_reply: tid=0 2026-02-24T09:18:30.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 client.17862 shutdown 2026-02-24T09:18:30.101 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2953965740 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 msgr2=0x55f33c105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c105ac0 secure :-1 s=READY pgs=1181 gs=1 cs=0 l=1 c_cookie=32589489764021800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4001b890 tx=0x7fbe4001b500 comp rx=0 tx=0).stop 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2953965740 shutdown_connections 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f33c218f40 0x55f33c2393c0 crc :-1 s=READY pgs=194 gs=4 cs=0 l=0 c_cookie=8168409132103343566 s_cookie=18433972323722420491 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f33c16a560 0x55f33c1b0530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f33c1258c0 0x55f33c105ac0 unknown :-1 s=CLOSED pgs=1181 gs=1 cs=0 l=1 c_cookie=32589489764021800 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 --2- 10.20.193.4:0/2953965740 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f33c124fb0 0x55f33c105580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe117fa640 0 client.17862 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2953965740 >> 10.20.193.4:0/2953965740 conn(0x55f33c1034b0 msgr2=0x55f33c1852e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2953965740 shutdown_connections 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.091+0000 7fbe57b25e00 1 -- 10.20.193.4:0/2953965740 wait complete. 2026-02-24T09:18:30.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe57b25e00 20 client.17862 trim_cache size 0 max 16384 2026-02-24T09:18:30.103 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:18:30.103 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:18:30.103 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:18:30.103 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 36, 2026-02-24T09:18:30.103 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:18:30.103 INFO:teuthology.orchestra.run.trial004.stdout: "af9a5827": { 2026-02-24T09:18:30.103 INFO:teuthology.orchestra.run.trial004.stdout: "version": 36, 2026-02-24T09:18:30.103 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:18:30.103 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 142.8, 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:18:30.104 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:30.105 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:30.105 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:30.105 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:30.105 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:30.105 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:18:30.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 -- 10.20.193.4:0/2838218398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbe240b56e0 msgr2=0x7fbe240d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:30.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbe240b56e0 0x7fbe240d5b90 secure :-1 s=READY pgs=428 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe40005970 tx=0x7fbe40005900 comp rx=0 tx=0).stop 2026-02-24T09:18:30.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 -- 10.20.193.4:0/2838218398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbe5010f280 msgr2=0x7fbe50066fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:30.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbe5010f280 0x7fbe50066fb0 secure :-1 s=READY pgs=1177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe3c00d950 tx=0x7fbe3c00de20 comp rx=0 tx=0).stop 2026-02-24T09:18:30.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 -- 10.20.193.4:0/2838218398 shutdown_connections 2026-02-24T09:18:30.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbe240b56e0 0x7fbe240d5b90 unknown :-1 s=CLOSED pgs=428 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.106 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbe50115470 0x7fbe500638d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbe5010fc70 0x7fbe50063220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 --2- 10.20.193.4:0/2838218398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbe5010f280 0x7fbe50066fb0 unknown :-1 s=CLOSED pgs=1177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:30.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 -- 10.20.193.4:0/2838218398 >> 10.20.193.4:0/2838218398 conn(0x7fbe5005f830 msgr2=0x7fbe5010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:30.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 -- 10.20.193.4:0/2838218398 shutdown_connections 2026-02-24T09:18:30.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:30.092+0000 7fbe55b2b640 1 -- 10.20.193.4:0/2838218398 wait complete. 2026-02-24T09:18:30.166 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'af9a5827', total seconds elapsed: 23.5 2026-02-24T09:18:30.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:29 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1266253174' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:30.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:29 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1266253174' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:31.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:30 trial004 ceph-mon[41596]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 7.0 MiB/s wr, 49 op/s 2026-02-24T09:18:31.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:30 trial090 ceph-mon[47278]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 7.0 MiB/s wr, 49 op/s 2026-02-24T09:18:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:30 trial014 ceph-mon[46941]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 7.0 MiB/s wr, 49 op/s 2026-02-24T09:18:33.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:32 trial004 ceph-mon[41596]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 17 MiB/s wr, 110 op/s 2026-02-24T09:18:33.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:32 trial090 ceph-mon[47278]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 17 MiB/s wr, 110 op/s 2026-02-24T09:18:33.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:32 trial014 ceph-mon[46941]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 7.3 KiB/s rd, 17 MiB/s wr, 110 op/s 2026-02-24T09:18:34.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:33 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:18:34.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:33 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:18:34.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:33 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:18:35.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:34 trial004 ceph-mon[41596]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 21 MiB/s wr, 121 op/s 2026-02-24T09:18:35.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:34 trial090 ceph-mon[47278]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 21 MiB/s wr, 121 op/s 2026-02-24T09:18:35.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:34 trial014 ceph-mon[46941]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 21 MiB/s wr, 121 op/s 2026-02-24T09:18:37.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:36 trial004 ceph-mon[41596]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 25 MiB/s wr, 124 op/s 2026-02-24T09:18:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:36 trial090 ceph-mon[47278]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 25 MiB/s wr, 124 op/s 2026-02-24T09:18:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:36 trial014 ceph-mon[46941]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 25 MiB/s wr, 124 op/s 2026-02-24T09:18:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:38 trial004 ceph-mon[41596]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 35 MiB/s wr, 130 op/s 2026-02-24T09:18:39.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:38 trial090 ceph-mon[47278]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 35 MiB/s wr, 130 op/s 2026-02-24T09:18:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:38 trial014 ceph-mon[46941]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 35 MiB/s wr, 130 op/s 2026-02-24T09:18:41.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:40 trial004 ceph-mon[41596]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 42 MiB/s wr, 117 op/s 2026-02-24T09:18:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:40 trial090 ceph-mon[47278]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 42 MiB/s wr, 117 op/s 2026-02-24T09:18:41.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:40 trial014 ceph-mon[46941]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 42 MiB/s wr, 117 op/s 2026-02-24T09:18:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:42 trial004 ceph-mon[41596]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 143 MiB/s wr, 115 op/s 2026-02-24T09:18:43.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:42 trial090 ceph-mon[47278]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 143 MiB/s wr, 115 op/s 2026-02-24T09:18:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:42 trial014 ceph-mon[46941]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 9.5 KiB/s rd, 143 MiB/s wr, 115 op/s 2026-02-24T09:18:44.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:44 trial090 ceph-mon[47278]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 205 MiB/s wr, 73 op/s 2026-02-24T09:18:44.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:44 trial014 ceph-mon[46941]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 205 MiB/s wr, 73 op/s 2026-02-24T09:18:44.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:44 trial004 ceph-mon[41596]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 205 MiB/s wr, 73 op/s 2026-02-24T09:18:47.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:46 trial004 ceph-mon[41596]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 226 MiB/s wr, 67 op/s 2026-02-24T09:18:47.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:46 trial090 ceph-mon[47278]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 226 MiB/s wr, 67 op/s 2026-02-24T09:18:47.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:46 trial014 ceph-mon[46941]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 226 MiB/s wr, 67 op/s 2026-02-24T09:18:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:48 trial004 ceph-mon[41596]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 275 MiB/s wr, 80 op/s 2026-02-24T09:18:49.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:48 trial090 ceph-mon[47278]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 275 MiB/s wr, 80 op/s 2026-02-24T09:18:49.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:48 trial014 ceph-mon[46941]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 275 MiB/s wr, 80 op/s 2026-02-24T09:18:51.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:50 trial004 ceph-mon[41596]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 358 MiB/s wr, 96 op/s 2026-02-24T09:18:51.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:50 trial090 ceph-mon[47278]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 358 MiB/s wr, 96 op/s 2026-02-24T09:18:51.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:50 trial014 ceph-mon[46941]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 358 MiB/s wr, 96 op/s 2026-02-24T09:18:53.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:52 trial004 ceph-mon[41596]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 622 MiB/s wr, 164 op/s 2026-02-24T09:18:53.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:52 trial090 ceph-mon[47278]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 622 MiB/s wr, 164 op/s 2026-02-24T09:18:53.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:52 trial014 ceph-mon[46941]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 622 MiB/s wr, 164 op/s 2026-02-24T09:18:54.487 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:18:54.646 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:54.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.800+0000 7fd4bc52a640 1 -- 10.20.193.4:0/1918279886 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4b41135c0 msgr2=0x7fd4b4173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:54.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.800+0000 7fd4bc52a640 1 --2- 10.20.193.4:0/1918279886 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4b41135c0 0x7fd4b4173f90 secure :-1 s=READY pgs=1182 gs=1 cs=0 l=1 c_cookie=4037663775168873191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b000aa30 tx=0x7fd4b0030280 comp rx=0 tx=0).stop 2026-02-24T09:18:54.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.800+0000 7fd4bc52a640 1 -- 10.20.193.4:0/1918279886 shutdown_connections 2026-02-24T09:18:54.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.800+0000 7fd4bc52a640 1 --2- 10.20.193.4:0/1918279886 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4b41135c0 0x7fd4b4173f90 unknown :-1 s=CLOSED pgs=1182 gs=1 cs=0 l=1 c_cookie=4037663775168873191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.800+0000 7fd4bc52a640 1 --2- 10.20.193.4:0/1918279886 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4b410ddc0 0x7fd4b4112e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.800+0000 7fd4bc52a640 1 --2- 10.20.193.4:0/1918279886 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4b410d3d0 0x7fd4b410d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.800+0000 7fd4bc52a640 1 -- 10.20.193.4:0/1918279886 >> 10.20.193.4:0/1918279886 conn(0x7fd4b40eaca0 msgr2=0x7fd4b410b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.800+0000 7fd4bc52a640 1 -- 10.20.193.4:0/1918279886 shutdown_connections 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.800+0000 7fd4bc52a640 1 -- 10.20.193.4:0/1918279886 wait complete. 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.800+0000 7fd4bc52a640 1 Processor -- start 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4bc52a640 1 -- start start 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4bc52a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4b410d3d0 0x7fd4b4060f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4bc52a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4b410ddc0 0x7fd4b40614d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4bc52a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4b41135c0 0x7fd4b4061a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4bc52a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4163fa0 con 0x7fd4b410d3d0 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4bc52a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4164110 con 0x7fd4b410ddc0 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4bc52a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41642d0 con 0x7fd4b41135c0 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4b9a9e640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4b410ddc0 0x7fd4b40614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.806 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4baaa0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4b41135c0 0x7fd4b4061a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4b9a9e640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4b410ddc0 0x7fd4b40614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:39302/0 (socket says 10.20.193.4:39302) 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4baaa0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4b41135c0 0x7fd4b4061a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:51210/0 (socket says 10.20.193.4:51210) 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4b9a9e640 1 -- 10.20.193.4:0/3689763996 learned_addr learned my addr 10.20.193.4:0/3689763996 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4b410d3d0 0x7fd4b4060f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4ba29f640 1 -- 10.20.193.4:0/3689763996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4b41135c0 msgr2=0x7fd4b4061a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4b41135c0 0x7fd4b4061a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4ba29f640 1 -- 10.20.193.4:0/3689763996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4b410ddc0 msgr2=0x7fd4b40614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4b410ddc0 0x7fd4b40614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4ba29f640 1 -- 10.20.193.4:0/3689763996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b000a650 con 0x7fd4b410d3d0 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4b410d3d0 0x7fd4b4060f90 secure :-1 s=READY pgs=1183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4a400d720 tx=0x7fd4a400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd49b7fe640 1 -- 10.20.193.4:0/3689763996 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4a4004500 con 0x7fd4b410d3d0 2026-02-24T09:18:54.807 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4bc52a640 1 -- 10.20.193.4:0/3689763996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b41645b0 con 0x7fd4b410d3d0 2026-02-24T09:18:54.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd49b7fe640 1 -- 10.20.193.4:0/3689763996 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4a4004d30 con 0x7fd4b410d3d0 2026-02-24T09:18:54.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd49b7fe640 1 -- 10.20.193.4:0/3689763996 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4a40052a0 con 0x7fd4b410d3d0 2026-02-24T09:18:54.808 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.801+0000 7fd4bc52a640 1 -- 10.20.193.4:0/3689763996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b4164ad0 con 0x7fd4b410d3d0 2026-02-24T09:18:54.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.804+0000 7fd49b7fe640 1 -- 10.20.193.4:0/3689763996 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fd4a4005430 con 0x7fd4b410d3d0 2026-02-24T09:18:54.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.804+0000 7fd49b7fe640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4900b56e0 0x7fd4900d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.805+0000 7fd49b7fe640 1 -- 10.20.193.4:0/3689763996 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd4a40e66d0 con 0x7fd4b410d3d0 2026-02-24T09:18:54.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.805+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4900b56e0 0x7fd4900d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.805+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4900b56e0 0x7fd4900d5b90 secure :-1 s=READY pgs=429 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b4111e30 tx=0x7fd4a8004050 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:54.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4be524e00 1 Processor -- start 2026-02-24T09:18:54.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4be524e00 1 -- start start 2026-02-24T09:18:54.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1db820 0x55d6fc1dbbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc220890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 0x55d6fc2411b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4be524e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc0ebde0 con 0x55d6fc1dc130 2026-02-24T09:18:54.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4be524e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc0e7b10 con 0x55d6fc1db820 2026-02-24T09:18:54.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4be524e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc0e1ab0 con 0x55d6fc220dd0 2026-02-24T09:18:54.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4b9a9e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc220890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4b9a9e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc220890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51874/0 (socket says 10.20.193.4:51874) 2026-02-24T09:18:54.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4b9a9e640 1 -- 10.20.193.4:0/2358971114 learned_addr learned my addr 10.20.193.4:0/2358971114 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:54.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4ba29f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1db820 0x55d6fc1dbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.808+0000 7fd4baaa0640 1 --2- 10.20.193.4:0/2358971114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 0x55d6fc2411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.809+0000 7fd4b9a9e640 1 -- 10.20.193.4:0/2358971114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 msgr2=0x55d6fc2411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.809+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/2358971114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 0x55d6fc2411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.809+0000 7fd4b9a9e640 1 -- 10.20.193.4:0/2358971114 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1db820 msgr2=0x55d6fc1dbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.809+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/2358971114 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1db820 0x55d6fc1dbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.809+0000 7fd4b9a9e640 1 -- 10.20.193.4:0/2358971114 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fc08d310 con 0x55d6fc1dc130 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.809+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/2358971114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc220890 secure :-1 s=READY pgs=1184 gs=1 cs=0 l=1 c_cookie=13735598468038469805 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4a80041e0 tx=0x7fd4a8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9ea60848d528ad server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.809+0000 7fd498b0a640 1 -- 10.20.193.4:0/2358971114 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4a801d630 con 0x55d6fc1dc130 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.809+0000 7fd498b0a640 1 -- 10.20.193.4:0/2358971114 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4a8011e60 con 0x55d6fc1dc130 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.809+0000 7fd498b0a640 1 -- 10.20.193.4:0/2358971114 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4a8010c40 con 0x55d6fc1dc130 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.810+0000 7fd4be524e00 1 -- 10.20.193.4:0/2358971114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 msgr2=0x55d6fc220890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.810+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2358971114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc220890 secure :-1 s=READY pgs=1184 gs=1 cs=0 l=1 c_cookie=13735598468038469805 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4a80041e0 tx=0x7fd4a8012000 comp rx=0 tx=0).stop 2026-02-24T09:18:54.814 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.810+0000 7fd4be524e00 1 -- 10.20.193.4:0/2358971114 shutdown_connections 2026-02-24T09:18:54.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.810+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2358971114 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 0x55d6fc2411b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.810+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2358971114 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc220890 unknown :-1 s=CLOSED pgs=1184 gs=1 cs=0 l=1 c_cookie=13735598468038469805 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.810+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2358971114 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1db820 0x55d6fc1dbbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.810+0000 7fd4be524e00 1 -- 10.20.193.4:0/2358971114 >> 10.20.193.4:0/2358971114 conn(0x55d6fc0fa6b0 msgr2=0x55d6fc1da100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:54.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.810+0000 7fd4be524e00 1 -- 10.20.193.4:0/2358971114 shutdown_connections 2026-02-24T09:18:54.815 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.810+0000 7fd4be524e00 1 -- 10.20.193.4:0/2358971114 wait complete. 2026-02-24T09:18:54.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4be524e00 1 -- start start 2026-02-24T09:18:54.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4be524e00 1 Processor -- start 2026-02-24T09:18:54.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1db820 0x55d6fc1f3c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1dc130 0x55d6fc1f4180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 0x55d6fc1f9170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4be524e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc1f96b0 con 0x55d6fc1db820 2026-02-24T09:18:54.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4be524e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc1f9820 con 0x55d6fc1dc130 2026-02-24T09:18:54.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4be524e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc1f99e0 con 0x55d6fc220dd0 2026-02-24T09:18:54.819 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4ba29f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1db820 0x55d6fc1f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4ba29f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1db820 0x55d6fc1f3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51890/0 (socket says 10.20.193.4:51890) 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4ba29f640 1 -- 10.20.193.4:0/2954788234 learned_addr learned my addr 10.20.193.4:0/2954788234 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4baaa0640 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 0x55d6fc1f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4ba29f640 1 -- 10.20.193.4:0/2954788234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 msgr2=0x55d6fc1f9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 0x55d6fc1f9170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4ba29f640 1 -- 10.20.193.4:0/2954788234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1dc130 msgr2=0x55d6fc1f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.811+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1dc130 0x55d6fc1f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4ba29f640 1 -- 10.20.193.4:0/2954788234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fc0658c0 con 0x55d6fc1db820 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4baaa0640 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 0x55d6fc1f9170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1db820 0x55d6fc1f3c40 secure :-1 s=READY pgs=1185 gs=1 cs=0 l=1 c_cookie=8164026910466176075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4a4005aa0 tx=0x7fd4a40acab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714c73385f10f44b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd467fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:54.820 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd467fff640 1 -- 10.20.193.4:0/2954788234 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4a40ad400 con 0x55d6fc1db820 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd467fff640 1 -- 10.20.193.4:0/2954788234 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4a40b2720 con 0x55d6fc1db820 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 1 -- 10.20.193.4:0/2954788234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a800fa10 con 0x55d6fc1db820 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd467fff640 1 -- 10.20.193.4:0/2954788234 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4a4071e10 con 0x55d6fc1db820 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 10 client.17874 _ll_register_callbacks cb 0x55d6fc07d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd467fff640 1 -- 10.20.193.4:0/2954788234 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd4a40ad690 con 0x55d6fc1db820 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 1 -- 10.20.193.4:0/2954788234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d6fbe314a0 con 0x55d6fc1db820 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd467fff640 1 -- 10.20.193.4:0/2954788234 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd4a40ad850 con 0x55d6fc1db820 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 10 client.17874 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 1 -- 10.20.193.4:0/2954788234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d6fc0776e0 con 0x55d6fc1db820 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd467fff640 1 -- 10.20.193.4:0/2954788234 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd4a40aed20 con 0x55d6fc1db820 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 10 client.17874 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 10 client.17874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:54.821 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 20 client.17874 populate_metadata read hostname 'trial004' 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d6fc21e4a0 0x55d6fc21e940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 4 client.17874 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4be524e00 1 -- 10.20.193.4:0/2954788234 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6fc0d74f0 con 0x55d6fc21e4a0 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.812+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d6fc21e4a0 0x55d6fc21e940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.813+0000 7fd467fff640 10 client.17874 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.813+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d6fc21e4a0 0x55d6fc21e940 crc :-1 s=READY pgs=195 gs=4 cs=0 l=0 c_cookie=6846363522303720979 s_cookie=4341496438576800 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f032b59961afe13 server_cookie=f6c916903d6a0 in_seq=0 out_seq=0 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.813+0000 7fd467fff640 1 -- 10.20.193.4:0/2954788234 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d6fc0d74f0 con 0x55d6fc21e4a0 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.813+0000 7fd467fff640 10 client.17874 handle_command_reply: tid=0 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.813+0000 7fd4be524e00 1 client.17874 shutdown 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 1 -- 10.20.193.4:0/2954788234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1db820 msgr2=0x55d6fc1f3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:54.822 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1db820 0x55d6fc1f3c40 secure :-1 s=READY pgs=1185 gs=1 cs=0 l=1 c_cookie=8164026910466176075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4a4005aa0 tx=0x7fd4a40acab0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 1 -- 10.20.193.4:0/2954788234 shutdown_connections 2026-02-24T09:18:54.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d6fc21e4a0 0x55d6fc21e940 crc :-1 s=READY pgs=195 gs=4 cs=0 l=0 c_cookie=6846363522303720979 s_cookie=4341496438576800 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc220dd0 0x55d6fc1f9170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1dc130 0x55d6fc1f4180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2954788234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1db820 0x55d6fc1f3c40 unknown :-1 s=CLOSED pgs=1185 gs=1 cs=0 l=1 c_cookie=8164026910466176075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd467fff640 0 client.17874 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:54.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 1 -- 10.20.193.4:0/2954788234 >> 10.20.193.4:0/2954788234 conn(0x55d6fc0fa6b0 msgr2=0x55d6fc1da810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:54.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 1 -- 10.20.193.4:0/2954788234 shutdown_connections 2026-02-24T09:18:54.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 1 -- 10.20.193.4:0/2954788234 wait complete. 2026-02-24T09:18:54.823 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.814+0000 7fd4be524e00 20 client.17874 trim_cache size 0 max 16384 2026-02-24T09:18:54.829 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4be524e00 1 Processor -- start 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4be524e00 1 -- start start 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc1db820 0x55d6fc1f1240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1dc130 0x55d6fc1f86e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc220dd0 0x55d6fc220230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4be524e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc0df6e0 con 0x55d6fc220dd0 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4be524e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d6fbdaaf50 con 0x55d6fc1dc130 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4be524e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc14c450 con 0x55d6fc1db820 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4baaa0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc220dd0 0x55d6fc220230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4baaa0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc220dd0 0x55d6fc220230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51898/0 (socket says 10.20.193.4:51898) 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4baaa0640 1 -- 10.20.193.4:0/2224860276 learned_addr learned my addr 10.20.193.4:0/2224860276 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/2224860276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc1db820 0x55d6fc1f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.830 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/2224860276 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1dc130 0x55d6fc1f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4baaa0640 1 -- 10.20.193.4:0/2224860276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc1db820 msgr2=0x55d6fc1f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:54.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4baaa0640 1 --2- 10.20.193.4:0/2224860276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc1db820 0x55d6fc1f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4baaa0640 1 -- 10.20.193.4:0/2224860276 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1dc130 msgr2=0x55d6fc1f86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:54.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4baaa0640 1 --2- 10.20.193.4:0/2224860276 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1dc130 0x55d6fc1f86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4baaa0640 1 -- 10.20.193.4:0/2224860276 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fc072160 con 0x55d6fc220dd0 2026-02-24T09:18:54.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.826+0000 7fd4baaa0640 1 --2- 10.20.193.4:0/2224860276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc220dd0 0x55d6fc220230 secure :-1 s=READY pgs=1186 gs=1 cs=0 l=1 c_cookie=759853362417233899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b000a230 tx=0x7fd4b003b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b8a9b7443efeb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:54.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.827+0000 7fd4824e6640 1 -- 10.20.193.4:0/2224860276 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4b0030ae0 con 0x55d6fc220dd0 2026-02-24T09:18:54.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.827+0000 7fd4824e6640 1 -- 10.20.193.4:0/2224860276 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4b003f040 con 0x55d6fc220dd0 2026-02-24T09:18:54.831 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.827+0000 7fd4824e6640 1 -- 10.20.193.4:0/2224860276 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4b0005040 con 0x55d6fc220dd0 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.828+0000 7fd4be524e00 1 -- 10.20.193.4:0/2224860276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc220dd0 msgr2=0x55d6fc220230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.828+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2224860276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc220dd0 0x55d6fc220230 secure :-1 s=READY pgs=1186 gs=1 cs=0 l=1 c_cookie=759853362417233899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b000a230 tx=0x7fd4b003b040 comp rx=0 tx=0).stop 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.828+0000 7fd4be524e00 1 -- 10.20.193.4:0/2224860276 shutdown_connections 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.828+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2224860276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc220dd0 0x55d6fc220230 unknown :-1 s=CLOSED pgs=1186 gs=1 cs=0 l=1 c_cookie=759853362417233899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.828+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2224860276 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc1dc130 0x55d6fc1f86e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.828+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2224860276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc1db820 0x55d6fc1f1240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.828+0000 7fd4be524e00 1 -- 10.20.193.4:0/2224860276 >> 10.20.193.4:0/2224860276 conn(0x55d6fc0fa6b0 msgr2=0x55d6fc1f7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.828+0000 7fd4be524e00 1 -- 10.20.193.4:0/2224860276 shutdown_connections 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.828+0000 7fd4be524e00 1 -- 10.20.193.4:0/2224860276 wait complete. 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.828+0000 7fd4be524e00 1 -- start start 2026-02-24T09:18:54.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4be524e00 1 Processor -- start 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc1db820 0x55d6fc1ffac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc200000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4be524e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc220dd0 0x55d6fc1fa370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4be524e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc14e150 con 0x55d6fc1dc130 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4be524e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc1dc500 con 0x55d6fc220dd0 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4be524e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d6fc14f410 con 0x55d6fc1db820 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4b9a9e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc200000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4b9a9e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc200000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51910/0 (socket says 10.20.193.4:51910) 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4b9a9e640 1 -- 10.20.193.4:0/2522648844 learned_addr learned my addr 10.20.193.4:0/2522648844 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc1db820 0x55d6fc1ffac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4b9a9e640 1 -- 10.20.193.4:0/2522648844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc1db820 msgr2=0x55d6fc1ffac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:54.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc1db820 0x55d6fc1ffac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4b9a9e640 1 -- 10.20.193.4:0/2522648844 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc220dd0 msgr2=0x55d6fc1fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc220dd0 0x55d6fc1fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4b9a9e640 1 -- 10.20.193.4:0/2522648844 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fc065bf0 con 0x55d6fc1dc130 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4b9a9e640 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc200000 secure :-1 s=READY pgs=1187 gs=1 cs=0 l=1 c_cookie=430193859975197536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55d6fc1fa200 tx=0x7fd4a8011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f85b0950603360 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd467fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd467fff640 1 -- 10.20.193.4:0/2522648844 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4a8010c30 con 0x55d6fc1dc130 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd467fff640 1 -- 10.20.193.4:0/2522648844 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4a8010d90 con 0x55d6fc1dc130 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd467fff640 1 -- 10.20.193.4:0/2522648844 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4a8026900 con 0x55d6fc1dc130 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4be524e00 1 -- 10.20.193.4:0/2522648844 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b4174800 con 0x55d6fc1dc130 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd467fff640 1 -- 10.20.193.4:0/2522648844 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd4a8026a90 con 0x55d6fc1dc130 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd467fff640 10 client.17880 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4be524e00 10 client.17880 _ll_register_callbacks cb 0x55d6fc07d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:54.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.829+0000 7fd4be524e00 1 -- 10.20.193.4:0/2522648844 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d6fbd6cf40 con 0x55d6fc1dc130 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd467fff640 1 -- 10.20.193.4:0/2522648844 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd4a8026c50 con 0x55d6fc1dc130 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd4be524e00 10 client.17880 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd4be524e00 1 -- 10.20.193.4:0/2522648844 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d6fc077940 con 0x55d6fc1dc130 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd467fff640 1 -- 10.20.193.4:0/2522648844 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd4a8031070 con 0x55d6fc1dc130 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd4be524e00 10 client.17880 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd4be524e00 10 client.17880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd4be524e00 20 client.17880 populate_metadata read hostname 'trial004' 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d6fc2cec20 0x55d6fc2ef0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd4be524e00 4 client.17880 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd4be524e00 1 -- 10.20.193.4:0/2522648844 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fd4a8011e60 con 0x55d6fc2cec20 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d6fc2cec20 0x55d6fc2ef0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:54.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd467fff640 10 client.17880 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd4ba29f640 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d6fc2cec20 0x55d6fc2ef0d0 crc :-1 s=READY pgs=196 gs=4 cs=0 l=0 c_cookie=11388212046452666138 s_cookie=15425656510285260351 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e0b0e84d7a2af1a server_cookie=d612f0de12bea63f in_seq=0 out_seq=0 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd467fff640 1 -- 10.20.193.4:0/2522648844 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x7fd4a8011e60 con 0x55d6fc2cec20 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.830+0000 7fd467fff640 10 client.17880 handle_command_reply: tid=0 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 client.17880 shutdown 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 -- 10.20.193.4:0/2522648844 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 msgr2=0x55d6fc200000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc200000 secure :-1 s=READY pgs=1187 gs=1 cs=0 l=1 c_cookie=430193859975197536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55d6fc1fa200 tx=0x7fd4a8011ce0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 -- 10.20.193.4:0/2522648844 shutdown_connections 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d6fc2cec20 0x55d6fc2ef0d0 crc :-1 s=READY pgs=196 gs=4 cs=0 l=0 c_cookie=11388212046452666138 s_cookie=15425656510285260351 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d6fc220dd0 0x55d6fc1fa370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d6fc1dc130 0x55d6fc200000 unknown :-1 s=CLOSED pgs=1187 gs=1 cs=0 l=1 c_cookie=430193859975197536 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 --2- 10.20.193.4:0/2522648844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d6fc1db820 0x55d6fc1ffac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd467fff640 0 client.17880 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:54.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 -- 10.20.193.4:0/2522648844 >> 10.20.193.4:0/2522648844 conn(0x55d6fc0fa6b0 msgr2=0x55d6fc1f87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:54.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 -- 10.20.193.4:0/2522648844 shutdown_connections 2026-02-24T09:18:54.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 1 -- 10.20.193.4:0/2522648844 wait complete. 2026-02-24T09:18:54.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.831+0000 7fd4be524e00 20 client.17880 trim_cache size 0 max 16384 2026-02-24T09:18:54.841 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:18:54.841 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:18:54.841 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.842 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:18:54.843 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:18:54.844 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 -- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4900b56e0 msgr2=0x7fd4900d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4900b56e0 0x7fd4900d5b90 secure :-1 s=READY pgs=429 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b4111e30 tx=0x7fd4a8004050 comp rx=0 tx=0).stop 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 -- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4b410d3d0 msgr2=0x7fd4b4060f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4b410d3d0 0x7fd4b4060f90 secure :-1 s=READY pgs=1183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4a400d720 tx=0x7fd4a400dbf0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 -- 10.20.193.4:0/3689763996 shutdown_connections 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4900b56e0 0x7fd4900d5b90 unknown :-1 s=CLOSED pgs=429 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4b41135c0 0x7fd4b4061a10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4b410ddc0 0x7fd4b40614d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 --2- 10.20.193.4:0/3689763996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4b410d3d0 0x7fd4b4060f90 unknown :-1 s=CLOSED pgs=1183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 -- 10.20.193.4:0/3689763996 >> 10.20.193.4:0/3689763996 conn(0x7fd4b40eaca0 msgr2=0x7fd4b410b080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 -- 10.20.193.4:0/3689763996 shutdown_connections 2026-02-24T09:18:54.845 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:54.832+0000 7fd4bc52a640 1 -- 10.20.193.4:0/3689763996 wait complete. 2026-02-24T09:18:54.933 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:18:54.934 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:18:55.083 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:55.120 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:54 trial004 ceph-mon[41596]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 705 MiB/s wr, 183 op/s 2026-02-24T09:18:55.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.249+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/2270451020 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a8810d010 msgr2=0x7f8a8810d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.249+0000 7f8a8d1ee640 1 --2- 10.20.193.4:0/2270451020 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a8810d010 0x7f8a8810d3e0 secure :-1 s=READY pgs=1188 gs=1 cs=0 l=1 c_cookie=2456038536991852508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a7c009950 tx=0x7f8a7c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.249+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/2270451020 shutdown_connections 2026-02-24T09:18:55.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.249+0000 7f8a8d1ee640 1 --2- 10.20.193.4:0/2270451020 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a88113200 0x7f8a88173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.249+0000 7f8a8d1ee640 1 --2- 10.20.193.4:0/2270451020 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a8810da00 0x7f8a88112a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.249+0000 7f8a8d1ee640 1 --2- 10.20.193.4:0/2270451020 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a8810d010 0x7f8a8810d3e0 unknown :-1 s=CLOSED pgs=1188 gs=1 cs=0 l=1 c_cookie=2456038536991852508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.249+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/2270451020 >> 10.20.193.4:0/2270451020 conn(0x7f8a8805f830 msgr2=0x7f8a8810ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:55.253 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.249+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/2270451020 shutdown_connections 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.249+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/2270451020 wait complete. 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a8d1ee640 1 Processor -- start 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a8d1ee640 1 -- start start 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a8d1ee640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a8810d010 0x7f8a8811b980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a8d1ee640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a8810da00 0x7f8a8811bec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a8d1ee640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a88113200 0x7f8a88121240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a8d1ee640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88121860 con 0x7f8a8810d010 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a8d1ee640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f8a881219d0 con 0x7f8a8810da00 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a8d1ee640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88121b90 con 0x7f8a88113200 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a86d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a8810d010 0x7f8a8811b980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a86d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a8810d010 0x7f8a8811b980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51928/0 (socket says 10.20.193.4:51928) 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a86d76640 1 -- 10.20.193.4:0/4260459780 learned_addr learned my addr 10.20.193.4:0/4260459780 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a86d76640 1 -- 10.20.193.4:0/4260459780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a88113200 msgr2=0x7f8a88121240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a86d76640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a88113200 0x7f8a88121240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a86d76640 1 -- 10.20.193.4:0/4260459780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a8810da00 msgr2=0x7f8a8811bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a86d76640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a8810da00 0x7f8a8811bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a86d76640 1 -- 10.20.193.4:0/4260459780 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c009570 con 0x7f8a8810d010 2026-02-24T09:18:55.254 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a86d76640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a8810d010 0x7f8a8811b980 secure :-1 s=READY pgs=1189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a7c038820 tx=0x7f8a7c004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:55.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a67fff640 1 -- 10.20.193.4:0/4260459780 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a7c03d070 con 0x7f8a8810d010 2026-02-24T09:18:55.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a67fff640 1 -- 10.20.193.4:0/4260459780 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a7c002ad0 con 0x7f8a8810d010 2026-02-24T09:18:55.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/4260459780 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a88121e10 con 0x7f8a8810d010 2026-02-24T09:18:55.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a67fff640 1 -- 10.20.193.4:0/4260459780 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a7c041940 con 0x7f8a8810d010 2026-02-24T09:18:55.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.250+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/4260459780 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a88162570 con 0x7f8a8810d010 2026-02-24T09:18:55.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.251+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/4260459780 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a8810e2f0 con 0x7f8a8810d010 2026-02-24T09:18:55.255 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.253+0000 7f8a67fff640 1 -- 10.20.193.4:0/4260459780 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f8a7c041ad0 con 0x7f8a8810d010 2026-02-24T09:18:55.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.254+0000 7f8a67fff640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a5c0b56e0 0x7f8a5c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.254+0000 7f8a67fff640 1 -- 10.20.193.4:0/4260459780 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8a7c10b880 con 0x7f8a8810d010 2026-02-24T09:18:55.256 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.254+0000 7f8a86575640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a5c0b56e0 0x7f8a5c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.254+0000 7f8a86575640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a5c0b56e0 0x7f8a5c0d5b90 secure :-1 s=READY pgs=430 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a881222d0 tx=0x7f8a70009690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:55.257 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.255+0000 7f8a67fff640 1 -- 10.20.193.4:0/4260459780 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8a7c0ce200 con 0x7f8a8810d010 2026-02-24T09:18:55.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:54 trial090 ceph-mon[47278]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 705 MiB/s wr, 183 op/s 2026-02-24T09:18:55.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:54 trial014 ceph-mon[46941]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 705 MiB/s wr, 183 op/s 2026-02-24T09:18:55.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.418+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/4260459780 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a8811ca90 con 0x7f8a8810d010 2026-02-24T09:18:55.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.419+0000 7f8a67fff640 1 -- 10.20.193.4:0/4260459780 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f8a7c0d13b0 con 0x7f8a8810d010 2026-02-24T09:18:55.421 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:18:55.422 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:18:55.422 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:18:55.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.424+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/4260459780 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a5c0b56e0 msgr2=0x7f8a5c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.424+0000 7f8a8d1ee640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a5c0b56e0 0x7f8a5c0d5b90 secure :-1 s=READY pgs=430 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a881222d0 tx=0x7f8a70009690 comp rx=0 tx=0).stop 2026-02-24T09:18:55.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.424+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/4260459780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a8810d010 msgr2=0x7f8a8811b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.424+0000 7f8a8d1ee640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a8810d010 0x7f8a8811b980 secure :-1 s=READY pgs=1189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a7c038820 tx=0x7f8a7c004300 comp rx=0 tx=0).stop 2026-02-24T09:18:55.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.424+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/4260459780 shutdown_connections 2026-02-24T09:18:55.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.424+0000 7f8a8d1ee640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a5c0b56e0 0x7f8a5c0d5b90 unknown :-1 s=CLOSED pgs=430 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.424+0000 7f8a8d1ee640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8a88113200 0x7f8a88121240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.424+0000 7f8a8d1ee640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8a8810da00 0x7f8a8811bec0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.424+0000 7f8a8d1ee640 1 --2- 10.20.193.4:0/4260459780 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8a8810d010 0x7f8a8811b980 unknown :-1 s=CLOSED pgs=1189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.424+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/4260459780 >> 10.20.193.4:0/4260459780 conn(0x7f8a8805f830 msgr2=0x7f8a8810ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:55.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.425+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/4260459780 shutdown_connections 2026-02-24T09:18:55.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.425+0000 7f8a8d1ee640 1 -- 10.20.193.4:0/4260459780 wait complete. 2026-02-24T09:18:55.537 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:18:55.687 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:55.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.842+0000 7f6c7fd28640 1 -- 10.20.193.4:0/3544498228 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c7810be60 msgr2=0x7f6c7810c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.842+0000 7f6c7fd28640 1 --2- 10.20.193.4:0/3544498228 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c7810be60 0x7f6c7810c230 secure :-1 s=READY pgs=1190 gs=1 cs=0 l=1 c_cookie=5329532644176094335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c68009950 tx=0x7f6c6802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.842+0000 7f6c7fd28640 1 -- 10.20.193.4:0/3544498228 shutdown_connections 2026-02-24T09:18:55.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.842+0000 7f6c7fd28640 1 --2- 10.20.193.4:0/3544498228 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c78155b90 0x7f6c78175f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.842+0000 7f6c7fd28640 1 --2- 10.20.193.4:0/3544498228 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c7810c770 0x7f6c78155650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.842+0000 7f6c7fd28640 1 --2- 10.20.193.4:0/3544498228 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c7810be60 0x7f6c7810c230 unknown :-1 s=CLOSED pgs=1190 gs=1 cs=0 l=1 c_cookie=5329532644176094335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.842+0000 7f6c7fd28640 1 -- 10.20.193.4:0/3544498228 >> 10.20.193.4:0/3544498228 conn(0x7f6c780e9b80 msgr2=0x7f6c78109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.842+0000 7f6c7fd28640 1 -- 10.20.193.4:0/3544498228 shutdown_connections 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.842+0000 7f6c7fd28640 1 -- 10.20.193.4:0/3544498228 wait complete. 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7fd28640 1 Processor -- start 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7fd28640 1 -- start start 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7fd28640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c7810be60 0x7f6c78160810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7fd28640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c7810c770 0x7f6c78160d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7fd28640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c78155b90 0x7f6c78166120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7fd28640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78166740 con 0x7f6c78155b90 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7fd28640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f6c781668b0 con 0x7f6c7810be60 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7fd28640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78166a70 con 0x7f6c7810c770 2026-02-24T09:18:55.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7e29e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c78155b90 0x7f6c78166120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7e29e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c78155b90 0x7f6c78166120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51948/0 (socket says 10.20.193.4:51948) 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7e29e640 1 -- 10.20.193.4:0/901112722 learned_addr learned my addr 10.20.193.4:0/901112722 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7d29c640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c7810c770 0x7f6c78160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c7810be60 0x7f6c78160810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7e29e640 1 -- 10.20.193.4:0/901112722 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c7810c770 msgr2=0x7f6c78160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c7810c770 0x7f6c78160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7e29e640 1 -- 10.20.193.4:0/901112722 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c7810be60 msgr2=0x7f6c78160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c7810be60 0x7f6c78160810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7e29e640 1 -- 10.20.193.4:0/901112722 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c68009570 con 0x7f6c78155b90 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c78155b90 0x7f6c78166120 secure :-1 s=READY pgs=1191 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c74006e90 tx=0x7f6c7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c66ffd640 1 -- 10.20.193.4:0/901112722 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c74005500 con 0x7f6c78155b90 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7fd28640 1 -- 10.20.193.4:0/901112722 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c78166d50 con 0x7f6c78155b90 2026-02-24T09:18:55.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c66ffd640 1 -- 10.20.193.4:0/901112722 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c74005e10 con 0x7f6c78155b90 2026-02-24T09:18:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c66ffd640 1 -- 10.20.193.4:0/901112722 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c74003a90 con 0x7f6c78155b90 2026-02-24T09:18:55.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.843+0000 7f6c7fd28640 1 -- 10.20.193.4:0/901112722 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c781527c0 con 0x7f6c78155b90 2026-02-24T09:18:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.846+0000 7f6c66ffd640 1 -- 10.20.193.4:0/901112722 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f6c7400c840 con 0x7f6c78155b90 2026-02-24T09:18:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.847+0000 7f6c66ffd640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c540b56e0 0x7f6c540d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.847+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c540b56e0 0x7f6c540d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.847+0000 7f6c66ffd640 1 -- 10.20.193.4:0/901112722 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6c740e7a00 con 0x7f6c78155b90 2026-02-24T09:18:55.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.848+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c540b56e0 0x7f6c540d5b90 secure :-1 s=READY pgs=431 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c680023d0 tx=0x7f6c68031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c81d22e00 1 Processor -- start 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c81d22e00 1 -- start start 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401f4c320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 0x558401f90fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f91500 0x558401fb18e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558401e5cee0 con 0x558401f4bf50 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558401e58c10 con 0x558401f91500 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558401e52d70 con 0x558401f4c860 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c7da9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401f4c320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c7da9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401f4c320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51960/0 (socket says 10.20.193.4:51960) 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c7da9d640 1 -- 10.20.193.4:0/393121949 learned_addr learned my addr 10.20.193.4:0/393121949 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:55.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c7d29c640 1 --2- 10.20.193.4:0/393121949 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 0x558401f90fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c7da9d640 1 -- 10.20.193.4:0/393121949 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 msgr2=0x558401f90fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/393121949 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 0x558401f90fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c7da9d640 1 -- 10.20.193.4:0/393121949 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f91500 msgr2=0x558401fb18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/393121949 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f91500 0x558401fb18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c7da9d640 1 -- 10.20.193.4:0/393121949 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558401dfe340 con 0x558401f4bf50 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.850+0000 7f6c7d29c640 1 --2- 10.20.193.4:0/393121949 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 0x558401f90fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/393121949 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401f4c320 secure :-1 s=READY pgs=1192 gs=1 cs=0 l=1 c_cookie=7286917882250014374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c68002ed0 tx=0x7f6c68040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65205534c6f42ea6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c464e6640 1 -- 10.20.193.4:0/393121949 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c68002a80 con 0x558401f4bf50 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c464e6640 1 -- 10.20.193.4:0/393121949 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c68038920 con 0x558401f4bf50 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c464e6640 1 -- 10.20.193.4:0/393121949 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c6804f890 con 0x558401f4bf50 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c81d22e00 1 -- 10.20.193.4:0/393121949 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 msgr2=0x558401f4c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/393121949 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401f4c320 secure :-1 s=READY pgs=1192 gs=1 cs=0 l=1 c_cookie=7286917882250014374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c68002ed0 tx=0x7f6c68040000 comp rx=0 tx=0).stop 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c81d22e00 1 -- 10.20.193.4:0/393121949 shutdown_connections 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/393121949 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f91500 0x558401fb18e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/393121949 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 0x558401f90fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/393121949 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401f4c320 unknown :-1 s=CLOSED pgs=1192 gs=1 cs=0 l=1 c_cookie=7286917882250014374 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c81d22e00 1 -- 10.20.193.4:0/393121949 >> 10.20.193.4:0/393121949 conn(0x558401e6adb0 msgr2=0x558401f4a830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:55.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c81d22e00 1 -- 10.20.193.4:0/393121949 shutdown_connections 2026-02-24T09:18:55.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.851+0000 7f6c81d22e00 1 -- 10.20.193.4:0/393121949 wait complete. 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.852+0000 7f6c81d22e00 1 -- start start 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.852+0000 7f6c81d22e00 1 Processor -- start 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401fa8dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 0x558401fa9310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f91500 0x558401fae300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558401fae840 con 0x558401f4bf50 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558401fae9b0 con 0x558401f91500 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558401faeb70 con 0x558401f4c860 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7da9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401fa8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7da9d640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401fa8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51966/0 (socket says 10.20.193.4:51966) 2026-02-24T09:18:55.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7da9d640 1 -- 10.20.193.4:0/767961447 learned_addr learned my addr 10.20.193.4:0/767961447 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7d29c640 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 0x558401fa9310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7da9d640 1 -- 10.20.193.4:0/767961447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 msgr2=0x558401fa9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 0x558401fa9310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7da9d640 1 -- 10.20.193.4:0/767961447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f91500 msgr2=0x558401fae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f91500 0x558401fae300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f91500 0x558401fae300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7da9d640 1 -- 10.20.193.4:0/767961447 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558401dd69d0 con 0x558401f4bf50 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f91500 0x558401fae300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401fa8dd0 secure :-1 s=READY pgs=1193 gs=1 cs=0 l=1 c_cookie=7152250529739639082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c680098a0 tx=0x7f6c6804fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6341e5f669bb092a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c337fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c337fe640 1 -- 10.20.193.4:0/767961447 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c6802f9f0 con 0x558401f4bf50 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 1 -- 10.20.193.4:0/767961447 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c78060e70 con 0x558401f4bf50 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c337fe640 1 -- 10.20.193.4:0/767961447 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c6804fe90 con 0x558401f4bf50 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c337fe640 1 -- 10.20.193.4:0/767961447 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c68058370 con 0x558401f4bf50 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 10 client.17898 _ll_register_callbacks cb 0x558401dfd080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 1 -- 10.20.193.4:0/767961447 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558401ba24a0 con 0x558401f4bf50 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c337fe640 1 -- 10.20.193.4:0/767961447 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6c68058500 con 0x558401f4bf50 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c337fe640 1 -- 10.20.193.4:0/767961447 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6c680586e0 con 0x558401f4bf50 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 10 client.17898 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.853+0000 7f6c81d22e00 1 -- 10.20.193.4:0/767961447 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x558401de8710 con 0x558401f4bf50 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.854+0000 7f6c337fe640 1 -- 10.20.193.4:0/767961447 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6c6802fb50 con 0x558401f4bf50 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.854+0000 7f6c81d22e00 10 client.17898 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.854+0000 7f6c81d22e00 10 client.17898 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.854+0000 7f6c81d22e00 20 client.17898 populate_metadata read hostname 'trial004' 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.854+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x558401f8e450 0x558401f8e8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.854+0000 7f6c81d22e00 4 client.17898 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.854+0000 7f6c81d22e00 1 -- 10.20.193.4:0/767961447 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558401e487b0 con 0x558401f8e450 2026-02-24T09:18:55.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.854+0000 7f6c7d29c640 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x558401f8e450 0x558401f8e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.854+0000 7f6c7d29c640 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x558401f8e450 0x558401f8e8f0 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=5491980728273315463 s_cookie=5729608089471177100 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4c376f5fe605a687 server_cookie=4f83a8335b22518c in_seq=0 out_seq=0 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.854+0000 7f6c337fe640 10 client.17898 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c337fe640 1 -- 10.20.193.4:0/767961447 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x558401e487b0 con 0x558401f8e450 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c337fe640 10 client.17898 handle_command_reply: tid=0 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 client.17898 shutdown 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 -- 10.20.193.4:0/767961447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 msgr2=0x558401fa8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401fa8dd0 secure :-1 s=READY pgs=1193 gs=1 cs=0 l=1 c_cookie=7152250529739639082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c680098a0 tx=0x7f6c6804fd60 comp rx=0 tx=0).stop 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 -- 10.20.193.4:0/767961447 shutdown_connections 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x558401f8e450 0x558401f8e8f0 crc :-1 s=READY pgs=54 gs=4 cs=0 l=0 c_cookie=5491980728273315463 s_cookie=5729608089471177100 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f91500 0x558401fae300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4c860 0x558401fa9310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/767961447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f4bf50 0x558401fa8dd0 unknown :-1 s=CLOSED pgs=1193 gs=1 cs=0 l=1 c_cookie=7152250529739639082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c337fe640 0 client.17898 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 -- 10.20.193.4:0/767961447 >> 10.20.193.4:0/767961447 conn(0x558401e6adb0 msgr2=0x558401f4a040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 -- 10.20.193.4:0/767961447 shutdown_connections 2026-02-24T09:18:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 1 -- 10.20.193.4:0/767961447 wait complete. 2026-02-24T09:18:55.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.855+0000 7f6c81d22e00 20 client.17898 trim_cache size 0 max 16384 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c81d22e00 1 Processor -- start 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c81d22e00 1 -- start start 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4bf50 0x558401f4b460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f4c860 0x558401f4b9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f8c110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558401f94460 con 0x558401f91500 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558401fae700 con 0x558401f4c860 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558401e509a0 con 0x558401f4bf50 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c7e29e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f8c110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c7e29e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f8c110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51974/0 (socket says 10.20.193.4:51974) 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c7e29e640 1 -- 10.20.193.4:0/32908961 learned_addr learned my addr 10.20.193.4:0/32908961 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.863+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/32908961 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4bf50 0x558401f4b460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c7d29c640 1 --2- 10.20.193.4:0/32908961 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f4c860 0x558401f4b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c7e29e640 1 -- 10.20.193.4:0/32908961 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4bf50 msgr2=0x558401f4b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:55.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/32908961 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4bf50 0x558401f4b460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c7e29e640 1 -- 10.20.193.4:0/32908961 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f4c860 msgr2=0x558401f4b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/32908961 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f4c860 0x558401f4b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c7e29e640 1 -- 10.20.193.4:0/32908961 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558401de3190 con 0x558401f91500 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/32908961 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f8c110 secure :-1 s=READY pgs=1194 gs=1 cs=0 l=1 c_cookie=9247463938193405019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c740050a0 tx=0x7f6c740aa4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80559774e540b45b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c45ce5640 1 -- 10.20.193.4:0/32908961 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c740d3070 con 0x558401f91500 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c45ce5640 1 -- 10.20.193.4:0/32908961 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c740ae730 con 0x558401f91500 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c45ce5640 1 -- 10.20.193.4:0/32908961 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c740ad8d0 con 0x558401f91500 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c81d22e00 1 -- 10.20.193.4:0/32908961 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 msgr2=0x558401f8c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.864+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/32908961 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f8c110 secure :-1 s=READY pgs=1194 gs=1 cs=0 l=1 c_cookie=9247463938193405019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c740050a0 tx=0x7f6c740aa4a0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 -- 10.20.193.4:0/32908961 shutdown_connections 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/32908961 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f8c110 unknown :-1 s=CLOSED pgs=1194 gs=1 cs=0 l=1 c_cookie=9247463938193405019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/32908961 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f4c860 0x558401f4b9a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/32908961 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4bf50 0x558401f4b460 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 -- 10.20.193.4:0/32908961 >> 10.20.193.4:0/32908961 conn(0x558401e6adb0 msgr2=0x558401fad950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 -- 10.20.193.4:0/32908961 shutdown_connections 2026-02-24T09:18:55.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 -- 10.20.193.4:0/32908961 wait complete. 2026-02-24T09:18:55.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 -- start start 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 Processor -- start 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4bf50 0x558401f2fb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f4c860 0x558401f2b360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f2b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x558401fa93e0 con 0x558401f91500 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x558401f2bfd0 con 0x558401f4c860 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c81d22e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x558401f2c190 con 0x558401f4bf50 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c7e29e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f2b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c7e29e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f2b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51990/0 (socket says 10.20.193.4:51990) 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c7e29e640 1 -- 10.20.193.4:0/1075962920 learned_addr learned my addr 10.20.193.4:0/1075962920 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.865+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4bf50 0x558401f2fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c7d29c640 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f4c860 0x558401f2b360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c7e29e640 1 -- 10.20.193.4:0/1075962920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4bf50 msgr2=0x558401f2fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4bf50 0x558401f2fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c7e29e640 1 -- 10.20.193.4:0/1075962920 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f4c860 msgr2=0x558401f2b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f4c860 0x558401f2b360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c7e29e640 1 -- 10.20.193.4:0/1075962920 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558401dd6d00 con 0x558401f91500 2026-02-24T09:18:55.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c7e29e640 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f2b8a0 secure :-1 s=READY pgs=1195 gs=1 cs=0 l=1 c_cookie=8986552588950005814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c740add10 tx=0x7f6c7400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb6a5f783bb6836 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c337fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c337fe640 1 -- 10.20.193.4:0/1075962920 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c740e5340 con 0x558401f91500 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 1 -- 10.20.193.4:0/1075962920 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c781527c0 con 0x558401f91500 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c337fe640 1 -- 10.20.193.4:0/1075962920 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c740d30d0 con 0x558401f91500 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c337fe640 1 -- 10.20.193.4:0/1075962920 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c740b89e0 con 0x558401f91500 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 10 client.17904 _ll_register_callbacks cb 0x558401dfd080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 1 -- 10.20.193.4:0/1075962920 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c68038920 con 0x558401f91500 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c337fe640 1 -- 10.20.193.4:0/1075962920 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6c740b3030 con 0x558401f91500 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c337fe640 1 -- 10.20.193.4:0/1075962920 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6c740b8b70 con 0x558401f91500 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 10 client.17904 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 1 -- 10.20.193.4:0/1075962920 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x558401de8970 con 0x558401f91500 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c337fe640 1 -- 10.20.193.4:0/1075962920 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6c74072ec0 con 0x558401f91500 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 10 client.17904 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 10 client.17904 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 20 client.17904 populate_metadata read hostname 'trial004' 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55840203e840 0x55840205ecf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 4 client.17904 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.866+0000 7f6c81d22e00 1 -- 10.20.193.4:0/1075962920 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558401b87160 con 0x55840203e840 2026-02-24T09:18:55.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55840203e840 0x55840205ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c7da9d640 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55840203e840 0x55840205ecf0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=14484210101526151617 s_cookie=16568988311353030929 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c9024058c19741c1 server_cookie=e5f0df1539cbf911 in_seq=0 out_seq=0 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c337fe640 10 client.17904 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c337fe640 1 -- 10.20.193.4:0/1075962920 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558401b87160 con 0x55840203e840 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c337fe640 10 client.17904 handle_command_reply: tid=0 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 client.17904 shutdown 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 -- 10.20.193.4:0/1075962920 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 msgr2=0x558401f2b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f2b8a0 secure :-1 s=READY pgs=1195 gs=1 cs=0 l=1 c_cookie=8986552588950005814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c740add10 tx=0x7f6c7400cce0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 -- 10.20.193.4:0/1075962920 shutdown_connections 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55840203e840 0x55840205ecf0 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=14484210101526151617 s_cookie=16568988311353030929 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x558401f91500 0x558401f2b8a0 unknown :-1 s=CLOSED pgs=1195 gs=1 cs=0 l=1 c_cookie=8986552588950005814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x558401f4c860 0x558401f2b360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 --2- 10.20.193.4:0/1075962920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x558401f4bf50 0x558401f2fb70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c337fe640 0 client.17904 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 -- 10.20.193.4:0/1075962920 >> 10.20.193.4:0/1075962920 conn(0x558401e6adb0 msgr2=0x558401f4a450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 -- 10.20.193.4:0/1075962920 shutdown_connections 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.867+0000 7f6c81d22e00 1 -- 10.20.193.4:0/1075962920 wait complete. 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c81d22e00 20 client.17904 trim_cache size 0 max 16384 2026-02-24T09:18:55.871 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 -- 10.20.193.4:0/901112722 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c540b56e0 msgr2=0x7f6c540d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c540b56e0 0x7f6c540d5b90 secure :-1 s=READY pgs=431 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c680023d0 tx=0x7f6c68031040 comp rx=0 tx=0).stop 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 -- 10.20.193.4:0/901112722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c78155b90 msgr2=0x7f6c78166120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c78155b90 0x7f6c78166120 secure :-1 s=READY pgs=1191 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c74006e90 tx=0x7f6c7400edf0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 -- 10.20.193.4:0/901112722 shutdown_connections 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c540b56e0 0x7f6c540d5b90 unknown :-1 s=CLOSED pgs=431 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6c78155b90 0x7f6c78166120 unknown :-1 s=CLOSED pgs=1191 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6c7810c770 0x7f6c78160d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 --2- 10.20.193.4:0/901112722 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6c7810be60 0x7f6c78160810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 -- 10.20.193.4:0/901112722 >> 10.20.193.4:0/901112722 conn(0x7f6c780e9b80 msgr2=0x7f6c78109f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 -- 10.20.193.4:0/901112722 shutdown_connections 2026-02-24T09:18:55.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:55.868+0000 7f6c7fd28640 1 -- 10.20.193.4:0/901112722 wait complete. 2026-02-24T09:18:55.975 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:18:56.000 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:55 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4260459780' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:56.147 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:56.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.306+0000 7fc42570c640 1 -- 10.20.193.4:0/253542589 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc42010f650 msgr2=0x7fc42010fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.306+0000 7fc42570c640 1 --2- 10.20.193.4:0/253542589 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc42010f650 0x7fc42010fa20 secure :-1 s=READY pgs=1196 gs=1 cs=0 l=1 c_cookie=17727923960235780552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc414009950 tx=0x7fc41402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.306+0000 7fc42570c640 1 -- 10.20.193.4:0/253542589 shutdown_connections 2026-02-24T09:18:56.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.306+0000 7fc42570c640 1 --2- 10.20.193.4:0/253542589 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc420115840 0x7fc420176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.306+0000 7fc42570c640 1 --2- 10.20.193.4:0/253542589 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc420110040 0x7fc420115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.306+0000 7fc42570c640 1 --2- 10.20.193.4:0/253542589 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc42010f650 0x7fc42010fa20 unknown :-1 s=CLOSED pgs=1196 gs=1 cs=0 l=1 c_cookie=17727923960235780552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.306+0000 7fc42570c640 1 -- 10.20.193.4:0/253542589 >> 10.20.193.4:0/253542589 conn(0x7fc4200ecf20 msgr2=0x7fc42010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.306+0000 7fc42570c640 1 -- 10.20.193.4:0/253542589 shutdown_connections 2026-02-24T09:18:56.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.306+0000 7fc42570c640 1 -- 10.20.193.4:0/253542589 wait complete. 2026-02-24T09:18:56.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc42570c640 1 Processor -- start 2026-02-24T09:18:56.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc42570c640 1 -- start start 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc42570c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc42010f650 0x7fc42011df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc42570c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc420110040 0x7fc42011e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc42570c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc420115840 0x7fc420123810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc42570c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fc420123e30 con 0x7fc420110040 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc42570c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fc420123fa0 con 0x7fc420115840 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc42570c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc420124160 con 0x7fc42010f650 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41e7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc420110040 0x7fc42011e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41e7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc420110040 0x7fc42011e440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52000/0 (socket says 10.20.193.4:52000) 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41e7fc640 1 -- 10.20.193.4:0/2304321640 learned_addr learned my addr 10.20.193.4:0/2304321640 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41f7fe640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc420115840 0x7fc420123810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41effd640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc42010f650 0x7fc42011df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41e7fc640 1 -- 10.20.193.4:0/2304321640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc42010f650 msgr2=0x7fc42011df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc42010f650 0x7fc42011df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41e7fc640 1 -- 10.20.193.4:0/2304321640 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc420115840 msgr2=0x7fc420123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc420115840 0x7fc420123810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41e7fc640 1 -- 10.20.193.4:0/2304321640 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc414009570 con 0x7fc420110040 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.307+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc420110040 0x7fc42011e440 secure :-1 s=READY pgs=1197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc408009480 tx=0x7fc40800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.308+0000 7fc3fffff640 1 -- 10.20.193.4:0/2304321640 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc40800cd40 con 0x7fc420110040 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.308+0000 7fc42570c640 1 -- 10.20.193.4:0/2304321640 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc420124440 con 0x7fc420110040 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.308+0000 7fc42570c640 1 -- 10.20.193.4:0/2304321640 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc420164b40 con 0x7fc420110040 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.308+0000 7fc3fffff640 1 -- 10.20.193.4:0/2304321640 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc408004d30 con 0x7fc420110040 2026-02-24T09:18:56.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.308+0000 7fc3fffff640 1 -- 10.20.193.4:0/2304321640 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4080106b0 con 0x7fc420110040 2026-02-24T09:18:56.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.311+0000 7fc3fffff640 1 -- 10.20.193.4:0/2304321640 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fc40801f060 con 0x7fc420110040 2026-02-24T09:18:56.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.311+0000 7fc3fffff640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3f40b56e0 0x7fc3f40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.312+0000 7fc3fffff640 1 -- 10.20.193.4:0/2304321640 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fc408014070 con 0x7fc420110040 2026-02-24T09:18:56.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.312+0000 7fc41effd640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3f40b56e0 0x7fc3f40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.312+0000 7fc41effd640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3f40b56e0 0x7fc3f40d5b90 secure :-1 s=READY pgs=432 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4140023d0 tx=0x7fc414031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc427706e00 1 Processor -- start 2026-02-24T09:18:56.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc427706e00 1 -- start start 2026-02-24T09:18:56.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc427706e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd276320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc427706e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd2bafc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc427706e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2bb500 0x55d4dd2db8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc427706e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd186ee0 con 0x55d4dd276860 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc427706e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd182c10 con 0x55d4dd275f50 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc427706e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd17cd70 con 0x55d4dd2bb500 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41e7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd2bafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41e7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd2bafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52008/0 (socket says 10.20.193.4:52008) 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41e7fc640 1 -- 10.20.193.4:0/2434079903 learned_addr learned my addr 10.20.193.4:0/2434079903 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41effd640 1 --2- 10.20.193.4:0/2434079903 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd276320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41f7fe640 1 --2- 10.20.193.4:0/2434079903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2bb500 0x55d4dd2db8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41e7fc640 1 -- 10.20.193.4:0/2434079903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2bb500 msgr2=0x55d4dd2db8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/2434079903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2bb500 0x55d4dd2db8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41e7fc640 1 -- 10.20.193.4:0/2434079903 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 msgr2=0x55d4dd276320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/2434079903 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd276320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41e7fc640 1 -- 10.20.193.4:0/2434079903 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4dd128340 con 0x55d4dd276860 2026-02-24T09:18:56.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.315+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/2434079903 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd2bafc0 secure :-1 s=READY pgs=1198 gs=1 cs=0 l=1 c_cookie=7367868882501011900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc408005430 tx=0x7fc408005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663fedb6452089bc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.316+0000 7fc3eb7fe640 1 -- 10.20.193.4:0/2434079903 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4080aca30 con 0x55d4dd276860 2026-02-24T09:18:56.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.316+0000 7fc3eb7fe640 1 -- 10.20.193.4:0/2434079903 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc4080adc30 con 0x55d4dd276860 2026-02-24T09:18:56.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.316+0000 7fc3eb7fe640 1 -- 10.20.193.4:0/2434079903 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4080ad050 con 0x55d4dd276860 2026-02-24T09:18:56.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.316+0000 7fc427706e00 1 -- 10.20.193.4:0/2434079903 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 msgr2=0x55d4dd2bafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.316+0000 7fc427706e00 1 --2- 10.20.193.4:0/2434079903 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd2bafc0 secure :-1 s=READY pgs=1198 gs=1 cs=0 l=1 c_cookie=7367868882501011900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc408005430 tx=0x7fc408005890 comp rx=0 tx=0).stop 2026-02-24T09:18:56.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.316+0000 7fc427706e00 1 -- 10.20.193.4:0/2434079903 shutdown_connections 2026-02-24T09:18:56.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.316+0000 7fc427706e00 1 --2- 10.20.193.4:0/2434079903 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2bb500 0x55d4dd2db8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.316+0000 7fc427706e00 1 --2- 10.20.193.4:0/2434079903 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd2bafc0 unknown :-1 s=CLOSED pgs=1198 gs=1 cs=0 l=1 c_cookie=7367868882501011900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.316+0000 7fc427706e00 1 --2- 10.20.193.4:0/2434079903 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd276320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.316+0000 7fc427706e00 1 -- 10.20.193.4:0/2434079903 >> 10.20.193.4:0/2434079903 conn(0x55d4dd194db0 msgr2=0x55d4dd274830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.317+0000 7fc427706e00 1 -- 10.20.193.4:0/2434079903 shutdown_connections 2026-02-24T09:18:56.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.317+0000 7fc427706e00 1 -- 10.20.193.4:0/2434079903 wait complete. 2026-02-24T09:18:56.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc427706e00 1 -- start start 2026-02-24T09:18:56.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc427706e00 1 Processor -- start 2026-02-24T09:18:56.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc427706e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd275f50 0x55d4dd2d2db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc427706e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd276860 0x55d4dd2d32f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc427706e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd2bb500 0x55d4dd2d82e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc427706e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd2d8820 con 0x55d4dd275f50 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc427706e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd2d8990 con 0x55d4dd2bb500 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc427706e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd2d8b50 con 0x55d4dd276860 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc41effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd275f50 0x55d4dd2d2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc41effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd275f50 0x55d4dd2d2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52014/0 (socket says 10.20.193.4:52014) 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc41effd640 1 -- 10.20.193.4:0/3935092356 learned_addr learned my addr 10.20.193.4:0/3935092356 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc41f7fe640 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd2bb500 0x55d4dd2d82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.318+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd276860 0x55d4dd2d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc41effd640 1 -- 10.20.193.4:0/3935092356 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd276860 msgr2=0x55d4dd2d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc41effd640 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd276860 0x55d4dd2d32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc41effd640 1 -- 10.20.193.4:0/3935092356 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd2bb500 msgr2=0x55d4dd2d82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc41effd640 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd2bb500 0x55d4dd2d82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc41effd640 1 -- 10.20.193.4:0/3935092356 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4dd1009d0 con 0x55d4dd275f50 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc41effd640 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd275f50 0x55d4dd2d2db0 secure :-1 s=READY pgs=1199 gs=1 cs=0 l=1 c_cookie=7512714049266446795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc414038820 tx=0x7fc41402f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6842859fad9cf1cb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc3e8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/3935092356 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc414038d50 con 0x55d4dd275f50 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/3935092356 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc4140043a0 con 0x55d4dd275f50 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 1 -- 10.20.193.4:0/3935092356 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc420164b40 con 0x55d4dd275f50 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/3935092356 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc414043400 con 0x55d4dd275f50 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 10 client.17916 _ll_register_callbacks cb 0x55d4dd127080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 1 -- 10.20.193.4:0/3935092356 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d4dcecc4a0 con 0x55d4dd275f50 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/3935092356 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fc414043560 con 0x55d4dd275f50 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/3935092356 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc414043760 con 0x55d4dd275f50 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 10 client.17916 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:56.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 1 -- 10.20.193.4:0/3935092356 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d4dd112710 con 0x55d4dd275f50 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/3935092356 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fc4140439c0 con 0x55d4dd275f50 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 10 client.17916 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 10 client.17916 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 20 client.17916 populate_metadata read hostname 'trial004' 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d4dd2b87b0 0x55d4dd2b8c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 4 client.17916 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.319+0000 7fc427706e00 1 -- 10.20.193.4:0/3935092356 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4dd1727b0 con 0x55d4dd2b87b0 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.320+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d4dd2b87b0 0x55d4dd2b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.320+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d4dd2b87b0 0x55d4dd2b8c50 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=868811170217783189 s_cookie=298602849108956382 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0ea327f9b8ef95 server_cookie=424d9b58e0f14de in_seq=0 out_seq=0 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.320+0000 7fc3e8ff9640 10 client.17916 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/3935092356 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d4dd1727b0 con 0x55d4dd2b87b0 2026-02-24T09:18:56.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc3e8ff9640 10 client.17916 handle_command_reply: tid=0 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 client.17916 shutdown 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 -- 10.20.193.4:0/3935092356 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd275f50 msgr2=0x55d4dd2d2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd275f50 0x55d4dd2d2db0 secure :-1 s=READY pgs=1199 gs=1 cs=0 l=1 c_cookie=7512714049266446795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc414038820 tx=0x7fc41402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 -- 10.20.193.4:0/3935092356 shutdown_connections 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d4dd2b87b0 0x55d4dd2b8c50 crc :-1 s=READY pgs=55 gs=4 cs=0 l=0 c_cookie=868811170217783189 s_cookie=298602849108956382 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd2bb500 0x55d4dd2d82e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd276860 0x55d4dd2d32f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc3e8ff9640 0 client.17916 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 --2- 10.20.193.4:0/3935092356 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd275f50 0x55d4dd2d2db0 unknown :-1 s=CLOSED pgs=1199 gs=1 cs=0 l=1 c_cookie=7512714049266446795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 -- 10.20.193.4:0/3935092356 >> 10.20.193.4:0/3935092356 conn(0x55d4dd194db0 msgr2=0x55d4dd274040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 -- 10.20.193.4:0/3935092356 shutdown_connections 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 1 -- 10.20.193.4:0/3935092356 wait complete. 2026-02-24T09:18:56.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.321+0000 7fc427706e00 20 client.17916 trim_cache size 0 max 16384 2026-02-24T09:18:56.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:55 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4260459780' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:56.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc427706e00 1 Processor -- start 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc427706e00 1 -- start start 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc427706e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd274450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc427706e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd274990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc427706e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2b87b0 0x55d4dd274ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc427706e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd17a9a0 con 0x55d4dd276860 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc427706e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d4dcf56df0 con 0x55d4dd275f50 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc427706e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd2d38d0 con 0x55d4dd2b87b0 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41e7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd274990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41e7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd274990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52018/0 (socket says 10.20.193.4:52018) 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41e7fc640 1 -- 10.20.193.4:0/929661217 learned_addr learned my addr 10.20.193.4:0/929661217 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:56.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41f7fe640 1 --2- 10.20.193.4:0/929661217 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2b87b0 0x55d4dd274ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41effd640 1 --2- 10.20.193.4:0/929661217 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd274450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41e7fc640 1 -- 10.20.193.4:0/929661217 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2b87b0 msgr2=0x55d4dd274ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/929661217 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2b87b0 0x55d4dd274ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41e7fc640 1 -- 10.20.193.4:0/929661217 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 msgr2=0x55d4dd274450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/929661217 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd274450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41e7fc640 1 -- 10.20.193.4:0/929661217 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4dd10d190 con 0x55d4dd276860 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.331+0000 7fc41effd640 1 --2- 10.20.193.4:0/929661217 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd274450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/929661217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd274990 secure :-1 s=READY pgs=1200 gs=1 cs=0 l=1 c_cookie=7347285917445420855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4080a9800 tx=0x7fc4080a94a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f6cd9d44907737 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc3eaffd640 1 -- 10.20.193.4:0/929661217 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4080aca30 con 0x55d4dd276860 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc3eaffd640 1 -- 10.20.193.4:0/929661217 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc4080b2f50 con 0x55d4dd276860 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc3eaffd640 1 -- 10.20.193.4:0/929661217 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4080ae140 con 0x55d4dd276860 2026-02-24T09:18:56.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc427706e00 1 -- 10.20.193.4:0/929661217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 msgr2=0x55d4dd274990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc427706e00 1 --2- 10.20.193.4:0/929661217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd274990 secure :-1 s=READY pgs=1200 gs=1 cs=0 l=1 c_cookie=7347285917445420855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4080a9800 tx=0x7fc4080a94a0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc427706e00 1 -- 10.20.193.4:0/929661217 shutdown_connections 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc427706e00 1 --2- 10.20.193.4:0/929661217 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2b87b0 0x55d4dd274ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc427706e00 1 --2- 10.20.193.4:0/929661217 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd274990 unknown :-1 s=CLOSED pgs=1200 gs=1 cs=0 l=1 c_cookie=7347285917445420855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc427706e00 1 --2- 10.20.193.4:0/929661217 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd274450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc427706e00 1 -- 10.20.193.4:0/929661217 >> 10.20.193.4:0/929661217 conn(0x55d4dd194db0 msgr2=0x55d4dd2d7930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc427706e00 1 -- 10.20.193.4:0/929661217 shutdown_connections 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.332+0000 7fc427706e00 1 -- 10.20.193.4:0/929661217 wait complete. 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 1 -- start start 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 1 Processor -- start 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd255a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd255fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2b87b0 0x55d4dd321100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd2c0370 con 0x55d4dd276860 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd2d8c90 con 0x55d4dd275f50 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d4dd3216c0 con 0x55d4dd2b87b0 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41e7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd255fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41e7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd255fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52030/0 (socket says 10.20.193.4:52030) 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41e7fc640 1 -- 10.20.193.4:0/1916201938 learned_addr learned my addr 10.20.193.4:0/1916201938 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41effd640 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd255a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41e7fc640 1 -- 10.20.193.4:0/1916201938 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2b87b0 msgr2=0x55d4dd321100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2b87b0 0x55d4dd321100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41e7fc640 1 -- 10.20.193.4:0/1916201938 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 msgr2=0x55d4dd255a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd255a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41e7fc640 1 -- 10.20.193.4:0/1916201938 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4dd100d00 con 0x55d4dd276860 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41effd640 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd255a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc41e7fc640 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd255fa0 secure :-1 s=READY pgs=1201 gs=1 cs=0 l=1 c_cookie=12536590258835243924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4080d2010 tx=0x7fc4080adda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfaea6b307f4394 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc3e8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/1916201938 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc408091070 con 0x55d4dd276860 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 1 -- 10.20.193.4:0/1916201938 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4dd128340 con 0x55d4dd276860 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/1916201938 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc4080acdd0 con 0x55d4dd276860 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/1916201938 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4080723c0 con 0x55d4dd276860 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 10 client.17922 _ll_register_callbacks cb 0x55d4dd127080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc427706e00 1 -- 10.20.193.4:0/1916201938 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4080adc30 con 0x55d4dd276860 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.333+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/1916201938 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fc4080e4e40 con 0x55d4dd276860 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/1916201938 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc4080bd070 con 0x55d4dd276860 2026-02-24T09:18:56.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc427706e00 10 client.17922 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc427706e00 1 -- 10.20.193.4:0/1916201938 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d4dd112970 con 0x55d4dd276860 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/1916201938 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fc4080ab210 con 0x55d4dd276860 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc427706e00 10 client.17922 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc427706e00 10 client.17922 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc427706e00 20 client.17922 populate_metadata read hostname 'trial004' 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc427706e00 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d4dd2bb500 0x55d4dd3892a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc427706e00 4 client.17922 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc427706e00 1 -- 10.20.193.4:0/1916201938 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d4dceb1160 con 0x55d4dd2bb500 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc41effd640 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d4dd2bb500 0x55d4dd3892a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc41effd640 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d4dd2bb500 0x55d4dd3892a0 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=12088117061835540604 s_cookie=12231328884853832376 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a7c19e6c120bc87c server_cookie=a9be68d100affab8 in_seq=0 out_seq=0 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.334+0000 7fc3e8ff9640 10 client.17922 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:18:56.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc3e8ff9640 1 -- 10.20.193.4:0/1916201938 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d4dceb1160 con 0x55d4dd2bb500 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc3e8ff9640 10 client.17922 handle_command_reply: tid=0 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 client.17922 shutdown 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 -- 10.20.193.4:0/1916201938 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 msgr2=0x55d4dd255fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd255fa0 secure :-1 s=READY pgs=1201 gs=1 cs=0 l=1 c_cookie=12536590258835243924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4080d2010 tx=0x7fc4080adda0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 -- 10.20.193.4:0/1916201938 shutdown_connections 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55d4dd2bb500 0x55d4dd3892a0 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=12088117061835540604 s_cookie=12231328884853832376 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d4dd2b87b0 0x55d4dd321100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d4dd276860 0x55d4dd255fa0 unknown :-1 s=CLOSED pgs=1201 gs=1 cs=0 l=1 c_cookie=12536590258835243924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc3e8ff9640 0 client.17922 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 --2- 10.20.193.4:0/1916201938 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d4dd275f50 0x55d4dd255a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 -- 10.20.193.4:0/1916201938 >> 10.20.193.4:0/1916201938 conn(0x55d4dd194db0 msgr2=0x55d4dd2d6010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 -- 10.20.193.4:0/1916201938 shutdown_connections 2026-02-24T09:18:56.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 1 -- 10.20.193.4:0/1916201938 wait complete. 2026-02-24T09:18:56.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc427706e00 20 client.17922 trim_cache size 0 max 16384 2026-02-24T09:18:56.346 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:18:56.347 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:55 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4260459780' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:18:56.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 -- 10.20.193.4:0/2304321640 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3f40b56e0 msgr2=0x7fc3f40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3f40b56e0 0x7fc3f40d5b90 secure :-1 s=READY pgs=432 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4140023d0 tx=0x7fc414031040 comp rx=0 tx=0).stop 2026-02-24T09:18:56.347 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 -- 10.20.193.4:0/2304321640 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc420110040 msgr2=0x7fc42011e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc420110040 0x7fc42011e440 secure :-1 s=READY pgs=1197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc408009480 tx=0x7fc40800ee60 comp rx=0 tx=0).stop 2026-02-24T09:18:56.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 -- 10.20.193.4:0/2304321640 shutdown_connections 2026-02-24T09:18:56.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fc3f40b56e0 0x7fc3f40d5b90 unknown :-1 s=CLOSED pgs=432 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fc420115840 0x7fc420123810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fc420110040 0x7fc42011e440 unknown :-1 s=CLOSED pgs=1197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 --2- 10.20.193.4:0/2304321640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc42010f650 0x7fc42011df00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 -- 10.20.193.4:0/2304321640 >> 10.20.193.4:0/2304321640 conn(0x7fc4200ecf20 msgr2=0x7fc42010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 -- 10.20.193.4:0/2304321640 shutdown_connections 2026-02-24T09:18:56.348 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.335+0000 7fc42570c640 1 -- 10.20.193.4:0/2304321640 wait complete. 2026-02-24T09:18:56.490 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:18:56.700 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:56.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.848+0000 7f98a68cc640 1 -- 10.20.193.4:0/2173687781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f98a0062b60 msgr2=0x7f98a0061030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.848+0000 7f98a68cc640 1 --2- 10.20.193.4:0/2173687781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f98a0062b60 0x7f98a0061030 secure :-1 s=READY pgs=1202 gs=1 cs=0 l=1 c_cookie=6034340920641062676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f988c009950 tx=0x7f988c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.848+0000 7f98a68cc640 1 -- 10.20.193.4:0/2173687781 shutdown_connections 2026-02-24T09:18:56.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.848+0000 7f98a68cc640 1 --2- 10.20.193.4:0/2173687781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a0159f20 0x7f98a017a300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.848+0000 7f98a68cc640 1 --2- 10.20.193.4:0/2173687781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f98a0061570 0x7f98a00619a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.848+0000 7f98a68cc640 1 --2- 10.20.193.4:0/2173687781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f98a0062b60 0x7f98a0061030 unknown :-1 s=CLOSED pgs=1202 gs=1 cs=0 l=1 c_cookie=6034340920641062676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.848+0000 7f98a68cc640 1 -- 10.20.193.4:0/2173687781 >> 10.20.193.4:0/2173687781 conn(0x7f98a00eaca0 msgr2=0x7f98a010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.848+0000 7f98a68cc640 1 -- 10.20.193.4:0/2173687781 shutdown_connections 2026-02-24T09:18:56.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.848+0000 7f98a68cc640 1 -- 10.20.193.4:0/2173687781 wait complete. 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a68cc640 1 Processor -- start 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a68cc640 1 -- start start 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a68cc640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f98a0061570 0x7f98a00f2fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a68cc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a0062b60 0x7f98a00f3520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a68cc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f98a0159f20 0x7f98a00f88f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a68cc640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f98a00f8f10 con 0x7f98a0159f20 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a68cc640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f98a00f9080 con 0x7f98a0061570 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a68cc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f98a00f9240 con 0x7f98a0062b60 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a4e42640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f98a0159f20 0x7f98a00f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a4e42640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f98a0159f20 0x7f98a00f88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52048/0 (socket says 10.20.193.4:52048) 2026-02-24T09:18:56.854 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a4e42640 1 -- 10.20.193.4:0/4202232101 learned_addr learned my addr 10.20.193.4:0/4202232101 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:56.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f989ffff640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f98a0061570 0x7f98a00f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f989f7fe640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a0062b60 0x7f98a00f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a4e42640 1 -- 10.20.193.4:0/4202232101 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a0062b60 msgr2=0x7f98a00f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a4e42640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a0062b60 0x7f98a00f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a4e42640 1 -- 10.20.193.4:0/4202232101 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f98a0061570 msgr2=0x7f98a00f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a4e42640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f98a0061570 0x7f98a00f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a4e42640 1 -- 10.20.193.4:0/4202232101 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988c009570 con 0x7f98a0159f20 2026-02-24T09:18:56.855 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f98a4e42640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f98a0159f20 0x7f98a00f88f0 secure :-1 s=READY pgs=1203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f989400f8d0 tx=0x7f989400fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.849+0000 7f989d7fa640 1 -- 10.20.193.4:0/4202232101 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f989400dce0 con 0x7f98a0159f20 2026-02-24T09:18:56.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.850+0000 7f98a68cc640 1 -- 10.20.193.4:0/4202232101 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a00f9520 con 0x7f98a0159f20 2026-02-24T09:18:56.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.850+0000 7f989d7fa640 1 -- 10.20.193.4:0/4202232101 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f989400de40 con 0x7f98a0159f20 2026-02-24T09:18:56.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.850+0000 7f98a68cc640 1 -- 10.20.193.4:0/4202232101 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a00f9c00 con 0x7f98a0159f20 2026-02-24T09:18:56.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.850+0000 7f989d7fa640 1 -- 10.20.193.4:0/4202232101 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f98940116b0 con 0x7f98a0159f20 2026-02-24T09:18:56.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.853+0000 7f989d7fa640 1 -- 10.20.193.4:0/4202232101 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9894020060 con 0x7f98a0159f20 2026-02-24T09:18:56.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.854+0000 7f989d7fa640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f98740b5760 0x7f98740d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.854+0000 7f989d7fa640 1 -- 10.20.193.4:0/4202232101 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9894015070 con 0x7f98a0159f20 2026-02-24T09:18:56.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.854+0000 7f989ffff640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f98740b5760 0x7f98740d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.854+0000 7f989ffff640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f98740b5760 0x7f98740d5c10 secure :-1 s=READY pgs=433 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f988c0023d0 tx=0x7f988c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f98a88c6e00 1 Processor -- start 2026-02-24T09:18:56.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f98a88c6e00 1 -- start start 2026-02-24T09:18:56.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8008d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.864 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b800d1fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 0x564b800f28e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564b7ff9dee0 con 0x564b8008cf50 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564b7ff99c10 con 0x564b800d2500 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564b7ff93d70 con 0x564b8008d860 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f989ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8008d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f989f7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b800d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f989f7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b800d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:51416/0 (socket says 10.20.193.4:51416) 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f989f7fe640 1 -- 10.20.193.4:0/3134186634 learned_addr learned my addr 10.20.193.4:0/3134186634 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f98a4e42640 1 --2- 10.20.193.4:0/3134186634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 0x564b800f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f989ffff640 1 -- 10.20.193.4:0/3134186634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 msgr2=0x564b800d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f989ffff640 1 --2- 10.20.193.4:0/3134186634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b800d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f989ffff640 1 -- 10.20.193.4:0/3134186634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 msgr2=0x564b800f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f989ffff640 1 --2- 10.20.193.4:0/3134186634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 0x564b800f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f989ffff640 1 -- 10.20.193.4:0/3134186634 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7ff3f340 con 0x564b8008cf50 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.859+0000 7f98a4e42640 1 --2- 10.20.193.4:0/3134186634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 0x564b800f28e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f989ffff640 1 --2- 10.20.193.4:0/3134186634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8008d320 secure :-1 s=READY pgs=1204 gs=1 cs=0 l=1 c_cookie=2728840246201661531 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f988c0098a0 tx=0x7f988c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dec9bef3a3b85b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f9870ce3640 1 -- 10.20.193.4:0/3134186634 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f988c002980 con 0x564b8008cf50 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f9870ce3640 1 -- 10.20.193.4:0/3134186634 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f988c002ae0 con 0x564b8008cf50 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f9870ce3640 1 -- 10.20.193.4:0/3134186634 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f988c04f7a0 con 0x564b8008cf50 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f98a88c6e00 1 -- 10.20.193.4:0/3134186634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 msgr2=0x564b8008d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/3134186634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8008d320 secure :-1 s=READY pgs=1204 gs=1 cs=0 l=1 c_cookie=2728840246201661531 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f988c0098a0 tx=0x7f988c040000 comp rx=0 tx=0).stop 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f98a88c6e00 1 -- 10.20.193.4:0/3134186634 shutdown_connections 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/3134186634 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 0x564b800f28e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/3134186634 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b800d1fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.866 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/3134186634 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8008d320 unknown :-1 s=CLOSED pgs=1204 gs=1 cs=0 l=1 c_cookie=2728840246201661531 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f98a88c6e00 1 -- 10.20.193.4:0/3134186634 >> 10.20.193.4:0/3134186634 conn(0x564b7ffabdb0 msgr2=0x564b8008b830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f98a88c6e00 1 -- 10.20.193.4:0/3134186634 shutdown_connections 2026-02-24T09:18:56.867 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.860+0000 7f98a88c6e00 1 -- 10.20.193.4:0/3134186634 wait complete. 2026-02-24T09:18:56.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.861+0000 7f98a88c6e00 1 -- start start 2026-02-24T09:18:56.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.861+0000 7f98a88c6e00 1 Processor -- start 2026-02-24T09:18:56.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.861+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b8008cf50 0x564b800e9d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.861+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b800ea250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.861+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b800d2500 0x564b800ef240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.861+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564b800ef780 con 0x564b800d2500 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.861+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564b800ef8f0 con 0x564b8008cf50 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.861+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564b800efab0 con 0x564b8008d860 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a4e42640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b800d2500 0x564b800ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a4e42640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b800d2500 0x564b800ef240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52080/0 (socket says 10.20.193.4:52080) 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a4e42640 1 -- 10.20.193.4:0/1914967097 learned_addr learned my addr 10.20.193.4:0/1914967097 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f989ffff640 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b8008cf50 0x564b800e9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f989f7fe640 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b800ea250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a4e42640 1 -- 10.20.193.4:0/1914967097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 msgr2=0x564b800ea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a4e42640 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b800ea250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a4e42640 1 -- 10.20.193.4:0/1914967097 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b8008cf50 msgr2=0x564b800e9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a4e42640 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b8008cf50 0x564b800e9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a4e42640 1 -- 10.20.193.4:0/1914967097 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a017af60 con 0x564b800d2500 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f989f7fe640 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b800ea250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a4e42640 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b800d2500 0x564b800ef240 secure :-1 s=READY pgs=1205 gs=1 cs=0 l=1 c_cookie=324724737528280173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98940e57c0 tx=0x7f98940ad920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481a76da627b46d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f9861ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f9861ffb640 1 -- 10.20.193.4:0/1914967097 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9894073400 con 0x564b800d2500 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1914967097 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a00f9c00 con 0x564b800d2500 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f9861ffb640 1 -- 10.20.193.4:0/1914967097 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f989406ce90 con 0x564b800d2500 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f9861ffb640 1 -- 10.20.193.4:0/1914967097 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f98940aef60 con 0x564b800d2500 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 10 client.17934 _ll_register_callbacks cb 0x564b7ff3e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1914967097 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564b7fce34a0 con 0x564b800d2500 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f9861ffb640 1 -- 10.20.193.4:0/1914967097 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f98940ade00 con 0x564b800d2500 2026-02-24T09:18:56.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f9861ffb640 1 -- 10.20.193.4:0/1914967097 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f98940b8d00 con 0x564b800d2500 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 10 client.17934 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1914967097 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564b7ff179d0 con 0x564b800d2500 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f9861ffb640 1 -- 10.20.193.4:0/1914967097 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f989400c550 con 0x564b800d2500 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 10 client.17934 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 10 client.17934 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 20 client.17934 populate_metadata read hostname 'trial004' 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564b800cf630 0x564b800cfad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 4 client.17934 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.862+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1914967097 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b7ff897b0 con 0x564b800cf630 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.863+0000 7f989ffff640 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564b800cf630 0x564b800cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.863+0000 7f9861ffb640 10 client.17934 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.863+0000 7f989ffff640 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564b800cf630 0x564b800cfad0 crc :-1 s=READY pgs=197 gs=4 cs=0 l=0 c_cookie=2180712776009478205 s_cookie=11047556811258002450 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e4372b74333703d server_cookie=9950ce632afafc12 in_seq=0 out_seq=0 2026-02-24T09:18:56.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.863+0000 7f9861ffb640 1 -- 10.20.193.4:0/1914967097 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564b7ff897b0 con 0x564b800cf630 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.863+0000 7f9861ffb640 10 client.17934 handle_command_reply: tid=0 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.863+0000 7f98a88c6e00 1 client.17934 shutdown 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1914967097 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b800d2500 msgr2=0x564b800ef240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b800d2500 0x564b800ef240 secure :-1 s=READY pgs=1205 gs=1 cs=0 l=1 c_cookie=324724737528280173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98940e57c0 tx=0x7f98940ad920 comp rx=0 tx=0).stop 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1914967097 shutdown_connections 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564b800cf630 0x564b800cfad0 crc :-1 s=READY pgs=197 gs=4 cs=0 l=0 c_cookie=2180712776009478205 s_cookie=11047556811258002450 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b800d2500 0x564b800ef240 unknown :-1 s=CLOSED pgs=1205 gs=1 cs=0 l=1 c_cookie=324724737528280173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b800ea250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f9861ffb640 0 client.17934 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1914967097 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b8008cf50 0x564b800e9d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1914967097 >> 10.20.193.4:0/1914967097 conn(0x564b7ffabdb0 msgr2=0x564b8008b040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1914967097 shutdown_connections 2026-02-24T09:18:56.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1914967097 wait complete. 2026-02-24T09:18:56.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.864+0000 7f98a88c6e00 20 client.17934 trim_cache size 0 max 16384 2026-02-24T09:18:56.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f98a88c6e00 1 Processor -- start 2026-02-24T09:18:56.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f98a88c6e00 1 -- start start 2026-02-24T09:18:56.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b8008cf50 0x564b800e6ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008d860 0x564b800e7530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b800d2500 0x564b800cd110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564b7ff919a0 con 0x564b8008d860 2026-02-24T09:18:56.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564b7fd6ddf0 con 0x564b8008cf50 2026-02-24T09:18:56.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564b800efbf0 con 0x564b800d2500 2026-02-24T09:18:56.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f989f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008d860 0x564b800e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f989f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008d860 0x564b800e7530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52082/0 (socket says 10.20.193.4:52082) 2026-02-24T09:18:56.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f989f7fe640 1 -- 10.20.193.4:0/1170701063 learned_addr learned my addr 10.20.193.4:0/1170701063 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:56.883 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f98a4e42640 1 --2- 10.20.193.4:0/1170701063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b800d2500 0x564b800cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f989ffff640 1 --2- 10.20.193.4:0/1170701063 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b8008cf50 0x564b800e6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f989f7fe640 1 -- 10.20.193.4:0/1170701063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b800d2500 msgr2=0x564b800cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f989f7fe640 1 --2- 10.20.193.4:0/1170701063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b800d2500 0x564b800cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f989f7fe640 1 -- 10.20.193.4:0/1170701063 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b8008cf50 msgr2=0x564b800e6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f989f7fe640 1 --2- 10.20.193.4:0/1170701063 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b8008cf50 0x564b800e6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f989f7fe640 1 -- 10.20.193.4:0/1170701063 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b800dc370 con 0x564b8008d860 2026-02-24T09:18:56.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f989f7fe640 1 --2- 10.20.193.4:0/1170701063 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008d860 0x564b800e7530 secure :-1 s=READY pgs=1206 gs=1 cs=0 l=1 c_cookie=8086417319987726930 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9890005f80 tx=0x7f9890002e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7038b9b5776f4a52 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f9863fff640 1 -- 10.20.193.4:0/1170701063 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9890013b40 con 0x564b8008d860 2026-02-24T09:18:56.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f9863fff640 1 -- 10.20.193.4:0/1170701063 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9890013ca0 con 0x564b8008d860 2026-02-24T09:18:56.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.872+0000 7f9863fff640 1 -- 10.20.193.4:0/1170701063 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f98900107e0 con 0x564b8008d860 2026-02-24T09:18:56.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1170701063 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008d860 msgr2=0x564b800e7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1170701063 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008d860 0x564b800e7530 secure :-1 s=READY pgs=1206 gs=1 cs=0 l=1 c_cookie=8086417319987726930 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9890005f80 tx=0x7f9890002e80 comp rx=0 tx=0).stop 2026-02-24T09:18:56.885 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1170701063 shutdown_connections 2026-02-24T09:18:56.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1170701063 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b800d2500 0x564b800cd110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1170701063 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008d860 0x564b800e7530 unknown :-1 s=CLOSED pgs=1206 gs=1 cs=0 l=1 c_cookie=8086417319987726930 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1170701063 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b8008cf50 0x564b800e6ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1170701063 >> 10.20.193.4:0/1170701063 conn(0x564b7ffabdb0 msgr2=0x564b800e68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1170701063 shutdown_connections 2026-02-24T09:18:56.886 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1170701063 wait complete. 2026-02-24T09:18:56.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 -- start start 2026-02-24T09:18:56.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.873+0000 7f98a88c6e00 1 Processor -- start 2026-02-24T09:18:56.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8006c6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b8006cc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 0x564b8006d1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564b80138250 con 0x564b8008cf50 2026-02-24T09:18:56.887 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564b801383c0 con 0x564b800d2500 2026-02-24T09:18:56.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564b80138580 con 0x564b8008d860 2026-02-24T09:18:56.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f989ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8006c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f989ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8006c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52098/0 (socket says 10.20.193.4:52098) 2026-02-24T09:18:56.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f989ffff640 1 -- 10.20.193.4:0/1316290742 learned_addr learned my addr 10.20.193.4:0/1316290742 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:56.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f989f7fe640 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b8006cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.888 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a4e42640 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 0x564b8006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f989ffff640 1 -- 10.20.193.4:0/1316290742 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 msgr2=0x564b8006cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f989ffff640 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b8006cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f989ffff640 1 -- 10.20.193.4:0/1316290742 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 msgr2=0x564b8006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:56.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f989ffff640 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 0x564b8006d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f989ffff640 1 -- 10.20.193.4:0/1316290742 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7ff29710 con 0x564b8008cf50 2026-02-24T09:18:56.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f989ffff640 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8006c6e0 secure :-1 s=READY pgs=1207 gs=1 cs=0 l=1 c_cookie=2961049317726237244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f988c0098a0 tx=0x7f988c005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2917c2aa897c323c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:56.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f9861ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:56.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f9861ffb640 1 -- 10.20.193.4:0/1316290742 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f988c038920 con 0x564b8008cf50 2026-02-24T09:18:56.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f9861ffb640 1 -- 10.20.193.4:0/1316290742 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f988c048040 con 0x564b8008cf50 2026-02-24T09:18:56.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1316290742 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98900026a0 con 0x564b8008cf50 2026-02-24T09:18:56.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f9861ffb640 1 -- 10.20.193.4:0/1316290742 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f988c05ae60 con 0x564b8008cf50 2026-02-24T09:18:56.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 10 client.17940 _ll_register_callbacks cb 0x564b7ff3e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:56.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1316290742 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f988c002ae0 con 0x564b8008cf50 2026-02-24T09:18:56.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f9861ffb640 1 -- 10.20.193.4:0/1316290742 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f988c068450 con 0x564b8008cf50 2026-02-24T09:18:56.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f9861ffb640 1 -- 10.20.193.4:0/1316290742 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f988c068610 con 0x564b8008cf50 2026-02-24T09:18:56.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 10 client.17940 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:56.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1316290742 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564b7ff24190 con 0x564b8008cf50 2026-02-24T09:18:56.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f9861ffb640 1 -- 10.20.193.4:0/1316290742 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f988c05a560 con 0x564b8008cf50 2026-02-24T09:18:56.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 10 client.17940 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:56.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 10 client.17940 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:56.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 20 client.17940 populate_metadata read hostname 'trial004' 2026-02-24T09:18:56.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564b801801c0 0x564b801a0670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:56.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 4 client.17940 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:18:56.892 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.874+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1316290742 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b7fcc8160 con 0x564b801801c0 2026-02-24T09:18:56.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f989f7fe640 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564b801801c0 0x564b801a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:56.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f989f7fe640 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564b801801c0 0x564b801a0670 crc :-1 s=READY pgs=198 gs=4 cs=0 l=0 c_cookie=6066525597979675357 s_cookie=16115503058750750689 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5430a0e3b8648add server_cookie=dfa5c4a5f98f3fe1 in_seq=0 out_seq=0 2026-02-24T09:18:56.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f9861ffb640 10 client.17940 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:56.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f9861ffb640 1 -- 10.20.193.4:0/1316290742 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b7fcc8160 con 0x564b801801c0 2026-02-24T09:18:56.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f9861ffb640 10 client.17940 handle_command_reply: tid=0 2026-02-24T09:18:56.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 client.17940 shutdown 2026-02-24T09:18:56.893 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1316290742 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 msgr2=0x564b8006c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8006c6e0 secure :-1 s=READY pgs=1207 gs=1 cs=0 l=1 c_cookie=2961049317726237244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f988c0098a0 tx=0x7f988c005f80 comp rx=0 tx=0).stop 2026-02-24T09:18:56.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1316290742 shutdown_connections 2026-02-24T09:18:56.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564b801801c0 0x564b801a0670 crc :-1 s=READY pgs=198 gs=4 cs=0 l=0 c_cookie=6066525597979675357 s_cookie=16115503058750750689 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564b800d2500 0x564b8006d1a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564b8008d860 0x564b8006cc20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 --2- 10.20.193.4:0/1316290742 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564b8008cf50 0x564b8006c6e0 unknown :-1 s=CLOSED pgs=1207 gs=1 cs=0 l=1 c_cookie=2961049317726237244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f9861ffb640 0 client.17940 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:56.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1316290742 >> 10.20.193.4:0/1316290742 conn(0x564b7ffabdb0 msgr2=0x564b800e6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1316290742 shutdown_connections 2026-02-24T09:18:56.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 1 -- 10.20.193.4:0/1316290742 wait complete. 2026-02-24T09:18:56.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.875+0000 7f98a88c6e00 20 client.17940 trim_cache size 0 max 16384 2026-02-24T09:18:56.896 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:18:56.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 -- 10.20.193.4:0/4202232101 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f98740b5760 msgr2=0x7f98740d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f98740b5760 0x7f98740d5c10 secure :-1 s=READY pgs=433 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f988c0023d0 tx=0x7f988c031040 comp rx=0 tx=0).stop 2026-02-24T09:18:56.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 -- 10.20.193.4:0/4202232101 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f98a0159f20 msgr2=0x7f98a00f88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:56.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f98a0159f20 0x7f98a00f88f0 secure :-1 s=READY pgs=1203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f989400f8d0 tx=0x7f989400fda0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 -- 10.20.193.4:0/4202232101 shutdown_connections 2026-02-24T09:18:56.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f98740b5760 0x7f98740d5c10 unknown :-1 s=CLOSED pgs=433 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f98a0159f20 0x7f98a00f88f0 unknown :-1 s=CLOSED pgs=1203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a0062b60 0x7f98a00f3520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 --2- 10.20.193.4:0/4202232101 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f98a0061570 0x7f98a00f2fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:56.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 -- 10.20.193.4:0/4202232101 >> 10.20.193.4:0/4202232101 conn(0x7f98a00eaca0 msgr2=0x7f98a010e610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:56.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 -- 10.20.193.4:0/4202232101 shutdown_connections 2026-02-24T09:18:56.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:56.876+0000 7f98a68cc640 1 -- 10.20.193.4:0/4202232101 wait complete. 2026-02-24T09:18:57.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:56 trial004 ceph-mon[41596]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 772 MiB/s wr, 205 op/s 2026-02-24T09:18:57.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:56 trial090 ceph-mon[47278]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 772 MiB/s wr, 205 op/s 2026-02-24T09:18:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:56 trial014 ceph-mon[46941]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 772 MiB/s wr, 205 op/s 2026-02-24T09:18:57.978 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:18:57.978 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:18:58.144 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:58.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 -- 10.20.193.4:0/1114290473 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f395010ccf0 msgr2=0x7f3950111d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 --2- 10.20.193.4:0/1114290473 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f395010ccf0 0x7f3950111d40 secure :-1 s=READY pgs=1208 gs=1 cs=0 l=1 c_cookie=1649779223097788644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3940009950 tx=0x7f394002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 -- 10.20.193.4:0/1114290473 shutdown_connections 2026-02-24T09:18:58.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 --2- 10.20.193.4:0/1114290473 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f39501124f0 0x7f395005fd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 --2- 10.20.193.4:0/1114290473 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f395010ccf0 0x7f3950111d40 unknown :-1 s=CLOSED pgs=1208 gs=1 cs=0 l=1 c_cookie=1649779223097788644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 --2- 10.20.193.4:0/1114290473 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f395010c300 0x7f395010c6d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 -- 10.20.193.4:0/1114290473 >> 10.20.193.4:0/1114290473 conn(0x7f39500e9bf0 msgr2=0x7f395010a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 -- 10.20.193.4:0/1114290473 shutdown_connections 2026-02-24T09:18:58.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 -- 10.20.193.4:0/1114290473 wait complete. 2026-02-24T09:18:58.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 Processor -- start 2026-02-24T09:18:58.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 -- start start 2026-02-24T09:18:58.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f395010c300 0x7f395011c970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f395010ccf0 0x7f395011ceb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39501124f0 0x7f3950122280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f39501228a0 con 0x7f395010c300 2026-02-24T09:18:58.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3950122a10 con 0x7f395010ccf0 2026-02-24T09:18:58.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f3956077640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3950122bd0 con 0x7f39501124f0 2026-02-24T09:18:58.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f394f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f395010c300 0x7f395011c970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f394f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f395010c300 0x7f395011c970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52120/0 (socket says 10.20.193.4:52120) 2026-02-24T09:18:58.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.289+0000 7f394f7fe640 1 -- 10.20.193.4:0/1476571402 learned_addr learned my addr 10.20.193.4:0/1476571402 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:58.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f394effd640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f395010ccf0 0x7f395011ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f394f7fe640 1 -- 10.20.193.4:0/1476571402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39501124f0 msgr2=0x7f3950122280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f394f7fe640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39501124f0 0x7f3950122280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f394f7fe640 1 -- 10.20.193.4:0/1476571402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f395010ccf0 msgr2=0x7f395011ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f394f7fe640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f395010ccf0 0x7f395011ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f394f7fe640 1 -- 10.20.193.4:0/1476571402 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3940009570 con 0x7f395010c300 2026-02-24T09:18:58.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f394f7fe640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f395010c300 0x7f395011c970 secure :-1 s=READY pgs=1209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f393c009480 tx=0x7f393c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f394cff9640 1 -- 10.20.193.4:0/1476571402 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f393c00cd40 con 0x7f395010c300 2026-02-24T09:18:58.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f3956077640 1 -- 10.20.193.4:0/1476571402 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3950122eb0 con 0x7f395010c300 2026-02-24T09:18:58.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f394cff9640 1 -- 10.20.193.4:0/1476571402 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f393c004d30 con 0x7f395010c300 2026-02-24T09:18:58.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f394cff9640 1 -- 10.20.193.4:0/1476571402 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f393c0106e0 con 0x7f395010c300 2026-02-24T09:18:58.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.290+0000 7f3956077640 1 -- 10.20.193.4:0/1476571402 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39501635b0 con 0x7f395010c300 2026-02-24T09:18:58.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.292+0000 7f394cff9640 1 -- 10.20.193.4:0/1476571402 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f393c01f060 con 0x7f395010c300 2026-02-24T09:18:58.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.294+0000 7f394cff9640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f39240b56e0 0x7f39240d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.294+0000 7f394cff9640 1 -- 10.20.193.4:0/1476571402 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f393c014070 con 0x7f395010c300 2026-02-24T09:18:58.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.294+0000 7f394effd640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f39240b56e0 0x7f39240d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.294+0000 7f394effd640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f39240b56e0 0x7f39240d5b90 secure :-1 s=READY pgs=434 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39400098a0 tx=0x7f3940031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f3958071e00 1 Processor -- start 2026-02-24T09:18:58.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f3958071e00 1 -- start start 2026-02-24T09:18:58.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f3958071e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7bb6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f3958071e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 0x5557ba800370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f3958071e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 0x5557ba820c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f3958071e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5557ba6cb520 con 0x5557ba7bb300 2026-02-24T09:18:58.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f3958071e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5557ba6c7250 con 0x5557ba8008b0 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f3958071e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5557ba6c13b0 con 0x5557ba7bbc10 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f394f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7bb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f394f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7bb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52136/0 (socket says 10.20.193.4:52136) 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.297+0000 7f394f7fe640 1 -- 10.20.193.4:0/152929942 learned_addr learned my addr 10.20.193.4:0/152929942 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f394ffff640 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 0x5557ba820c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f394effd640 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 0x5557ba800370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f394f7fe640 1 -- 10.20.193.4:0/152929942 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 msgr2=0x5557ba800370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f394f7fe640 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 0x5557ba800370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f394f7fe640 1 -- 10.20.193.4:0/152929942 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 msgr2=0x5557ba820c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f394f7fe640 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 0x5557ba820c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f394f7fe640 1 -- 10.20.193.4:0/152929942 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ba66c6e0 con 0x5557ba7bb300 2026-02-24T09:18:58.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f394ffff640 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 0x5557ba820c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:58.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f394effd640 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 0x5557ba800370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:58.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f394f7fe640 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7bb6d0 secure :-1 s=READY pgs=1210 gs=1 cs=0 l=1 c_cookie=7488054741800728120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f393c0058d0 tx=0x7f393c0a91f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67eaea1d3fb63638 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f3913fff640 1 -- 10.20.193.4:0/152929942 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f393c0acb50 con 0x5557ba7bb300 2026-02-24T09:18:58.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f3913fff640 1 -- 10.20.193.4:0/152929942 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f393c016330 con 0x5557ba7bb300 2026-02-24T09:18:58.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.298+0000 7f3913fff640 1 -- 10.20.193.4:0/152929942 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f393c072760 con 0x5557ba7bb300 2026-02-24T09:18:58.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.299+0000 7f3958071e00 1 -- 10.20.193.4:0/152929942 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 msgr2=0x5557ba7bb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.299+0000 7f3958071e00 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7bb6d0 secure :-1 s=READY pgs=1210 gs=1 cs=0 l=1 c_cookie=7488054741800728120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f393c0058d0 tx=0x7f393c0a91f0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.299+0000 7f3958071e00 1 -- 10.20.193.4:0/152929942 shutdown_connections 2026-02-24T09:18:58.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.299+0000 7f3958071e00 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 0x5557ba820c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.299+0000 7f3958071e00 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 0x5557ba800370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.299+0000 7f3958071e00 1 --2- 10.20.193.4:0/152929942 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7bb6d0 unknown :-1 s=CLOSED pgs=1210 gs=1 cs=0 l=1 c_cookie=7488054741800728120 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.299+0000 7f3958071e00 1 -- 10.20.193.4:0/152929942 >> 10.20.193.4:0/152929942 conn(0x5557ba6d94f0 msgr2=0x5557ba7b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.299+0000 7f3958071e00 1 -- 10.20.193.4:0/152929942 shutdown_connections 2026-02-24T09:18:58.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.299+0000 7f3958071e00 1 -- 10.20.193.4:0/152929942 wait complete. 2026-02-24T09:18:58.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f3958071e00 1 -- start start 2026-02-24T09:18:58.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f3958071e00 1 Processor -- start 2026-02-24T09:18:58.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f3958071e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7d3170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f3958071e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 0x5557ba7d36b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f3958071e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 0x5557ba7d86a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f3958071e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5557ba7d8be0 con 0x5557ba7bb300 2026-02-24T09:18:58.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f3958071e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5557ba7d8d50 con 0x5557ba8008b0 2026-02-24T09:18:58.311 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f3958071e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5557ba7d8f10 con 0x5557ba7bbc10 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f394f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f394f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7d3170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52138/0 (socket says 10.20.193.4:52138) 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f394f7fe640 1 -- 10.20.193.4:0/3407985910 learned_addr learned my addr 10.20.193.4:0/3407985910 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.300+0000 7f394ffff640 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 0x5557ba7d86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f394effd640 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 0x5557ba7d36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f394f7fe640 1 -- 10.20.193.4:0/3407985910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 msgr2=0x5557ba7d36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f394f7fe640 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 0x5557ba7d36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f394f7fe640 1 -- 10.20.193.4:0/3407985910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 msgr2=0x5557ba7d86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f394f7fe640 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 0x5557ba7d86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f394f7fe640 1 -- 10.20.193.4:0/3407985910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ba644cd0 con 0x5557ba7bb300 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f394ffff640 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 0x5557ba7d86a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:58.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f394effd640 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 0x5557ba7d36b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f394f7fe640 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7d3170 secure :-1 s=READY pgs=1211 gs=1 cs=0 l=1 c_cookie=4639744945813018009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f393c0a98d0 tx=0x7f393c005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4063af721f995599 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f39117fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f39117fa640 1 -- 10.20.193.4:0/3407985910 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f393c0b3070 con 0x5557ba7bb300 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f39117fa640 1 -- 10.20.193.4:0/3407985910 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f393c016330 con 0x5557ba7bb300 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 1 -- 10.20.193.4:0/3407985910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39501635b0 con 0x5557ba7bb300 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f39117fa640 1 -- 10.20.193.4:0/3407985910 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f393c0165c0 con 0x5557ba7bb300 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f39117fa640 1 -- 10.20.193.4:0/3407985910 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f393c06d020 con 0x5557ba7bb300 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f39117fa640 10 client.17952 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 10 client.17952 _ll_register_callbacks cb 0x5557ba63d790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 1 -- 10.20.193.4:0/3407985910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5557ba34e9d0 con 0x5557ba7bb300 2026-02-24T09:18:58.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f39117fa640 1 -- 10.20.193.4:0/3407985910 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f393c0add50 con 0x5557ba7bb300 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 10 client.17952 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 1 -- 10.20.193.4:0/3407985910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5557ba656ab0 con 0x5557ba7bb300 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f39117fa640 1 -- 10.20.193.4:0/3407985910 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f393c0ab330 con 0x5557ba7bb300 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 10 client.17952 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 10 client.17952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 20 client.17952 populate_metadata read hostname 'trial004' 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5557ba7fd710 0x5557ba7fdbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 4 client.17952 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.301+0000 7f3958071e00 1 -- 10.20.193.4:0/3407985910 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557ba6d1b70 con 0x5557ba7fd710 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.302+0000 7f394effd640 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5557ba7fd710 0x5557ba7fdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.314 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.302+0000 7f39117fa640 10 client.17952 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.302+0000 7f394effd640 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5557ba7fd710 0x5557ba7fdbb0 crc :-1 s=READY pgs=199 gs=4 cs=0 l=0 c_cookie=3666107730748986925 s_cookie=5972012193909444570 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32e0a18ea79b562d server_cookie=52e0d97304460fda in_seq=0 out_seq=0 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f39117fa640 1 -- 10.20.193.4:0/3407985910 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5557ba6d1b70 con 0x5557ba7fd710 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f39117fa640 10 client.17952 handle_command_reply: tid=0 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 client.17952 shutdown 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 -- 10.20.193.4:0/3407985910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 msgr2=0x5557ba7d3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7d3170 secure :-1 s=READY pgs=1211 gs=1 cs=0 l=1 c_cookie=4639744945813018009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f393c0a98d0 tx=0x7f393c005570 comp rx=0 tx=0).stop 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 -- 10.20.193.4:0/3407985910 shutdown_connections 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5557ba7fd710 0x5557ba7fdbb0 crc :-1 s=READY pgs=199 gs=4 cs=0 l=0 c_cookie=3666107730748986925 s_cookie=5972012193909444570 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba8008b0 0x5557ba7d86a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba7bbc10 0x5557ba7d36b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407985910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bb300 0x5557ba7d3170 unknown :-1 s=CLOSED pgs=1211 gs=1 cs=0 l=1 c_cookie=4639744945813018009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f39117fa640 0 client.17952 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:58.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 -- 10.20.193.4:0/3407985910 >> 10.20.193.4:0/3407985910 conn(0x5557ba6d94f0 msgr2=0x5557ba7ba2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 -- 10.20.193.4:0/3407985910 shutdown_connections 2026-02-24T09:18:58.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.303+0000 7f3958071e00 1 -- 10.20.193.4:0/3407985910 wait complete. 2026-02-24T09:18:58.316 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.304+0000 7f3958071e00 20 client.17952 trim_cache size 0 max 16384 2026-02-24T09:18:58.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.315+0000 7f3958071e00 1 Processor -- start 2026-02-24T09:18:58.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.315+0000 7f3958071e00 1 -- start start 2026-02-24T09:18:58.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f3958071e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 0x5557ba7d6ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f3958071e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba7d0750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f3958071e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba8008b0 0x5557ba7d0c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f3958071e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5557ba6befe0 con 0x5557ba7bbc10 2026-02-24T09:18:58.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f3958071e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5557ba389fe0 con 0x5557ba7bb300 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f3958071e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5557ba72f4c0 con 0x5557ba8008b0 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba7d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba7d0750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52146/0 (socket says 10.20.193.4:52146) 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394effd640 1 -- 10.20.193.4:0/488775185 learned_addr learned my addr 10.20.193.4:0/488775185 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394ffff640 1 --2- 10.20.193.4:0/488775185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba8008b0 0x5557ba7d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394f7fe640 1 --2- 10.20.193.4:0/488775185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 0x5557ba7d6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394effd640 1 -- 10.20.193.4:0/488775185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba8008b0 msgr2=0x5557ba7d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394effd640 1 --2- 10.20.193.4:0/488775185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba8008b0 0x5557ba7d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394effd640 1 -- 10.20.193.4:0/488775185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 msgr2=0x5557ba7d6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394effd640 1 --2- 10.20.193.4:0/488775185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 0x5557ba7d6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394effd640 1 -- 10.20.193.4:0/488775185 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ba651530 con 0x5557ba7bbc10 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f394effd640 1 --2- 10.20.193.4:0/488775185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba7d0750 secure :-1 s=READY pgs=1212 gs=1 cs=0 l=1 c_cookie=5734005839684120234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3940009950 tx=0x7f394003a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9347ee5e632eaa server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f39137fe640 1 -- 10.20.193.4:0/488775185 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f394003f070 con 0x5557ba7bbc10 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f39137fe640 1 -- 10.20.193.4:0/488775185 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f394004a070 con 0x5557ba7bbc10 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.316+0000 7f39137fe640 1 -- 10.20.193.4:0/488775185 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3940039d40 con 0x5557ba7bbc10 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.317+0000 7f3958071e00 1 -- 10.20.193.4:0/488775185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 msgr2=0x5557ba7d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.317+0000 7f3958071e00 1 --2- 10.20.193.4:0/488775185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba7d0750 secure :-1 s=READY pgs=1212 gs=1 cs=0 l=1 c_cookie=5734005839684120234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3940009950 tx=0x7f394003a000 comp rx=0 tx=0).stop 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.317+0000 7f3958071e00 1 -- 10.20.193.4:0/488775185 shutdown_connections 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.317+0000 7f3958071e00 1 --2- 10.20.193.4:0/488775185 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba8008b0 0x5557ba7d0c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.317+0000 7f3958071e00 1 --2- 10.20.193.4:0/488775185 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba7d0750 unknown :-1 s=CLOSED pgs=1212 gs=1 cs=0 l=1 c_cookie=5734005839684120234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.317+0000 7f3958071e00 1 --2- 10.20.193.4:0/488775185 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 0x5557ba7d6ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.317+0000 7f3958071e00 1 -- 10.20.193.4:0/488775185 >> 10.20.193.4:0/488775185 conn(0x5557ba6d94f0 msgr2=0x5557ba7d63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.317+0000 7f3958071e00 1 -- 10.20.193.4:0/488775185 shutdown_connections 2026-02-24T09:18:58.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.317+0000 7f3958071e00 1 -- 10.20.193.4:0/488775185 wait complete. 2026-02-24T09:18:58.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f3958071e00 1 -- start start 2026-02-24T09:18:58.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f3958071e00 1 Processor -- start 2026-02-24T09:18:58.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f3958071e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 0x5557ba846120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f3958071e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba846660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f3958071e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba8008b0 0x5557ba7db370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f3958071e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5557ba7c5940 con 0x5557ba7bbc10 2026-02-24T09:18:58.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f3958071e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5557ba796650 con 0x5557ba7bb300 2026-02-24T09:18:58.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f3958071e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5557ba7d9050 con 0x5557ba8008b0 2026-02-24T09:18:58.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f394effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba846660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f394f7fe640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 0x5557ba846120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f394effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba846660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52156/0 (socket says 10.20.193.4:52156) 2026-02-24T09:18:58.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.318+0000 7f394effd640 1 -- 10.20.193.4:0/3407645852 learned_addr learned my addr 10.20.193.4:0/3407645852 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:58.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f394ffff640 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba8008b0 0x5557ba7db370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f394effd640 1 -- 10.20.193.4:0/3407645852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba8008b0 msgr2=0x5557ba7db370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f394effd640 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba8008b0 0x5557ba7db370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f394effd640 1 -- 10.20.193.4:0/3407645852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 msgr2=0x5557ba846120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f394effd640 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 0x5557ba846120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f394effd640 1 -- 10.20.193.4:0/3407645852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557ba645000 con 0x5557ba7bbc10 2026-02-24T09:18:58.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f394f7fe640 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 0x5557ba846120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:18:58.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f394effd640 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba846660 secure :-1 s=READY pgs=1213 gs=2 cs=0 l=1 c_cookie=16744182830702312114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3940002e10 tx=0x7f3940002b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85f4991ee34bab2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f39117fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:58.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f39117fa640 1 -- 10.20.193.4:0/3407645852 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f394003f040 con 0x5557ba7bbc10 2026-02-24T09:18:58.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f39117fa640 1 -- 10.20.193.4:0/3407645852 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3940002960 con 0x5557ba7bbc10 2026-02-24T09:18:58.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 1 -- 10.20.193.4:0/3407645852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3950060e70 con 0x5557ba7bbc10 2026-02-24T09:18:58.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f39117fa640 1 -- 10.20.193.4:0/3407645852 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39400549c0 con 0x5557ba7bbc10 2026-02-24T09:18:58.330 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 10 client.17958 _ll_register_callbacks cb 0x5557ba63d790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 1 -- 10.20.193.4:0/3407645852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5557ba6d37e0 con 0x5557ba7bbc10 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f39117fa640 1 -- 10.20.193.4:0/3407645852 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3940054b60 con 0x5557ba7bbc10 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f39117fa640 1 -- 10.20.193.4:0/3407645852 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3940054d80 con 0x5557ba7bbc10 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 10 client.17958 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 1 -- 10.20.193.4:0/3407645852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5557ba656d10 con 0x5557ba7bbc10 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f39117fa640 1 -- 10.20.193.4:0/3407645852 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f394006e070 con 0x5557ba7bbc10 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 10 client.17958 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 10 client.17958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 20 client.17958 populate_metadata read hostname 'trial004' 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5557ba8ae2d0 0x5557ba8ce780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.331 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 4 client.17958 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.319+0000 7f3958071e00 1 -- 10.20.193.4:0/3407645852 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5557ba34c220 con 0x5557ba8ae2d0 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.320+0000 7f394f7fe640 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5557ba8ae2d0 0x5557ba8ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.320+0000 7f394f7fe640 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5557ba8ae2d0 0x5557ba8ce780 crc :-1 s=READY pgs=200 gs=4 cs=0 l=0 c_cookie=3710819295778314049 s_cookie=11814490628699228302 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=337f7a7d1e881741 server_cookie=a3f580a185cc888e in_seq=0 out_seq=0 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.320+0000 7f39117fa640 10 client.17958 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f39117fa640 1 -- 10.20.193.4:0/3407645852 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5557ba34c220 con 0x5557ba8ae2d0 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f39117fa640 10 client.17958 handle_command_reply: tid=0 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 client.17958 shutdown 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 -- 10.20.193.4:0/3407645852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 msgr2=0x5557ba846660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba846660 secure :-1 s=READY pgs=1213 gs=2 cs=0 l=1 c_cookie=16744182830702312114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3940002e10 tx=0x7f3940002b00 comp rx=0 tx=0).stop 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 -- 10.20.193.4:0/3407645852 shutdown_connections 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5557ba8ae2d0 0x5557ba8ce780 crc :-1 s=READY pgs=200 gs=4 cs=0 l=0 c_cookie=3710819295778314049 s_cookie=11814490628699228302 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5557ba8008b0 0x5557ba7db370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5557ba7bbc10 0x5557ba846660 unknown :-1 s=CLOSED pgs=1213 gs=2 cs=0 l=1 c_cookie=16744182830702312114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f39117fa640 0 client.17958 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:58.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 --2- 10.20.193.4:0/3407645852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5557ba7bb300 0x5557ba846120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 -- 10.20.193.4:0/3407645852 >> 10.20.193.4:0/3407645852 conn(0x5557ba6d94f0 msgr2=0x5557ba7d6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 -- 10.20.193.4:0/3407645852 shutdown_connections 2026-02-24T09:18:58.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 1 -- 10.20.193.4:0/3407645852 wait complete. 2026-02-24T09:18:58.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3958071e00 20 client.17958 trim_cache size 0 max 16384 2026-02-24T09:18:58.333 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:18:58.334 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:18:58.334 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "b703ea3c-d980-4a3f-b2c3-714d8f9ad80d", 2026-02-24T09:18:58.334 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:18:58.334 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:18:58.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3956077640 1 -- 10.20.193.4:0/1476571402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f39240b56e0 msgr2=0x7f39240d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3956077640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f39240b56e0 0x7f39240d5b90 secure :-1 s=READY pgs=434 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39400098a0 tx=0x7f3940031040 comp rx=0 tx=0).stop 2026-02-24T09:18:58.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3956077640 1 -- 10.20.193.4:0/1476571402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f395010c300 msgr2=0x7f395011c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.321+0000 7f3956077640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f395010c300 0x7f395011c970 secure :-1 s=READY pgs=1209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f393c009480 tx=0x7f393c00ee60 comp rx=0 tx=0).stop 2026-02-24T09:18:58.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.322+0000 7f3956077640 1 -- 10.20.193.4:0/1476571402 shutdown_connections 2026-02-24T09:18:58.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.322+0000 7f3956077640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f39240b56e0 0x7f39240d5b90 unknown :-1 s=CLOSED pgs=434 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.322+0000 7f3956077640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39501124f0 0x7f3950122280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.322+0000 7f3956077640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f395010ccf0 0x7f395011ceb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.322+0000 7f3956077640 1 --2- 10.20.193.4:0/1476571402 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f395010c300 0x7f395011c970 unknown :-1 s=CLOSED pgs=1209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.322+0000 7f3956077640 1 -- 10.20.193.4:0/1476571402 >> 10.20.193.4:0/1476571402 conn(0x7f39500e9bf0 msgr2=0x7f3950109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.322+0000 7f3956077640 1 -- 10.20.193.4:0/1476571402 shutdown_connections 2026-02-24T09:18:58.336 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.322+0000 7f3956077640 1 -- 10.20.193.4:0/1476571402 wait complete. 2026-02-24T09:18:58.420 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:18:58.600 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:58.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.763+0000 7f5ebc84a640 1 -- 10.20.193.4:0/4003770773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5eb4115840 msgr2=0x7f5eb4176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.763+0000 7f5ebc84a640 1 --2- 10.20.193.4:0/4003770773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5eb4115840 0x7f5eb4176210 secure :-1 s=READY pgs=1214 gs=1 cs=0 l=1 c_cookie=607857203827911006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea800aa30 tx=0x7f5ea8030280 comp rx=0 tx=0).stop 2026-02-24T09:18:58.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.763+0000 7f5ebc84a640 1 -- 10.20.193.4:0/4003770773 shutdown_connections 2026-02-24T09:18:58.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.763+0000 7f5ebc84a640 1 --2- 10.20.193.4:0/4003770773 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5eb4115840 0x7f5eb4176210 unknown :-1 s=CLOSED pgs=1214 gs=1 cs=0 l=1 c_cookie=607857203827911006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.763+0000 7f5ebc84a640 1 --2- 10.20.193.4:0/4003770773 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb4110040 0x7f5eb4115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.763+0000 7f5ebc84a640 1 --2- 10.20.193.4:0/4003770773 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5eb410f650 0x7f5eb410fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.763+0000 7f5ebc84a640 1 -- 10.20.193.4:0/4003770773 >> 10.20.193.4:0/4003770773 conn(0x7f5eb40ecf20 msgr2=0x7f5eb410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.763+0000 7f5ebc84a640 1 -- 10.20.193.4:0/4003770773 shutdown_connections 2026-02-24T09:18:58.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.763+0000 7f5ebc84a640 1 -- 10.20.193.4:0/4003770773 wait complete. 2026-02-24T09:18:58.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.763+0000 7f5ebc84a640 1 Processor -- start 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5ebc84a640 1 -- start start 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5ebc84a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5eb410f650 0x7f5eb411deb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5ebc84a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb4110040 0x7f5eb411e3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5ebc84a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5eb4115840 0x7f5eb41237c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5ebc84a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb4123d50 con 0x7f5eb410f650 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5ebc84a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb4123ec0 con 0x7f5eb4115840 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5ebc84a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb4124080 con 0x7f5eb4110040 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5eba5bf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5eb410f650 0x7f5eb411deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5eba5bf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5eb410f650 0x7f5eb411deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52166/0 (socket says 10.20.193.4:52166) 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5eba5bf640 1 -- 10.20.193.4:0/3041935503 learned_addr learned my addr 10.20.193.4:0/3041935503 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5eb9dbe640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb4110040 0x7f5eb411e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.770 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5ebadc0640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5eb4115840 0x7f5eb41237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5eba5bf640 1 -- 10.20.193.4:0/3041935503 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb4110040 msgr2=0x7f5eb411e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb4110040 0x7f5eb411e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5eba5bf640 1 -- 10.20.193.4:0/3041935503 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5eb4115840 msgr2=0x7f5eb41237c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5eb4115840 0x7f5eb41237c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5eba5bf640 1 -- 10.20.193.4:0/3041935503 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea800a650 con 0x7f5eb410f650 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5eb410f650 0x7f5eb411deb0 secure :-1 s=READY pgs=1215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eac00c9b0 tx=0x7f5eac00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5e9f7fe640 1 -- 10.20.193.4:0/3041935503 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5eac0044a0 con 0x7f5eb410f650 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5ebc84a640 1 -- 10.20.193.4:0/3041935503 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb4124360 con 0x7f5eb410f650 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5e9f7fe640 1 -- 10.20.193.4:0/3041935503 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5eac007da0 con 0x7f5eb410f650 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5e9f7fe640 1 -- 10.20.193.4:0/3041935503 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5eac018670 con 0x7f5eb410f650 2026-02-24T09:18:58.771 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.764+0000 7f5ebc84a640 1 -- 10.20.193.4:0/3041935503 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb4164af0 con 0x7f5eb410f650 2026-02-24T09:18:58.772 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.767+0000 7f5e9f7fe640 1 -- 10.20.193.4:0/3041935503 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f5eac020070 con 0x7f5eb410f650 2026-02-24T09:18:58.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.769+0000 7f5e9f7fe640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e900b56e0 0x7f5e900d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.770+0000 7f5eb9dbe640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e900b56e0 0x7f5e900d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.773 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.770+0000 7f5e9f7fe640 1 -- 10.20.193.4:0/3041935503 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f5eac0e6c70 con 0x7f5eb410f650 2026-02-24T09:18:58.774 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.770+0000 7f5eb9dbe640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e900b56e0 0x7f5e900d5b90 secure :-1 s=READY pgs=435 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eb4124850 tx=0x7f5ea0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5ebe844e00 1 Processor -- start 2026-02-24T09:18:58.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5ebe844e00 1 -- start start 2026-02-24T09:18:58.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 0x55d843bf0bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf1130 0x55d843c35890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c561b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d843b00de0 con 0x55d843c35dd0 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d843afcb10 con 0x55d843bf1130 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d843af6ab0 con 0x55d843bf0820 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5eba5bf640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 0x55d843bf0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5eba5bf640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 0x55d843bf0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:51534/0 (socket says 10.20.193.4:51534) 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5eba5bf640 1 -- 10.20.193.4:0/3386086835 learned_addr learned my addr 10.20.193.4:0/3386086835 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5ebadc0640 1 --2- 10.20.193.4:0/3386086835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5eb9dbe640 1 --2- 10.20.193.4:0/3386086835 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf1130 0x55d843c35890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5eba5bf640 1 -- 10.20.193.4:0/3386086835 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf1130 msgr2=0x55d843c35890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3386086835 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf1130 0x55d843c35890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5eba5bf640 1 -- 10.20.193.4:0/3386086835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 msgr2=0x55d843c561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3386086835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5eba5bf640 1 -- 10.20.193.4:0/3386086835 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d843aa2310 con 0x55d843bf0820 2026-02-24T09:18:58.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3386086835 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 0x55d843bf0bf0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=13842095906044887078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eac0e4710 tx=0x7f5eac002d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c01900e352b1c026 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5e9ccf3640 1 -- 10.20.193.4:0/3386086835 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5eac0ad9a0 con 0x55d843bf0820 2026-02-24T09:18:58.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5e9ccf3640 1 -- 10.20.193.4:0/3386086835 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5eac0b2cc0 con 0x55d843bf0820 2026-02-24T09:18:58.778 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.772+0000 7f5e9ccf3640 1 -- 10.20.193.4:0/3386086835 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5eac0af0e0 con 0x55d843bf0820 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.773+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3386086835 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 msgr2=0x55d843bf0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.773+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3386086835 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 0x55d843bf0bf0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=13842095906044887078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eac0e4710 tx=0x7f5eac002d20 comp rx=0 tx=0).stop 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.773+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3386086835 shutdown_connections 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.773+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3386086835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c561b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.773+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3386086835 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf1130 0x55d843c35890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.773+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3386086835 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 0x55d843bf0bf0 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=13842095906044887078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.773+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3386086835 >> 10.20.193.4:0/3386086835 conn(0x55d843b0f6b0 msgr2=0x55d843bef100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.773+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3386086835 shutdown_connections 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.773+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3386086835 wait complete. 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.774+0000 7f5ebe844e00 1 -- start start 2026-02-24T09:18:58.783 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.774+0000 7f5ebe844e00 1 Processor -- start 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 0x55d843c08e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf1130 0x55d843c09370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c0e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d843c0e8a0 con 0x55d843c35dd0 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d843c0ea10 con 0x55d843bf1130 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d843c0ebd0 con 0x55d843bf0820 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebadc0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c0e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebadc0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c0e360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52178/0 (socket says 10.20.193.4:52178) 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebadc0640 1 -- 10.20.193.4:0/3594284934 learned_addr learned my addr 10.20.193.4:0/3594284934 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5eb9dbe640 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf1130 0x55d843c09370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.784 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 0x55d843c08e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebadc0640 1 -- 10.20.193.4:0/3594284934 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 msgr2=0x55d843c08e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebadc0640 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 0x55d843c08e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebadc0640 1 -- 10.20.193.4:0/3594284934 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf1130 msgr2=0x55d843c09370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebadc0640 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf1130 0x55d843c09370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebadc0640 1 -- 10.20.193.4:0/3594284934 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d843a7a8c0 con 0x55d843c35dd0 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebadc0640 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c0e360 secure :-1 s=READY pgs=1216 gs=1 cs=0 l=1 c_cookie=16942122358433369702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea800a230 tx=0x7f5ea8039470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1e8285939fce66 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5e67fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5e67fff640 1 -- 10.20.193.4:0/3594284934 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea803e040 con 0x55d843c35dd0 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3594284934 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb4164af0 con 0x55d843c35dd0 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5e67fff640 1 -- 10.20.193.4:0/3594284934 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5ea8003bb0 con 0x55d843c35dd0 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5e67fff640 1 -- 10.20.193.4:0/3594284934 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea80446f0 con 0x55d843c35dd0 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebe844e00 10 client.17970 _ll_register_callbacks cb 0x55d843a92160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:58.785 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3594284934 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d8438464a0 con 0x55d843c35dd0 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.775+0000 7f5e67fff640 1 -- 10.20.193.4:0/3594284934 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f5ea8044880 con 0x55d843c35dd0 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5e67fff640 1 -- 10.20.193.4:0/3594284934 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5ea8044a40 con 0x55d843c35dd0 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5ebe844e00 10 client.17970 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3594284934 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d843a8c6e0 con 0x55d843c35dd0 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5e67fff640 1 -- 10.20.193.4:0/3594284934 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f5ea80050c0 con 0x55d843c35dd0 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5ebe844e00 10 client.17970 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5ebe844e00 10 client.17970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5ebe844e00 20 client.17970 populate_metadata read hostname 'trial004' 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d843c33660 0x55d843c33b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5ebe844e00 4 client.17970 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3594284934 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d843aec4f0 con 0x55d843c33660 2026-02-24T09:18:58.786 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d843c33660 0x55d843c33b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5e67fff640 10 client.17970 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.776+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d843c33660 0x55d843c33b00 crc :-1 s=READY pgs=201 gs=4 cs=0 l=0 c_cookie=11010188903203204672 s_cookie=17274441636824118204 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98cc0c79155fee40 server_cookie=efbb2525101e73bc in_seq=0 out_seq=0 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5e67fff640 1 -- 10.20.193.4:0/3594284934 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d843aec4f0 con 0x55d843c33660 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5e67fff640 10 client.17970 handle_command_reply: tid=0 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 client.17970 shutdown 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3594284934 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 msgr2=0x55d843c0e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c0e360 secure :-1 s=READY pgs=1216 gs=1 cs=0 l=1 c_cookie=16942122358433369702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea800a230 tx=0x7f5ea8039470 comp rx=0 tx=0).stop 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3594284934 shutdown_connections 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d843c33660 0x55d843c33b00 crc :-1 s=READY pgs=201 gs=4 cs=0 l=0 c_cookie=11010188903203204672 s_cookie=17274441636824118204 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c0e360 unknown :-1 s=CLOSED pgs=1216 gs=1 cs=0 l=1 c_cookie=16942122358433369702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf1130 0x55d843c09370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3594284934 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf0820 0x55d843c08e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.787 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5e67fff640 0 client.17970 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:58.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3594284934 >> 10.20.193.4:0/3594284934 conn(0x55d843b0f6b0 msgr2=0x55d843bef810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3594284934 shutdown_connections 2026-02-24T09:18:58.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3594284934 wait complete. 2026-02-24T09:18:58.788 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.777+0000 7f5ebe844e00 20 client.17970 trim_cache size 0 max 16384 2026-02-24T09:18:58.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.788+0000 7f5ebe844e00 1 Processor -- start 2026-02-24T09:18:58.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.788+0000 7f5ebe844e00 1 -- start start 2026-02-24T09:18:58.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf0820 0x55d843c06430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843bf1130 0x55d843c2e840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843c35dd0 0x55d843c2ed80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d843af46e0 con 0x55d843bf1130 2026-02-24T09:18:58.798 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d8437bff50 con 0x55d843bf0820 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d843b64410 con 0x55d843c35dd0 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5eb9dbe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843bf1130 0x55d843c2e840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5eb9dbe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843bf1130 0x55d843c2e840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52192/0 (socket says 10.20.193.4:52192) 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5eb9dbe640 1 -- 10.20.193.4:0/1226172712 learned_addr learned my addr 10.20.193.4:0/1226172712 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5ebadc0640 1 --2- 10.20.193.4:0/1226172712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843c35dd0 0x55d843c2ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/1226172712 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf0820 0x55d843c06430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5eb9dbe640 1 -- 10.20.193.4:0/1226172712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843c35dd0 msgr2=0x55d843c2ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5eb9dbe640 1 --2- 10.20.193.4:0/1226172712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843c35dd0 0x55d843c2ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5eb9dbe640 1 -- 10.20.193.4:0/1226172712 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf0820 msgr2=0x55d843c06430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5eb9dbe640 1 --2- 10.20.193.4:0/1226172712 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf0820 0x55d843c06430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5eb9dbe640 1 -- 10.20.193.4:0/1226172712 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d843a87160 con 0x55d843bf1130 2026-02-24T09:18:58.799 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5eb9dbe640 1 --2- 10.20.193.4:0/1226172712 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843bf1130 0x55d843c2e840 secure :-1 s=READY pgs=1217 gs=1 cs=0 l=1 c_cookie=11571040010782622201 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea0009c50 tx=0x7f5ea0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09497957487c1f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5e824e6640 1 -- 10.20.193.4:0/1226172712 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea0011ea0 con 0x55d843bf1130 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5e824e6640 1 -- 10.20.193.4:0/1226172712 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5ea0023040 con 0x55d843bf1130 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.789+0000 7f5e824e6640 1 -- 10.20.193.4:0/1226172712 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea001da30 con 0x55d843bf1130 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.790+0000 7f5ebe844e00 1 -- 10.20.193.4:0/1226172712 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843bf1130 msgr2=0x55d843c2e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.790+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/1226172712 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843bf1130 0x55d843c2e840 secure :-1 s=READY pgs=1217 gs=1 cs=0 l=1 c_cookie=11571040010782622201 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea0009c50 tx=0x7f5ea0013000 comp rx=0 tx=0).stop 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.790+0000 7f5ebe844e00 1 -- 10.20.193.4:0/1226172712 shutdown_connections 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.790+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/1226172712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843c35dd0 0x55d843c2ed80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.790+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/1226172712 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843bf1130 0x55d843c2e840 unknown :-1 s=CLOSED pgs=1217 gs=1 cs=0 l=1 c_cookie=11571040010782622201 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.790+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/1226172712 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf0820 0x55d843c06430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.790+0000 7f5ebe844e00 1 -- 10.20.193.4:0/1226172712 >> 10.20.193.4:0/1226172712 conn(0x55d843b0f6b0 msgr2=0x55d843beea00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.790+0000 7f5ebe844e00 1 -- 10.20.193.4:0/1226172712 shutdown_connections 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.790+0000 7f5ebe844e00 1 -- 10.20.193.4:0/1226172712 wait complete. 2026-02-24T09:18:58.800 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebe844e00 1 -- start start 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebe844e00 1 Processor -- start 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf0820 0x55d843c113d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf1130 0x55d843c11910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebe844e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c146b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d843c0ed10 con 0x55d843c35dd0 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d843c14c20 con 0x55d843bf0820 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebe844e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d843c14de0 con 0x55d843bf1130 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebadc0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c146b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5eb9dbe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf1130 0x55d843c11910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebadc0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c146b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52194/0 (socket says 10.20.193.4:52194) 2026-02-24T09:18:58.801 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebadc0640 1 -- 10.20.193.4:0/3506962639 learned_addr learned my addr 10.20.193.4:0/3506962639 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf0820 0x55d843c113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebadc0640 1 -- 10.20.193.4:0/3506962639 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf1130 msgr2=0x55d843c11910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebadc0640 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf1130 0x55d843c11910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebadc0640 1 -- 10.20.193.4:0/3506962639 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf0820 msgr2=0x55d843c113d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebadc0640 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf0820 0x55d843c113d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebadc0640 1 -- 10.20.193.4:0/3506962639 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d843a7abf0 con 0x55d843c35dd0 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5ebadc0640 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c146b0 secure :-1 s=READY pgs=1218 gs=3 cs=0 l=1 c_cookie=11654645611506256942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea8007010 tx=0x7f5ea8006eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bd9e6f48e54c2e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5e67fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5e67fff640 1 -- 10.20.193.4:0/3506962639 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea803e040 con 0x55d843c35dd0 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5e67fff640 1 -- 10.20.193.4:0/3506962639 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55d8438464a0 con 0x55d843c35dd0 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.791+0000 7f5e67fff640 1 -- 10.20.193.4:0/3506962639 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea804c630 con 0x55d843c35dd0 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3506962639 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea0009910 con 0x55d843c35dd0 2026-02-24T09:18:58.802 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5e67fff640 1 -- 10.20.193.4:0/3506962639 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f5ea804d400 con 0x55d843c35dd0 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5e67fff640 10 client.17976 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 10 client.17976 _ll_register_callbacks cb 0x55d843a92160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3506962639 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d843781f40 con 0x55d843c35dd0 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5e67fff640 1 -- 10.20.193.4:0/3506962639 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5ea8003bb0 con 0x55d843c35dd0 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 10 client.17976 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3506962639 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d843a8c940 con 0x55d843c35dd0 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5e67fff640 1 -- 10.20.193.4:0/3506962639 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f5ea804d5c0 con 0x55d843c35dd0 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 10 client.17976 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 10 client.17976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 20 client.17976 populate_metadata read hostname 'trial004' 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d843c7d950 0x55d843c7ddf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:58.803 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 4 client.17976 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3506962639 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f5eac0b2cc0 con 0x55d843c7d950 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.792+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d843c7d950 0x55d843c7ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5eba5bf640 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d843c7d950 0x55d843c7ddf0 crc :-1 s=READY pgs=202 gs=4 cs=0 l=0 c_cookie=3241964348072981231 s_cookie=16798686274090254787 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cfdc565dd5ef2ef server_cookie=e920ec29bc6141c3 in_seq=0 out_seq=0 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5e67fff640 10 client.17976 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5e67fff640 1 -- 10.20.193.4:0/3506962639 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x7f5eac0b2cc0 con 0x55d843c7d950 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5e67fff640 10 client.17976 handle_command_reply: tid=0 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 client.17976 shutdown 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3506962639 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 msgr2=0x55d843c146b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c146b0 secure :-1 s=READY pgs=1218 gs=3 cs=0 l=1 c_cookie=11654645611506256942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea8007010 tx=0x7f5ea8006eb0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3506962639 shutdown_connections 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d843c7d950 0x55d843c7ddf0 crc :-1 s=READY pgs=202 gs=4 cs=0 l=0 c_cookie=3241964348072981231 s_cookie=16798686274090254787 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d843c35dd0 0x55d843c146b0 unknown :-1 s=CLOSED pgs=1218 gs=3 cs=0 l=1 c_cookie=11654645611506256942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.804 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d843bf1130 0x55d843c11910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 --2- 10.20.193.4:0/3506962639 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d843bf0820 0x55d843c113d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5e67fff640 0 client.17976 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:18:58.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3506962639 >> 10.20.193.4:0/3506962639 conn(0x55d843b0f6b0 msgr2=0x55d843bef1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3506962639 shutdown_connections 2026-02-24T09:18:58.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 1 -- 10.20.193.4:0/3506962639 wait complete. 2026-02-24T09:18:58.805 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.793+0000 7f5ebe844e00 20 client.17976 trim_cache size 0 max 16384 2026-02-24T09:18:58.805 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: "b703ea3c-d980-4a3f-b2c3-714d8f9ad80d": { 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:58.321748+0000", 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.806 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.807 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.808 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:18:58.809 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.810 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.811 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:18:58.812 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.813 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.814 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:18:58.815 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:18:58.816 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:18:58.817 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:18:58.817 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:18:58.817 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:18:58.817 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:18:58.817 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:18:58.817 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:58.817 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:18:58.817 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:18:58.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 -- 10.20.193.4:0/3041935503 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e900b56e0 msgr2=0x7f5e900d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.817 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e900b56e0 0x7f5e900d5b90 secure :-1 s=READY pgs=435 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eb4124850 tx=0x7f5ea0005f90 comp rx=0 tx=0).stop 2026-02-24T09:18:58.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 -- 10.20.193.4:0/3041935503 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5eb410f650 msgr2=0x7f5eb411deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:58.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5eb410f650 0x7f5eb411deb0 secure :-1 s=READY pgs=1215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eac00c9b0 tx=0x7f5eac00ce80 comp rx=0 tx=0).stop 2026-02-24T09:18:58.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 -- 10.20.193.4:0/3041935503 shutdown_connections 2026-02-24T09:18:58.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f5e900b56e0 0x7f5e900d5b90 unknown :-1 s=CLOSED pgs=435 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f5eb4115840 0x7f5eb41237c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb4110040 0x7f5eb411e3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 --2- 10.20.193.4:0/3041935503 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5eb410f650 0x7f5eb411deb0 unknown :-1 s=CLOSED pgs=1215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:58.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 -- 10.20.193.4:0/3041935503 >> 10.20.193.4:0/3041935503 conn(0x7f5eb40ecf20 msgr2=0x7f5eb410d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:58.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 -- 10.20.193.4:0/3041935503 shutdown_connections 2026-02-24T09:18:58.818 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:58.794+0000 7f5ebc84a640 1 -- 10.20.193.4:0/3041935503 wait complete. 2026-02-24T09:18:58.904 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:18:58.905 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:18:59.074 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:59.152 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:58 trial004 ceph-mon[41596]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 883 MiB/s wr, 244 op/s 2026-02-24T09:18:59.153 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:58 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:18:59.153 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:58 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:59.153 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:58 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:18:59.153 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:58 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:59.153 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:58 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:18:59.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.221+0000 7efc71bce640 1 -- 10.20.193.4:0/4169965471 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc6c114780 msgr2=0x7efc6c1762b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.221+0000 7efc71bce640 1 --2- 10.20.193.4:0/4169965471 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc6c114780 0x7efc6c1762b0 secure :-1 s=READY pgs=1219 gs=1 cs=0 l=1 c_cookie=12094519843026548454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc6000aa30 tx=0x7efc60030280 comp rx=0 tx=0).stop 2026-02-24T09:18:59.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.221+0000 7efc71bce640 1 -- 10.20.193.4:0/4169965471 shutdown_connections 2026-02-24T09:18:59.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.221+0000 7efc71bce640 1 --2- 10.20.193.4:0/4169965471 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc6c114780 0x7efc6c1762b0 unknown :-1 s=CLOSED pgs=1219 gs=1 cs=0 l=1 c_cookie=12094519843026548454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.221+0000 7efc71bce640 1 --2- 10.20.193.4:0/4169965471 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc6c10c260 0x7efc6c114000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.221+0000 7efc71bce640 1 --2- 10.20.193.4:0/4169965471 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc6c10b8c0 0x7efc6c10bc90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.221+0000 7efc71bce640 1 -- 10.20.193.4:0/4169965471 >> 10.20.193.4:0/4169965471 conn(0x7efc6c0e9370 msgr2=0x7efc6c109780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:59.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.221+0000 7efc71bce640 1 -- 10.20.193.4:0/4169965471 shutdown_connections 2026-02-24T09:18:59.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.221+0000 7efc71bce640 1 -- 10.20.193.4:0/4169965471 wait complete. 2026-02-24T09:18:59.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc71bce640 1 Processor -- start 2026-02-24T09:18:59.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc71bce640 1 -- start start 2026-02-24T09:18:59.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc71bce640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc6c10b8c0 0x7efc6c11e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc71bce640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc6c10c260 0x7efc6c11e550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc71bce640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc6c114780 0x7efc6c123920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc71bce640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c123f40 con 0x7efc6c10b8c0 2026-02-24T09:18:59.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc71bce640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c1240b0 con 0x7efc6c114780 2026-02-24T09:18:59.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc71bce640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c124270 con 0x7efc6c10c260 2026-02-24T09:18:59.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc6c10b8c0 0x7efc6c11e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc6c10b8c0 0x7efc6c11e010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52224/0 (socket says 10.20.193.4:52224) 2026-02-24T09:18:59.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6b7fe640 1 -- 10.20.193.4:0/2555193351 learned_addr learned my addr 10.20.193.4:0/2555193351 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:59.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6affd640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc6c10c260 0x7efc6c11e550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6bfff640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc6c114780 0x7efc6c123920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6b7fe640 1 -- 10.20.193.4:0/2555193351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc6c10c260 msgr2=0x7efc6c11e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6b7fe640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc6c10c260 0x7efc6c11e550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6b7fe640 1 -- 10.20.193.4:0/2555193351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc6c114780 msgr2=0x7efc6c123920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6b7fe640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc6c114780 0x7efc6c123920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6b7fe640 1 -- 10.20.193.4:0/2555193351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6000a650 con 0x7efc6c10b8c0 2026-02-24T09:18:59.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc6b7fe640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc6c10b8c0 0x7efc6c11e010 secure :-1 s=READY pgs=1220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc5800d950 tx=0x7efc5800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:59.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc68ff9640 1 -- 10.20.193.4:0/2555193351 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc58004540 con 0x7efc6c10b8c0 2026-02-24T09:18:59.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc71bce640 1 -- 10.20.193.4:0/2555193351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6c124550 con 0x7efc6c10b8c0 2026-02-24T09:18:59.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc71bce640 1 -- 10.20.193.4:0/2555193351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6c164c50 con 0x7efc6c10b8c0 2026-02-24T09:18:59.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.222+0000 7efc68ff9640 1 -- 10.20.193.4:0/2555193351 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efc58009ca0 con 0x7efc6c10b8c0 2026-02-24T09:18:59.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.223+0000 7efc68ff9640 1 -- 10.20.193.4:0/2555193351 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc580106e0 con 0x7efc6c10b8c0 2026-02-24T09:18:59.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.223+0000 7efc71bce640 1 -- 10.20.193.4:0/2555193351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc6c05fb10 con 0x7efc6c10b8c0 2026-02-24T09:18:59.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.225+0000 7efc68ff9640 1 -- 10.20.193.4:0/2555193351 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7efc58002730 con 0x7efc6c10b8c0 2026-02-24T09:18:59.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.226+0000 7efc68ff9640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc400b5760 0x7efc400d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.226+0000 7efc68ff9640 1 -- 10.20.193.4:0/2555193351 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7efc580e6f70 con 0x7efc6c10b8c0 2026-02-24T09:18:59.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.226+0000 7efc6affd640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc400b5760 0x7efc400d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.226+0000 7efc68ff9640 1 -- 10.20.193.4:0/2555193351 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7efc580a9180 con 0x7efc6c10b8c0 2026-02-24T09:18:59.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.227+0000 7efc6affd640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc400b5760 0x7efc400d5c10 secure :-1 s=READY pgs=436 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc5c005970 tx=0x7efc5c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:58 trial090 ceph-mon[47278]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 883 MiB/s wr, 244 op/s 2026-02-24T09:18:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:58 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:18:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:58 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:58 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:18:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:58 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:58 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:18:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:58 trial014 ceph-mon[46941]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 883 MiB/s wr, 244 op/s 2026-02-24T09:18:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:58 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:18:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:58 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:58 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:18:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:58 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:18:59.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:58 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:18:59.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.393+0000 7efc71bce640 1 -- 10.20.193.4:0/2555193351 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc6c10bc90 con 0x7efc6c10b8c0 2026-02-24T09:18:59.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.394+0000 7efc68ff9640 1 -- 10.20.193.4:0/2555193351 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7efc580acae0 con 0x7efc6c10b8c0 2026-02-24T09:18:59.397 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:18:59.397 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:18:59.398 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:18:59.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.401+0000 7efc71bce640 1 -- 10.20.193.4:0/2555193351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc400b5760 msgr2=0x7efc400d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.401+0000 7efc71bce640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc400b5760 0x7efc400d5c10 secure :-1 s=READY pgs=436 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc5c005970 tx=0x7efc5c005900 comp rx=0 tx=0).stop 2026-02-24T09:18:59.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.401+0000 7efc71bce640 1 -- 10.20.193.4:0/2555193351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc6c10b8c0 msgr2=0x7efc6c11e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.401+0000 7efc71bce640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc6c10b8c0 0x7efc6c11e010 secure :-1 s=READY pgs=1220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc5800d950 tx=0x7efc5800de20 comp rx=0 tx=0).stop 2026-02-24T09:18:59.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.401+0000 7efc71bce640 1 -- 10.20.193.4:0/2555193351 shutdown_connections 2026-02-24T09:18:59.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.401+0000 7efc71bce640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7efc400b5760 0x7efc400d5c10 unknown :-1 s=CLOSED pgs=436 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.401+0000 7efc71bce640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7efc6c114780 0x7efc6c123920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.401+0000 7efc71bce640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efc6c10c260 0x7efc6c11e550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.401+0000 7efc71bce640 1 --2- 10.20.193.4:0/2555193351 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7efc6c10b8c0 0x7efc6c11e010 unknown :-1 s=CLOSED pgs=1220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.401+0000 7efc71bce640 1 -- 10.20.193.4:0/2555193351 >> 10.20.193.4:0/2555193351 conn(0x7efc6c0e9370 msgr2=0x7efc6c109750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:59.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.402+0000 7efc71bce640 1 -- 10.20.193.4:0/2555193351 shutdown_connections 2026-02-24T09:18:59.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.402+0000 7efc71bce640 1 -- 10.20.193.4:0/2555193351 wait complete. 2026-02-24T09:18:59.501 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:18:59.695 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:18:59.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.873+0000 7f7239777640 1 -- 10.20.193.4:0/3415899729 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f723410f650 msgr2=0x7f723410fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.873+0000 7f7239777640 1 --2- 10.20.193.4:0/3415899729 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f723410f650 0x7f723410fa20 secure :-1 s=READY pgs=1221 gs=1 cs=0 l=1 c_cookie=8204694528129709074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228009950 tx=0x7f722802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.873+0000 7f7239777640 1 -- 10.20.193.4:0/3415899729 shutdown_connections 2026-02-24T09:18:59.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.873+0000 7f7239777640 1 --2- 10.20.193.4:0/3415899729 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7234115840 0x7f7234176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.873+0000 7f7239777640 1 --2- 10.20.193.4:0/3415899729 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7234110040 0x7f7234115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.873+0000 7f7239777640 1 --2- 10.20.193.4:0/3415899729 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f723410f650 0x7f723410fa20 unknown :-1 s=CLOSED pgs=1221 gs=1 cs=0 l=1 c_cookie=8204694528129709074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.873+0000 7f7239777640 1 -- 10.20.193.4:0/3415899729 >> 10.20.193.4:0/3415899729 conn(0x7f72340ecf20 msgr2=0x7f723410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:59.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.873+0000 7f7239777640 1 -- 10.20.193.4:0/3415899729 shutdown_connections 2026-02-24T09:18:59.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.873+0000 7f7239777640 1 -- 10.20.193.4:0/3415899729 wait complete. 2026-02-24T09:18:59.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.874+0000 7f7239777640 1 Processor -- start 2026-02-24T09:18:59.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.874+0000 7f7239777640 1 -- start start 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.874+0000 7f7239777640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f723410f650 0x7f72340f9d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.874+0000 7f7239777640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7234110040 0x7f7234176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7232ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f723410f650 0x7f72340f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7239777640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7234115840 0x7f72340fa490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7232ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f723410f650 0x7f72340f9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:51594/0 (socket says 10.20.193.4:51594) 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7232ffd640 1 -- 10.20.193.4:0/536243468 learned_addr learned my addr 10.20.193.4:0/536243468 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f72327fc640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7234110040 0x7f7234176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f72340ff6a0 con 0x7f7234110040 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f72340ff810 con 0x7f7234115840 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f72340ff9d0 con 0x7f723410f650 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f72337fe640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7234115840 0x7f72340fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7232ffd640 1 -- 10.20.193.4:0/536243468 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7234115840 msgr2=0x7f72340fa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7232ffd640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7234115840 0x7f72340fa490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7232ffd640 1 -- 10.20.193.4:0/536243468 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7234110040 msgr2=0x7f7234176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.879 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7232ffd640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7234110040 0x7f7234176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7232ffd640 1 -- 10.20.193.4:0/536243468 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722400a590 con 0x7f723410f650 2026-02-24T09:18:59.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7232ffd640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f723410f650 0x7f72340f9d90 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228005b30 tx=0x7f7228004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:59.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7213fff640 1 -- 10.20.193.4:0/536243468 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f722803d070 con 0x7f723410f650 2026-02-24T09:18:59.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7213fff640 1 -- 10.20.193.4:0/536243468 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7228038920 con 0x7f723410f650 2026-02-24T09:18:59.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7228009570 con 0x7f723410f650 2026-02-24T09:18:59.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7213fff640 1 -- 10.20.193.4:0/536243468 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72280418a0 con 0x7f723410f650 2026-02-24T09:18:59.880 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.875+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72340fffb0 con 0x7f723410f650 2026-02-24T09:18:59.882 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.879+0000 7f7213fff640 1 -- 10.20.193.4:0/536243468 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f7228048020 con 0x7f723410f650 2026-02-24T09:18:59.889 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.886+0000 7f7213fff640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72080b5750 0x7f72080d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.886+0000 7f72327fc640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72080b5750 0x7f72080d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.890 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.887+0000 7f7213fff640 1 -- 10.20.193.4:0/536243468 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f722810c020 con 0x7f723410f650 2026-02-24T09:18:59.891 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.888+0000 7f72327fc640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72080b5750 0x7f72080d5c00 secure :-1 s=READY pgs=437 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7234100730 tx=0x7f721c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:59.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.891+0000 7f723b771e00 1 Processor -- start 2026-02-24T09:18:59.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.891+0000 7f723b771e00 1 -- start start 2026-02-24T09:18:59.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f723b771e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d62e320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f723b771e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62e860 0x563c4d672fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f723b771e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d673500 0x563c4d6938e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f723b771e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c4d53eee0 con 0x563c4d62df50 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f723b771e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c4d53ac10 con 0x563c4d62e860 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f723b771e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c4d534d70 con 0x563c4d673500 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f7232ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d62e320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f7232ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d62e320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52254/0 (socket says 10.20.193.4:52254) 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f7232ffd640 1 -- 10.20.193.4:0/2302909447 learned_addr learned my addr 10.20.193.4:0/2302909447 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f72337fe640 1 --2- 10.20.193.4:0/2302909447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d673500 0x563c4d6938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f72327fc640 1 --2- 10.20.193.4:0/2302909447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62e860 0x563c4d672fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f7232ffd640 1 -- 10.20.193.4:0/2302909447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d673500 msgr2=0x563c4d6938e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f7232ffd640 1 --2- 10.20.193.4:0/2302909447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d673500 0x563c4d6938e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f7232ffd640 1 -- 10.20.193.4:0/2302909447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62e860 msgr2=0x563c4d672fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f7232ffd640 1 --2- 10.20.193.4:0/2302909447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62e860 0x563c4d672fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f7232ffd640 1 -- 10.20.193.4:0/2302909447 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c4d4e0340 con 0x563c4d62df50 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f72327fc640 1 --2- 10.20.193.4:0/2302909447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62e860 0x563c4d672fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f7232ffd640 1 --2- 10.20.193.4:0/2302909447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d62e320 secure :-1 s=READY pgs=1222 gs=1 cs=0 l=1 c_cookie=15466096971793376369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228032040 tx=0x7f72280044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a29d40c17d2471 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f71ff7fe640 1 -- 10.20.193.4:0/2302909447 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72280d8070 con 0x563c4d62df50 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f71ff7fe640 1 -- 10.20.193.4:0/2302909447 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f72280da650 con 0x563c4d62df50 2026-02-24T09:18:59.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.892+0000 7f71ff7fe640 1 -- 10.20.193.4:0/2302909447 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72280dd000 con 0x563c4d62df50 2026-02-24T09:18:59.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.893+0000 7f723b771e00 1 -- 10.20.193.4:0/2302909447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 msgr2=0x563c4d62e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.894+0000 7f723b771e00 1 --2- 10.20.193.4:0/2302909447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d62e320 secure :-1 s=READY pgs=1222 gs=1 cs=0 l=1 c_cookie=15466096971793376369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228032040 tx=0x7f72280044b0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.894+0000 7f723b771e00 1 -- 10.20.193.4:0/2302909447 shutdown_connections 2026-02-24T09:18:59.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.894+0000 7f723b771e00 1 --2- 10.20.193.4:0/2302909447 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d673500 0x563c4d6938e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.894+0000 7f723b771e00 1 --2- 10.20.193.4:0/2302909447 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62e860 0x563c4d672fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.894+0000 7f723b771e00 1 --2- 10.20.193.4:0/2302909447 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d62e320 unknown :-1 s=CLOSED pgs=1222 gs=1 cs=0 l=1 c_cookie=15466096971793376369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.894+0000 7f723b771e00 1 -- 10.20.193.4:0/2302909447 >> 10.20.193.4:0/2302909447 conn(0x563c4d54cdb0 msgr2=0x563c4d62c830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:59.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.894+0000 7f723b771e00 1 -- 10.20.193.4:0/2302909447 shutdown_connections 2026-02-24T09:18:59.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.894+0000 7f723b771e00 1 -- 10.20.193.4:0/2302909447 wait complete. 2026-02-24T09:18:59.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.895+0000 7f723b771e00 1 -- start start 2026-02-24T09:18:59.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.895+0000 7f723b771e00 1 Processor -- start 2026-02-24T09:18:59.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f723b771e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d68ac80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f723b771e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62e860 0x563c4d68b1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f723b771e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d673500 0x563c4d6901b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f723b771e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c4d6906f0 con 0x563c4d62df50 2026-02-24T09:18:59.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f723b771e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c4d690860 con 0x563c4d673500 2026-02-24T09:18:59.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f723b771e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c4d690a20 con 0x563c4d62e860 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f7232ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d68ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f7232ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d68ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52264/0 (socket says 10.20.193.4:52264) 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f7232ffd640 1 -- 10.20.193.4:0/756646456 learned_addr learned my addr 10.20.193.4:0/756646456 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f72327fc640 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62e860 0x563c4d68b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f72337fe640 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d673500 0x563c4d6901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f7232ffd640 1 -- 10.20.193.4:0/756646456 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62e860 msgr2=0x563c4d68b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f7232ffd640 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62e860 0x563c4d68b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f7232ffd640 1 -- 10.20.193.4:0/756646456 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d673500 msgr2=0x563c4d6901b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f7232ffd640 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d673500 0x563c4d6901b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.896+0000 7f7232ffd640 1 -- 10.20.193.4:0/756646456 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c4d4b89d0 con 0x563c4d62df50 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f7232ffd640 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d68ac80 secure :-1 s=READY pgs=1223 gs=1 cs=0 l=1 c_cookie=12653861019414872670 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228038820 tx=0x7f72280d2120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9b8b8ddb62c25e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f71fcff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f71fcff9640 1 -- 10.20.193.4:0/756646456 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72280d3200 con 0x563c4d62df50 2026-02-24T09:18:59.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f723b771e00 1 -- 10.20.193.4:0/756646456 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72340fffb0 con 0x563c4d62df50 2026-02-24T09:18:59.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f71fcff9640 1 -- 10.20.193.4:0/756646456 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f72280dd490 con 0x563c4d62df50 2026-02-24T09:18:59.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f71fcff9640 1 -- 10.20.193.4:0/756646456 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72280ccb40 con 0x563c4d62df50 2026-02-24T09:18:59.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f723b771e00 10 client.17994 _ll_register_callbacks cb 0x563c4d4df080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f723b771e00 1 -- 10.20.193.4:0/756646456 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c4d2844a0 con 0x563c4d62df50 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f71fcff9640 1 -- 10.20.193.4:0/756646456 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f72280ccca0 con 0x563c4d62df50 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f71fcff9640 1 -- 10.20.193.4:0/756646456 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7228097410 con 0x563c4d62df50 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f723b771e00 10 client.17994 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.897+0000 7f723b771e00 1 -- 10.20.193.4:0/756646456 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563c4d4ca710 con 0x563c4d62df50 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.898+0000 7f71fcff9640 1 -- 10.20.193.4:0/756646456 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f722809b020 con 0x563c4d62df50 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.898+0000 7f723b771e00 10 client.17994 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.898+0000 7f723b771e00 10 client.17994 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.898+0000 7f723b771e00 20 client.17994 populate_metadata read hostname 'trial004' 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.898+0000 7f723b771e00 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c4d6701f0 0x563c4d670690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.898+0000 7f723b771e00 4 client.17994 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.898+0000 7f723b771e00 1 -- 10.20.193.4:0/756646456 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c4d52a7b0 con 0x563c4d6701f0 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.899+0000 7f72327fc640 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c4d6701f0 0x563c4d670690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.899+0000 7f72327fc640 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c4d6701f0 0x563c4d670690 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=5430440477808054449 s_cookie=6395964320195106084 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b5cccd7c5a6d0b1 server_cookie=58c307a9754d5524 in_seq=0 out_seq=0 2026-02-24T09:18:59.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.899+0000 7f71fcff9640 10 client.17994 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:59.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f71fcff9640 1 -- 10.20.193.4:0/756646456 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563c4d52a7b0 con 0x563c4d6701f0 2026-02-24T09:18:59.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f71fcff9640 10 client.17994 handle_command_reply: tid=0 2026-02-24T09:18:59.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 client.17994 shutdown 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 -- 10.20.193.4:0/756646456 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 msgr2=0x563c4d68ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d68ac80 secure :-1 s=READY pgs=1223 gs=1 cs=0 l=1 c_cookie=12653861019414872670 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228038820 tx=0x7f72280d2120 comp rx=0 tx=0).stop 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 -- 10.20.193.4:0/756646456 shutdown_connections 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c4d6701f0 0x563c4d670690 crc :-1 s=READY pgs=56 gs=4 cs=0 l=0 c_cookie=5430440477808054449 s_cookie=6395964320195106084 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d673500 0x563c4d6901b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62e860 0x563c4d68b1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 --2- 10.20.193.4:0/756646456 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62df50 0x563c4d68ac80 unknown :-1 s=CLOSED pgs=1223 gs=1 cs=0 l=1 c_cookie=12653861019414872670 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 -- 10.20.193.4:0/756646456 >> 10.20.193.4:0/756646456 conn(0x563c4d54cdb0 msgr2=0x563c4d62c040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f71fcff9640 0 client.17994 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 -- 10.20.193.4:0/756646456 shutdown_connections 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 1 -- 10.20.193.4:0/756646456 wait complete. 2026-02-24T09:18:59.904 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.900+0000 7f723b771e00 20 client.17994 trim_cache size 0 max 16384 2026-02-24T09:18:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.912+0000 7f723b771e00 1 Processor -- start 2026-02-24T09:18:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.912+0000 7f723b771e00 1 -- start start 2026-02-24T09:18:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.912+0000 7f723b771e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62df50 0x563c4d675f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.912+0000 7f723b771e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d62d460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.912+0000 7f723b771e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d673500 0x563c4d62d9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.912+0000 7f723b771e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c4d5329a0 con 0x563c4d62e860 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.912+0000 7f723b771e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c4d30edf0 con 0x563c4d673500 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.912+0000 7f723b771e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c4d53ac10 con 0x563c4d62df50 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f72327fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d62d460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f72327fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d62d460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52268/0 (socket says 10.20.193.4:52268) 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f72327fc640 1 -- 10.20.193.4:0/2331150295 learned_addr learned my addr 10.20.193.4:0/2331150295 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f7232ffd640 1 --2- 10.20.193.4:0/2331150295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62df50 0x563c4d675f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f72337fe640 1 --2- 10.20.193.4:0/2331150295 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d673500 0x563c4d62d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f7232ffd640 1 -- 10.20.193.4:0/2331150295 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d673500 msgr2=0x563c4d62d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f7232ffd640 1 --2- 10.20.193.4:0/2331150295 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d673500 0x563c4d62d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f7232ffd640 1 -- 10.20.193.4:0/2331150295 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 msgr2=0x563c4d62d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:59.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f7232ffd640 1 --2- 10.20.193.4:0/2331150295 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d62d460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f7232ffd640 1 -- 10.20.193.4:0/2331150295 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c4d4c5190 con 0x563c4d62df50 2026-02-24T09:18:59.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.913+0000 7f72327fc640 1 --2- 10.20.193.4:0/2331150295 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d62d460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:18:59.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.914+0000 7f7232ffd640 1 --2- 10.20.193.4:0/2331150295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62df50 0x563c4d675f50 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=10452107734050770888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72280d2b20 tx=0x7f72280d2ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=910d589b42358fc8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:59.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.914+0000 7f71feffd640 1 -- 10.20.193.4:0/2331150295 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72280d2b50 con 0x563c4d62df50 2026-02-24T09:18:59.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.914+0000 7f71feffd640 1 -- 10.20.193.4:0/2331150295 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x563c4d2844a0 con 0x563c4d62df50 2026-02-24T09:18:59.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.914+0000 7f71feffd640 1 -- 10.20.193.4:0/2331150295 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72280d1960 con 0x563c4d62df50 2026-02-24T09:18:59.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.916+0000 7f723b771e00 1 -- 10.20.193.4:0/2331150295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62df50 msgr2=0x563c4d675f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.916+0000 7f723b771e00 1 --2- 10.20.193.4:0/2331150295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62df50 0x563c4d675f50 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=10452107734050770888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72280d2b20 tx=0x7f72280d2ec0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.916+0000 7f723b771e00 1 -- 10.20.193.4:0/2331150295 shutdown_connections 2026-02-24T09:18:59.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.916+0000 7f723b771e00 1 --2- 10.20.193.4:0/2331150295 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d673500 0x563c4d62d9a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.916+0000 7f723b771e00 1 --2- 10.20.193.4:0/2331150295 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d62d460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.916+0000 7f723b771e00 1 --2- 10.20.193.4:0/2331150295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d62df50 0x563c4d675f50 unknown :-1 s=CLOSED pgs=112 gs=2 cs=0 l=1 c_cookie=10452107734050770888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.916+0000 7f723b771e00 1 -- 10.20.193.4:0/2331150295 >> 10.20.193.4:0/2331150295 conn(0x563c4d54cdb0 msgr2=0x563c4d68f800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:59.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.916+0000 7f723b771e00 1 -- 10.20.193.4:0/2331150295 shutdown_connections 2026-02-24T09:18:59.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.916+0000 7f723b771e00 1 -- 10.20.193.4:0/2331150295 wait complete. 2026-02-24T09:18:59.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.917+0000 7f723b771e00 1 -- start start 2026-02-24T09:18:59.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.917+0000 7f723b771e00 1 Processor -- start 2026-02-24T09:18:59.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.917+0000 7f723b771e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62df50 0x563c4d66da60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f723b771e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d66dfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f723b771e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d673500 0x563c4d60e050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f723b771e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c4d66e600 con 0x563c4d62e860 2026-02-24T09:18:59.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f723b771e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c4d66e770 con 0x563c4d62df50 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f723b771e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c4d60e610 con 0x563c4d673500 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f72327fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d66dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f72327fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d66dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52272/0 (socket says 10.20.193.4:52272) 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f72327fc640 1 -- 10.20.193.4:0/488146898 learned_addr learned my addr 10.20.193.4:0/488146898 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f7232ffd640 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62df50 0x563c4d66da60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f72337fe640 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d673500 0x563c4d60e050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f72327fc640 1 -- 10.20.193.4:0/488146898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d673500 msgr2=0x563c4d60e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f72327fc640 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d673500 0x563c4d60e050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f72327fc640 1 -- 10.20.193.4:0/488146898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62df50 msgr2=0x563c4d66da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f72327fc640 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62df50 0x563c4d66da60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f72327fc640 1 -- 10.20.193.4:0/488146898 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c4d4ca710 con 0x563c4d62e860 2026-02-24T09:18:59.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f7232ffd640 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62df50 0x563c4d66da60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:18:59.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f72327fc640 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d66dfa0 secure :-1 s=READY pgs=1224 gs=1 cs=0 l=1 c_cookie=9869403427782731502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f721c0042a0 tx=0x7f721c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f72a20920326ee server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:18:59.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.918+0000 7f71fcff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:18:59.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.921+0000 7f71fcff9640 1 -- 10.20.193.4:0/488146898 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f721c026030 con 0x563c4d62e860 2026-02-24T09:18:59.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.921+0000 7f71fcff9640 1 -- 10.20.193.4:0/488146898 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f721c027040 con 0x563c4d62e860 2026-02-24T09:18:59.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.921+0000 7f71fcff9640 1 -- 10.20.193.4:0/488146898 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f721c0217b0 con 0x563c4d62e860 2026-02-24T09:18:59.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.921+0000 7f723b771e00 1 -- 10.20.193.4:0/488146898 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721c019040 con 0x563c4d62e860 2026-02-24T09:18:59.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.921+0000 7f723b771e00 10 client.18000 _ll_register_callbacks cb 0x563c4d4df080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:18:59.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.921+0000 7f723b771e00 1 -- 10.20.193.4:0/488146898 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c4d1bff40 con 0x563c4d62e860 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.921+0000 7f71fcff9640 1 -- 10.20.193.4:0/488146898 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f721c021940 con 0x563c4d62e860 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.921+0000 7f71fcff9640 1 -- 10.20.193.4:0/488146898 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f721c021b00 con 0x563c4d62e860 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.921+0000 7f723b771e00 10 client.18000 fetch_fsmap learned FSMap version 19 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.921+0000 7f723b771e00 1 -- 10.20.193.4:0/488146898 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563c4d4b8d00 con 0x563c4d62e860 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.922+0000 7f71fcff9640 1 -- 10.20.193.4:0/488146898 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f721c002d20 con 0x563c4d62e860 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.922+0000 7f723b771e00 10 client.18000 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.922+0000 7f723b771e00 10 client.18000 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.922+0000 7f723b771e00 20 client.18000 populate_metadata read hostname 'trial004' 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.922+0000 7f723b771e00 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c4d7208c0 0x563c4d740d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.922+0000 7f723b771e00 4 client.18000 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.922+0000 7f723b771e00 1 -- 10.20.193.4:0/488146898 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f72280da650 con 0x563c4d7208c0 2026-02-24T09:18:59.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.922+0000 7f7232ffd640 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c4d7208c0 0x563c4d740d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:18:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.923+0000 7f71fcff9640 10 client.18000 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.923+0000 7f7232ffd640 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c4d7208c0 0x563c4d740d70 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=15212625371579810061 s_cookie=15358082644694398064 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d31e1a2cee1c010d server_cookie=d522decb7419f470 in_seq=0 out_seq=0 2026-02-24T09:18:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.923+0000 7f71fcff9640 1 -- 10.20.193.4:0/488146898 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f72280da650 con 0x563c4d7208c0 2026-02-24T09:18:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.923+0000 7f71fcff9640 10 client.18000 handle_command_reply: tid=0 2026-02-24T09:18:59.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.923+0000 7f723b771e00 1 client.18000 shutdown 2026-02-24T09:18:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 1 -- 10.20.193.4:0/488146898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 msgr2=0x563c4d66dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d66dfa0 secure :-1 s=READY pgs=1224 gs=1 cs=0 l=1 c_cookie=9869403427782731502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f721c0042a0 tx=0x7f721c004770 comp rx=0 tx=0).stop 2026-02-24T09:18:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 1 -- 10.20.193.4:0/488146898 shutdown_connections 2026-02-24T09:18:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c4d7208c0 0x563c4d740d70 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=15212625371579810061 s_cookie=15358082644694398064 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c4d673500 0x563c4d60e050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c4d62e860 0x563c4d66dfa0 unknown :-1 s=CLOSED pgs=1224 gs=1 cs=0 l=1 c_cookie=9869403427782731502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f71fcff9640 0 client.18000 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:18:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 1 --2- 10.20.193.4:0/488146898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c4d62df50 0x563c4d66da60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 1 -- 10.20.193.4:0/488146898 >> 10.20.193.4:0/488146898 conn(0x563c4d54cdb0 msgr2=0x563c4d68dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 1 -- 10.20.193.4:0/488146898 shutdown_connections 2026-02-24T09:18:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 1 -- 10.20.193.4:0/488146898 wait complete. 2026-02-24T09:18:59.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.924+0000 7f723b771e00 20 client.18000 trim_cache size 0 max 16384 2026-02-24T09:18:59.931 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:18:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72080b5750 msgr2=0x7f72080d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72080b5750 0x7f72080d5c00 secure :-1 s=READY pgs=437 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7234100730 tx=0x7f721c009190 comp rx=0 tx=0).stop 2026-02-24T09:18:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f723410f650 msgr2=0x7f72340f9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:18:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f723410f650 0x7f72340f9d90 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228005b30 tx=0x7f7228004340 comp rx=0 tx=0).stop 2026-02-24T09:18:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 shutdown_connections 2026-02-24T09:18:59.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f72080b5750 0x7f72080d5c00 unknown :-1 s=CLOSED pgs=437 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7234115840 0x7f72340fa490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7234110040 0x7f7234176110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 --2- 10.20.193.4:0/536243468 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f723410f650 0x7f72340f9d90 unknown :-1 s=CLOSED pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:18:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 >> 10.20.193.4:0/536243468 conn(0x7f72340ecf20 msgr2=0x7f723410dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:18:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 shutdown_connections 2026-02-24T09:18:59.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:18:59.928+0000 7f7239777640 1 -- 10.20.193.4:0/536243468 wait complete. 2026-02-24T09:18:59.983 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:18:59 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2555193351' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:19:00.037 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:19:00.232 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:00.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:18:59 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2555193351' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:19:00.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:18:59 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2555193351' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:19:00.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.391+0000 7f915ae16640 1 -- 10.20.193.4:0/3453207424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9154115840 msgr2=0x7f9154176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.391+0000 7f915ae16640 1 --2- 10.20.193.4:0/3453207424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9154115840 0x7f9154176210 secure :-1 s=READY pgs=113 gs=3 cs=0 l=1 c_cookie=2787523842171629854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f915000aa30 tx=0x7f9150030280 comp rx=0 tx=0).stop 2026-02-24T09:19:00.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.391+0000 7f915ae16640 1 -- 10.20.193.4:0/3453207424 shutdown_connections 2026-02-24T09:19:00.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.391+0000 7f915ae16640 1 --2- 10.20.193.4:0/3453207424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9154115840 0x7f9154176210 unknown :-1 s=CLOSED pgs=113 gs=3 cs=0 l=1 c_cookie=2787523842171629854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.391+0000 7f915ae16640 1 --2- 10.20.193.4:0/3453207424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9154110040 0x7f9154115090 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.391+0000 7f915ae16640 1 --2- 10.20.193.4:0/3453207424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f915410f650 0x7f915410fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.391+0000 7f915ae16640 1 -- 10.20.193.4:0/3453207424 >> 10.20.193.4:0/3453207424 conn(0x7f91540ecf20 msgr2=0x7f915410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.391+0000 7f915ae16640 1 -- 10.20.193.4:0/3453207424 shutdown_connections 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.391+0000 7f915ae16640 1 -- 10.20.193.4:0/3453207424 wait complete. 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f915ae16640 1 Processor -- start 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f915ae16640 1 -- start start 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f915ae16640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f915410f650 0x7f915411df50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f915ae16640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9154110040 0x7f915411e490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f915ae16640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9154115840 0x7f9154123860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f915ae16640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9154123e80 con 0x7f9154110040 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f915ae16640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9154123ff0 con 0x7f9154115840 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f915ae16640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f91541241b0 con 0x7f915410f650 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f914bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9154110040 0x7f915411e490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f914bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9154110040 0x7f915411e490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52290/0 (socket says 10.20.193.4:52290) 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f914bfff640 1 -- 10.20.193.4:0/923716097 learned_addr learned my addr 10.20.193.4:0/923716097 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f9158b8b640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f915410f650 0x7f915411df50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f915938c640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9154115840 0x7f9154123860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f914bfff640 1 -- 10.20.193.4:0/923716097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f915410f650 msgr2=0x7f915411df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f914bfff640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f915410f650 0x7f915411df50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f914bfff640 1 -- 10.20.193.4:0/923716097 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9154115840 msgr2=0x7f9154123860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f914bfff640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9154115840 0x7f9154123860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f914bfff640 1 -- 10.20.193.4:0/923716097 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915000a650 con 0x7f9154110040 2026-02-24T09:19:00.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f9158b8b640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f915410f650 0x7f915411df50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:00.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.392+0000 7f914bfff640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9154110040 0x7f915411e490 secure :-1 s=READY pgs=1225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f913c009480 tx=0x7f913c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.393+0000 7f9149ffb640 1 -- 10.20.193.4:0/923716097 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f913c00ccc0 con 0x7f9154110040 2026-02-24T09:19:00.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.393+0000 7f915ae16640 1 -- 10.20.193.4:0/923716097 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9154124490 con 0x7f9154110040 2026-02-24T09:19:00.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.393+0000 7f915ae16640 1 -- 10.20.193.4:0/923716097 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9154164b90 con 0x7f9154110040 2026-02-24T09:19:00.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.393+0000 7f9149ffb640 1 -- 10.20.193.4:0/923716097 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f913c00ce20 con 0x7f9154110040 2026-02-24T09:19:00.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.393+0000 7f9149ffb640 1 -- 10.20.193.4:0/923716097 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f913c0106b0 con 0x7f9154110040 2026-02-24T09:19:00.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.395+0000 7f9149ffb640 1 -- 10.20.193.4:0/923716097 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f913c01f060 con 0x7f9154110040 2026-02-24T09:19:00.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.396+0000 7f9149ffb640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f91300b5760 0x7f91300d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.396+0000 7f9149ffb640 1 -- 10.20.193.4:0/923716097 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f913c014070 con 0x7f9154110040 2026-02-24T09:19:00.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.396+0000 7f9158b8b640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f91300b5760 0x7f91300d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.396+0000 7f9158b8b640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f91300b5760 0x7f91300d5c10 secure :-1 s=READY pgs=438 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9144004740 tx=0x7f9144005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.404+0000 7f915ce10e00 1 Processor -- start 2026-02-24T09:19:00.408 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.404+0000 7f915ce10e00 1 -- start start 2026-02-24T09:19:00.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.405+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc6bf320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.409 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.405+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc6bf860 0x55f0bc703fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.405+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc704500 0x55f0bc7248e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.405+0000 7f915ce10e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc5cfee0 con 0x55f0bc6bf860 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.405+0000 7f915ce10e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc5cbc10 con 0x55f0bc704500 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.405+0000 7f915ce10e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc5c5d70 con 0x55f0bc6bef50 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.405+0000 7f915938c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc704500 0x55f0bc7248e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.405+0000 7f915938c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc704500 0x55f0bc7248e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:39690/0 (socket says 10.20.193.4:39690) 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.405+0000 7f915938c640 1 -- 10.20.193.4:0/2457879024 learned_addr learned my addr 10.20.193.4:0/2457879024 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.405+0000 7f914bfff640 1 --2- 10.20.193.4:0/2457879024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc6bf860 0x55f0bc703fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.406+0000 7f914bfff640 1 -- 10.20.193.4:0/2457879024 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 msgr2=0x55f0bc6bf320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.406+0000 7f914bfff640 1 --2- 10.20.193.4:0/2457879024 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc6bf320 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.410 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.406+0000 7f914bfff640 1 -- 10.20.193.4:0/2457879024 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc704500 msgr2=0x55f0bc7248e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.406+0000 7f914bfff640 1 --2- 10.20.193.4:0/2457879024 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc704500 0x55f0bc7248e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.406+0000 7f914bfff640 1 -- 10.20.193.4:0/2457879024 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0bc571340 con 0x55f0bc6bf860 2026-02-24T09:19:00.411 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.406+0000 7f914bfff640 1 --2- 10.20.193.4:0/2457879024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc6bf860 0x55f0bc703fc0 secure :-1 s=READY pgs=1226 gs=2 cs=0 l=1 c_cookie=9195124043529465256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f913c00c6a0 tx=0x7f913c005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9ba499883a2da8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.410+0000 7f91214e4640 1 -- 10.20.193.4:0/2457879024 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f913c0ae950 con 0x55f0bc6bf860 2026-02-24T09:19:00.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.410+0000 7f91214e4640 1 -- 10.20.193.4:0/2457879024 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f913c0b3c70 con 0x55f0bc6bf860 2026-02-24T09:19:00.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.410+0000 7f91214e4640 1 -- 10.20.193.4:0/2457879024 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f913c0adaf0 con 0x55f0bc6bf860 2026-02-24T09:19:00.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.412+0000 7f915ce10e00 1 -- 10.20.193.4:0/2457879024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc6bf860 msgr2=0x55f0bc703fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.412+0000 7f915ce10e00 1 --2- 10.20.193.4:0/2457879024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc6bf860 0x55f0bc703fc0 secure :-1 s=READY pgs=1226 gs=2 cs=0 l=1 c_cookie=9195124043529465256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f913c00c6a0 tx=0x7f913c005380 comp rx=0 tx=0).stop 2026-02-24T09:19:00.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.412+0000 7f915ce10e00 1 -- 10.20.193.4:0/2457879024 shutdown_connections 2026-02-24T09:19:00.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.412+0000 7f915ce10e00 1 --2- 10.20.193.4:0/2457879024 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc704500 0x55f0bc7248e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.412+0000 7f915ce10e00 1 --2- 10.20.193.4:0/2457879024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc6bf860 0x55f0bc703fc0 unknown :-1 s=CLOSED pgs=1226 gs=2 cs=0 l=1 c_cookie=9195124043529465256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.412+0000 7f915ce10e00 1 --2- 10.20.193.4:0/2457879024 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc6bf320 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.412+0000 7f915ce10e00 1 -- 10.20.193.4:0/2457879024 >> 10.20.193.4:0/2457879024 conn(0x55f0bc5dddb0 msgr2=0x55f0bc6bd830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.412+0000 7f915ce10e00 1 -- 10.20.193.4:0/2457879024 shutdown_connections 2026-02-24T09:19:00.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.412+0000 7f915ce10e00 1 -- 10.20.193.4:0/2457879024 wait complete. 2026-02-24T09:19:00.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.415+0000 7f915ce10e00 1 -- start start 2026-02-24T09:19:00.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.416+0000 7f915ce10e00 1 Processor -- start 2026-02-24T09:19:00.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.417+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bef50 0x55f0bc71bdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.417+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc6bf860 0x55f0bc71c2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.417+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc704500 0x55f0bc7212e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.417+0000 7f915ce10e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc721820 con 0x55f0bc6bf860 2026-02-24T09:19:00.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.417+0000 7f915ce10e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc721990 con 0x55f0bc6bef50 2026-02-24T09:19:00.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.417+0000 7f915ce10e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc721b50 con 0x55f0bc704500 2026-02-24T09:19:00.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.417+0000 7f915938c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc704500 0x55f0bc7212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.417+0000 7f9158b8b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bef50 0x55f0bc71bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.417+0000 7f915938c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc704500 0x55f0bc7212e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:51656/0 (socket says 10.20.193.4:51656) 2026-02-24T09:19:00.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.417+0000 7f915938c640 1 -- 10.20.193.4:0/3294831047 learned_addr learned my addr 10.20.193.4:0/3294831047 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:00.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.418+0000 7f915938c640 1 -- 10.20.193.4:0/3294831047 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bef50 msgr2=0x55f0bc71bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.418+0000 7f915938c640 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bef50 0x55f0bc71bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.418+0000 7f915938c640 1 -- 10.20.193.4:0/3294831047 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc6bf860 msgr2=0x55f0bc71c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.418+0000 7f915938c640 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc6bf860 0x55f0bc71c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.418+0000 7f915938c640 1 -- 10.20.193.4:0/3294831047 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0bc5499d0 con 0x55f0bc704500 2026-02-24T09:19:00.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.418+0000 7f915938c640 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc704500 0x55f0bc7212e0 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=1222215196472503875 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f915000a230 tx=0x7f91500396a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10f62e3ee0d3ee43 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.418+0000 7f91127fc640 10 client.0 ms_handle_connect on v2:10.20.193.90:3300/0 2026-02-24T09:19:00.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.418+0000 7f91127fc640 1 -- 10.20.193.4:0/3294831047 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f915003e040 con 0x55f0bc704500 2026-02-24T09:19:00.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.418+0000 7f91127fc640 1 -- 10.20.193.4:0/3294831047 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f915003f040 con 0x55f0bc704500 2026-02-24T09:19:00.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.418+0000 7f91127fc640 1 -- 10.20.193.4:0/3294831047 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9150045450 con 0x55f0bc704500 2026-02-24T09:19:00.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.421+0000 7f915ce10e00 1 -- 10.20.193.4:0/3294831047 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9154164b90 con 0x55f0bc704500 2026-02-24T09:19:00.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.421+0000 7f915ce10e00 10 client.27022 _ll_register_callbacks cb 0x55f0bc570080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:00.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.421+0000 7f915ce10e00 1 -- 10.20.193.4:0/3294831047 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0bc3154a0 con 0x55f0bc704500 2026-02-24T09:19:00.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.421+0000 7f91127fc640 1 -- 10.20.193.4:0/3294831047 <== mon.1 v2:10.20.193.90:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f91500050c0 con 0x55f0bc704500 2026-02-24T09:19:00.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.421+0000 7f91127fc640 1 -- 10.20.193.4:0/3294831047 <== mon.1 v2:10.20.193.90:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9150005280 con 0x55f0bc704500 2026-02-24T09:19:00.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.421+0000 7f915ce10e00 10 client.27022 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:00.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.421+0000 7f915ce10e00 1 -- 10.20.193.4:0/3294831047 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f0bc55b710 con 0x55f0bc704500 2026-02-24T09:19:00.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.422+0000 7f91127fc640 1 -- 10.20.193.4:0/3294831047 <== mon.1 v2:10.20.193.90:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9150039960 con 0x55f0bc704500 2026-02-24T09:19:00.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.422+0000 7f915ce10e00 10 client.27022 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:00.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.422+0000 7f915ce10e00 10 client.27022 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:19:00.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.422+0000 7f915ce10e00 20 client.27022 populate_metadata read hostname 'trial004' 2026-02-24T09:19:00.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.422+0000 7f915ce10e00 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f0bc701830 0x55f0bc701cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.422+0000 7f915ce10e00 4 client.27022 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:00.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.422+0000 7f915ce10e00 1 -- 10.20.193.4:0/3294831047 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0bc5bb7b0 con 0x55f0bc701830 2026-02-24T09:19:00.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.422+0000 7f9158b8b640 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f0bc701830 0x55f0bc701cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.423+0000 7f9158b8b640 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f0bc701830 0x55f0bc701cd0 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=3182148164659017584 s_cookie=16786012542466047851 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2c2942e561297770 server_cookie=e8f3e578a4f0bf6b in_seq=0 out_seq=0 2026-02-24T09:19:00.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.423+0000 7f91127fc640 10 client.27022 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:19:00.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.423+0000 7f91127fc640 1 -- 10.20.193.4:0/3294831047 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f0bc5bb7b0 con 0x55f0bc701830 2026-02-24T09:19:00.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.423+0000 7f91127fc640 10 client.27022 handle_command_reply: tid=0 2026-02-24T09:19:00.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.423+0000 7f915ce10e00 1 client.27022 shutdown 2026-02-24T09:19:00.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.423+0000 7f915ce10e00 1 -- 10.20.193.4:0/3294831047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc704500 msgr2=0x55f0bc7212e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.423+0000 7f915ce10e00 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc704500 0x55f0bc7212e0 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=1222215196472503875 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f915000a230 tx=0x7f91500396a0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.424+0000 7f915ce10e00 1 -- 10.20.193.4:0/3294831047 shutdown_connections 2026-02-24T09:19:00.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.424+0000 7f915ce10e00 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f0bc701830 0x55f0bc701cd0 crc :-1 s=READY pgs=57 gs=4 cs=0 l=0 c_cookie=3182148164659017584 s_cookie=16786012542466047851 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.424+0000 7f915ce10e00 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc704500 0x55f0bc7212e0 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=1222215196472503875 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.424+0000 7f915ce10e00 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc6bf860 0x55f0bc71c2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.424+0000 7f915ce10e00 1 --2- 10.20.193.4:0/3294831047 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bef50 0x55f0bc71bdb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.424+0000 7f91127fc640 0 client.27022 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:19:00.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.424+0000 7f915ce10e00 1 -- 10.20.193.4:0/3294831047 >> 10.20.193.4:0/3294831047 conn(0x55f0bc5dddb0 msgr2=0x55f0bc6bd040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.424+0000 7f915ce10e00 1 -- 10.20.193.4:0/3294831047 shutdown_connections 2026-02-24T09:19:00.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.424+0000 7f915ce10e00 1 -- 10.20.193.4:0/3294831047 wait complete. 2026-02-24T09:19:00.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.424+0000 7f915ce10e00 20 client.27022 trim_cache size 0 max 16384 2026-02-24T09:19:00.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915ce10e00 1 Processor -- start 2026-02-24T09:19:00.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915ce10e00 1 -- start start 2026-02-24T09:19:00.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc7035c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bf860 0x55f0bc703b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc6fe100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915ce10e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc5c39a0 con 0x55f0bc704500 2026-02-24T09:19:00.443 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915ce10e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc39fdf0 con 0x55f0bc6bf860 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915ce10e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc693ea0 con 0x55f0bc6bef50 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f9158b8b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc7035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915938c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc6fe100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915938c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc6fe100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52304/0 (socket says 10.20.193.4:52304) 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915938c640 1 -- 10.20.193.4:0/2699018088 learned_addr learned my addr 10.20.193.4:0/2699018088 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915938c640 1 -- 10.20.193.4:0/2699018088 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 msgr2=0x55f0bc7035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915938c640 1 --2- 10.20.193.4:0/2699018088 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc7035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915938c640 1 -- 10.20.193.4:0/2699018088 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bf860 msgr2=0x55f0bc703b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f914bfff640 1 --2- 10.20.193.4:0/2699018088 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bf860 0x55f0bc703b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915938c640 1 --2- 10.20.193.4:0/2699018088 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bf860 0x55f0bc703b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.438+0000 7f915938c640 1 -- 10.20.193.4:0/2699018088 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0bc70e410 con 0x55f0bc704500 2026-02-24T09:19:00.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.439+0000 7f914bfff640 1 --2- 10.20.193.4:0/2699018088 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bf860 0x55f0bc703b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:19:00.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.439+0000 7f915938c640 1 --2- 10.20.193.4:0/2699018088 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc6fe100 secure :-1 s=READY pgs=1227 gs=2 cs=0 l=1 c_cookie=7992190860633058709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9150030790 tx=0x7f9150052000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee9f73e49282d95 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.439+0000 7f9120ce3640 1 -- 10.20.193.4:0/2699018088 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f915003e040 con 0x55f0bc704500 2026-02-24T09:19:00.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.439+0000 7f9120ce3640 1 -- 10.20.193.4:0/2699018088 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f0bc3154a0 con 0x55f0bc704500 2026-02-24T09:19:00.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.439+0000 7f9120ce3640 1 -- 10.20.193.4:0/2699018088 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9150003ea0 con 0x55f0bc704500 2026-02-24T09:19:00.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.440+0000 7f915ce10e00 1 -- 10.20.193.4:0/2699018088 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 msgr2=0x55f0bc6fe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.440+0000 7f915ce10e00 1 --2- 10.20.193.4:0/2699018088 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc6fe100 secure :-1 s=READY pgs=1227 gs=2 cs=0 l=1 c_cookie=7992190860633058709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9150030790 tx=0x7f9150052000 comp rx=0 tx=0).stop 2026-02-24T09:19:00.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.440+0000 7f915ce10e00 1 -- 10.20.193.4:0/2699018088 shutdown_connections 2026-02-24T09:19:00.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.440+0000 7f915ce10e00 1 --2- 10.20.193.4:0/2699018088 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc6fe100 unknown :-1 s=CLOSED pgs=1227 gs=2 cs=0 l=1 c_cookie=7992190860633058709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.440+0000 7f915ce10e00 1 --2- 10.20.193.4:0/2699018088 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bf860 0x55f0bc703b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.440+0000 7f915ce10e00 1 --2- 10.20.193.4:0/2699018088 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc7035c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.440+0000 7f915ce10e00 1 -- 10.20.193.4:0/2699018088 >> 10.20.193.4:0/2699018088 conn(0x55f0bc5dddb0 msgr2=0x55f0bc6bd450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.440+0000 7f915ce10e00 1 -- 10.20.193.4:0/2699018088 shutdown_connections 2026-02-24T09:19:00.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.440+0000 7f915ce10e00 1 -- 10.20.193.4:0/2699018088 wait complete. 2026-02-24T09:19:00.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.441+0000 7f915ce10e00 1 -- start start 2026-02-24T09:19:00.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.441+0000 7f915ce10e00 1 Processor -- start 2026-02-24T09:19:00.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc69e810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bf860 0x55f0bc69ed50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915ce10e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc76a090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915ce10e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc69f540 con 0x55f0bc704500 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915ce10e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc69f6b0 con 0x55f0bc6bf860 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915ce10e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f0bc76a620 con 0x55f0bc6bef50 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915938c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc76a090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915938c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc76a090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52316/0 (socket says 10.20.193.4:52316) 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915938c640 1 -- 10.20.193.4:0/1512312297 learned_addr learned my addr 10.20.193.4:0/1512312297 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f9158b8b640 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc69e810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915938c640 1 -- 10.20.193.4:0/1512312297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 msgr2=0x55f0bc69e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915938c640 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc69e810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915938c640 1 -- 10.20.193.4:0/1512312297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bf860 msgr2=0x55f0bc69ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915938c640 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bf860 0x55f0bc69ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.444+0000 7f915938c640 1 -- 10.20.193.4:0/1512312297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0bc556190 con 0x55f0bc704500 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915938c640 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc76a090 secure :-1 s=READY pgs=1228 gs=1 cs=0 l=1 c_cookie=5227559764136886200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9150006e60 tx=0x7f915000a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488c05e89f80ffb8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f91127fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f91127fc640 1 -- 10.20.193.4:0/1512312297 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f915003e040 con 0x55f0bc704500 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 1 -- 10.20.193.4:0/1512312297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0bc55b710 con 0x55f0bc704500 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f91127fc640 1 -- 10.20.193.4:0/1512312297 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9150003bb0 con 0x55f0bc704500 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f91127fc640 1 -- 10.20.193.4:0/1512312297 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9150038ca0 con 0x55f0bc704500 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 10 client.18015 _ll_register_callbacks cb 0x55f0bc570080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 1 -- 10.20.193.4:0/1512312297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f913c0b3c70 con 0x55f0bc704500 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f91127fc640 1 -- 10.20.193.4:0/1512312297 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9150038e30 con 0x55f0bc704500 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f91127fc640 1 -- 10.20.193.4:0/1512312297 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f915004d6d0 con 0x55f0bc704500 2026-02-24T09:19:00.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 10 client.18015 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:00.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 1 -- 10.20.193.4:0/1512312297 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f0bc549d00 con 0x55f0bc704500 2026-02-24T09:19:00.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f91127fc640 1 -- 10.20.193.4:0/1512312297 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9150060030 con 0x55f0bc704500 2026-02-24T09:19:00.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 10 client.18015 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:00.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 10 client.18015 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:19:00.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 20 client.18015 populate_metadata read hostname 'trial004' 2026-02-24T09:19:00.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f0bc7b21d0 0x55f0bc7d2680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 4 client.18015 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:19:00.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.445+0000 7f915ce10e00 1 -- 10.20.193.4:0/1512312297 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f0bc2fa160 con 0x55f0bc7b21d0 2026-02-24T09:19:00.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.446+0000 7f9158b8b640 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f0bc7b21d0 0x55f0bc7d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f9158b8b640 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f0bc7b21d0 0x55f0bc7d2680 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=17284801498987596329 s_cookie=10521925153495029407 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=efdff362704b8a29 server_cookie=9205632df751969f in_seq=0 out_seq=0 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f91127fc640 10 client.18015 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f91127fc640 1 -- 10.20.193.4:0/1512312297 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f0bc2fa160 con 0x55f0bc7b21d0 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f91127fc640 10 client.18015 handle_command_reply: tid=0 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 client.18015 shutdown 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 -- 10.20.193.4:0/1512312297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 msgr2=0x55f0bc76a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc76a090 secure :-1 s=READY pgs=1228 gs=1 cs=0 l=1 c_cookie=5227559764136886200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9150006e60 tx=0x7f915000a480 comp rx=0 tx=0).stop 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 -- 10.20.193.4:0/1512312297 shutdown_connections 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55f0bc7b21d0 0x55f0bc7d2680 crc :-1 s=READY pgs=58 gs=4 cs=0 l=0 c_cookie=17284801498987596329 s_cookie=10521925153495029407 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f0bc704500 0x55f0bc76a090 unknown :-1 s=CLOSED pgs=1228 gs=1 cs=0 l=1 c_cookie=5227559764136886200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f0bc6bf860 0x55f0bc69ed50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 --2- 10.20.193.4:0/1512312297 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f0bc6bef50 0x55f0bc69e810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 -- 10.20.193.4:0/1512312297 >> 10.20.193.4:0/1512312297 conn(0x55f0bc5dddb0 msgr2=0x55f0bc6bdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f91127fc640 0 client.18015 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:19:00.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 -- 10.20.193.4:0/1512312297 shutdown_connections 2026-02-24T09:19:00.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.447+0000 7f915ce10e00 1 -- 10.20.193.4:0/1512312297 wait complete. 2026-02-24T09:19:00.455 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.448+0000 7f915ce10e00 20 client.18015 trim_cache size 0 max 16384 2026-02-24T09:19:00.455 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:19:00.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 -- 10.20.193.4:0/923716097 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f91300b5760 msgr2=0x7f91300d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f91300b5760 0x7f91300d5c10 secure :-1 s=READY pgs=438 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9144004740 tx=0x7f9144005f90 comp rx=0 tx=0).stop 2026-02-24T09:19:00.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 -- 10.20.193.4:0/923716097 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9154110040 msgr2=0x7f915411e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.456 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9154110040 0x7f915411e490 secure :-1 s=READY pgs=1225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f913c009480 tx=0x7f913c00ee60 comp rx=0 tx=0).stop 2026-02-24T09:19:00.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 -- 10.20.193.4:0/923716097 shutdown_connections 2026-02-24T09:19:00.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f91300b5760 0x7f91300d5c10 unknown :-1 s=CLOSED pgs=438 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9154115840 0x7f9154123860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9154110040 0x7f915411e490 unknown :-1 s=CLOSED pgs=1225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 --2- 10.20.193.4:0/923716097 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f915410f650 0x7f915411df50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 -- 10.20.193.4:0/923716097 >> 10.20.193.4:0/923716097 conn(0x7f91540ecf20 msgr2=0x7f915410d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 -- 10.20.193.4:0/923716097 shutdown_connections 2026-02-24T09:19:00.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.449+0000 7f915ae16640 1 -- 10.20.193.4:0/923716097 wait complete. 2026-02-24T09:19:00.581 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:19:00.783 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:00.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.925+0000 7f829a877640 1 -- 10.20.193.4:0/375278992 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829410dee0 msgr2=0x7f829410e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.925+0000 7f829a877640 1 --2- 10.20.193.4:0/375278992 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829410dee0 0x7f829410e2b0 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=2028265889287543795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8280009950 tx=0x7f828002f1b0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.925+0000 7f829a877640 1 -- 10.20.193.4:0/375278992 shutdown_connections 2026-02-24T09:19:00.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.925+0000 7f829a877640 1 --2- 10.20.193.4:0/375278992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829410c0d0 0x7f8294175e90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.925+0000 7f829a877640 1 --2- 10.20.193.4:0/375278992 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829410b540 0x7f829410b970 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.925+0000 7f829a877640 1 --2- 10.20.193.4:0/375278992 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829410dee0 0x7f829410e2b0 unknown :-1 s=CLOSED pgs=96 gs=2 cs=0 l=1 c_cookie=2028265889287543795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.925+0000 7f829a877640 1 -- 10.20.193.4:0/375278992 >> 10.20.193.4:0/375278992 conn(0x7f82940e92c0 msgr2=0x7f82941096d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.925+0000 7f829a877640 1 -- 10.20.193.4:0/375278992 shutdown_connections 2026-02-24T09:19:00.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.925+0000 7f829a877640 1 -- 10.20.193.4:0/375278992 wait complete. 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f829a877640 1 Processor -- start 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f829a877640 1 -- start start 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f829a877640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829410b540 0x7f82940f41a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f829a877640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829410c0d0 0x7f82940f46e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f829a877640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829410dee0 0x7f82940f9ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f829a877640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f82940fa0d0 con 0x7f829410dee0 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f829a877640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f82940fa240 con 0x7f829410b540 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f829a877640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f82940fa400 con 0x7f829410c0d0 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f8298ded640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829410dee0 0x7f82940f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f8298ded640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829410dee0 0x7f82940f9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52328/0 (socket says 10.20.193.4:52328) 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f8298ded640 1 -- 10.20.193.4:0/2473851025 learned_addr learned my addr 10.20.193.4:0/2473851025 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.926+0000 7f8293fff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829410b540 0x7f82940f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f82937fe640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829410c0d0 0x7f82940f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f8298ded640 1 -- 10.20.193.4:0/2473851025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829410c0d0 msgr2=0x7f82940f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f8298ded640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829410c0d0 0x7f82940f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f8298ded640 1 -- 10.20.193.4:0/2473851025 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829410b540 msgr2=0x7f82940f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f8298ded640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829410b540 0x7f82940f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f8298ded640 1 -- 10.20.193.4:0/2473851025 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8280009570 con 0x7f829410dee0 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f82937fe640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829410c0d0 0x7f82940f46e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f8293fff640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829410b540 0x7f82940f41a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f8298ded640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829410dee0 0x7f82940f9ab0 secure :-1 s=READY pgs=1229 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828800c540 tx=0x7f828800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f82917fa640 1 -- 10.20.193.4:0/2473851025 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8288005500 con 0x7f829410dee0 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f829a877640 1 -- 10.20.193.4:0/2473851025 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82940fa6e0 con 0x7f829410dee0 2026-02-24T09:19:00.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f829a877640 1 -- 10.20.193.4:0/2473851025 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8294173080 con 0x7f829410dee0 2026-02-24T09:19:00.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f82917fa640 1 -- 10.20.193.4:0/2473851025 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8288005660 con 0x7f829410dee0 2026-02-24T09:19:00.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.927+0000 7f82917fa640 1 -- 10.20.193.4:0/2473851025 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8288010cb0 con 0x7f829410dee0 2026-02-24T09:19:00.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.929+0000 7f82917fa640 1 -- 10.20.193.4:0/2473851025 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f8288020060 con 0x7f829410dee0 2026-02-24T09:19:00.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.930+0000 7f82917fa640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82680b5760 0x7f82680d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.930+0000 7f8293fff640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82680b5760 0x7f82680d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.930+0000 7f82917fa640 1 -- 10.20.193.4:0/2473851025 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f82880e6c90 con 0x7f829410dee0 2026-02-24T09:19:00.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.931+0000 7f8293fff640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82680b5760 0x7f82680d5c10 secure :-1 s=READY pgs=439 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8280038820 tx=0x7f828003a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f829c871e00 1 Processor -- start 2026-02-24T09:19:00.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f829c871e00 1 -- start start 2026-02-24T09:19:00.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f829c871e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a419da320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f829c871e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a419da860 0x559a41a1efc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f829c871e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1f500 0x559a41a3f8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f829c871e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559a418eaee0 con 0x559a419d9f50 2026-02-24T09:19:00.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f829c871e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559a418e6c10 con 0x559a419da860 2026-02-24T09:19:00.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f829c871e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559a418e0d70 con 0x559a41a1f500 2026-02-24T09:19:00.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8293fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a419da320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8293fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a419da320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52330/0 (socket says 10.20.193.4:52330) 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8293fff640 1 -- 10.20.193.4:0/2796982132 learned_addr learned my addr 10.20.193.4:0/2796982132 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8293fff640 1 -- 10.20.193.4:0/2796982132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1f500 msgr2=0x559a41a3f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8298ded640 1 --2- 10.20.193.4:0/2796982132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1f500 0x559a41a3f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8293fff640 1 --2- 10.20.193.4:0/2796982132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1f500 0x559a41a3f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8293fff640 1 -- 10.20.193.4:0/2796982132 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a419da860 msgr2=0x559a41a1efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8293fff640 1 --2- 10.20.193.4:0/2796982132 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a419da860 0x559a41a1efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8293fff640 1 -- 10.20.193.4:0/2796982132 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a4188c340 con 0x559a419d9f50 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8298ded640 1 --2- 10.20.193.4:0/2796982132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1f500 0x559a41a3f8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8293fff640 1 --2- 10.20.193.4:0/2796982132 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a419da320 secure :-1 s=READY pgs=1230 gs=1 cs=0 l=1 c_cookie=4670395085900313291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8280005e20 tx=0x7f8280040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d09395f7d172cb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.932+0000 7f8264ce3640 1 -- 10.20.193.4:0/2796982132 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f828002fcf0 con 0x559a419d9f50 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f8264ce3640 1 -- 10.20.193.4:0/2796982132 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f828003e040 con 0x559a419d9f50 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f8264ce3640 1 -- 10.20.193.4:0/2796982132 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8280004960 con 0x559a419d9f50 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f829c871e00 1 -- 10.20.193.4:0/2796982132 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 msgr2=0x559a419da320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f829c871e00 1 --2- 10.20.193.4:0/2796982132 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a419da320 secure :-1 s=READY pgs=1230 gs=1 cs=0 l=1 c_cookie=4670395085900313291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8280005e20 tx=0x7f8280040000 comp rx=0 tx=0).stop 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f829c871e00 1 -- 10.20.193.4:0/2796982132 shutdown_connections 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f829c871e00 1 --2- 10.20.193.4:0/2796982132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1f500 0x559a41a3f8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f829c871e00 1 --2- 10.20.193.4:0/2796982132 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a419da860 0x559a41a1efc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f829c871e00 1 --2- 10.20.193.4:0/2796982132 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a419da320 unknown :-1 s=CLOSED pgs=1230 gs=1 cs=0 l=1 c_cookie=4670395085900313291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f829c871e00 1 -- 10.20.193.4:0/2796982132 >> 10.20.193.4:0/2796982132 conn(0x559a418f8db0 msgr2=0x559a419d8830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f829c871e00 1 -- 10.20.193.4:0/2796982132 shutdown_connections 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.933+0000 7f829c871e00 1 -- 10.20.193.4:0/2796982132 wait complete. 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f829c871e00 1 -- start start 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f829c871e00 1 Processor -- start 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f829c871e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a36d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f829c871e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a419da860 0x559a41a37240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f829c871e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a41a1f500 0x559a41a3c230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f829c871e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559a41a3c770 con 0x559a419d9f50 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f829c871e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559a41a3c8e0 con 0x559a41a1f500 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f829c871e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559a41a3caa0 con 0x559a419da860 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f8293fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a36d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f8293fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a36d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52340/0 (socket says 10.20.193.4:52340) 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f8293fff640 1 -- 10.20.193.4:0/1577055522 learned_addr learned my addr 10.20.193.4:0/1577055522 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.934+0000 7f8298ded640 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a41a1f500 0x559a41a3c230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8293fff640 1 -- 10.20.193.4:0/1577055522 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a419da860 msgr2=0x559a41a37240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8293fff640 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a419da860 0x559a41a37240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8293fff640 1 -- 10.20.193.4:0/1577055522 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a41a1f500 msgr2=0x559a41a3c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8293fff640 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a41a1f500 0x559a41a3c230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8293fff640 1 -- 10.20.193.4:0/1577055522 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a418649d0 con 0x559a419d9f50 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8293fff640 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a36d00 secure :-1 s=READY pgs=1231 gs=1 cs=0 l=1 c_cookie=10835777457009174443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82800098a0 tx=0x7f828002fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96606a2fce37a7ab server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8255ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8255ffb640 1 -- 10.20.193.4:0/1577055522 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8280038d90 con 0x559a419d9f50 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8255ffb640 1 -- 10.20.193.4:0/1577055522 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8280005570 con 0x559a419d9f50 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 1 -- 10.20.193.4:0/1577055522 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8294176a70 con 0x559a419d9f50 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8255ffb640 1 -- 10.20.193.4:0/1577055522 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8280059b40 con 0x559a419d9f50 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 10 client.18027 _ll_register_callbacks cb 0x559a4188b080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 1 -- 10.20.193.4:0/1577055522 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559a416304a0 con 0x559a419d9f50 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8255ffb640 1 -- 10.20.193.4:0/1577055522 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8280059cd0 con 0x559a419d9f50 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8255ffb640 1 -- 10.20.193.4:0/1577055522 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8280044410 con 0x559a419d9f50 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 10 client.18027 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:00.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 1 -- 10.20.193.4:0/1577055522 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559a41876710 con 0x559a419d9f50 2026-02-24T09:19:00.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f8255ffb640 1 -- 10.20.193.4:0/1577055522 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f8280057040 con 0x559a419d9f50 2026-02-24T09:19:00.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 10 client.18027 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:00.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 10 client.18027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:00.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 20 client.18027 populate_metadata read hostname 'trial004' 2026-02-24T09:19:00.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559a41a1c460 0x559a41a1c900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 4 client.18027 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:00.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.935+0000 7f829c871e00 1 -- 10.20.193.4:0/1577055522 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a418d67b0 con 0x559a41a1c460 2026-02-24T09:19:00.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.936+0000 7f82937fe640 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559a41a1c460 0x559a41a1c900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.936+0000 7f82937fe640 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559a41a1c460 0x559a41a1c900 crc :-1 s=READY pgs=203 gs=4 cs=0 l=0 c_cookie=13220482623921888553 s_cookie=16237729374196021119 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b77896e6be169d29 server_cookie=e15800d5abe1377f in_seq=0 out_seq=0 2026-02-24T09:19:00.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.936+0000 7f8255ffb640 10 client.18027 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f8255ffb640 1 -- 10.20.193.4:0/1577055522 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x559a418d67b0 con 0x559a41a1c460 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f8255ffb640 10 client.18027 handle_command_reply: tid=0 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 client.18027 shutdown 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 -- 10.20.193.4:0/1577055522 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 msgr2=0x559a41a36d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a36d00 secure :-1 s=READY pgs=1231 gs=1 cs=0 l=1 c_cookie=10835777457009174443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82800098a0 tx=0x7f828002fd80 comp rx=0 tx=0).stop 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 -- 10.20.193.4:0/1577055522 shutdown_connections 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559a41a1c460 0x559a41a1c900 crc :-1 s=READY pgs=203 gs=4 cs=0 l=0 c_cookie=13220482623921888553 s_cookie=16237729374196021119 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a41a1f500 0x559a41a3c230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a419da860 0x559a41a37240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f8255ffb640 0 client.18027 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 --2- 10.20.193.4:0/1577055522 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a36d00 unknown :-1 s=CLOSED pgs=1231 gs=1 cs=0 l=1 c_cookie=10835777457009174443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 -- 10.20.193.4:0/1577055522 >> 10.20.193.4:0/1577055522 conn(0x559a418f8db0 msgr2=0x559a419d8040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 -- 10.20.193.4:0/1577055522 shutdown_connections 2026-02-24T09:19:00.940 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 1 -- 10.20.193.4:0/1577055522 wait complete. 2026-02-24T09:19:00.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.937+0000 7f829c871e00 20 client.18027 trim_cache size 0 max 16384 2026-02-24T09:19:00.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f829c871e00 1 Processor -- start 2026-02-24T09:19:00.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f829c871e00 1 -- start start 2026-02-24T09:19:00.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f829c871e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a3b7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f829c871e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a419da860 0x559a41a1a140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f829c871e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1c460 0x559a41a1a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f829c871e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559a41a37640 con 0x559a419d9f50 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f829c871e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559a418de9a0 con 0x559a419da860 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f829c871e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559a416badf0 con 0x559a41a1c460 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f8293fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a3b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f8293fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a3b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52354/0 (socket says 10.20.193.4:52354) 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f8293fff640 1 -- 10.20.193.4:0/567393300 learned_addr learned my addr 10.20.193.4:0/567393300 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f82937fe640 1 --2- 10.20.193.4:0/567393300 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a419da860 0x559a41a1a140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.946+0000 7f8298ded640 1 --2- 10.20.193.4:0/567393300 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1c460 0x559a41a1a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.947+0000 7f8293fff640 1 -- 10.20.193.4:0/567393300 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1c460 msgr2=0x559a41a1a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.947+0000 7f8293fff640 1 --2- 10.20.193.4:0/567393300 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1c460 0x559a41a1a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.947+0000 7f8293fff640 1 -- 10.20.193.4:0/567393300 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a419da860 msgr2=0x559a41a1a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.947+0000 7f8293fff640 1 --2- 10.20.193.4:0/567393300 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a419da860 0x559a41a1a140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.947+0000 7f8293fff640 1 -- 10.20.193.4:0/567393300 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a419d9dc0 con 0x559a419d9f50 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.947+0000 7f8293fff640 1 --2- 10.20.193.4:0/567393300 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a3b7a0 secure :-1 s=READY pgs=1232 gs=1 cs=0 l=1 c_cookie=4806768853008245484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82800054a0 tx=0x7f8280064000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b512cdf0f7e2ec server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.947+0000 7f8257fff640 1 -- 10.20.193.4:0/567393300 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8280005540 con 0x559a419d9f50 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.947+0000 7f8257fff640 1 -- 10.20.193.4:0/567393300 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x559a416304a0 con 0x559a419d9f50 2026-02-24T09:19:00.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.947+0000 7f8257fff640 1 -- 10.20.193.4:0/567393300 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8280058f00 con 0x559a419d9f50 2026-02-24T09:19:00.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.948+0000 7f829c871e00 1 -- 10.20.193.4:0/567393300 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 msgr2=0x559a41a3b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.948+0000 7f829c871e00 1 --2- 10.20.193.4:0/567393300 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a3b7a0 secure :-1 s=READY pgs=1232 gs=1 cs=0 l=1 c_cookie=4806768853008245484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82800054a0 tx=0x7f8280064000 comp rx=0 tx=0).stop 2026-02-24T09:19:00.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.948+0000 7f829c871e00 1 -- 10.20.193.4:0/567393300 shutdown_connections 2026-02-24T09:19:00.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.948+0000 7f829c871e00 1 --2- 10.20.193.4:0/567393300 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a41a1c460 0x559a41a1a680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.948+0000 7f829c871e00 1 --2- 10.20.193.4:0/567393300 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a419da860 0x559a41a1a140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.948+0000 7f829c871e00 1 --2- 10.20.193.4:0/567393300 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419d9f50 0x559a41a3b7a0 unknown :-1 s=CLOSED pgs=1232 gs=1 cs=0 l=1 c_cookie=4806768853008245484 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.948+0000 7f829c871e00 1 -- 10.20.193.4:0/567393300 >> 10.20.193.4:0/567393300 conn(0x559a418f8db0 msgr2=0x559a41a3b090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.948+0000 7f829c871e00 1 -- 10.20.193.4:0/567393300 shutdown_connections 2026-02-24T09:19:00.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.948+0000 7f829c871e00 1 -- 10.20.193.4:0/567393300 wait complete. 2026-02-24T09:19:00.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f829c871e00 1 -- start start 2026-02-24T09:19:00.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f829c871e00 1 Processor -- start 2026-02-24T09:19:00.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f829c871e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a419d9f50 0x559a41a345c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f829c871e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419da860 0x559a419b8030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f829c871e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a41a1c460 0x559a419b8570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f829c871e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x559a418de9a0 con 0x559a419da860 2026-02-24T09:19:00.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f829c871e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x559a416badf0 con 0x559a41a1c460 2026-02-24T09:19:00.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f829c871e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x559a41a24370 con 0x559a419d9f50 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f82937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419da860 0x559a419b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f82937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419da860 0x559a419b8030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52368/0 (socket says 10.20.193.4:52368) 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f82937fe640 1 -- 10.20.193.4:0/3654480145 learned_addr learned my addr 10.20.193.4:0/3654480145 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f8293fff640 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a419d9f50 0x559a41a345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f8298ded640 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a41a1c460 0x559a419b8570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f82937fe640 1 -- 10.20.193.4:0/3654480145 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a419d9f50 msgr2=0x559a41a345c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f82937fe640 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a419d9f50 0x559a41a345c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f82937fe640 1 -- 10.20.193.4:0/3654480145 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a41a1c460 msgr2=0x559a419b8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f82937fe640 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a41a1c460 0x559a419b8570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f82937fe640 1 -- 10.20.193.4:0/3654480145 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a41871190 con 0x559a419da860 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f82937fe640 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419da860 0x559a419b8030 secure :-1 s=READY pgs=1233 gs=1 cs=0 l=1 c_cookie=14034255182901288786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82940fab40 tx=0x7f8284004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c3b0bb70041f52 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.949+0000 7f8255ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f8255ffb640 1 -- 10.20.193.4:0/3654480145 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8284018040 con 0x559a419da860 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 1 -- 10.20.193.4:0/3654480145 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a41876710 con 0x559a419da860 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f8255ffb640 1 -- 10.20.193.4:0/3654480145 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8284003df0 con 0x559a419da860 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f8255ffb640 1 -- 10.20.193.4:0/3654480145 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8284011b00 con 0x559a419da860 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 10 client.18033 _ll_register_callbacks cb 0x559a4188b080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:00.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 1 -- 10.20.193.4:0/3654480145 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f828003e040 con 0x559a419da860 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f8255ffb640 1 -- 10.20.193.4:0/3654480145 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8284011c90 con 0x559a419da860 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f8255ffb640 1 -- 10.20.193.4:0/3654480145 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8284011e50 con 0x559a419da860 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 10 client.18033 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 1 -- 10.20.193.4:0/3654480145 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x559a41864d00 con 0x559a419da860 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f8255ffb640 1 -- 10.20.193.4:0/3654480145 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f828401d6a0 con 0x559a419da860 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 10 client.18033 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 10 client.18033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 20 client.18033 populate_metadata read hostname 'trial004' 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559a41a1f500 0x559a41aec9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 4 client.18033 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.950+0000 7f829c871e00 1 -- 10.20.193.4:0/3654480145 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a41615160 con 0x559a41a1f500 2026-02-24T09:19:00.954 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.951+0000 7f8293fff640 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559a41a1f500 0x559a41aec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.951+0000 7f8255ffb640 10 client.18033 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.951+0000 7f8293fff640 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559a41a1f500 0x559a41aec9c0 crc :-1 s=READY pgs=204 gs=4 cs=0 l=0 c_cookie=7556023064569831965 s_cookie=5403820803078692552 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68dc62f19657e21d server_cookie=4afe3a63c55f1ec8 in_seq=0 out_seq=0 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.951+0000 7f8255ffb640 1 -- 10.20.193.4:0/3654480145 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a41615160 con 0x559a41a1f500 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.951+0000 7f8255ffb640 10 client.18033 handle_command_reply: tid=0 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.951+0000 7f829c871e00 1 client.18033 shutdown 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 1 -- 10.20.193.4:0/3654480145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419da860 msgr2=0x559a419b8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419da860 0x559a419b8030 secure :-1 s=READY pgs=1233 gs=1 cs=0 l=1 c_cookie=14034255182901288786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82940fab40 tx=0x7f8284004410 comp rx=0 tx=0).stop 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 1 -- 10.20.193.4:0/3654480145 shutdown_connections 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x559a41a1f500 0x559a41aec9c0 crc :-1 s=READY pgs=204 gs=4 cs=0 l=0 c_cookie=7556023064569831965 s_cookie=5403820803078692552 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x559a41a1c460 0x559a419b8570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f8255ffb640 0 client.18033 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x559a419da860 0x559a419b8030 unknown :-1 s=CLOSED pgs=1233 gs=1 cs=0 l=1 c_cookie=14034255182901288786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 1 --2- 10.20.193.4:0/3654480145 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x559a419d9f50 0x559a41a345c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 1 -- 10.20.193.4:0/3654480145 >> 10.20.193.4:0/3654480145 conn(0x559a418f8db0 msgr2=0x559a41a338b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.956 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:19:00.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 1 -- 10.20.193.4:0/3654480145 shutdown_connections 2026-02-24T09:19:00.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 1 -- 10.20.193.4:0/3654480145 wait complete. 2026-02-24T09:19:00.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.952+0000 7f829c871e00 20 client.18033 trim_cache size 0 max 16384 2026-02-24T09:19:00.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 -- 10.20.193.4:0/2473851025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82680b5760 msgr2=0x7f82680d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82680b5760 0x7f82680d5c10 secure :-1 s=READY pgs=439 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8280038820 tx=0x7f828003a040 comp rx=0 tx=0).stop 2026-02-24T09:19:00.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 -- 10.20.193.4:0/2473851025 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829410dee0 msgr2=0x7f82940f9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:00.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829410dee0 0x7f82940f9ab0 secure :-1 s=READY pgs=1229 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828800c540 tx=0x7f828800ca10 comp rx=0 tx=0).stop 2026-02-24T09:19:00.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 -- 10.20.193.4:0/2473851025 shutdown_connections 2026-02-24T09:19:00.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82680b5760 0x7f82680d5c10 unknown :-1 s=CLOSED pgs=439 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829410dee0 0x7f82940f9ab0 unknown :-1 s=CLOSED pgs=1229 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829410c0d0 0x7f82940f46e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 --2- 10.20.193.4:0/2473851025 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829410b540 0x7f82940f41a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:00.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 -- 10.20.193.4:0/2473851025 >> 10.20.193.4:0/2473851025 conn(0x7f82940e92c0 msgr2=0x7f82940eea90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:00.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 -- 10.20.193.4:0/2473851025 shutdown_connections 2026-02-24T09:19:00.958 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:00.954+0000 7f829a877640 1 -- 10.20.193.4:0/2473851025 wait complete. 2026-02-24T09:19:01.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:00 trial004 ceph-mon[41596]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 852 MiB/s wr, 239 op/s 2026-02-24T09:19:01.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:00 trial090 ceph-mon[47278]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 852 MiB/s wr, 239 op/s 2026-02-24T09:19:01.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:00 trial014 ceph-mon[46941]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 47 KiB/s rd, 852 MiB/s wr, 239 op/s 2026-02-24T09:19:02.011 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:19:02.012 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:19:02.199 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:02.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.369+0000 7ff7eb78c640 1 -- 10.20.193.4:0/3536429805 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff7e410de40 msgr2=0x7ff7e4112e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.369+0000 7ff7eb78c640 1 --2- 10.20.193.4:0/3536429805 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff7e410de40 0x7ff7e4112e90 secure :-1 s=READY pgs=1234 gs=1 cs=0 l=1 c_cookie=5099956972999667015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7d8009950 tx=0x7ff7d802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.370+0000 7ff7eb78c640 1 -- 10.20.193.4:0/3536429805 shutdown_connections 2026-02-24T09:19:02.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.370+0000 7ff7eb78c640 1 --2- 10.20.193.4:0/3536429805 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e4113640 0x7ff7e4174010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.370+0000 7ff7eb78c640 1 --2- 10.20.193.4:0/3536429805 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff7e410de40 0x7ff7e4112e90 unknown :-1 s=CLOSED pgs=1234 gs=1 cs=0 l=1 c_cookie=5099956972999667015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.370+0000 7ff7eb78c640 1 --2- 10.20.193.4:0/3536429805 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff7e410d450 0x7ff7e410d820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.370+0000 7ff7eb78c640 1 -- 10.20.193.4:0/3536429805 >> 10.20.193.4:0/3536429805 conn(0x7ff7e40ead00 msgr2=0x7ff7e410b110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.370+0000 7ff7eb78c640 1 -- 10.20.193.4:0/3536429805 shutdown_connections 2026-02-24T09:19:02.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.371+0000 7ff7eb78c640 1 -- 10.20.193.4:0/3536429805 wait complete. 2026-02-24T09:19:02.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.371+0000 7ff7eb78c640 1 Processor -- start 2026-02-24T09:19:02.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.371+0000 7ff7eb78c640 1 -- start start 2026-02-24T09:19:02.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.371+0000 7ff7eb78c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff7e410d450 0x7ff7e40f5930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.371+0000 7ff7eb78c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e410de40 0x7ff7e4173f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7eb78c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff7e4113640 0x7ff7e40f6030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7eb78c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e40fb240 con 0x7ff7e4113640 2026-02-24T09:19:02.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7eb78c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e40fb3b0 con 0x7ff7e410d450 2026-02-24T09:19:02.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7eb78c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e40fb570 con 0x7ff7e410de40 2026-02-24T09:19:02.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7e9d02640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff7e4113640 0x7ff7e40f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7e9d02640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff7e4113640 0x7ff7e40f6030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52392/0 (socket says 10.20.193.4:52392) 2026-02-24T09:19:02.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7e9d02640 1 -- 10.20.193.4:0/2587121318 learned_addr learned my addr 10.20.193.4:0/2587121318 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7e9d02640 1 -- 10.20.193.4:0/2587121318 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e410de40 msgr2=0x7ff7e4173f10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7e9d02640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e410de40 0x7ff7e4173f10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7e9d02640 1 -- 10.20.193.4:0/2587121318 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff7e410d450 msgr2=0x7ff7e40f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7e9d02640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff7e410d450 0x7ff7e40f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7e9d02640 1 -- 10.20.193.4:0/2587121318 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d8009570 con 0x7ff7e4113640 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7e9d02640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff7e4113640 0x7ff7e40f6030 secure :-1 s=READY pgs=1235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7e000f8d0 tx=0x7ff7e000fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7d27fc640 1 -- 10.20.193.4:0/2587121318 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7e000dce0 con 0x7ff7e4113640 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7eb78c640 1 -- 10.20.193.4:0/2587121318 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e40fb850 con 0x7ff7e4113640 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.372+0000 7ff7eb78c640 1 -- 10.20.193.4:0/2587121318 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e40fbd70 con 0x7ff7e4113640 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.373+0000 7ff7d27fc640 1 -- 10.20.193.4:0/2587121318 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff7e000de40 con 0x7ff7e4113640 2026-02-24T09:19:02.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.373+0000 7ff7d27fc640 1 -- 10.20.193.4:0/2587121318 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7e00116b0 con 0x7ff7e4113640 2026-02-24T09:19:02.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.379+0000 7ff7d27fc640 1 -- 10.20.193.4:0/2587121318 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff7e0020060 con 0x7ff7e4113640 2026-02-24T09:19:02.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.381+0000 7ff7d27fc640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7c00b5750 0x7ff7c00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.381+0000 7ff7d27fc640 1 -- 10.20.193.4:0/2587121318 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff7e0015070 con 0x7ff7e4113640 2026-02-24T09:19:02.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.382+0000 7ff7e9501640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7c00b5750 0x7ff7c00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.382+0000 7ff7e9501640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7c00b5750 0x7ff7c00d5c00 secure :-1 s=READY pgs=440 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7d4009480 tx=0x7ff7d4009410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7ed786e00 1 Processor -- start 2026-02-24T09:19:02.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7ed786e00 1 -- start start 2026-02-24T09:19:02.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522b76d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522b7c10 0x55e1522fc370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 0x55e15231cc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e1521c7520 con 0x55e1522b7300 2026-02-24T09:19:02.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e1521c3250 con 0x55e1522fc8b0 2026-02-24T09:19:02.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e1521bd3b0 con 0x55e1522b7c10 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7e9501640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7e9501640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522b76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52396/0 (socket says 10.20.193.4:52396) 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7e9501640 1 -- 10.20.193.4:0/2726964954 learned_addr learned my addr 10.20.193.4:0/2726964954 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7e8d00640 1 --2- 10.20.193.4:0/2726964954 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522b7c10 0x55e1522fc370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.383+0000 7ff7e9d02640 1 --2- 10.20.193.4:0/2726964954 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 0x55e15231cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.384+0000 7ff7e9501640 1 -- 10.20.193.4:0/2726964954 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522b7c10 msgr2=0x55e1522fc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.384+0000 7ff7e9501640 1 --2- 10.20.193.4:0/2726964954 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522b7c10 0x55e1522fc370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.384+0000 7ff7e9501640 1 -- 10.20.193.4:0/2726964954 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 msgr2=0x55e15231cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.384+0000 7ff7e9501640 1 --2- 10.20.193.4:0/2726964954 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 0x55e15231cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.384+0000 7ff7e9501640 1 -- 10.20.193.4:0/2726964954 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1521686e0 con 0x55e1522b7300 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.384+0000 7ff7e9d02640 1 --2- 10.20.193.4:0/2726964954 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 0x55e15231cc90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:02.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.384+0000 7ff7e9501640 1 --2- 10.20.193.4:0/2726964954 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522b76d0 secure :-1 s=READY pgs=1236 gs=1 cs=0 l=1 c_cookie=4356442105417414355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7d4009750 tx=0x7ff7d4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c75310371f5b6d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.384+0000 7ff7b1ce5640 1 -- 10.20.193.4:0/2726964954 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7d4010e20 con 0x55e1522b7300 2026-02-24T09:19:02.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.384+0000 7ff7b1ce5640 1 -- 10.20.193.4:0/2726964954 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff7d40026a0 con 0x55e1522b7300 2026-02-24T09:19:02.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.384+0000 7ff7b1ce5640 1 -- 10.20.193.4:0/2726964954 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7d401c6a0 con 0x55e1522b7300 2026-02-24T09:19:02.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.385+0000 7ff7ed786e00 1 -- 10.20.193.4:0/2726964954 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 msgr2=0x55e1522b76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.393 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.385+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/2726964954 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522b76d0 secure :-1 s=READY pgs=1236 gs=1 cs=0 l=1 c_cookie=4356442105417414355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7d4009750 tx=0x7ff7d4011000 comp rx=0 tx=0).stop 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.385+0000 7ff7ed786e00 1 -- 10.20.193.4:0/2726964954 shutdown_connections 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.385+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/2726964954 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 0x55e15231cc90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.385+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/2726964954 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522b7c10 0x55e1522fc370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.385+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/2726964954 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522b76d0 unknown :-1 s=CLOSED pgs=1236 gs=1 cs=0 l=1 c_cookie=4356442105417414355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.385+0000 7ff7ed786e00 1 -- 10.20.193.4:0/2726964954 >> 10.20.193.4:0/2726964954 conn(0x55e1521d54f0 msgr2=0x55e1522b5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.385+0000 7ff7ed786e00 1 -- 10.20.193.4:0/2726964954 shutdown_connections 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.385+0000 7ff7ed786e00 1 -- 10.20.193.4:0/2726964954 wait complete. 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7ed786e00 1 -- start start 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7ed786e00 1 Processor -- start 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522cf340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522b7c10 0x55e1522cf880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 0x55e1522d4870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e1522d4db0 con 0x55e1522b7300 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e1522d4f20 con 0x55e1522fc8b0 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e1522d50e0 con 0x55e1522b7c10 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7e9501640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7e9d02640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 0x55e1522d4870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7e9501640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52398/0 (socket says 10.20.193.4:52398) 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7e9501640 1 -- 10.20.193.4:0/1415863200 learned_addr learned my addr 10.20.193.4:0/1415863200 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.387+0000 7ff7e8d00640 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522b7c10 0x55e1522cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff7e9d02640 1 -- 10.20.193.4:0/1415863200 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522b7c10 msgr2=0x55e1522cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff7e9d02640 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522b7c10 0x55e1522cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff7e9d02640 1 -- 10.20.193.4:0/1415863200 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 msgr2=0x55e1522cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff7e9d02640 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff7e9d02640 1 -- 10.20.193.4:0/1415863200 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e152140cd0 con 0x55e1522fc8b0 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff7e9501640 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522cf340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff7e9d02640 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 0x55e1522d4870 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=2296326819447016570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7e000a4e0 tx=0x7ff7e00aeaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fde311369578c7a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff79effd640 10 client.0 ms_handle_connect on v2:10.20.193.14:3300/0 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff79effd640 1 -- 10.20.193.4:0/1415863200 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7e00aefa0 con 0x55e1522fc8b0 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1415863200 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d400e9f0 con 0x55e1522fc8b0 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff79effd640 1 -- 10.20.193.4:0/1415863200 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff7e00b9230 con 0x55e1522fc8b0 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff79effd640 1 -- 10.20.193.4:0/1415863200 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7e00ac0d0 con 0x55e1522fc8b0 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff7ed786e00 10 client.26885 _ll_register_callbacks cb 0x55e152139790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1415863200 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e151e4a9d0 con 0x55e1522fc8b0 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff79effd640 1 -- 10.20.193.4:0/1415863200 <== mon.2 v2:10.20.193.14:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff7e00ac260 con 0x55e1522fc8b0 2026-02-24T09:19:02.396 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.388+0000 7ff79effd640 1 -- 10.20.193.4:0/1415863200 <== mon.2 v2:10.20.193.14:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff7e006cea0 con 0x55e1522fc8b0 2026-02-24T09:19:02.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.389+0000 7ff7ed786e00 10 client.26885 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:02.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.389+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1415863200 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e152152ab0 con 0x55e1522fc8b0 2026-02-24T09:19:02.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.389+0000 7ff79effd640 1 -- 10.20.193.4:0/1415863200 <== mon.2 v2:10.20.193.14:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff7e00afae0 con 0x55e1522fc8b0 2026-02-24T09:19:02.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.389+0000 7ff7ed786e00 10 client.26885 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:02.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.389+0000 7ff7ed786e00 10 client.26885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:02.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.389+0000 7ff7ed786e00 20 client.26885 populate_metadata read hostname 'trial004' 2026-02-24T09:19:02.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.389+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e1522f9a90 0x55e1522f9f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.389+0000 7ff7ed786e00 4 client.26885 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:02.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.389+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1415863200 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1521cdb70 con 0x55e1522f9a90 2026-02-24T09:19:02.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.390+0000 7ff7e9501640 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e1522f9a90 0x55e1522f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.393+0000 7ff79effd640 10 client.26885 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:02.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.393+0000 7ff7e9501640 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e1522f9a90 0x55e1522f9f30 crc :-1 s=READY pgs=205 gs=4 cs=0 l=0 c_cookie=17916445259654558226 s_cookie=12102432845321227578 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8a40009cb70f212 server_cookie=a7f47a8d27644d3a in_seq=0 out_seq=0 2026-02-24T09:19:02.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff79effd640 1 -- 10.20.193.4:0/1415863200 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e1521cdb70 con 0x55e1522f9a90 2026-02-24T09:19:02.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff79effd640 10 client.26885 handle_command_reply: tid=0 2026-02-24T09:19:02.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 client.26885 shutdown 2026-02-24T09:19:02.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1415863200 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 msgr2=0x55e1522d4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 0x55e1522d4870 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=2296326819447016570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7e000a4e0 tx=0x7ff7e00aeaf0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1415863200 shutdown_connections 2026-02-24T09:19:02.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e1522f9a90 0x55e1522f9f30 crc :-1 s=READY pgs=205 gs=4 cs=0 l=0 c_cookie=17916445259654558226 s_cookie=12102432845321227578 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522fc8b0 0x55e1522d4870 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=2296326819447016570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522b7c10 0x55e1522cf880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/1415863200 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7300 0x55e1522cf340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff79effd640 0 client.26885 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:02.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1415863200 >> 10.20.193.4:0/1415863200 conn(0x55e1521d54f0 msgr2=0x55e1522b62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1415863200 shutdown_connections 2026-02-24T09:19:02.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.394+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1415863200 wait complete. 2026-02-24T09:19:02.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.396+0000 7ff7ed786e00 20 client.26885 trim_cache size 0 max 16384 2026-02-24T09:19:02.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7ed786e00 1 Processor -- start 2026-02-24T09:19:02.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7ed786e00 1 -- start start 2026-02-24T09:19:02.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 0x55e1522f4d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522f5290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522f9a90 0x55e1522b54e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e1521bafe0 con 0x55e1522b7c10 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e151e85fe0 con 0x55e1522b7300 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e152248dd0 con 0x55e1522f9a90 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7e8d00640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7e9501640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 0x55e1522f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7e9501640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 0x55e1522f4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:39778/0 (socket says 10.20.193.4:39778) 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.410+0000 7ff7e8d00640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522f5290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52408/0 (socket says 10.20.193.4:52408) 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7e9501640 1 -- 10.20.193.4:0/1485155770 learned_addr learned my addr 10.20.193.4:0/1485155770 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7e9d02640 1 --2- 10.20.193.4:0/1485155770 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522f9a90 0x55e1522b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7e8d00640 1 -- 10.20.193.4:0/1485155770 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522f9a90 msgr2=0x55e1522b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7e8d00640 1 --2- 10.20.193.4:0/1485155770 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522f9a90 0x55e1522b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7e8d00640 1 -- 10.20.193.4:0/1485155770 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 msgr2=0x55e1522f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.416 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7e8d00640 1 --2- 10.20.193.4:0/1485155770 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 0x55e1522f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7e8d00640 1 -- 10.20.193.4:0/1485155770 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e15214d530 con 0x55e1522b7c10 2026-02-24T09:19:02.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7e8d00640 1 --2- 10.20.193.4:0/1485155770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522f5290 secure :-1 s=READY pgs=1237 gs=1 cs=0 l=1 c_cookie=4091729229396908349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55e15222a310 tx=0x7ff7d803a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c8be0e2349193d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7b14e4640 1 -- 10.20.193.4:0/1485155770 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7d803f040 con 0x55e1522b7c10 2026-02-24T09:19:02.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7b14e4640 1 -- 10.20.193.4:0/1485155770 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff7d8005dd0 con 0x55e1522b7c10 2026-02-24T09:19:02.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.411+0000 7ff7b14e4640 1 -- 10.20.193.4:0/1485155770 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7d802fc70 con 0x55e1522b7c10 2026-02-24T09:19:02.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.413+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1485155770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 msgr2=0x55e1522f5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.413+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/1485155770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522f5290 secure :-1 s=READY pgs=1237 gs=1 cs=0 l=1 c_cookie=4091729229396908349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x55e15222a310 tx=0x7ff7d803a040 comp rx=0 tx=0).stop 2026-02-24T09:19:02.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.413+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1485155770 shutdown_connections 2026-02-24T09:19:02.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.413+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/1485155770 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522f9a90 0x55e1522b54e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.413+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/1485155770 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522f5290 unknown :-1 s=CLOSED pgs=1237 gs=1 cs=0 l=1 c_cookie=4091729229396908349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.413+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/1485155770 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 0x55e1522f4d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.413+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1485155770 >> 10.20.193.4:0/1485155770 conn(0x55e1521d54f0 msgr2=0x55e1522cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.413+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1485155770 shutdown_connections 2026-02-24T09:19:02.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.413+0000 7ff7ed786e00 1 -- 10.20.193.4:0/1485155770 wait complete. 2026-02-24T09:19:02.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.413+0000 7ff7ed786e00 1 -- start start 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7ed786e00 1 Processor -- start 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 0x55e1522d7630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522d7b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7ed786e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522f9a90 0x55e15234a840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e152292650 con 0x55e1522b7c10 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e1522d4980 con 0x55e1522b7300 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7ed786e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e15234ae30 con 0x55e1522f9a90 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7e8d00640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522d7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7e8d00640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522d7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52418/0 (socket says 10.20.193.4:52418) 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7e8d00640 1 -- 10.20.193.4:0/3365172881 learned_addr learned my addr 10.20.193.4:0/3365172881 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:02.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7e9d02640 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522f9a90 0x55e15234a840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7e9501640 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 0x55e1522d7630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7e8d00640 1 -- 10.20.193.4:0/3365172881 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522f9a90 msgr2=0x55e15234a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7e8d00640 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522f9a90 0x55e15234a840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7e8d00640 1 -- 10.20.193.4:0/3365172881 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 msgr2=0x55e1522d7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7e8d00640 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 0x55e1522d7630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.414+0000 7ff7e8d00640 1 -- 10.20.193.4:0/3365172881 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e152141000 con 0x55e1522b7c10 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7e8d00640 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522d7b70 secure :-1 s=READY pgs=1238 gs=1 cs=0 l=1 c_cookie=13941353482216153047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7d80098a0 tx=0x7ff7d802fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c179a320aba61fd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff79effd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff79effd640 1 -- 10.20.193.4:0/3365172881 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7d803f040 con 0x55e1522b7c10 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 1 -- 10.20.193.4:0/3365172881 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e4174880 con 0x55e1522b7c10 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff79effd640 1 -- 10.20.193.4:0/3365172881 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff7d8038680 con 0x55e1522b7c10 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff79effd640 1 -- 10.20.193.4:0/3365172881 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7d8045990 con 0x55e1522b7c10 2026-02-24T09:19:02.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 10 client.18051 _ll_register_callbacks cb 0x55e152139790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 1 -- 10.20.193.4:0/3365172881 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e1521cf7e0 con 0x55e1522b7c10 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff79effd640 1 -- 10.20.193.4:0/3365172881 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff7d8045b20 con 0x55e1522b7c10 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff79effd640 1 -- 10.20.193.4:0/3365172881 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff7d8045d20 con 0x55e1522b7c10 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 10 client.18051 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 1 -- 10.20.193.4:0/3365172881 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e152152d10 con 0x55e1522b7c10 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff79effd640 1 -- 10.20.193.4:0/3365172881 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff7d805a460 con 0x55e1522b7c10 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 10 client.18051 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 10 client.18051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 20 client.18051 populate_metadata read hostname 'trial004' 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e1522fc8b0 0x55e15234cae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 4 client.18051 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:19:02.425 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.415+0000 7ff7ed786e00 1 -- 10.20.193.4:0/3365172881 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e151e48220 con 0x55e1522fc8b0 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.416+0000 7ff7e9501640 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e1522fc8b0 0x55e15234cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.416+0000 7ff7e9501640 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e1522fc8b0 0x55e15234cae0 crc :-1 s=READY pgs=206 gs=4 cs=0 l=0 c_cookie=10447066661422073032 s_cookie=11323367941702795613 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90fb6fc712e384c8 server_cookie=9d24af26323dc15d in_seq=0 out_seq=0 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.416+0000 7ff79effd640 10 client.18051 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff79effd640 1 -- 10.20.193.4:0/3365172881 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e151e48220 con 0x55e1522fc8b0 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff79effd640 10 client.18051 handle_command_reply: tid=0 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff7ed786e00 1 client.18051 shutdown 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff7ed786e00 1 -- 10.20.193.4:0/3365172881 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 msgr2=0x55e1522d7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522d7b70 secure :-1 s=READY pgs=1238 gs=1 cs=0 l=1 c_cookie=13941353482216153047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7d80098a0 tx=0x7ff7d802fc80 comp rx=0 tx=0).stop 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff7ed786e00 1 -- 10.20.193.4:0/3365172881 shutdown_connections 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55e1522fc8b0 0x55e15234cae0 crc :-1 s=READY pgs=206 gs=4 cs=0 l=0 c_cookie=10447066661422073032 s_cookie=11323367941702795613 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e1522f9a90 0x55e15234a840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.426 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1522b7c10 0x55e1522d7b70 unknown :-1 s=CLOSED pgs=1238 gs=1 cs=0 l=1 c_cookie=13941353482216153047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff79effd640 0 client.18051 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:02.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.417+0000 7ff7ed786e00 1 --2- 10.20.193.4:0/3365172881 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1522b7300 0x55e1522d7630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7ed786e00 1 -- 10.20.193.4:0/3365172881 >> 10.20.193.4:0/3365172881 conn(0x55e1521d54f0 msgr2=0x55e1522cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7ed786e00 1 -- 10.20.193.4:0/3365172881 shutdown_connections 2026-02-24T09:19:02.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7ed786e00 1 -- 10.20.193.4:0/3365172881 wait complete. 2026-02-24T09:19:02.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7ed786e00 20 client.18051 trim_cache size 0 max 16384 2026-02-24T09:19:02.427 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:19:02.427 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:19:02.428 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "50fcb56c-a674-4f78-aafd-69881ffc04d0", 2026-02-24T09:19:02.428 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:19:02.428 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:19:02.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 -- 10.20.193.4:0/2587121318 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7c00b5750 msgr2=0x7ff7c00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7c00b5750 0x7ff7c00d5c00 secure :-1 s=READY pgs=440 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7d4009480 tx=0x7ff7d4009410 comp rx=0 tx=0).stop 2026-02-24T09:19:02.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 -- 10.20.193.4:0/2587121318 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff7e4113640 msgr2=0x7ff7e40f6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff7e4113640 0x7ff7e40f6030 secure :-1 s=READY pgs=1235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7e000f8d0 tx=0x7ff7e000fda0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 -- 10.20.193.4:0/2587121318 shutdown_connections 2026-02-24T09:19:02.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7c00b5750 0x7ff7c00d5c00 unknown :-1 s=CLOSED pgs=440 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff7e4113640 0x7ff7e40f6030 unknown :-1 s=CLOSED pgs=1235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e410de40 0x7ff7e4173f10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 --2- 10.20.193.4:0/2587121318 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff7e410d450 0x7ff7e40f5930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 -- 10.20.193.4:0/2587121318 >> 10.20.193.4:0/2587121318 conn(0x7ff7e40ead00 msgr2=0x7ff7e410c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 -- 10.20.193.4:0/2587121318 shutdown_connections 2026-02-24T09:19:02.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.418+0000 7ff7eb78c640 1 -- 10.20.193.4:0/2587121318 wait complete. 2026-02-24T09:19:02.477 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:19:02.671 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:02.846 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.840+0000 7f4de6e16640 1 -- 10.20.193.4:0/1943765208 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4de010cc80 msgr2=0x7f4de0111cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.840+0000 7f4de6e16640 1 --2- 10.20.193.4:0/1943765208 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4de010cc80 0x7f4de0111cd0 secure :-1 s=READY pgs=98 gs=3 cs=0 l=1 c_cookie=13878993812150507664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dc8009890 tx=0x7f4dc802f0e0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.840+0000 7f4de6e16640 1 -- 10.20.193.4:0/1943765208 shutdown_connections 2026-02-24T09:19:02.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.840+0000 7f4de6e16640 1 --2- 10.20.193.4:0/1943765208 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4de0112480 0x7f4de0172e50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.840+0000 7f4de6e16640 1 --2- 10.20.193.4:0/1943765208 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4de010cc80 0x7f4de0111cd0 unknown :-1 s=CLOSED pgs=98 gs=3 cs=0 l=1 c_cookie=13878993812150507664 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.840+0000 7f4de6e16640 1 --2- 10.20.193.4:0/1943765208 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4de010c290 0x7f4de010c660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.840+0000 7f4de6e16640 1 -- 10.20.193.4:0/1943765208 >> 10.20.193.4:0/1943765208 conn(0x7f4de00e9b80 msgr2=0x7f4de0109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.840+0000 7f4de6e16640 1 -- 10.20.193.4:0/1943765208 shutdown_connections 2026-02-24T09:19:02.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.840+0000 7f4de6e16640 1 -- 10.20.193.4:0/1943765208 wait complete. 2026-02-24T09:19:02.847 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.841+0000 7f4de6e16640 1 Processor -- start 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.841+0000 7f4de6e16640 1 -- start start 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.841+0000 7f4de6e16640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4de010c290 0x7f4de00f3e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.841+0000 7f4de6e16640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4de010cc80 0x7f4de0172d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.841+0000 7f4de6e16640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4de0112480 0x7f4de00f4550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.841+0000 7f4de6e16640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00f9710 con 0x7f4de0112480 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.841+0000 7f4de6e16640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00f9880 con 0x7f4de010cc80 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.841+0000 7f4de6e16640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00f9a40 con 0x7f4de010c290 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de538c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4de0112480 0x7f4de00f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de4b8b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4de010c290 0x7f4de00f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de4b8b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4de010c290 0x7f4de00f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:51830/0 (socket says 10.20.193.4:51830) 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de4b8b640 1 -- 10.20.193.4:0/2041563815 learned_addr learned my addr 10.20.193.4:0/2041563815 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:02.848 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4dd7fff640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4de010cc80 0x7f4de0172d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de538c640 1 -- 10.20.193.4:0/2041563815 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4de010c290 msgr2=0x7f4de00f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de538c640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4de010c290 0x7f4de00f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de538c640 1 -- 10.20.193.4:0/2041563815 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4de010cc80 msgr2=0x7f4de0172d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de538c640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4de010cc80 0x7f4de0172d50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de538c640 1 -- 10.20.193.4:0/2041563815 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc80094b0 con 0x7f4de0112480 2026-02-24T09:19:02.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de538c640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4de0112480 0x7f4de00f4550 secure :-1 s=READY pgs=1239 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ddc00f940 tx=0x7f4ddc00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4dd5ffb640 1 -- 10.20.193.4:0/2041563815 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ddc00dce0 con 0x7f4de0112480 2026-02-24T09:19:02.849 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.842+0000 7f4de6e16640 1 -- 10.20.193.4:0/2041563815 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de00f9d20 con 0x7f4de0112480 2026-02-24T09:19:02.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.843+0000 7f4de6e16640 1 -- 10.20.193.4:0/2041563815 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de00fa240 con 0x7f4de0112480 2026-02-24T09:19:02.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.844+0000 7f4dd5ffb640 1 -- 10.20.193.4:0/2041563815 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ddc00de40 con 0x7f4de0112480 2026-02-24T09:19:02.850 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.844+0000 7f4dd5ffb640 1 -- 10.20.193.4:0/2041563815 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ddc0116b0 con 0x7f4de0112480 2026-02-24T09:19:02.851 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.848+0000 7f4dd5ffb640 1 -- 10.20.193.4:0/2041563815 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f4ddc020060 con 0x7f4de0112480 2026-02-24T09:19:02.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.848+0000 7f4dd5ffb640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dbc0b5750 0x7f4dbc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.849+0000 7f4dd5ffb640 1 -- 10.20.193.4:0/2041563815 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4ddc015070 con 0x7f4de0112480 2026-02-24T09:19:02.852 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.849+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dbc0b5750 0x7f4dbc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.853 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.849+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dbc0b5750 0x7f4dbc0d5c00 secure :-1 s=READY pgs=441 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dd0005970 tx=0x7f4dd0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.852+0000 7f4de8e10e00 1 Processor -- start 2026-02-24T09:19:02.856 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.852+0000 7f4de8e10e00 1 -- start start 2026-02-24T09:19:02.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.853+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fce82820 0x5599fce82bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.853+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fcec7890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.853+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fcec7dd0 0x5599fcee81b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.853+0000 7f4de8e10e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5599fcd92de0 con 0x5599fcec7dd0 2026-02-24T09:19:02.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.853+0000 7f4dd7fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fcec7890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.857 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.853+0000 7f4dd7fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fcec7890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:51838/0 (socket says 10.20.193.4:51838) 2026-02-24T09:19:02.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.853+0000 7f4dd7fff640 1 -- 10.20.193.4:0/3219079077 learned_addr learned my addr 10.20.193.4:0/3219079077 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:02.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.853+0000 7f4de538c640 1 --2- 10.20.193.4:0/3219079077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fcec7dd0 0x5599fcee81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.853+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/3219079077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fce82820 0x5599fce82bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.854+0000 7f4de8e10e00 1 -- 10.20.193.4:0/3219079077 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5599fcd8eb10 con 0x5599fce82820 2026-02-24T09:19:02.858 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.854+0000 7f4de8e10e00 1 -- 10.20.193.4:0/3219079077 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5599fcd88ab0 con 0x5599fce83130 2026-02-24T09:19:02.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.854+0000 7f4dd7fff640 1 -- 10.20.193.4:0/3219079077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fce82820 msgr2=0x5599fce82bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.855+0000 7f4dd7fff640 1 --2- 10.20.193.4:0/3219079077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fce82820 0x5599fce82bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.855+0000 7f4dd7fff640 1 -- 10.20.193.4:0/3219079077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fcec7dd0 msgr2=0x5599fcee81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.855+0000 7f4dd7fff640 1 --2- 10.20.193.4:0/3219079077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fcec7dd0 0x5599fcee81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.855+0000 7f4dd7fff640 1 -- 10.20.193.4:0/3219079077 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fcd34310 con 0x5599fce83130 2026-02-24T09:19:02.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.855+0000 7f4dd7fff640 1 --2- 10.20.193.4:0/3219079077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fcec7890 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=6784567412191971380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dc8004740 tx=0x7f4dc8038470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e27a01d7e64c834 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.855+0000 7f4dad4e4640 1 -- 10.20.193.4:0/3219079077 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dc803d070 con 0x5599fce83130 2026-02-24T09:19:02.859 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.855+0000 7f4dad4e4640 1 -- 10.20.193.4:0/3219079077 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4dc8005d40 con 0x5599fce83130 2026-02-24T09:19:02.860 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.855+0000 7f4dad4e4640 1 -- 10.20.193.4:0/3219079077 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dc80386b0 con 0x5599fce83130 2026-02-24T09:19:02.861 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.858+0000 7f4de8e10e00 1 -- 10.20.193.4:0/3219079077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 msgr2=0x5599fcec7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.858+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/3219079077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fcec7890 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=6784567412191971380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dc8004740 tx=0x7f4dc8038470 comp rx=0 tx=0).stop 2026-02-24T09:19:02.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.858+0000 7f4de8e10e00 1 -- 10.20.193.4:0/3219079077 shutdown_connections 2026-02-24T09:19:02.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.858+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/3219079077 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fcec7dd0 0x5599fcee81b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.858+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/3219079077 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fcec7890 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=6784567412191971380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.862 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.858+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/3219079077 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fce82820 0x5599fce82bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.858+0000 7f4de8e10e00 1 -- 10.20.193.4:0/3219079077 >> 10.20.193.4:0/3219079077 conn(0x5599fcda16b0 msgr2=0x5599fce81100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.859+0000 7f4de8e10e00 1 -- 10.20.193.4:0/3219079077 shutdown_connections 2026-02-24T09:19:02.863 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.859+0000 7f4de8e10e00 1 -- 10.20.193.4:0/3219079077 wait complete. 2026-02-24T09:19:02.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.862+0000 7f4de8e10e00 1 -- start start 2026-02-24T09:19:02.865 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.862+0000 7f4de8e10e00 1 Processor -- start 2026-02-24T09:19:02.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.862+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce82820 0x5599fce9adb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.862+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fce9b2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.862+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec7dd0 0x5599fcea02e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.862+0000 7f4de8e10e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5599fcea0820 con 0x5599fce82820 2026-02-24T09:19:02.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.862+0000 7f4de8e10e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5599fcea0990 con 0x5599fcec7dd0 2026-02-24T09:19:02.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.862+0000 7f4de8e10e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5599fcea0b50 con 0x5599fce83130 2026-02-24T09:19:02.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.862+0000 7f4de538c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec7dd0 0x5599fcea02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.862+0000 7f4dd7fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fce9b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4de538c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec7dd0 0x5599fcea02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:39830/0 (socket says 10.20.193.4:39830) 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4de538c640 1 -- 10.20.193.4:0/1319077323 learned_addr learned my addr 10.20.193.4:0/1319077323 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4dd7fff640 1 -- 10.20.193.4:0/1319077323 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec7dd0 msgr2=0x5599fcea02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4dd7fff640 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec7dd0 0x5599fcea02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4dd7fff640 1 -- 10.20.193.4:0/1319077323 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce82820 msgr2=0x5599fce9adb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4dd7fff640 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce82820 0x5599fce9adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4dd7fff640 1 -- 10.20.193.4:0/1319077323 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fcd0c8c0 con 0x5599fce83130 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4de538c640 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec7dd0 0x5599fcea02e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4dd7fff640 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fce9b2f0 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=6992564726082769495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dc802f5f0 tx=0x7f4dc8002e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=610a9491f7171257 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4d9e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.90:3300/0 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.863+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/1319077323 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dc803d040 con 0x5599fce83130 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.864+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/1319077323 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4dc8038840 con 0x5599fce83130 2026-02-24T09:19:02.869 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.864+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/1319077323 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dc80416b0 con 0x5599fce83130 2026-02-24T09:19:02.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.864+0000 7f4de8e10e00 1 -- 10.20.193.4:0/1319077323 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de0060e70 con 0x5599fce83130 2026-02-24T09:19:02.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.864+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/1319077323 <== mon.1 v2:10.20.193.90:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4dc8041810 con 0x5599fce83130 2026-02-24T09:19:02.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.864+0000 7f4d9e7fc640 10 client.27061 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:19:02.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.865+0000 7f4de8e10e00 10 client.27061 _ll_register_callbacks cb 0x5599fcd24160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:02.870 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.865+0000 7f4de8e10e00 1 -- 10.20.193.4:0/1319077323 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5599fcad84a0 con 0x5599fce83130 2026-02-24T09:19:02.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.865+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/1319077323 <== mon.1 v2:10.20.193.90:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4dc802f940 con 0x5599fce83130 2026-02-24T09:19:02.871 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.867+0000 7f4de8e10e00 10 client.27061 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:02.872 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.867+0000 7f4de8e10e00 1 -- 10.20.193.4:0/1319077323 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5599fcd1e6e0 con 0x5599fce83130 2026-02-24T09:19:02.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.869+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/1319077323 <== mon.1 v2:10.20.193.90:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4dc8048070 con 0x5599fce83130 2026-02-24T09:19:02.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.869+0000 7f4de8e10e00 10 client.27061 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:02.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.869+0000 7f4de8e10e00 10 client.27061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:02.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.869+0000 7f4de8e10e00 20 client.27061 populate_metadata read hostname 'trial004' 2026-02-24T09:19:02.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.869+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5599fcec5390 0x5599fcec5830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.869+0000 7f4de8e10e00 4 client.27061 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:02.873 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.869+0000 7f4de8e10e00 1 -- 10.20.193.4:0/1319077323 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599fcd7e4f0 con 0x5599fcec5390 2026-02-24T09:19:02.874 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.871+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5599fcec5390 0x5599fcec5830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.871+0000 7f4d9e7fc640 10 client.27061 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:02.875 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.871+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5599fcec5390 0x5599fcec5830 crc :-1 s=READY pgs=207 gs=4 cs=0 l=0 c_cookie=5758249949412222277 s_cookie=9767098799726026668 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fe969d20aa06545 server_cookie=878bb49c2bd05fac in_seq=0 out_seq=0 2026-02-24T09:19:02.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.872+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/1319077323 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5599fcd7e4f0 con 0x5599fcec5390 2026-02-24T09:19:02.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.872+0000 7f4d9e7fc640 10 client.27061 handle_command_reply: tid=0 2026-02-24T09:19:02.876 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.872+0000 7f4de8e10e00 1 client.27061 shutdown 2026-02-24T09:19:02.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 1 -- 10.20.193.4:0/1319077323 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 msgr2=0x5599fce9b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fce9b2f0 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=6992564726082769495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dc802f5f0 tx=0x7f4dc8002e70 comp rx=0 tx=0).stop 2026-02-24T09:19:02.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 1 -- 10.20.193.4:0/1319077323 shutdown_connections 2026-02-24T09:19:02.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5599fcec5390 0x5599fcec5830 crc :-1 s=READY pgs=207 gs=4 cs=0 l=0 c_cookie=5758249949412222277 s_cookie=9767098799726026668 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec7dd0 0x5599fcea02e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce83130 0x5599fce9b2f0 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=6992564726082769495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4d9e7fc640 0 client.27061 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:02.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/1319077323 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce82820 0x5599fce9adb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 1 -- 10.20.193.4:0/1319077323 >> 10.20.193.4:0/1319077323 conn(0x5599fcda16b0 msgr2=0x5599fce81810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 1 -- 10.20.193.4:0/1319077323 shutdown_connections 2026-02-24T09:19:02.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 1 -- 10.20.193.4:0/1319077323 wait complete. 2026-02-24T09:19:02.878 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.873+0000 7f4de8e10e00 20 client.27061 trim_cache size 0 max 16384 2026-02-24T09:19:02.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de8e10e00 1 Processor -- start 2026-02-24T09:19:02.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de8e10e00 1 -- start start 2026-02-24T09:19:02.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fce983b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.894 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fce83130 0x5599fce9f850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fcec5390 0x5599fcec7120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de8e10e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5599fcd866e0 con 0x5599fcec5390 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de8e10e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5599fca51f50 con 0x5599fce83130 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de8e10e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5599fcdf5150 con 0x5599fce82820 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de4b8b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fce983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4dd7fff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fce83130 0x5599fce9f850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de4b8b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fce983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:51856/0 (socket says 10.20.193.4:51856) 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de538c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fcec5390 0x5599fcec7120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.889+0000 7f4de4b8b640 1 -- 10.20.193.4:0/240400027 learned_addr learned my addr 10.20.193.4:0/240400027 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.890+0000 7f4de4b8b640 1 -- 10.20.193.4:0/240400027 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fce83130 msgr2=0x5599fce9f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.890+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/240400027 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fce83130 0x5599fce9f850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.890+0000 7f4de4b8b640 1 -- 10.20.193.4:0/240400027 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fcec5390 msgr2=0x5599fcec7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.890+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/240400027 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fcec5390 0x5599fcec7120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.890+0000 7f4de4b8b640 1 -- 10.20.193.4:0/240400027 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fcd19160 con 0x5599fce82820 2026-02-24T09:19:02.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.890+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/240400027 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fce983b0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=17217415610553886491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dd0003b60 tx=0x7f4dd0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eef08c46a954671b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.890+0000 7f4dacce3640 1 -- 10.20.193.4:0/240400027 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dd0021040 con 0x5599fce82820 2026-02-24T09:19:02.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.890+0000 7f4dacce3640 1 -- 10.20.193.4:0/240400027 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4dd00278f0 con 0x5599fce82820 2026-02-24T09:19:02.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.890+0000 7f4dacce3640 1 -- 10.20.193.4:0/240400027 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dd001b9e0 con 0x5599fce82820 2026-02-24T09:19:02.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.892+0000 7f4de8e10e00 1 -- 10.20.193.4:0/240400027 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 msgr2=0x5599fce983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.892+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/240400027 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fce983b0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=17217415610553886491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dd0003b60 tx=0x7f4dd0014000 comp rx=0 tx=0).stop 2026-02-24T09:19:02.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.892+0000 7f4de8e10e00 1 -- 10.20.193.4:0/240400027 shutdown_connections 2026-02-24T09:19:02.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.892+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/240400027 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fcec5390 0x5599fcec7120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.892+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/240400027 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fce83130 0x5599fce9f850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.892+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/240400027 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fce983b0 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=17217415610553886491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.892+0000 7f4de8e10e00 1 -- 10.20.193.4:0/240400027 >> 10.20.193.4:0/240400027 conn(0x5599fcda16b0 msgr2=0x5599fce9f140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.892+0000 7f4de8e10e00 1 -- 10.20.193.4:0/240400027 shutdown_connections 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.892+0000 7f4de8e10e00 1 -- 10.20.193.4:0/240400027 wait complete. 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4de8e10e00 1 -- start start 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4de8e10e00 1 Processor -- start 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fcea2860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce83130 0x5599fcea2da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4de8e10e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec5390 0x5599fcea32e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4de8e10e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5599fcdf23d0 con 0x5599fce83130 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4de8e10e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5599fcf2d3f0 con 0x5599fcec5390 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4de8e10e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5599fcf2d5b0 con 0x5599fce82820 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4dd7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce83130 0x5599fcea2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4dd7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce83130 0x5599fcea2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52472/0 (socket says 10.20.193.4:52472) 2026-02-24T09:19:02.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4dd7fff640 1 -- 10.20.193.4:0/73359118 learned_addr learned my addr 10.20.193.4:0/73359118 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fcea2860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.893+0000 7f4de538c640 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec5390 0x5599fcea32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4dd7fff640 1 -- 10.20.193.4:0/73359118 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 msgr2=0x5599fcea2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4dd7fff640 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fcea2860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4dd7fff640 1 -- 10.20.193.4:0/73359118 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec5390 msgr2=0x5599fcea32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4dd7fff640 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec5390 0x5599fcea32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4dd7fff640 1 -- 10.20.193.4:0/73359118 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fcd1e940 con 0x5599fce83130 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4de538c640 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec5390 0x5599fcea32e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fcea2860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4dd7fff640 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce83130 0x5599fcea2da0 secure :-1 s=READY pgs=1240 gs=1 cs=0 l=1 c_cookie=1833959530740595974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dc8009230 tx=0x7f4dc8002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19738879fa3c3d06 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4d9e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:02.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/73359118 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dc803d050 con 0x5599fce83130 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4de8e10e00 1 -- 10.20.193.4:0/73359118 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599fcd0cbf0 con 0x5599fce83130 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4de8e10e00 10 client.18066 _ll_register_callbacks cb 0x5599fcd24160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4de8e10e00 1 -- 10.20.193.4:0/73359118 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5599fca13f40 con 0x5599fce83130 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/73359118 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5599fca13f40 con 0x5599fce83130 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/73359118 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dc80386b0 con 0x5599fce83130 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/73359118 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4dc8038810 con 0x5599fce83130 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.894+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/73359118 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4dc8038a60 con 0x5599fce83130 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.895+0000 7f4de8e10e00 10 client.18066 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.895+0000 7f4de8e10e00 1 -- 10.20.193.4:0/73359118 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5599fcf74b50 con 0x5599fce83130 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.895+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/73359118 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4dc8048040 con 0x5599fce83130 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.895+0000 7f4de8e10e00 10 client.18066 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:02.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.895+0000 7f4de8e10e00 10 client.18066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:02.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.895+0000 7f4de8e10e00 20 client.18066 populate_metadata read hostname 'trial004' 2026-02-24T09:19:02.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.895+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5599fcec7dd0 0x5599fcf95380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:02.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.895+0000 7f4de8e10e00 4 client.18066 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:19:02.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.895+0000 7f4de8e10e00 1 -- 10.20.193.4:0/73359118 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f4dc8005d40 con 0x5599fcec7dd0 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.897+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5599fcec7dd0 0x5599fcf95380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.898+0000 7f4de4b8b640 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5599fcec7dd0 0x5599fcf95380 crc :-1 s=READY pgs=208 gs=4 cs=0 l=0 c_cookie=7424540450936456439 s_cookie=1672820565067108129 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67094434069604f7 server_cookie=17370d70e1cb0f21 in_seq=0 out_seq=0 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.898+0000 7f4d9e7fc640 10 client.18066 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.898+0000 7f4d9e7fc640 1 -- 10.20.193.4:0/73359118 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x7f4dc8005d40 con 0x5599fcec7dd0 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.898+0000 7f4d9e7fc640 10 client.18066 handle_command_reply: tid=0 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.898+0000 7f4de8e10e00 1 client.18066 shutdown 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.898+0000 7f4de8e10e00 1 -- 10.20.193.4:0/73359118 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce83130 msgr2=0x5599fcea2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.898+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce83130 0x5599fcea2da0 secure :-1 s=READY pgs=1240 gs=1 cs=0 l=1 c_cookie=1833959530740595974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dc8009230 tx=0x7f4dc8002390 comp rx=0 tx=0).stop 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.899+0000 7f4de8e10e00 1 -- 10.20.193.4:0/73359118 shutdown_connections 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.899+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5599fcec7dd0 0x5599fcf95380 crc :-1 s=READY pgs=208 gs=4 cs=0 l=0 c_cookie=7424540450936456439 s_cookie=1672820565067108129 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.905 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.899+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5599fcec5390 0x5599fcea32e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.899+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5599fce83130 0x5599fcea2da0 unknown :-1 s=CLOSED pgs=1240 gs=1 cs=0 l=1 c_cookie=1833959530740595974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.899+0000 7f4de8e10e00 1 --2- 10.20.193.4:0/73359118 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5599fce82820 0x5599fcea2860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.899+0000 7f4de8e10e00 1 -- 10.20.193.4:0/73359118 >> 10.20.193.4:0/73359118 conn(0x5599fcda16b0 msgr2=0x5599fce811f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.899+0000 7f4d9e7fc640 0 client.18066 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:02.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.899+0000 7f4de8e10e00 1 -- 10.20.193.4:0/73359118 shutdown_connections 2026-02-24T09:19:02.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.900+0000 7f4de8e10e00 1 -- 10.20.193.4:0/73359118 wait complete. 2026-02-24T09:19:02.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.900+0000 7f4de8e10e00 20 client.18066 trim_cache size 0 max 16384 2026-02-24T09:19:02.906 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: "50fcb56c-a674-4f78-aafd-69881ffc04d0": { 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "50fcb56c-a674-4f78-aafd-69881ffc04d0", 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: "50fcb56c-a674-4f78-aafd-69881ffc04d0": { 2026-02-24T09:19:02.907 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:02.417630+0000", 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "b703ea3c-d980-4a3f-b2c3-714d8f9ad80d": { 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:58.321748+0000", 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.908 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:19:02.909 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.910 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:19:02.911 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.912 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.913 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.914 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.915 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.916 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.917 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:02.918 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:02.919 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:02.919 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:02.919 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:02.919 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:02.919 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:02.919 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.901+0000 7f4de6e16640 1 -- 10.20.193.4:0/2041563815 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dbc0b5750 msgr2=0x7f4dbc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.901+0000 7f4de6e16640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dbc0b5750 0x7f4dbc0d5c00 secure :-1 s=READY pgs=441 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dd0005970 tx=0x7f4dd0009310 comp rx=0 tx=0).stop 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.901+0000 7f4de6e16640 1 -- 10.20.193.4:0/2041563815 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4de0112480 msgr2=0x7f4de00f4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.901+0000 7f4de6e16640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4de0112480 0x7f4de00f4550 secure :-1 s=READY pgs=1239 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ddc00f940 tx=0x7f4ddc00fe10 comp rx=0 tx=0).stop 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.902+0000 7f4de6e16640 1 -- 10.20.193.4:0/2041563815 shutdown_connections 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.902+0000 7f4de6e16640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4dbc0b5750 0x7f4dbc0d5c00 unknown :-1 s=CLOSED pgs=441 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.902+0000 7f4de6e16640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4de0112480 0x7f4de00f4550 unknown :-1 s=CLOSED pgs=1239 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.902+0000 7f4de6e16640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4de010cc80 0x7f4de0172d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.902+0000 7f4de6e16640 1 --2- 10.20.193.4:0/2041563815 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4de010c290 0x7f4de00f3e50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.902+0000 7f4de6e16640 1 -- 10.20.193.4:0/2041563815 >> 10.20.193.4:0/2041563815 conn(0x7f4de00e9b80 msgr2=0x7f4de0110b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:02.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.902+0000 7f4de6e16640 1 -- 10.20.193.4:0/2041563815 shutdown_connections 2026-02-24T09:19:02.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:02.902+0000 7f4de6e16640 1 -- 10.20.193.4:0/2041563815 wait complete. 2026-02-24T09:19:02.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:02 trial004 ceph-mon[41596]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 840 MiB/s wr, 239 op/s 2026-02-24T09:19:02.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:02 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:19:02.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:02 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:02.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:02 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:19:02.965 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:02 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:02.990 INFO:tasks.cephfs.filesystem:scrub status for tag:50fcb56c-a674-4f78-aafd-69881ffc04d0 - {'path': '/', 'tag': '50fcb56c-a674-4f78-aafd-69881ffc04d0', 'options': 'recursive,force'} 2026-02-24T09:19:03.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:02 trial090 ceph-mon[47278]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 840 MiB/s wr, 239 op/s 2026-02-24T09:19:03.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:02 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:19:03.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:02 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:03.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:02 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:19:03.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:02 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:02 trial014 ceph-mon[46941]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 840 MiB/s wr, 239 op/s 2026-02-24T09:19:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:02 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:19:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:02 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:02 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:19:03.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:02 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:04.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:03 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:19:04.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:03 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:19:04.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:03 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:19:05.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:04 trial004 ceph-mon[41596]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 685 MiB/s wr, 199 op/s 2026-02-24T09:19:05.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:04 trial090 ceph-mon[47278]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 685 MiB/s wr, 199 op/s 2026-02-24T09:19:05.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:04 trial014 ceph-mon[46941]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 685 MiB/s wr, 199 op/s 2026-02-24T09:19:07.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:06 trial004 ceph-mon[41596]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 648 MiB/s wr, 190 op/s 2026-02-24T09:19:07.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:06 trial090 ceph-mon[47278]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 648 MiB/s wr, 190 op/s 2026-02-24T09:19:07.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:06 trial014 ceph-mon[46941]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 648 MiB/s wr, 190 op/s 2026-02-24T09:19:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:08 trial004 ceph-mon[41596]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 61 KiB/s rd, 776 MiB/s wr, 219 op/s 2026-02-24T09:19:09.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:08 trial090 ceph-mon[47278]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 61 KiB/s rd, 776 MiB/s wr, 219 op/s 2026-02-24T09:19:09.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:08 trial014 ceph-mon[46941]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 61 KiB/s rd, 776 MiB/s wr, 219 op/s 2026-02-24T09:19:11.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:10 trial004 ceph-mon[41596]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 38 KiB/s rd, 784 MiB/s wr, 215 op/s 2026-02-24T09:19:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:10 trial090 ceph-mon[47278]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 38 KiB/s rd, 784 MiB/s wr, 215 op/s 2026-02-24T09:19:11.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:10 trial014 ceph-mon[46941]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 38 KiB/s rd, 784 MiB/s wr, 215 op/s 2026-02-24T09:19:13.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:12 trial004 ceph-mon[41596]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 890 MiB/s wr, 249 op/s 2026-02-24T09:19:13.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:12 trial090 ceph-mon[47278]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 890 MiB/s wr, 249 op/s 2026-02-24T09:19:13.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:12 trial014 ceph-mon[46941]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 890 MiB/s wr, 249 op/s 2026-02-24T09:19:14.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:13 trial004 ceph-mon[41596]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 823 MiB/s wr, 234 op/s 2026-02-24T09:19:14.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:13 trial090 ceph-mon[47278]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 823 MiB/s wr, 234 op/s 2026-02-24T09:19:14.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:13 trial014 ceph-mon[46941]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 823 MiB/s wr, 234 op/s 2026-02-24T09:19:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:16 trial004 ceph-mon[41596]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 753 MiB/s wr, 217 op/s 2026-02-24T09:19:17.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:16 trial090 ceph-mon[47278]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 753 MiB/s wr, 217 op/s 2026-02-24T09:19:17.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:16 trial014 ceph-mon[46941]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 753 MiB/s wr, 217 op/s 2026-02-24T09:19:19.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:18 trial004 ceph-mon[41596]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 779 MiB/s wr, 224 op/s 2026-02-24T09:19:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:18 trial090 ceph-mon[47278]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 779 MiB/s wr, 224 op/s 2026-02-24T09:19:19.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:18 trial014 ceph-mon[46941]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 779 MiB/s wr, 224 op/s 2026-02-24T09:19:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:20 trial004 ceph-mon[41596]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 661 MiB/s wr, 193 op/s 2026-02-24T09:19:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:20 trial090 ceph-mon[47278]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 661 MiB/s wr, 193 op/s 2026-02-24T09:19:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:20 trial014 ceph-mon[46941]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 661 MiB/s wr, 193 op/s 2026-02-24T09:19:23.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:22 trial004 ceph-mon[41596]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 797 MiB/s wr, 223 op/s 2026-02-24T09:19:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:22 trial090 ceph-mon[47278]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 797 MiB/s wr, 223 op/s 2026-02-24T09:19:23.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:22 trial014 ceph-mon[46941]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 53 KiB/s rd, 797 MiB/s wr, 223 op/s 2026-02-24T09:19:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:24 trial004 ceph-mon[41596]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 813 MiB/s wr, 217 op/s 2026-02-24T09:19:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:24 trial090 ceph-mon[47278]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 813 MiB/s wr, 217 op/s 2026-02-24T09:19:25.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:24 trial014 ceph-mon[46941]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 813 MiB/s wr, 217 op/s 2026-02-24T09:19:27.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:26 trial004 ceph-mon[41596]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 859 MiB/s wr, 228 op/s 2026-02-24T09:19:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:26 trial090 ceph-mon[47278]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 859 MiB/s wr, 228 op/s 2026-02-24T09:19:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:26 trial014 ceph-mon[46941]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 859 MiB/s wr, 228 op/s 2026-02-24T09:19:28.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:19:28.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:19:28.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:19:28.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:19:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:19:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:19:28.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:19:28.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.335 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:19:28.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:19:28.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-24T09:19:28.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:19:28.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:19:28.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:19:28.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:19:29.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:28 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial090 to 16915M 2026-02-24T09:19:29.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:28 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial014 to 16915M 2026-02-24T09:19:29.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:28 trial004 ceph-mon[41596]: Adjusting osd_memory_target on trial004 to 16915M 2026-02-24T09:19:29.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:28 trial004 ceph-mon[41596]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 837 MiB/s wr, 224 op/s 2026-02-24T09:19:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:28 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial090 to 16915M 2026-02-24T09:19:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:28 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial014 to 16915M 2026-02-24T09:19:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:28 trial090 ceph-mon[47278]: Adjusting osd_memory_target on trial004 to 16915M 2026-02-24T09:19:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:28 trial090 ceph-mon[47278]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 837 MiB/s wr, 224 op/s 2026-02-24T09:19:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:28 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial090 to 16915M 2026-02-24T09:19:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:28 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial014 to 16915M 2026-02-24T09:19:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:28 trial014 ceph-mon[46941]: Adjusting osd_memory_target on trial004 to 16915M 2026-02-24T09:19:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:28 trial014 ceph-mon[46941]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 837 MiB/s wr, 224 op/s 2026-02-24T09:19:31.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:30 trial004 ceph-mon[41596]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 717 MiB/s wr, 194 op/s 2026-02-24T09:19:31.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:30 trial090 ceph-mon[47278]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 717 MiB/s wr, 194 op/s 2026-02-24T09:19:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:30 trial014 ceph-mon[46941]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 717 MiB/s wr, 194 op/s 2026-02-24T09:19:32.991 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:19:33.167 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:33.195 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:32 trial004 ceph-mon[41596]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 795 MiB/s wr, 215 op/s 2026-02-24T09:19:33.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.289+0000 7f2563537640 1 -- 10.20.193.4:0/545458579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255c10c7d0 msgr2=0x7f255c1556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.289+0000 7f2563537640 1 --2- 10.20.193.4:0/545458579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255c10c7d0 0x7f255c1556b0 secure :-1 s=READY pgs=1241 gs=1 cs=0 l=1 c_cookie=2179428952993580809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2550009950 tx=0x7f255002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.289+0000 7f2563537640 1 -- 10.20.193.4:0/545458579 shutdown_connections 2026-02-24T09:19:33.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.289+0000 7f2563537640 1 --2- 10.20.193.4:0/545458579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255c155bf0 0x7f255c175fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.289+0000 7f2563537640 1 --2- 10.20.193.4:0/545458579 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255c10c7d0 0x7f255c1556b0 unknown :-1 s=CLOSED pgs=1241 gs=1 cs=0 l=1 c_cookie=2179428952993580809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.289+0000 7f2563537640 1 --2- 10.20.193.4:0/545458579 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f255c10bec0 0x7f255c10c290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.289+0000 7f2563537640 1 -- 10.20.193.4:0/545458579 >> 10.20.193.4:0/545458579 conn(0x7f255c0e9b80 msgr2=0x7f255c109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.289+0000 7f2563537640 1 -- 10.20.193.4:0/545458579 shutdown_connections 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.289+0000 7f2563537640 1 -- 10.20.193.4:0/545458579 wait complete. 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2563537640 1 Processor -- start 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2563537640 1 -- start start 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2563537640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255c10bec0 0x7f255c160860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2563537640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255c10c7d0 0x7f255c160da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2563537640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f255c155bf0 0x7f255c166170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2563537640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f255c166790 con 0x7f255c10bec0 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2563537640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f255c166900 con 0x7f255c155bf0 2026-02-24T09:19:33.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2563537640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f255c166ac0 con 0x7f255c10c7d0 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f25612ac640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255c10bec0 0x7f255c160860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f25612ac640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255c10bec0 0x7f255c160860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60088/0 (socket says 10.20.193.4:60088) 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f25612ac640 1 -- 10.20.193.4:0/3904403043 learned_addr learned my addr 10.20.193.4:0/3904403043 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2561aad640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f255c155bf0 0x7f255c166170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2560aab640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255c10c7d0 0x7f255c160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f25612ac640 1 -- 10.20.193.4:0/3904403043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255c10c7d0 msgr2=0x7f255c160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f25612ac640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255c10c7d0 0x7f255c160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f25612ac640 1 -- 10.20.193.4:0/3904403043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f255c155bf0 msgr2=0x7f255c166170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f25612ac640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f255c155bf0 0x7f255c166170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f25612ac640 1 -- 10.20.193.4:0/3904403043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2550009570 con 0x7f255c10bec0 2026-02-24T09:19:33.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2561aad640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f255c155bf0 0x7f255c166170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:19:33.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2560aab640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255c10c7d0 0x7f255c160da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:19:33.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f25612ac640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255c10bec0 0x7f255c160860 secure :-1 s=READY pgs=1242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f254c00d950 tx=0x7f254c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:33.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f254a7fc640 1 -- 10.20.193.4:0/3904403043 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f254c004540 con 0x7f255c10bec0 2026-02-24T09:19:33.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f254a7fc640 1 -- 10.20.193.4:0/3904403043 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f254c009d00 con 0x7f255c10bec0 2026-02-24T09:19:33.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2563537640 1 -- 10.20.193.4:0/3904403043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255c166da0 con 0x7f255c10bec0 2026-02-24T09:19:33.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f254a7fc640 1 -- 10.20.193.4:0/3904403043 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f254c0106e0 con 0x7f255c10bec0 2026-02-24T09:19:33.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.290+0000 7f2563537640 1 -- 10.20.193.4:0/3904403043 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255c152820 con 0x7f255c10bec0 2026-02-24T09:19:33.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.293+0000 7f254a7fc640 1 -- 10.20.193.4:0/3904403043 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f254c0097c0 con 0x7f255c10bec0 2026-02-24T09:19:33.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.294+0000 7f254a7fc640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25380b5760 0x7f25380d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.294+0000 7f2560aab640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25380b5760 0x7f25380d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.294+0000 7f254a7fc640 1 -- 10.20.193.4:0/3904403043 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f254c0e6e00 con 0x7f255c10bec0 2026-02-24T09:19:33.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.294+0000 7f2560aab640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25380b5760 0x7f25380d5c10 secure :-1 s=READY pgs=442 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25500098a0 tx=0x7f2550031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:33.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f2565531e00 1 Processor -- start 2026-02-24T09:19:33.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f2565531e00 1 -- start start 2026-02-24T09:19:33.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f2565531e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad06bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f2565531e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad4b890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f2565531e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad4bdd0 0x56162ad6c1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f2565531e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56162ac16de0 con 0x56162ad06820 2026-02-24T09:19:33.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f2565531e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56162ac12b10 con 0x56162ad4bdd0 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f2565531e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56162ac0cab0 con 0x56162ad07130 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f25612ac640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad06bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f25612ac640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad06bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60094/0 (socket says 10.20.193.4:60094) 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.296+0000 7f25612ac640 1 -- 10.20.193.4:0/1572606608 learned_addr learned my addr 10.20.193.4:0/1572606608 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f2560aab640 1 --2- 10.20.193.4:0/1572606608 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad4b890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f2561aad640 1 --2- 10.20.193.4:0/1572606608 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad4bdd0 0x56162ad6c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f25612ac640 1 -- 10.20.193.4:0/1572606608 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 msgr2=0x56162ad4b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f25612ac640 1 --2- 10.20.193.4:0/1572606608 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad4b890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f25612ac640 1 -- 10.20.193.4:0/1572606608 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad4bdd0 msgr2=0x56162ad6c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f25612ac640 1 --2- 10.20.193.4:0/1572606608 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad4bdd0 0x56162ad6c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f25612ac640 1 -- 10.20.193.4:0/1572606608 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162abb8310 con 0x56162ad06820 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f25612ac640 1 --2- 10.20.193.4:0/1572606608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad06bf0 secure :-1 s=READY pgs=1243 gs=1 cs=0 l=1 c_cookie=14019023625764875433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f254c0aa3a0 tx=0x7f254c002cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28d93b62f862ca9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f2525ce5640 1 -- 10.20.193.4:0/1572606608 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f254c0acb10 con 0x56162ad06820 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f2525ce5640 1 -- 10.20.193.4:0/1572606608 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f254c0ac930 con 0x56162ad06820 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.297+0000 7f2525ce5640 1 -- 10.20.193.4:0/1572606608 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f254c0722c0 con 0x56162ad06820 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.298+0000 7f2565531e00 1 -- 10.20.193.4:0/1572606608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 msgr2=0x56162ad06bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.298+0000 7f2565531e00 1 --2- 10.20.193.4:0/1572606608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad06bf0 secure :-1 s=READY pgs=1243 gs=1 cs=0 l=1 c_cookie=14019023625764875433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f254c0aa3a0 tx=0x7f254c002cc0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.298+0000 7f2565531e00 1 -- 10.20.193.4:0/1572606608 shutdown_connections 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.298+0000 7f2565531e00 1 --2- 10.20.193.4:0/1572606608 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad4bdd0 0x56162ad6c1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.298+0000 7f2565531e00 1 --2- 10.20.193.4:0/1572606608 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad4b890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.298+0000 7f2565531e00 1 --2- 10.20.193.4:0/1572606608 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad06bf0 unknown :-1 s=CLOSED pgs=1243 gs=1 cs=0 l=1 c_cookie=14019023625764875433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.298+0000 7f2565531e00 1 -- 10.20.193.4:0/1572606608 >> 10.20.193.4:0/1572606608 conn(0x56162ac256b0 msgr2=0x56162ad05100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:33.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.298+0000 7f2565531e00 1 -- 10.20.193.4:0/1572606608 shutdown_connections 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.298+0000 7f2565531e00 1 -- 10.20.193.4:0/1572606608 wait complete. 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2565531e00 1 -- start start 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2565531e00 1 Processor -- start 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2565531e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad06820 0x56162ad1eeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2565531e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad1f3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2565531e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad4bdd0 0x56162ad243e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2565531e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56162ad24920 con 0x56162ad4bdd0 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2565531e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56162ad24a90 con 0x56162ad06820 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2565531e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56162ad24c50 con 0x56162ad07130 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2561aad640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad4bdd0 0x56162ad243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2561aad640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad4bdd0 0x56162ad243e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60106/0 (socket says 10.20.193.4:60106) 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2561aad640 1 -- 10.20.193.4:0/3129017575 learned_addr learned my addr 10.20.193.4:0/3129017575 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2560aab640 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad1f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f25612ac640 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad06820 0x56162ad1eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2561aad640 1 -- 10.20.193.4:0/3129017575 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 msgr2=0x56162ad1f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2561aad640 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad1f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2561aad640 1 -- 10.20.193.4:0/3129017575 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad06820 msgr2=0x56162ad1eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2561aad640 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad06820 0x56162ad1eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.299+0000 7f2561aad640 1 -- 10.20.193.4:0/3129017575 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162ab908c0 con 0x56162ad4bdd0 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2561aad640 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad4bdd0 0x56162ad243e0 secure :-1 s=READY pgs=1244 gs=3 cs=0 l=1 c_cookie=2215595847797449324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25580115f0 tx=0x7f2558011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebf60af51cc226c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2516ffd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2516ffd640 1 -- 10.20.193.4:0/3129017575 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2558013940 con 0x56162ad4bdd0 2026-02-24T09:19:33.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2516ffd640 1 -- 10.20.193.4:0/3129017575 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f255801b400 con 0x56162ad4bdd0 2026-02-24T09:19:33.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2516ffd640 1 -- 10.20.193.4:0/3129017575 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2558012660 con 0x56162ad4bdd0 2026-02-24T09:19:33.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2565531e00 1 -- 10.20.193.4:0/3129017575 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255c152820 con 0x56162ad4bdd0 2026-02-24T09:19:33.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2516ffd640 1 -- 10.20.193.4:0/3129017575 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f25580127c0 con 0x56162ad4bdd0 2026-02-24T09:19:33.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2516ffd640 10 client.18078 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:19:33.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2565531e00 10 client.18078 _ll_register_callbacks cb 0x56162aba8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:33.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2565531e00 1 -- 10.20.193.4:0/3129017575 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56162a95c4a0 con 0x56162ad4bdd0 2026-02-24T09:19:33.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2516ffd640 1 -- 10.20.193.4:0/3129017575 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2558013aa0 con 0x56162ad4bdd0 2026-02-24T09:19:33.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2565531e00 10 client.18078 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:33.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.300+0000 7f2565531e00 1 -- 10.20.193.4:0/3129017575 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56162aba26e0 con 0x56162ad4bdd0 2026-02-24T09:19:33.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.301+0000 7f2516ffd640 1 -- 10.20.193.4:0/3129017575 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f2558019020 con 0x56162ad4bdd0 2026-02-24T09:19:33.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.301+0000 7f2565531e00 10 client.18078 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:33.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.301+0000 7f2565531e00 10 client.18078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:33.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.301+0000 7f2565531e00 20 client.18078 populate_metadata read hostname 'trial004' 2026-02-24T09:19:33.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.301+0000 7f2565531e00 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56162ad497a0 0x56162ad49c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.301+0000 7f2565531e00 4 client.18078 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:33.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.301+0000 7f2565531e00 1 -- 10.20.193.4:0/3129017575 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56162ac024f0 con 0x56162ad497a0 2026-02-24T09:19:33.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.301+0000 7f25612ac640 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56162ad497a0 0x56162ad49c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.301+0000 7f25612ac640 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56162ad497a0 0x56162ad49c40 crc :-1 s=READY pgs=209 gs=4 cs=0 l=0 c_cookie=1653447171051734746 s_cookie=16744314498250086450 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16f239711569c6da server_cookie=e85fc1522b9e9832 in_seq=0 out_seq=0 2026-02-24T09:19:33.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.301+0000 7f2516ffd640 10 client.18078 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:33.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2516ffd640 1 -- 10.20.193.4:0/3129017575 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56162ac024f0 con 0x56162ad497a0 2026-02-24T09:19:33.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2516ffd640 10 client.18078 handle_command_reply: tid=0 2026-02-24T09:19:33.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 client.18078 shutdown 2026-02-24T09:19:33.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 -- 10.20.193.4:0/3129017575 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad4bdd0 msgr2=0x56162ad243e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad4bdd0 0x56162ad243e0 secure :-1 s=READY pgs=1244 gs=3 cs=0 l=1 c_cookie=2215595847797449324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25580115f0 tx=0x7f2558011ac0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 -- 10.20.193.4:0/3129017575 shutdown_connections 2026-02-24T09:19:33.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56162ad497a0 0x56162ad49c40 crc :-1 s=READY pgs=209 gs=4 cs=0 l=0 c_cookie=1653447171051734746 s_cookie=16744314498250086450 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad4bdd0 0x56162ad243e0 unknown :-1 s=CLOSED pgs=1244 gs=3 cs=0 l=1 c_cookie=2215595847797449324 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad1f3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.312 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 --2- 10.20.193.4:0/3129017575 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad06820 0x56162ad1eeb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2516ffd640 0 client.18078 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:33.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 -- 10.20.193.4:0/3129017575 >> 10.20.193.4:0/3129017575 conn(0x56162ac256b0 msgr2=0x56162ad05810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:33.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 -- 10.20.193.4:0/3129017575 shutdown_connections 2026-02-24T09:19:33.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 1 -- 10.20.193.4:0/3129017575 wait complete. 2026-02-24T09:19:33.313 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.302+0000 7f2565531e00 20 client.18078 trim_cache size 0 max 16384 2026-02-24T09:19:33.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.312+0000 7f2565531e00 1 Processor -- start 2026-02-24T09:19:33.315 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2565531e00 1 -- start start 2026-02-24T09:19:33.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2565531e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad448c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.317 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2565531e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad44e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2565531e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 0x56162ad04a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2565531e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56162ac0a6e0 con 0x56162ad06820 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2565531e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56162a8d5f50 con 0x56162ad497a0 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2565531e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56162ac763d0 con 0x56162ad07130 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2561aad640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 0x56162ad04a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f25612ac640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2560aab640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad44e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2561aad640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 0x56162ad04a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:33360/0 (socket says 10.20.193.4:33360) 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2561aad640 1 -- 10.20.193.4:0/1392800557 learned_addr learned my addr 10.20.193.4:0/1392800557 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.313+0000 7f2560aab640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad44e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:49876/0 (socket says 10.20.193.4:49876) 2026-02-24T09:19:33.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.314+0000 7f2561aad640 1 -- 10.20.193.4:0/1392800557 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 msgr2=0x56162ad44e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:33.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.314+0000 7f2561aad640 1 --2- 10.20.193.4:0/1392800557 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad44e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.314+0000 7f2561aad640 1 -- 10.20.193.4:0/1392800557 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 msgr2=0x56162ad448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:33.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.314+0000 7f2561aad640 1 --2- 10.20.193.4:0/1392800557 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.314+0000 7f2561aad640 1 -- 10.20.193.4:0/1392800557 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162ad113b0 con 0x56162ad497a0 2026-02-24T09:19:33.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.314+0000 7f25612ac640 1 --2- 10.20.193.4:0/1392800557 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad448c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:33.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.314+0000 7f2561aad640 1 --2- 10.20.193.4:0/1392800557 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 0x56162ad04a00 secure :-1 s=READY pgs=99 gs=3 cs=0 l=1 c_cookie=12580726783373236720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2558006e90 tx=0x7f255801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae97b85a9b3459f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:33.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.314+0000 7f25254e4640 1 -- 10.20.193.4:0/1392800557 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25580113e0 con 0x56162ad497a0 2026-02-24T09:19:33.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.314+0000 7f25254e4640 1 -- 10.20.193.4:0/1392800557 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f255802a070 con 0x56162ad497a0 2026-02-24T09:19:33.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.314+0000 7f25254e4640 1 -- 10.20.193.4:0/1392800557 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2558012db0 con 0x56162ad497a0 2026-02-24T09:19:33.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 -- 10.20.193.4:0/1392800557 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 msgr2=0x56162ad04a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 --2- 10.20.193.4:0/1392800557 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 0x56162ad04a00 secure :-1 s=READY pgs=99 gs=3 cs=0 l=1 c_cookie=12580726783373236720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2558006e90 tx=0x7f255801f000 comp rx=0 tx=0).stop 2026-02-24T09:19:33.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 -- 10.20.193.4:0/1392800557 shutdown_connections 2026-02-24T09:19:33.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 --2- 10.20.193.4:0/1392800557 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 0x56162ad04a00 unknown :-1 s=CLOSED pgs=99 gs=3 cs=0 l=1 c_cookie=12580726783373236720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 --2- 10.20.193.4:0/1392800557 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad44e00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 --2- 10.20.193.4:0/1392800557 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad448c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 -- 10.20.193.4:0/1392800557 >> 10.20.193.4:0/1392800557 conn(0x56162ac256b0 msgr2=0x56162ad1b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:33.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 -- 10.20.193.4:0/1392800557 shutdown_connections 2026-02-24T09:19:33.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 -- 10.20.193.4:0/1392800557 wait complete. 2026-02-24T09:19:33.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 -- start start 2026-02-24T09:19:33.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.315+0000 7f2565531e00 1 Processor -- start 2026-02-24T09:19:33.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad26c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad271a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 0x56162adb12f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56162ad27990 con 0x56162ad06820 2026-02-24T09:19:33.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56162ad27b00 con 0x56162ad497a0 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56162adb1880 con 0x56162ad07130 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f25612ac640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad26c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f25612ac640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad26c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60122/0 (socket says 10.20.193.4:60122) 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f25612ac640 1 -- 10.20.193.4:0/2344568558 learned_addr learned my addr 10.20.193.4:0/2344568558 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f25612ac640 1 -- 10.20.193.4:0/2344568558 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 msgr2=0x56162ad271a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2560aab640 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad271a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f25612ac640 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad271a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f25612ac640 1 -- 10.20.193.4:0/2344568558 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 msgr2=0x56162adb12f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f25612ac640 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 0x56162adb12f0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f25612ac640 1 -- 10.20.193.4:0/2344568558 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162aba26e0 con 0x56162ad06820 2026-02-24T09:19:33.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2560aab640 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad271a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f25612ac640 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad26c60 secure :-1 s=READY pgs=1245 gs=1 cs=0 l=1 c_cookie=7204429385492108827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f254c0ad3a0 tx=0x7f254c002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fb465afba4961b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2516ffd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2516ffd640 1 -- 10.20.193.4:0/2344568558 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f254c0b2e50 con 0x56162ad06820 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 1 -- 10.20.193.4:0/2344568558 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56162abb8310 con 0x56162ad06820 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2516ffd640 1 -- 10.20.193.4:0/2344568558 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f254c0a93a0 con 0x56162ad06820 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 10 client.18084 _ll_register_callbacks cb 0x56162aba8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2516ffd640 1 -- 10.20.193.4:0/2344568558 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f254c0b8010 con 0x56162ad06820 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 1 -- 10.20.193.4:0/2344568558 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f254c0ac930 con 0x56162ad06820 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2516ffd640 1 -- 10.20.193.4:0/2344568558 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f254c0724d0 con 0x56162ad06820 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2516ffd640 1 -- 10.20.193.4:0/2344568558 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f254c0219c0 con 0x56162ad06820 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 10 client.18084 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:33.326 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.316+0000 7f2565531e00 1 -- 10.20.193.4:0/2344568558 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56162ab9d160 con 0x56162ad06820 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2516ffd640 1 -- 10.20.193.4:0/2344568558 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f254c0ab110 con 0x56162ad06820 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 10 client.18084 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 10 client.18084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 20 client.18084 populate_metadata read hostname 'trial004' 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56162ad4bdd0 0x56162ae19810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 4 client.18084 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 1 -- 10.20.193.4:0/2344568558 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56162a941160 con 0x56162ad4bdd0 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2560aab640 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56162ad4bdd0 0x56162ae19810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2560aab640 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56162ad4bdd0 0x56162ae19810 crc :-1 s=READY pgs=210 gs=3 cs=0 l=0 c_cookie=13765808885932992001 s_cookie=14137767732717880184 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf09fa3f53f3a601 server_cookie=c43370d909a10378 in_seq=0 out_seq=0 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2516ffd640 10 client.18084 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2516ffd640 1 -- 10.20.193.4:0/2344568558 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x56162a941160 con 0x56162ad4bdd0 2026-02-24T09:19:33.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2516ffd640 10 client.18084 handle_command_reply: tid=0 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 1 client.18084 shutdown 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 1 -- 10.20.193.4:0/2344568558 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 msgr2=0x56162ad26c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad26c60 secure :-1 s=READY pgs=1245 gs=1 cs=0 l=1 c_cookie=7204429385492108827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f254c0ad3a0 tx=0x7f254c002390 comp rx=0 tx=0).stop 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 1 -- 10.20.193.4:0/2344568558 shutdown_connections 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56162ad4bdd0 0x56162ae19810 crc :-1 s=READY pgs=210 gs=3 cs=0 l=0 c_cookie=13765808885932992001 s_cookie=14137767732717880184 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.317+0000 7f2565531e00 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56162ad497a0 0x56162adb12f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.318+0000 7f2565531e00 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56162ad07130 0x56162ad271a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.318+0000 7f2565531e00 1 --2- 10.20.193.4:0/2344568558 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56162ad06820 0x56162ad26c60 unknown :-1 s=CLOSED pgs=1245 gs=1 cs=0 l=1 c_cookie=7204429385492108827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.318+0000 7f2516ffd640 0 client.18084 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.318+0000 7f2565531e00 1 -- 10.20.193.4:0/2344568558 >> 10.20.193.4:0/2344568558 conn(0x56162ac256b0 msgr2=0x56162ad1ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.318+0000 7f2565531e00 1 -- 10.20.193.4:0/2344568558 shutdown_connections 2026-02-24T09:19:33.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.318+0000 7f2565531e00 1 -- 10.20.193.4:0/2344568558 wait complete. 2026-02-24T09:19:33.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.318+0000 7f2565531e00 20 client.18084 trim_cache size 0 max 16384 2026-02-24T09:19:33.329 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:19:33.329 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:19:33.329 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:19:33.329 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:19:33.329 INFO:teuthology.orchestra.run.trial004.stdout: "50fcb56c-a674-4f78-aafd-69881ffc04d0": { 2026-02-24T09:19:33.329 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:02.417630+0000", 2026-02-24T09:19:33.330 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.330 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.330 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.330 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.330 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.330 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.330 INFO:teuthology.orchestra.run.trial004.stdout: "b703ea3c-d980-4a3f-b2c3-714d8f9ad80d": { 2026-02-24T09:19:33.330 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:58.321748+0000", 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.331 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:19:33.332 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.333 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.334 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:19:33.335 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.336 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.337 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.338 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.339 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:33.340 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:19:33.341 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:19:33.341 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:33.341 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:33.341 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:33.341 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:33.341 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:33.341 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:33.341 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:33.341 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.318+0000 7f2563537640 1 -- 10.20.193.4:0/3904403043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25380b5760 msgr2=0x7f25380d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.318+0000 7f2563537640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25380b5760 0x7f25380d5c10 secure :-1 s=READY pgs=442 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25500098a0 tx=0x7f2550031040 comp rx=0 tx=0).stop 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.319+0000 7f2563537640 1 -- 10.20.193.4:0/3904403043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255c10bec0 msgr2=0x7f255c160860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.319+0000 7f2563537640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255c10bec0 0x7f255c160860 secure :-1 s=READY pgs=1242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f254c00d950 tx=0x7f254c00de20 comp rx=0 tx=0).stop 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.319+0000 7f2563537640 1 -- 10.20.193.4:0/3904403043 shutdown_connections 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.319+0000 7f2563537640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f25380b5760 0x7f25380d5c10 unknown :-1 s=CLOSED pgs=442 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.319+0000 7f2563537640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f255c155bf0 0x7f255c166170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.319+0000 7f2563537640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f255c10c7d0 0x7f255c160da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.319+0000 7f2563537640 1 --2- 10.20.193.4:0/3904403043 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f255c10bec0 0x7f255c160860 unknown :-1 s=CLOSED pgs=1242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.319+0000 7f2563537640 1 -- 10.20.193.4:0/3904403043 >> 10.20.193.4:0/3904403043 conn(0x7f255c0e9b80 msgr2=0x7f255c109f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:33.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.319+0000 7f2563537640 1 -- 10.20.193.4:0/3904403043 shutdown_connections 2026-02-24T09:19:33.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.319+0000 7f2563537640 1 -- 10.20.193.4:0/3904403043 wait complete. 2026-02-24T09:19:33.343 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:32 trial090 ceph-mon[47278]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 795 MiB/s wr, 215 op/s 2026-02-24T09:19:33.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:32 trial014 ceph-mon[46941]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 32 KiB/s rd, 795 MiB/s wr, 215 op/s 2026-02-24T09:19:33.421 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:19:33.421 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:19:33.554 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:33.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.707+0000 7f1d5e411640 1 -- 10.20.193.4:0/2504034548 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d5810bed0 msgr2=0x7f1d5810c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.707+0000 7f1d5e411640 1 --2- 10.20.193.4:0/2504034548 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d5810bed0 0x7f1d5810c2a0 secure :-1 s=READY pgs=1246 gs=1 cs=0 l=1 c_cookie=12678526024199293154 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d44009950 tx=0x7f1d4402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.707+0000 7f1d5e411640 1 -- 10.20.193.4:0/2504034548 shutdown_connections 2026-02-24T09:19:33.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.707+0000 7f1d5e411640 1 --2- 10.20.193.4:0/2504034548 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d58155c00 0x7f1d58175fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.707+0000 7f1d5e411640 1 --2- 10.20.193.4:0/2504034548 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d5810c7e0 0x7f1d581556c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.707+0000 7f1d5e411640 1 --2- 10.20.193.4:0/2504034548 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d5810bed0 0x7f1d5810c2a0 unknown :-1 s=CLOSED pgs=1246 gs=1 cs=0 l=1 c_cookie=12678526024199293154 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.707+0000 7f1d5e411640 1 -- 10.20.193.4:0/2504034548 >> 10.20.193.4:0/2504034548 conn(0x7f1d580e9bf0 msgr2=0x7f1d5810a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:33.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.707+0000 7f1d5e411640 1 -- 10.20.193.4:0/2504034548 shutdown_connections 2026-02-24T09:19:33.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.707+0000 7f1d5e411640 1 -- 10.20.193.4:0/2504034548 wait complete. 2026-02-24T09:19:33.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.708+0000 7f1d5e411640 1 Processor -- start 2026-02-24T09:19:33.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.708+0000 7f1d5e411640 1 -- start start 2026-02-24T09:19:33.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.708+0000 7f1d5e411640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d5810bed0 0x7f1d581612c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.708+0000 7f1d5e411640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d5810c7e0 0x7f1d58161800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.708+0000 7f1d5e411640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d58155c00 0x7f1d58166bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.708+0000 7f1d5e411640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f1d581671f0 con 0x7f1d5810bed0 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.708+0000 7f1d5e411640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f1d58167360 con 0x7f1d58155c00 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.708+0000 7f1d5e411640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d58167520 con 0x7f1d5810c7e0 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d57fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d5810bed0 0x7f1d581612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d57fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d5810bed0 0x7f1d581612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60130/0 (socket says 10.20.193.4:60130) 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d57fff640 1 -- 10.20.193.4:0/873195010 learned_addr learned my addr 10.20.193.4:0/873195010 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d577fe640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d5810c7e0 0x7f1d58161800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d5c987640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d58155c00 0x7f1d58166bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d57fff640 1 -- 10.20.193.4:0/873195010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d5810c7e0 msgr2=0x7f1d58161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d57fff640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d5810c7e0 0x7f1d58161800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d57fff640 1 -- 10.20.193.4:0/873195010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d58155c00 msgr2=0x7f1d58166bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d57fff640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d58155c00 0x7f1d58166bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d57fff640 1 -- 10.20.193.4:0/873195010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d44009570 con 0x7f1d5810bed0 2026-02-24T09:19:33.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d5c987640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d58155c00 0x7f1d58166bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:33.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d57fff640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d5810bed0 0x7f1d581612c0 secure :-1 s=READY pgs=1247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d440023d0 tx=0x7f1d440043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:33.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d557fa640 1 -- 10.20.193.4:0/873195010 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d4403d070 con 0x7f1d5810bed0 2026-02-24T09:19:33.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d5e411640 1 -- 10.20.193.4:0/873195010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d581677a0 con 0x7f1d5810bed0 2026-02-24T09:19:33.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d557fa640 1 -- 10.20.193.4:0/873195010 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1d44038920 con 0x7f1d5810bed0 2026-02-24T09:19:33.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d557fa640 1 -- 10.20.193.4:0/873195010 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d440419d0 con 0x7f1d5810bed0 2026-02-24T09:19:33.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.709+0000 7f1d5e411640 1 -- 10.20.193.4:0/873195010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d58152830 con 0x7f1d5810bed0 2026-02-24T09:19:33.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.711+0000 7f1d5e411640 1 -- 10.20.193.4:0/873195010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d58060420 con 0x7f1d5810bed0 2026-02-24T09:19:33.715 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.712+0000 7f1d557fa640 1 -- 10.20.193.4:0/873195010 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f1d44038a90 con 0x7f1d5810bed0 2026-02-24T09:19:33.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.713+0000 7f1d557fa640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d2c0b56e0 0x7f1d2c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:33.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.713+0000 7f1d557fa640 1 -- 10.20.193.4:0/873195010 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f1d4410b8e0 con 0x7f1d5810bed0 2026-02-24T09:19:33.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.713+0000 7f1d577fe640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d2c0b56e0 0x7f1d2c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:33.716 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.714+0000 7f1d577fe640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d2c0b56e0 0x7f1d2c0d5b90 secure :-1 s=READY pgs=443 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d58167c60 tx=0x7f1d4800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:33.717 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.715+0000 7f1d557fa640 1 -- 10.20.193.4:0/873195010 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f1d440ce2f0 con 0x7f1d5810bed0 2026-02-24T09:19:33.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.892+0000 7f1d5e411640 1 -- 10.20.193.4:0/873195010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d5810c2a0 con 0x7f1d5810bed0 2026-02-24T09:19:33.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.893+0000 7f1d557fa640 1 -- 10.20.193.4:0/873195010 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f1d440d1410 con 0x7f1d5810bed0 2026-02-24T09:19:33.896 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:19:33.897 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:19:33.897 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:19:33.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 -- 10.20.193.4:0/873195010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d2c0b56e0 msgr2=0x7f1d2c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d2c0b56e0 0x7f1d2c0d5b90 secure :-1 s=READY pgs=443 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d58167c60 tx=0x7f1d4800b410 comp rx=0 tx=0).stop 2026-02-24T09:19:33.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 -- 10.20.193.4:0/873195010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d5810bed0 msgr2=0x7f1d581612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:33.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d5810bed0 0x7f1d581612c0 secure :-1 s=READY pgs=1247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d440023d0 tx=0x7f1d440043d0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 -- 10.20.193.4:0/873195010 shutdown_connections 2026-02-24T09:19:33.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f1d2c0b56e0 0x7f1d2c0d5b90 unknown :-1 s=CLOSED pgs=443 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f1d58155c00 0x7f1d58166bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1d5810c7e0 0x7f1d58161800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 --2- 10.20.193.4:0/873195010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f1d5810bed0 0x7f1d581612c0 unknown :-1 s=CLOSED pgs=1247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:33.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 -- 10.20.193.4:0/873195010 >> 10.20.193.4:0/873195010 conn(0x7f1d580e9bf0 msgr2=0x7f1d58109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:33.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 -- 10.20.193.4:0/873195010 shutdown_connections 2026-02-24T09:19:33.901 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:33.897+0000 7f1d5e411640 1 -- 10.20.193.4:0/873195010 wait complete. 2026-02-24T09:19:33.964 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:33 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/873195010' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:19:33.996 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:19:34.163 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:34.318 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.315+0000 7f6f2768a640 1 -- 10.20.193.4:0/3454786748 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6f2010ddc0 msgr2=0x7f6f20112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.315+0000 7f6f2768a640 1 --2- 10.20.193.4:0/3454786748 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6f2010ddc0 0x7f6f20112e10 secure :-1 s=READY pgs=1248 gs=1 cs=0 l=1 c_cookie=13037583910189491599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f14009950 tx=0x7f6f1402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.315+0000 7f6f2768a640 1 -- 10.20.193.4:0/3454786748 shutdown_connections 2026-02-24T09:19:34.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.315+0000 7f6f2768a640 1 --2- 10.20.193.4:0/3454786748 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6f201135c0 0x7f6f20173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.315+0000 7f6f2768a640 1 --2- 10.20.193.4:0/3454786748 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6f2010ddc0 0x7f6f20112e10 unknown :-1 s=CLOSED pgs=1248 gs=1 cs=0 l=1 c_cookie=13037583910189491599 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.315+0000 7f6f2768a640 1 --2- 10.20.193.4:0/3454786748 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6f2010d3d0 0x7f6f2010d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.315+0000 7f6f2768a640 1 -- 10.20.193.4:0/3454786748 >> 10.20.193.4:0/3454786748 conn(0x7f6f200eaca0 msgr2=0x7f6f2010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f2768a640 1 -- 10.20.193.4:0/3454786748 shutdown_connections 2026-02-24T09:19:34.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f2768a640 1 -- 10.20.193.4:0/3454786748 wait complete. 2026-02-24T09:19:34.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f2768a640 1 Processor -- start 2026-02-24T09:19:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f2768a640 1 -- start start 2026-02-24T09:19:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f2768a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6f2010d3d0 0x7f6f20060f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f2768a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6f2010ddc0 0x7f6f20173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f2768a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6f201135c0 0x7f6f20061480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f2768a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f6f200619c0 con 0x7f6f201135c0 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f2768a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20061b30 con 0x7f6f2010d3d0 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f2768a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20061cf0 con 0x7f6f2010ddc0 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f25c00640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6f201135c0 0x7f6f20061480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f25c00640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6f201135c0 0x7f6f20061480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60142/0 (socket says 10.20.193.4:60142) 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f25c00640 1 -- 10.20.193.4:0/1750735573 learned_addr learned my addr 10.20.193.4:0/1750735573 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f253ff640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6f2010d3d0 0x7f6f20060f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.316+0000 7f6f24bfe640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6f2010ddc0 0x7f6f20173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f25c00640 1 -- 10.20.193.4:0/1750735573 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6f2010ddc0 msgr2=0x7f6f20173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f25c00640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6f2010ddc0 0x7f6f20173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f25c00640 1 -- 10.20.193.4:0/1750735573 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6f2010d3d0 msgr2=0x7f6f20060f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f25c00640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6f2010d3d0 0x7f6f20060f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f25c00640 1 -- 10.20.193.4:0/1750735573 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f100094b0 con 0x7f6f201135c0 2026-02-24T09:19:34.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f25c00640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6f201135c0 0x7f6f20061480 secure :-1 s=READY pgs=1249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f1c00f8d0 tx=0x7f6f1c00fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f0e7fc640 1 -- 10.20.193.4:0/1750735573 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f1c00dce0 con 0x7f6f201135c0 2026-02-24T09:19:34.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f2768a640 1 -- 10.20.193.4:0/1750735573 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f14009570 con 0x7f6f201135c0 2026-02-24T09:19:34.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f0e7fc640 1 -- 10.20.193.4:0/1750735573 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f1c00de40 con 0x7f6f201135c0 2026-02-24T09:19:34.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f0e7fc640 1 -- 10.20.193.4:0/1750735573 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f1c011740 con 0x7f6f201135c0 2026-02-24T09:19:34.322 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.317+0000 7f6f2768a640 1 -- 10.20.193.4:0/1750735573 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f200fbce0 con 0x7f6f201135c0 2026-02-24T09:19:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.320+0000 7f6f0e7fc640 1 -- 10.20.193.4:0/1750735573 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f6f1c020060 con 0x7f6f201135c0 2026-02-24T09:19:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.320+0000 7f6f0e7fc640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6efc0b56e0 0x7f6efc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.320+0000 7f6f0e7fc640 1 -- 10.20.193.4:0/1750735573 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6f1c015070 con 0x7f6f201135c0 2026-02-24T09:19:34.323 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.320+0000 7f6f253ff640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6efc0b56e0 0x7f6efc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.321+0000 7f6f253ff640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6efc0b56e0 0x7f6efc0d5b90 secure :-1 s=READY pgs=444 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f10004740 tx=0x7f6f10005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.327 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f29684e00 1 Processor -- start 2026-02-24T09:19:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f29684e00 1 -- start start 2026-02-24T09:19:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e0619320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 0x55c0e065dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 0x55c0e067e8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f29684e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55c0e0529ee0 con 0x55c0e0619860 2026-02-24T09:19:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f29684e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55c0e0525c10 con 0x55c0e065e500 2026-02-24T09:19:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f29684e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55c0e051fd70 con 0x55c0e0618f50 2026-02-24T09:19:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f24bfe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 0x55c0e065dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f24bfe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 0x55c0e065dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60152/0 (socket says 10.20.193.4:60152) 2026-02-24T09:19:34.328 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f24bfe640 1 -- 10.20.193.4:0/1837737245 learned_addr learned my addr 10.20.193.4:0/1837737245 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f25c00640 1 --2- 10.20.193.4:0/1837737245 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 0x55c0e067e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f24bfe640 1 -- 10.20.193.4:0/1837737245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 msgr2=0x55c0e0619320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f24bfe640 1 --2- 10.20.193.4:0/1837737245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e0619320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f24bfe640 1 -- 10.20.193.4:0/1837737245 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 msgr2=0x55c0e067e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f24bfe640 1 --2- 10.20.193.4:0/1837737245 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 0x55c0e067e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f24bfe640 1 -- 10.20.193.4:0/1837737245 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0e04cb340 con 0x55c0e0619860 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f25c00640 1 --2- 10.20.193.4:0/1837737245 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 0x55c0e067e8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.324+0000 7f6f24bfe640 1 --2- 10.20.193.4:0/1837737245 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 0x55c0e065dfc0 secure :-1 s=READY pgs=1250 gs=1 cs=0 l=1 c_cookie=15580134247383205896 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f14005ab0 tx=0x7f6f140059a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d837c18d082c8808 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.325+0000 7f6eedce5640 1 -- 10.20.193.4:0/1837737245 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f14038470 con 0x55c0e0619860 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.325+0000 7f6eedce5640 1 -- 10.20.193.4:0/1837737245 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f140385d0 con 0x55c0e0619860 2026-02-24T09:19:34.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.325+0000 7f6eedce5640 1 -- 10.20.193.4:0/1837737245 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f1402fea0 con 0x55c0e0619860 2026-02-24T09:19:34.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.326+0000 7f6f29684e00 1 -- 10.20.193.4:0/1837737245 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 msgr2=0x55c0e065dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.326+0000 7f6f29684e00 1 --2- 10.20.193.4:0/1837737245 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 0x55c0e065dfc0 secure :-1 s=READY pgs=1250 gs=1 cs=0 l=1 c_cookie=15580134247383205896 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f14005ab0 tx=0x7f6f140059a0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.326+0000 7f6f29684e00 1 -- 10.20.193.4:0/1837737245 shutdown_connections 2026-02-24T09:19:34.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.326+0000 7f6f29684e00 1 --2- 10.20.193.4:0/1837737245 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 0x55c0e067e8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.326+0000 7f6f29684e00 1 --2- 10.20.193.4:0/1837737245 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 0x55c0e065dfc0 unknown :-1 s=CLOSED pgs=1250 gs=1 cs=0 l=1 c_cookie=15580134247383205896 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.326+0000 7f6f29684e00 1 --2- 10.20.193.4:0/1837737245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e0619320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.332 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.326+0000 7f6f29684e00 1 -- 10.20.193.4:0/1837737245 >> 10.20.193.4:0/1837737245 conn(0x55c0e0537db0 msgr2=0x55c0e0617830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.326+0000 7f6f29684e00 1 -- 10.20.193.4:0/1837737245 shutdown_connections 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.326+0000 7f6f29684e00 1 -- 10.20.193.4:0/1837737245 wait complete. 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.327+0000 7f6f29684e00 1 -- start start 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f29684e00 1 Processor -- start 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0618f50 0x55c0e061a0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0619860 0x55c0e061a630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 0x55c0e063efa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f29684e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55c0e063f4e0 con 0x55c0e0618f50 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f29684e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55c0e063f650 con 0x55c0e065e500 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f29684e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55c0e063f810 con 0x55c0e0619860 2026-02-24T09:19:34.333 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f253ff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0618f50 0x55c0e061a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f253ff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0618f50 0x55c0e061a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60160/0 (socket says 10.20.193.4:60160) 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f253ff640 1 -- 10.20.193.4:0/1675957277 learned_addr learned my addr 10.20.193.4:0/1675957277 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f25c00640 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 0x55c0e063efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f253ff640 1 -- 10.20.193.4:0/1675957277 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0619860 msgr2=0x55c0e061a630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f253ff640 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0619860 0x55c0e061a630 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f253ff640 1 -- 10.20.193.4:0/1675957277 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 msgr2=0x55c0e063efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f253ff640 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 0x55c0e063efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.328+0000 7f6f253ff640 1 -- 10.20.193.4:0/1675957277 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0e04a39d0 con 0x55c0e0618f50 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.329+0000 7f6f253ff640 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0618f50 0x55c0e061a0f0 secure :-1 s=READY pgs=1251 gs=1 cs=0 l=1 c_cookie=4158237816650490497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f10004520 tx=0x7f6f10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b50743510c6281 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.329+0000 7f6edaffd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.329+0000 7f6edaffd640 1 -- 10.20.193.4:0/1675957277 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f10027640 con 0x55c0e0618f50 2026-02-24T09:19:34.334 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.329+0000 7f6f29684e00 1 -- 10.20.193.4:0/1675957277 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f20174800 con 0x55c0e0618f50 2026-02-24T09:19:34.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.329+0000 7f6edaffd640 1 -- 10.20.193.4:0/1675957277 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f10016070 con 0x55c0e0618f50 2026-02-24T09:19:34.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.329+0000 7f6edaffd640 1 -- 10.20.193.4:0/1675957277 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f1001e960 con 0x55c0e0618f50 2026-02-24T09:19:34.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.329+0000 7f6edaffd640 1 -- 10.20.193.4:0/1675957277 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6f1001eaf0 con 0x55c0e0618f50 2026-02-24T09:19:34.335 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.329+0000 7f6edaffd640 10 client.18102 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:19:34.336 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:33 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/873195010' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:19:34.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6f29684e00 10 client.18102 _ll_register_callbacks cb 0x55c0e04ca080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:34.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6f29684e00 1 -- 10.20.193.4:0/1675957277 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c0e026f4a0 con 0x55c0e0618f50 2026-02-24T09:19:34.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6edaffd640 1 -- 10.20.193.4:0/1675957277 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6f1001e410 con 0x55c0e0618f50 2026-02-24T09:19:34.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6f29684e00 10 client.18102 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:34.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6f29684e00 1 -- 10.20.193.4:0/1675957277 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55c0e04b5710 con 0x55c0e0618f50 2026-02-24T09:19:34.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6edaffd640 1 -- 10.20.193.4:0/1675957277 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6f1001ecf0 con 0x55c0e0618f50 2026-02-24T09:19:34.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6f29684e00 10 client.18102 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:34.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6f29684e00 10 client.18102 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:19:34.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6f29684e00 20 client.18102 populate_metadata read hostname 'trial004' 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6f29684e00 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55c0e06441b0 0x55c0e0644650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6f29684e00 4 client.18102 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.330+0000 7f6f29684e00 1 -- 10.20.193.4:0/1675957277 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0e05157b0 con 0x55c0e06441b0 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.331+0000 7f6f24bfe640 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55c0e06441b0 0x55c0e0644650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.331+0000 7f6edaffd640 10 client.18102 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.331+0000 7f6f24bfe640 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55c0e06441b0 0x55c0e0644650 crc :-1 s=READY pgs=58 gs=3 cs=0 l=0 c_cookie=17281231264451762180 s_cookie=17319282298843194229 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=efd344466f059804 server_cookie=f05a737d43426375 in_seq=0 out_seq=0 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6edaffd640 1 -- 10.20.193.4:0/1675957277 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55c0e05157b0 con 0x55c0e06441b0 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6edaffd640 10 client.18102 handle_command_reply: tid=0 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6f29684e00 1 client.18102 shutdown 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6f29684e00 1 -- 10.20.193.4:0/1675957277 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0618f50 msgr2=0x55c0e061a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6f29684e00 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0618f50 0x55c0e061a0f0 secure :-1 s=READY pgs=1251 gs=1 cs=0 l=1 c_cookie=4158237816650490497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f10004520 tx=0x7f6f10004770 comp rx=0 tx=0).stop 2026-02-24T09:19:34.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6f29684e00 1 -- 10.20.193.4:0/1675957277 shutdown_connections 2026-02-24T09:19:34.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6f29684e00 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55c0e06441b0 0x55c0e0644650 crc :-1 s=READY pgs=58 gs=3 cs=0 l=0 c_cookie=17281231264451762180 s_cookie=17319282298843194229 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6edaffd640 0 client.18102 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:19:34.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6f29684e00 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e065e500 0x55c0e063efa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6f29684e00 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0619860 0x55c0e061a630 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6f29684e00 1 --2- 10.20.193.4:0/1675957277 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0618f50 0x55c0e061a0f0 unknown :-1 s=CLOSED pgs=1251 gs=1 cs=0 l=1 c_cookie=4158237816650490497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.332+0000 7f6f29684e00 1 -- 10.20.193.4:0/1675957277 >> 10.20.193.4:0/1675957277 conn(0x55c0e0537db0 msgr2=0x55c0e0617040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.333+0000 7f6f29684e00 1 -- 10.20.193.4:0/1675957277 shutdown_connections 2026-02-24T09:19:34.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.333+0000 7f6f29684e00 1 -- 10.20.193.4:0/1675957277 wait complete. 2026-02-24T09:19:34.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.333+0000 7f6f29684e00 20 client.18102 trim_cache size 0 max 16384 2026-02-24T09:19:34.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:33 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/873195010' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:19:34.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f29684e00 1 Processor -- start 2026-02-24T09:19:34.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f29684e00 1 -- start start 2026-02-24T09:19:34.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e06691f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 0x55c0e0669730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e06441b0 0x55c0e0618140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f29684e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55c0e051d9a0 con 0x55c0e0619860 2026-02-24T09:19:34.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f29684e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55c0e02f9df0 con 0x55c0e06441b0 2026-02-24T09:19:34.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f29684e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55c0e066bd80 con 0x55c0e0618f50 2026-02-24T09:19:34.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f25c00640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e06441b0 0x55c0e0618140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f253ff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e06691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f25c00640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e06441b0 0x55c0e0618140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:33430/0 (socket says 10.20.193.4:33430) 2026-02-24T09:19:34.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.347+0000 7f6f25c00640 1 -- 10.20.193.4:0/3686461338 learned_addr learned my addr 10.20.193.4:0/3686461338 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:34.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.348+0000 7f6f25c00640 1 -- 10.20.193.4:0/3686461338 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 msgr2=0x55c0e06691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.348+0000 7f6f25c00640 1 --2- 10.20.193.4:0/3686461338 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e06691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.348+0000 7f6f25c00640 1 -- 10.20.193.4:0/3686461338 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 msgr2=0x55c0e0669730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.348+0000 7f6f25c00640 1 --2- 10.20.193.4:0/3686461338 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 0x55c0e0669730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.348+0000 7f6f25c00640 1 -- 10.20.193.4:0/3686461338 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0e04b0190 con 0x55c0e06441b0 2026-02-24T09:19:34.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.348+0000 7f6f253ff640 1 --2- 10.20.193.4:0/3686461338 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e06691f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:34.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.348+0000 7f6f25c00640 1 --2- 10.20.193.4:0/3686461338 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e06441b0 0x55c0e0618140 secure :-1 s=READY pgs=100 gs=3 cs=0 l=1 c_cookie=8625423634195295644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f1c00d6a0 tx=0x7f6f1c01e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77b3a91889782d9c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.348+0000 7f6eed4e4640 1 -- 10.20.193.4:0/3686461338 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f1c006920 con 0x55c0e06441b0 2026-02-24T09:19:34.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.348+0000 7f6eed4e4640 1 -- 10.20.193.4:0/3686461338 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f1c0b3de0 con 0x55c0e06441b0 2026-02-24T09:19:34.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.348+0000 7f6eed4e4640 1 -- 10.20.193.4:0/3686461338 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f1c0adee0 con 0x55c0e06441b0 2026-02-24T09:19:34.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.350+0000 7f6f29684e00 1 -- 10.20.193.4:0/3686461338 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e06441b0 msgr2=0x55c0e0618140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.350+0000 7f6f29684e00 1 --2- 10.20.193.4:0/3686461338 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e06441b0 0x55c0e0618140 secure :-1 s=READY pgs=100 gs=3 cs=0 l=1 c_cookie=8625423634195295644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f1c00d6a0 tx=0x7f6f1c01e000 comp rx=0 tx=0).stop 2026-02-24T09:19:34.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.350+0000 7f6f29684e00 1 -- 10.20.193.4:0/3686461338 shutdown_connections 2026-02-24T09:19:34.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.350+0000 7f6f29684e00 1 --2- 10.20.193.4:0/3686461338 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e06441b0 0x55c0e0618140 unknown :-1 s=CLOSED pgs=100 gs=3 cs=0 l=1 c_cookie=8625423634195295644 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.350+0000 7f6f29684e00 1 --2- 10.20.193.4:0/3686461338 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e0619860 0x55c0e0669730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.350+0000 7f6f29684e00 1 --2- 10.20.193.4:0/3686461338 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e06691f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.350+0000 7f6f29684e00 1 -- 10.20.193.4:0/3686461338 >> 10.20.193.4:0/3686461338 conn(0x55c0e0537db0 msgr2=0x55c0e065f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.354 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.350+0000 7f6f29684e00 1 -- 10.20.193.4:0/3686461338 shutdown_connections 2026-02-24T09:19:34.355 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.350+0000 7f6f29684e00 1 -- 10.20.193.4:0/3686461338 wait complete. 2026-02-24T09:19:34.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.351+0000 7f6f29684e00 1 -- start start 2026-02-24T09:19:34.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.351+0000 7f6f29684e00 1 Processor -- start 2026-02-24T09:19:34.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e0645220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e0619860 0x55c0e0645760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f29684e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e06441b0 0x55c0e0645ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f29684e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55c0e064afe0 con 0x55c0e06441b0 2026-02-24T09:19:34.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f29684e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55c0e0713150 con 0x55c0e0619860 2026-02-24T09:19:34.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f29684e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55c0e0713310 con 0x55c0e0618f50 2026-02-24T09:19:34.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f25c00640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e06441b0 0x55c0e0645ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f25c00640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e06441b0 0x55c0e0645ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60174/0 (socket says 10.20.193.4:60174) 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f25c00640 1 -- 10.20.193.4:0/3227603641 learned_addr learned my addr 10.20.193.4:0/3227603641 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f25c00640 1 -- 10.20.193.4:0/3227603641 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 msgr2=0x55c0e0645220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f25c00640 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e0645220 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f25c00640 1 -- 10.20.193.4:0/3227603641 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e0619860 msgr2=0x55c0e0645760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f25c00640 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e0619860 0x55c0e0645760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f25c00640 1 -- 10.20.193.4:0/3227603641 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f200fbce0 con 0x55c0e06441b0 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6f25c00640 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e06441b0 0x55c0e0645ca0 secure :-1 s=READY pgs=1252 gs=1 cs=0 l=1 c_cookie=519269769275591220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f1c0ae330 tx=0x7f6f1c0066e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734d11a9c454a34 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6edaffd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.352+0000 7f6edaffd640 1 -- 10.20.193.4:0/3227603641 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f1c0aa4a0 con 0x55c0e06441b0 2026-02-24T09:19:34.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.353+0000 7f6f29684e00 1 -- 10.20.193.4:0/3227603641 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f10036040 con 0x55c0e06441b0 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.353+0000 7f6f29684e00 10 client.18105 _ll_register_callbacks cb 0x55c0e04ca080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.353+0000 7f6edaffd640 1 -- 10.20.193.4:0/3227603641 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6f1c006920 con 0x55c0e06441b0 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.353+0000 7f6edaffd640 1 -- 10.20.193.4:0/3227603641 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f1c0b8d70 con 0x55c0e06441b0 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.353+0000 7f6f29684e00 1 -- 10.20.193.4:0/3227603641 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f140385d0 con 0x55c0e06441b0 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.353+0000 7f6edaffd640 1 -- 10.20.193.4:0/3227603641 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6f1c0b8f00 con 0x55c0e06441b0 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.353+0000 7f6edaffd640 1 -- 10.20.193.4:0/3227603641 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6f1c073250 con 0x55c0e06441b0 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.353+0000 7f6f29684e00 10 client.18105 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.353+0000 7f6f29684e00 1 -- 10.20.193.4:0/3227603641 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55c0e04a3d00 con 0x55c0e06441b0 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.353+0000 7f6edaffd640 1 -- 10.20.193.4:0/3227603641 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6f1c0b8040 con 0x55c0e06441b0 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.354+0000 7f6f29684e00 10 client.18105 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.354+0000 7f6f29684e00 10 client.18105 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.354+0000 7f6f29684e00 20 client.18105 populate_metadata read hostname 'trial004' 2026-02-24T09:19:34.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.354+0000 7f6f29684e00 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55c0e065e500 0x55c0e0735120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.354+0000 7f6f29684e00 4 client.18105 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:19:34.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.354+0000 7f6f29684e00 1 -- 10.20.193.4:0/3227603641 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c0e0254160 con 0x55c0e065e500 2026-02-24T09:19:34.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.354+0000 7f6f253ff640 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55c0e065e500 0x55c0e0735120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f253ff640 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55c0e065e500 0x55c0e0735120 crc :-1 s=READY pgs=59 gs=3 cs=0 l=0 c_cookie=7131118015023090819 s_cookie=12288540575423228657 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=62f6d20d68d70c83 server_cookie=aa89aa8bbe136af1 in_seq=0 out_seq=0 2026-02-24T09:19:34.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6edaffd640 10 client.18105 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:19:34.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6edaffd640 1 -- 10.20.193.4:0/3227603641 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c0e0254160 con 0x55c0e065e500 2026-02-24T09:19:34.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6edaffd640 10 client.18105 handle_command_reply: tid=0 2026-02-24T09:19:34.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 client.18105 shutdown 2026-02-24T09:19:34.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 -- 10.20.193.4:0/3227603641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e06441b0 msgr2=0x55c0e0645ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e06441b0 0x55c0e0645ca0 secure :-1 s=READY pgs=1252 gs=1 cs=0 l=1 c_cookie=519269769275591220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f1c0ae330 tx=0x7f6f1c0066e0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 -- 10.20.193.4:0/3227603641 shutdown_connections 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55c0e065e500 0x55c0e0735120 crc :-1 s=READY pgs=59 gs=3 cs=0 l=0 c_cookie=7131118015023090819 s_cookie=12288540575423228657 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55c0e06441b0 0x55c0e0645ca0 unknown :-1 s=CLOSED pgs=1252 gs=1 cs=0 l=1 c_cookie=519269769275591220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55c0e0619860 0x55c0e0645760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6edaffd640 0 client.18105 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 --2- 10.20.193.4:0/3227603641 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55c0e0618f50 0x55c0e0645220 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 -- 10.20.193.4:0/3227603641 >> 10.20.193.4:0/3227603641 conn(0x55c0e0537db0 msgr2=0x55c0e065d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 -- 10.20.193.4:0/3227603641 shutdown_connections 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 1 -- 10.20.193.4:0/3227603641 wait complete. 2026-02-24T09:19:34.362 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.356+0000 7f6f29684e00 20 client.18105 trim_cache size 0 max 16384 2026-02-24T09:19:34.363 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:19:34.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.357+0000 7f6f2768a640 1 -- 10.20.193.4:0/1750735573 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6efc0b56e0 msgr2=0x7f6efc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.357+0000 7f6f2768a640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6efc0b56e0 0x7f6efc0d5b90 secure :-1 s=READY pgs=444 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f10004740 tx=0x7f6f10005f90 comp rx=0 tx=0).stop 2026-02-24T09:19:34.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.357+0000 7f6f2768a640 1 -- 10.20.193.4:0/1750735573 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6f201135c0 msgr2=0x7f6f20061480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.357+0000 7f6f2768a640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6f201135c0 0x7f6f20061480 secure :-1 s=READY pgs=1249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f1c00f8d0 tx=0x7f6f1c00fda0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.358+0000 7f6f2768a640 1 -- 10.20.193.4:0/1750735573 shutdown_connections 2026-02-24T09:19:34.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.358+0000 7f6f2768a640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6efc0b56e0 0x7f6efc0d5b90 unknown :-1 s=CLOSED pgs=444 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.358+0000 7f6f2768a640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6f201135c0 0x7f6f20061480 unknown :-1 s=CLOSED pgs=1249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.364 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.358+0000 7f6f2768a640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6f2010ddc0 0x7f6f20173e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.358+0000 7f6f2768a640 1 --2- 10.20.193.4:0/1750735573 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6f2010d3d0 0x7f6f20060f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.358+0000 7f6f2768a640 1 -- 10.20.193.4:0/1750735573 >> 10.20.193.4:0/1750735573 conn(0x7f6f200eaca0 msgr2=0x7f6f2010b860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.358+0000 7f6f2768a640 1 -- 10.20.193.4:0/1750735573 shutdown_connections 2026-02-24T09:19:34.365 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.358+0000 7f6f2768a640 1 -- 10.20.193.4:0/1750735573 wait complete. 2026-02-24T09:19:34.460 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:19:34.675 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:34.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.907+0000 7f0e7c702640 1 -- 10.20.193.4:0/1425298818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e7410de60 msgr2=0x7f0e74112eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.907+0000 7f0e7c702640 1 --2- 10.20.193.4:0/1425298818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e7410de60 0x7f0e74112eb0 secure :-1 s=READY pgs=1253 gs=1 cs=0 l=1 c_cookie=10316286890327007576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e68009950 tx=0x7f0e6802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.907+0000 7f0e7c702640 1 -- 10.20.193.4:0/1425298818 shutdown_connections 2026-02-24T09:19:34.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.907+0000 7f0e7c702640 1 --2- 10.20.193.4:0/1425298818 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e74113660 0x7f0e74174030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.907+0000 7f0e7c702640 1 --2- 10.20.193.4:0/1425298818 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e7410de60 0x7f0e74112eb0 unknown :-1 s=CLOSED pgs=1253 gs=1 cs=0 l=1 c_cookie=10316286890327007576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.907+0000 7f0e7c702640 1 --2- 10.20.193.4:0/1425298818 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e7410d470 0x7f0e7410d840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.907+0000 7f0e7c702640 1 -- 10.20.193.4:0/1425298818 >> 10.20.193.4:0/1425298818 conn(0x7f0e740ead40 msgr2=0x7f0e7410b150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.907+0000 7f0e7c702640 1 -- 10.20.193.4:0/1425298818 shutdown_connections 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.907+0000 7f0e7c702640 1 -- 10.20.193.4:0/1425298818 wait complete. 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.908+0000 7f0e7c702640 1 Processor -- start 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.908+0000 7f0e7c702640 1 -- start start 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.908+0000 7f0e7c702640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e7410d470 0x7f0e740f2c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.908+0000 7f0e7c702640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e7410de60 0x7f0e74173f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.908+0000 7f0e7c702640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e74113660 0x7f0e740f3340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.908+0000 7f0e7c702640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740f8550 con 0x7f0e7410d470 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.908+0000 7f0e7c702640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740f86c0 con 0x7f0e7410de60 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.908+0000 7f0e7c702640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e740f8880 con 0x7f0e74113660 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.908+0000 7f0e7a477640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e7410d470 0x7f0e740f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7a477640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e7410d470 0x7f0e740f2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60192/0 (socket says 10.20.193.4:60192) 2026-02-24T09:19:34.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7a477640 1 -- 10.20.193.4:0/44271491 learned_addr learned my addr 10.20.193.4:0/44271491 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e79c76640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e7410de60 0x7f0e74173f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7ac78640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e74113660 0x7f0e740f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7a477640 1 -- 10.20.193.4:0/44271491 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e74113660 msgr2=0x7f0e740f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7a477640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e74113660 0x7f0e740f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7a477640 1 -- 10.20.193.4:0/44271491 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e7410de60 msgr2=0x7f0e74173f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7a477640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e7410de60 0x7f0e74173f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7a477640 1 -- 10.20.193.4:0/44271491 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e68009570 con 0x7f0e7410d470 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7a477640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e7410d470 0x7f0e740f2c40 secure :-1 s=READY pgs=1254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e64005db0 tx=0x7f0e6400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e5b7fe640 1 -- 10.20.193.4:0/44271491 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e64004500 con 0x7f0e7410d470 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7c702640 1 -- 10.20.193.4:0/44271491 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e740f8b60 con 0x7f0e7410d470 2026-02-24T09:19:34.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e5b7fe640 1 -- 10.20.193.4:0/44271491 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e64004d30 con 0x7f0e7410d470 2026-02-24T09:19:34.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e5b7fe640 1 -- 10.20.193.4:0/44271491 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e64005310 con 0x7f0e7410d470 2026-02-24T09:19:34.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.909+0000 7f0e7c702640 1 -- 10.20.193.4:0/44271491 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e740f8fe0 con 0x7f0e7410d470 2026-02-24T09:19:34.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.913+0000 7f0e5b7fe640 1 -- 10.20.193.4:0/44271491 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f0e640054a0 con 0x7f0e7410d470 2026-02-24T09:19:34.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.914+0000 7f0e5b7fe640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e500b56d0 0x7f0e500d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.914+0000 7f0e5b7fe640 1 -- 10.20.193.4:0/44271491 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0e640e6cd0 con 0x7f0e7410d470 2026-02-24T09:19:34.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.914+0000 7f0e79c76640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e500b56d0 0x7f0e500d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.915+0000 7f0e79c76640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e500b56d0 0x7f0e500d5b80 secure :-1 s=READY pgs=445 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e680023d0 tx=0x7f0e68031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7e6fce00 1 Processor -- start 2026-02-24T09:19:34.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7e6fce00 1 -- start start 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527928f50 0x556527929320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x55652796dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x55652798e8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556527839ee0 con 0x55652796e500 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556527835c10 con 0x556527929860 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55652782fd70 con 0x556527928f50 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7ac78640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x55652798e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7ac78640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x55652798e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60206/0 (socket says 10.20.193.4:60206) 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7ac78640 1 -- 10.20.193.4:0/3963306334 learned_addr learned my addr 10.20.193.4:0/3963306334 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.919+0000 7f0e7a477640 1 --2- 10.20.193.4:0/3963306334 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527928f50 0x556527929320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.920+0000 7f0e7a477640 1 -- 10.20.193.4:0/3963306334 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 msgr2=0x55652796dfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:34.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.920+0000 7f0e7a477640 1 --2- 10.20.193.4:0/3963306334 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x55652796dfc0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.920+0000 7f0e7a477640 1 -- 10.20.193.4:0/3963306334 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 msgr2=0x55652798e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.920+0000 7f0e7a477640 1 --2- 10.20.193.4:0/3963306334 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x55652798e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.920+0000 7f0e7a477640 1 -- 10.20.193.4:0/3963306334 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565277db340 con 0x556527928f50 2026-02-24T09:19:34.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.920+0000 7f0e7a477640 1 --2- 10.20.193.4:0/3963306334 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527928f50 0x556527929320 secure :-1 s=READY pgs=118 gs=2 cs=0 l=1 c_cookie=9639199717951290267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e640040a0 tx=0x7f0e640a8ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85c55112a3883b9b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.923+0000 7f0e58cf3640 1 -- 10.20.193.4:0/3963306334 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e64096070 con 0x556527928f50 2026-02-24T09:19:34.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.923+0000 7f0e58cf3640 1 -- 10.20.193.4:0/3963306334 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e640ac800 con 0x556527928f50 2026-02-24T09:19:34.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.923+0000 7f0e58cf3640 1 -- 10.20.193.4:0/3963306334 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e64009a60 con 0x556527928f50 2026-02-24T09:19:34.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.924+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/3963306334 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527928f50 msgr2=0x556527929320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.924+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/3963306334 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527928f50 0x556527929320 secure :-1 s=READY pgs=118 gs=2 cs=0 l=1 c_cookie=9639199717951290267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e640040a0 tx=0x7f0e640a8ea0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.924+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/3963306334 shutdown_connections 2026-02-24T09:19:34.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.924+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/3963306334 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x55652798e8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.924+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/3963306334 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x55652796dfc0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.924+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/3963306334 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527928f50 0x556527929320 unknown :-1 s=CLOSED pgs=118 gs=2 cs=0 l=1 c_cookie=9639199717951290267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.924+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/3963306334 >> 10.20.193.4:0/3963306334 conn(0x556527847db0 msgr2=0x556527927830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.924+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/3963306334 shutdown_connections 2026-02-24T09:19:34.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.924+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/3963306334 wait complete. 2026-02-24T09:19:34.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.925+0000 7f0e7e6fce00 1 -- start start 2026-02-24T09:19:34.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.925+0000 7f0e7e6fce00 1 Processor -- start 2026-02-24T09:19:34.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x556527985db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x5565279862f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55652796e500 0x55652798b2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55652798b820 con 0x556527928f50 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55652798b990 con 0x556527929860 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55652798bb50 con 0x55652796e500 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7a477640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x556527985db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7a477640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x556527985db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60214/0 (socket says 10.20.193.4:60214) 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7a477640 1 -- 10.20.193.4:0/2942054366 learned_addr learned my addr 10.20.193.4:0/2942054366 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e79c76640 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x5565279862f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7a477640 1 -- 10.20.193.4:0/2942054366 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55652796e500 msgr2=0x55652798b2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7a477640 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55652796e500 0x55652798b2e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7a477640 1 -- 10.20.193.4:0/2942054366 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 msgr2=0x5565279862f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7a477640 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x5565279862f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7a477640 1 -- 10.20.193.4:0/2942054366 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565277b39d0 con 0x556527928f50 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e7a477640 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x556527985db0 secure :-1 s=READY pgs=1255 gs=1 cs=0 l=1 c_cookie=13043102698588977017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e640a97c0 tx=0x7f0e64009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50268cc8e55b779 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e27fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.926+0000 7f0e27fff640 1 -- 10.20.193.4:0/2942054366 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e64096040 con 0x556527928f50 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2942054366 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e740f8fe0 con 0x556527928f50 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e27fff640 1 -- 10.20.193.4:0/2942054366 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e640ada00 con 0x556527928f50 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e27fff640 1 -- 10.20.193.4:0/2942054366 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e640b7cb0 con 0x556527928f50 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 10 client.18117 _ll_register_callbacks cb 0x5565277da080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2942054366 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55652757f4a0 con 0x556527928f50 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e27fff640 1 -- 10.20.193.4:0/2942054366 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0e640b7e40 con 0x556527928f50 2026-02-24T09:19:34.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e27fff640 1 -- 10.20.193.4:0/2942054366 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0e64072100 con 0x556527928f50 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 10 client.18117 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2942054366 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5565277c5710 con 0x556527928f50 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e27fff640 1 -- 10.20.193.4:0/2942054366 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0e640aafe0 con 0x556527928f50 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 10 client.18117 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 10 client.18117 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 20 client.18117 populate_metadata read hostname 'trial004' 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55652796b3b0 0x55652796b850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 4 client.18117 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.927+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2942054366 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565278257b0 con 0x55652796b3b0 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.928+0000 7f0e79c76640 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55652796b3b0 0x55652796b850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.929+0000 7f0e79c76640 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55652796b3b0 0x55652796b850 crc :-1 s=READY pgs=59 gs=3 cs=0 l=0 c_cookie=16085820131392532495 s_cookie=859741391034022955 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df3c502ee47ab00f server_cookie=bee6a3d73487c2b in_seq=0 out_seq=0 2026-02-24T09:19:34.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.929+0000 7f0e27fff640 10 client.18117 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:19:34.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.929+0000 7f0e27fff640 1 -- 10.20.193.4:0/2942054366 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5565278257b0 con 0x55652796b3b0 2026-02-24T09:19:34.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.929+0000 7f0e27fff640 10 client.18117 handle_command_reply: tid=0 2026-02-24T09:19:34.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.929+0000 7f0e7e6fce00 1 client.18117 shutdown 2026-02-24T09:19:34.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.929+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2942054366 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 msgr2=0x556527985db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.929+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x556527985db0 secure :-1 s=READY pgs=1255 gs=1 cs=0 l=1 c_cookie=13043102698588977017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e640a97c0 tx=0x7f0e64009cb0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.930+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2942054366 shutdown_connections 2026-02-24T09:19:34.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.930+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55652796b3b0 0x55652796b850 crc :-1 s=READY pgs=59 gs=3 cs=0 l=0 c_cookie=16085820131392532495 s_cookie=859741391034022955 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.930+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55652796e500 0x55652798b2e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.930+0000 7f0e27fff640 0 client.18117 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:19:34.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.930+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x5565279862f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.930+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2942054366 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x556527985db0 unknown :-1 s=CLOSED pgs=1255 gs=1 cs=0 l=1 c_cookie=13043102698588977017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.930+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2942054366 >> 10.20.193.4:0/2942054366 conn(0x556527847db0 msgr2=0x556527927040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.930+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2942054366 shutdown_connections 2026-02-24T09:19:34.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.930+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2942054366 wait complete. 2026-02-24T09:19:34.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.930+0000 7f0e7e6fce00 20 client.18117 trim_cache size 0 max 16384 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7e6fce00 1 Processor -- start 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7e6fce00 1 -- start start 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x5565279831a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x5565279836e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55652796e500 0x556527928460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55652782d9a0 con 0x556527928f50 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556527609df0 con 0x556527929860 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5565279733a0 con 0x55652796e500 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7a477640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x5565279831a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7a477640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x5565279831a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60230/0 (socket says 10.20.193.4:60230) 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7a477640 1 -- 10.20.193.4:0/3346337229 learned_addr learned my addr 10.20.193.4:0/3346337229 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.938+0000 7f0e7ac78640 1 --2- 10.20.193.4:0/3346337229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55652796e500 0x556527928460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.939+0000 7f0e79c76640 1 --2- 10.20.193.4:0/3346337229 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x5565279836e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.939+0000 7f0e7a477640 1 -- 10.20.193.4:0/3346337229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55652796e500 msgr2=0x556527928460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.939+0000 7f0e7a477640 1 --2- 10.20.193.4:0/3346337229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55652796e500 0x556527928460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.939+0000 7f0e7a477640 1 -- 10.20.193.4:0/3346337229 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 msgr2=0x5565279836e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.939+0000 7f0e7a477640 1 --2- 10.20.193.4:0/3346337229 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x5565279836e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.939+0000 7f0e7a477640 1 -- 10.20.193.4:0/3346337229 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565277c0190 con 0x556527928f50 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.939+0000 7f0e7a477640 1 --2- 10.20.193.4:0/3346337229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x5565279831a0 secure :-1 s=READY pgs=1256 gs=1 cs=0 l=1 c_cookie=3924700413015628510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e64009610 tx=0x7f0e6401b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3677563b4fa01ade server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.939+0000 7f0e424e6640 1 -- 10.20.193.4:0/3346337229 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e64096040 con 0x556527928f50 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.939+0000 7f0e424e6640 1 -- 10.20.193.4:0/3346337229 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e640c8060 con 0x556527928f50 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.939+0000 7f0e424e6640 1 -- 10.20.193.4:0/3346337229 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e640ada00 con 0x556527928f50 2026-02-24T09:19:34.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/3346337229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 msgr2=0x5565279831a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/3346337229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x5565279831a0 secure :-1 s=READY pgs=1256 gs=1 cs=0 l=1 c_cookie=3924700413015628510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e64009610 tx=0x7f0e6401b070 comp rx=0 tx=0).stop 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/3346337229 shutdown_connections 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/3346337229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55652796e500 0x556527928460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/3346337229 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527929860 0x5565279836e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/3346337229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527928f50 0x5565279831a0 unknown :-1 s=CLOSED pgs=1256 gs=1 cs=0 l=1 c_cookie=3924700413015628510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/3346337229 >> 10.20.193.4:0/3346337229 conn(0x556527847db0 msgr2=0x55652798a930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/3346337229 shutdown_connections 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/3346337229 wait complete. 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 -- start start 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.940+0000 7f0e7e6fce00 1 Processor -- start 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527928f50 0x556527928770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527929860 0x556527907030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x556527907570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5565279d5110 con 0x55652796e500 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5565279d5280 con 0x556527928f50 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556527907b30 con 0x556527929860 2026-02-24T09:19:34.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7ac78640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x556527907570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7ac78640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x556527907570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60242/0 (socket says 10.20.193.4:60242) 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7ac78640 1 -- 10.20.193.4:0/2248280329 learned_addr learned my addr 10.20.193.4:0/2248280329 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7a477640 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527928f50 0x556527928770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e79c76640 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527929860 0x556527907030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7ac78640 1 -- 10.20.193.4:0/2248280329 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527929860 msgr2=0x556527907030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7ac78640 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527929860 0x556527907030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7ac78640 1 -- 10.20.193.4:0/2248280329 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527928f50 msgr2=0x556527928770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7ac78640 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527928f50 0x556527928770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7ac78640 1 -- 10.20.193.4:0/2248280329 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565277b3d00 con 0x55652796e500 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7ac78640 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x556527907570 secure :-1 s=READY pgs=1257 gs=1 cs=0 l=1 c_cookie=7158709742947567672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e700050a0 tx=0x7f0e70005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6358d8952e848838 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e27fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:34.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e27fff640 1 -- 10.20.193.4:0/2248280329 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e70012660 con 0x55652796e500 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2248280329 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565277c5710 con 0x55652796e500 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e27fff640 1 -- 10.20.193.4:0/2248280329 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0e70018040 con 0x55652796e500 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e27fff640 1 -- 10.20.193.4:0/2248280329 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e70011dc0 con 0x55652796e500 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 10 client.18123 _ll_register_callbacks cb 0x5565277da080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2248280329 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e640ac800 con 0x55652796e500 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e27fff640 1 -- 10.20.193.4:0/2248280329 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0e70026440 con 0x55652796e500 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e27fff640 1 -- 10.20.193.4:0/2248280329 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0e70026600 con 0x55652796e500 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 10 client.18123 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.941+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2248280329 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5565277c5970 con 0x55652796e500 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.942+0000 7f0e27fff640 1 -- 10.20.193.4:0/2248280329 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0e700267e0 con 0x55652796e500 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.942+0000 7f0e7e6fce00 10 client.18123 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:34.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.942+0000 7f0e7e6fce00 10 client.18123 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:19:34.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.942+0000 7f0e7e6fce00 20 client.18123 populate_metadata read hostname 'trial004' 2026-02-24T09:19:34.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.942+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x556527a1c040 0x556527a3c4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:34.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.942+0000 7f0e7e6fce00 4 client.18123 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:19:34.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.942+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2248280329 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556527564160 con 0x556527a1c040 2026-02-24T09:19:34.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.942+0000 7f0e7a477640 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x556527a1c040 0x556527a3c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:34.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e27fff640 10 client.18123 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:19:34.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e7a477640 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x556527a1c040 0x556527a3c4f0 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=1767614716166560512 s_cookie=14397908152921090147 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1887d43818dc5b00 server_cookie=c7cfa52e838fe863 in_seq=0 out_seq=0 2026-02-24T09:19:34.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e27fff640 1 -- 10.20.193.4:0/2248280329 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556527564160 con 0x556527a1c040 2026-02-24T09:19:34.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e27fff640 10 client.18123 handle_command_reply: tid=0 2026-02-24T09:19:34.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e7e6fce00 1 client.18123 shutdown 2026-02-24T09:19:34.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2248280329 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 msgr2=0x556527907570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x556527907570 secure :-1 s=READY pgs=1257 gs=1 cs=0 l=1 c_cookie=7158709742947567672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e700050a0 tx=0x7f0e70005570 comp rx=0 tx=0).stop 2026-02-24T09:19:34.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2248280329 shutdown_connections 2026-02-24T09:19:34.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x556527a1c040 0x556527a3c4f0 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=1767614716166560512 s_cookie=14397908152921090147 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55652796e500 0x556527907570 unknown :-1 s=CLOSED pgs=1257 gs=1 cs=0 l=1 c_cookie=7158709742947567672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527929860 0x556527907030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e7e6fce00 1 --2- 10.20.193.4:0/2248280329 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527928f50 0x556527928770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2248280329 >> 10.20.193.4:0/2248280329 conn(0x556527847db0 msgr2=0x556527989010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.943+0000 7f0e27fff640 0 client.18123 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:19:34.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2248280329 shutdown_connections 2026-02-24T09:19:34.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7e6fce00 1 -- 10.20.193.4:0/2248280329 wait complete. 2026-02-24T09:19:34.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7e6fce00 20 client.18123 trim_cache size 0 max 16384 2026-02-24T09:19:34.954 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:19:34.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 -- 10.20.193.4:0/44271491 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e500b56d0 msgr2=0x7f0e500d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e500b56d0 0x7f0e500d5b80 secure :-1 s=READY pgs=445 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e680023d0 tx=0x7f0e68031040 comp rx=0 tx=0).stop 2026-02-24T09:19:34.955 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 -- 10.20.193.4:0/44271491 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e7410d470 msgr2=0x7f0e740f2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:34.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e7410d470 0x7f0e740f2c40 secure :-1 s=READY pgs=1254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e64005db0 tx=0x7f0e6400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 -- 10.20.193.4:0/44271491 shutdown_connections 2026-02-24T09:19:34.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f0e500b56d0 0x7f0e500d5b80 unknown :-1 s=CLOSED pgs=445 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0e74113660 0x7f0e740f3340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0e7410de60 0x7f0e74173f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 --2- 10.20.193.4:0/44271491 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0e7410d470 0x7f0e740f2c40 unknown :-1 s=CLOSED pgs=1254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:34.956 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 -- 10.20.193.4:0/44271491 >> 10.20.193.4:0/44271491 conn(0x7f0e740ead40 msgr2=0x7f0e7410b900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:34.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 -- 10.20.193.4:0/44271491 shutdown_connections 2026-02-24T09:19:34.957 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:34.944+0000 7f0e7c702640 1 -- 10.20.193.4:0/44271491 wait complete. 2026-02-24T09:19:35.072 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:34 trial004 ceph-mon[41596]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 692 MiB/s wr, 188 op/s 2026-02-24T09:19:35.074 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:19:35.249 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:35.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:34 trial090 ceph-mon[47278]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 692 MiB/s wr, 188 op/s 2026-02-24T09:19:35.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:34 trial014 ceph-mon[46941]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 692 MiB/s wr, 188 op/s 2026-02-24T09:19:35.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/3654449304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c84115840 msgr2=0x7f8c84176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:35.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 --2- 10.20.193.4:0/3654449304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c84115840 0x7f8c84176210 secure :-1 s=READY pgs=119 gs=2 cs=0 l=1 c_cookie=6367650031383176521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c8000aa30 tx=0x7f8c80030280 comp rx=0 tx=0).stop 2026-02-24T09:19:35.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/3654449304 shutdown_connections 2026-02-24T09:19:35.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 --2- 10.20.193.4:0/3654449304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c84115840 0x7f8c84176210 unknown :-1 s=CLOSED pgs=119 gs=2 cs=0 l=1 c_cookie=6367650031383176521 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 --2- 10.20.193.4:0/3654449304 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c84110040 0x7f8c84115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.450 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 --2- 10.20.193.4:0/3654449304 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c8410f650 0x7f8c8410fa20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/3654449304 >> 10.20.193.4:0/3654449304 conn(0x7f8c840ecf20 msgr2=0x7f8c8410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/3654449304 shutdown_connections 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/3654449304 wait complete. 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 Processor -- start 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.445+0000 7f8c8b1f8640 1 -- start start 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c8b1f8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c8410f650 0x7f8c84066fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c8b1f8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c84110040 0x7f8c84063220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c8b1f8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c84115840 0x7f8c840638d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c8b1f8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84064060 con 0x7f8c84110040 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c8b1f8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8411dcc0 con 0x7f8c8410f650 2026-02-24T09:19:35.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c8b1f8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8411de80 con 0x7f8c84115840 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c84110040 0x7f8c84063220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c84110040 0x7f8c84063220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60274/0 (socket says 10.20.193.4:60274) 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c7bfff640 1 -- 10.20.193.4:0/2913282466 learned_addr learned my addr 10.20.193.4:0/2913282466 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c8976e640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c84115840 0x7f8c840638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c8410f650 0x7f8c84066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c7bfff640 1 -- 10.20.193.4:0/2913282466 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c84115840 msgr2=0x7f8c840638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c84115840 0x7f8c840638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c7bfff640 1 -- 10.20.193.4:0/2913282466 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c8410f650 msgr2=0x7f8c84066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c8410f650 0x7f8c84066fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c7bfff640 1 -- 10.20.193.4:0/2913282466 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c740094b0 con 0x7f8c84110040 2026-02-24T09:19:35.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c84110040 0x7f8c84063220 secure :-1 s=READY pgs=1258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c6c005db0 tx=0x7f8c6c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:35.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c79ffb640 1 -- 10.20.193.4:0/2913282466 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c6c004500 con 0x7f8c84110040 2026-02-24T09:19:35.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/2913282466 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8000a650 con 0x7f8c84110040 2026-02-24T09:19:35.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c79ffb640 1 -- 10.20.193.4:0/2913282466 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8c6c004d30 con 0x7f8c84110040 2026-02-24T09:19:35.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c79ffb640 1 -- 10.20.193.4:0/2913282466 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c6c005330 con 0x7f8c84110040 2026-02-24T09:19:35.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.446+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/2913282466 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8411e440 con 0x7f8c84110040 2026-02-24T09:19:35.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.449+0000 7f8c79ffb640 1 -- 10.20.193.4:0/2913282466 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f8c6c0054c0 con 0x7f8c84110040 2026-02-24T09:19:35.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.450+0000 7f8c79ffb640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c600b56e0 0x7f8c600d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.450+0000 7f8c79ffb640 1 -- 10.20.193.4:0/2913282466 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8c6c0e6b50 con 0x7f8c84110040 2026-02-24T09:19:35.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.450+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c600b56e0 0x7f8c600d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.450+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c600b56e0 0x7f8c600d5b90 secure :-1 s=READY pgs=446 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c74004740 tx=0x7f8c74005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:35.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.453+0000 7f8c8d1f2e00 1 Processor -- start 2026-02-24T09:19:35.457 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.453+0000 7f8c8d1f2e00 1 -- start start 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.453+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x55797878f320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.453+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787d3fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.453+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5579787d4500 0x5579787f48e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.453+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55797869fee0 con 0x55797878f860 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.453+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55797869bc10 con 0x5579787d4500 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.453+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557978695d70 con 0x55797878ef50 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787d3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60284/0 (socket says 10.20.193.4:60284) 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c7bfff640 1 -- 10.20.193.4:0/1622739356 learned_addr learned my addr 10.20.193.4:0/1622739356 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/1622739356 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x55797878f320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c7bfff640 1 -- 10.20.193.4:0/1622739356 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 msgr2=0x55797878f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:35.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/1622739356 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x55797878f320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c7bfff640 1 -- 10.20.193.4:0/1622739356 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5579787d4500 msgr2=0x5579787f48e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:19:35.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/1622739356 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5579787d4500 0x5579787f48e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c7bfff640 1 -- 10.20.193.4:0/1622739356 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557978641340 con 0x55797878f860 2026-02-24T09:19:35.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/1622739356 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x55797878f320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:19:35.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/1622739356 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787d3fc0 secure :-1 s=READY pgs=1259 gs=1 cs=0 l=1 c_cookie=2671768338584251473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c6c0e4650 tx=0x7f8c6c0a8d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25140725f7732c51 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:35.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c514e4640 1 -- 10.20.193.4:0/1622739356 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c6c0ac680 con 0x55797878f860 2026-02-24T09:19:35.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c514e4640 1 -- 10.20.193.4:0/1622739356 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8c6c0ad880 con 0x55797878f860 2026-02-24T09:19:35.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.454+0000 7f8c514e4640 1 -- 10.20.193.4:0/1622739356 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c6c0a90f0 con 0x55797878f860 2026-02-24T09:19:35.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.455+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1622739356 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 msgr2=0x5579787d3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:35.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.455+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/1622739356 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787d3fc0 secure :-1 s=READY pgs=1259 gs=1 cs=0 l=1 c_cookie=2671768338584251473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c6c0e4650 tx=0x7f8c6c0a8d20 comp rx=0 tx=0).stop 2026-02-24T09:19:35.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.455+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1622739356 shutdown_connections 2026-02-24T09:19:35.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.455+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/1622739356 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5579787d4500 0x5579787f48e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.455+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/1622739356 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787d3fc0 unknown :-1 s=CLOSED pgs=1259 gs=1 cs=0 l=1 c_cookie=2671768338584251473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.455+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/1622739356 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x55797878f320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.455+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1622739356 >> 10.20.193.4:0/1622739356 conn(0x5579786addb0 msgr2=0x55797878d830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:35.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.455+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1622739356 shutdown_connections 2026-02-24T09:19:35.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.455+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1622739356 wait complete. 2026-02-24T09:19:35.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c8d1f2e00 1 -- start start 2026-02-24T09:19:35.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c8d1f2e00 1 Processor -- start 2026-02-24T09:19:35.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x5579787ebdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787ec330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5579787d4500 0x5579787f1320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5579787f1860 con 0x55797878f860 2026-02-24T09:19:35.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5579787f19d0 con 0x5579787d4500 2026-02-24T09:19:35.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5579787f1b90 con 0x55797878ef50 2026-02-24T09:19:35.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c7bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787ec330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60286/0 (socket says 10.20.193.4:60286) 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c7bfff640 1 -- 10.20.193.4:0/595671742 learned_addr learned my addr 10.20.193.4:0/595671742 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.457+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x5579787ebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c8976e640 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5579787d4500 0x5579787f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c7bfff640 1 -- 10.20.193.4:0/595671742 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 msgr2=0x5579787ebdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x5579787ebdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c7bfff640 1 -- 10.20.193.4:0/595671742 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5579787d4500 msgr2=0x5579787f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5579787d4500 0x5579787f1320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c7bfff640 1 -- 10.20.193.4:0/595671742 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579786199d0 con 0x55797878f860 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787ec330 secure :-1 s=READY pgs=1260 gs=1 cs=0 l=1 c_cookie=10360218977116858872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c6c00dfd0 tx=0x7f8c6c009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc6e444d64fa9f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c427fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:35.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c427fc640 1 -- 10.20.193.4:0/595671742 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c6c0add30 con 0x55797878f860 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/595671742 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8411e440 con 0x55797878f860 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c427fc640 1 -- 10.20.193.4:0/595671742 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8c6c0a9280 con 0x55797878f860 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c427fc640 1 -- 10.20.193.4:0/595671742 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c6c0b7db0 con 0x55797878f860 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c8d1f2e00 10 client.18135 _ll_register_callbacks cb 0x557978640080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/595671742 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5579783e54a0 con 0x55797878f860 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c427fc640 1 -- 10.20.193.4:0/595671742 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8c6c072010 con 0x55797878f860 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c427fc640 1 -- 10.20.193.4:0/595671742 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8c6c0721d0 con 0x55797878f860 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c8d1f2e00 10 client.18135 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/595671742 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55797862b710 con 0x55797878f860 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.458+0000 7f8c427fc640 1 -- 10.20.193.4:0/595671742 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f8c6c0aae60 con 0x55797878f860 2026-02-24T09:19:35.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.459+0000 7f8c8d1f2e00 10 client.18135 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:35.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.459+0000 7f8c8d1f2e00 10 client.18135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:35.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.459+0000 7f8c8d1f2e00 20 client.18135 populate_metadata read hostname 'trial004' 2026-02-24T09:19:35.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.459+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5579787d12a0 0x5579787d1740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.459+0000 7f8c8d1f2e00 4 client.18135 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:35.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.459+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/595671742 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55797868b7b0 con 0x5579787d12a0 2026-02-24T09:19:35.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.459+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5579787d12a0 0x5579787d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.459+0000 7f8c427fc640 10 client.18135 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:35.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.460+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5579787d12a0 0x5579787d1740 crc :-1 s=READY pgs=211 gs=4 cs=0 l=0 c_cookie=3738244978967748136 s_cookie=16312586831173759148 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e0ea0096c29e28 server_cookie=e261f34b8fd3b0ac in_seq=0 out_seq=0 2026-02-24T09:19:35.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c427fc640 1 -- 10.20.193.4:0/595671742 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55797868b7b0 con 0x5579787d12a0 2026-02-24T09:19:35.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c427fc640 10 client.18135 handle_command_reply: tid=0 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 client.18135 shutdown 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/595671742 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 msgr2=0x5579787ec330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787ec330 secure :-1 s=READY pgs=1260 gs=1 cs=0 l=1 c_cookie=10360218977116858872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c6c00dfd0 tx=0x7f8c6c009af0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/595671742 shutdown_connections 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5579787d12a0 0x5579787d1740 crc :-1 s=READY pgs=211 gs=4 cs=0 l=0 c_cookie=3738244978967748136 s_cookie=16312586831173759148 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5579787d4500 0x5579787f1320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55797878f860 0x5579787ec330 unknown :-1 s=CLOSED pgs=1260 gs=1 cs=0 l=1 c_cookie=10360218977116858872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/595671742 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x5579787ebdf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c427fc640 0 client.18135 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/595671742 >> 10.20.193.4:0/595671742 conn(0x5579786addb0 msgr2=0x55797878d040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:35.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/595671742 shutdown_connections 2026-02-24T09:19:35.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/595671742 wait complete. 2026-02-24T09:19:35.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.461+0000 7f8c8d1f2e00 20 client.18135 trim_cache size 0 max 16384 2026-02-24T09:19:35.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c8d1f2e00 1 Processor -- start 2026-02-24T09:19:35.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c8d1f2e00 1 -- start start 2026-02-24T09:19:35.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878ef50 0x5579787e91e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878f860 0x5579787e9720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 0x5579787cf160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5579786939a0 con 0x5579787d4500 2026-02-24T09:19:35.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55797846fdf0 con 0x55797878ef50 2026-02-24T09:19:35.478 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5579787f1430 con 0x55797878f860 2026-02-24T09:19:35.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c88f6d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878ef50 0x5579787e91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c8976e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 0x5579787cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c88f6d640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878ef50 0x5579787e91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:33504/0 (socket says 10.20.193.4:33504) 2026-02-24T09:19:35.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.473+0000 7f8c88f6d640 1 -- 10.20.193.4:0/4204584434 learned_addr learned my addr 10.20.193.4:0/4204584434 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:35.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.474+0000 7f8c8976e640 1 -- 10.20.193.4:0/4204584434 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878f860 msgr2=0x5579787e9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:35.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.474+0000 7f8c8976e640 1 --2- 10.20.193.4:0/4204584434 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878f860 0x5579787e9720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.474+0000 7f8c8976e640 1 -- 10.20.193.4:0/4204584434 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878ef50 msgr2=0x5579787e91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:35.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.474+0000 7f8c8976e640 1 --2- 10.20.193.4:0/4204584434 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878ef50 0x5579787e91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.474+0000 7f8c8976e640 1 -- 10.20.193.4:0/4204584434 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557978626190 con 0x5579787d4500 2026-02-24T09:19:35.479 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.474+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/4204584434 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878ef50 0x5579787e91e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:35.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.474+0000 7f8c8976e640 1 --2- 10.20.193.4:0/4204584434 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 0x5579787cf160 secure :-1 s=READY pgs=1261 gs=2 cs=0 l=1 c_cookie=5576406951197588253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c8000a980 tx=0x7f8c80006da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d636093b926bb1d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:35.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.474+0000 7f8c50ce3640 1 -- 10.20.193.4:0/4204584434 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c80030ae0 con 0x5579787d4500 2026-02-24T09:19:35.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.474+0000 7f8c50ce3640 1 -- 10.20.193.4:0/4204584434 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8c8003f050 con 0x5579787d4500 2026-02-24T09:19:35.480 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.474+0000 7f8c50ce3640 1 -- 10.20.193.4:0/4204584434 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c800050c0 con 0x5579787d4500 2026-02-24T09:19:35.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.477+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/4204584434 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 msgr2=0x5579787cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:35.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.477+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/4204584434 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 0x5579787cf160 secure :-1 s=READY pgs=1261 gs=2 cs=0 l=1 c_cookie=5576406951197588253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c8000a980 tx=0x7f8c80006da0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.477+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/4204584434 shutdown_connections 2026-02-24T09:19:35.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.477+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/4204584434 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 0x5579787cf160 unknown :-1 s=CLOSED pgs=1261 gs=2 cs=0 l=1 c_cookie=5576406951197588253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.481 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.477+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/4204584434 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878f860 0x5579787e9720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.477+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/4204584434 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878ef50 0x5579787e91e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.477+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/4204584434 >> 10.20.193.4:0/4204584434 conn(0x5579786addb0 msgr2=0x5579787d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:35.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.477+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/4204584434 shutdown_connections 2026-02-24T09:19:35.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.477+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/4204584434 wait complete. 2026-02-24T09:19:35.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.478+0000 7f8c8d1f2e00 1 -- start start 2026-02-24T09:19:35.482 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c8d1f2e00 1 Processor -- start 2026-02-24T09:19:35.484 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x557978772bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878f860 0x55797876e360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c8d1f2e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 0x55797876e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55797876ef80 con 0x5579787d4500 2026-02-24T09:19:35.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55797876f0f0 con 0x55797878f860 2026-02-24T09:19:35.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c8d1f2e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55797883a100 con 0x55797878ef50 2026-02-24T09:19:35.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c88f6d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x557978772bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c88f6d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x557978772bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:50050/0 (socket says 10.20.193.4:50050) 2026-02-24T09:19:35.485 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c88f6d640 1 -- 10.20.193.4:0/1893066011 learned_addr learned my addr 10.20.193.4:0/1893066011 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:35.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.479+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878f860 0x55797876e360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c8976e640 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 0x55797876e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c88f6d640 1 -- 10.20.193.4:0/1893066011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878f860 msgr2=0x55797876e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:35.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878f860 0x55797876e360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c88f6d640 1 -- 10.20.193.4:0/1893066011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 msgr2=0x55797876e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:35.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 0x55797876e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c88f6d640 1 -- 10.20.193.4:0/1893066011 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c84176a80 con 0x55797878ef50 2026-02-24T09:19:35.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c88f6d640 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x557978772bb0 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=7097024570561736406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c74002a70 tx=0x7f8c740047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627db23eca8d2ed6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:35.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c427fc640 10 client.0 ms_handle_connect on v2:10.20.193.90:3300/0 2026-02-24T09:19:35.486 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c427fc640 1 -- 10.20.193.4:0/1893066011 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c74024070 con 0x55797878ef50 2026-02-24T09:19:35.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c427fc640 1 -- 10.20.193.4:0/1893066011 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8c74025040 con 0x55797878ef50 2026-02-24T09:19:35.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c427fc640 1 -- 10.20.193.4:0/1893066011 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c7402a320 con 0x55797878ef50 2026-02-24T09:19:35.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.480+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1893066011 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c74012450 con 0x55797878ef50 2026-02-24T09:19:35.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.481+0000 7f8c427fc640 1 -- 10.20.193.4:0/1893066011 <== mon.1 v2:10.20.193.90:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8c7401e850 con 0x55797878ef50 2026-02-24T09:19:35.487 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.481+0000 7f8c427fc640 10 client.27124 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:19:35.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.482+0000 7f8c8d1f2e00 10 client.27124 _ll_register_callbacks cb 0x557978640080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:35.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.482+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1893066011 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c6c0ad880 con 0x55797878ef50 2026-02-24T09:19:35.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.483+0000 7f8c427fc640 1 -- 10.20.193.4:0/1893066011 <== mon.1 v2:10.20.193.90:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8c74012da0 con 0x55797878ef50 2026-02-24T09:19:35.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.483+0000 7f8c8d1f2e00 10 client.27124 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:35.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.483+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1893066011 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557978619d00 con 0x55797878ef50 2026-02-24T09:19:35.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.483+0000 7f8c427fc640 1 -- 10.20.193.4:0/1893066011 <== mon.1 v2:10.20.193.90:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f8c74032020 con 0x55797878ef50 2026-02-24T09:19:35.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.483+0000 7f8c8d1f2e00 10 client.27124 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:35.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.483+0000 7f8c8d1f2e00 10 client.27124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:35.490 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.483+0000 7f8c8d1f2e00 20 client.27124 populate_metadata read hostname 'trial004' 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.483+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5579788820a0 0x5579788a2550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.483+0000 7f8c8d1f2e00 4 client.27124 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.483+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1893066011 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8c6c0ad880 con 0x5579788820a0 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.484+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5579788820a0 0x5579788a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c7bfff640 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5579788820a0 0x5579788a2550 crc :-1 s=READY pgs=212 gs=4 cs=0 l=0 c_cookie=15633765204287070117 s_cookie=12571512344263961500 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8f64a9f3f649fa5 server_cookie=ae76fbded14aab9c in_seq=0 out_seq=0 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c427fc640 10 client.27124 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c427fc640 1 -- 10.20.193.4:0/1893066011 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8c6c0ad880 con 0x5579788820a0 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c427fc640 10 client.27124 handle_command_reply: tid=0 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 client.27124 shutdown 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1893066011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 msgr2=0x557978772bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:35.491 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x557978772bb0 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=7097024570561736406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c74002a70 tx=0x7f8c740047e0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1893066011 shutdown_connections 2026-02-24T09:19:35.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5579788820a0 0x5579788a2550 crc :-1 s=READY pgs=212 gs=4 cs=0 l=0 c_cookie=15633765204287070117 s_cookie=12571512344263961500 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5579787d4500 0x55797876e8a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55797878f860 0x55797876e360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 --2- 10.20.193.4:0/1893066011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55797878ef50 0x557978772bb0 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=7097024570561736406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1893066011 >> 10.20.193.4:0/1893066011 conn(0x5579786addb0 msgr2=0x55797878d450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:35.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c427fc640 0 client.27124 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:35.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1893066011 shutdown_connections 2026-02-24T09:19:35.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.485+0000 7f8c8d1f2e00 1 -- 10.20.193.4:0/1893066011 wait complete. 2026-02-24T09:19:35.492 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.486+0000 7f8c8d1f2e00 20 client.27124 trim_cache size 0 max 16384 2026-02-24T09:19:35.493 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:19:35.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.487+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/2913282466 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c600b56e0 msgr2=0x7f8c600d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:35.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.487+0000 7f8c8b1f8640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c600b56e0 0x7f8c600d5b90 secure :-1 s=READY pgs=446 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c74004740 tx=0x7f8c74005f90 comp rx=0 tx=0).stop 2026-02-24T09:19:35.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.487+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/2913282466 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c84110040 msgr2=0x7f8c84063220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:35.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.487+0000 7f8c8b1f8640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c84110040 0x7f8c84063220 secure :-1 s=READY pgs=1258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c6c005db0 tx=0x7f8c6c00ddf0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.487+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/2913282466 shutdown_connections 2026-02-24T09:19:35.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.487+0000 7f8c8b1f8640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8c600b56e0 0x7f8c600d5b90 unknown :-1 s=CLOSED pgs=446 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.494 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.487+0000 7f8c8b1f8640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c84115840 0x7f8c840638d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.487+0000 7f8c8b1f8640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8c84110040 0x7f8c84063220 unknown :-1 s=CLOSED pgs=1258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.487+0000 7f8c8b1f8640 1 --2- 10.20.193.4:0/2913282466 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8c8410f650 0x7f8c84066fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:35.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.487+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/2913282466 >> 10.20.193.4:0/2913282466 conn(0x7f8c840ecf20 msgr2=0x7f8c8410d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:35.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.488+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/2913282466 shutdown_connections 2026-02-24T09:19:35.495 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:35.488+0000 7f8c8b1f8640 1 -- 10.20.193.4:0/2913282466 wait complete. 2026-02-24T09:19:36.557 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:19:36.557 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:19:36.734 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:36.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 -- 10.20.193.4:0/1318759901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79f810fc70 msgr2=0x7f79f8114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:36.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 --2- 10.20.193.4:0/1318759901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79f810fc70 0x7f79f8114cc0 secure :-1 s=READY pgs=1262 gs=1 cs=0 l=1 c_cookie=16816575839782524266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e8009950 tx=0x7f79e802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 -- 10.20.193.4:0/1318759901 shutdown_connections 2026-02-24T09:19:36.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 --2- 10.20.193.4:0/1318759901 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79f8115470 0x7f79f8175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 --2- 10.20.193.4:0/1318759901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79f810fc70 0x7f79f8114cc0 unknown :-1 s=CLOSED pgs=1262 gs=1 cs=0 l=1 c_cookie=16816575839782524266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 --2- 10.20.193.4:0/1318759901 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79f810f280 0x7f79f810f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 -- 10.20.193.4:0/1318759901 >> 10.20.193.4:0/1318759901 conn(0x7f79f805f830 msgr2=0x7f79f810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:36.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 -- 10.20.193.4:0/1318759901 shutdown_connections 2026-02-24T09:19:36.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 -- 10.20.193.4:0/1318759901 wait complete. 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 Processor -- start 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.930+0000 7f79fdc0f640 1 -- start start 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79fdc0f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79f810f280 0x7f79f80f5560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79fdc0f640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79f810fc70 0x7f79f8175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79fdc0f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79f8115470 0x7f79f80f5c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79fdc0f640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f79f80fae70 con 0x7f79f810f280 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79fdc0f640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f79f80fafe0 con 0x7f79f810fc70 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79fdc0f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79f80fb1a0 con 0x7f79f8115470 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79f810f280 0x7f79f80f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79f810f280 0x7f79f80f5560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60326/0 (socket says 10.20.193.4:60326) 2026-02-24T09:19:36.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f77fe640 1 -- 10.20.193.4:0/3492193157 learned_addr learned my addr 10.20.193.4:0/3492193157 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f6ffd640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79f810fc70 0x7f79f8175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f7fff640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79f8115470 0x7f79f80f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f77fe640 1 -- 10.20.193.4:0/3492193157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79f8115470 msgr2=0x7f79f80f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f77fe640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79f8115470 0x7f79f80f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f77fe640 1 -- 10.20.193.4:0/3492193157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79f810fc70 msgr2=0x7f79f8175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f77fe640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79f810fc70 0x7f79f8175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f77fe640 1 -- 10.20.193.4:0/3492193157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e8009570 con 0x7f79f810f280 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f77fe640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79f810f280 0x7f79f80f5560 secure :-1 s=READY pgs=1263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e400d950 tx=0x7f79e400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f4ff9640 1 -- 10.20.193.4:0/3492193157 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79e4004540 con 0x7f79f810f280 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79fdc0f640 1 -- 10.20.193.4:0/3492193157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f80fb480 con 0x7f79f810f280 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f4ff9640 1 -- 10.20.193.4:0/3492193157 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79e4009d00 con 0x7f79f810f280 2026-02-24T09:19:36.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79f4ff9640 1 -- 10.20.193.4:0/3492193157 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79e40106e0 con 0x7f79f810f280 2026-02-24T09:19:36.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.931+0000 7f79fdc0f640 1 -- 10.20.193.4:0/3492193157 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f80fba20 con 0x7f79f810f280 2026-02-24T09:19:36.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.934+0000 7f79f4ff9640 1 -- 10.20.193.4:0/3492193157 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f79e40027c0 con 0x7f79f810f280 2026-02-24T09:19:36.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.935+0000 7f79f4ff9640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79cc0b56d0 0x7f79cc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.935+0000 7f79f4ff9640 1 -- 10.20.193.4:0/3492193157 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f79e40e6f30 con 0x7f79f810f280 2026-02-24T09:19:36.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.935+0000 7f79f6ffd640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79cc0b56d0 0x7f79cc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.935+0000 7f79f6ffd640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79cc0b56d0 0x7f79cc0d5b80 secure :-1 s=READY pgs=447 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e80023d0 tx=0x7f79e8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:36.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79ffc09e00 1 Processor -- start 2026-02-24T09:19:36.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79ffc09e00 1 -- start start 2026-02-24T09:19:36.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 0x5622a53296d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.941 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329c10 0x5622a536e370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a536e8b0 0x5622a538ec90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5622a5239520 con 0x5622a5329c10 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5622a5235250 con 0x5622a536e8b0 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5622a522f3b0 con 0x5622a5329300 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329c10 0x5622a536e370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f6ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329c10 0x5622a536e370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60336/0 (socket says 10.20.193.4:60336) 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f6ffd640 1 -- 10.20.193.4:0/3419392595 learned_addr learned my addr 10.20.193.4:0/3419392595 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f77fe640 1 --2- 10.20.193.4:0/3419392595 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 0x5622a53296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f6ffd640 1 -- 10.20.193.4:0/3419392595 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 msgr2=0x5622a53296d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f6ffd640 1 --2- 10.20.193.4:0/3419392595 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 0x5622a53296d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f6ffd640 1 -- 10.20.193.4:0/3419392595 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a536e8b0 msgr2=0x5622a538ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f6ffd640 1 --2- 10.20.193.4:0/3419392595 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a536e8b0 0x5622a538ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f6ffd640 1 -- 10.20.193.4:0/3419392595 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622a51da6e0 con 0x5622a5329c10 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f77fe640 1 --2- 10.20.193.4:0/3419392595 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 0x5622a53296d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79f6ffd640 1 --2- 10.20.193.4:0/3419392595 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329c10 0x5622a536e370 secure :-1 s=READY pgs=1264 gs=1 cs=0 l=1 c_cookie=3949313746791649361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e8009950 tx=0x7f79e8040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cec7eda8155051 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.937+0000 7f79bbfff640 1 -- 10.20.193.4:0/3419392595 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79e802fc10 con 0x5622a5329c10 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79bbfff640 1 -- 10.20.193.4:0/3419392595 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79e8038650 con 0x5622a5329c10 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79bbfff640 1 -- 10.20.193.4:0/3419392595 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79e804fad0 con 0x5622a5329c10 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3419392595 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329c10 msgr2=0x5622a536e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/3419392595 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329c10 0x5622a536e370 secure :-1 s=READY pgs=1264 gs=1 cs=0 l=1 c_cookie=3949313746791649361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e8009950 tx=0x7f79e8040000 comp rx=0 tx=0).stop 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3419392595 shutdown_connections 2026-02-24T09:19:36.943 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/3419392595 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a536e8b0 0x5622a538ec90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/3419392595 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329c10 0x5622a536e370 unknown :-1 s=CLOSED pgs=1264 gs=1 cs=0 l=1 c_cookie=3949313746791649361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/3419392595 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 0x5622a53296d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3419392595 >> 10.20.193.4:0/3419392595 conn(0x5622a52474f0 msgr2=0x5622a5327be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:36.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3419392595 shutdown_connections 2026-02-24T09:19:36.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.938+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3419392595 wait complete. 2026-02-24T09:19:36.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.939+0000 7f79ffc09e00 1 -- start start 2026-02-24T09:19:36.947 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.939+0000 7f79ffc09e00 1 Processor -- start 2026-02-24T09:19:36.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53412a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329c10 0x5622a53417e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a536e8b0 0x5622a53467d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5622a5346d10 con 0x5622a5329300 2026-02-24T09:19:36.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5622a5346e80 con 0x5622a536e8b0 2026-02-24T09:19:36.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5622a5347040 con 0x5622a5329c10 2026-02-24T09:19:36.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60338/0 (socket says 10.20.193.4:60338) 2026-02-24T09:19:36.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f77fe640 1 -- 10.20.193.4:0/2982901810 learned_addr learned my addr 10.20.193.4:0/2982901810 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:36.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f6ffd640 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329c10 0x5622a53417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f7fff640 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a536e8b0 0x5622a53467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f77fe640 1 -- 10.20.193.4:0/2982901810 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329c10 msgr2=0x5622a53417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f77fe640 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329c10 0x5622a53417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f77fe640 1 -- 10.20.193.4:0/2982901810 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a536e8b0 msgr2=0x5622a53467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f77fe640 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a536e8b0 0x5622a53467d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f77fe640 1 -- 10.20.193.4:0/2982901810 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622a51b2cd0 con 0x5622a5329300 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79f77fe640 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53412a0 secure :-1 s=READY pgs=1265 gs=1 cs=0 l=1 c_cookie=2311616152935634241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e4009610 tx=0x7f79e40a91d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201482a4c4c89541 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79b97fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79b97fa640 1 -- 10.20.193.4:0/2982901810 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79e40ae110 con 0x5622a5329300 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79b97fa640 1 -- 10.20.193.4:0/2982901810 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79e40adc60 con 0x5622a5329300 2026-02-24T09:19:36.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79b97fa640 1 -- 10.20.193.4:0/2982901810 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79e40725e0 con 0x5622a5329300 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79ffc09e00 1 -- 10.20.193.4:0/2982901810 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f81766b0 con 0x5622a5329300 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79b97fa640 1 -- 10.20.193.4:0/2982901810 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f79e40ab240 con 0x5622a5329300 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.940+0000 7f79b97fa640 10 client.18153 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79ffc09e00 10 client.18153 _ll_register_callbacks cb 0x5622a51ab790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79ffc09e00 1 -- 10.20.193.4:0/2982901810 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5622a4ebc9d0 con 0x5622a5329300 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79b97fa640 1 -- 10.20.193.4:0/2982901810 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f79e40b2f80 con 0x5622a5329300 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79ffc09e00 10 client.18153 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79ffc09e00 1 -- 10.20.193.4:0/2982901810 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5622a51c4ab0 con 0x5622a5329300 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79b97fa640 1 -- 10.20.193.4:0/2982901810 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f79e40e2ba0 con 0x5622a5329300 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79ffc09e00 10 client.18153 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79ffc09e00 10 client.18153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:36.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79ffc09e00 20 client.18153 populate_metadata read hostname 'trial004' 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622a536bb50 0x5622a536bff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79ffc09e00 4 client.18153 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79ffc09e00 1 -- 10.20.193.4:0/2982901810 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622a523fb70 con 0x5622a536bb50 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.941+0000 7f79f6ffd640 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622a536bb50 0x5622a536bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.942+0000 7f79b97fa640 10 client.18153 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.942+0000 7f79f6ffd640 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622a536bb50 0x5622a536bff0 crc :-1 s=READY pgs=213 gs=4 cs=0 l=0 c_cookie=1792090901973650971 s_cookie=518087720601179206 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18dec92e31594e1b server_cookie=7309e0974ecd446 in_seq=0 out_seq=0 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79b97fa640 1 -- 10.20.193.4:0/2982901810 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5622a523fb70 con 0x5622a536bb50 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79b97fa640 10 client.18153 handle_command_reply: tid=0 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 client.18153 shutdown 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 -- 10.20.193.4:0/2982901810 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 msgr2=0x5622a53412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:36.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53412a0 secure :-1 s=READY pgs=1265 gs=1 cs=0 l=1 c_cookie=2311616152935634241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e4009610 tx=0x7f79e40a91d0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 -- 10.20.193.4:0/2982901810 shutdown_connections 2026-02-24T09:19:36.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622a536bb50 0x5622a536bff0 crc :-1 s=READY pgs=213 gs=4 cs=0 l=0 c_cookie=1792090901973650971 s_cookie=518087720601179206 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a536e8b0 0x5622a53467d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329c10 0x5622a53417e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79b97fa640 0 client.18153 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:36.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/2982901810 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53412a0 unknown :-1 s=CLOSED pgs=1265 gs=1 cs=0 l=1 c_cookie=2311616152935634241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 -- 10.20.193.4:0/2982901810 >> 10.20.193.4:0/2982901810 conn(0x5622a52474f0 msgr2=0x5622a53282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:36.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 -- 10.20.193.4:0/2982901810 shutdown_connections 2026-02-24T09:19:36.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 1 -- 10.20.193.4:0/2982901810 wait complete. 2026-02-24T09:19:36.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.943+0000 7f79ffc09e00 20 client.18153 trim_cache size 0 max 16384 2026-02-24T09:19:36.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.955+0000 7f79ffc09e00 1 Processor -- start 2026-02-24T09:19:36.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.955+0000 7f79ffc09e00 1 -- start start 2026-02-24T09:19:36.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.955+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53284f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.955+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 0x5622a5328a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.959 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a536e8b0 0x5622a5366c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5622a522cfe0 con 0x5622a5329300 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5622a4ef7fe0 con 0x5622a5329c10 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5622a533a560 con 0x5622a536e8b0 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f77fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53284f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f6ffd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 0x5622a5328a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f7fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a536e8b0 0x5622a5366c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f6ffd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 0x5622a5328a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:33578/0 (socket says 10.20.193.4:33578) 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f6ffd640 1 -- 10.20.193.4:0/1524685779 learned_addr learned my addr 10.20.193.4:0/1524685779 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f77fe640 1 -- 10.20.193.4:0/1524685779 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a536e8b0 msgr2=0x5622a5366c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f77fe640 1 --2- 10.20.193.4:0/1524685779 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a536e8b0 0x5622a5366c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.960 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f77fe640 1 -- 10.20.193.4:0/1524685779 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 msgr2=0x5622a5328a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:36.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f77fe640 1 --2- 10.20.193.4:0/1524685779 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 0x5622a5328a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f77fe640 1 -- 10.20.193.4:0/1524685779 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622a51bf530 con 0x5622a5329300 2026-02-24T09:19:36.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79f77fe640 1 --2- 10.20.193.4:0/1524685779 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53284f0 secure :-1 s=READY pgs=1266 gs=1 cs=0 l=1 c_cookie=11080016899087211022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e40ac300 tx=0x7f79e401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c420aa4f6b1a0e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:36.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79bb7fe640 1 -- 10.20.193.4:0/1524685779 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79e40b2f80 con 0x5622a5329300 2026-02-24T09:19:36.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79bb7fe640 1 -- 10.20.193.4:0/1524685779 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5622a4ebc9d0 con 0x5622a5329300 2026-02-24T09:19:36.961 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.956+0000 7f79bb7fe640 1 -- 10.20.193.4:0/1524685779 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79e40b55d0 con 0x5622a5329300 2026-02-24T09:19:36.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.957+0000 7f79ffc09e00 1 -- 10.20.193.4:0/1524685779 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 msgr2=0x5622a53284f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:36.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.957+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/1524685779 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53284f0 secure :-1 s=READY pgs=1266 gs=1 cs=0 l=1 c_cookie=11080016899087211022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e40ac300 tx=0x7f79e401c000 comp rx=0 tx=0).stop 2026-02-24T09:19:36.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.957+0000 7f79ffc09e00 1 -- 10.20.193.4:0/1524685779 shutdown_connections 2026-02-24T09:19:36.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.957+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/1524685779 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a536e8b0 0x5622a5366c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.957+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/1524685779 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 0x5622a5328a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.957+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/1524685779 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a5329300 0x5622a53284f0 unknown :-1 s=CLOSED pgs=1266 gs=1 cs=0 l=1 c_cookie=11080016899087211022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.957+0000 7f79ffc09e00 1 -- 10.20.193.4:0/1524685779 >> 10.20.193.4:0/1524685779 conn(0x5622a52474f0 msgr2=0x5622a5345e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.957+0000 7f79ffc09e00 1 -- 10.20.193.4:0/1524685779 shutdown_connections 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.957+0000 7f79ffc09e00 1 -- 10.20.193.4:0/1524685779 wait complete. 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79ffc09e00 1 -- start start 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79ffc09e00 1 Processor -- start 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 0x5622a5348d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 0x5622a5349280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79ffc09e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a536e8b0 0x5622a53497c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5622a53468e0 con 0x5622a536e8b0 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5622a53d3dd0 con 0x5622a5329c10 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79ffc09e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5622a53d3f90 con 0x5622a5329300 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a536e8b0 0x5622a53497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a536e8b0 0x5622a53497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60352/0 (socket says 10.20.193.4:60352) 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f7fff640 1 -- 10.20.193.4:0/3814509894 learned_addr learned my addr 10.20.193.4:0/3814509894 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f77fe640 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 0x5622a5348d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f6ffd640 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 0x5622a5349280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f7fff640 1 -- 10.20.193.4:0/3814509894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 msgr2=0x5622a5348d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f7fff640 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 0x5622a5348d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f7fff640 1 -- 10.20.193.4:0/3814509894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 msgr2=0x5622a5349280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f7fff640 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 0x5622a5349280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f7fff640 1 -- 10.20.193.4:0/3814509894 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622a51b3000 con 0x5622a536e8b0 2026-02-24T09:19:36.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79f7fff640 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a536e8b0 0x5622a53497c0 secure :-1 s=READY pgs=1267 gs=1 cs=0 l=1 c_cookie=10829014155589583794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79ec005170 tx=0x7f79ec0116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964862fffb9803b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.958+0000 7f79b97fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79b97fa640 1 -- 10.20.193.4:0/3814509894 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79ec015860 con 0x5622a536e8b0 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79b97fa640 1 -- 10.20.193.4:0/3814509894 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79ec00d030 con 0x5622a536e8b0 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79b97fa640 1 -- 10.20.193.4:0/3814509894 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79ec014e50 con 0x5622a536e8b0 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3814509894 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622a51c4ab0 con 0x5622a536e8b0 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79b97fa640 1 -- 10.20.193.4:0/3814509894 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f79ec01d3f0 con 0x5622a536e8b0 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79b97fa640 10 client.18159 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 10 client.18159 _ll_register_callbacks cb 0x5622a51ab790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3814509894 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5622a52417e0 con 0x5622a536e8b0 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79b97fa640 1 -- 10.20.193.4:0/3814509894 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f79ec014460 con 0x5622a536e8b0 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 10 client.18159 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:36.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3814509894 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5622a51c4d10 con 0x5622a536e8b0 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79b97fa640 1 -- 10.20.193.4:0/3814509894 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f79ec0159c0 con 0x5622a536e8b0 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 10 client.18159 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 10 client.18159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 20 client.18159 populate_metadata read hostname 'trial004' 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622a541c0b0 0x5622a543c540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 4 client.18159 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.959+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3814509894 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5622a4eba220 con 0x5622a541c0b0 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.960+0000 7f79f77fe640 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622a541c0b0 0x5622a543c540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.960+0000 7f79b97fa640 10 client.18159 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.960+0000 7f79f77fe640 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622a541c0b0 0x5622a543c540 crc :-1 s=READY pgs=214 gs=4 cs=0 l=0 c_cookie=5061471589461595286 s_cookie=70217256111134843 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=463df59802971496 server_cookie=f97638ef9b587b in_seq=0 out_seq=0 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79b97fa640 1 -- 10.20.193.4:0/3814509894 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5622a4eba220 con 0x5622a541c0b0 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79b97fa640 10 client.18159 handle_command_reply: tid=0 2026-02-24T09:19:36.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 client.18159 shutdown 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3814509894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a536e8b0 msgr2=0x5622a53497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a536e8b0 0x5622a53497c0 secure :-1 s=READY pgs=1267 gs=1 cs=0 l=1 c_cookie=10829014155589583794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79ec005170 tx=0x7f79ec0116f0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3814509894 shutdown_connections 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5622a541c0b0 0x5622a543c540 crc :-1 s=READY pgs=214 gs=4 cs=0 l=0 c_cookie=5061471589461595286 s_cookie=70217256111134843 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5622a536e8b0 0x5622a53497c0 unknown :-1 s=CLOSED pgs=1267 gs=1 cs=0 l=1 c_cookie=10829014155589583794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5622a5329c10 0x5622a5349280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79b97fa640 0 client.18159 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 --2- 10.20.193.4:0/3814509894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5622a5329300 0x5622a5348d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3814509894 >> 10.20.193.4:0/3814509894 conn(0x5622a52474f0 msgr2=0x5622a5344500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3814509894 shutdown_connections 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.961+0000 7f79ffc09e00 1 -- 10.20.193.4:0/3814509894 wait complete. 2026-02-24T09:19:36.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79ffc09e00 20 client.18159 trim_cache size 0 max 16384 2026-02-24T09:19:36.972 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:19:36.972 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:19:36.972 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "02c4bb30-7b42-4907-8bbf-d28c355c477b", 2026-02-24T09:19:36.972 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:19:36.972 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:19:36.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 -- 10.20.193.4:0/3492193157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79cc0b56d0 msgr2=0x7f79cc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:36.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79cc0b56d0 0x7f79cc0d5b80 secure :-1 s=READY pgs=447 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e80023d0 tx=0x7f79e8031040 comp rx=0 tx=0).stop 2026-02-24T09:19:36.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 -- 10.20.193.4:0/3492193157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79f810f280 msgr2=0x7f79f80f5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:36.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79f810f280 0x7f79f80f5560 secure :-1 s=READY pgs=1263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e400d950 tx=0x7f79e400de20 comp rx=0 tx=0).stop 2026-02-24T09:19:36.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 -- 10.20.193.4:0/3492193157 shutdown_connections 2026-02-24T09:19:36.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79cc0b56d0 0x7f79cc0d5b80 unknown :-1 s=CLOSED pgs=447 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79f8115470 0x7f79f80f5c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79f810fc70 0x7f79f8175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 --2- 10.20.193.4:0/3492193157 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79f810f280 0x7f79f80f5560 unknown :-1 s=CLOSED pgs=1263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:36.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 -- 10.20.193.4:0/3492193157 >> 10.20.193.4:0/3492193157 conn(0x7f79f805f830 msgr2=0x7f79f8111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:36.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 -- 10.20.193.4:0/3492193157 shutdown_connections 2026-02-24T09:19:36.974 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:36.962+0000 7f79fdc0f640 1 -- 10.20.193.4:0/3492193157 wait complete. 2026-02-24T09:19:37.094 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:36 trial004 ceph-mon[41596]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 56 KiB/s rd, 706 MiB/s wr, 191 op/s 2026-02-24T09:19:37.095 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:19:37.264 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:37.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:36 trial090 ceph-mon[47278]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 56 KiB/s rd, 706 MiB/s wr, 191 op/s 2026-02-24T09:19:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:36 trial014 ceph-mon[46941]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 56 KiB/s rd, 706 MiB/s wr, 191 op/s 2026-02-24T09:19:37.527 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.524+0000 7f9376e38640 1 -- 10.20.193.4:0/3073138186 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f937010f650 msgr2=0x7f937010fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.524+0000 7f9376e38640 1 --2- 10.20.193.4:0/3073138186 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f937010f650 0x7f937010fa20 secure :-1 s=READY pgs=1268 gs=1 cs=0 l=1 c_cookie=219685244022006796 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9360009950 tx=0x7f936002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 -- 10.20.193.4:0/3073138186 shutdown_connections 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 --2- 10.20.193.4:0/3073138186 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9370115840 0x7f9370176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 --2- 10.20.193.4:0/3073138186 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9370110040 0x7f9370115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 --2- 10.20.193.4:0/3073138186 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f937010f650 0x7f937010fa20 unknown :-1 s=CLOSED pgs=1268 gs=1 cs=0 l=1 c_cookie=219685244022006796 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 -- 10.20.193.4:0/3073138186 >> 10.20.193.4:0/3073138186 conn(0x7f93700ecf20 msgr2=0x7f937010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 -- 10.20.193.4:0/3073138186 shutdown_connections 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 -- 10.20.193.4:0/3073138186 wait complete. 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 Processor -- start 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 -- start start 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f937010f650 0x7f937011df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9370110040 0x7f937011e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9370115840 0x7f9370123810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9370123e30 con 0x7f9370110040 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9370123fa0 con 0x7f937010f650 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9376e38640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9370124160 con 0x7f9370115840 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9367fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9370110040 0x7f937011e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9367fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9370110040 0x7f937011e440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60372/0 (socket says 10.20.193.4:60372) 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9367fff640 1 -- 10.20.193.4:0/1345047896 learned_addr learned my addr 10.20.193.4:0/1345047896 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f9374bad640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f937010f650 0x7f937011df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.525+0000 7f93753ae640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9370115840 0x7f9370123810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9367fff640 1 -- 10.20.193.4:0/1345047896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9370115840 msgr2=0x7f9370123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.528 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9367fff640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9370115840 0x7f9370123810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9367fff640 1 -- 10.20.193.4:0/1345047896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f937010f650 msgr2=0x7f937011df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9367fff640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f937010f650 0x7f937011df00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9367fff640 1 -- 10.20.193.4:0/1345047896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9360009570 con 0x7f9370110040 2026-02-24T09:19:37.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9367fff640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9370110040 0x7f937011e440 secure :-1 s=READY pgs=1269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f935800b500 tx=0x7f935800b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9365ffb640 1 -- 10.20.193.4:0/1345047896 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93580044a0 con 0x7f9370110040 2026-02-24T09:19:37.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9376e38640 1 -- 10.20.193.4:0/1345047896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9370124440 con 0x7f9370110040 2026-02-24T09:19:37.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9365ffb640 1 -- 10.20.193.4:0/1345047896 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9358002b80 con 0x7f9370110040 2026-02-24T09:19:37.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9365ffb640 1 -- 10.20.193.4:0/1345047896 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f935800fd90 con 0x7f9370110040 2026-02-24T09:19:37.529 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.526+0000 7f9376e38640 1 -- 10.20.193.4:0/1345047896 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9370164bc0 con 0x7f9370110040 2026-02-24T09:19:37.531 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.529+0000 7f9365ffb640 1 -- 10.20.193.4:0/1345047896 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9358019460 con 0x7f9370110040 2026-02-24T09:19:37.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.531+0000 7f9365ffb640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f934c0b5760 0x7f934c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.531+0000 7f9374bad640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f934c0b5760 0x7f934c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.531+0000 7f9365ffb640 1 -- 10.20.193.4:0/1345047896 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f93580e5fb0 con 0x7f9370110040 2026-02-24T09:19:37.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.531+0000 7f9374bad640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f934c0b5760 0x7f934c0d5c10 secure :-1 s=READY pgs=448 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93600023d0 tx=0x7f9360031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.534+0000 7f9378e32e00 1 Processor -- start 2026-02-24T09:19:37.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.534+0000 7f9378e32e00 1 -- start start 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad2820 0x5584b3ad2bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3b17890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3b17dd0 0x5584b3b381b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9378e32e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5584b39e2de0 con 0x5584b3ad3130 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9378e32e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5584b39deb10 con 0x5584b3ad2820 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9378e32e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584b39d8ab0 con 0x5584b3b17dd0 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9374bad640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad2820 0x5584b3ad2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9374bad640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad2820 0x5584b3ad2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:33612/0 (socket says 10.20.193.4:33612) 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9374bad640 1 -- 10.20.193.4:0/364545509 learned_addr learned my addr 10.20.193.4:0/364545509 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9367fff640 1 --2- 10.20.193.4:0/364545509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3b17890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f93753ae640 1 --2- 10.20.193.4:0/364545509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3b17dd0 0x5584b3b381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9374bad640 1 -- 10.20.193.4:0/364545509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3b17dd0 msgr2=0x5584b3b381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9374bad640 1 --2- 10.20.193.4:0/364545509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3b17dd0 0x5584b3b381b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9374bad640 1 -- 10.20.193.4:0/364545509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 msgr2=0x5584b3b17890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9374bad640 1 --2- 10.20.193.4:0/364545509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3b17890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9374bad640 1 -- 10.20.193.4:0/364545509 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b3984310 con 0x5584b3ad2820 2026-02-24T09:19:37.537 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9367fff640 1 --2- 10.20.193.4:0/364545509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3b17890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:37.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f9374bad640 1 --2- 10.20.193.4:0/364545509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad2820 0x5584b3ad2bf0 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=1330685901777768734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93600059f0 tx=0x7f9360040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12778bc70315911e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f933d4e4640 1 -- 10.20.193.4:0/364545509 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9360002a00 con 0x5584b3ad2820 2026-02-24T09:19:37.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f933d4e4640 1 -- 10.20.193.4:0/364545509 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9360038920 con 0x5584b3ad2820 2026-02-24T09:19:37.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.535+0000 7f933d4e4640 1 -- 10.20.193.4:0/364545509 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f936004f7d0 con 0x5584b3ad2820 2026-02-24T09:19:37.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.536+0000 7f9378e32e00 1 -- 10.20.193.4:0/364545509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad2820 msgr2=0x5584b3ad2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.536+0000 7f9378e32e00 1 --2- 10.20.193.4:0/364545509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad2820 0x5584b3ad2bf0 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=1330685901777768734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93600059f0 tx=0x7f9360040000 comp rx=0 tx=0).stop 2026-02-24T09:19:37.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.536+0000 7f9378e32e00 1 -- 10.20.193.4:0/364545509 shutdown_connections 2026-02-24T09:19:37.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.536+0000 7f9378e32e00 1 --2- 10.20.193.4:0/364545509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3b17dd0 0x5584b3b381b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.536+0000 7f9378e32e00 1 --2- 10.20.193.4:0/364545509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3b17890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.538 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.536+0000 7f9378e32e00 1 --2- 10.20.193.4:0/364545509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad2820 0x5584b3ad2bf0 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=1330685901777768734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.536+0000 7f9378e32e00 1 -- 10.20.193.4:0/364545509 >> 10.20.193.4:0/364545509 conn(0x5584b39f16b0 msgr2=0x5584b3ad1100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.536+0000 7f9378e32e00 1 -- 10.20.193.4:0/364545509 shutdown_connections 2026-02-24T09:19:37.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.536+0000 7f9378e32e00 1 -- 10.20.193.4:0/364545509 wait complete. 2026-02-24T09:19:37.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9378e32e00 1 -- start start 2026-02-24T09:19:37.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9378e32e00 1 Processor -- start 2026-02-24T09:19:37.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3aeae30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3aeb370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3b17dd0 0x5584b3af0360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9378e32e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5584b3af08a0 con 0x5584b3ad3130 2026-02-24T09:19:37.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9378e32e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5584b3af0a10 con 0x5584b3b17dd0 2026-02-24T09:19:37.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9378e32e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584b3af0bd0 con 0x5584b3ad2820 2026-02-24T09:19:37.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9367fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3aeb370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f93753ae640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3b17dd0 0x5584b3af0360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9367fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3aeb370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60390/0 (socket says 10.20.193.4:60390) 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9367fff640 1 -- 10.20.193.4:0/3258653279 learned_addr learned my addr 10.20.193.4:0/3258653279 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9374bad640 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3aeae30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9367fff640 1 -- 10.20.193.4:0/3258653279 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 msgr2=0x5584b3aeae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9367fff640 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3aeae30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9367fff640 1 -- 10.20.193.4:0/3258653279 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3b17dd0 msgr2=0x5584b3af0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9367fff640 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3b17dd0 0x5584b3af0360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.538+0000 7f9367fff640 1 -- 10.20.193.4:0/3258653279 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9370176a80 con 0x5584b3ad3130 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9367fff640 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3aeb370 secure :-1 s=READY pgs=1270 gs=1 cs=0 l=1 c_cookie=11931419294604160989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93580023d0 tx=0x7f935800f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a594eaa2111f6fdd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f932e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f932e7fc640 1 -- 10.20.193.4:0/3258653279 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93580b2040 con 0x5584b3ad3130 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 1 -- 10.20.193.4:0/3258653279 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9370164bc0 con 0x5584b3ad3130 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 10 client.18171 _ll_register_callbacks cb 0x5584b3974160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f932e7fc640 1 -- 10.20.193.4:0/3258653279 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f93580b4620 con 0x5584b3ad3130 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 1 -- 10.20.193.4:0/3258653279 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584b37284a0 con 0x5584b3ad3130 2026-02-24T09:19:37.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f932e7fc640 1 -- 10.20.193.4:0/3258653279 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93580aa580 con 0x5584b3ad3130 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f932e7fc640 1 -- 10.20.193.4:0/3258653279 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f93580727d0 con 0x5584b3ad3130 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f932e7fc640 1 -- 10.20.193.4:0/3258653279 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f93580add10 con 0x5584b3ad3130 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 10 client.18171 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 1 -- 10.20.193.4:0/3258653279 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5584b395c8c0 con 0x5584b3ad3130 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f932e7fc640 1 -- 10.20.193.4:0/3258653279 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f93580ade70 con 0x5584b3ad3130 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 10 client.18171 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 10 client.18171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 20 client.18171 populate_metadata read hostname 'trial004' 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584b3b157e0 0x5584b3b15c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 4 client.18171 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.539+0000 7f9378e32e00 1 -- 10.20.193.4:0/3258653279 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584b39ce4f0 con 0x5584b3b157e0 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.540+0000 7f9374bad640 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584b3b157e0 0x5584b3b15c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.540+0000 7f9374bad640 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584b3b157e0 0x5584b3b15c80 crc :-1 s=READY pgs=215 gs=4 cs=0 l=0 c_cookie=10891175688673433585 s_cookie=5935463868665099201 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97253a95bdc017f1 server_cookie=525f00f0ecf2f3c1 in_seq=0 out_seq=0 2026-02-24T09:19:37.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.540+0000 7f932e7fc640 10 client.18171 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f932e7fc640 1 -- 10.20.193.4:0/3258653279 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5584b39ce4f0 con 0x5584b3b157e0 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f932e7fc640 10 client.18171 handle_command_reply: tid=0 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 client.18171 shutdown 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 -- 10.20.193.4:0/3258653279 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 msgr2=0x5584b3aeb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3aeb370 secure :-1 s=READY pgs=1270 gs=1 cs=0 l=1 c_cookie=11931419294604160989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93580023d0 tx=0x7f935800f7a0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 -- 10.20.193.4:0/3258653279 shutdown_connections 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584b3b157e0 0x5584b3b15c80 crc :-1 s=READY pgs=215 gs=4 cs=0 l=0 c_cookie=10891175688673433585 s_cookie=5935463868665099201 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3b17dd0 0x5584b3af0360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3ad3130 0x5584b3aeb370 unknown :-1 s=CLOSED pgs=1270 gs=1 cs=0 l=1 c_cookie=11931419294604160989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 --2- 10.20.193.4:0/3258653279 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3aeae30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f932e7fc640 0 client.18171 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 -- 10.20.193.4:0/3258653279 >> 10.20.193.4:0/3258653279 conn(0x5584b39f16b0 msgr2=0x5584b3ad1810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 -- 10.20.193.4:0/3258653279 shutdown_connections 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 1 -- 10.20.193.4:0/3258653279 wait complete. 2026-02-24T09:19:37.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.541+0000 7f9378e32e00 20 client.18171 trim_cache size 0 max 16384 2026-02-24T09:19:37.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9378e32e00 1 Processor -- start 2026-02-24T09:19:37.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9378e32e00 1 -- start start 2026-02-24T09:19:37.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3b17510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad3130 0x5584b3b107b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b10cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9378e32e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5584b39d66e0 con 0x5584b3b17dd0 2026-02-24T09:19:37.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9378e32e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5584b36a1f50 con 0x5584b3ad3130 2026-02-24T09:19:37.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9378e32e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584b3a46410 con 0x5584b3ad2820 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9374bad640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3b17510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9374bad640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3b17510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:50146/0 (socket says 10.20.193.4:50146) 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9374bad640 1 -- 10.20.193.4:0/1002051674 learned_addr learned my addr 10.20.193.4:0/1002051674 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f9367fff640 1 --2- 10.20.193.4:0/1002051674 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad3130 0x5584b3b107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f93753ae640 1 --2- 10.20.193.4:0/1002051674 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b10cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f93753ae640 1 -- 10.20.193.4:0/1002051674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 msgr2=0x5584b3b17510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f93753ae640 1 --2- 10.20.193.4:0/1002051674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3b17510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f93753ae640 1 -- 10.20.193.4:0/1002051674 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad3130 msgr2=0x5584b3b107b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f93753ae640 1 --2- 10.20.193.4:0/1002051674 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad3130 0x5584b3b107b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.553+0000 7f93753ae640 1 -- 10.20.193.4:0/1002051674 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b396e6e0 con 0x5584b3b17dd0 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.554+0000 7f93753ae640 1 --2- 10.20.193.4:0/1002051674 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b10cf0 secure :-1 s=READY pgs=1271 gs=1 cs=0 l=1 c_cookie=13690274223277368622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f936c004870 tx=0x7f936c00a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfd9fdf3422652e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.554+0000 7f933cce3640 1 -- 10.20.193.4:0/1002051674 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f936c017070 con 0x5584b3b17dd0 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.554+0000 7f933cce3640 1 -- 10.20.193.4:0/1002051674 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f936c018040 con 0x5584b3b17dd0 2026-02-24T09:19:37.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.554+0000 7f933cce3640 1 -- 10.20.193.4:0/1002051674 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f936c01c7a0 con 0x5584b3b17dd0 2026-02-24T09:19:37.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.555+0000 7f9378e32e00 1 -- 10.20.193.4:0/1002051674 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 msgr2=0x5584b3b10cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.555+0000 7f9378e32e00 1 --2- 10.20.193.4:0/1002051674 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b10cf0 secure :-1 s=READY pgs=1271 gs=1 cs=0 l=1 c_cookie=13690274223277368622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f936c004870 tx=0x7f936c00a310 comp rx=0 tx=0).stop 2026-02-24T09:19:37.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.555+0000 7f9378e32e00 1 -- 10.20.193.4:0/1002051674 shutdown_connections 2026-02-24T09:19:37.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.555+0000 7f9378e32e00 1 --2- 10.20.193.4:0/1002051674 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b10cf0 unknown :-1 s=CLOSED pgs=1271 gs=1 cs=0 l=1 c_cookie=13690274223277368622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.555+0000 7f9378e32e00 1 --2- 10.20.193.4:0/1002051674 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad3130 0x5584b3b107b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.555+0000 7f9378e32e00 1 --2- 10.20.193.4:0/1002051674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3b17510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.555+0000 7f9378e32e00 1 -- 10.20.193.4:0/1002051674 >> 10.20.193.4:0/1002051674 conn(0x5584b39f16b0 msgr2=0x5584b3ae7210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.555+0000 7f9378e32e00 1 -- 10.20.193.4:0/1002051674 shutdown_connections 2026-02-24T09:19:37.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.555+0000 7f9378e32e00 1 -- 10.20.193.4:0/1002051674 wait complete. 2026-02-24T09:19:37.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f9378e32e00 1 -- start start 2026-02-24T09:19:37.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f9378e32e00 1 Processor -- start 2026-02-24T09:19:37.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3af2f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad3130 0x5584b3af3510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f9378e32e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b7d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f9378e32e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5584b3a41600 con 0x5584b3b17dd0 2026-02-24T09:19:37.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f9378e32e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5584b3a423d0 con 0x5584b3ad3130 2026-02-24T09:19:37.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f9378e32e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5584b3b7d960 con 0x5584b3ad2820 2026-02-24T09:19:37.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f93753ae640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b7d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f93753ae640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b7d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:60412/0 (socket says 10.20.193.4:60412) 2026-02-24T09:19:37.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f93753ae640 1 -- 10.20.193.4:0/452723466 learned_addr learned my addr 10.20.193.4:0/452723466 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f9367fff640 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad3130 0x5584b3af3510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f9374bad640 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3af2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f93753ae640 1 -- 10.20.193.4:0/452723466 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 msgr2=0x5584b3af2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f93753ae640 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3af2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f93753ae640 1 -- 10.20.193.4:0/452723466 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad3130 msgr2=0x5584b3af3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f93753ae640 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad3130 0x5584b3af3510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.556+0000 7f93753ae640 1 -- 10.20.193.4:0/452723466 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b3969160 con 0x5584b3b17dd0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f93753ae640 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b7d2f0 secure :-1 s=READY pgs=1272 gs=1 cs=0 l=1 c_cookie=13419115755644307405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f936c006ec0 tx=0x7f936c006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3a46aea706c7cd server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f932e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f932e7fc640 1 -- 10.20.193.4:0/452723466 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f936c017040 con 0x5584b3b17dd0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 1 -- 10.20.193.4:0/452723466 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936c0054e0 con 0x5584b3b17dd0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f932e7fc640 1 -- 10.20.193.4:0/452723466 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f936c01c710 con 0x5584b3b17dd0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f932e7fc640 1 -- 10.20.193.4:0/452723466 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f936c027990 con 0x5584b3b17dd0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 10 client.18177 _ll_register_callbacks cb 0x5584b3974160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 1 -- 10.20.193.4:0/452723466 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584b3663f40 con 0x5584b3b17dd0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f932e7fc640 1 -- 10.20.193.4:0/452723466 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f936c027b20 con 0x5584b3b17dd0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f932e7fc640 1 -- 10.20.193.4:0/452723466 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f936c027ce0 con 0x5584b3b17dd0 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 10 client.18177 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:37.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 1 -- 10.20.193.4:0/452723466 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5584b395cbf0 con 0x5584b3b17dd0 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f932e7fc640 1 -- 10.20.193.4:0/452723466 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f936c01cb50 con 0x5584b3b17dd0 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 10 client.18177 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 10 client.18177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 20 client.18177 populate_metadata read hostname 'trial004' 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584b3bc5a40 0x5584b3be5ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 4 client.18177 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.557+0000 7f9378e32e00 1 -- 10.20.193.4:0/452723466 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f9360038920 con 0x5584b3bc5a40 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.558+0000 7f9374bad640 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584b3bc5a40 0x5584b3be5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.558+0000 7f9374bad640 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584b3bc5a40 0x5584b3be5ef0 crc :-1 s=READY pgs=216 gs=4 cs=0 l=0 c_cookie=15253054004655414149 s_cookie=8294933134977932789 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3adbbcd9755db85 server_cookie=731d85bce1fa1df5 in_seq=0 out_seq=0 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.558+0000 7f932e7fc640 10 client.18177 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.558+0000 7f932e7fc640 1 -- 10.20.193.4:0/452723466 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x7f9360038920 con 0x5584b3bc5a40 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.558+0000 7f932e7fc640 10 client.18177 handle_command_reply: tid=0 2026-02-24T09:19:37.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.558+0000 7f9378e32e00 1 client.18177 shutdown 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.558+0000 7f9378e32e00 1 -- 10.20.193.4:0/452723466 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 msgr2=0x5584b3b7d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.558+0000 7f9378e32e00 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b7d2f0 secure :-1 s=READY pgs=1272 gs=1 cs=0 l=1 c_cookie=13419115755644307405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f936c006ec0 tx=0x7f936c006ef0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.559+0000 7f9378e32e00 1 -- 10.20.193.4:0/452723466 shutdown_connections 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.559+0000 7f9378e32e00 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5584b3bc5a40 0x5584b3be5ef0 crc :-1 s=READY pgs=216 gs=4 cs=0 l=0 c_cookie=15253054004655414149 s_cookie=8294933134977932789 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.559+0000 7f9378e32e00 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5584b3b17dd0 0x5584b3b7d2f0 unknown :-1 s=CLOSED pgs=1272 gs=1 cs=0 l=1 c_cookie=13419115755644307405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.559+0000 7f9378e32e00 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5584b3ad3130 0x5584b3af3510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.559+0000 7f932e7fc640 0 client.18177 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.559+0000 7f9378e32e00 1 --2- 10.20.193.4:0/452723466 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5584b3ad2820 0x5584b3af2f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.559+0000 7f9378e32e00 1 -- 10.20.193.4:0/452723466 >> 10.20.193.4:0/452723466 conn(0x5584b39f16b0 msgr2=0x5584b3ad11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.559+0000 7f9378e32e00 1 -- 10.20.193.4:0/452723466 shutdown_connections 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.559+0000 7f9378e32e00 1 -- 10.20.193.4:0/452723466 wait complete. 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.559+0000 7f9378e32e00 20 client.18177 trim_cache size 0 max 16384 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stdout: "02c4bb30-7b42-4907-8bbf-d28c355c477b": { 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "02c4bb30-7b42-4907-8bbf-d28c355c477b", 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:19:37.562 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "50fcb56c-a674-4f78-aafd-69881ffc04d0": { 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:02.417630+0000", 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "b703ea3c-d980-4a3f-b2c3-714d8f9ad80d": { 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:58.321748+0000", 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.563 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.564 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.565 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.566 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "02c4bb30-7b42-4907-8bbf-d28c355c477b": { 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:36.960639+0000", 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.567 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 -- 10.20.193.4:0/1345047896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f934c0b5760 msgr2=0x7f934c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f934c0b5760 0x7f934c0d5c10 secure :-1 s=READY pgs=448 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93600023d0 tx=0x7f9360031040 comp rx=0 tx=0).stop 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 -- 10.20.193.4:0/1345047896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9370110040 msgr2=0x7f937011e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9370110040 0x7f937011e440 secure :-1 s=READY pgs=1269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f935800b500 tx=0x7f935800b9d0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 -- 10.20.193.4:0/1345047896 shutdown_connections 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f934c0b5760 0x7f934c0d5c10 unknown :-1 s=CLOSED pgs=448 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9370115840 0x7f9370123810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9370110040 0x7f937011e440 unknown :-1 s=CLOSED pgs=1269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 --2- 10.20.193.4:0/1345047896 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f937010f650 0x7f937011df00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 -- 10.20.193.4:0/1345047896 >> 10.20.193.4:0/1345047896 conn(0x7f93700ecf20 msgr2=0x7f937010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 -- 10.20.193.4:0/1345047896 shutdown_connections 2026-02-24T09:19:37.568 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:37.560+0000 7f9376e38640 1 -- 10.20.193.4:0/1345047896 wait complete. 2026-02-24T09:19:37.682 INFO:tasks.cephfs.filesystem:scrub status for tag:02c4bb30-7b42-4907-8bbf-d28c355c477b - {'path': '/', 'tag': '02c4bb30-7b42-4907-8bbf-d28c355c477b', 'options': 'recursive,force'} 2026-02-24T09:19:38.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:37 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:19:38.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:37 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:38.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:37 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:19:38.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:37 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:37 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:19:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:37 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:37 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:19:38.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:37 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:37 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:19:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:37 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:37 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:19:38.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:37 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:19:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:38 trial004 ceph-mon[41596]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 857 MiB/s wr, 237 op/s 2026-02-24T09:19:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:38 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:19:39.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:38 trial090 ceph-mon[47278]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 857 MiB/s wr, 237 op/s 2026-02-24T09:19:39.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:38 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:19:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:38 trial014 ceph-mon[46941]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 857 MiB/s wr, 237 op/s 2026-02-24T09:19:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:38 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:19:41.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:40 trial004 ceph-mon[41596]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 893 MiB/s wr, 251 op/s 2026-02-24T09:19:41.313 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:40 trial014 ceph-mon[46941]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 893 MiB/s wr, 251 op/s 2026-02-24T09:19:41.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:40 trial090 ceph-mon[47278]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 55 KiB/s rd, 893 MiB/s wr, 251 op/s 2026-02-24T09:19:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:42 trial004 ceph-mon[41596]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 854 MiB/s wr, 243 op/s 2026-02-24T09:19:43.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:42 trial090 ceph-mon[47278]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 854 MiB/s wr, 243 op/s 2026-02-24T09:19:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:42 trial014 ceph-mon[46941]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 44 KiB/s rd, 854 MiB/s wr, 243 op/s 2026-02-24T09:19:45.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:44 trial004 ceph-mon[41596]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 43 KiB/s rd, 692 MiB/s wr, 201 op/s 2026-02-24T09:19:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:44 trial090 ceph-mon[47278]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 43 KiB/s rd, 692 MiB/s wr, 201 op/s 2026-02-24T09:19:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:44 trial014 ceph-mon[46941]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 43 KiB/s rd, 692 MiB/s wr, 201 op/s 2026-02-24T09:19:47.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:46 trial004 ceph-mon[41596]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 642 MiB/s wr, 189 op/s 2026-02-24T09:19:47.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:46 trial090 ceph-mon[47278]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 642 MiB/s wr, 189 op/s 2026-02-24T09:19:47.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:46 trial014 ceph-mon[46941]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 642 MiB/s wr, 189 op/s 2026-02-24T09:19:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:48 trial004 ceph-mon[41596]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 750 MiB/s wr, 215 op/s 2026-02-24T09:19:49.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:48 trial090 ceph-mon[47278]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 750 MiB/s wr, 215 op/s 2026-02-24T09:19:49.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:48 trial014 ceph-mon[46941]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 33 KiB/s rd, 750 MiB/s wr, 215 op/s 2026-02-24T09:19:50.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:49 trial004 ceph-mon[41596]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 692 MiB/s wr, 189 op/s 2026-02-24T09:19:50.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:49 trial090 ceph-mon[47278]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 692 MiB/s wr, 189 op/s 2026-02-24T09:19:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:49 trial014 ceph-mon[46941]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 692 MiB/s wr, 189 op/s 2026-02-24T09:19:53.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:52 trial004 ceph-mon[41596]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 833 MiB/s wr, 226 op/s 2026-02-24T09:19:53.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:52 trial090 ceph-mon[47278]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 833 MiB/s wr, 226 op/s 2026-02-24T09:19:53.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:52 trial014 ceph-mon[46941]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 833 MiB/s wr, 226 op/s 2026-02-24T09:19:54.852 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.2 2026-02-24T09:19:54.853 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:19:55.065 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:55.149 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:54 trial004 ceph-mon[41596]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 45 KiB/s rd, 888 MiB/s wr, 241 op/s 2026-02-24T09:19:55.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.241+0000 7f9034e39640 1 -- 10.20.193.4:0/3644378438 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f903010da00 msgr2=0x7f9030112a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.241+0000 7f9034e39640 1 --2- 10.20.193.4:0/3644378438 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f903010da00 0x7f9030112a50 secure :-1 s=READY pgs=121 gs=2 cs=0 l=1 c_cookie=11669009887699673109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9018009890 tx=0x7f901802f0e0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.247 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.241+0000 7f9034e39640 1 -- 10.20.193.4:0/3644378438 shutdown_connections 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.241+0000 7f9034e39640 1 --2- 10.20.193.4:0/3644378438 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9030113200 0x7f9030173bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.241+0000 7f9034e39640 1 --2- 10.20.193.4:0/3644378438 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f903010da00 0x7f9030112a50 unknown :-1 s=CLOSED pgs=121 gs=2 cs=0 l=1 c_cookie=11669009887699673109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.241+0000 7f9034e39640 1 --2- 10.20.193.4:0/3644378438 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f903010d010 0x7f903010d3e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.241+0000 7f9034e39640 1 -- 10.20.193.4:0/3644378438 >> 10.20.193.4:0/3644378438 conn(0x7f903005f830 msgr2=0x7f903010ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f9034e39640 1 -- 10.20.193.4:0/3644378438 shutdown_connections 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f9034e39640 1 -- 10.20.193.4:0/3644378438 wait complete. 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f9034e39640 1 Processor -- start 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f9034e39640 1 -- start start 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f9034e39640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f903010d010 0x7f90300f5620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f9034e39640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f903010da00 0x7f9030173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.248 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f9034e39640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9030113200 0x7f90300f5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f9034e39640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f90300faee0 con 0x7f903010da00 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f9034e39640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f90300fb050 con 0x7f903010d010 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f9034e39640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90300fb210 con 0x7f9030113200 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f902dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f903010da00 0x7f9030173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f902dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f903010da00 0x7f9030173ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52402/0 (socket says 10.20.193.4:52402) 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.242+0000 7f902dd74640 1 -- 10.20.193.4:0/1368584493 learned_addr learned my addr 10.20.193.4:0/1368584493 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f902dd74640 1 -- 10.20.193.4:0/1368584493 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9030113200 msgr2=0x7f90300f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f902dd74640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9030113200 0x7f90300f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f902dd74640 1 -- 10.20.193.4:0/1368584493 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f903010d010 msgr2=0x7f90300f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f902dd74640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f903010d010 0x7f90300f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.249 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f902dd74640 1 -- 10.20.193.4:0/1368584493 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9024009570 con 0x7f903010da00 2026-02-24T09:19:55.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f902dd74640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f903010da00 0x7f9030173ad0 secure :-1 s=READY pgs=1273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90180023b0 tx=0x7f90180028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:55.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f90177fe640 1 -- 10.20.193.4:0/1368584493 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f901803d070 con 0x7f903010da00 2026-02-24T09:19:55.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f9034e39640 1 -- 10.20.193.4:0/1368584493 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90180094b0 con 0x7f903010da00 2026-02-24T09:19:55.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f9034e39640 1 -- 10.20.193.4:0/1368584493 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90300fb7c0 con 0x7f903010da00 2026-02-24T09:19:55.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f90177fe640 1 -- 10.20.193.4:0/1368584493 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f901802fcb0 con 0x7f903010da00 2026-02-24T09:19:55.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.243+0000 7f90177fe640 1 -- 10.20.193.4:0/1368584493 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9018041a00 con 0x7f903010da00 2026-02-24T09:19:55.250 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.244+0000 7f90157fa640 1 -- 10.20.193.4:0/1368584493 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903010e2f0 con 0x7f903010da00 2026-02-24T09:19:55.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.246+0000 7f90177fe640 1 -- 10.20.193.4:0/1368584493 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9018041b90 con 0x7f903010da00 2026-02-24T09:19:55.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.247+0000 7f90177fe640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90080b5750 0x7f90080d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.251 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.247+0000 7f90177fe640 1 -- 10.20.193.4:0/1368584493 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f901810b6e0 con 0x7f903010da00 2026-02-24T09:19:55.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.247+0000 7f902e575640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90080b5750 0x7f90080d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.248+0000 7f902e575640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90080b5750 0x7f90080d5c00 secure :-1 s=READY pgs=449 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9024004740 tx=0x7f9024005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:55.252 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.249+0000 7f90177fe640 1 -- 10.20.193.4:0/1368584493 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f90180ce060 con 0x7f903010da00 2026-02-24T09:19:55.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:54 trial090 ceph-mon[47278]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 45 KiB/s rd, 888 MiB/s wr, 241 op/s 2026-02-24T09:19:55.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:54 trial014 ceph-mon[46941]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 45 KiB/s rd, 888 MiB/s wr, 241 op/s 2026-02-24T09:19:55.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.458+0000 7f90157fa640 1 -- 10.20.193.4:0/1368584493 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9030176ef0 con 0x7f903010da00 2026-02-24T09:19:55.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.459+0000 7f90177fe640 1 -- 10.20.193.4:0/1368584493 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f90180d1210 con 0x7f903010da00 2026-02-24T09:19:55.463 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:19:55.464 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:19:55.464 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:19:55.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.465+0000 7f90157fa640 1 -- 10.20.193.4:0/1368584493 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90080b5750 msgr2=0x7f90080d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.465+0000 7f90157fa640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90080b5750 0x7f90080d5c00 secure :-1 s=READY pgs=449 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9024004740 tx=0x7f9024005ab0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.465+0000 7f90157fa640 1 -- 10.20.193.4:0/1368584493 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f903010da00 msgr2=0x7f9030173ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.465+0000 7f90157fa640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f903010da00 0x7f9030173ad0 secure :-1 s=READY pgs=1273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90180023b0 tx=0x7f90180028d0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.466+0000 7f90157fa640 1 -- 10.20.193.4:0/1368584493 shutdown_connections 2026-02-24T09:19:55.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.466+0000 7f90157fa640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90080b5750 0x7f90080d5c00 unknown :-1 s=CLOSED pgs=449 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.466+0000 7f90157fa640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9030113200 0x7f90300f5d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.466+0000 7f90157fa640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f903010da00 0x7f9030173ad0 unknown :-1 s=CLOSED pgs=1273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.466+0000 7f90157fa640 1 --2- 10.20.193.4:0/1368584493 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f903010d010 0x7f90300f5620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.466+0000 7f90157fa640 1 -- 10.20.193.4:0/1368584493 >> 10.20.193.4:0/1368584493 conn(0x7f903005f830 msgr2=0x7f903010f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:55.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.466+0000 7f90157fa640 1 -- 10.20.193.4:0/1368584493 shutdown_connections 2026-02-24T09:19:55.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.466+0000 7f90157fa640 1 -- 10.20.193.4:0/1368584493 wait complete. 2026-02-24T09:19:55.562 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 133.2 --await-for 45.0' 2026-02-24T09:19:55.562 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 133.2 --await-for 45.0 2026-02-24T09:19:55.704 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:19:55.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.890+0000 7f984d8c4640 1 -- 10.20.193.4:0/4083399694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f984810beb0 msgr2=0x7f984810c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.890+0000 7f984d8c4640 1 --2- 10.20.193.4:0/4083399694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f984810beb0 0x7f984810c280 secure :-1 s=READY pgs=1274 gs=1 cs=0 l=1 c_cookie=14062741636824552165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983c009890 tx=0x7f983c02f0e0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.890+0000 7f984d8c4640 1 -- 10.20.193.4:0/4083399694 shutdown_connections 2026-02-24T09:19:55.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.890+0000 7f984d8c4640 1 --2- 10.20.193.4:0/4083399694 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9848155be0 0x7f9848175fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.890+0000 7f984d8c4640 1 --2- 10.20.193.4:0/4083399694 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f984810c7c0 0x7f98481556a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.890+0000 7f984d8c4640 1 --2- 10.20.193.4:0/4083399694 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f984810beb0 0x7f984810c280 unknown :-1 s=CLOSED pgs=1274 gs=1 cs=0 l=1 c_cookie=14062741636824552165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.890+0000 7f984d8c4640 1 -- 10.20.193.4:0/4083399694 >> 10.20.193.4:0/4083399694 conn(0x7f98480e9b50 msgr2=0x7f9848109f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:55.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.890+0000 7f984d8c4640 1 -- 10.20.193.4:0/4083399694 shutdown_connections 2026-02-24T09:19:55.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.890+0000 7f984d8c4640 1 -- 10.20.193.4:0/4083399694 wait complete. 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.891+0000 7f984d8c4640 1 Processor -- start 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.891+0000 7f984d8c4640 1 -- start start 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.891+0000 7f984d8c4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f984810beb0 0x7f98481608d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.891+0000 7f984d8c4640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f984810c7c0 0x7f9848160e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.891+0000 7f984d8c4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9848155be0 0x7f98481661e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.891+0000 7f984d8c4640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9848166800 con 0x7f9848155be0 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.891+0000 7f984d8c4640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9848166970 con 0x7f984810c7c0 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.891+0000 7f984d8c4640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9848166b30 con 0x7f984810beb0 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.892+0000 7f98477fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9848155be0 0x7f98481661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.892+0000 7f98477fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9848155be0 0x7f98481661e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52420/0 (socket says 10.20.193.4:52420) 2026-02-24T09:19:55.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.892+0000 7f98477fe640 1 -- 10.20.193.4:0/2987423587 learned_addr learned my addr 10.20.193.4:0/2987423587 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:55.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.892+0000 7f9846ffd640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f984810beb0 0x7f98481608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.892+0000 7f98477fe640 1 -- 10.20.193.4:0/2987423587 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f984810beb0 msgr2=0x7f98481608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.892+0000 7f98477fe640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f984810beb0 0x7f98481608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.892+0000 7f98477fe640 1 -- 10.20.193.4:0/2987423587 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f984810c7c0 msgr2=0x7f9848160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.892+0000 7f98477fe640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f984810c7c0 0x7f9848160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.892+0000 7f98477fe640 1 -- 10.20.193.4:0/2987423587 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983c0094b0 con 0x7f9848155be0 2026-02-24T09:19:55.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.894+0000 7f98477fe640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9848155be0 0x7f98481661e0 secure :-1 s=READY pgs=1275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983800e950 tx=0x7f983800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:55.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.894+0000 7f984c8c2640 1 -- 10.20.193.4:0/2987423587 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9838005500 con 0x7f9848155be0 2026-02-24T09:19:55.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.894+0000 7f984d8c4640 1 -- 10.20.193.4:0/2987423587 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9848166e10 con 0x7f9848155be0 2026-02-24T09:19:55.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.894+0000 7f984d8c4640 1 -- 10.20.193.4:0/2987423587 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9848152810 con 0x7f9848155be0 2026-02-24T09:19:55.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.894+0000 7f984c8c2640 1 -- 10.20.193.4:0/2987423587 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f983800cd20 con 0x7f9848155be0 2026-02-24T09:19:55.900 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.894+0000 7f984c8c2640 1 -- 10.20.193.4:0/2987423587 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f98380116e0 con 0x7f9848155be0 2026-02-24T09:19:55.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.898+0000 7f984c8c2640 1 -- 10.20.193.4:0/2987423587 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9838011870 con 0x7f9848155be0 2026-02-24T09:19:55.902 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.899+0000 7f984c8c2640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f981c0b5760 0x7f981c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.899+0000 7f984c8c2640 1 -- 10.20.193.4:0/2987423587 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f98380e7c20 con 0x7f9848155be0 2026-02-24T09:19:55.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.899+0000 7f9846ffd640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f981c0b5760 0x7f981c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.903 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.899+0000 7f9846ffd640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f981c0b5760 0x7f981c0d5c10 secure :-1 s=READY pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983c0097e0 tx=0x7f983c03a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:55.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.901+0000 7f984f8bee00 1 Processor -- start 2026-02-24T09:19:55.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.901+0000 7f984f8bee00 1 -- start start 2026-02-24T09:19:55.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.901+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa98f7fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.901+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa98f84e0 0x555aa993cc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.906 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.901+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa993d180 0x555aa995d560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.901+0000 7f984f8bee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555aa9806f20 con 0x555aa98f7bd0 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.901+0000 7f984f8bee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555aa9802c50 con 0x555aa98f84e0 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.901+0000 7f984f8bee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555aa97fcdb0 con 0x555aa993d180 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f98467fc640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa98f84e0 0x555aa993cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f98467fc640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa98f84e0 0x555aa993cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:49142/0 (socket says 10.20.193.4:49142) 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f98477fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa993d180 0x555aa995d560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f98467fc640 1 -- 10.20.193.4:0/259368052 learned_addr learned my addr 10.20.193.4:0/259368052 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f98467fc640 1 -- 10.20.193.4:0/259368052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa993d180 msgr2=0x555aa995d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f98467fc640 1 --2- 10.20.193.4:0/259368052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa993d180 0x555aa995d560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f98467fc640 1 -- 10.20.193.4:0/259368052 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 msgr2=0x555aa98f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:55.907 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f98467fc640 1 --2- 10.20.193.4:0/259368052 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa98f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f98467fc640 1 -- 10.20.193.4:0/259368052 --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa979d690 con 0x555aa98f84e0 2026-02-24T09:19:55.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f98467fc640 1 --2- 10.20.193.4:0/259368052 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa98f84e0 0x555aa993cc40 secure :-1 s=READY pgs=102 gs=3 cs=0 l=1 c_cookie=9909520946025191315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9830009540 tx=0x7f983000e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8985b0cc2a1fd793 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:55.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f980bfff640 1 -- 10.20.193.4:0/259368052 <== mon.2 v2:10.20.193.14:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f983000ed20 con 0x555aa98f84e0 2026-02-24T09:19:55.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f980bfff640 1 -- 10.20.193.4:0/259368052 <== mon.2 v2:10.20.193.14:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f983000ee80 con 0x555aa98f84e0 2026-02-24T09:19:55.908 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.902+0000 7f980bfff640 1 -- 10.20.193.4:0/259368052 <== mon.2 v2:10.20.193.14:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9830005430 con 0x555aa98f84e0 2026-02-24T09:19:55.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.903+0000 7f984f8bee00 1 -- 10.20.193.4:0/259368052 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa98f84e0 msgr2=0x555aa993cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.903+0000 7f984f8bee00 1 --2- 10.20.193.4:0/259368052 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa98f84e0 0x555aa993cc40 secure :-1 s=READY pgs=102 gs=3 cs=0 l=1 c_cookie=9909520946025191315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9830009540 tx=0x7f983000e350 comp rx=0 tx=0).stop 2026-02-24T09:19:55.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.903+0000 7f984f8bee00 1 -- 10.20.193.4:0/259368052 shutdown_connections 2026-02-24T09:19:55.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.903+0000 7f984f8bee00 1 --2- 10.20.193.4:0/259368052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa993d180 0x555aa995d560 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.903+0000 7f984f8bee00 1 --2- 10.20.193.4:0/259368052 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa98f84e0 0x555aa993cc40 unknown :-1 s=CLOSED pgs=102 gs=3 cs=0 l=1 c_cookie=9909520946025191315 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.903+0000 7f984f8bee00 1 --2- 10.20.193.4:0/259368052 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa98f7fa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.903+0000 7f984f8bee00 1 -- 10.20.193.4:0/259368052 >> 10.20.193.4:0/259368052 conn(0x555aa9815880 msgr2=0x555aa98f64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:55.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.903+0000 7f984f8bee00 1 -- 10.20.193.4:0/259368052 shutdown_connections 2026-02-24T09:19:55.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.903+0000 7f984f8bee00 1 -- 10.20.193.4:0/259368052 wait complete. 2026-02-24T09:19:55.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.905+0000 7f984f8bee00 1 -- start start 2026-02-24T09:19:55.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.905+0000 7f984f8bee00 1 Processor -- start 2026-02-24T09:19:55.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa9918550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 0x555aa9918a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa993d180 0x555aa991da80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f984f8bee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555aa991dfc0 con 0x555aa98f7bd0 2026-02-24T09:19:55.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f984f8bee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555aa991e130 con 0x555aa993d180 2026-02-24T09:19:55.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f984f8bee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555aa991e2f0 con 0x555aa98f84e0 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f98467fc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 0x555aa9918a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f98467fc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 0x555aa9918a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:57854/0 (socket says 10.20.193.4:57854) 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f98467fc640 1 -- 10.20.193.4:0/3742962664 learned_addr learned my addr 10.20.193.4:0/3742962664 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f9846ffd640 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa9918550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f98477fe640 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa993d180 0x555aa991da80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f98467fc640 1 -- 10.20.193.4:0/3742962664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa993d180 msgr2=0x555aa991da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f98467fc640 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa993d180 0x555aa991da80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f98467fc640 1 -- 10.20.193.4:0/3742962664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 msgr2=0x555aa9918550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f98467fc640 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa9918550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.906+0000 7f98467fc640 1 -- 10.20.193.4:0/3742962664 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa97a83d0 con 0x555aa98f84e0 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.907+0000 7f98467fc640 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 0x555aa9918a90 secure :-1 s=READY pgs=122 gs=2 cs=0 l=1 c_cookie=13689941309167125944 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983000ee50 tx=0x7f9830004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdfc711698da45b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:55.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.907+0000 7f98097fa640 10 client.0 ms_handle_connect on v2:10.20.193.90:3300/0 2026-02-24T09:19:55.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.907+0000 7f98097fa640 1 -- 10.20.193.4:0/3742962664 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f983001f040 con 0x555aa98f84e0 2026-02-24T09:19:55.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.907+0000 7f98097fa640 1 -- 10.20.193.4:0/3742962664 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9830004cd0 con 0x555aa98f84e0 2026-02-24T09:19:55.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.907+0000 7f98097fa640 1 -- 10.20.193.4:0/3742962664 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f98300106d0 con 0x555aa98f84e0 2026-02-24T09:19:55.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.907+0000 7f984f8bee00 1 -- 10.20.193.4:0/3742962664 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98300097e0 con 0x555aa98f84e0 2026-02-24T09:19:55.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.907+0000 7f98097fa640 1 -- 10.20.193.4:0/3742962664 <== mon.1 v2:10.20.193.90:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f9830014070 con 0x555aa98f84e0 2026-02-24T09:19:55.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.907+0000 7f98097fa640 10 client.27163 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:19:55.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.909+0000 7f984f8bee00 10 client.27163 _ll_register_callbacks cb 0x555aa977da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:55.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.909+0000 7f984f8bee00 1 -- 10.20.193.4:0/3742962664 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555aa948aeb0 con 0x555aa98f84e0 2026-02-24T09:19:55.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.917+0000 7f98097fa640 1 -- 10.20.193.4:0/3742962664 <== mon.1 v2:10.20.193.90:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9830024e60 con 0x555aa98f84e0 2026-02-24T09:19:55.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.917+0000 7f984f8bee00 10 client.27163 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:55.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.917+0000 7f984f8bee00 1 -- 10.20.193.4:0/3742962664 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({fsmap=19}) -- 0x555aa97805c0 con 0x555aa98f84e0 2026-02-24T09:19:55.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.917+0000 7f98097fa640 1 -- 10.20.193.4:0/3742962664 <== mon.1 v2:10.20.193.90:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9830004fd0 con 0x555aa98f84e0 2026-02-24T09:19:55.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.918+0000 7f984f8bee00 10 client.27163 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:55.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.918+0000 7f984f8bee00 10 client.27163 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:19:55.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.918+0000 7f984f8bee00 20 client.27163 populate_metadata read hostname 'trial004' 2026-02-24T09:19:55.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.918+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555aa9922bb0 0x555aa9923050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.918+0000 7f984f8bee00 4 client.27163 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:19:55.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.918+0000 7f984f8bee00 1 -- 10.20.193.4:0/3742962664 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aa980df00 con 0x555aa9922bb0 2026-02-24T09:19:55.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.919+0000 7f9846ffd640 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555aa9922bb0 0x555aa9923050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.923+0000 7f98097fa640 10 client.27163 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:55.926 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.923+0000 7f9846ffd640 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555aa9922bb0 0x555aa9923050 crc :-1 s=READY pgs=217 gs=4 cs=0 l=0 c_cookie=7341912409599098146 s_cookie=12448755615534270535 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65e3b66ffa2fbd22 server_cookie=acc2dd46a791c847 in_seq=0 out_seq=0 2026-02-24T09:19:55.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f98097fa640 1 -- 10.20.193.4:0/3742962664 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555aa980df00 con 0x555aa9922bb0 2026-02-24T09:19:55.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f98097fa640 10 client.27163 handle_command_reply: tid=0 2026-02-24T09:19:55.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 client.27163 shutdown 2026-02-24T09:19:55.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 -- 10.20.193.4:0/3742962664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 msgr2=0x555aa9918a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 0x555aa9918a90 secure :-1 s=READY pgs=122 gs=2 cs=0 l=1 c_cookie=13689941309167125944 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983000ee50 tx=0x7f9830004750 comp rx=0 tx=0).stop 2026-02-24T09:19:55.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 -- 10.20.193.4:0/3742962664 shutdown_connections 2026-02-24T09:19:55.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555aa9922bb0 0x555aa9923050 crc :-1 s=READY pgs=217 gs=4 cs=0 l=0 c_cookie=7341912409599098146 s_cookie=12448755615534270535 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa993d180 0x555aa991da80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 0x555aa9918a90 unknown :-1 s=CLOSED pgs=122 gs=2 cs=0 l=1 c_cookie=13689941309167125944 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f98097fa640 0 client.27163 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:55.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3742962664 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa9918550 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 -- 10.20.193.4:0/3742962664 >> 10.20.193.4:0/3742962664 conn(0x555aa9815880 msgr2=0x555aa98f6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:55.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 -- 10.20.193.4:0/3742962664 shutdown_connections 2026-02-24T09:19:55.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.924+0000 7f984f8bee00 1 -- 10.20.193.4:0/3742962664 wait complete. 2026-02-24T09:19:55.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.925+0000 7f984f8bee00 20 client.27163 trim_cache size 0 max 16384 2026-02-24T09:19:55.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f984f8bee00 1 Processor -- start 2026-02-24T09:19:55.942 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f984f8bee00 1 -- start start 2026-02-24T09:19:55.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f7bd0 0x555aa993ca20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f84e0 0x555aa98f6dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 0x555aa98f7300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f984f8bee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555aa97fa9e0 con 0x555aa98f84e0 2026-02-24T09:19:55.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f984f8bee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555aa94b2ec0 con 0x555aa9922bb0 2026-02-24T09:19:55.944 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f984f8bee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555aa986b290 con 0x555aa98f7bd0 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f98467fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f84e0 0x555aa98f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f9846ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f7bd0 0x555aa993ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f98467fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f84e0 0x555aa98f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52454/0 (socket says 10.20.193.4:52454) 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f98467fc640 1 -- 10.20.193.4:0/872871875 learned_addr learned my addr 10.20.193.4:0/872871875 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.939+0000 7f98477fe640 1 --2- 10.20.193.4:0/872871875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 0x555aa98f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.940+0000 7f98467fc640 1 -- 10.20.193.4:0/872871875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f7bd0 msgr2=0x555aa993ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.940+0000 7f98467fc640 1 --2- 10.20.193.4:0/872871875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f7bd0 0x555aa993ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.940+0000 7f98467fc640 1 -- 10.20.193.4:0/872871875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 msgr2=0x555aa98f7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.940+0000 7f98467fc640 1 --2- 10.20.193.4:0/872871875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 0x555aa98f7300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.940+0000 7f98467fc640 1 -- 10.20.193.4:0/872871875 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa9902530 con 0x555aa98f84e0 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.940+0000 7f98477fe640 1 --2- 10.20.193.4:0/872871875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 0x555aa98f7300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:19:55.945 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.940+0000 7f98467fc640 1 --2- 10.20.193.4:0/872871875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f84e0 0x555aa98f6dc0 secure :-1 s=READY pgs=1276 gs=1 cs=0 l=1 c_cookie=16844800021622946402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983002d760 tx=0x7f983002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c4c05f4153fa62 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:55.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.940+0000 7f980b7fe640 1 -- 10.20.193.4:0/872871875 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f983001f070 con 0x555aa98f84e0 2026-02-24T09:19:55.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.940+0000 7f980b7fe640 1 -- 10.20.193.4:0/872871875 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9830031020 con 0x555aa98f84e0 2026-02-24T09:19:55.946 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.940+0000 7f980b7fe640 1 -- 10.20.193.4:0/872871875 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9830004ce0 con 0x555aa98f84e0 2026-02-24T09:19:55.948 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.941+0000 7f984f8bee00 1 -- 10.20.193.4:0/872871875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f84e0 msgr2=0x555aa98f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:55.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.941+0000 7f984f8bee00 1 --2- 10.20.193.4:0/872871875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f84e0 0x555aa98f6dc0 secure :-1 s=READY pgs=1276 gs=1 cs=0 l=1 c_cookie=16844800021622946402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983002d760 tx=0x7f983002b000 comp rx=0 tx=0).stop 2026-02-24T09:19:55.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.941+0000 7f984f8bee00 1 -- 10.20.193.4:0/872871875 shutdown_connections 2026-02-24T09:19:55.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.941+0000 7f984f8bee00 1 --2- 10.20.193.4:0/872871875 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 0x555aa98f7300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.941+0000 7f984f8bee00 1 --2- 10.20.193.4:0/872871875 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f84e0 0x555aa98f6dc0 unknown :-1 s=CLOSED pgs=1276 gs=1 cs=0 l=1 c_cookie=16844800021622946402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.941+0000 7f984f8bee00 1 --2- 10.20.193.4:0/872871875 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f7bd0 0x555aa993ca20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.941+0000 7f984f8bee00 1 -- 10.20.193.4:0/872871875 >> 10.20.193.4:0/872871875 conn(0x555aa9815880 msgr2=0x555aa993c310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:55.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.941+0000 7f984f8bee00 1 -- 10.20.193.4:0/872871875 shutdown_connections 2026-02-24T09:19:55.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.941+0000 7f984f8bee00 1 -- 10.20.193.4:0/872871875 wait complete. 2026-02-24T09:19:55.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.942+0000 7f984f8bee00 1 -- start start 2026-02-24T09:19:55.949 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f984f8bee00 1 Processor -- start 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa9932d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 0x555aa99332d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f984f8bee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 0x555aa9991780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f984f8bee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555aa97fa9e0 con 0x555aa98f7bd0 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f984f8bee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555aa9991d40 con 0x555aa9922bb0 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f984f8bee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555aa9991f00 con 0x555aa98f84e0 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f9846ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa9932d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f9846ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa9932d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:52462/0 (socket says 10.20.193.4:52462) 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f9846ffd640 1 -- 10.20.193.4:0/3936653483 learned_addr learned my addr 10.20.193.4:0/3936653483 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f98467fc640 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 0x555aa99332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f98477fe640 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 0x555aa9991780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.950 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f9846ffd640 1 -- 10.20.193.4:0/3936653483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 msgr2=0x555aa99332d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f9846ffd640 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 0x555aa99332d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f9846ffd640 1 -- 10.20.193.4:0/3936653483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 msgr2=0x555aa9991780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f9846ffd640 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 0x555aa9991780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f9846ffd640 1 -- 10.20.193.4:0/3936653483 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa97805c0 con 0x555aa98f7bd0 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f98477fe640 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 0x555aa9991780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f9846ffd640 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa9932d70 secure :-1 s=READY pgs=1277 gs=1 cs=0 l=1 c_cookie=17506187086623379394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983c0551b0 tx=0x7f983c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f278674db78fc2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f98097fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f98097fa640 1 -- 10.20.193.4:0/3936653483 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f983c0042e0 con 0x555aa98f7bd0 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f984f8bee00 1 -- 10.20.193.4:0/3936653483 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9848152810 con 0x555aa98f7bd0 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f98097fa640 1 -- 10.20.193.4:0/3936653483 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f983c04a040 con 0x555aa98f7bd0 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f98097fa640 1 -- 10.20.193.4:0/3936653483 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f983c055a00 con 0x555aa98f7bd0 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f984f8bee00 10 client.18198 _ll_register_callbacks cb 0x555aa98fda50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:19:55.951 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.943+0000 7f984f8bee00 1 -- 10.20.193.4:0/3936653483 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555aa980fb70 con 0x555aa98f7bd0 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f98097fa640 1 -- 10.20.193.4:0/3936653483 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f983c055b90 con 0x555aa98f7bd0 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f98097fa640 1 -- 10.20.193.4:0/3936653483 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f983c055d50 con 0x555aa98f7bd0 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f984f8bee00 10 client.18198 fetch_fsmap learned FSMap version 19 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f984f8bee00 1 -- 10.20.193.4:0/3936653483 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x555aa9792500 con 0x555aa98f7bd0 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f98097fa640 1 -- 10.20.193.4:0/3936653483 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f983c05e470 con 0x555aa98f7bd0 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f984f8bee00 10 client.18198 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f984f8bee00 10 client.18198 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f984f8bee00 20 client.18198 populate_metadata read hostname 'trial004' 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555aa993d180 0x555aa9a13f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f984f8bee00 4 client.18198 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.2, "await_for": 45.0}] 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.944+0000 7f984f8bee00 1 -- 10.20.193.4:0/3936653483 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.2, "await_for": 45.0}) -- 0x555aa94d3a60 con 0x555aa993d180 2026-02-24T09:19:55.952 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.945+0000 7f98467fc640 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555aa993d180 0x555aa9a13f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:19:55.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.946+0000 7f98467fc640 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555aa993d180 0x555aa9a13f10 crc :-1 s=READY pgs=218 gs=4 cs=0 l=0 c_cookie=9332899271580626539 s_cookie=47059107297175782 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81851e708f10ae6b server_cookie=a730023de528e6 in_seq=0 out_seq=0 2026-02-24T09:19:55.953 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:55.946+0000 7f98097fa640 10 client.18198 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:56.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f98097fa640 1 -- 10.20.193.4:0/3936653483 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555aa94d3a60 con 0x555aa993d180 2026-02-24T09:19:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f98097fa640 10 client.18198 handle_command_reply: tid=0 2026-02-24T09:19:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f984f8bee00 1 client.18198 shutdown 2026-02-24T09:19:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f984f8bee00 1 -- 10.20.193.4:0/3936653483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 msgr2=0x555aa9932d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa9932d70 secure :-1 s=READY pgs=1277 gs=1 cs=0 l=1 c_cookie=17506187086623379394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983c0551b0 tx=0x7f983c005f90 comp rx=0 tx=0).stop 2026-02-24T09:19:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f984f8bee00 1 -- 10.20.193.4:0/3936653483 shutdown_connections 2026-02-24T09:19:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555aa993d180 0x555aa9a13f10 crc :-1 s=READY pgs=218 gs=4 cs=0 l=0 c_cookie=9332899271580626539 s_cookie=47059107297175782 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555aa9922bb0 0x555aa9991780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555aa98f84e0 0x555aa99332d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f984f8bee00 1 --2- 10.20.193.4:0/3936653483 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555aa98f7bd0 0x555aa9932d70 unknown :-1 s=CLOSED pgs=1277 gs=1 cs=0 l=1 c_cookie=17506187086623379394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:56.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.010+0000 7f98097fa640 0 client.18198 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:19:56.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.011+0000 7f984f8bee00 1 -- 10.20.193.4:0/3936653483 >> 10.20.193.4:0/3936653483 conn(0x555aa9815880 msgr2=0x555aa98f5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:56.016 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:55 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1368584493' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:19:56.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.011+0000 7f984f8bee00 1 -- 10.20.193.4:0/3936653483 shutdown_connections 2026-02-24T09:19:56.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.011+0000 7f984f8bee00 1 -- 10.20.193.4:0/3936653483 wait complete. 2026-02-24T09:19:56.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.011+0000 7f984f8bee00 20 client.18198 trim_cache size 0 max 16384 2026-02-24T09:19:56.017 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:19:56.017 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:19:56.017 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:19:56.017 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 38, 2026-02-24T09:19:56.017 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "4edec7bf": { 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "version": 38, 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 133.2, 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:19:56.018 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:19:56.019 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:19:56.019 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:19:56.019 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:19:56.019 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:56.019 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:56.019 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:56.019 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:56.019 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:19:56.019 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:19:56.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 -- 10.20.193.4:0/2987423587 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f981c0b5760 msgr2=0x7f981c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:56.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f981c0b5760 0x7f981c0d5c10 secure :-1 s=READY pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983c0097e0 tx=0x7f983c03a040 comp rx=0 tx=0).stop 2026-02-24T09:19:56.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 -- 10.20.193.4:0/2987423587 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9848155be0 msgr2=0x7f98481661e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:19:56.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9848155be0 0x7f98481661e0 secure :-1 s=READY pgs=1275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983800e950 tx=0x7f983800ee20 comp rx=0 tx=0).stop 2026-02-24T09:19:56.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 -- 10.20.193.4:0/2987423587 shutdown_connections 2026-02-24T09:19:56.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f981c0b5760 0x7f981c0d5c10 unknown :-1 s=CLOSED pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:56.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9848155be0 0x7f98481661e0 unknown :-1 s=CLOSED pgs=1275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:56.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f984810c7c0 0x7f9848160e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:56.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 --2- 10.20.193.4:0/2987423587 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f984810beb0 0x7f98481608d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:19:56.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 -- 10.20.193.4:0/2987423587 >> 10.20.193.4:0/2987423587 conn(0x7f98480e9b50 msgr2=0x7f9848109f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:19:56.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 -- 10.20.193.4:0/2987423587 shutdown_connections 2026-02-24T09:19:56.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:19:56.012+0000 7f984d8c4640 1 -- 10.20.193.4:0/2987423587 wait complete. 2026-02-24T09:19:56.065 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4edec7bf', quiesce took 1.2 seconds. Will release after: 12.0 2026-02-24T09:19:56.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:55 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1368584493' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:19:56.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:55 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1368584493' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:19:57.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:56 trial004 ceph-mon[41596]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 838 MiB/s wr, 231 op/s 2026-02-24T09:19:57.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:56 trial090 ceph-mon[47278]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 838 MiB/s wr, 231 op/s 2026-02-24T09:19:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:56 trial014 ceph-mon[46941]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 838 MiB/s wr, 231 op/s 2026-02-24T09:19:59.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:19:58 trial004 ceph-mon[41596]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 815 MiB/s wr, 225 op/s 2026-02-24T09:19:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:19:58 trial090 ceph-mon[47278]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 815 MiB/s wr, 225 op/s 2026-02-24T09:19:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:19:58 trial014 ceph-mon[46941]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 815 MiB/s wr, 225 op/s 2026-02-24T09:20:01.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:00 trial004 ceph-mon[41596]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 45 KiB/s rd, 687 MiB/s wr, 194 op/s 2026-02-24T09:20:01.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:00 trial004 ceph-mon[41596]: overall HEALTH_OK 2026-02-24T09:20:01.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:00 trial090 ceph-mon[47278]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 45 KiB/s rd, 687 MiB/s wr, 194 op/s 2026-02-24T09:20:01.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:00 trial090 ceph-mon[47278]: overall HEALTH_OK 2026-02-24T09:20:01.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:00 trial014 ceph-mon[46941]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 45 KiB/s rd, 687 MiB/s wr, 194 op/s 2026-02-24T09:20:01.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:00 trial014 ceph-mon[46941]: overall HEALTH_OK 2026-02-24T09:20:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:02 trial004 ceph-mon[41596]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 880 MiB/s wr, 252 op/s 2026-02-24T09:20:03.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:02 trial090 ceph-mon[47278]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 880 MiB/s wr, 252 op/s 2026-02-24T09:20:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:02 trial014 ceph-mon[46941]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 880 MiB/s wr, 252 op/s 2026-02-24T09:20:05.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:04 trial004 ceph-mon[41596]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 861 MiB/s wr, 350 op/s 2026-02-24T09:20:05.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:04 trial090 ceph-mon[47278]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 861 MiB/s wr, 350 op/s 2026-02-24T09:20:05.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:04 trial014 ceph-mon[46941]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 17 KiB/s rd, 861 MiB/s wr, 350 op/s 2026-02-24T09:20:07.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:06 trial004 ceph-mon[41596]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 878 MiB/s wr, 497 op/s 2026-02-24T09:20:07.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:06 trial090 ceph-mon[47278]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 878 MiB/s wr, 497 op/s 2026-02-24T09:20:07.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:06 trial014 ceph-mon[46941]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 878 MiB/s wr, 497 op/s 2026-02-24T09:20:07.682 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:20:07.804 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:07.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.908+0000 7f9664561640 1 -- 10.20.193.4:0/1666671145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f965c115840 msgr2=0x7f965c176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:07.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.908+0000 7f9664561640 1 --2- 10.20.193.4:0/1666671145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f965c115840 0x7f965c176210 secure :-1 s=READY pgs=1278 gs=1 cs=0 l=1 c_cookie=9623382844533858175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f965800aa30 tx=0x7f9658030280 comp rx=0 tx=0).stop 2026-02-24T09:20:07.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.908+0000 7f9664561640 1 -- 10.20.193.4:0/1666671145 shutdown_connections 2026-02-24T09:20:07.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.908+0000 7f9664561640 1 --2- 10.20.193.4:0/1666671145 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f965c115840 0x7f965c176210 unknown :-1 s=CLOSED pgs=1278 gs=1 cs=0 l=1 c_cookie=9623382844533858175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.908+0000 7f9664561640 1 --2- 10.20.193.4:0/1666671145 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965c110040 0x7f965c115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.908+0000 7f9664561640 1 --2- 10.20.193.4:0/1666671145 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965c10f650 0x7f965c10fa20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.908+0000 7f9664561640 1 -- 10.20.193.4:0/1666671145 >> 10.20.193.4:0/1666671145 conn(0x7f965c0ecf20 msgr2=0x7f965c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.908+0000 7f9664561640 1 -- 10.20.193.4:0/1666671145 shutdown_connections 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.908+0000 7f9664561640 1 -- 10.20.193.4:0/1666671145 wait complete. 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.908+0000 7f9664561640 1 Processor -- start 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9664561640 1 -- start start 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9664561640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965c10f650 0x7f965c11def0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9664561640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965c110040 0x7f965c11e430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9664561640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f965c115840 0x7f965c123800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9664561640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f965c123e20 con 0x7f965c115840 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9664561640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f965c123f90 con 0x7f965c10f650 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9664561640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f965c124150 con 0x7f965c110040 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9662ad7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f965c115840 0x7f965c123800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9662ad7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f965c115840 0x7f965c123800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39098/0 (socket says 10.20.193.4:39098) 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9662ad7640 1 -- 10.20.193.4:0/2643281167 learned_addr learned my addr 10.20.193.4:0/2643281167 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f96622d6640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965c10f650 0x7f965c11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9661ad5640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965c110040 0x7f965c11e430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9662ad7640 1 -- 10.20.193.4:0/2643281167 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965c110040 msgr2=0x7f965c11e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9662ad7640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965c110040 0x7f965c11e430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9662ad7640 1 -- 10.20.193.4:0/2643281167 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965c10f650 msgr2=0x7f965c11def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9662ad7640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965c10f650 0x7f965c11def0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9662ad7640 1 -- 10.20.193.4:0/2643281167 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965800a650 con 0x7f965c115840 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9661ad5640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965c110040 0x7f965c11e430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9662ad7640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f965c115840 0x7f965c123800 secure :-1 s=READY pgs=1279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f965800a330 tx=0x7f96580039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f96437fe640 1 -- 10.20.193.4:0/2643281167 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f965803e070 con 0x7f965c115840 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9664561640 1 -- 10.20.193.4:0/2643281167 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965c1243d0 con 0x7f965c115840 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f9664561640 1 -- 10.20.193.4:0/2643281167 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965c164b30 con 0x7f965c115840 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f96437fe640 1 -- 10.20.193.4:0/2643281167 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f96580055a0 con 0x7f965c115840 2026-02-24T09:20:07.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.909+0000 7f96437fe640 1 -- 10.20.193.4:0/2643281167 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9658042960 con 0x7f965c115840 2026-02-24T09:20:07.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.911+0000 7f96437fe640 1 -- 10.20.193.4:0/2643281167 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9658039b80 con 0x7f965c115840 2026-02-24T09:20:07.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.911+0000 7f96437fe640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96380b5760 0x7f96380d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.912+0000 7f96622d6640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96380b5760 0x7f96380d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.912+0000 7f96437fe640 1 -- 10.20.193.4:0/2643281167 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f965810c850 con 0x7f965c115840 2026-02-24T09:20:07.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.912+0000 7f96622d6640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96380b5760 0x7f96380d5c10 secure :-1 s=READY pgs=451 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964c004740 tx=0x7f964c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f966655be00 1 Processor -- start 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f966655be00 1 -- start start 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f966655be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc0820 0x55b4efbc0bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f966655be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efbc1130 0x55b4efc05890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f966655be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efc05dd0 0x55b4efc261b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f966655be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b4efad0de0 con 0x55b4efc05dd0 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f966655be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b4efaccb10 con 0x55b4efbc1130 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f966655be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b4efac6ab0 con 0x55b4efbc0820 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9662ad7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efc05dd0 0x55b4efc261b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9662ad7640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efc05dd0 0x55b4efc261b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39106/0 (socket says 10.20.193.4:39106) 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9662ad7640 1 -- 10.20.193.4:0/1239887620 learned_addr learned my addr 10.20.193.4:0/1239887620 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f96622d6640 1 --2- 10.20.193.4:0/1239887620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc0820 0x55b4efbc0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9661ad5640 1 --2- 10.20.193.4:0/1239887620 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efbc1130 0x55b4efc05890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9662ad7640 1 -- 10.20.193.4:0/1239887620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc0820 msgr2=0x55b4efbc0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:07.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9662ad7640 1 --2- 10.20.193.4:0/1239887620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc0820 0x55b4efbc0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9662ad7640 1 -- 10.20.193.4:0/1239887620 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efbc1130 msgr2=0x55b4efc05890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9662ad7640 1 --2- 10.20.193.4:0/1239887620 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efbc1130 0x55b4efc05890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9662ad7640 1 -- 10.20.193.4:0/1239887620 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4efa72310 con 0x55b4efc05dd0 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9662ad7640 1 --2- 10.20.193.4:0/1239887620 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efc05dd0 0x55b4efc261b0 secure :-1 s=READY pgs=1280 gs=2 cs=0 l=1 c_cookie=8797167186888901394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96580ceaf0 tx=0x7f9658039f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a15d0f2743c4312 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9640b0a640 1 -- 10.20.193.4:0/1239887620 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96580d3580 con 0x55b4efc05dd0 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9640b0a640 1 -- 10.20.193.4:0/1239887620 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f96580d88a0 con 0x55b4efc05dd0 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f9640b0a640 1 -- 10.20.193.4:0/1239887620 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96580d3810 con 0x55b4efc05dd0 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f966655be00 1 -- 10.20.193.4:0/1239887620 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efc05dd0 msgr2=0x55b4efc261b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.913+0000 7f966655be00 1 --2- 10.20.193.4:0/1239887620 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efc05dd0 0x55b4efc261b0 secure :-1 s=READY pgs=1280 gs=2 cs=0 l=1 c_cookie=8797167186888901394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96580ceaf0 tx=0x7f9658039f20 comp rx=0 tx=0).stop 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 -- 10.20.193.4:0/1239887620 shutdown_connections 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 --2- 10.20.193.4:0/1239887620 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efc05dd0 0x55b4efc261b0 unknown :-1 s=CLOSED pgs=1280 gs=2 cs=0 l=1 c_cookie=8797167186888901394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 --2- 10.20.193.4:0/1239887620 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efbc1130 0x55b4efc05890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 --2- 10.20.193.4:0/1239887620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc0820 0x55b4efbc0bf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 -- 10.20.193.4:0/1239887620 >> 10.20.193.4:0/1239887620 conn(0x55b4efadf6b0 msgr2=0x55b4efbbf100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 -- 10.20.193.4:0/1239887620 shutdown_connections 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 -- 10.20.193.4:0/1239887620 wait complete. 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 -- start start 2026-02-24T09:20:07.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 Processor -- start 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbd8b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.914+0000 7f966655be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbd90d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f966655be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbde0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f966655be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b4efbde600 con 0x55b4efbc0820 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f966655be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b4efbde770 con 0x55b4efc05dd0 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f966655be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b4efbde930 con 0x55b4efbc1130 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f96622d6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbd8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f96622d6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbd8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39118/0 (socket says 10.20.193.4:39118) 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f96622d6640 1 -- 10.20.193.4:0/181510215 learned_addr learned my addr 10.20.193.4:0/181510215 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f9661ad5640 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbd90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f9662ad7640 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbde0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f96622d6640 1 -- 10.20.193.4:0/181510215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 msgr2=0x55b4efbd90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f96622d6640 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbd90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f96622d6640 1 -- 10.20.193.4:0/181510215 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 msgr2=0x55b4efbde0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f96622d6640 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbde0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f96622d6640 1 -- 10.20.193.4:0/181510215 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4efa4a8c0 con 0x55b4efbc0820 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f96622d6640 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbd8b90 secure :-1 s=READY pgs=1281 gs=1 cs=0 l=1 c_cookie=8493371516326753624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964c003010 tx=0x7f964c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75de8464f013b558 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f960ffff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f960ffff640 1 -- 10.20.193.4:0/181510215 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f964c022070 con 0x55b4efbc0820 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f960ffff640 1 -- 10.20.193.4:0/181510215 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f964c01db80 con 0x55b4efbc0820 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f960ffff640 1 -- 10.20.193.4:0/181510215 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f964c01ada0 con 0x55b4efbc0820 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f966655be00 1 -- 10.20.193.4:0/181510215 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965c164b30 con 0x55b4efbc0820 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f960ffff640 1 -- 10.20.193.4:0/181510215 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f964c01c3e0 con 0x55b4efbc0820 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f960ffff640 10 client.18210 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f966655be00 10 client.18210 _ll_register_callbacks cb 0x55b4efa62160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f966655be00 1 -- 10.20.193.4:0/181510215 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4ef8164a0 con 0x55b4efbc0820 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f960ffff640 1 -- 10.20.193.4:0/181510215 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f964c01dcf0 con 0x55b4efbc0820 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f966655be00 10 client.18210 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.915+0000 7f966655be00 1 -- 10.20.193.4:0/181510215 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55b4efa5c6e0 con 0x55b4efbc0820 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.916+0000 7f960ffff640 1 -- 10.20.193.4:0/181510215 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f964c01d6a0 con 0x55b4efbc0820 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.916+0000 7f966655be00 10 client.18210 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.916+0000 7f966655be00 10 client.18210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.916+0000 7f966655be00 20 client.18210 populate_metadata read hostname 'trial004' 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.916+0000 7f966655be00 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b4efc03420 0x55b4efc038c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.916+0000 7f966655be00 4 client.18210 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.916+0000 7f966655be00 1 -- 10.20.193.4:0/181510215 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4efabc4f0 con 0x55b4efc03420 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.916+0000 7f9661ad5640 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b4efc03420 0x55b4efc038c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.916+0000 7f9661ad5640 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b4efc03420 0x55b4efc038c0 crc :-1 s=READY pgs=219 gs=4 cs=0 l=0 c_cookie=3950154265584001261 s_cookie=2612426467152857383 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36d1c4603020e0ed server_cookie=24413407d8798927 in_seq=0 out_seq=0 2026-02-24T09:20:07.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.916+0000 7f960ffff640 10 client.18210 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f960ffff640 1 -- 10.20.193.4:0/181510215 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55b4efabc4f0 con 0x55b4efc03420 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f960ffff640 10 client.18210 handle_command_reply: tid=0 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 client.18210 shutdown 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 -- 10.20.193.4:0/181510215 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 msgr2=0x55b4efbd8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbd8b90 secure :-1 s=READY pgs=1281 gs=1 cs=0 l=1 c_cookie=8493371516326753624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964c003010 tx=0x7f964c0047e0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 -- 10.20.193.4:0/181510215 shutdown_connections 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b4efc03420 0x55b4efc038c0 crc :-1 s=READY pgs=219 gs=4 cs=0 l=0 c_cookie=3950154265584001261 s_cookie=2612426467152857383 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbde0c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbd90d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f960ffff640 0 client.18210 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 --2- 10.20.193.4:0/181510215 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbd8b90 unknown :-1 s=CLOSED pgs=1281 gs=1 cs=0 l=1 c_cookie=8493371516326753624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 -- 10.20.193.4:0/181510215 >> 10.20.193.4:0/181510215 conn(0x55b4efadf6b0 msgr2=0x55b4efbbf810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 -- 10.20.193.4:0/181510215 shutdown_connections 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 1 -- 10.20.193.4:0/181510215 wait complete. 2026-02-24T09:20:07.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.917+0000 7f966655be00 20 client.18210 trim_cache size 0 max 16384 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.925+0000 7f966655be00 1 Processor -- start 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 -- start start 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbdd630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbfe4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbfea30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b4efbd92a0 con 0x55b4efbc0820 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b4efbde4c0 con 0x55b4efc05dd0 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b4efac46e0 con 0x55b4efbc1130 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f96622d6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbdd630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f96622d6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbdd630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39128/0 (socket says 10.20.193.4:39128) 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f96622d6640 1 -- 10.20.193.4:0/2094986502 learned_addr learned my addr 10.20.193.4:0/2094986502 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f9661ad5640 1 --2- 10.20.193.4:0/2094986502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbfe4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f9662ad7640 1 --2- 10.20.193.4:0/2094986502 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbfea30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f96622d6640 1 -- 10.20.193.4:0/2094986502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 msgr2=0x55b4efbfe4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f96622d6640 1 --2- 10.20.193.4:0/2094986502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbfe4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f96622d6640 1 -- 10.20.193.4:0/2094986502 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 msgr2=0x55b4efbfea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f96622d6640 1 --2- 10.20.193.4:0/2094986502 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbfea30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f96622d6640 1 -- 10.20.193.4:0/2094986502 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4efbc63b0 con 0x55b4efbc0820 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f96622d6640 1 --2- 10.20.193.4:0/2094986502 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbdd630 secure :-1 s=READY pgs=1282 gs=1 cs=0 l=1 c_cookie=1788932594532226729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964c002fe0 tx=0x7f964c02b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d390b7703616a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f962a4e6640 1 -- 10.20.193.4:0/2094986502 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f964c022050 con 0x55b4efbc0820 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f962a4e6640 1 -- 10.20.193.4:0/2094986502 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55b4ef8164a0 con 0x55b4efbc0820 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f962a4e6640 1 -- 10.20.193.4:0/2094986502 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f964c028d00 con 0x55b4efbc0820 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 -- 10.20.193.4:0/2094986502 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 msgr2=0x55b4efbdd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 --2- 10.20.193.4:0/2094986502 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbdd630 secure :-1 s=READY pgs=1282 gs=1 cs=0 l=1 c_cookie=1788932594532226729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964c002fe0 tx=0x7f964c02b000 comp rx=0 tx=0).stop 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 -- 10.20.193.4:0/2094986502 shutdown_connections 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 --2- 10.20.193.4:0/2094986502 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbfea30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 --2- 10.20.193.4:0/2094986502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbfe4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 --2- 10.20.193.4:0/2094986502 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbdd630 unknown :-1 s=CLOSED pgs=1282 gs=1 cs=0 l=1 c_cookie=1788932594532226729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 -- 10.20.193.4:0/2094986502 >> 10.20.193.4:0/2094986502 conn(0x55b4efadf6b0 msgr2=0x55b4efbdcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 -- 10.20.193.4:0/2094986502 shutdown_connections 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.926+0000 7f966655be00 1 -- 10.20.193.4:0/2094986502 wait complete. 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f966655be00 1 -- start start 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f966655be00 1 Processor -- start 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f966655be00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbe49e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f966655be00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbdeed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f966655be00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbdf410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f966655be00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55b4efaccb10 con 0x55b4efbc0820 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f966655be00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55b4efbc6270 con 0x55b4efc05dd0 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f966655be00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55b4efbe5210 con 0x55b4efbc1130 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f96622d6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbe49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f96622d6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbe49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39144/0 (socket says 10.20.193.4:39144) 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f96622d6640 1 -- 10.20.193.4:0/766551306 learned_addr learned my addr 10.20.193.4:0/766551306 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f9661ad5640 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbdeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f9662ad7640 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbdf410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f96622d6640 1 -- 10.20.193.4:0/766551306 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 msgr2=0x55b4efbdeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f96622d6640 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbdeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f96622d6640 1 -- 10.20.193.4:0/766551306 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 msgr2=0x55b4efbdf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f96622d6640 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbdf410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f96622d6640 1 -- 10.20.193.4:0/766551306 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4efa57160 con 0x55b4efbc0820 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f9662ad7640 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbdf410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f96622d6640 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbe49e0 secure :-1 s=READY pgs=1283 gs=1 cs=0 l=1 c_cookie=16677568522001411970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964c01d040 tx=0x7f964c0289a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e772a0358f216f82 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.927+0000 7f960ffff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f960ffff640 1 -- 10.20.193.4:0/766551306 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f964c022050 con 0x55b4efbc0820 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 1 -- 10.20.193.4:0/766551306 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4efa5c6e0 con 0x55b4efbc0820 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f960ffff640 1 -- 10.20.193.4:0/766551306 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f964c028e90 con 0x55b4efbc0820 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f960ffff640 1 -- 10.20.193.4:0/766551306 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f964c0326a0 con 0x55b4efbc0820 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 10 client.18216 _ll_register_callbacks cb 0x55b4efa62160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:07.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 1 -- 10.20.193.4:0/766551306 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96580d88a0 con 0x55b4efbc0820 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f960ffff640 1 -- 10.20.193.4:0/766551306 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f964c032830 con 0x55b4efbc0820 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f960ffff640 1 -- 10.20.193.4:0/766551306 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f964c032a10 con 0x55b4efbc0820 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 10 client.18216 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 1 -- 10.20.193.4:0/766551306 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55b4efa4abf0 con 0x55b4efbc0820 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f960ffff640 1 -- 10.20.193.4:0/766551306 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f964c03b070 con 0x55b4efbc0820 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 10 client.18216 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 10 client.18216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 20 client.18216 populate_metadata read hostname 'trial004' 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b4efcb35d0 0x55b4efcd3a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 4 client.18216 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f966655be00 1 -- 10.20.193.4:0/766551306 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b4ef7fb160 con 0x55b4efcb35d0 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.928+0000 7f9661ad5640 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b4efcb35d0 0x55b4efcd3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f9661ad5640 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b4efcb35d0 0x55b4efcd3a80 crc :-1 s=READY pgs=220 gs=4 cs=0 l=0 c_cookie=14042071725918120509 s_cookie=14389913824784255913 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2df75d62de7ea3d server_cookie=c7b33e61f2bf8ba9 in_seq=0 out_seq=0 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f960ffff640 10 client.18216 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f960ffff640 1 -- 10.20.193.4:0/766551306 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x55b4ef7fb160 con 0x55b4efcb35d0 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f960ffff640 10 client.18216 handle_command_reply: tid=0 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 client.18216 shutdown 2026-02-24T09:20:07.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 -- 10.20.193.4:0/766551306 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 msgr2=0x55b4efbe49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbe49e0 secure :-1 s=READY pgs=1283 gs=1 cs=0 l=1 c_cookie=16677568522001411970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964c01d040 tx=0x7f964c0289a0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 -- 10.20.193.4:0/766551306 shutdown_connections 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55b4efcb35d0 0x55b4efcd3a80 crc :-1 s=READY pgs=220 gs=4 cs=0 l=0 c_cookie=14042071725918120509 s_cookie=14389913824784255913 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55b4efc05dd0 0x55b4efbdf410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55b4efbc1130 0x55b4efbdeed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 --2- 10.20.193.4:0/766551306 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55b4efbc0820 0x55b4efbe49e0 unknown :-1 s=CLOSED pgs=1283 gs=1 cs=0 l=1 c_cookie=16677568522001411970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f960ffff640 0 client.18216 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 -- 10.20.193.4:0/766551306 >> 10.20.193.4:0/766551306 conn(0x55b4efadf6b0 msgr2=0x55b4efc04990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 -- 10.20.193.4:0/766551306 shutdown_connections 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 1 -- 10.20.193.4:0/766551306 wait complete. 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.929+0000 7f966655be00 20 client.18216 trim_cache size 0 max 16384 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stdout: "50fcb56c-a674-4f78-aafd-69881ffc04d0": { 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:02.417630+0000", 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.933 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "b703ea3c-d980-4a3f-b2c3-714d8f9ad80d": { 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:58.321748+0000", 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.934 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.935 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "02c4bb30-7b42-4907-8bbf-d28c355c477b": { 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:36.960639+0000", 2026-02-24T09:20:07.936 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 -- 10.20.193.4:0/2643281167 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96380b5760 msgr2=0x7f96380d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96380b5760 0x7f96380d5c10 secure :-1 s=READY pgs=451 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964c004740 tx=0x7f964c005f90 comp rx=0 tx=0).stop 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 -- 10.20.193.4:0/2643281167 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f965c115840 msgr2=0x7f965c123800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f965c115840 0x7f965c123800 secure :-1 s=READY pgs=1279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f965800a330 tx=0x7f96580039b0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 -- 10.20.193.4:0/2643281167 shutdown_connections 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96380b5760 0x7f96380d5c10 unknown :-1 s=CLOSED pgs=451 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f965c115840 0x7f965c123800 unknown :-1 s=CLOSED pgs=1279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965c110040 0x7f965c11e430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 --2- 10.20.193.4:0/2643281167 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965c10f650 0x7f965c11def0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 -- 10.20.193.4:0/2643281167 >> 10.20.193.4:0/2643281167 conn(0x7f965c0ecf20 msgr2=0x7f965c10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 -- 10.20.193.4:0/2643281167 shutdown_connections 2026-02-24T09:20:07.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:07.930+0000 7f9664561640 1 -- 10.20.193.4:0/2643281167 wait complete. 2026-02-24T09:20:07.968 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:20:07.968 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:20:08.066 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:20:08.084 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:08.181 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:08.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.195+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2582146399 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4c010f280 msgr2=0x7fd4c010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.195+0000 7fd4c59b4640 1 --2- 10.20.193.4:0/2582146399 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4c010f280 0x7fd4c010f650 secure :-1 s=READY pgs=1284 gs=1 cs=0 l=1 c_cookie=16803726193511209382 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b4009950 tx=0x7fd4b402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.198 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.195+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2582146399 shutdown_connections 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.195+0000 7fd4c59b4640 1 --2- 10.20.193.4:0/2582146399 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4c0115470 0x7fd4c0175e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.195+0000 7fd4c59b4640 1 --2- 10.20.193.4:0/2582146399 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4c010fc70 0x7fd4c0114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.195+0000 7fd4c59b4640 1 --2- 10.20.193.4:0/2582146399 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4c010f280 0x7fd4c010f650 unknown :-1 s=CLOSED pgs=1284 gs=1 cs=0 l=1 c_cookie=16803726193511209382 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.195+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2582146399 >> 10.20.193.4:0/2582146399 conn(0x7fd4c005f830 msgr2=0x7fd4c010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.195+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2582146399 shutdown_connections 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.195+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2582146399 wait complete. 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c59b4640 1 Processor -- start 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c59b4640 1 -- start start 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c59b4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4c010f280 0x7fd4c011dbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c59b4640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4c010fc70 0x7fd4c011e0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c59b4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4c0115470 0x7fd4c01234c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c59b4640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c0123ae0 con 0x7fd4c010f280 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c59b4640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c0123c50 con 0x7fd4c010fc70 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c59b4640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c0123e10 con 0x7fd4c0115470 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4beffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4c010f280 0x7fd4c011dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4beffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4c010f280 0x7fd4c011dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39168/0 (socket says 10.20.193.4:39168) 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4beffd640 1 -- 10.20.193.4:0/2705677322 learned_addr learned my addr 10.20.193.4:0/2705677322 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.199 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4be7fc640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4c010fc70 0x7fd4c011e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4bf7fe640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4c0115470 0x7fd4c01234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4beffd640 1 -- 10.20.193.4:0/2705677322 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4c0115470 msgr2=0x7fd4c01234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4beffd640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4c0115470 0x7fd4c01234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4beffd640 1 -- 10.20.193.4:0/2705677322 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4c010fc70 msgr2=0x7fd4c011e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4beffd640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4c010fc70 0x7fd4c011e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4beffd640 1 -- 10.20.193.4:0/2705677322 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b4009570 con 0x7fd4c010f280 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4bf7fe640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4c0115470 0x7fd4c01234c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4be7fc640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4c010fc70 0x7fd4c011e0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4beffd640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4c010f280 0x7fd4c011dbb0 secure :-1 s=READY pgs=1285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b40023d0 tx=0x7fd4b40043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c49b2640 1 -- 10.20.193.4:0/2705677322 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4b403d070 con 0x7fd4c010f280 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2705677322 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c0124090 con 0x7fd4c010f280 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c49b2640 1 -- 10.20.193.4:0/2705677322 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd4b4038920 con 0x7fd4c010f280 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.196+0000 7fd4c49b2640 1 -- 10.20.193.4:0/2705677322 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd4b40419d0 con 0x7fd4c010f280 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.197+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2705677322 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c01647f0 con 0x7fd4c010f280 2026-02-24T09:20:08.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.197+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2705677322 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c0110560 con 0x7fd4c010f280 2026-02-24T09:20:08.201 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.198+0000 7fd4c49b2640 1 -- 10.20.193.4:0/2705677322 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fd4b4038a90 con 0x7fd4c010f280 2026-02-24T09:20:08.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.199+0000 7fd4c49b2640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4940b56e0 0x7fd4940d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.199+0000 7fd4be7fc640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4940b56e0 0x7fd4940d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.199+0000 7fd4c49b2640 1 -- 10.20.193.4:0/2705677322 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd4b410b950 con 0x7fd4c010f280 2026-02-24T09:20:08.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.199+0000 7fd4be7fc640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4940b56e0 0x7fd4940d5b90 secure :-1 s=READY pgs=452 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4c0124550 tx=0x7fd4a8004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.200+0000 7fd4c49b2640 1 -- 10.20.193.4:0/2705677322 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fd4b40ce3a0 con 0x7fd4c010f280 2026-02-24T09:20:08.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.283+0000 7fe06a943640 1 -- 10.20.193.4:0/1607687505 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0640618c0 msgr2=0x7fe064155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.283+0000 7fe06a943640 1 --2- 10.20.193.4:0/1607687505 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0640618c0 0x7fe064155210 secure :-1 s=READY pgs=1286 gs=1 cs=0 l=1 c_cookie=6312232270349797797 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe054009950 tx=0x7fe05402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.283+0000 7fe06a943640 1 -- 10.20.193.4:0/1607687505 shutdown_connections 2026-02-24T09:20:08.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.283+0000 7fe06a943640 1 --2- 10.20.193.4:0/1607687505 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe064155750 0x7fe064175b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.283+0000 7fe06a943640 1 --2- 10.20.193.4:0/1607687505 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe0640618c0 0x7fe064155210 unknown :-1 s=CLOSED pgs=1286 gs=1 cs=0 l=1 c_cookie=6312232270349797797 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.283+0000 7fe06a943640 1 --2- 10.20.193.4:0/1607687505 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe064060fb0 0x7fe064061380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.283+0000 7fe06a943640 1 -- 10.20.193.4:0/1607687505 >> 10.20.193.4:0/1607687505 conn(0x7fe06405f830 msgr2=0x7fe06410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.283+0000 7fe06a943640 1 -- 10.20.193.4:0/1607687505 shutdown_connections 2026-02-24T09:20:08.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.283+0000 7fe06a943640 1 -- 10.20.193.4:0/1607687505 wait complete. 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe06a943640 1 Processor -- start 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe06a943640 1 -- start start 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe06a943640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe064060fb0 0x7fe064161f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe06a943640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0640618c0 0x7fe064162440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe06a943640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe064155750 0x7fe064167810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe06a943640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe064167e30 con 0x7fe064155750 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe06a943640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe064167fa0 con 0x7fe0640618c0 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe06a943640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe064168160 con 0x7fe064060fb0 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe068eb9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe064155750 0x7fe064167810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe068eb9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe064155750 0x7fe064167810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39184/0 (socket says 10.20.193.4:39184) 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe068eb9640 1 -- 10.20.193.4:0/4161046204 learned_addr learned my addr 10.20.193.4:0/4161046204 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe063fff640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe064060fb0 0x7fe064161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe0637fe640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0640618c0 0x7fe064162440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe068eb9640 1 -- 10.20.193.4:0/4161046204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe064060fb0 msgr2=0x7fe064161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe068eb9640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe064060fb0 0x7fe064161f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe068eb9640 1 -- 10.20.193.4:0/4161046204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0640618c0 msgr2=0x7fe064162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe068eb9640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0640618c0 0x7fe064162440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe068eb9640 1 -- 10.20.193.4:0/4161046204 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe054009570 con 0x7fe064155750 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe0637fe640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0640618c0 0x7fe064162440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe068eb9640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe064155750 0x7fe064167810 secure :-1 s=READY pgs=1287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe058006e90 tx=0x7fe05800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe0617fa640 1 -- 10.20.193.4:0/4161046204 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe058005500 con 0x7fe064155750 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe06a943640 1 -- 10.20.193.4:0/4161046204 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe064168440 con 0x7fe064155750 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe0617fa640 1 -- 10.20.193.4:0/4161046204 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe058005e10 con 0x7fe064155750 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe0617fa640 1 -- 10.20.193.4:0/4161046204 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe058003a90 con 0x7fe064155750 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.284+0000 7fe06a943640 1 -- 10.20.193.4:0/4161046204 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe064151370 con 0x7fe064155750 2026-02-24T09:20:08.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.285+0000 7fe06a943640 1 -- 10.20.193.4:0/4161046204 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe064168660 con 0x7fe064155750 2026-02-24T09:20:08.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.286+0000 7fe0617fa640 1 -- 10.20.193.4:0/4161046204 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fe05800c840 con 0x7fe064155750 2026-02-24T09:20:08.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.287+0000 7fe0617fa640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0380b56e0 0x7fe0380d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.287+0000 7fe0617fa640 1 -- 10.20.193.4:0/4161046204 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe0580e7d50 con 0x7fe064155750 2026-02-24T09:20:08.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.287+0000 7fe063fff640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0380b56e0 0x7fe0380d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.287+0000 7fe063fff640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0380b56e0 0x7fe0380d5b90 secure :-1 s=READY pgs=453 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe050004740 tx=0x7fe050004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.287+0000 7fe0617fa640 1 -- 10.20.193.4:0/4161046204 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe0580aa710 con 0x7fe064155750 2026-02-24T09:20:08.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.338+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2705677322 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4c010f650 con 0x7fd4c010f280 2026-02-24T09:20:08.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.339+0000 7fd4c49b2640 1 -- 10.20.193.4:0/2705677322 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fd4b40d14c0 con 0x7fd4c010f280 2026-02-24T09:20:08.342 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:20:08.342 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:20:08.342 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2705677322 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4940b56e0 msgr2=0x7fd4940d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4940b56e0 0x7fd4940d5b90 secure :-1 s=READY pgs=452 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4c0124550 tx=0x7fd4a8004420 comp rx=0 tx=0).stop 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2705677322 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4c010f280 msgr2=0x7fd4c011dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4c010f280 0x7fd4c011dbb0 secure :-1 s=READY pgs=1285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b40023d0 tx=0x7fd4b40043d0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2705677322 shutdown_connections 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd4940b56e0 0x7fd4940d5b90 unknown :-1 s=CLOSED pgs=452 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd4c0115470 0x7fd4c01234c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd4c010fc70 0x7fd4c011e0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 --2- 10.20.193.4:0/2705677322 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd4c010f280 0x7fd4c011dbb0 unknown :-1 s=CLOSED pgs=1285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2705677322 >> 10.20.193.4:0/2705677322 conn(0x7fd4c005f830 msgr2=0x7fd4c010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2705677322 shutdown_connections 2026-02-24T09:20:08.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.341+0000 7fd4c59b4640 1 -- 10.20.193.4:0/2705677322 wait complete. 2026-02-24T09:20:08.380 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:20:08.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.425+0000 7fe06a943640 1 -- 10.20.193.4:0/4161046204 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe064163060 con 0x7fe064155750 2026-02-24T09:20:08.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.426+0000 7fe0617fa640 1 -- 10.20.193.4:0/4161046204 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fe0580ad8c0 con 0x7fe064155750 2026-02-24T09:20:08.429 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:20:08.429 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:20:08.429 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:20:08.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 -- 10.20.193.4:0/4161046204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0380b56e0 msgr2=0x7fe0380d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0380b56e0 0x7fe0380d5b90 secure :-1 s=READY pgs=453 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe050004740 tx=0x7fe050004420 comp rx=0 tx=0).stop 2026-02-24T09:20:08.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 -- 10.20.193.4:0/4161046204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe064155750 msgr2=0x7fe064167810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe064155750 0x7fe064167810 secure :-1 s=READY pgs=1287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe058006e90 tx=0x7fe05800edf0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 -- 10.20.193.4:0/4161046204 shutdown_connections 2026-02-24T09:20:08.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe0380b56e0 0x7fe0380d5b90 unknown :-1 s=CLOSED pgs=453 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe064155750 0x7fe064167810 unknown :-1 s=CLOSED pgs=1287 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe0640618c0 0x7fe064162440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 --2- 10.20.193.4:0/4161046204 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe064060fb0 0x7fe064161f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 -- 10.20.193.4:0/4161046204 >> 10.20.193.4:0/4161046204 conn(0x7fe06405f830 msgr2=0x7fe06410ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 -- 10.20.193.4:0/4161046204 shutdown_connections 2026-02-24T09:20:08.432 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.428+0000 7fe06a943640 1 -- 10.20.193.4:0/4161046204 wait complete. 2026-02-24T09:20:08.469 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id 4edec7bf --release --await' 2026-02-24T09:20:08.469 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id 4edec7bf --release --await 2026-02-24T09:20:08.536 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:08.627 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:08.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.639+0000 7fac66d6b640 1 -- 10.20.193.4:0/2756843197 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fac601135c0 msgr2=0x7fac60173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.639+0000 7fac66d6b640 1 --2- 10.20.193.4:0/2756843197 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fac601135c0 0x7fac60173f90 secure :-1 s=READY pgs=1288 gs=1 cs=0 l=1 c_cookie=4781231325232222041 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c00aa30 tx=0x7fac5c030280 comp rx=0 tx=0).stop 2026-02-24T09:20:08.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.639+0000 7fac66d6b640 1 -- 10.20.193.4:0/2756843197 shutdown_connections 2026-02-24T09:20:08.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.639+0000 7fac66d6b640 1 --2- 10.20.193.4:0/2756843197 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fac601135c0 0x7fac60173f90 unknown :-1 s=CLOSED pgs=1288 gs=1 cs=0 l=1 c_cookie=4781231325232222041 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.639+0000 7fac66d6b640 1 --2- 10.20.193.4:0/2756843197 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fac6010ddc0 0x7fac60112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.639+0000 7fac66d6b640 1 --2- 10.20.193.4:0/2756843197 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac6010d3d0 0x7fac6010d7a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.639+0000 7fac66d6b640 1 -- 10.20.193.4:0/2756843197 >> 10.20.193.4:0/2756843197 conn(0x7fac600eaca0 msgr2=0x7fac6010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.639+0000 7fac66d6b640 1 -- 10.20.193.4:0/2756843197 shutdown_connections 2026-02-24T09:20:08.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.639+0000 7fac66d6b640 1 -- 10.20.193.4:0/2756843197 wait complete. 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac66d6b640 1 Processor -- start 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac66d6b640 1 -- start start 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac66d6b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fac6010d3d0 0x7fac600f58a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac66d6b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac6010ddc0 0x7fac60173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac66d6b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fac601135c0 0x7fac600f5fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac66d6b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fac600fb110 con 0x7fac6010d3d0 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac66d6b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fac600fb280 con 0x7fac601135c0 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac66d6b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac600fb440 con 0x7fac6010ddc0 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac64ae0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fac6010d3d0 0x7fac600f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac64ae0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fac6010d3d0 0x7fac600f58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39190/0 (socket says 10.20.193.4:39190) 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac64ae0640 1 -- 10.20.193.4:0/1715220788 learned_addr learned my addr 10.20.193.4:0/1715220788 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac57fff640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac6010ddc0 0x7fac60173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac652e1640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fac601135c0 0x7fac600f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac64ae0640 1 -- 10.20.193.4:0/1715220788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac6010ddc0 msgr2=0x7fac60173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac64ae0640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac6010ddc0 0x7fac60173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac64ae0640 1 -- 10.20.193.4:0/1715220788 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fac601135c0 msgr2=0x7fac600f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac64ae0640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fac601135c0 0x7fac600f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac64ae0640 1 -- 10.20.193.4:0/1715220788 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c00a650 con 0x7fac6010d3d0 2026-02-24T09:20:08.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac64ae0640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fac6010d3d0 0x7fac600f58a0 secure :-1 s=READY pgs=1289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac50005db0 tx=0x7fac5000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac55ffb640 1 -- 10.20.193.4:0/1715220788 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac50004500 con 0x7fac6010d3d0 2026-02-24T09:20:08.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac66d6b640 1 -- 10.20.193.4:0/1715220788 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac600fb720 con 0x7fac6010d3d0 2026-02-24T09:20:08.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac55ffb640 1 -- 10.20.193.4:0/1715220788 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fac50004d30 con 0x7fac6010d3d0 2026-02-24T09:20:08.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac55ffb640 1 -- 10.20.193.4:0/1715220788 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac50005330 con 0x7fac6010d3d0 2026-02-24T09:20:08.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.640+0000 7fac66d6b640 1 -- 10.20.193.4:0/1715220788 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac600fbbf0 con 0x7fac6010d3d0 2026-02-24T09:20:08.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.642+0000 7fac55ffb640 1 -- 10.20.193.4:0/1715220788 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fac500054c0 con 0x7fac6010d3d0 2026-02-24T09:20:08.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.643+0000 7fac55ffb640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fac3c0b5750 0x7fac3c0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.643+0000 7fac57fff640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fac3c0b5750 0x7fac3c0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.643+0000 7fac55ffb640 1 -- 10.20.193.4:0/1715220788 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fac500e6b20 con 0x7fac6010d3d0 2026-02-24T09:20:08.646 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.643+0000 7fac57fff640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fac3c0b5750 0x7fac3c0d5c00 secure :-1 s=READY pgs=454 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac600fc1a0 tx=0x7fac4800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.644+0000 7fac68d65e00 1 Processor -- start 2026-02-24T09:20:08.647 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.644+0000 7fac68d65e00 1 -- start start 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c909ae320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 0x563c909f2fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f3500 0x563c90a138e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c908beee0 con 0x563c909f3500 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c908bac10 con 0x563c909ae860 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c908b4d70 con 0x563c909adf50 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac652e1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f3500 0x563c90a138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac652e1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f3500 0x563c90a138e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39196/0 (socket says 10.20.193.4:39196) 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac652e1640 1 -- 10.20.193.4:0/2512191229 learned_addr learned my addr 10.20.193.4:0/2512191229 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac57fff640 1 --2- 10.20.193.4:0/2512191229 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 0x563c909f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac64ae0640 1 --2- 10.20.193.4:0/2512191229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c909ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac652e1640 1 -- 10.20.193.4:0/2512191229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 msgr2=0x563c909ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac652e1640 1 --2- 10.20.193.4:0/2512191229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c909ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac652e1640 1 -- 10.20.193.4:0/2512191229 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 msgr2=0x563c909f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac652e1640 1 --2- 10.20.193.4:0/2512191229 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 0x563c909f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac652e1640 1 -- 10.20.193.4:0/2512191229 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c90860340 con 0x563c909f3500 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac652e1640 1 --2- 10.20.193.4:0/2512191229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f3500 0x563c90a138e0 secure :-1 s=READY pgs=1290 gs=1 cs=0 l=1 c_cookie=2924998158164282258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c006f80 tx=0x7fac5c006da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2897ae53da0dcb92 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac2d4e4640 1 -- 10.20.193.4:0/2512191229 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5c03e050 con 0x563c909f3500 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac2d4e4640 1 -- 10.20.193.4:0/2512191229 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fac5c03f040 con 0x563c909f3500 2026-02-24T09:20:08.648 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac2d4e4640 1 -- 10.20.193.4:0/2512191229 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5c005340 con 0x563c909f3500 2026-02-24T09:20:08.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 -- 10.20.193.4:0/2512191229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f3500 msgr2=0x563c90a138e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 --2- 10.20.193.4:0/2512191229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f3500 0x563c90a138e0 secure :-1 s=READY pgs=1290 gs=1 cs=0 l=1 c_cookie=2924998158164282258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c006f80 tx=0x7fac5c006da0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 -- 10.20.193.4:0/2512191229 shutdown_connections 2026-02-24T09:20:08.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 --2- 10.20.193.4:0/2512191229 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f3500 0x563c90a138e0 unknown :-1 s=CLOSED pgs=1290 gs=1 cs=0 l=1 c_cookie=2924998158164282258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 --2- 10.20.193.4:0/2512191229 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 0x563c909f2fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 --2- 10.20.193.4:0/2512191229 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c909ae320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 -- 10.20.193.4:0/2512191229 >> 10.20.193.4:0/2512191229 conn(0x563c908ccdb0 msgr2=0x563c909ac830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.645+0000 7fac68d65e00 1 -- 10.20.193.4:0/2512191229 shutdown_connections 2026-02-24T09:20:08.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.646+0000 7fac68d65e00 1 -- 10.20.193.4:0/2512191229 wait complete. 2026-02-24T09:20:08.649 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.646+0000 7fac68d65e00 1 -- start start 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac68d65e00 1 Processor -- start 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c90a0ad30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909ae860 0x563c90a0b270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909f3500 0x563c90a10260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac68d65e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c90a107a0 con 0x563c909ae860 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac68d65e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c90a10910 con 0x563c909f3500 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac68d65e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c90a10ad0 con 0x563c909adf50 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac57fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909ae860 0x563c90a0b270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac57fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909ae860 0x563c90a0b270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39202/0 (socket says 10.20.193.4:39202) 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac57fff640 1 -- 10.20.193.4:0/1010282762 learned_addr learned my addr 10.20.193.4:0/1010282762 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac64ae0640 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c90a0ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac652e1640 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909f3500 0x563c90a10260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac57fff640 1 -- 10.20.193.4:0/1010282762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 msgr2=0x563c90a0ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac57fff640 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c90a0ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac57fff640 1 -- 10.20.193.4:0/1010282762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909f3500 msgr2=0x563c90a10260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac57fff640 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909f3500 0x563c90a10260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.650 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac57fff640 1 -- 10.20.193.4:0/1010282762 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c908389d0 con 0x563c909ae860 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac57fff640 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909ae860 0x563c90a0b270 secure :-1 s=READY pgs=1291 gs=1 cs=0 l=1 c_cookie=3408683741851456953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac4800b730 tx=0x7fac480047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4e13cda0b495b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac1e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac1e7fc640 1 -- 10.20.193.4:0/1010282762 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac4801e910 con 0x563c909ae860 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac1e7fc640 1 -- 10.20.193.4:0/1010282762 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fac48023070 con 0x563c909ae860 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac68d65e00 1 -- 10.20.193.4:0/1010282762 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac60174800 con 0x563c909ae860 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.647+0000 7fac1e7fc640 1 -- 10.20.193.4:0/1010282762 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac480273d0 con 0x563c909ae860 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac68d65e00 10 client.18240 _ll_register_callbacks cb 0x563c9085f080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac68d65e00 1 -- 10.20.193.4:0/1010282762 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c906044a0 con 0x563c909ae860 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac1e7fc640 1 -- 10.20.193.4:0/1010282762 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fac48017070 con 0x563c909ae860 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac1e7fc640 1 -- 10.20.193.4:0/1010282762 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fac48027560 con 0x563c909ae860 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac68d65e00 10 client.18240 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac68d65e00 1 -- 10.20.193.4:0/1010282762 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563c9084a710 con 0x563c909ae860 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac1e7fc640 1 -- 10.20.193.4:0/1010282762 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fac4802f060 con 0x563c909ae860 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac68d65e00 10 client.18240 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac68d65e00 10 client.18240 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac68d65e00 20 client.18240 populate_metadata read hostname 'trial004' 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac68d65e00 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c909f0720 0x563c909f0bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac68d65e00 4 client.18240 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:08.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac68d65e00 1 -- 10.20.193.4:0/1010282762 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c908aa7b0 con 0x563c909f0720 2026-02-24T09:20:08.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.648+0000 7fac64ae0640 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c909f0720 0x563c909f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac1e7fc640 10 client.18240 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:20:08.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac64ae0640 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c909f0720 0x563c909f0bc0 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=11149772674530966176 s_cookie=9996430585718491331 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9abbf32c67c67aa0 server_cookie=8aba74a78399c8c3 in_seq=0 out_seq=0 2026-02-24T09:20:08.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac1e7fc640 1 -- 10.20.193.4:0/1010282762 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x563c908aa7b0 con 0x563c909f0720 2026-02-24T09:20:08.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac1e7fc640 10 client.18240 handle_command_reply: tid=0 2026-02-24T09:20:08.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 client.18240 shutdown 2026-02-24T09:20:08.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 -- 10.20.193.4:0/1010282762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909ae860 msgr2=0x563c90a0b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909ae860 0x563c90a0b270 secure :-1 s=READY pgs=1291 gs=1 cs=0 l=1 c_cookie=3408683741851456953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac4800b730 tx=0x7fac480047e0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 -- 10.20.193.4:0/1010282762 shutdown_connections 2026-02-24T09:20:08.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c909f0720 0x563c909f0bc0 crc :-1 s=READY pgs=60 gs=4 cs=0 l=0 c_cookie=11149772674530966176 s_cookie=9996430585718491331 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909f3500 0x563c90a10260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909ae860 0x563c90a0b270 unknown :-1 s=CLOSED pgs=1291 gs=1 cs=0 l=1 c_cookie=3408683741851456953 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 --2- 10.20.193.4:0/1010282762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c90a0ad30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac1e7fc640 0 client.18240 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:20:08.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 -- 10.20.193.4:0/1010282762 >> 10.20.193.4:0/1010282762 conn(0x563c908ccdb0 msgr2=0x563c909ac040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 -- 10.20.193.4:0/1010282762 shutdown_connections 2026-02-24T09:20:08.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 1 -- 10.20.193.4:0/1010282762 wait complete. 2026-02-24T09:20:08.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.649+0000 7fac68d65e00 20 client.18240 trim_cache size 0 max 16384 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac68d65e00 1 Processor -- start 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac68d65e00 1 -- start start 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c909f5ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 0x563c90a08120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c90a08660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac68d65e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c908b29a0 con 0x563c909f0720 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac68d65e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c9068edf0 con 0x563c909ae860 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac68d65e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c90a13d80 con 0x563c909adf50 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac652e1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c90a08660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac652e1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c90a08660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39210/0 (socket says 10.20.193.4:39210) 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac652e1640 1 -- 10.20.193.4:0/2836763452 learned_addr learned my addr 10.20.193.4:0/2836763452 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac64ae0640 1 --2- 10.20.193.4:0/2836763452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c909f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac652e1640 1 -- 10.20.193.4:0/2836763452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 msgr2=0x563c909f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac652e1640 1 --2- 10.20.193.4:0/2836763452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c909f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac57fff640 1 --2- 10.20.193.4:0/2836763452 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 0x563c90a08120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac652e1640 1 -- 10.20.193.4:0/2836763452 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 msgr2=0x563c90a08120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac652e1640 1 --2- 10.20.193.4:0/2836763452 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 0x563c90a08120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac652e1640 1 -- 10.20.193.4:0/2836763452 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c90845190 con 0x563c909f0720 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac57fff640 1 --2- 10.20.193.4:0/2836763452 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 0x563c90a08120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac652e1640 1 --2- 10.20.193.4:0/2836763452 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c90a08660 secure :-1 s=READY pgs=1292 gs=1 cs=0 l=1 c_cookie=3565913773512647589 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c00a980 tx=0x7fac5c006a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317cabaf19e4e3a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac2cce3640 1 -- 10.20.193.4:0/2836763452 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5c039470 con 0x563c909f0720 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac2cce3640 1 -- 10.20.193.4:0/2836763452 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fac5c0395d0 con 0x563c909f0720 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.657+0000 7fac2cce3640 1 -- 10.20.193.4:0/2836763452 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5c04c6a0 con 0x563c909f0720 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 -- 10.20.193.4:0/2836763452 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 msgr2=0x563c90a08660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 --2- 10.20.193.4:0/2836763452 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c90a08660 secure :-1 s=READY pgs=1292 gs=1 cs=0 l=1 c_cookie=3565913773512647589 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c00a980 tx=0x7fac5c006a90 comp rx=0 tx=0).stop 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 -- 10.20.193.4:0/2836763452 shutdown_connections 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 --2- 10.20.193.4:0/2836763452 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c90a08660 unknown :-1 s=CLOSED pgs=1292 gs=1 cs=0 l=1 c_cookie=3565913773512647589 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 --2- 10.20.193.4:0/2836763452 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909ae860 0x563c90a08120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 --2- 10.20.193.4:0/2836763452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909adf50 0x563c909f5ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 -- 10.20.193.4:0/2836763452 >> 10.20.193.4:0/2836763452 conn(0x563c908ccdb0 msgr2=0x563c909f58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 -- 10.20.193.4:0/2836763452 shutdown_connections 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 -- 10.20.193.4:0/2836763452 wait complete. 2026-02-24T09:20:08.661 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 -- start start 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.658+0000 7fac68d65e00 1 Processor -- start 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909adf50 0x563c90991600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909ae860 0x563c90991b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c9098d360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x563c908b29a0 con 0x563c909f0720 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x563c9098da90 con 0x563c909adf50 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x563c9098dc50 con 0x563c909ae860 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac652e1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c9098d360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac652e1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c9098d360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39212/0 (socket says 10.20.193.4:39212) 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac652e1640 1 -- 10.20.193.4:0/155243331 learned_addr learned my addr 10.20.193.4:0/155243331 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac57fff640 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909ae860 0x563c90991b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac64ae0640 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909adf50 0x563c90991600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac652e1640 1 -- 10.20.193.4:0/155243331 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909ae860 msgr2=0x563c90991b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac652e1640 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909ae860 0x563c90991b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac652e1640 1 -- 10.20.193.4:0/155243331 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909adf50 msgr2=0x563c90991600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac652e1640 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909adf50 0x563c90991600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac652e1640 1 -- 10.20.193.4:0/155243331 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c90838d00 con 0x563c909f0720 2026-02-24T09:20:08.662 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac64ae0640 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909adf50 0x563c90991600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac652e1640 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c9098d360 secure :-1 s=READY pgs=1293 gs=1 cs=0 l=1 c_cookie=10503477203324939068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c00a230 tx=0x7fac5c006d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c3d8ddda98ab3c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac1e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac1e7fc640 1 -- 10.20.193.4:0/155243331 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5c03e040 con 0x563c909f0720 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 1 -- 10.20.193.4:0/155243331 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c90860340 con 0x563c909f0720 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 10 client.18246 _ll_register_callbacks cb 0x563c9085f080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 1 -- 10.20.193.4:0/155243331 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac5c03f040 con 0x563c909f0720 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac1e7fc640 1 -- 10.20.193.4:0/155243331 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fac5c003bb0 con 0x563c909f0720 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac1e7fc640 1 -- 10.20.193.4:0/155243331 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5c0576b0 con 0x563c909f0720 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac1e7fc640 1 -- 10.20.193.4:0/155243331 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fac5c04ce70 con 0x563c909f0720 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac1e7fc640 1 -- 10.20.193.4:0/155243331 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fac5c0578c0 con 0x563c909f0720 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 10 client.18246 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.659+0000 7fac68d65e00 1 -- 10.20.193.4:0/155243331 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x563c9084a970 con 0x563c909f0720 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.660+0000 7fac1e7fc640 1 -- 10.20.193.4:0/155243331 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fac5c04c830 con 0x563c909f0720 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.660+0000 7fac68d65e00 10 client.18246 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.660+0000 7fac68d65e00 10 client.18246 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.660+0000 7fac68d65e00 20 client.18246 populate_metadata read hostname 'trial004' 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.660+0000 7fac68d65e00 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c909f3500 0x563c90ac07a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.660+0000 7fac68d65e00 4 client.18246 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.660+0000 7fac68d65e00 1 -- 10.20.193.4:0/155243331 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c905e9160 con 0x563c909f3500 2026-02-24T09:20:08.663 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.660+0000 7fac64ae0640 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c909f3500 0x563c90ac07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac64ae0640 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c909f3500 0x563c90ac07a0 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=4966982179413925868 s_cookie=10196064173476999711 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44ee43f9d9a99fec server_cookie=8d7fb2583f2ef21f in_seq=0 out_seq=0 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac1e7fc640 10 client.18246 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac1e7fc640 1 -- 10.20.193.4:0/155243331 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c905e9160 con 0x563c909f3500 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac1e7fc640 10 client.18246 handle_command_reply: tid=0 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 client.18246 shutdown 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 -- 10.20.193.4:0/155243331 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 msgr2=0x563c9098d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c9098d360 secure :-1 s=READY pgs=1293 gs=1 cs=0 l=1 c_cookie=10503477203324939068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5c00a230 tx=0x7fac5c006d80 comp rx=0 tx=0).stop 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 -- 10.20.193.4:0/155243331 shutdown_connections 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x563c909f3500 0x563c90ac07a0 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=4966982179413925868 s_cookie=10196064173476999711 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x563c909f0720 0x563c9098d360 unknown :-1 s=CLOSED pgs=1293 gs=1 cs=0 l=1 c_cookie=10503477203324939068 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x563c909ae860 0x563c90991b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 --2- 10.20.193.4:0/155243331 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x563c909adf50 0x563c90991600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac1e7fc640 0 client.18246 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 -- 10.20.193.4:0/155243331 >> 10.20.193.4:0/155243331 conn(0x563c908ccdb0 msgr2=0x563c90a07110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 -- 10.20.193.4:0/155243331 shutdown_connections 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 1 -- 10.20.193.4:0/155243331 wait complete. 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac68d65e00 20 client.18246 trim_cache size 0 max 16384 2026-02-24T09:20:08.664 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 -- 10.20.193.4:0/1715220788 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fac3c0b5750 msgr2=0x7fac3c0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fac3c0b5750 0x7fac3c0d5c00 secure :-1 s=READY pgs=454 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac600fc1a0 tx=0x7fac4800b410 comp rx=0 tx=0).stop 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 -- 10.20.193.4:0/1715220788 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fac6010d3d0 msgr2=0x7fac600f58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fac6010d3d0 0x7fac600f58a0 secure :-1 s=READY pgs=1289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac50005db0 tx=0x7fac5000ddf0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 -- 10.20.193.4:0/1715220788 shutdown_connections 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fac3c0b5750 0x7fac3c0d5c00 unknown :-1 s=CLOSED pgs=454 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fac601135c0 0x7fac600f5fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac6010ddc0 0x7fac60173e90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 --2- 10.20.193.4:0/1715220788 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fac6010d3d0 0x7fac600f58a0 unknown :-1 s=CLOSED pgs=1289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 -- 10.20.193.4:0/1715220788 >> 10.20.193.4:0/1715220788 conn(0x7fac600eaca0 msgr2=0x7fac60111510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 -- 10.20.193.4:0/1715220788 shutdown_connections 2026-02-24T09:20:08.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.661+0000 7fac66d6b640 1 -- 10.20.193.4:0/1715220788 wait complete. 2026-02-24T09:20:08.700 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:20:08.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 -- 10.20.193.4:0/3848642337 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d010b670 msgr2=0x7fd5d010ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 --2- 10.20.193.4:0/3848642337 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d010b670 0x7fd5d010ba80 secure :-1 s=READY pgs=1294 gs=1 cs=0 l=1 c_cookie=16022127441223111939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c0009950 tx=0x7fd5c002f220 comp rx=0 tx=0).stop 2026-02-24T09:20:08.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 -- 10.20.193.4:0/3848642337 shutdown_connections 2026-02-24T09:20:08.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 --2- 10.20.193.4:0/3848642337 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d010c0d0 0x7fd5d0175fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 --2- 10.20.193.4:0/3848642337 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d010b670 0x7fd5d010ba80 unknown :-1 s=CLOSED pgs=1294 gs=1 cs=0 l=1 c_cookie=16022127441223111939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 --2- 10.20.193.4:0/3848642337 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d010df80 0x7fd5d010e350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 -- 10.20.193.4:0/3848642337 >> 10.20.193.4:0/3848642337 conn(0x7fd5d00e9370 msgr2=0x7fd5d0109780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 -- 10.20.193.4:0/3848642337 shutdown_connections 2026-02-24T09:20:08.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 -- 10.20.193.4:0/3848642337 wait complete. 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 Processor -- start 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 -- start start 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d010b670 0x7fd5d00f4d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d010c0d0 0x7fd5d00f5250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d010df80 0x7fd5d00fa620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d00fac40 con 0x7fd5d010b670 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d00fadb0 con 0x7fd5d010c0d0 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d665a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d00faf70 con 0x7fd5d010df80 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5cffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d010b670 0x7fd5d00f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5cffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d010b670 0x7fd5d00f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39226/0 (socket says 10.20.193.4:39226) 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5cffff640 1 -- 10.20.193.4:0/1660205424 learned_addr learned my addr 10.20.193.4:0/1660205424 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5cf7fe640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d010c0d0 0x7fd5d00f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.731 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.727+0000 7fd5d4bd0640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d010df80 0x7fd5d00fa620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5cffff640 1 -- 10.20.193.4:0/1660205424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d010df80 msgr2=0x7fd5d00fa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5cffff640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d010df80 0x7fd5d00fa620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5cffff640 1 -- 10.20.193.4:0/1660205424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d010c0d0 msgr2=0x7fd5d00f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5cffff640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d010c0d0 0x7fd5d00f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5cffff640 1 -- 10.20.193.4:0/1660205424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c0009570 con 0x7fd5d010b670 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5cf7fe640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d010c0d0 0x7fd5d00f5250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5cffff640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d010b670 0x7fd5d00f4d10 secure :-1 s=READY pgs=1295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5bc00d950 tx=0x7fd5bc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5cd7fa640 1 -- 10.20.193.4:0/1660205424 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5bc004540 con 0x7fd5d010b670 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5cd7fa640 1 -- 10.20.193.4:0/1660205424 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5bc009d00 con 0x7fd5d010b670 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5d665a640 1 -- 10.20.193.4:0/1660205424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d00fb250 con 0x7fd5d010b670 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5cd7fa640 1 -- 10.20.193.4:0/1660205424 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5bc0106e0 con 0x7fd5d010b670 2026-02-24T09:20:08.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.728+0000 7fd5d665a640 1 -- 10.20.193.4:0/1660205424 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d0173130 con 0x7fd5d010b670 2026-02-24T09:20:08.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.730+0000 7fd5cd7fa640 1 -- 10.20.193.4:0/1660205424 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fd5bc0097c0 con 0x7fd5d010b670 2026-02-24T09:20:08.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5cd7fa640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5a40b56e0 0x7fd5a40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5cf7fe640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5a40b56e0 0x7fd5a40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5cd7fa640 1 -- 10.20.193.4:0/1660205424 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd5bc0e6e20 con 0x7fd5d010b670 2026-02-24T09:20:08.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5cf7fe640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5a40b56e0 0x7fd5a40d5b90 secure :-1 s=READY pgs=455 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c00023d0 tx=0x7fd5c0031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5d8654e00 1 Processor -- start 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5d8654e00 1 -- start start 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d823262fb0 0x55d823263380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8232638c0 0x55d8232a8020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c8940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d823174050 con 0x55d8232a8560 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d82316fd80 con 0x55d823262fb0 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.731+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d823169ee0 con 0x55d8232638c0 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d4bd0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d4bd0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39238/0 (socket says 10.20.193.4:39238) 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3312645926 learned_addr learned my addr 10.20.193.4:0/3312645926 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5cffff640 1 --2- 10.20.193.4:0/3312645926 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d823262fb0 0x55d823263380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5cf7fe640 1 --2- 10.20.193.4:0/3312645926 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8232638c0 0x55d8232a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.736 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3312645926 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8232638c0 msgr2=0x55d8232a8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d4bd0640 1 --2- 10.20.193.4:0/3312645926 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8232638c0 0x55d8232a8020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3312645926 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d823262fb0 msgr2=0x55d823263380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d4bd0640 1 --2- 10.20.193.4:0/3312645926 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d823262fb0 0x55d823263380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3312645926 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d823115540 con 0x55d8232a8560 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d4bd0640 1 --2- 10.20.193.4:0/3312645926 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c8940 secure :-1 s=READY pgs=1296 gs=1 cs=0 l=1 c_cookie=16240258766802229816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c4006d50 tx=0x7fd5c4003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e160fd4dc7ab9a38 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5a0ce3640 1 -- 10.20.193.4:0/3312645926 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c4010c50 con 0x55d8232a8560 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5a0ce3640 1 -- 10.20.193.4:0/3312645926 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5c4010db0 con 0x55d8232a8560 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5a0ce3640 1 -- 10.20.193.4:0/3312645926 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c40119c0 con 0x55d8232a8560 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3312645926 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 msgr2=0x55d8232c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3312645926 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c8940 secure :-1 s=READY pgs=1296 gs=1 cs=0 l=1 c_cookie=16240258766802229816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c4006d50 tx=0x7fd5c4003ea0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3312645926 shutdown_connections 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3312645926 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c8940 unknown :-1 s=CLOSED pgs=1296 gs=1 cs=0 l=1 c_cookie=16240258766802229816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3312645926 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8232638c0 0x55d8232a8020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3312645926 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d823262fb0 0x55d823263380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3312645926 >> 10.20.193.4:0/3312645926 conn(0x55d8232414b0 msgr2=0x55d823261890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3312645926 shutdown_connections 2026-02-24T09:20:08.737 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.732+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3312645926 wait complete. 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.733+0000 7fd5d8654e00 1 -- start start 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.733+0000 7fd5d8654e00 1 Processor -- start 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d823262fb0 0x55d8232bfe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d8232c0360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c5350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d8232c5890 con 0x55d8232a8560 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d8232c5a00 con 0x55d8232638c0 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d8232c5bc0 con 0x55d823262fb0 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d4bd0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d4bd0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39250/0 (socket says 10.20.193.4:39250) 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3698146284 learned_addr learned my addr 10.20.193.4:0/3698146284 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5cffff640 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d823262fb0 0x55d8232bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5cf7fe640 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d8232c0360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3698146284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d823262fb0 msgr2=0x55d8232bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d4bd0640 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d823262fb0 0x55d8232bfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3698146284 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 msgr2=0x55d8232c0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d4bd0640 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d8232c0360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3698146284 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8230edbd0 con 0x55d8232a8560 2026-02-24T09:20:08.740 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d4bd0640 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c5350 secure :-1 s=READY pgs=1297 gs=1 cs=0 l=1 c_cookie=11340827642229354470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c4010ce0 tx=0x7fd5c4010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d62b6a78202efe6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd591ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd591ffb640 1 -- 10.20.193.4:0/3698146284 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c4011d70 con 0x55d8232a8560 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd591ffb640 1 -- 10.20.193.4:0/3698146284 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5c4011ed0 con 0x55d8232a8560 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3698146284 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c4005550 con 0x55d8232a8560 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd591ffb640 1 -- 10.20.193.4:0/3698146284 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c401b9a0 con 0x55d8232a8560 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 10 client.18258 _ll_register_callbacks cb 0x55d823158290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3698146284 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d822eb9700 con 0x55d8232a8560 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd591ffb640 1 -- 10.20.193.4:0/3698146284 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd5c401bb30 con 0x55d8232a8560 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd591ffb640 1 -- 10.20.193.4:0/3698146284 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd5c401bd10 con 0x55d8232a8560 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 10 client.18258 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3698146284 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d8230ff910 con 0x55d8232a8560 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd591ffb640 1 -- 10.20.193.4:0/3698146284 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd5c4012440 con 0x55d8232a8560 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 10 client.18258 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 10 client.18258 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 20 client.18258 populate_metadata read hostname 'trial004' 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8232a55f0 0x55d8232a5a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 4 client.18258 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.734+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3698146284 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d82315f920 con 0x55d8232a55f0 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.735+0000 7fd5cffff640 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8232a55f0 0x55d8232a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.735+0000 7fd591ffb640 10 client.18258 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:08.741 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.735+0000 7fd5cffff640 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8232a55f0 0x55d8232a5a90 crc :-1 s=READY pgs=221 gs=4 cs=0 l=0 c_cookie=7989291211031213311 s_cookie=5143981629944045329 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6edfaa0700aa74ff server_cookie=47631809d7f31f11 in_seq=0 out_seq=0 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd591ffb640 1 -- 10.20.193.4:0/3698146284 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55d82315f920 con 0x55d8232a55f0 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd591ffb640 10 client.18258 handle_command_reply: tid=0 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 client.18258 shutdown 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3698146284 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 msgr2=0x55d8232c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c5350 secure :-1 s=READY pgs=1297 gs=1 cs=0 l=1 c_cookie=11340827642229354470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c4010ce0 tx=0x7fd5c4010d10 comp rx=0 tx=0).stop 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3698146284 shutdown_connections 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8232a55f0 0x55d8232a5a90 crc :-1 s=READY pgs=221 gs=4 cs=0 l=0 c_cookie=7989291211031213311 s_cookie=5143981629944045329 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a8560 0x55d8232c5350 unknown :-1 s=CLOSED pgs=1297 gs=1 cs=0 l=1 c_cookie=11340827642229354470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d8232c0360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd591ffb640 0 client.18258 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3698146284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d823262fb0 0x55d8232bfe20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3698146284 >> 10.20.193.4:0/3698146284 conn(0x55d8232414b0 msgr2=0x55d823261890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3698146284 shutdown_connections 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3698146284 wait complete. 2026-02-24T09:20:08.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.736+0000 7fd5d8654e00 20 client.18258 trim_cache size 0 max 16384 2026-02-24T09:20:08.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5d8654e00 1 Processor -- start 2026-02-24T09:20:08.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5d8654e00 1 -- start start 2026-02-24T09:20:08.753 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d823262fb0 0x55d8232bd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d8232bd640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8232a55f0 0x55d8232a31a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d823167b10 con 0x55d823262fb0 2026-02-24T09:20:08.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d822e331b0 con 0x55d8232638c0 2026-02-24T09:20:08.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d8232635c0 con 0x55d8232a55f0 2026-02-24T09:20:08.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d823262fb0 0x55d8232bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d823262fb0 0x55d8232bd100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39260/0 (socket says 10.20.193.4:39260) 2026-02-24T09:20:08.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cffff640 1 -- 10.20.193.4:0/2388227353 learned_addr learned my addr 10.20.193.4:0/2388227353 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cf7fe640 1 --2- 10.20.193.4:0/2388227353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d8232bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.754 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cffff640 1 -- 10.20.193.4:0/2388227353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8232a55f0 msgr2=0x55d8232a31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cffff640 1 --2- 10.20.193.4:0/2388227353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8232a55f0 0x55d8232a31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cffff640 1 -- 10.20.193.4:0/2388227353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 msgr2=0x55d8232bd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cffff640 1 --2- 10.20.193.4:0/2388227353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d8232bd640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cffff640 1 -- 10.20.193.4:0/2388227353 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8230fa390 con 0x55d823262fb0 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cf7fe640 1 --2- 10.20.193.4:0/2388227353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d8232bd640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd5cffff640 1 --2- 10.20.193.4:0/2388227353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d823262fb0 0x55d8232bd100 secure :-1 s=READY pgs=1298 gs=1 cs=0 l=1 c_cookie=17701739126430662072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5bc0ad400 tx=0x7fd5bc002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a935f299887db8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd593fff640 1 -- 10.20.193.4:0/2388227353 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5bc05b0d0 con 0x55d823262fb0 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd593fff640 1 -- 10.20.193.4:0/2388227353 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5bc0adb90 con 0x55d823262fb0 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.746+0000 7fd593fff640 1 -- 10.20.193.4:0/2388227353 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5bc0ade20 con 0x55d823262fb0 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 -- 10.20.193.4:0/2388227353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d823262fb0 msgr2=0x55d8232bd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/2388227353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d823262fb0 0x55d8232bd100 secure :-1 s=READY pgs=1298 gs=1 cs=0 l=1 c_cookie=17701739126430662072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5bc0ad400 tx=0x7fd5bc002f90 comp rx=0 tx=0).stop 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 -- 10.20.193.4:0/2388227353 shutdown_connections 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/2388227353 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d8232a55f0 0x55d8232a31a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/2388227353 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d8232bd640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.755 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/2388227353 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d823262fb0 0x55d8232bd100 unknown :-1 s=CLOSED pgs=1298 gs=1 cs=0 l=1 c_cookie=17701739126430662072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 -- 10.20.193.4:0/2388227353 >> 10.20.193.4:0/2388227353 conn(0x55d8232414b0 msgr2=0x55d8232bc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 -- 10.20.193.4:0/2388227353 shutdown_connections 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 -- 10.20.193.4:0/2388227353 wait complete. 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 -- start start 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 Processor -- start 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d823262fb0 0x55d823243100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d823243640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a55f0 0x55d82330e4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55d823241220 con 0x55d8232a55f0 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55d8231d7090 con 0x55d8232638c0 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d8654e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55d823243ec0 con 0x55d823262fb0 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d4bd0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a55f0 0x55d82330e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d4bd0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a55f0 0x55d82330e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39274/0 (socket says 10.20.193.4:39274) 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.747+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3956341544 learned_addr learned my addr 10.20.193.4:0/3956341544 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:08.756 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5cf7fe640 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d823243640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5cffff640 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d823262fb0 0x55d823243100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3956341544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d823262fb0 msgr2=0x55d823243100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d4bd0640 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d823262fb0 0x55d823243100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3956341544 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 msgr2=0x55d823243640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d4bd0640 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d823243640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d4bd0640 1 -- 10.20.193.4:0/3956341544 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8230edf00 con 0x55d8232a55f0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d4bd0640 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a55f0 0x55d82330e4d0 secure :-1 s=READY pgs=1299 gs=1 cs=0 l=1 c_cookie=16441571601130081000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c402fbe0 tx=0x7fd5c4006da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42c324292824ae8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd591ffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd591ffb640 1 -- 10.20.193.4:0/3956341544 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c4011480 con 0x55d8232a55f0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd591ffb640 1 -- 10.20.193.4:0/3956341544 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd5c401f070 con 0x55d8232a55f0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3956341544 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d0173130 con 0x55d8232a55f0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd591ffb640 1 -- 10.20.193.4:0/3956341544 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5c4011bb0 con 0x55d8232a55f0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 10 client.18264 _ll_register_callbacks cb 0x55d823158290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3956341544 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5c4010db0 con 0x55d8232a55f0 2026-02-24T09:20:08.757 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd591ffb640 1 -- 10.20.193.4:0/3956341544 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd5c4011d40 con 0x55d8232a55f0 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd591ffb640 1 -- 10.20.193.4:0/3956341544 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd5c40057c0 con 0x55d8232a55f0 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 10 client.18264 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3956341544 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d8230ffb70 con 0x55d8232a55f0 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd591ffb640 1 -- 10.20.193.4:0/3956341544 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd5c4040020 con 0x55d8232a55f0 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 10 client.18264 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 10 client.18264 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 20 client.18264 populate_metadata read hostname 'trial004' 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8232a8560 0x55d823376280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 4 client.18264 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4edec7bf", "release": true, "await": true}] 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3956341544 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4edec7bf", "release": true, "await": true}) -- 0x55d822e9e3c0 con 0x55d8232a8560 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.748+0000 7fd5cffff640 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8232a8560 0x55d823376280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.749+0000 7fd591ffb640 10 client.18264 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:08.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.749+0000 7fd5cffff640 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8232a8560 0x55d823376280 crc :-1 s=READY pgs=222 gs=4 cs=0 l=0 c_cookie=8834034242003014182 s_cookie=959369913548554232 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a98cb56a03a1226 server_cookie=d505dda79423ff8 in_seq=0 out_seq=0 2026-02-24T09:20:08.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd591ffb640 1 -- 10.20.193.4:0/3956341544 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d822e9e3c0 con 0x55d8232a8560 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd591ffb640 10 client.18264 handle_command_reply: tid=0 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 client.18264 shutdown 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3956341544 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a55f0 msgr2=0x55d82330e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a55f0 0x55d82330e4d0 secure :-1 s=READY pgs=1299 gs=1 cs=0 l=1 c_cookie=16441571601130081000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c402fbe0 tx=0x7fd5c4006da0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3956341544 shutdown_connections 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55d8232a8560 0x55d823376280 crc :-1 s=READY pgs=222 gs=4 cs=0 l=0 c_cookie=8834034242003014182 s_cookie=959369913548554232 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55d8232a55f0 0x55d82330e4d0 unknown :-1 s=CLOSED pgs=1299 gs=1 cs=0 l=1 c_cookie=16441571601130081000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55d8232638c0 0x55d823243640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 --2- 10.20.193.4:0/3956341544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55d823262fb0 0x55d823243100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd591ffb640 0 client.18264 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3956341544 >> 10.20.193.4:0/3956341544 conn(0x55d8232414b0 msgr2=0x55d8232bd100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3956341544 shutdown_connections 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 1 -- 10.20.193.4:0/3956341544 wait complete. 2026-02-24T09:20:08.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.751+0000 7fd5d8654e00 20 client.18264 trim_cache size 0 max 16384 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 40, 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout: "4edec7bf": { 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout: "version": 40, 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:20:08.761 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 133.2, 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:08.762 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:20:08.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 -- 10.20.193.4:0/1660205424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5a40b56e0 msgr2=0x7fd5a40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5a40b56e0 0x7fd5a40d5b90 secure :-1 s=READY pgs=455 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c00023d0 tx=0x7fd5c0031040 comp rx=0 tx=0).stop 2026-02-24T09:20:08.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 -- 10.20.193.4:0/1660205424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d010b670 msgr2=0x7fd5d00f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:08.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d010b670 0x7fd5d00f4d10 secure :-1 s=READY pgs=1295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5bc00d950 tx=0x7fd5bc00de20 comp rx=0 tx=0).stop 2026-02-24T09:20:08.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 -- 10.20.193.4:0/1660205424 shutdown_connections 2026-02-24T09:20:08.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd5a40b56e0 0x7fd5a40d5b90 unknown :-1 s=CLOSED pgs=455 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5d010df80 0x7fd5d00fa620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd5d010c0d0 0x7fd5d00f5250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 --2- 10.20.193.4:0/1660205424 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd5d010b670 0x7fd5d00f4d10 unknown :-1 s=CLOSED pgs=1295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:08.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 -- 10.20.193.4:0/1660205424 >> 10.20.193.4:0/1660205424 conn(0x7fd5d00e9370 msgr2=0x7fd5d00eb160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:08.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 -- 10.20.193.4:0/1660205424 shutdown_connections 2026-02-24T09:20:08.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:08.752+0000 7fd5d665a640 1 -- 10.20.193.4:0/1660205424 wait complete. 2026-02-24T09:20:08.816 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4edec7bf', total seconds elapsed: 14.0 2026-02-24T09:20:08.871 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:09.026 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 -- 10.20.193.4:0/2970953222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f904010ddc0 msgr2=0x7f9040112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 --2- 10.20.193.4:0/2970953222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f904010ddc0 0x7f9040112e10 secure :-1 s=READY pgs=123 gs=3 cs=0 l=1 c_cookie=5562625371334621359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9028009950 tx=0x7f902802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 -- 10.20.193.4:0/2970953222 shutdown_connections 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 --2- 10.20.193.4:0/2970953222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f90401135c0 0x7f9040173f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 --2- 10.20.193.4:0/2970953222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f904010ddc0 0x7f9040112e10 unknown :-1 s=CLOSED pgs=123 gs=3 cs=0 l=1 c_cookie=5562625371334621359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 --2- 10.20.193.4:0/2970953222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f904010d3d0 0x7f904010d7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 -- 10.20.193.4:0/2970953222 >> 10.20.193.4:0/2970953222 conn(0x7f90400eaca0 msgr2=0x7f904010b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 -- 10.20.193.4:0/2970953222 shutdown_connections 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 -- 10.20.193.4:0/2970953222 wait complete. 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 Processor -- start 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 -- start start 2026-02-24T09:20:09.027 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f904010d3d0 0x7f90400f3650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f904010ddc0 0x7f9040173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f90401135c0 0x7f90400f3d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f90400f8f10 con 0x7f90401135c0 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f90400f9080 con 0x7f904010d3d0 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f9044f96640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90400f9240 con 0x7f904010ddc0 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f903ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f90401135c0 0x7f90400f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f903ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f90401135c0 0x7f90400f3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39296/0 (socket says 10.20.193.4:39296) 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f903ed76640 1 -- 10.20.193.4:0/529236238 learned_addr learned my addr 10.20.193.4:0/529236238 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f903dd74640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f904010ddc0 0x7f9040173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.022+0000 7f903e575640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f904010d3d0 0x7f90400f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f903dd74640 1 -- 10.20.193.4:0/529236238 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f904010d3d0 msgr2=0x7f90400f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f903dd74640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f904010d3d0 0x7f90400f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f903dd74640 1 -- 10.20.193.4:0/529236238 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f90401135c0 msgr2=0x7f90400f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f903dd74640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f90401135c0 0x7f90400f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f903dd74640 1 -- 10.20.193.4:0/529236238 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9028009570 con 0x7f904010ddc0 2026-02-24T09:20:09.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f903ed76640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f90401135c0 0x7f90400f3d50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:20:09.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f903dd74640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f904010ddc0 0x7f9040173e90 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f902802f6e0 tx=0x7f9028004300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f90277fe640 1 -- 10.20.193.4:0/529236238 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f902803d070 con 0x7f904010ddc0 2026-02-24T09:20:09.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f90277fe640 1 -- 10.20.193.4:0/529236238 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9028038920 con 0x7f904010ddc0 2026-02-24T09:20:09.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f9044f96640 1 -- 10.20.193.4:0/529236238 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90400f94c0 con 0x7f904010ddc0 2026-02-24T09:20:09.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f90277fe640 1 -- 10.20.193.4:0/529236238 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9028041a00 con 0x7f904010ddc0 2026-02-24T09:20:09.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.023+0000 7f9044f96640 1 -- 10.20.193.4:0/529236238 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90400f9980 con 0x7f904010ddc0 2026-02-24T09:20:09.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.025+0000 7f90277fe640 1 -- 10.20.193.4:0/529236238 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9028038a90 con 0x7f904010ddc0 2026-02-24T09:20:09.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.026+0000 7f90277fe640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90180b5750 0x7f90180d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.026+0000 7f90277fe640 1 -- 10.20.193.4:0/529236238 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f902810b160 con 0x7f904010ddc0 2026-02-24T09:20:09.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.026+0000 7f903e575640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90180b5750 0x7f90180d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.026+0000 7f903e575640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90180b5750 0x7f90180d5c00 secure :-1 s=READY pgs=456 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9034004740 tx=0x7f90340073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.030+0000 7f9046f90e00 1 Processor -- start 2026-02-24T09:20:09.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.030+0000 7f9046f90e00 1 -- start start 2026-02-24T09:20:09.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.030+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd1f320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.030+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1f860 0x55769fd63fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.030+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd64500 0x55769fd848e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f9046f90e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55769fc2fee0 con 0x55769fd1f860 2026-02-24T09:20:09.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f9046f90e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55769fc2bc10 con 0x55769fd64500 2026-02-24T09:20:09.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f9046f90e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55769fc25d70 con 0x55769fd1ef50 2026-02-24T09:20:09.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1f860 0x55769fd63fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd1f320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903dd74640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1f860 0x55769fd63fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39308/0 (socket says 10.20.193.4:39308) 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903dd74640 1 -- 10.20.193.4:0/738567000 learned_addr learned my addr 10.20.193.4:0/738567000 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd1f320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:51058/0 (socket says 10.20.193.4:51058) 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903ed76640 1 --2- 10.20.193.4:0/738567000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd64500 0x55769fd848e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903dd74640 1 -- 10.20.193.4:0/738567000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 msgr2=0x55769fd1f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903dd74640 1 --2- 10.20.193.4:0/738567000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd1f320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903dd74640 1 -- 10.20.193.4:0/738567000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd64500 msgr2=0x55769fd848e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903dd74640 1 --2- 10.20.193.4:0/738567000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd64500 0x55769fd848e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903dd74640 1 -- 10.20.193.4:0/738567000 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769fbd1340 con 0x55769fd1f860 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903e575640 1 --2- 10.20.193.4:0/738567000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd1f320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f903dd74640 1 --2- 10.20.193.4:0/738567000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1f860 0x55769fd63fc0 secure :-1 s=READY pgs=1300 gs=1 cs=0 l=1 c_cookie=9006707312350245511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90280ce7b0 tx=0x7f9028002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfe4094bc8cb287 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f9024ff9640 1 -- 10.20.193.4:0/738567000 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90280d0d40 con 0x55769fd1f860 2026-02-24T09:20:09.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f9024ff9640 1 -- 10.20.193.4:0/738567000 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f90280d71b0 con 0x55769fd1f860 2026-02-24T09:20:09.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.031+0000 7f9024ff9640 1 -- 10.20.193.4:0/738567000 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90280d2e80 con 0x55769fd1f860 2026-02-24T09:20:09.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.032+0000 7f9046f90e00 1 -- 10.20.193.4:0/738567000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1f860 msgr2=0x55769fd63fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.032+0000 7f9046f90e00 1 --2- 10.20.193.4:0/738567000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1f860 0x55769fd63fc0 secure :-1 s=READY pgs=1300 gs=1 cs=0 l=1 c_cookie=9006707312350245511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90280ce7b0 tx=0x7f9028002b90 comp rx=0 tx=0).stop 2026-02-24T09:20:09.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.032+0000 7f9046f90e00 1 -- 10.20.193.4:0/738567000 shutdown_connections 2026-02-24T09:20:09.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.032+0000 7f9046f90e00 1 --2- 10.20.193.4:0/738567000 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd64500 0x55769fd848e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.032+0000 7f9046f90e00 1 --2- 10.20.193.4:0/738567000 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1f860 0x55769fd63fc0 unknown :-1 s=CLOSED pgs=1300 gs=1 cs=0 l=1 c_cookie=9006707312350245511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.032+0000 7f9046f90e00 1 --2- 10.20.193.4:0/738567000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd1f320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.032+0000 7f9046f90e00 1 -- 10.20.193.4:0/738567000 >> 10.20.193.4:0/738567000 conn(0x55769fc3ddb0 msgr2=0x55769fd1d830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.032+0000 7f9046f90e00 1 -- 10.20.193.4:0/738567000 shutdown_connections 2026-02-24T09:20:09.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.032+0000 7f9046f90e00 1 -- 10.20.193.4:0/738567000 wait complete. 2026-02-24T09:20:09.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.033+0000 7f9046f90e00 1 -- start start 2026-02-24T09:20:09.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.033+0000 7f9046f90e00 1 Processor -- start 2026-02-24T09:20:09.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd7bd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fd7c290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd64500 0x55769fd81280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f9046f90e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55769fd817c0 con 0x55769fd64500 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f9046f90e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55769fd81930 con 0x55769fd1f860 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f9046f90e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55769fd81af0 con 0x55769fd1ef50 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd64500 0x55769fd81280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd64500 0x55769fd81280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39318/0 (socket says 10.20.193.4:39318) 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903ed76640 1 -- 10.20.193.4:0/1044554223 learned_addr learned my addr 10.20.193.4:0/1044554223 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903dd74640 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fd7c290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903e575640 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd7bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903ed76640 1 -- 10.20.193.4:0/1044554223 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 msgr2=0x55769fd7bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903ed76640 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd7bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903ed76640 1 -- 10.20.193.4:0/1044554223 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 msgr2=0x55769fd7c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903ed76640 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fd7c290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903ed76640 1 -- 10.20.193.4:0/1044554223 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90400f9980 con 0x55769fd64500 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f903ed76640 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd64500 0x55769fd81280 secure :-1 s=READY pgs=1301 gs=1 cs=0 l=1 c_cookie=15217566931184999544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9030012870 tx=0x7f9030012d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32fa87f6f035c78 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f8feffff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f8feffff640 1 -- 10.20.193.4:0/1044554223 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9030017070 con 0x55769fd64500 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f9046f90e00 1 -- 10.20.193.4:0/1044554223 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9034007cf0 con 0x55769fd64500 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f8feffff640 1 -- 10.20.193.4:0/1044554223 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9030005600 con 0x55769fd64500 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f8feffff640 1 -- 10.20.193.4:0/1044554223 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f903001c6a0 con 0x55769fd64500 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f8feffff640 1 -- 10.20.193.4:0/1044554223 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f903000e350 con 0x55769fd64500 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.034+0000 7f8feffff640 10 client.18276 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f9046f90e00 10 client.18276 _ll_register_callbacks cb 0x55769fbd0080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f9046f90e00 1 -- 10.20.193.4:0/1044554223 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55769f9754a0 con 0x55769fd64500 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f8feffff640 1 -- 10.20.193.4:0/1044554223 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9030003780 con 0x55769fd64500 2026-02-24T09:20:09.042 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f9046f90e00 10 client.18276 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:09.043 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f9046f90e00 1 -- 10.20.193.4:0/1044554223 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55769fba99d0 con 0x55769fd64500 2026-02-24T09:20:09.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:08 trial004 ceph-mon[41596]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 870 MiB/s wr, 555 op/s 2026-02-24T09:20:09.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:08 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2705677322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:09.043 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:08 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4161046204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:09.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f8feffff640 1 -- 10.20.193.4:0/1044554223 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f90300039a0 con 0x55769fd64500 2026-02-24T09:20:09.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f9046f90e00 10 client.18276 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:09.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f9046f90e00 10 client.18276 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:20:09.045 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f9046f90e00 20 client.18276 populate_metadata read hostname 'trial004' 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f9046f90e00 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55769fd61680 0x55769fd61b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f9046f90e00 4 client.18276 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f9046f90e00 1 -- 10.20.193.4:0/1044554223 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55769fc1b7b0 con 0x55769fd61680 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.035+0000 7f903e575640 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55769fd61680 0x55769fd61b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f903e575640 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55769fd61680 0x55769fd61b20 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=3355647709145638193 s_cookie=6975116207591069409 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e91a7cffefaa531 server_cookie=60cc973c2c8916e1 in_seq=0 out_seq=0 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f8feffff640 10 client.18276 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f8feffff640 1 -- 10.20.193.4:0/1044554223 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55769fc1b7b0 con 0x55769fd61680 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f8feffff640 10 client.18276 handle_command_reply: tid=0 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 client.18276 shutdown 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 -- 10.20.193.4:0/1044554223 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd64500 msgr2=0x55769fd81280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd64500 0x55769fd81280 secure :-1 s=READY pgs=1301 gs=1 cs=0 l=1 c_cookie=15217566931184999544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9030012870 tx=0x7f9030012d40 comp rx=0 tx=0).stop 2026-02-24T09:20:09.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 -- 10.20.193.4:0/1044554223 shutdown_connections 2026-02-24T09:20:09.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55769fd61680 0x55769fd61b20 crc :-1 s=READY pgs=61 gs=4 cs=0 l=0 c_cookie=3355647709145638193 s_cookie=6975116207591069409 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd64500 0x55769fd81280 unknown :-1 s=CLOSED pgs=1301 gs=1 cs=0 l=1 c_cookie=15217566931184999544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fd7c290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f8feffff640 0 client.18276 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:20:09.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 --2- 10.20.193.4:0/1044554223 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd7bd50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 -- 10.20.193.4:0/1044554223 >> 10.20.193.4:0/1044554223 conn(0x55769fc3ddb0 msgr2=0x55769fd1d040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 -- 10.20.193.4:0/1044554223 shutdown_connections 2026-02-24T09:20:09.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 1 -- 10.20.193.4:0/1044554223 wait complete. 2026-02-24T09:20:09.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.036+0000 7f9046f90e00 20 client.18276 trim_cache size 0 max 16384 2026-02-24T09:20:09.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.046+0000 7f9046f90e00 1 Processor -- start 2026-02-24T09:20:09.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.046+0000 7f9046f90e00 1 -- start start 2026-02-24T09:20:09.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.046+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd5e150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.046+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fd5e690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.046+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd61680 0x55769fd5ebd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.046+0000 7f9046f90e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55769fc239a0 con 0x55769fd61680 2026-02-24T09:20:09.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.046+0000 7f9046f90e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55769f9ffdf0 con 0x55769fd1f860 2026-02-24T09:20:09.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.046+0000 7f9046f90e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55769fc2bc10 con 0x55769fd1ef50 2026-02-24T09:20:09.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd61680 0x55769fd5ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903ed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd61680 0x55769fd5ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39328/0 (socket says 10.20.193.4:39328) 2026-02-24T09:20:09.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903ed76640 1 -- 10.20.193.4:0/4263945369 learned_addr learned my addr 10.20.193.4:0/4263945369 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903dd74640 1 --2- 10.20.193.4:0/4263945369 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fd5e690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903ed76640 1 -- 10.20.193.4:0/4263945369 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 msgr2=0x55769fd5e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903ed76640 1 --2- 10.20.193.4:0/4263945369 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd5e150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903ed76640 1 -- 10.20.193.4:0/4263945369 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 msgr2=0x55769fd5e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903ed76640 1 --2- 10.20.193.4:0/4263945369 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fd5e690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903ed76640 1 -- 10.20.193.4:0/4263945369 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769fd6e3b0 con 0x55769fd61680 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903dd74640 1 --2- 10.20.193.4:0/4263945369 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fd5e690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f903ed76640 1 --2- 10.20.193.4:0/4263945369 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd61680 0x55769fd5ebd0 secure :-1 s=READY pgs=1302 gs=1 cs=0 l=1 c_cookie=5123483317208827897 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9030008e10 tx=0x7f9030020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471a44ee7edf47f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f900a4e6640 1 -- 10.20.193.4:0/4263945369 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9030017040 con 0x55769fd61680 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f900a4e6640 1 -- 10.20.193.4:0/4263945369 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55769f9754a0 con 0x55769fd61680 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.047+0000 7f900a4e6640 1 -- 10.20.193.4:0/4263945369 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90300053e0 con 0x55769fd61680 2026-02-24T09:20:09.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.048+0000 7f9046f90e00 1 -- 10.20.193.4:0/4263945369 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd61680 msgr2=0x55769fd5ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.048+0000 7f9046f90e00 1 --2- 10.20.193.4:0/4263945369 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd61680 0x55769fd5ebd0 secure :-1 s=READY pgs=1302 gs=1 cs=0 l=1 c_cookie=5123483317208827897 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9030008e10 tx=0x7f9030020000 comp rx=0 tx=0).stop 2026-02-24T09:20:09.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.048+0000 7f9046f90e00 1 -- 10.20.193.4:0/4263945369 shutdown_connections 2026-02-24T09:20:09.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.048+0000 7f9046f90e00 1 --2- 10.20.193.4:0/4263945369 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd61680 0x55769fd5ebd0 unknown :-1 s=CLOSED pgs=1302 gs=1 cs=0 l=1 c_cookie=5123483317208827897 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.048+0000 7f9046f90e00 1 --2- 10.20.193.4:0/4263945369 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fd5e690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.048+0000 7f9046f90e00 1 --2- 10.20.193.4:0/4263945369 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd1ef50 0x55769fd5e150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.048+0000 7f9046f90e00 1 -- 10.20.193.4:0/4263945369 >> 10.20.193.4:0/4263945369 conn(0x55769fc3ddb0 msgr2=0x55769fd78130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.048+0000 7f9046f90e00 1 -- 10.20.193.4:0/4263945369 shutdown_connections 2026-02-24T09:20:09.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.048+0000 7f9046f90e00 1 -- 10.20.193.4:0/4263945369 wait complete. 2026-02-24T09:20:09.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 1 -- start start 2026-02-24T09:20:09.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 1 Processor -- start 2026-02-24T09:20:09.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1ef50 0x55769fcfe640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fcfeb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd61680 0x55769fcff0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55769fdc9ee0 con 0x55769fd1ef50 2026-02-24T09:20:09.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55769fdca050 con 0x55769fd1f860 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55769fdca210 con 0x55769fd61680 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1ef50 0x55769fcfe640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1ef50 0x55769fcfe640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39342/0 (socket says 10.20.193.4:39342) 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903e575640 1 -- 10.20.193.4:0/2358901003 learned_addr learned my addr 10.20.193.4:0/2358901003 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903dd74640 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fcfeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903e575640 1 -- 10.20.193.4:0/2358901003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd61680 msgr2=0x55769fcff0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903e575640 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd61680 0x55769fcff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903e575640 1 -- 10.20.193.4:0/2358901003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 msgr2=0x55769fcfeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903e575640 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fcfeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903e575640 1 -- 10.20.193.4:0/2358901003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769fbbb710 con 0x55769fd1ef50 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903dd74640 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fcfeb80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:09.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f903e575640 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1ef50 0x55769fcfe640 secure :-1 s=READY pgs=1303 gs=1 cs=0 l=1 c_cookie=503571201658131704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9034005e30 tx=0x7f9034004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd0b5701f314f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f8feffff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f8feffff640 1 -- 10.20.193.4:0/2358901003 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9034004a70 con 0x55769fd1ef50 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f8feffff640 1 -- 10.20.193.4:0/2358901003 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9034023040 con 0x55769fd1ef50 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 1 -- 10.20.193.4:0/2358901003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55769fba99d0 con 0x55769fd1ef50 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f8feffff640 1 -- 10.20.193.4:0/2358901003 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f903402bb60 con 0x55769fd1ef50 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 10 client.18282 _ll_register_callbacks cb 0x55769fbd0080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f9046f90e00 1 -- 10.20.193.4:0/2358901003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90280d71b0 con 0x55769fd1ef50 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.049+0000 7f8feffff640 1 -- 10.20.193.4:0/2358901003 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f903402bcf0 con 0x55769fd1ef50 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f8feffff640 1 -- 10.20.193.4:0/2358901003 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f903401d410 con 0x55769fd1ef50 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f9046f90e00 10 client.18282 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f9046f90e00 1 -- 10.20.193.4:0/2358901003 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55769fbb6190 con 0x55769fd1ef50 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f8feffff640 1 -- 10.20.193.4:0/2358901003 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f9034028070 con 0x55769fd1ef50 2026-02-24T09:20:09.059 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f9046f90e00 10 client.18282 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f9046f90e00 10 client.18282 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f9046f90e00 20 client.18282 populate_metadata read hostname 'trial004' 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f9046f90e00 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55769fd64500 0x55769fe324b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f9046f90e00 4 client.18282 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f9046f90e00 1 -- 10.20.193.4:0/2358901003 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55769f95a160 con 0x55769fd64500 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f903dd74640 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55769fd64500 0x55769fe324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f903dd74640 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55769fd64500 0x55769fe324b0 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=6525373953788583521 s_cookie=11086748050277503002 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a8ec909be279e61 server_cookie=99dc0a9c930b901a in_seq=0 out_seq=0 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f8feffff640 10 client.18282 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f8feffff640 1 -- 10.20.193.4:0/2358901003 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55769f95a160 con 0x55769fd64500 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.050+0000 7f8feffff640 10 client.18282 handle_command_reply: tid=0 2026-02-24T09:20:09.060 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 client.18282 shutdown 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 -- 10.20.193.4:0/2358901003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1ef50 msgr2=0x55769fcfe640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1ef50 0x55769fcfe640 secure :-1 s=READY pgs=1303 gs=1 cs=0 l=1 c_cookie=503571201658131704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9034005e30 tx=0x7f9034004770 comp rx=0 tx=0).stop 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 -- 10.20.193.4:0/2358901003 shutdown_connections 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55769fd64500 0x55769fe324b0 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=6525373953788583521 s_cookie=11086748050277503002 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55769fd61680 0x55769fcff0c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55769fd1f860 0x55769fcfeb80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f8feffff640 0 client.18282 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 --2- 10.20.193.4:0/2358901003 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55769fd1ef50 0x55769fcfe640 unknown :-1 s=CLOSED pgs=1303 gs=1 cs=0 l=1 c_cookie=503571201658131704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 -- 10.20.193.4:0/2358901003 >> 10.20.193.4:0/2358901003 conn(0x55769fc3ddb0 msgr2=0x55769fd78920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 -- 10.20.193.4:0/2358901003 shutdown_connections 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 1 -- 10.20.193.4:0/2358901003 wait complete. 2026-02-24T09:20:09.061 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9046f90e00 20 client.18282 trim_cache size 0 max 16384 2026-02-24T09:20:09.062 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9044f96640 1 -- 10.20.193.4:0/529236238 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90180b5750 msgr2=0x7f90180d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9044f96640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90180b5750 0x7f90180d5c00 secure :-1 s=READY pgs=456 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9034004740 tx=0x7f90340073d0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9044f96640 1 -- 10.20.193.4:0/529236238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f904010ddc0 msgr2=0x7f9040173e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.051+0000 7f9044f96640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f904010ddc0 0x7f9040173e90 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f902802f6e0 tx=0x7f9028004300 comp rx=0 tx=0).stop 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.052+0000 7f9044f96640 1 -- 10.20.193.4:0/529236238 shutdown_connections 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.052+0000 7f9044f96640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f90180b5750 0x7f90180d5c00 unknown :-1 s=CLOSED pgs=456 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.052+0000 7f9044f96640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f90401135c0 0x7f90400f3d50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.052+0000 7f9044f96640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f904010ddc0 0x7f9040173e90 unknown :-1 s=CLOSED pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.052+0000 7f9044f96640 1 --2- 10.20.193.4:0/529236238 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f904010d3d0 0x7f90400f3650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.052+0000 7f9044f96640 1 -- 10.20.193.4:0/529236238 >> 10.20.193.4:0/529236238 conn(0x7f90400eaca0 msgr2=0x7f904010b860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.063 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.052+0000 7f9044f96640 1 -- 10.20.193.4:0/529236238 shutdown_connections 2026-02-24T09:20:09.064 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.052+0000 7f9044f96640 1 -- 10.20.193.4:0/529236238 wait complete. 2026-02-24T09:20:09.148 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:20:09.301 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:09.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:08 trial090 ceph-mon[47278]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 870 MiB/s wr, 555 op/s 2026-02-24T09:20:09.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:08 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2705677322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:09.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:08 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4161046204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:09.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:08 trial014 ceph-mon[46941]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 870 MiB/s wr, 555 op/s 2026-02-24T09:20:09.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:08 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2705677322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:09.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:08 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4161046204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:09.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1152542312 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7e0c110040 msgr2=0x7f7e0c115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 --2- 10.20.193.4:0/1152542312 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7e0c110040 0x7f7e0c115090 secure :-1 s=READY pgs=1304 gs=1 cs=0 l=1 c_cookie=15459466315034282977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e00009950 tx=0x7f7e0002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.444 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1152542312 shutdown_connections 2026-02-24T09:20:09.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 --2- 10.20.193.4:0/1152542312 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7e0c115840 0x7f7e0c176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 --2- 10.20.193.4:0/1152542312 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7e0c110040 0x7f7e0c115090 unknown :-1 s=CLOSED pgs=1304 gs=1 cs=0 l=1 c_cookie=15459466315034282977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 --2- 10.20.193.4:0/1152542312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7e0c10f650 0x7f7e0c10fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1152542312 >> 10.20.193.4:0/1152542312 conn(0x7f7e0c0ecf20 msgr2=0x7f7e0c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1152542312 shutdown_connections 2026-02-24T09:20:09.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1152542312 wait complete. 2026-02-24T09:20:09.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 Processor -- start 2026-02-24T09:20:09.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 -- start start 2026-02-24T09:20:09.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7e0c10f650 0x7f7e0c0f5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.445 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7e0c110040 0x7f7e0c176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7e0c115840 0x7f7e0c0f5f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c0fb1a0 con 0x7f7e0c10f650 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c0fb310 con 0x7f7e0c115840 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e13dc6640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c0fb4d0 con 0x7f7e0c110040 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e11b3b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7e0c10f650 0x7f7e0c0f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e11b3b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7e0c10f650 0x7f7e0c0f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39356/0 (socket says 10.20.193.4:39356) 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e11b3b640 1 -- 10.20.193.4:0/1482858863 learned_addr learned my addr 10.20.193.4:0/1482858863 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.440+0000 7f7e1233c640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7e0c115840 0x7f7e0c0f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7e1133a640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7e0c110040 0x7f7e0c176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7e11b3b640 1 -- 10.20.193.4:0/1482858863 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7e0c110040 msgr2=0x7f7e0c176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7e0c110040 0x7f7e0c176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.446 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7e11b3b640 1 -- 10.20.193.4:0/1482858863 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7e0c115840 msgr2=0x7f7e0c0f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7e0c115840 0x7f7e0c0f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7e11b3b640 1 -- 10.20.193.4:0/1482858863 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc0094b0 con 0x7f7e0c10f650 2026-02-24T09:20:09.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7e0c10f650 0x7f7e0c0f5890 secure :-1 s=READY pgs=1305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dfc009fd0 tx=0x7f7dfc002bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7dfaffd640 1 -- 10.20.193.4:0/1482858863 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dfc00ed60 con 0x7f7e0c10f650 2026-02-24T09:20:09.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1482858863 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e00009570 con 0x7f7e0c10f650 2026-02-24T09:20:09.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7dfaffd640 1 -- 10.20.193.4:0/1482858863 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7dfc002e20 con 0x7f7e0c10f650 2026-02-24T09:20:09.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7dfaffd640 1 -- 10.20.193.4:0/1482858863 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dfc018880 con 0x7f7e0c10f650 2026-02-24T09:20:09.447 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.441+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1482858863 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0c0fbb40 con 0x7f7e0c10f650 2026-02-24T09:20:09.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.443+0000 7f7dfaffd640 1 -- 10.20.193.4:0/1482858863 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f7dfc016020 con 0x7f7e0c10f650 2026-02-24T09:20:09.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.444+0000 7f7dfaffd640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7de80b56d0 0x7f7de80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.448 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.444+0000 7f7dfaffd640 1 -- 10.20.193.4:0/1482858863 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f7dfc0e7ec0 con 0x7f7e0c10f650 2026-02-24T09:20:09.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.444+0000 7f7e1133a640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7de80b56d0 0x7f7de80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.449 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.445+0000 7f7e1133a640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7de80b56d0 0x7f7de80d5b80 secure :-1 s=READY pgs=457 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e000023d0 tx=0x7f7e00031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e15dc0e00 1 Processor -- start 2026-02-24T09:20:09.451 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e15dc0e00 1 -- start start 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43bf50 0x55f70e43c320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43c860 0x55f70e480fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e481500 0x55f70e4a18e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f70e34cee0 con 0x55f70e43c860 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f70e348c10 con 0x55f70e43bf50 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f70e342d70 con 0x55f70e481500 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e1133a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43c860 0x55f70e480fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e1133a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43c860 0x55f70e480fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39370/0 (socket says 10.20.193.4:39370) 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e1133a640 1 -- 10.20.193.4:0/2874163470 learned_addr learned my addr 10.20.193.4:0/2874163470 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/2874163470 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43bf50 0x55f70e43c320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e1233c640 1 --2- 10.20.193.4:0/2874163470 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e481500 0x55f70e4a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.452 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e1133a640 1 -- 10.20.193.4:0/2874163470 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e481500 msgr2=0x55f70e4a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e1133a640 1 --2- 10.20.193.4:0/2874163470 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e481500 0x55f70e4a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e1133a640 1 -- 10.20.193.4:0/2874163470 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43bf50 msgr2=0x55f70e43c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e1133a640 1 --2- 10.20.193.4:0/2874163470 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43bf50 0x55f70e43c320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e1133a640 1 -- 10.20.193.4:0/2874163470 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70e2ee340 con 0x55f70e43c860 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/2874163470 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43bf50 0x55f70e43c320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7e1133a640 1 --2- 10.20.193.4:0/2874163470 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43c860 0x55f70e480fc0 secure :-1 s=READY pgs=1306 gs=1 cs=0 l=1 c_cookie=2775288022397330931 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e00009950 tx=0x7f7e00040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2683cdc09463a5f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7dda4e6640 1 -- 10.20.193.4:0/2874163470 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e00002980 con 0x55f70e43c860 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7dda4e6640 1 -- 10.20.193.4:0/2874163470 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7e00002ae0 con 0x55f70e43c860 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.447+0000 7f7dda4e6640 1 -- 10.20.193.4:0/2874163470 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e0004f810 con 0x55f70e43c860 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.448+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2874163470 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43c860 msgr2=0x55f70e480fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.448+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/2874163470 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43c860 0x55f70e480fc0 secure :-1 s=READY pgs=1306 gs=1 cs=0 l=1 c_cookie=2775288022397330931 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e00009950 tx=0x7f7e00040000 comp rx=0 tx=0).stop 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.448+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2874163470 shutdown_connections 2026-02-24T09:20:09.453 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.448+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/2874163470 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e481500 0x55f70e4a18e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.448+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/2874163470 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43c860 0x55f70e480fc0 unknown :-1 s=CLOSED pgs=1306 gs=1 cs=0 l=1 c_cookie=2775288022397330931 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.448+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/2874163470 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43bf50 0x55f70e43c320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.448+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2874163470 >> 10.20.193.4:0/2874163470 conn(0x55f70e35adb0 msgr2=0x55f70e43a830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.448+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2874163470 shutdown_connections 2026-02-24T09:20:09.454 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.448+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2874163470 wait complete. 2026-02-24T09:20:09.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.449+0000 7f7e15dc0e00 1 -- start start 2026-02-24T09:20:09.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e15dc0e00 1 Processor -- start 2026-02-24T09:20:09.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e498d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 0x55f70e4992a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e481500 0x55f70e49e290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f70e49e7d0 con 0x55f70e43bf50 2026-02-24T09:20:09.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f70e49e940 con 0x55f70e43c860 2026-02-24T09:20:09.458 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f70e49eb00 con 0x55f70e481500 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e11b3b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e498d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e11b3b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e498d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39374/0 (socket says 10.20.193.4:39374) 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e11b3b640 1 -- 10.20.193.4:0/3687958793 learned_addr learned my addr 10.20.193.4:0/3687958793 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e1233c640 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e481500 0x55f70e49e290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e1133a640 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 0x55f70e4992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e11b3b640 1 -- 10.20.193.4:0/3687958793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e481500 msgr2=0x55f70e49e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e481500 0x55f70e49e290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e11b3b640 1 -- 10.20.193.4:0/3687958793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 msgr2=0x55f70e4992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 0x55f70e4992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e11b3b640 1 -- 10.20.193.4:0/3687958793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70e2c69d0 con 0x55f70e43bf50 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e498d60 secure :-1 s=READY pgs=1307 gs=1 cs=0 l=1 c_cookie=13656355304030329066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dfc0e5a20 tx=0x7f7dfc0ae3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd851ecb673fd8ea server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.459 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7dc77fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7dc77fe640 1 -- 10.20.193.4:0/3687958793 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dfc076070 con 0x55f70e43bf50 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7dc77fe640 1 -- 10.20.193.4:0/3687958793 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7dfc0b3f50 con 0x55f70e43bf50 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7dc77fe640 1 -- 10.20.193.4:0/3687958793 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dfc0b8ee0 con 0x55f70e43bf50 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.450+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/3687958793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0c176a80 con 0x55f70e43bf50 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7dc77fe640 1 -- 10.20.193.4:0/3687958793 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f7dfc0e5e40 con 0x55f70e43bf50 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7dc77fe640 10 client.18294 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e15dc0e00 10 client.18294 _ll_register_callbacks cb 0x55f70e2ed080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/3687958793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f70e0924a0 con 0x55f70e43bf50 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7dc77fe640 1 -- 10.20.193.4:0/3687958793 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7dfc0b6530 con 0x55f70e43bf50 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e15dc0e00 10 client.18294 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/3687958793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f70e2d8710 con 0x55f70e43bf50 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7dc77fe640 1 -- 10.20.193.4:0/3687958793 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f7dfc073330 con 0x55f70e43bf50 2026-02-24T09:20:09.460 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e15dc0e00 10 client.18294 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e15dc0e00 10 client.18294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e15dc0e00 20 client.18294 populate_metadata read hostname 'trial004' 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f70e47e670 0x55f70e47eae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e15dc0e00 4 client.18294 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/3687958793 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f70e3387b0 con 0x55f70e47e670 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.451+0000 7f7e1133a640 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f70e47e670 0x55f70e47eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.452+0000 7f7e1133a640 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f70e47e670 0x55f70e47eae0 crc :-1 s=READY pgs=223 gs=4 cs=0 l=0 c_cookie=11786564234304139123 s_cookie=9929051672366252837 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a39249b92405af73 server_cookie=89cb13e3bfe38325 in_seq=0 out_seq=0 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.452+0000 7f7dc77fe640 10 client.18294 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.452+0000 7f7dc77fe640 1 -- 10.20.193.4:0/3687958793 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f70e3387b0 con 0x55f70e47e670 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.452+0000 7f7dc77fe640 10 client.18294 handle_command_reply: tid=0 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.452+0000 7f7e15dc0e00 1 client.18294 shutdown 2026-02-24T09:20:09.461 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/3687958793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 msgr2=0x55f70e498d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e498d60 secure :-1 s=READY pgs=1307 gs=1 cs=0 l=1 c_cookie=13656355304030329066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dfc0e5a20 tx=0x7f7dfc0ae3b0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/3687958793 shutdown_connections 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f70e47e670 0x55f70e47eae0 crc :-1 s=READY pgs=223 gs=4 cs=0 l=0 c_cookie=11786564234304139123 s_cookie=9929051672366252837 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e481500 0x55f70e49e290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7dc77fe640 0 client.18294 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 0x55f70e4992a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/3687958793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e498d60 unknown :-1 s=CLOSED pgs=1307 gs=1 cs=0 l=1 c_cookie=13656355304030329066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/3687958793 >> 10.20.193.4:0/3687958793 conn(0x55f70e35adb0 msgr2=0x55f70e43a040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/3687958793 shutdown_connections 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/3687958793 wait complete. 2026-02-24T09:20:09.462 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.453+0000 7f7e15dc0e00 20 client.18294 trim_cache size 0 max 16384 2026-02-24T09:20:09.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e15dc0e00 1 Processor -- start 2026-02-24T09:20:09.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e15dc0e00 1 -- start start 2026-02-24T09:20:09.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e49d800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 0x55f70e47c110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e47e670 0x55f70e47c650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f70e49e690 con 0x55f70e43bf50 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f70e3409a0 con 0x55f70e43c860 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f70e11cdf0 con 0x55f70e47e670 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e11b3b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e49d800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e11b3b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e49d800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39378/0 (socket says 10.20.193.4:39378) 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e11b3b640 1 -- 10.20.193.4:0/4159859871 learned_addr learned my addr 10.20.193.4:0/4159859871 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e1233c640 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e47e670 0x55f70e47c650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e1133a640 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 0x55f70e47c110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e11b3b640 1 -- 10.20.193.4:0/4159859871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e47e670 msgr2=0x55f70e47c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e47e670 0x55f70e47c650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e11b3b640 1 -- 10.20.193.4:0/4159859871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 msgr2=0x55f70e47c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 0x55f70e47c110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e11b3b640 1 -- 10.20.193.4:0/4159859871 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70e43bdc0 con 0x55f70e43bf50 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e1233c640 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e47e670 0x55f70e47c650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e1133a640 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 0x55f70e47c110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e49d800 secure :-1 s=READY pgs=1308 gs=1 cs=0 l=1 c_cookie=4654762702099314782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dfc00e720 tx=0x7f7dfc079000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40990a03fc5df85e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7dd9ce5640 1 -- 10.20.193.4:0/4159859871 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dfc076040 con 0x55f70e43bf50 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7dd9ce5640 1 -- 10.20.193.4:0/4159859871 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55f70e0924a0 con 0x55f70e43bf50 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.461+0000 7f7dd9ce5640 1 -- 10.20.193.4:0/4159859871 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dfc071020 con 0x55f70e43bf50 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/4159859871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 msgr2=0x55f70e49d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e49d800 secure :-1 s=READY pgs=1308 gs=1 cs=0 l=1 c_cookie=4654762702099314782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dfc00e720 tx=0x7f7dfc079000 comp rx=0 tx=0).stop 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/4159859871 shutdown_connections 2026-02-24T09:20:09.470 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e47e670 0x55f70e47c650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e43c860 0x55f70e47c110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/4159859871 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e49d800 unknown :-1 s=CLOSED pgs=1308 gs=1 cs=0 l=1 c_cookie=4654762702099314782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/4159859871 >> 10.20.193.4:0/4159859871 conn(0x55f70e35adb0 msgr2=0x55f70e49d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/4159859871 shutdown_connections 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/4159859871 wait complete. 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 -- start start 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.462+0000 7f7e15dc0e00 1 Processor -- start 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e4963a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e43c860 0x55f70e4968e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e47e670 0x55f70e41a030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f70e11cdf0 con 0x55f70e43bf50 2026-02-24T09:20:09.471 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f70e4172a0 con 0x55f70e47e670 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f70e41a5a0 con 0x55f70e43c860 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e11b3b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e4963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e11b3b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e4963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39380/0 (socket says 10.20.193.4:39380) 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e11b3b640 1 -- 10.20.193.4:0/2197861910 learned_addr learned my addr 10.20.193.4:0/2197861910 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e1233c640 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e47e670 0x55f70e41a030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e1133a640 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e43c860 0x55f70e4968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e11b3b640 1 -- 10.20.193.4:0/2197861910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e43c860 msgr2=0x55f70e4968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e43c860 0x55f70e4968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e11b3b640 1 -- 10.20.193.4:0/2197861910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e47e670 msgr2=0x55f70e41a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e47e670 0x55f70e41a030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e11b3b640 1 -- 10.20.193.4:0/2197861910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70e2d3190 con 0x55f70e43bf50 2026-02-24T09:20:09.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e11b3b640 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e4963a0 secure :-1 s=READY pgs=1309 gs=1 cs=0 l=1 c_cookie=619006600975469552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dfc0ae210 tx=0x7f7dfc0b40a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897273954c3cbf0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7dc77fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7dc77fe640 1 -- 10.20.193.4:0/2197861910 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dfc076040 con 0x55f70e43bf50 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2197861910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70e2d8710 con 0x55f70e43bf50 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7dc77fe640 1 -- 10.20.193.4:0/2197861910 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7dfc0b9370 con 0x55f70e43bf50 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7dc77fe640 1 -- 10.20.193.4:0/2197861910 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dfc0ac210 con 0x55f70e43bf50 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 10 client.18300 _ll_register_callbacks cb 0x55f70e2ed080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2197861910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e00002ae0 con 0x55f70e43bf50 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7dc77fe640 1 -- 10.20.193.4:0/2197861910 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f7dfc0e5e40 con 0x55f70e43bf50 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7dc77fe640 1 -- 10.20.193.4:0/2197861910 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7dfc0ac370 con 0x55f70e43bf50 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 10 client.18300 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2197861910 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f70e2c6d00 con 0x55f70e43bf50 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7dc77fe640 1 -- 10.20.193.4:0/2197861910 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f7dfc0cc030 con 0x55f70e43bf50 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 10 client.18300 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:09.473 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 10 client.18300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 20 client.18300 populate_metadata read hostname 'trial004' 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f70e481500 0x55f70e41f970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 4 client.18300 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.463+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2197861910 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f70e077160 con 0x55f70e481500 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.464+0000 7f7e1133a640 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f70e481500 0x55f70e41f970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.464+0000 7f7dc77fe640 10 client.18300 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.464+0000 7f7e1133a640 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f70e481500 0x55f70e41f970 crc :-1 s=READY pgs=224 gs=4 cs=0 l=0 c_cookie=13996884747238474633 s_cookie=9278009112753575373 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c23eec84d93b8389 server_cookie=80c21c218c8395cd in_seq=0 out_seq=0 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7dc77fe640 1 -- 10.20.193.4:0/2197861910 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f70e077160 con 0x55f70e481500 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7dc77fe640 10 client.18300 handle_command_reply: tid=0 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 client.18300 shutdown 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2197861910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 msgr2=0x55f70e4963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e4963a0 secure :-1 s=READY pgs=1309 gs=1 cs=0 l=1 c_cookie=619006600975469552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dfc0ae210 tx=0x7f7dfc0b40a0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2197861910 shutdown_connections 2026-02-24T09:20:09.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f70e481500 0x55f70e41f970 crc :-1 s=READY pgs=224 gs=4 cs=0 l=0 c_cookie=13996884747238474633 s_cookie=9278009112753575373 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f70e47e670 0x55f70e41a030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f70e43c860 0x55f70e4968e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7dc77fe640 0 client.18300 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:09.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 --2- 10.20.193.4:0/2197861910 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f70e43bf50 0x55f70e4963a0 unknown :-1 s=CLOSED pgs=1309 gs=1 cs=0 l=1 c_cookie=619006600975469552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2197861910 >> 10.20.193.4:0/2197861910 conn(0x55f70e35adb0 msgr2=0x55f70e495910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2197861910 shutdown_connections 2026-02-24T09:20:09.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 1 -- 10.20.193.4:0/2197861910 wait complete. 2026-02-24T09:20:09.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e15dc0e00 20 client.18300 trim_cache size 0 max 16384 2026-02-24T09:20:09.476 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:20:09.476 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1482858863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7de80b56d0 msgr2=0x7f7de80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7de80b56d0 0x7f7de80d5b80 secure :-1 s=READY pgs=457 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e000023d0 tx=0x7f7e00031040 comp rx=0 tx=0).stop 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1482858863 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7e0c10f650 msgr2=0x7f7e0c0f5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7e0c10f650 0x7f7e0c0f5890 secure :-1 s=READY pgs=1305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dfc009fd0 tx=0x7f7dfc002bc0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1482858863 shutdown_connections 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f7de80b56d0 0x7f7de80d5b80 unknown :-1 s=CLOSED pgs=457 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f7e0c115840 0x7f7e0c0f5f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7e0c110040 0x7f7e0c176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 --2- 10.20.193.4:0/1482858863 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f7e0c10f650 0x7f7e0c0f5890 unknown :-1 s=CLOSED pgs=1305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1482858863 >> 10.20.193.4:0/1482858863 conn(0x7f7e0c0ecf20 msgr2=0x7f7e0c111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1482858863 shutdown_connections 2026-02-24T09:20:09.477 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:09.465+0000 7f7e13dc6640 1 -- 10.20.193.4:0/1482858863 wait complete. 2026-02-24T09:20:10.568 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:20:10.568 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:20:10.745 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:10.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.890+0000 7fce6730a640 1 -- 10.20.193.4:0/4207394835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce6010bf60 msgr2=0x7fce6010c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:10.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.890+0000 7fce6730a640 1 --2- 10.20.193.4:0/4207394835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce6010bf60 0x7fce6010c330 secure :-1 s=READY pgs=1310 gs=1 cs=0 l=1 c_cookie=11815310999642330156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce50009980 tx=0x7fce5002f180 comp rx=0 tx=0).stop 2026-02-24T09:20:10.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.890+0000 7fce6730a640 1 -- 10.20.193.4:0/4207394835 shutdown_connections 2026-02-24T09:20:10.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.890+0000 7fce6730a640 1 --2- 10.20.193.4:0/4207394835 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce60111540 0x7fce601119e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.890+0000 7fce6730a640 1 --2- 10.20.193.4:0/4207394835 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce6010c950 0x7fce60110f20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.890+0000 7fce6730a640 1 --2- 10.20.193.4:0/4207394835 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce6010bf60 0x7fce6010c330 unknown :-1 s=CLOSED pgs=1310 gs=1 cs=0 l=1 c_cookie=11815310999642330156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.895 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.890+0000 7fce6730a640 1 -- 10.20.193.4:0/4207394835 >> 10.20.193.4:0/4207394835 conn(0x7fce600e9bf0 msgr2=0x7fce6010a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.890+0000 7fce6730a640 1 -- 10.20.193.4:0/4207394835 shutdown_connections 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.890+0000 7fce6730a640 1 -- 10.20.193.4:0/4207394835 wait complete. 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6730a640 1 Processor -- start 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6730a640 1 -- start start 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6730a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce6010bf60 0x7fce60122920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6730a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce6010c950 0x7fce60122e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6730a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce60111540 0x7fce60128230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6730a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fce60128850 con 0x7fce60111540 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6730a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fce601289c0 con 0x7fce6010bf60 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6730a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce60128b80 con 0x7fce6010c950 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce65880640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce60111540 0x7fce60128230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce65880640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce60111540 0x7fce60128230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39392/0 (socket says 10.20.193.4:39392) 2026-02-24T09:20:10.896 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce65880640 1 -- 10.20.193.4:0/1888652552 learned_addr learned my addr 10.20.193.4:0/1888652552 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6487e640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce6010c950 0x7fce60122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6507f640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce6010bf60 0x7fce60122920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce65880640 1 -- 10.20.193.4:0/1888652552 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce6010c950 msgr2=0x7fce60122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce65880640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce6010c950 0x7fce60122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce65880640 1 -- 10.20.193.4:0/1888652552 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce6010bf60 msgr2=0x7fce60122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce65880640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce6010bf60 0x7fce60122920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce65880640 1 -- 10.20.193.4:0/1888652552 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce50009570 con 0x7fce60111540 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6507f640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce6010bf60 0x7fce60122920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce65880640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce60111540 0x7fce60128230 secure :-1 s=READY pgs=1311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce5c006e90 tx=0x7fce5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce4e7fc640 1 -- 10.20.193.4:0/1888652552 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce5c005500 con 0x7fce60111540 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6730a640 1 -- 10.20.193.4:0/1888652552 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce60128e60 con 0x7fce60111540 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce4e7fc640 1 -- 10.20.193.4:0/1888652552 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce5c005e10 con 0x7fce60111540 2026-02-24T09:20:10.897 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce4e7fc640 1 -- 10.20.193.4:0/1888652552 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce5c0039e0 con 0x7fce60111540 2026-02-24T09:20:10.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.891+0000 7fce6730a640 1 -- 10.20.193.4:0/1888652552 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce60169560 con 0x7fce60111540 2026-02-24T09:20:10.898 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.894+0000 7fce4e7fc640 1 -- 10.20.193.4:0/1888652552 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fce5c00c8d0 con 0x7fce60111540 2026-02-24T09:20:10.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.895+0000 7fce4e7fc640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce3c0b56e0 0x7fce3c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.895+0000 7fce4e7fc640 1 -- 10.20.193.4:0/1888652552 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fce5c0e79b0 con 0x7fce60111540 2026-02-24T09:20:10.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.895+0000 7fce6507f640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce3c0b56e0 0x7fce3c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.899 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.895+0000 7fce6507f640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce3c0b56e0 0x7fce3c0d5b90 secure :-1 s=READY pgs=458 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce50009950 tx=0x7fce50031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:10.909 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce69304e00 1 Processor -- start 2026-02-24T09:20:10.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce69304e00 1 -- start start 2026-02-24T09:20:10.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce69304e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6300 0x55833c0b66d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce69304e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6c10 0x55833c0fb370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce69304e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0fb8b0 0x55833c11bc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.910 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce69304e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55833bfc6520 con 0x55833c0b6c10 2026-02-24T09:20:10.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce69304e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55833bfc2250 con 0x55833c0b6300 2026-02-24T09:20:10.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce69304e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55833bfbc3b0 con 0x55833c0fb8b0 2026-02-24T09:20:10.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6487e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6c10 0x55833c0fb370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6487e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6c10 0x55833c0fb370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39402/0 (socket says 10.20.193.4:39402) 2026-02-24T09:20:10.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6487e640 1 -- 10.20.193.4:0/364870100 learned_addr learned my addr 10.20.193.4:0/364870100 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:10.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce65880640 1 --2- 10.20.193.4:0/364870100 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0fb8b0 0x55833c11bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.911 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6507f640 1 --2- 10.20.193.4:0/364870100 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6300 0x55833c0b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6487e640 1 -- 10.20.193.4:0/364870100 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0fb8b0 msgr2=0x55833c11bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:10.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6487e640 1 --2- 10.20.193.4:0/364870100 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0fb8b0 0x55833c11bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6487e640 1 -- 10.20.193.4:0/364870100 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6300 msgr2=0x55833c0b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:10.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6487e640 1 --2- 10.20.193.4:0/364870100 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6300 0x55833c0b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6487e640 1 -- 10.20.193.4:0/364870100 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55833bf676e0 con 0x55833c0b6c10 2026-02-24T09:20:10.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6507f640 1 --2- 10.20.193.4:0/364870100 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6300 0x55833c0b66d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:10.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce6487e640 1 --2- 10.20.193.4:0/364870100 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6c10 0x55833c0fb370 secure :-1 s=READY pgs=1312 gs=1 cs=0 l=1 c_cookie=16549478050691286497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce54002b60 tx=0x7fce5400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ab8e9aad9405e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:10.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce2dce5640 1 -- 10.20.193.4:0/364870100 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce54002e80 con 0x55833c0b6c10 2026-02-24T09:20:10.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce2dce5640 1 -- 10.20.193.4:0/364870100 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce5400fe50 con 0x55833c0b6c10 2026-02-24T09:20:10.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.898+0000 7fce2dce5640 1 -- 10.20.193.4:0/364870100 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce54010920 con 0x55833c0b6c10 2026-02-24T09:20:10.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.899+0000 7fce69304e00 1 -- 10.20.193.4:0/364870100 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6c10 msgr2=0x55833c0fb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:10.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.899+0000 7fce69304e00 1 --2- 10.20.193.4:0/364870100 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6c10 0x55833c0fb370 secure :-1 s=READY pgs=1312 gs=1 cs=0 l=1 c_cookie=16549478050691286497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce54002b60 tx=0x7fce5400f730 comp rx=0 tx=0).stop 2026-02-24T09:20:10.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.899+0000 7fce69304e00 1 -- 10.20.193.4:0/364870100 shutdown_connections 2026-02-24T09:20:10.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.899+0000 7fce69304e00 1 --2- 10.20.193.4:0/364870100 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0fb8b0 0x55833c11bc90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.899+0000 7fce69304e00 1 --2- 10.20.193.4:0/364870100 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6c10 0x55833c0fb370 unknown :-1 s=CLOSED pgs=1312 gs=1 cs=0 l=1 c_cookie=16549478050691286497 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.899+0000 7fce69304e00 1 --2- 10.20.193.4:0/364870100 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6300 0x55833c0b66d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.899+0000 7fce69304e00 1 -- 10.20.193.4:0/364870100 >> 10.20.193.4:0/364870100 conn(0x55833bfd44f0 msgr2=0x55833c0b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:10.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.899+0000 7fce69304e00 1 -- 10.20.193.4:0/364870100 shutdown_connections 2026-02-24T09:20:10.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.899+0000 7fce69304e00 1 -- 10.20.193.4:0/364870100 wait complete. 2026-02-24T09:20:10.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce69304e00 1 -- start start 2026-02-24T09:20:10.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce69304e00 1 Processor -- start 2026-02-24T09:20:10.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce69304e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6300 0x55833c0ce4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce69304e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6c10 0x55833c0ce9f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce69304e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0fb8b0 0x55833c0d39e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce69304e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55833c0d3f20 con 0x55833c0b6300 2026-02-24T09:20:10.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce69304e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55833c0d4090 con 0x55833c0fb8b0 2026-02-24T09:20:10.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce69304e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55833c0d4250 con 0x55833c0b6c10 2026-02-24T09:20:10.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce6507f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6300 0x55833c0ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce6507f640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6300 0x55833c0ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39410/0 (socket says 10.20.193.4:39410) 2026-02-24T09:20:10.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce6487e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6c10 0x55833c0ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce6507f640 1 -- 10.20.193.4:0/2439013500 learned_addr learned my addr 10.20.193.4:0/2439013500 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:10.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce65880640 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0fb8b0 0x55833c0d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce6507f640 1 -- 10.20.193.4:0/2439013500 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6c10 msgr2=0x55833c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:10.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce6507f640 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6c10 0x55833c0ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce6507f640 1 -- 10.20.193.4:0/2439013500 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0fb8b0 msgr2=0x55833c0d39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:10.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce6507f640 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0fb8b0 0x55833c0d39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.900+0000 7fce6507f640 1 -- 10.20.193.4:0/2439013500 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55833bf3fcd0 con 0x55833c0b6300 2026-02-24T09:20:10.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce6507f640 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6300 0x55833c0ce4b0 secure :-1 s=READY pgs=1313 gs=1 cs=0 l=1 c_cookie=10071222404344866609 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce50038600 tx=0x7fce5002f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc42b6ac8ee6731 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:10.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce1affd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:10.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce1affd640 1 -- 10.20.193.4:0/2439013500 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce50038b70 con 0x55833c0b6300 2026-02-24T09:20:10.917 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce1affd640 1 -- 10.20.193.4:0/2439013500 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce5004a070 con 0x55833c0b6300 2026-02-24T09:20:10.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 1 -- 10.20.193.4:0/2439013500 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce54002780 con 0x55833c0b6300 2026-02-24T09:20:10.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce1affd640 1 -- 10.20.193.4:0/2439013500 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce50043680 con 0x55833c0b6300 2026-02-24T09:20:10.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce1affd640 1 -- 10.20.193.4:0/2439013500 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fce50043810 con 0x55833c0b6300 2026-02-24T09:20:10.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce1affd640 10 client.18312 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:20:10.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 10 client.18312 _ll_register_callbacks cb 0x55833bf38790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:10.918 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 1 -- 10.20.193.4:0/2439013500 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55833bc499d0 con 0x55833c0b6300 2026-02-24T09:20:10.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce1affd640 1 -- 10.20.193.4:0/2439013500 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fce50038cd0 con 0x55833c0b6300 2026-02-24T09:20:10.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 10 client.18312 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:10.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 1 -- 10.20.193.4:0/2439013500 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55833bf51ab0 con 0x55833c0b6300 2026-02-24T09:20:10.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce1affd640 1 -- 10.20.193.4:0/2439013500 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fce500439d0 con 0x55833c0b6300 2026-02-24T09:20:10.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 10 client.18312 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:10.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 10 client.18312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:10.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 20 client.18312 populate_metadata read hostname 'trial004' 2026-02-24T09:20:10.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55833c0f8d40 0x55833c0f91e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 4 client.18312 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:10.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.901+0000 7fce69304e00 1 -- 10.20.193.4:0/2439013500 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55833bfccb70 con 0x55833c0f8d40 2026-02-24T09:20:10.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.902+0000 7fce6487e640 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55833c0f8d40 0x55833c0f91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.902+0000 7fce6487e640 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55833c0f8d40 0x55833c0f91e0 crc :-1 s=READY pgs=225 gs=4 cs=0 l=0 c_cookie=15287928516506579610 s_cookie=8011921164928719786 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d429a1fca1f0729a server_cookie=6f300fd9bc029baa in_seq=0 out_seq=0 2026-02-24T09:20:10.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.902+0000 7fce1affd640 10 client.18312 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:10.920 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.902+0000 7fce1affd640 1 -- 10.20.193.4:0/2439013500 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55833bfccb70 con 0x55833c0f8d40 2026-02-24T09:20:10.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.902+0000 7fce1affd640 10 client.18312 handle_command_reply: tid=0 2026-02-24T09:20:10.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.902+0000 7fce69304e00 1 client.18312 shutdown 2026-02-24T09:20:10.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.902+0000 7fce69304e00 1 -- 10.20.193.4:0/2439013500 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6300 msgr2=0x55833c0ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:10.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.902+0000 7fce69304e00 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6300 0x55833c0ce4b0 secure :-1 s=READY pgs=1313 gs=1 cs=0 l=1 c_cookie=10071222404344866609 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce50038600 tx=0x7fce5002f180 comp rx=0 tx=0).stop 2026-02-24T09:20:10.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.903+0000 7fce69304e00 1 -- 10.20.193.4:0/2439013500 shutdown_connections 2026-02-24T09:20:10.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.903+0000 7fce69304e00 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55833c0f8d40 0x55833c0f91e0 crc :-1 s=READY pgs=225 gs=4 cs=0 l=0 c_cookie=15287928516506579610 s_cookie=8011921164928719786 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.903+0000 7fce69304e00 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0fb8b0 0x55833c0d39e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.903+0000 7fce1affd640 0 client.18312 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:10.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.903+0000 7fce69304e00 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6c10 0x55833c0ce9f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.903+0000 7fce69304e00 1 --2- 10.20.193.4:0/2439013500 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0b6300 0x55833c0ce4b0 unknown :-1 s=CLOSED pgs=1313 gs=1 cs=0 l=1 c_cookie=10071222404344866609 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.903+0000 7fce69304e00 1 -- 10.20.193.4:0/2439013500 >> 10.20.193.4:0/2439013500 conn(0x55833bfd44f0 msgr2=0x55833c0b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:10.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.903+0000 7fce69304e00 1 -- 10.20.193.4:0/2439013500 shutdown_connections 2026-02-24T09:20:10.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.903+0000 7fce69304e00 1 -- 10.20.193.4:0/2439013500 wait complete. 2026-02-24T09:20:10.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.903+0000 7fce69304e00 20 client.18312 trim_cache size 0 max 16384 2026-02-24T09:20:10.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce69304e00 1 Processor -- start 2026-02-24T09:20:10.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce69304e00 1 -- start start 2026-02-24T09:20:10.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce69304e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6300 0x55833c0d2f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce69304e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6c10 0x55833c0f2eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce69304e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c0f33f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce69304e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55833bfb9fe0 con 0x55833c0f8d40 2026-02-24T09:20:10.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce69304e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55833bc84fe0 con 0x55833c0b6c10 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce69304e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55833c0cefd0 con 0x55833c0b6300 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce65880640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c0f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce65880640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c0f33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39414/0 (socket says 10.20.193.4:39414) 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce65880640 1 -- 10.20.193.4:0/4181675658 learned_addr learned my addr 10.20.193.4:0/4181675658 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce6487e640 1 --2- 10.20.193.4:0/4181675658 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6c10 0x55833c0f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce6507f640 1 --2- 10.20.193.4:0/4181675658 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6300 0x55833c0d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce65880640 1 -- 10.20.193.4:0/4181675658 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6300 msgr2=0x55833c0d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce65880640 1 --2- 10.20.193.4:0/4181675658 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6300 0x55833c0d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce65880640 1 -- 10.20.193.4:0/4181675658 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6c10 msgr2=0x55833c0f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce65880640 1 --2- 10.20.193.4:0/4181675658 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6c10 0x55833c0f2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce65880640 1 -- 10.20.193.4:0/4181675658 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55833bf4c530 con 0x55833c0f8d40 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce6507f640 1 --2- 10.20.193.4:0/4181675658 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6300 0x55833c0d2f50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce65880640 1 --2- 10.20.193.4:0/4181675658 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c0f33f0 secure :-1 s=READY pgs=1314 gs=2 cs=0 l=1 c_cookie=7090501999647942957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce5c0aa2b0 tx=0x7fce5c00cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626686006836692d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:10.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.915+0000 7fce2d4e4640 1 -- 10.20.193.4:0/4181675658 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce5c0ae6e0 con 0x55833c0f8d40 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce2d4e4640 1 -- 10.20.193.4:0/4181675658 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce5c0b3a00 con 0x55833c0f8d40 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce2d4e4640 1 -- 10.20.193.4:0/4181675658 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce5c0aebf0 con 0x55833c0f8d40 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 -- 10.20.193.4:0/4181675658 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 msgr2=0x55833c0f33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 --2- 10.20.193.4:0/4181675658 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c0f33f0 secure :-1 s=READY pgs=1314 gs=2 cs=0 l=1 c_cookie=7090501999647942957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce5c0aa2b0 tx=0x7fce5c00cd10 comp rx=0 tx=0).stop 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 -- 10.20.193.4:0/4181675658 shutdown_connections 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 --2- 10.20.193.4:0/4181675658 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c0f33f0 unknown :-1 s=CLOSED pgs=1314 gs=2 cs=0 l=1 c_cookie=7090501999647942957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 --2- 10.20.193.4:0/4181675658 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6c10 0x55833c0f2eb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 --2- 10.20.193.4:0/4181675658 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6300 0x55833c0d2f50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 -- 10.20.193.4:0/4181675658 >> 10.20.193.4:0/4181675658 conn(0x55833bfd44f0 msgr2=0x55833c0d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 -- 10.20.193.4:0/4181675658 shutdown_connections 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 -- 10.20.193.4:0/4181675658 wait complete. 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 -- start start 2026-02-24T09:20:10.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.916+0000 7fce69304e00 1 Processor -- start 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6300 0x55833c0d6740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6c10 0x55833c0d6c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c140dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55833c0f9340 con 0x55833c0f8d40 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55833c0c9e70 con 0x55833c0b6300 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55833c0c7440 con 0x55833c0b6c10 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce65880640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce65880640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39420/0 (socket says 10.20.193.4:39420) 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce65880640 1 -- 10.20.193.4:0/1005179622 learned_addr learned my addr 10.20.193.4:0/1005179622 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce6487e640 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6c10 0x55833c0d6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce65880640 1 -- 10.20.193.4:0/1005179622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6c10 msgr2=0x55833c0d6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce65880640 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6c10 0x55833c0d6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.933 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce65880640 1 -- 10.20.193.4:0/1005179622 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6300 msgr2=0x55833c0d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce65880640 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6300 0x55833c0d6740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce65880640 1 -- 10.20.193.4:0/1005179622 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55833bf40000 con 0x55833c0f8d40 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce65880640 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c140dc0 secure :-1 s=READY pgs=1315 gs=1 cs=0 l=1 c_cookie=3301566520181783904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce5c0a9cf0 tx=0x7fce5c0d3180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd18541f5c1fd60 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce1affd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce1affd640 1 -- 10.20.193.4:0/1005179622 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce5c0b8e20 con 0x55833c0f8d40 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 -- 10.20.193.4:0/1005179622 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce60169560 con 0x55833c0f8d40 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce1affd640 1 -- 10.20.193.4:0/1005179622 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce5c0a9f50 con 0x55833c0f8d40 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce1affd640 1 -- 10.20.193.4:0/1005179622 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce5c072e70 con 0x55833c0f8d40 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 10 client.18318 _ll_register_callbacks cb 0x55833bf38790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 -- 10.20.193.4:0/1005179622 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55833bfce7e0 con 0x55833c0f8d40 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce1affd640 1 -- 10.20.193.4:0/1005179622 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fce5c073000 con 0x55833c0f8d40 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce1affd640 1 -- 10.20.193.4:0/1005179622 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fce5c0abcc0 con 0x55833c0f8d40 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 10 client.18318 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 -- 10.20.193.4:0/1005179622 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55833bf51d10 con 0x55833c0f8d40 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce1affd640 1 -- 10.20.193.4:0/1005179622 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fce5c0af6d0 con 0x55833c0f8d40 2026-02-24T09:20:10.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 10 client.18318 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 10 client.18318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 20 client.18318 populate_metadata read hostname 'trial004' 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55833c0fb8b0 0x55833c1c9150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 4 client.18318 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.917+0000 7fce69304e00 1 -- 10.20.193.4:0/1005179622 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55833bc47220 con 0x55833c0fb8b0 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.918+0000 7fce6507f640 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55833c0fb8b0 0x55833c1c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.918+0000 7fce1affd640 10 client.18318 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.918+0000 7fce6507f640 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55833c0fb8b0 0x55833c1c9150 crc :-1 s=READY pgs=226 gs=4 cs=0 l=0 c_cookie=4302177902169954500 s_cookie=13019020555492557493 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bb46802136018c4 server_cookie=b4acda37ada482b5 in_seq=0 out_seq=0 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce1affd640 1 -- 10.20.193.4:0/1005179622 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55833bc47220 con 0x55833c0fb8b0 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce1affd640 10 client.18318 handle_command_reply: tid=0 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce69304e00 1 client.18318 shutdown 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce69304e00 1 -- 10.20.193.4:0/1005179622 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 msgr2=0x55833c140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce69304e00 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c140dc0 secure :-1 s=READY pgs=1315 gs=1 cs=0 l=1 c_cookie=3301566520181783904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce5c0a9cf0 tx=0x7fce5c0d3180 comp rx=0 tx=0).stop 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce69304e00 1 -- 10.20.193.4:0/1005179622 shutdown_connections 2026-02-24T09:20:10.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce69304e00 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55833c0fb8b0 0x55833c1c9150 crc :-1 s=READY pgs=226 gs=4 cs=0 l=0 c_cookie=4302177902169954500 s_cookie=13019020555492557493 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce1affd640 0 client.18318 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:10.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce69304e00 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55833c0f8d40 0x55833c140dc0 unknown :-1 s=CLOSED pgs=1315 gs=1 cs=0 l=1 c_cookie=3301566520181783904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce69304e00 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55833c0b6c10 0x55833c0d6c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce69304e00 1 --2- 10.20.193.4:0/1005179622 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55833c0b6300 0x55833c0d6740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce69304e00 1 -- 10.20.193.4:0/1005179622 >> 10.20.193.4:0/1005179622 conn(0x55833bfd44f0 msgr2=0x55833c0d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:10.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.919+0000 7fce69304e00 1 -- 10.20.193.4:0/1005179622 shutdown_connections 2026-02-24T09:20:10.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce69304e00 1 -- 10.20.193.4:0/1005179622 wait complete. 2026-02-24T09:20:10.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce69304e00 20 client.18318 trim_cache size 0 max 16384 2026-02-24T09:20:10.936 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:20:10.936 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:20:10.937 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "7f3fcd8b-96a7-4762-a5be-feb95dd814b9", 2026-02-24T09:20:10.937 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:20:10.937 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:20:10.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 -- 10.20.193.4:0/1888652552 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce3c0b56e0 msgr2=0x7fce3c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:10.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce3c0b56e0 0x7fce3c0d5b90 secure :-1 s=READY pgs=458 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce50009950 tx=0x7fce50031040 comp rx=0 tx=0).stop 2026-02-24T09:20:10.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 -- 10.20.193.4:0/1888652552 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce60111540 msgr2=0x7fce60128230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:10.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce60111540 0x7fce60128230 secure :-1 s=READY pgs=1311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce5c006e90 tx=0x7fce5c00edf0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 -- 10.20.193.4:0/1888652552 shutdown_connections 2026-02-24T09:20:10.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce3c0b56e0 0x7fce3c0d5b90 unknown :-1 s=CLOSED pgs=458 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce60111540 0x7fce60128230 unknown :-1 s=CLOSED pgs=1311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce6010c950 0x7fce60122e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 --2- 10.20.193.4:0/1888652552 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce6010bf60 0x7fce60122920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:10.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 -- 10.20.193.4:0/1888652552 >> 10.20.193.4:0/1888652552 conn(0x7fce600e9bf0 msgr2=0x7fce60109fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:10.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 -- 10.20.193.4:0/1888652552 shutdown_connections 2026-02-24T09:20:10.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:10.920+0000 7fce6730a640 1 -- 10.20.193.4:0/1888652552 wait complete. 2026-02-24T09:20:11.015 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:20:11.176 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:11.209 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:10 trial004 ceph-mon[41596]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 766 MiB/s wr, 529 op/s 2026-02-24T09:20:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:10 trial090 ceph-mon[47278]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 766 MiB/s wr, 529 op/s 2026-02-24T09:20:11.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.337+0000 7f79d015b640 1 -- 10.20.193.4:0/1104323103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79c810bef0 msgr2=0x7f79c810c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:11.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.337+0000 7f79d015b640 1 --2- 10.20.193.4:0/1104323103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79c810bef0 0x7f79c810c2c0 secure :-1 s=READY pgs=1316 gs=1 cs=0 l=1 c_cookie=2858856490690616043 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79b8009980 tx=0x7f79b802f180 comp rx=0 tx=0).stop 2026-02-24T09:20:11.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.337+0000 7f79d015b640 1 -- 10.20.193.4:0/1104323103 shutdown_connections 2026-02-24T09:20:11.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.337+0000 7f79d015b640 1 --2- 10.20.193.4:0/1104323103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79c81114d0 0x7f79c8111970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.337+0000 7f79d015b640 1 --2- 10.20.193.4:0/1104323103 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79c810c8e0 0x7f79c8110eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.337+0000 7f79d015b640 1 --2- 10.20.193.4:0/1104323103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79c810bef0 0x7f79c810c2c0 unknown :-1 s=CLOSED pgs=1316 gs=1 cs=0 l=1 c_cookie=2858856490690616043 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.337+0000 7f79d015b640 1 -- 10.20.193.4:0/1104323103 >> 10.20.193.4:0/1104323103 conn(0x7f79c80e9b80 msgr2=0x7f79c8109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:11.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.337+0000 7f79d015b640 1 -- 10.20.193.4:0/1104323103 shutdown_connections 2026-02-24T09:20:11.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.337+0000 7f79d015b640 1 -- 10.20.193.4:0/1104323103 wait complete. 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79d015b640 1 Processor -- start 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79d015b640 1 -- start start 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79d015b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79c810bef0 0x7f79c8121e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79d015b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79c810c8e0 0x7f79c81223a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79d015b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79c81114d0 0x7f79c8127770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79d015b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8127d90 con 0x7f79c81114d0 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79d015b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8127f00 con 0x7f79c810c8e0 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79d015b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81280c0 con 0x7f79c810bef0 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79ce6d1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79c81114d0 0x7f79c8127770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79ce6d1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79c81114d0 0x7f79c8127770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39448/0 (socket says 10.20.193.4:39448) 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79ce6d1640 1 -- 10.20.193.4:0/1156469823 learned_addr learned my addr 10.20.193.4:0/1156469823 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:11.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79cded0640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79c810bef0 0x7f79c8121e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79c810c8e0 0x7f79c81223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79ce6d1640 1 -- 10.20.193.4:0/1156469823 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79c810bef0 msgr2=0x7f79c8121e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79ce6d1640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79c810bef0 0x7f79c8121e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79ce6d1640 1 -- 10.20.193.4:0/1156469823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79c810c8e0 msgr2=0x7f79c81223a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79ce6d1640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79c810c8e0 0x7f79c81223a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79ce6d1640 1 -- 10.20.193.4:0/1156469823 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b8009570 con 0x7f79c81114d0 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79c810c8e0 0x7f79c81223a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79ce6d1640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79c81114d0 0x7f79c8127770 secure :-1 s=READY pgs=1317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c4006e90 tx=0x7f79c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79b6ffd640 1 -- 10.20.193.4:0/1156469823 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79c4005500 con 0x7f79c81114d0 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79d015b640 1 -- 10.20.193.4:0/1156469823 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c81283a0 con 0x7f79c81114d0 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79b6ffd640 1 -- 10.20.193.4:0/1156469823 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79c4005e10 con 0x7f79c81114d0 2026-02-24T09:20:11.344 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79b6ffd640 1 -- 10.20.193.4:0/1156469823 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79c4003a90 con 0x7f79c81114d0 2026-02-24T09:20:11.345 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.338+0000 7f79d015b640 1 -- 10.20.193.4:0/1156469823 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c8168aa0 con 0x7f79c81114d0 2026-02-24T09:20:11.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:10 trial014 ceph-mon[46941]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 766 MiB/s wr, 529 op/s 2026-02-24T09:20:11.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.341+0000 7f79b6ffd640 1 -- 10.20.193.4:0/1156469823 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f79c400c840 con 0x7f79c81114d0 2026-02-24T09:20:11.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.342+0000 7f79b6ffd640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79a40b56e0 0x7f79a40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.342+0000 7f79b6ffd640 1 -- 10.20.193.4:0/1156469823 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f79c40e7890 con 0x7f79c81114d0 2026-02-24T09:20:11.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.342+0000 7f79cded0640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79a40b56e0 0x7f79a40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.346 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.342+0000 7f79cded0640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79a40b56e0 0x7f79a40d5b90 secure :-1 s=READY pgs=459 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79b8005b30 tx=0x7f79b803a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:11.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79d2155e00 1 Processor -- start 2026-02-24T09:20:11.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79d2155e00 1 -- start start 2026-02-24T09:20:11.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317b820 0x56288317bbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.350 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56288317c130 0x5628831c0890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5628831c0dd0 0x5628831e11b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79d2155e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56288308bde0 con 0x5628831c0dd0 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79d2155e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562883087b10 con 0x56288317b820 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79d2155e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562883081ab0 con 0x56288317c130 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79ce6d1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5628831c0dd0 0x5628831e11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79cded0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317b820 0x56288317bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79ce6d1640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5628831c0dd0 0x5628831e11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39464/0 (socket says 10.20.193.4:39464) 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79ce6d1640 1 -- 10.20.193.4:0/1411223201 learned_addr learned my addr 10.20.193.4:0/1411223201 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/1411223201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56288317c130 0x5628831c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79ce6d1640 1 -- 10.20.193.4:0/1411223201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56288317c130 msgr2=0x5628831c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79ce6d1640 1 --2- 10.20.193.4:0/1411223201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56288317c130 0x5628831c0890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.351 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79ce6d1640 1 -- 10.20.193.4:0/1411223201 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317b820 msgr2=0x56288317bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79ce6d1640 1 --2- 10.20.193.4:0/1411223201 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317b820 0x56288317bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79ce6d1640 1 -- 10.20.193.4:0/1411223201 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288302d310 con 0x5628831c0dd0 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79ce6d1640 1 --2- 10.20.193.4:0/1411223201 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5628831c0dd0 0x5628831e11b0 secure :-1 s=READY pgs=1318 gs=1 cs=0 l=1 c_cookie=15494614302478152982 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c40aa1d0 tx=0x7f79c4005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d707ed9d36e5b516 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79964e6640 1 -- 10.20.193.4:0/1411223201 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79c40ad5e0 con 0x5628831c0dd0 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79964e6640 1 -- 10.20.193.4:0/1411223201 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79c40ad400 con 0x5628831c0dd0 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.346+0000 7f79964e6640 1 -- 10.20.193.4:0/1411223201 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79c40ada20 con 0x5628831c0dd0 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.347+0000 7f79d2155e00 1 -- 10.20.193.4:0/1411223201 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5628831c0dd0 msgr2=0x5628831e11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.347+0000 7f79d2155e00 1 --2- 10.20.193.4:0/1411223201 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5628831c0dd0 0x5628831e11b0 secure :-1 s=READY pgs=1318 gs=1 cs=0 l=1 c_cookie=15494614302478152982 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c40aa1d0 tx=0x7f79c4005730 comp rx=0 tx=0).stop 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.347+0000 7f79d2155e00 1 -- 10.20.193.4:0/1411223201 shutdown_connections 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.347+0000 7f79d2155e00 1 --2- 10.20.193.4:0/1411223201 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5628831c0dd0 0x5628831e11b0 unknown :-1 s=CLOSED pgs=1318 gs=1 cs=0 l=1 c_cookie=15494614302478152982 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.347+0000 7f79d2155e00 1 --2- 10.20.193.4:0/1411223201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56288317c130 0x5628831c0890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.347+0000 7f79d2155e00 1 --2- 10.20.193.4:0/1411223201 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317b820 0x56288317bbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.352 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.347+0000 7f79d2155e00 1 -- 10.20.193.4:0/1411223201 >> 10.20.193.4:0/1411223201 conn(0x56288309a6b0 msgr2=0x56288317a100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:11.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.347+0000 7f79d2155e00 1 -- 10.20.193.4:0/1411223201 shutdown_connections 2026-02-24T09:20:11.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.347+0000 7f79d2155e00 1 -- 10.20.193.4:0/1411223201 wait complete. 2026-02-24T09:20:11.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 1 -- start start 2026-02-24T09:20:11.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 1 Processor -- start 2026-02-24T09:20:11.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56288317b820 0x562883193e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317c130 0x5628831943a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5628831c0dd0 0x562883199390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5628831998d0 con 0x56288317c130 2026-02-24T09:20:11.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562883199a40 con 0x5628831c0dd0 2026-02-24T09:20:11.357 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x562883199c00 con 0x56288317b820 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79cd6cf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317c130 0x5628831943a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79cd6cf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317c130 0x5628831943a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39474/0 (socket says 10.20.193.4:39474) 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79cd6cf640 1 -- 10.20.193.4:0/3953637728 learned_addr learned my addr 10.20.193.4:0/3953637728 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79cded0640 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56288317b820 0x562883193e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79ce6d1640 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5628831c0dd0 0x562883199390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79cd6cf640 1 -- 10.20.193.4:0/3953637728 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56288317b820 msgr2=0x562883193e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56288317b820 0x562883193e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79cd6cf640 1 -- 10.20.193.4:0/3953637728 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5628831c0dd0 msgr2=0x562883199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5628831c0dd0 0x562883199390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79cd6cf640 1 -- 10.20.193.4:0/3953637728 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628830058c0 con 0x56288317c130 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317c130 0x5628831943a0 secure :-1 s=READY pgs=1319 gs=1 cs=0 l=1 c_cookie=2004559049812808716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79bc0041e0 tx=0x7f79bc012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd19fd5cf63140c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:11.358 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79837fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79837fe640 1 -- 10.20.193.4:0/3953637728 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79bc00f820 con 0x56288317c130 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79837fe640 1 -- 10.20.193.4:0/3953637728 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79bc00fe60 con 0x56288317c130 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 1 -- 10.20.193.4:0/3953637728 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c8168aa0 con 0x56288317c130 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79837fe640 1 -- 10.20.193.4:0/3953637728 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79bc0103d0 con 0x56288317c130 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 10 client.18330 _ll_register_callbacks cb 0x56288301d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79837fe640 1 -- 10.20.193.4:0/3953637728 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f79bc010560 con 0x56288317c130 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.349+0000 7f79d2155e00 1 -- 10.20.193.4:0/3953637728 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562882dd14a0 con 0x56288317c130 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79837fe640 1 -- 10.20.193.4:0/3953637728 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f79bc010720 con 0x56288317c130 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79d2155e00 10 client.18330 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79d2155e00 1 -- 10.20.193.4:0/3953637728 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5628830176e0 con 0x56288317c130 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79837fe640 1 -- 10.20.193.4:0/3953637728 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f79bc010940 con 0x56288317c130 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79d2155e00 10 client.18330 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:11.359 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79d2155e00 10 client.18330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79d2155e00 20 client.18330 populate_metadata read hostname 'trial004' 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79d2155e00 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5628831be7b0 0x5628831bec50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79d2155e00 4 client.18330 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79d2155e00 1 -- 10.20.193.4:0/3953637728 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628830774f0 con 0x5628831be7b0 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79cded0640 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5628831be7b0 0x5628831bec50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.350+0000 7f79837fe640 10 client.18330 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79cded0640 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5628831be7b0 0x5628831bec50 crc :-1 s=READY pgs=227 gs=4 cs=0 l=0 c_cookie=7190296085857415528 s_cookie=1337062919405841943 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63c91031bb69b168 server_cookie=128e33a421882e17 in_seq=0 out_seq=0 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79837fe640 1 -- 10.20.193.4:0/3953637728 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5628830774f0 con 0x5628831be7b0 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79837fe640 10 client.18330 handle_command_reply: tid=0 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 client.18330 shutdown 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 -- 10.20.193.4:0/3953637728 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317c130 msgr2=0x5628831943a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:11.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317c130 0x5628831943a0 secure :-1 s=READY pgs=1319 gs=1 cs=0 l=1 c_cookie=2004559049812808716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79bc0041e0 tx=0x7f79bc012820 comp rx=0 tx=0).stop 2026-02-24T09:20:11.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 -- 10.20.193.4:0/3953637728 shutdown_connections 2026-02-24T09:20:11.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5628831be7b0 0x5628831bec50 crc :-1 s=READY pgs=227 gs=4 cs=0 l=0 c_cookie=7190296085857415528 s_cookie=1337062919405841943 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5628831c0dd0 0x562883199390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79837fe640 0 client.18330 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:11.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317c130 0x5628831943a0 unknown :-1 s=CLOSED pgs=1319 gs=1 cs=0 l=1 c_cookie=2004559049812808716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 --2- 10.20.193.4:0/3953637728 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56288317b820 0x562883193e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 -- 10.20.193.4:0/3953637728 >> 10.20.193.4:0/3953637728 conn(0x56288309a6b0 msgr2=0x56288317a810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:11.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 -- 10.20.193.4:0/3953637728 shutdown_connections 2026-02-24T09:20:11.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.351+0000 7f79d2155e00 1 -- 10.20.193.4:0/3953637728 wait complete. 2026-02-24T09:20:11.361 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.352+0000 7f79d2155e00 20 client.18330 trim_cache size 0 max 16384 2026-02-24T09:20:11.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79d2155e00 1 Processor -- start 2026-02-24T09:20:11.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79d2155e00 1 -- start start 2026-02-24T09:20:11.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288317e6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 0x56288317aa10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5628831be7b0 0x56288317af50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79d2155e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56288307f6e0 con 0x56288317b820 2026-02-24T09:20:11.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79d2155e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x562882d4af50 con 0x56288317c130 2026-02-24T09:20:11.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79d2155e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5628830eb3d0 con 0x5628831be7b0 2026-02-24T09:20:11.368 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79cded0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288317e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79cded0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288317e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39476/0 (socket says 10.20.193.4:39476) 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.364+0000 7f79cded0640 1 -- 10.20.193.4:0/4286851104 learned_addr learned my addr 10.20.193.4:0/4286851104 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f79ce6d1640 1 --2- 10.20.193.4:0/4286851104 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5628831be7b0 0x56288317af50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f79cded0640 1 -- 10.20.193.4:0/4286851104 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5628831be7b0 msgr2=0x56288317af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/4286851104 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 0x56288317aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f79cded0640 1 --2- 10.20.193.4:0/4286851104 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5628831be7b0 0x56288317af50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f79cded0640 1 -- 10.20.193.4:0/4286851104 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 msgr2=0x56288317aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f79cded0640 1 --2- 10.20.193.4:0/4286851104 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 0x56288317aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f79cded0640 1 -- 10.20.193.4:0/4286851104 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562883012160 con 0x56288317b820 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f79ce6d1640 1 --2- 10.20.193.4:0/4286851104 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5628831be7b0 0x56288317af50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:11.369 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f79cded0640 1 --2- 10.20.193.4:0/4286851104 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288317e6e0 secure :-1 s=READY pgs=1320 gs=1 cs=0 l=1 c_cookie=1437286159958375193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79b80047f0 tx=0x7f79b8040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f24425bce77b19 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:11.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f7995ce5640 1 -- 10.20.193.4:0/4286851104 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79b8057070 con 0x56288317b820 2026-02-24T09:20:11.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f7995ce5640 1 -- 10.20.193.4:0/4286851104 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79b803e040 con 0x56288317b820 2026-02-24T09:20:11.370 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.365+0000 7f7995ce5640 1 -- 10.20.193.4:0/4286851104 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79b8052820 con 0x56288317b820 2026-02-24T09:20:11.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.366+0000 7f79d2155e00 1 -- 10.20.193.4:0/4286851104 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 msgr2=0x56288317e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:11.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.366+0000 7f79d2155e00 1 --2- 10.20.193.4:0/4286851104 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288317e6e0 secure :-1 s=READY pgs=1320 gs=1 cs=0 l=1 c_cookie=1437286159958375193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79b80047f0 tx=0x7f79b8040000 comp rx=0 tx=0).stop 2026-02-24T09:20:11.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.366+0000 7f79d2155e00 1 -- 10.20.193.4:0/4286851104 shutdown_connections 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.366+0000 7f79d2155e00 1 --2- 10.20.193.4:0/4286851104 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5628831be7b0 0x56288317af50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.366+0000 7f79d2155e00 1 --2- 10.20.193.4:0/4286851104 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 0x56288317aa10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.366+0000 7f79d2155e00 1 --2- 10.20.193.4:0/4286851104 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288317e6e0 unknown :-1 s=CLOSED pgs=1320 gs=1 cs=0 l=1 c_cookie=1437286159958375193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.366+0000 7f79d2155e00 1 -- 10.20.193.4:0/4286851104 >> 10.20.193.4:0/4286851104 conn(0x56288309a6b0 msgr2=0x5628831bf310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.366+0000 7f79d2155e00 1 -- 10.20.193.4:0/4286851104 shutdown_connections 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.366+0000 7f79d2155e00 1 -- 10.20.193.4:0/4286851104 wait complete. 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.366+0000 7f79d2155e00 1 -- start start 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79d2155e00 1 Processor -- start 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288319fa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 0x56288319a150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79d2155e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5628831be7b0 0x56288319a690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79d2155e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5628831a01d0 con 0x56288317b820 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79d2155e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5628831a0340 con 0x56288317c130 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79d2155e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56288319ac50 con 0x5628831be7b0 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cded0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288319fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cded0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288319fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:39490/0 (socket says 10.20.193.4:39490) 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cded0640 1 -- 10.20.193.4:0/2584737713 learned_addr learned my addr 10.20.193.4:0/2584737713 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 0x56288319a150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cded0640 1 -- 10.20.193.4:0/2584737713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5628831be7b0 msgr2=0x56288319a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cded0640 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5628831be7b0 0x56288319a690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cded0640 1 -- 10.20.193.4:0/2584737713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 msgr2=0x56288319a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cded0640 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 0x56288319a150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cded0640 1 -- 10.20.193.4:0/2584737713 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562883005bf0 con 0x56288317b820 2026-02-24T09:20:11.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 0x56288319a150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79cded0640 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288319fa50 secure :-1 s=READY pgs=1321 gs=1 cs=0 l=1 c_cookie=13155884680706444059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79b8005f70 tx=0x7f79b802f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b693176a0b82cb1b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79837fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79837fe640 1 -- 10.20.193.4:0/2584737713 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79b8057050 con 0x56288317b820 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79837fe640 1 -- 10.20.193.4:0/2584737713 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79b8052e90 con 0x56288317b820 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79837fe640 1 -- 10.20.193.4:0/2584737713 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79b8038d80 con 0x56288317b820 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79d2155e00 1 -- 10.20.193.4:0/2584737713 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c8060e70 con 0x56288317b820 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79837fe640 1 -- 10.20.193.4:0/2584737713 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f79b805c440 con 0x56288317b820 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.367+0000 7f79837fe640 10 client.18336 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79d2155e00 10 client.18336 _ll_register_callbacks cb 0x56288301d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79d2155e00 1 -- 10.20.193.4:0/2584737713 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562882d0cf40 con 0x56288317b820 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79837fe640 1 -- 10.20.193.4:0/2584737713 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f79b8052790 con 0x56288317b820 2026-02-24T09:20:11.377 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79d2155e00 10 client.18336 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79d2155e00 1 -- 10.20.193.4:0/2584737713 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x562883017940 con 0x56288317b820 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79837fe640 1 -- 10.20.193.4:0/2584737713 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f79b802fc00 con 0x56288317b820 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79d2155e00 10 client.18336 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79d2155e00 10 client.18336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79d2155e00 20 client.18336 populate_metadata read hostname 'trial004' 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79d2155e00 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5628831c0dd0 0x56288328ee20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79d2155e00 4 client.18336 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79d2155e00 1 -- 10.20.193.4:0/2584737713 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f79c40ad400 con 0x5628831c0dd0 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.368+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5628831c0dd0 0x56288328ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79cd6cf640 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5628831c0dd0 0x56288328ee20 crc :-1 s=READY pgs=228 gs=4 cs=0 l=0 c_cookie=1915766483869701111 s_cookie=12527065291160448098 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a962b7787a713f7 server_cookie=add91382d5be6c62 in_seq=0 out_seq=0 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79837fe640 10 client.18336 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:11.378 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79837fe640 1 -- 10.20.193.4:0/2584737713 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6250 (crc 0 0 0) 0x7f79c40ad400 con 0x5628831c0dd0 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79837fe640 10 client.18336 handle_command_reply: tid=0 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79d2155e00 1 client.18336 shutdown 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79d2155e00 1 -- 10.20.193.4:0/2584737713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 msgr2=0x56288319fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79d2155e00 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288319fa50 secure :-1 s=READY pgs=1321 gs=1 cs=0 l=1 c_cookie=13155884680706444059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79b8005f70 tx=0x7f79b802f180 comp rx=0 tx=0).stop 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79d2155e00 1 -- 10.20.193.4:0/2584737713 shutdown_connections 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79d2155e00 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5628831c0dd0 0x56288328ee20 crc :-1 s=READY pgs=228 gs=4 cs=0 l=0 c_cookie=1915766483869701111 s_cookie=12527065291160448098 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79d2155e00 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5628831be7b0 0x56288319a690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79d2155e00 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56288317c130 0x56288319a150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79837fe640 0 client.18336 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79d2155e00 1 --2- 10.20.193.4:0/2584737713 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56288317b820 0x56288319fa50 unknown :-1 s=CLOSED pgs=1321 gs=1 cs=0 l=1 c_cookie=13155884680706444059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79d2155e00 1 -- 10.20.193.4:0/2584737713 >> 10.20.193.4:0/2584737713 conn(0x56288309a6b0 msgr2=0x56288317a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:11.379 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.369+0000 7f79d2155e00 1 -- 10.20.193.4:0/2584737713 shutdown_connections 2026-02-24T09:20:11.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d2155e00 1 -- 10.20.193.4:0/2584737713 wait complete. 2026-02-24T09:20:11.380 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d2155e00 20 client.18336 trim_cache size 0 max 16384 2026-02-24T09:20:11.380 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:20:11.380 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:20:11.380 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:20:11.380 INFO:teuthology.orchestra.run.trial004.stdout: "7f3fcd8b-96a7-4762-a5be-feb95dd814b9": { 2026-02-24T09:20:11.380 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "7f3fcd8b-96a7-4762-a5be-feb95dd814b9", 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: "50fcb56c-a674-4f78-aafd-69881ffc04d0": { 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:02.417630+0000", 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.381 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: "b703ea3c-d980-4a3f-b2c3-714d8f9ad80d": { 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:58.321748+0000", 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:20:11.382 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.383 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.384 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.385 INFO:teuthology.orchestra.run.trial004.stdout: "7f3fcd8b-96a7-4762-a5be-feb95dd814b9": { 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:20:10.919666+0000", 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.386 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:20:11.387 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.388 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.389 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:20:11.390 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:20:11.391 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "02c4bb30-7b42-4907-8bbf-d28c355c477b": { 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:36.960639+0000", 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.392 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:11.393 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 -- 10.20.193.4:0/1156469823 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79a40b56e0 msgr2=0x7f79a40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79a40b56e0 0x7f79a40d5b90 secure :-1 s=READY pgs=459 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79b8005b30 tx=0x7f79b803a040 comp rx=0 tx=0).stop 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 -- 10.20.193.4:0/1156469823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79c81114d0 msgr2=0x7f79c8127770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79c81114d0 0x7f79c8127770 secure :-1 s=READY pgs=1317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c4006e90 tx=0x7f79c400edf0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 -- 10.20.193.4:0/1156469823 shutdown_connections 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f79a40b56e0 0x7f79a40d5b90 unknown :-1 s=CLOSED pgs=459 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f79c81114d0 0x7f79c8127770 unknown :-1 s=CLOSED pgs=1317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f79c810c8e0 0x7f79c81223a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 --2- 10.20.193.4:0/1156469823 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f79c810bef0 0x7f79c8121e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:11.394 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 -- 10.20.193.4:0/1156469823 >> 10.20.193.4:0/1156469823 conn(0x7f79c80e9b80 msgr2=0x7f79c8109f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:11.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 -- 10.20.193.4:0/1156469823 shutdown_connections 2026-02-24T09:20:11.395 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:11.370+0000 7f79d015b640 1 -- 10.20.193.4:0/1156469823 wait complete. 2026-02-24T09:20:11.475 INFO:tasks.cephfs.filesystem:scrub status for tag:7f3fcd8b-96a7-4762-a5be-feb95dd814b9 - {'path': '/', 'tag': '7f3fcd8b-96a7-4762-a5be-feb95dd814b9', 'options': 'recursive,force'} 2026-02-24T09:20:12.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:11 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:20:12.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:11 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:12.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:11 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:20:12.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:11 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:12.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:11 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:20:12.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:11 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:12.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:11 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:20:12.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:11 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:11 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:20:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:11 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:11 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:20:12.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:11 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:13.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:12 trial004 ceph-mon[41596]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 630 MiB/s wr, 494 op/s 2026-02-24T09:20:13.234 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:12 trial090 ceph-mon[47278]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 630 MiB/s wr, 494 op/s 2026-02-24T09:20:13.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:12 trial014 ceph-mon[46941]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 630 MiB/s wr, 494 op/s 2026-02-24T09:20:14.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:13 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:20:14.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:13 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:20:14.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:13 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:20:15.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:14 trial004 ceph-mon[41596]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 284 MiB/s wr, 398 op/s 2026-02-24T09:20:15.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:14 trial090 ceph-mon[47278]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 284 MiB/s wr, 398 op/s 2026-02-24T09:20:15.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:14 trial014 ceph-mon[46941]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 284 MiB/s wr, 398 op/s 2026-02-24T09:20:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:16 trial004 ceph-mon[41596]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 109 MiB/s wr, 243 op/s 2026-02-24T09:20:17.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:16 trial090 ceph-mon[47278]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 109 MiB/s wr, 243 op/s 2026-02-24T09:20:17.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:16 trial014 ceph-mon[46941]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 109 MiB/s wr, 243 op/s 2026-02-24T09:20:19.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:18 trial004 ceph-mon[41596]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 30 MiB/s wr, 77 op/s 2026-02-24T09:20:19.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:18 trial090 ceph-mon[47278]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 30 MiB/s wr, 77 op/s 2026-02-24T09:20:19.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:18 trial014 ceph-mon[46941]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 30 MiB/s wr, 77 op/s 2026-02-24T09:20:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:20 trial004 ceph-mon[41596]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 30 MiB/s wr, 15 op/s 2026-02-24T09:20:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:20 trial090 ceph-mon[47278]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 30 MiB/s wr, 15 op/s 2026-02-24T09:20:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:20 trial014 ceph-mon[46941]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 30 MiB/s wr, 15 op/s 2026-02-24T09:20:22.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:21 trial004 ceph-mon[41596]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 90 MiB/s wr, 31 op/s 2026-02-24T09:20:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:21 trial090 ceph-mon[47278]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 90 MiB/s wr, 31 op/s 2026-02-24T09:20:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:21 trial014 ceph-mon[46941]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 90 MiB/s wr, 31 op/s 2026-02-24T09:20:25.093 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:24 trial014 ceph-mon[46941]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 202 MiB/s wr, 58 op/s 2026-02-24T09:20:25.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:24 trial004 ceph-mon[41596]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 202 MiB/s wr, 58 op/s 2026-02-24T09:20:25.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:24 trial090 ceph-mon[47278]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 202 MiB/s wr, 58 op/s 2026-02-24T09:20:27.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:26 trial004 ceph-mon[41596]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 411 MiB/s wr, 111 op/s 2026-02-24T09:20:27.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:26 trial090 ceph-mon[47278]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 411 MiB/s wr, 111 op/s 2026-02-24T09:20:27.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:26 trial014 ceph-mon[46941]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 411 MiB/s wr, 111 op/s 2026-02-24T09:20:28.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:27 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:20:28.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:27 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:20:28.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:27 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T09:20:29.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:28 trial004 ceph-mon[41596]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 613 MiB/s wr, 161 op/s 2026-02-24T09:20:29.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:20:29.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:20:29.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:20:29.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:28 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:20:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:28 trial090 ceph-mon[47278]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 613 MiB/s wr, 161 op/s 2026-02-24T09:20:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:20:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:20:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:20:29.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:28 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:20:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:28 trial014 ceph-mon[46941]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 613 MiB/s wr, 161 op/s 2026-02-24T09:20:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T09:20:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T09:20:29.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' 2026-02-24T09:20:29.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:28 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T09:20:31.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:30 trial004 ceph-mon[41596]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 748 MiB/s wr, 199 op/s 2026-02-24T09:20:31.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:30 trial090 ceph-mon[47278]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 748 MiB/s wr, 199 op/s 2026-02-24T09:20:31.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:30 trial014 ceph-mon[46941]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 748 MiB/s wr, 199 op/s 2026-02-24T09:20:32.102 INFO:tasks.workunit.client.0.trial004.stdout:stopping iogen 2026-02-24T09:20:32.103 INFO:tasks.workunit.client.0.trial004.stderr:+ echo 'stopping iogen' 2026-02-24T09:20:32.103 INFO:tasks.workunit.client.0.trial004.stderr:+ ./iogen -k 2026-02-24T09:20:32.104 INFO:tasks.workunit.client.0.trial004.stdout:OK 2026-02-24T09:20:32.104 INFO:tasks.workunit.client.0.trial004.stderr:+ echo OK 2026-02-24T09:20:33.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:32 trial004 ceph-mon[41596]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 881 MiB/s wr, 243 op/s 2026-02-24T09:20:33.331 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10.1 2026-02-24T09:20:33.332 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:20:33.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:32 trial090 ceph-mon[47278]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 881 MiB/s wr, 243 op/s 2026-02-24T09:20:33.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:32 trial014 ceph-mon[46941]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 51 KiB/s rd, 881 MiB/s wr, 243 op/s 2026-02-24T09:20:33.512 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.686+0000 7f563ea10640 1 -- 10.20.193.4:0/2415658653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5638113200 msgr2=0x7f5638173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.686+0000 7f563ea10640 1 --2- 10.20.193.4:0/2415658653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5638113200 0x7f5638173bd0 secure :-1 s=READY pgs=1322 gs=1 cs=0 l=1 c_cookie=6097344830105156212 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f562c00a970 tx=0x7f562c0301b0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.686+0000 7f563ea10640 1 -- 10.20.193.4:0/2415658653 shutdown_connections 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.686+0000 7f563ea10640 1 --2- 10.20.193.4:0/2415658653 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5638113200 0x7f5638173bd0 unknown :-1 s=CLOSED pgs=1322 gs=1 cs=0 l=1 c_cookie=6097344830105156212 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.686+0000 7f563ea10640 1 --2- 10.20.193.4:0/2415658653 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f563810da00 0x7f5638112a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.686+0000 7f563ea10640 1 --2- 10.20.193.4:0/2415658653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f563810d010 0x7f563810d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.686+0000 7f563ea10640 1 -- 10.20.193.4:0/2415658653 >> 10.20.193.4:0/2415658653 conn(0x7f563805f830 msgr2=0x7f563810ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.686+0000 7f563ea10640 1 -- 10.20.193.4:0/2415658653 shutdown_connections 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.686+0000 7f563ea10640 1 -- 10.20.193.4:0/2415658653 wait complete. 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563ea10640 1 Processor -- start 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563ea10640 1 -- start start 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563ea10640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f563810d010 0x7f56380efcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563ea10640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f563810da00 0x7f5638173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563ea10640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5638113200 0x7f56380ebf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563ea10640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f56380ec710 con 0x7f5638113200 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563ea10640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f56380ec880 con 0x7f563810d010 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563ea10640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56380eca40 con 0x7f563810da00 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563cf86640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5638113200 0x7f56380ebf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f5637fff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f563810d010 0x7f56380efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563cf86640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5638113200 0x7f56380ebf80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41862/0 (socket says 10.20.193.4:41862) 2026-02-24T09:20:33.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.688+0000 7f563cf86640 1 -- 10.20.193.4:0/1125383902 learned_addr learned my addr 10.20.193.4:0/1125383902 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:33.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f56377fe640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f563810da00 0x7f5638173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:33.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f563cf86640 1 -- 10.20.193.4:0/1125383902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f563810da00 msgr2=0x7f5638173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:33.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f563cf86640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f563810da00 0x7f5638173ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f563cf86640 1 -- 10.20.193.4:0/1125383902 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f563810d010 msgr2=0x7f56380efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:33.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f563cf86640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f563810d010 0x7f56380efcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f563cf86640 1 -- 10.20.193.4:0/1125383902 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c00a590 con 0x7f5638113200 2026-02-24T09:20:33.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f56377fe640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f563810da00 0x7f5638173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:33.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f563cf86640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5638113200 0x7f56380ebf80 secure :-1 s=READY pgs=1323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f562c005820 tx=0x7f562c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:33.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f56357fa640 1 -- 10.20.193.4:0/1125383902 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f562c03e070 con 0x7f5638113200 2026-02-24T09:20:33.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f563ea10640 1 -- 10.20.193.4:0/1125383902 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56380eccc0 con 0x7f5638113200 2026-02-24T09:20:33.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f56357fa640 1 -- 10.20.193.4:0/1125383902 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f562c003e10 con 0x7f5638113200 2026-02-24T09:20:33.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f56357fa640 1 -- 10.20.193.4:0/1125383902 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f562c042a00 con 0x7f5638113200 2026-02-24T09:20:33.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.689+0000 7f563ea10640 1 -- 10.20.193.4:0/1125383902 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56380f5480 con 0x7f5638113200 2026-02-24T09:20:33.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.690+0000 7f563ea10640 1 -- 10.20.193.4:0/1125383902 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f563810e2f0 con 0x7f5638113200 2026-02-24T09:20:33.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.691+0000 7f56357fa640 1 -- 10.20.193.4:0/1125383902 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f562c042b90 con 0x7f5638113200 2026-02-24T09:20:33.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.692+0000 7f56357fa640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f560c0b56e0 0x7f560c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:33.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.692+0000 7f56357fa640 1 -- 10.20.193.4:0/1125383902 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f562c10cb40 con 0x7f5638113200 2026-02-24T09:20:33.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.692+0000 7f5637fff640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f560c0b56e0 0x7f560c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:33.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.692+0000 7f5637fff640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f560c0b56e0 0x7f560c0d5b90 secure :-1 s=READY pgs=460 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5624004740 tx=0x7f5624009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:33.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.693+0000 7f56357fa640 1 -- 10.20.193.4:0/1125383902 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f562c0cf4c0 con 0x7f5638113200 2026-02-24T09:20:33.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.864+0000 7f563ea10640 1 -- 10.20.193.4:0/1125383902 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56380ed220 con 0x7f5638113200 2026-02-24T09:20:33.868 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.865+0000 7f56357fa640 1 -- 10.20.193.4:0/1125383902 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f562c0d2670 con 0x7f5638113200 2026-02-24T09:20:33.869 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:20:33.869 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:20:33.869 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:20:33.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.873+0000 7f563ea10640 1 -- 10.20.193.4:0/1125383902 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f560c0b56e0 msgr2=0x7f560c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:33.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.873+0000 7f563ea10640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f560c0b56e0 0x7f560c0d5b90 secure :-1 s=READY pgs=460 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5624004740 tx=0x7f5624009190 comp rx=0 tx=0).stop 2026-02-24T09:20:33.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.873+0000 7f563ea10640 1 -- 10.20.193.4:0/1125383902 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5638113200 msgr2=0x7f56380ebf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:33.877 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.873+0000 7f563ea10640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5638113200 0x7f56380ebf80 secure :-1 s=READY pgs=1323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f562c005820 tx=0x7f562c0039b0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.880+0000 7f563ea10640 1 -- 10.20.193.4:0/1125383902 shutdown_connections 2026-02-24T09:20:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.880+0000 7f563ea10640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f560c0b56e0 0x7f560c0d5b90 unknown :-1 s=CLOSED pgs=460 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.880+0000 7f563ea10640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f5638113200 0x7f56380ebf80 unknown :-1 s=CLOSED pgs=1323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.880+0000 7f563ea10640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f563810da00 0x7f5638173ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.880+0000 7f563ea10640 1 --2- 10.20.193.4:0/1125383902 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f563810d010 0x7f56380efcb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.880+0000 7f563ea10640 1 -- 10.20.193.4:0/1125383902 >> 10.20.193.4:0/1125383902 conn(0x7f563805f830 msgr2=0x7f563810f810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.880+0000 7f563ea10640 1 -- 10.20.193.4:0/1125383902 shutdown_connections 2026-02-24T09:20:33.884 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:33.880+0000 7f563ea10640 1 -- 10.20.193.4:0/1125383902 wait complete. 2026-02-24T09:20:34.000 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db / --timeout 90 --expiration 130.1 --await-for 45.0' 2026-02-24T09:20:34.001 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db / --timeout 90 --expiration 130.1 --await-for 45.0 2026-02-24T09:20:34.138 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:34.165 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:33 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1125383902' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:34.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.266+0000 7fba6d8de640 1 -- 10.20.193.4:0/206521094 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba681135a0 msgr2=0x7fba68173f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:34.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.266+0000 7fba6d8de640 1 --2- 10.20.193.4:0/206521094 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba681135a0 0x7fba68173f70 secure :-1 s=READY pgs=1324 gs=1 cs=0 l=1 c_cookie=1571904884468475947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5800aa30 tx=0x7fba58030280 comp rx=0 tx=0).stop 2026-02-24T09:20:34.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.266+0000 7fba6d8de640 1 -- 10.20.193.4:0/206521094 shutdown_connections 2026-02-24T09:20:34.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.266+0000 7fba6d8de640 1 --2- 10.20.193.4:0/206521094 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba681135a0 0x7fba68173f70 unknown :-1 s=CLOSED pgs=1324 gs=1 cs=0 l=1 c_cookie=1571904884468475947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.266+0000 7fba6d8de640 1 --2- 10.20.193.4:0/206521094 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba6810bcd0 0x7fba68112df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.266+0000 7fba6d8de640 1 --2- 10.20.193.4:0/206521094 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba6810b2e0 0x7fba6810b6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.266+0000 7fba6d8de640 1 -- 10.20.193.4:0/206521094 >> 10.20.193.4:0/206521094 conn(0x7fba680e8e50 msgr2=0x7fba68109260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.266+0000 7fba6d8de640 1 -- 10.20.193.4:0/206521094 shutdown_connections 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.266+0000 7fba6d8de640 1 -- 10.20.193.4:0/206521094 wait complete. 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6d8de640 1 Processor -- start 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6d8de640 1 -- start start 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6d8de640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba6810b2e0 0x7fba6810cbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6d8de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba6810bcd0 0x7fba6810d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6d8de640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba681135a0 0x7fba6810d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6d8de640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fba68163600 con 0x7fba6810bcd0 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6d8de640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fba68163770 con 0x7fba681135a0 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6d8de640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba68163930 con 0x7fba6810b2e0 2026-02-24T09:20:34.275 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba667fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba6810bcd0 0x7fba6810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba667fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba6810bcd0 0x7fba6810d110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41880/0 (socket says 10.20.193.4:41880) 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba667fc640 1 -- 10.20.193.4:0/2038115651 learned_addr learned my addr 10.20.193.4:0/2038115651 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba677fe640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba681135a0 0x7fba6810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba66ffd640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba6810b2e0 0x7fba6810cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba667fc640 1 -- 10.20.193.4:0/2038115651 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba6810b2e0 msgr2=0x7fba6810cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba667fc640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba6810b2e0 0x7fba6810cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba667fc640 1 -- 10.20.193.4:0/2038115651 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba681135a0 msgr2=0x7fba6810d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba667fc640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba681135a0 0x7fba6810d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba667fc640 1 -- 10.20.193.4:0/2038115651 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5800a650 con 0x7fba6810bcd0 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba66ffd640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba6810b2e0 0x7fba6810cbd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba667fc640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba6810bcd0 0x7fba6810d110 secure :-1 s=READY pgs=1325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba50005db0 tx=0x7fba5000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:34.276 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6c8dc640 1 -- 10.20.193.4:0/2038115651 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba50004500 con 0x7fba6810bcd0 2026-02-24T09:20:34.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6d8de640 1 -- 10.20.193.4:0/2038115651 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba68163c10 con 0x7fba6810bcd0 2026-02-24T09:20:34.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6c8dc640 1 -- 10.20.193.4:0/2038115651 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba50004d30 con 0x7fba6810bcd0 2026-02-24T09:20:34.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6c8dc640 1 -- 10.20.193.4:0/2038115651 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba50005310 con 0x7fba6810bcd0 2026-02-24T09:20:34.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.267+0000 7fba6d8de640 1 -- 10.20.193.4:0/2038115651 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba68164090 con 0x7fba6810bcd0 2026-02-24T09:20:34.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.269+0000 7fba6c8dc640 1 -- 10.20.193.4:0/2038115651 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fba500054a0 con 0x7fba6810bcd0 2026-02-24T09:20:34.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.270+0000 7fba6c8dc640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba3c0b56e0 0x7fba3c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.270+0000 7fba66ffd640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba3c0b56e0 0x7fba3c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.270+0000 7fba6c8dc640 1 -- 10.20.193.4:0/2038115651 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fba500e6ce0 con 0x7fba6810bcd0 2026-02-24T09:20:34.277 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.270+0000 7fba66ffd640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba3c0b56e0 0x7fba3c0d5b90 secure :-1 s=READY pgs=461 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5c004740 tx=0x7fba5c005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba6f8d8e00 1 Processor -- start 2026-02-24T09:20:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba6f8d8e00 1 -- start start 2026-02-24T09:20:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8dbd0 0x561eaae8dfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 0x561eaaed2c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaaed3180 0x561eaaef3560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561eaad9cf20 con 0x561eaaed3180 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561eaad98c50 con 0x561eaae8e4e0 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561eaad92db0 con 0x561eaae8dbd0 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba677fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaaed3180 0x561eaaef3560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba677fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaaed3180 0x561eaaef3560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41886/0 (socket says 10.20.193.4:41886) 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba677fe640 1 -- 10.20.193.4:0/2425090503 learned_addr learned my addr 10.20.193.4:0/2425090503 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba667fc640 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 0x561eaaed2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba677fe640 1 -- 10.20.193.4:0/2425090503 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8dbd0 msgr2=0x561eaae8dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba66ffd640 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8dbd0 0x561eaae8dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba677fe640 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8dbd0 0x561eaae8dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba677fe640 1 -- 10.20.193.4:0/2425090503 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 msgr2=0x561eaaed2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba677fe640 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 0x561eaaed2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba677fe640 1 -- 10.20.193.4:0/2425090503 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eaad33690 con 0x561eaaed3180 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba667fc640 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 0x561eaaed2c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba66ffd640 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8dbd0 0x561eaae8dfa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba677fe640 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaaed3180 0x561eaaef3560 secure :-1 s=READY pgs=1326 gs=1 cs=0 l=1 c_cookie=8343361213683950610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba58030790 tx=0x7fba58006a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c992d19e676412 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba2bfff640 1 -- 10.20.193.4:0/2425090503 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba5803e040 con 0x561eaaed3180 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba2bfff640 1 -- 10.20.193.4:0/2425090503 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba58030ae0 con 0x561eaaed3180 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.272+0000 7fba2bfff640 1 -- 10.20.193.4:0/2425090503 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba580050c0 con 0x561eaaed3180 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.273+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2425090503 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaaed3180 msgr2=0x561eaaef3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.273+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaaed3180 0x561eaaef3560 secure :-1 s=READY pgs=1326 gs=1 cs=0 l=1 c_cookie=8343361213683950610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba58030790 tx=0x7fba58006a90 comp rx=0 tx=0).stop 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.273+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2425090503 shutdown_connections 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.273+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaaed3180 0x561eaaef3560 unknown :-1 s=CLOSED pgs=1326 gs=1 cs=0 l=1 c_cookie=8343361213683950610 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.273+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 0x561eaaed2c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.285 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.273+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/2425090503 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8dbd0 0x561eaae8dfa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.273+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2425090503 >> 10.20.193.4:0/2425090503 conn(0x561eaadab880 msgr2=0x561eaae8c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.273+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2425090503 shutdown_connections 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.273+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2425090503 wait complete. 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.273+0000 7fba6f8d8e00 1 -- start start 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba6f8d8e00 1 Processor -- start 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaea5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8e4e0 0x561eaaea61c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaaed3180 0x561eaaeab1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561eaaeab6f0 con 0x561eaae8dbd0 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561eaaeab860 con 0x561eaaed3180 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561eaaeaba20 con 0x561eaae8e4e0 2026-02-24T09:20:34.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba66ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaea5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba66ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaea5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41894/0 (socket says 10.20.193.4:41894) 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba66ffd640 1 -- 10.20.193.4:0/3349584115 learned_addr learned my addr 10.20.193.4:0/3349584115 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba667fc640 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8e4e0 0x561eaaea61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba66ffd640 1 -- 10.20.193.4:0/3349584115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8e4e0 msgr2=0x561eaaea61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba66ffd640 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8e4e0 0x561eaaea61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba66ffd640 1 -- 10.20.193.4:0/3349584115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaaed3180 msgr2=0x561eaaeab1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba677fe640 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaaed3180 0x561eaaeab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba66ffd640 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaaed3180 0x561eaaeab1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba66ffd640 1 -- 10.20.193.4:0/3349584115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eaad3e3d0 con 0x561eaae8dbd0 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba66ffd640 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaea5c80 secure :-1 s=READY pgs=1327 gs=1 cs=0 l=1 c_cookie=10113848417866643782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5c010850 tx=0x7fba5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5b9b8cf3167946 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba297fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba297fa640 1 -- 10.20.193.4:0/3349584115 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba5c01c840 con 0x561eaae8dbd0 2026-02-24T09:20:34.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/3349584115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba681747e0 con 0x561eaae8dbd0 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba297fa640 1 -- 10.20.193.4:0/3349584115 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba5c01ce80 con 0x561eaae8dbd0 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba297fa640 1 -- 10.20.193.4:0/3349584115 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba5c024650 con 0x561eaae8dbd0 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba6f8d8e00 10 client.18354 _ll_register_callbacks cb 0x561eaad13a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.274+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/3349584115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561eaaa20eb0 con 0x561eaae8dbd0 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba297fa640 1 -- 10.20.193.4:0/3349584115 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fba5c0247e0 con 0x561eaae8dbd0 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba297fa640 1 -- 10.20.193.4:0/3349584115 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fba5c0249a0 con 0x561eaae8dbd0 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba6f8d8e00 10 client.18354 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/3349584115 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561eaad165c0 con 0x561eaae8dbd0 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba297fa640 1 -- 10.20.193.4:0/3349584115 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fba5c024b80 con 0x561eaae8dbd0 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba6f8d8e00 10 client.18354 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba6f8d8e00 10 client.18354 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba6f8d8e00 20 client.18354 populate_metadata read hostname 'trial004' 2026-02-24T09:20:34.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561eaaed06a0 0x561eaaed0b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba6f8d8e00 4 client.18354 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/3349584115 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561eaada3f00 con 0x561eaaed06a0 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba667fc640 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561eaaed06a0 0x561eaaed0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba667fc640 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561eaaed06a0 0x561eaaed0b10 crc :-1 s=READY pgs=229 gs=4 cs=0 l=0 c_cookie=14129578965595013618 s_cookie=14915226159967336509 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c41659351e1f41f2 server_cookie=cefd872b1177783d in_seq=0 out_seq=0 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.275+0000 7fba297fa640 10 client.18354 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba297fa640 1 -- 10.20.193.4:0/3349584115 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561eaada3f00 con 0x561eaaed06a0 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba297fa640 10 client.18354 handle_command_reply: tid=0 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 client.18354 shutdown 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/3349584115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 msgr2=0x561eaaea5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaea5c80 secure :-1 s=READY pgs=1327 gs=1 cs=0 l=1 c_cookie=10113848417866643782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5c010850 tx=0x7fba5c004770 comp rx=0 tx=0).stop 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/3349584115 shutdown_connections 2026-02-24T09:20:34.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561eaaed06a0 0x561eaaed0b10 crc :-1 s=READY pgs=229 gs=4 cs=0 l=0 c_cookie=14129578965595013618 s_cookie=14915226159967336509 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaaed3180 0x561eaaeab1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaae8e4e0 0x561eaaea61c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/3349584115 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaea5c80 unknown :-1 s=CLOSED pgs=1327 gs=1 cs=0 l=1 c_cookie=10113848417866643782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba297fa640 0 client.18354 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:34.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/3349584115 >> 10.20.193.4:0/3349584115 conn(0x561eaadab880 msgr2=0x561eaae8cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:34.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/3349584115 shutdown_connections 2026-02-24T09:20:34.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/3349584115 wait complete. 2026-02-24T09:20:34.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.276+0000 7fba6f8d8e00 20 client.18354 trim_cache size 0 max 16384 2026-02-24T09:20:34.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba6f8d8e00 1 Processor -- start 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba6f8d8e00 1 -- start start 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaeaa680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 0x561eaaecb690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaaed3180 0x561eaaecbbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561eaad909e0 con 0x561eaae8dbd0 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561eaaa48ec0 con 0x561eaae8e4e0 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561eaae9ec60 con 0x561eaaed3180 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba66ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaeaa680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba66ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaeaa680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41898/0 (socket says 10.20.193.4:41898) 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba66ffd640 1 -- 10.20.193.4:0/4080881006 learned_addr learned my addr 10.20.193.4:0/4080881006 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:34.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.286+0000 7fba667fc640 1 --2- 10.20.193.4:0/4080881006 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 0x561eaaecb690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.287+0000 7fba66ffd640 1 -- 10.20.193.4:0/4080881006 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaaed3180 msgr2=0x561eaaecbbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.287+0000 7fba66ffd640 1 --2- 10.20.193.4:0/4080881006 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaaed3180 0x561eaaecbbd0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.287+0000 7fba66ffd640 1 -- 10.20.193.4:0/4080881006 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 msgr2=0x561eaaecb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.287+0000 7fba66ffd640 1 --2- 10.20.193.4:0/4080881006 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 0x561eaaecb690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.287+0000 7fba66ffd640 1 -- 10.20.193.4:0/4080881006 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eaad28500 con 0x561eaae8dbd0 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.287+0000 7fba66ffd640 1 --2- 10.20.193.4:0/4080881006 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaeaa680 secure :-1 s=READY pgs=1328 gs=1 cs=0 l=1 c_cookie=14837004757347296317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5c013040 tx=0x7fba5c028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde7a1378c77643d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.287+0000 7fba2b7fe640 1 -- 10.20.193.4:0/4080881006 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba5c03b070 con 0x561eaae8dbd0 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.287+0000 7fba2b7fe640 1 -- 10.20.193.4:0/4080881006 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x561eaaa20eb0 con 0x561eaae8dbd0 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.287+0000 7fba2b7fe640 1 -- 10.20.193.4:0/4080881006 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba5c0247e0 con 0x561eaae8dbd0 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.288+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/4080881006 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 msgr2=0x561eaaeaa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.288+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/4080881006 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaeaa680 secure :-1 s=READY pgs=1328 gs=1 cs=0 l=1 c_cookie=14837004757347296317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5c013040 tx=0x7fba5c028000 comp rx=0 tx=0).stop 2026-02-24T09:20:34.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.288+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/4080881006 shutdown_connections 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.288+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/4080881006 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaaed3180 0x561eaaecbbd0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.288+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/4080881006 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8e4e0 0x561eaaecb690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.288+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/4080881006 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8dbd0 0x561eaaeaa680 unknown :-1 s=CLOSED pgs=1328 gs=1 cs=0 l=1 c_cookie=14837004757347296317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.288+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/4080881006 >> 10.20.193.4:0/4080881006 conn(0x561eaadab880 msgr2=0x561eaaea96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.288+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/4080881006 shutdown_connections 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.288+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/4080881006 wait complete. 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba6f8d8e00 1 -- start start 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba6f8d8e00 1 Processor -- start 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8dbd0 0x561eaaeb1d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8e4e0 0x561eaaeac240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba6f8d8e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaaed3180 0x561eaaeac780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561eaaeab2c0 con 0x561eaae8e4e0 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561eaadfe410 con 0x561eaae8dbd0 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba6f8d8e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561eaaecec40 con 0x561eaaed3180 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba667fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8e4e0 0x561eaaeac240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba667fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8e4e0 0x561eaaeac240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41914/0 (socket says 10.20.193.4:41914) 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba667fc640 1 -- 10.20.193.4:0/2242276793 learned_addr learned my addr 10.20.193.4:0/2242276793 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba66ffd640 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8dbd0 0x561eaaeb1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba677fe640 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaaed3180 0x561eaaeac780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba667fc640 1 -- 10.20.193.4:0/2242276793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaaed3180 msgr2=0x561eaaeac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba667fc640 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaaed3180 0x561eaaeac780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba667fc640 1 -- 10.20.193.4:0/2242276793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8dbd0 msgr2=0x561eaaeb1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba667fc640 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8dbd0 0x561eaaeb1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba667fc640 1 -- 10.20.193.4:0/2242276793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eaad22f80 con 0x561eaae8e4e0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba677fe640 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaaed3180 0x561eaaeac780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba667fc640 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8e4e0 0x561eaaeac240 secure :-1 s=READY pgs=1329 gs=1 cs=0 l=1 c_cookie=16105424482639141475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba50005470 tx=0x7fba50009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df81f63c9c95da63 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba297fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba297fa640 1 -- 10.20.193.4:0/2242276793 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba5006f070 con 0x561eaae8e4e0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba297fa640 1 -- 10.20.193.4:0/2242276793 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba50096040 con 0x561eaae8e4e0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba297fa640 1 -- 10.20.193.4:0/2242276793 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba500ace30 con 0x561eaae8e4e0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.289+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2242276793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eaad165c0 con 0x561eaae8e4e0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.290+0000 7fba297fa640 1 -- 10.20.193.4:0/2242276793 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fba500721a0 con 0x561eaae8e4e0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.290+0000 7fba297fa640 10 client.18360 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.290+0000 7fba6f8d8e00 10 client.18360 _ll_register_callbacks cb 0x561eaad13a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.290+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2242276793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561eaaa1e700 con 0x561eaae8e4e0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.290+0000 7fba297fa640 1 -- 10.20.193.4:0/2242276793 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fba500b5310 con 0x561eaae8e4e0 2026-02-24T09:20:34.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.290+0000 7fba6f8d8e00 10 client.18360 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.290+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2242276793 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561eaad168f0 con 0x561eaae8e4e0 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.290+0000 7fba297fa640 1 -- 10.20.193.4:0/2242276793 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fba500adca0 con 0x561eaae8e4e0 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.290+0000 7fba6f8d8e00 10 client.18360 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.290+0000 7fba6f8d8e00 10 client.18360 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.291+0000 7fba6f8d8e00 20 client.18360 populate_metadata read hostname 'trial004' 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.291+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561eaaf810d0 0x561eaafa1580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.291+0000 7fba6f8d8e00 4 client.18360 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.1, "await_for": 45.0}] 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.291+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2242276793 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.1, "await_for": 45.0}) -- 0x561eaada5b70 con 0x561eaaf810d0 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.291+0000 7fba66ffd640 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561eaaf810d0 0x561eaafa1580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.291+0000 7fba66ffd640 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561eaaf810d0 0x561eaafa1580 crc :-1 s=READY pgs=230 gs=4 cs=0 l=0 c_cookie=15113489262329183484 s_cookie=14660064552059674220 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1bde668cdcfbcfc server_cookie=cb730309a9d01e6c in_seq=0 out_seq=0 2026-02-24T09:20:34.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.291+0000 7fba297fa640 10 client.18360 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:34.319 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba297fa640 1 -- 10.20.193.4:0/2242276793 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561eaada5b70 con 0x561eaaf810d0 2026-02-24T09:20:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba297fa640 10 client.18360 handle_command_reply: tid=0 2026-02-24T09:20:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba6f8d8e00 1 client.18360 shutdown 2026-02-24T09:20:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2242276793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8e4e0 msgr2=0x561eaaeac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8e4e0 0x561eaaeac240 secure :-1 s=READY pgs=1329 gs=1 cs=0 l=1 c_cookie=16105424482639141475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba50005470 tx=0x7fba50009de0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2242276793 shutdown_connections 2026-02-24T09:20:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x561eaaf810d0 0x561eaafa1580 crc :-1 s=READY pgs=230 gs=4 cs=0 l=0 c_cookie=15113489262329183484 s_cookie=14660064552059674220 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x561eaaed3180 0x561eaaeac780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x561eaae8e4e0 0x561eaaeac240 unknown :-1 s=CLOSED pgs=1329 gs=1 cs=0 l=1 c_cookie=16105424482639141475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.320 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba6f8d8e00 1 --2- 10.20.193.4:0/2242276793 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x561eaae8dbd0 0x561eaaeb1d80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba297fa640 0 client.18360 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.315+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2242276793 >> 10.20.193.4:0/2242276793 conn(0x561eaadab880 msgr2=0x561eaaea4090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2242276793 shutdown_connections 2026-02-24T09:20:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6f8d8e00 1 -- 10.20.193.4:0/2242276793 wait complete. 2026-02-24T09:20:34.321 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6f8d8e00 20 client.18360 trim_cache size 0 max 16384 2026-02-24T09:20:34.321 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:20:34.321 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 42, 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "fac655d2": { 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "version": 42, 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:20:34.322 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 130.1, 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: "name": "QUIESCED", 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:34.323 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:20:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 -- 10.20.193.4:0/2038115651 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba3c0b56e0 msgr2=0x7fba3c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba3c0b56e0 0x7fba3c0d5b90 secure :-1 s=READY pgs=461 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba5c004740 tx=0x7fba5c005f00 comp rx=0 tx=0).stop 2026-02-24T09:20:34.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 -- 10.20.193.4:0/2038115651 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba6810bcd0 msgr2=0x7fba6810d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba6810bcd0 0x7fba6810d110 secure :-1 s=READY pgs=1325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba50005db0 tx=0x7fba5000ddf0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 -- 10.20.193.4:0/2038115651 shutdown_connections 2026-02-24T09:20:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba3c0b56e0 0x7fba3c0d5b90 unknown :-1 s=CLOSED pgs=461 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba681135a0 0x7fba6810d650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba6810bcd0 0x7fba6810d110 unknown :-1 s=CLOSED pgs=1325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 --2- 10.20.193.4:0/2038115651 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba6810b2e0 0x7fba6810cbd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 -- 10.20.193.4:0/2038115651 >> 10.20.193.4:0/2038115651 conn(0x7fba680e8e50 msgr2=0x7fba68109230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 -- 10.20.193.4:0/2038115651 shutdown_connections 2026-02-24T09:20:34.325 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:34.316+0000 7fba6d8de640 1 -- 10.20.193.4:0/2038115651 wait complete. 2026-02-24T09:20:34.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:33 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1125383902' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:34.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:33 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1125383902' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:34.379 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fac655d2', quiesce took 1.0 seconds. Will release after: 9.1 2026-02-24T09:20:35.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:34 trial004 ceph-mon[41596]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 846 MiB/s wr, 238 op/s 2026-02-24T09:20:35.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:34 trial090 ceph-mon[47278]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 846 MiB/s wr, 238 op/s 2026-02-24T09:20:35.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:34 trial014 ceph-mon[46941]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 846 MiB/s wr, 238 op/s 2026-02-24T09:20:37.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:36 trial004 ceph-mon[41596]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 802 MiB/s wr, 228 op/s 2026-02-24T09:20:37.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:36 trial090 ceph-mon[47278]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 802 MiB/s wr, 228 op/s 2026-02-24T09:20:37.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:36 trial014 ceph-mon[46941]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 50 KiB/s rd, 802 MiB/s wr, 228 op/s 2026-02-24T09:20:39.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:38 trial004 ceph-mon[41596]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 739 MiB/s wr, 213 op/s 2026-02-24T09:20:39.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:38 trial090 ceph-mon[47278]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 739 MiB/s wr, 213 op/s 2026-02-24T09:20:39.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:38 trial014 ceph-mon[46941]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 739 MiB/s wr, 213 op/s 2026-02-24T09:20:41.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:40 trial004 ceph-mon[41596]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 678 MiB/s wr, 199 op/s 2026-02-24T09:20:41.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:40 trial090 ceph-mon[47278]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 678 MiB/s wr, 199 op/s 2026-02-24T09:20:41.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:40 trial014 ceph-mon[46941]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 35 KiB/s rd, 678 MiB/s wr, 199 op/s 2026-02-24T09:20:41.476 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:20:41.594 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:41.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 -- 10.20.193.4:0/3335412475 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8e4810f740 msgr2=0x7f8e4810fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 --2- 10.20.193.4:0/3335412475 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8e4810f740 0x7f8e4810fb10 secure :-1 s=READY pgs=1330 gs=1 cs=0 l=1 c_cookie=10151769500563146636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3c009950 tx=0x7f8e3c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 -- 10.20.193.4:0/3335412475 shutdown_connections 2026-02-24T09:20:41.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 --2- 10.20.193.4:0/3335412475 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8e48115930 0x7f8e48176300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 --2- 10.20.193.4:0/3335412475 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e48110130 0x7f8e48115180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 --2- 10.20.193.4:0/3335412475 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8e4810f740 0x7f8e4810fb10 unknown :-1 s=CLOSED pgs=1330 gs=1 cs=0 l=1 c_cookie=10151769500563146636 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 -- 10.20.193.4:0/3335412475 >> 10.20.193.4:0/3335412475 conn(0x7f8e480ed050 msgr2=0x7f8e4810d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:41.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 -- 10.20.193.4:0/3335412475 shutdown_connections 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 -- 10.20.193.4:0/3335412475 wait complete. 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 Processor -- start 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 -- start start 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8e4810f740 0x7f8e4811e0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e48110130 0x7f8e4811e600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8e48115930 0x7f8e481239d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f8e48123ff0 con 0x7f8e48115930 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f8e48124160 con 0x7f8e4810f740 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.690+0000 7f8e4d506640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8e48124320 con 0x7f8e48110130 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e477fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8e48115930 0x7f8e481239d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e477fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8e48115930 0x7f8e481239d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41934/0 (socket says 10.20.193.4:41934) 2026-02-24T09:20:41.697 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e477fe640 1 -- 10.20.193.4:0/2726563332 learned_addr learned my addr 10.20.193.4:0/2726563332 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8e4810f740 0x7f8e4811e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e467fc640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e48110130 0x7f8e4811e600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e477fe640 1 -- 10.20.193.4:0/2726563332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e48110130 msgr2=0x7f8e4811e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e477fe640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e48110130 0x7f8e4811e600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e477fe640 1 -- 10.20.193.4:0/2726563332 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8e4810f740 msgr2=0x7f8e4811e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e477fe640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8e4810f740 0x7f8e4811e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e477fe640 1 -- 10.20.193.4:0/2726563332 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3c009570 con 0x7f8e48115930 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8e4810f740 0x7f8e4811e0c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e477fe640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8e48115930 0x7f8e481239d0 secure :-1 s=READY pgs=1331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e38006e90 tx=0x7f8e3800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e27fff640 1 -- 10.20.193.4:0/2726563332 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e38005500 con 0x7f8e48115930 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e4d506640 1 -- 10.20.193.4:0/2726563332 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e48124600 con 0x7f8e48115930 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e27fff640 1 -- 10.20.193.4:0/2726563332 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e38005e10 con 0x7f8e48115930 2026-02-24T09:20:41.698 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e27fff640 1 -- 10.20.193.4:0/2726563332 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e38003a90 con 0x7f8e48115930 2026-02-24T09:20:41.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.691+0000 7f8e4d506640 1 -- 10.20.193.4:0/2726563332 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e48164d00 con 0x7f8e48115930 2026-02-24T09:20:41.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.693+0000 7f8e27fff640 1 -- 10.20.193.4:0/2726563332 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f8e3800c840 con 0x7f8e48115930 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.693+0000 7f8e27fff640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8e1c0b56e0 0x7f8e1c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.693+0000 7f8e27fff640 1 -- 10.20.193.4:0/2726563332 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8e380e7940 con 0x7f8e48115930 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.693+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8e1c0b56e0 0x7f8e1c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.694+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8e1c0b56e0 0x7f8e1c0d5b90 secure :-1 s=READY pgs=462 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3c0023d0 tx=0x7f8e3c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.694+0000 7f8e4f500e00 1 Processor -- start 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e4f500e00 1 -- start start 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f5820 0x56157a0f5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a0f6130 0x56157a13a890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a13add0 0x56157a15b1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56157a005de0 con 0x56157a0f5820 2026-02-24T09:20:41.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56157a001b10 con 0x56157a13add0 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x561579ffbab0 con 0x56157a0f6130 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e46ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f5820 0x56157a0f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e46ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f5820 0x56157a0f5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41948/0 (socket says 10.20.193.4:41948) 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e46ffd640 1 -- 10.20.193.4:0/3597055183 learned_addr learned my addr 10.20.193.4:0/3597055183 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e477fe640 1 --2- 10.20.193.4:0/3597055183 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a13add0 0x56157a15b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e467fc640 1 --2- 10.20.193.4:0/3597055183 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a0f6130 0x56157a13a890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e46ffd640 1 -- 10.20.193.4:0/3597055183 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a0f6130 msgr2=0x56157a13a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/3597055183 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a0f6130 0x56157a13a890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e46ffd640 1 -- 10.20.193.4:0/3597055183 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a13add0 msgr2=0x56157a15b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/3597055183 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a13add0 0x56157a15b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e46ffd640 1 -- 10.20.193.4:0/3597055183 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561579fa7310 con 0x56157a0f5820 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e467fc640 1 --2- 10.20.193.4:0/3597055183 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a0f6130 0x56157a13a890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/3597055183 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f5820 0x56157a0f5bf0 secure :-1 s=READY pgs=1332 gs=1 cs=0 l=1 c_cookie=2106079878859126286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3c005ed0 tx=0x7f8e3c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3a4c7dc7fef60e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e137fe640 1 -- 10.20.193.4:0/3597055183 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e3c02f9f0 con 0x56157a0f5820 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e137fe640 1 -- 10.20.193.4:0/3597055183 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e3c038e00 con 0x56157a0f5820 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e137fe640 1 -- 10.20.193.4:0/3597055183 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e3c04f9f0 con 0x56157a0f5820 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3597055183 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f5820 msgr2=0x56157a0f5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.695+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/3597055183 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f5820 0x56157a0f5bf0 secure :-1 s=READY pgs=1332 gs=1 cs=0 l=1 c_cookie=2106079878859126286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3c005ed0 tx=0x7f8e3c040000 comp rx=0 tx=0).stop 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.696+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3597055183 shutdown_connections 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.696+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/3597055183 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a13add0 0x56157a15b1b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.696+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/3597055183 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a0f6130 0x56157a13a890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.696+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/3597055183 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f5820 0x56157a0f5bf0 unknown :-1 s=CLOSED pgs=1332 gs=1 cs=0 l=1 c_cookie=2106079878859126286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.707 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.696+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3597055183 >> 10.20.193.4:0/3597055183 conn(0x56157a0146b0 msgr2=0x56157a0f4100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:41.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.696+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3597055183 shutdown_connections 2026-02-24T09:20:41.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.696+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3597055183 wait complete. 2026-02-24T09:20:41.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.696+0000 7f8e4f500e00 1 -- start start 2026-02-24T09:20:41.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.696+0000 7f8e4f500e00 1 Processor -- start 2026-02-24T09:20:41.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.696+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a0f5820 0x56157a10dd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10e2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 0x56157a1132c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56157a113800 con 0x56157a0f6130 2026-02-24T09:20:41.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56157a113970 con 0x56157a0f5820 2026-02-24T09:20:41.708 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56157a113b30 con 0x56157a13add0 2026-02-24T09:20:41.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e467fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e467fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41962/0 (socket says 10.20.193.4:41962) 2026-02-24T09:20:41.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e467fc640 1 -- 10.20.193.4:0/867361996 learned_addr learned my addr 10.20.193.4:0/867361996 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:41.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a0f5820 0x56157a10dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e467fc640 1 -- 10.20.193.4:0/867361996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 msgr2=0x56157a1132c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:41.709 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e477fe640 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 0x56157a1132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e467fc640 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 0x56157a1132c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e467fc640 1 -- 10.20.193.4:0/867361996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a0f5820 msgr2=0x56157a10dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:41.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e467fc640 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a0f5820 0x56157a10dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e467fc640 1 -- 10.20.193.4:0/867361996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561579f7f8c0 con 0x56157a0f6130 2026-02-24T09:20:41.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e477fe640 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 0x56157a1132c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:41.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e467fc640 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10e2d0 secure :-1 s=READY pgs=1333 gs=1 cs=0 l=1 c_cookie=15204590468569416845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e30004210 tx=0x7f8e30010810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3018e794a5ec48d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:41.710 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e10ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:41.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e10ff9640 1 -- 10.20.193.4:0/867361996 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e30012940 con 0x56157a0f6130 2026-02-24T09:20:41.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 1 -- 10.20.193.4:0/867361996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e48176b70 con 0x56157a0f6130 2026-02-24T09:20:41.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e10ff9640 1 -- 10.20.193.4:0/867361996 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e3001a400 con 0x56157a0f6130 2026-02-24T09:20:41.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e10ff9640 1 -- 10.20.193.4:0/867361996 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e30011660 con 0x56157a0f6130 2026-02-24T09:20:41.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 10 client.18372 _ll_register_callbacks cb 0x561579f97160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:41.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 1 -- 10.20.193.4:0/867361996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561579d4b4a0 con 0x56157a0f6130 2026-02-24T09:20:41.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e10ff9640 1 -- 10.20.193.4:0/867361996 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8e300117f0 con 0x56157a0f6130 2026-02-24T09:20:41.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e10ff9640 1 -- 10.20.193.4:0/867361996 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8e300119b0 con 0x56157a0f6130 2026-02-24T09:20:41.711 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 10 client.18372 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 1 -- 10.20.193.4:0/867361996 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561579f916e0 con 0x56157a0f6130 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e10ff9640 1 -- 10.20.193.4:0/867361996 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f8e30018020 con 0x56157a0f6130 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 10 client.18372 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 10 client.18372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 20 client.18372 populate_metadata read hostname 'trial004' 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56157a138690 0x56157a138b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 4 client.18372 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.697+0000 7f8e4f500e00 1 -- 10.20.193.4:0/867361996 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561579ff14f0 con 0x56157a138690 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56157a138690 0x56157a138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56157a138690 0x56157a138b30 crc :-1 s=READY pgs=231 gs=4 cs=0 l=0 c_cookie=7373236360166079391 s_cookie=17555885362454920326 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6652ff678cb17b9f server_cookie=f3a308b8da9afc86 in_seq=0 out_seq=0 2026-02-24T09:20:41.712 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e10ff9640 10 client.18372 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e10ff9640 1 -- 10.20.193.4:0/867361996 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x561579ff14f0 con 0x56157a138690 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e10ff9640 10 client.18372 handle_command_reply: tid=0 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 client.18372 shutdown 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 -- 10.20.193.4:0/867361996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 msgr2=0x56157a10e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10e2d0 secure :-1 s=READY pgs=1333 gs=1 cs=0 l=1 c_cookie=15204590468569416845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e30004210 tx=0x7f8e30010810 comp rx=0 tx=0).stop 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 -- 10.20.193.4:0/867361996 shutdown_connections 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56157a138690 0x56157a138b30 crc :-1 s=READY pgs=231 gs=4 cs=0 l=0 c_cookie=7373236360166079391 s_cookie=17555885362454920326 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 0x56157a1132c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10e2d0 unknown :-1 s=CLOSED pgs=1333 gs=1 cs=0 l=1 c_cookie=15204590468569416845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/867361996 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a0f5820 0x56157a10dd90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e10ff9640 0 client.18372 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 -- 10.20.193.4:0/867361996 >> 10.20.193.4:0/867361996 conn(0x56157a0146b0 msgr2=0x56157a0f4810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:41.713 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 -- 10.20.193.4:0/867361996 shutdown_connections 2026-02-24T09:20:41.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.698+0000 7f8e4f500e00 1 -- 10.20.193.4:0/867361996 wait complete. 2026-02-24T09:20:41.714 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.699+0000 7f8e4f500e00 20 client.18372 trim_cache size 0 max 16384 2026-02-24T09:20:41.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.707+0000 7f8e4f500e00 1 Processor -- start 2026-02-24T09:20:41.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.707+0000 7f8e4f500e00 1 -- start start 2026-02-24T09:20:41.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.707+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a0f5820 0x56157a10b160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.707+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10b6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.707+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 0x56157a132700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.707+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x561579ff96e0 con 0x56157a0f6130 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.707+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x561579cc4f50 con 0x56157a0f5820 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.707+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56157a0653d0 con 0x56157a13add0 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.707+0000 7f8e467fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.707+0000 7f8e467fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41976/0 (socket says 10.20.193.4:41976) 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e467fc640 1 -- 10.20.193.4:0/4157735531 learned_addr learned my addr 10.20.193.4:0/4157735531 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e477fe640 1 --2- 10.20.193.4:0/4157735531 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 0x56157a132700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/4157735531 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a0f5820 0x56157a10b160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e467fc640 1 -- 10.20.193.4:0/4157735531 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 msgr2=0x56157a132700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e467fc640 1 --2- 10.20.193.4:0/4157735531 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 0x56157a132700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e467fc640 1 -- 10.20.193.4:0/4157735531 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a0f5820 msgr2=0x56157a10b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e467fc640 1 --2- 10.20.193.4:0/4157735531 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a0f5820 0x56157a10b160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e467fc640 1 -- 10.20.193.4:0/4157735531 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561579f8c160 con 0x56157a0f6130 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e467fc640 1 --2- 10.20.193.4:0/4157735531 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10b6a0 secure :-1 s=READY pgs=1334 gs=1 cs=0 l=1 c_cookie=5168355255424484608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3000e4f0 tx=0x7f8e3001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b9afb8c0998500 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e12ffd640 1 -- 10.20.193.4:0/4157735531 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e30010d20 con 0x56157a0f6130 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e12ffd640 1 -- 10.20.193.4:0/4157735531 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x561579d4b4a0 con 0x56157a0f6130 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e12ffd640 1 -- 10.20.193.4:0/4157735531 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e30011280 con 0x56157a0f6130 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e4f500e00 1 -- 10.20.193.4:0/4157735531 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 msgr2=0x56157a10b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/4157735531 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10b6a0 secure :-1 s=READY pgs=1334 gs=1 cs=0 l=1 c_cookie=5168355255424484608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3000e4f0 tx=0x7f8e3001e000 comp rx=0 tx=0).stop 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e4f500e00 1 -- 10.20.193.4:0/4157735531 shutdown_connections 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/4157735531 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a13add0 0x56157a132700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/4157735531 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a10b6a0 unknown :-1 s=CLOSED pgs=1334 gs=1 cs=0 l=1 c_cookie=5168355255424484608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/4157735531 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a0f5820 0x56157a10b160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e4f500e00 1 -- 10.20.193.4:0/4157735531 >> 10.20.193.4:0/4157735531 conn(0x56157a0146b0 msgr2=0x56157a1391f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e4f500e00 1 -- 10.20.193.4:0/4157735531 shutdown_connections 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.708+0000 7f8e4f500e00 1 -- 10.20.193.4:0/4157735531 wait complete. 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 -- start start 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 Processor -- start 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a0f5820 0x56157a115ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a116400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a13add0 0x56157a1193c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56157a106e40 con 0x56157a0f6130 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56157a064600 con 0x56157a13add0 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56157a119900 con 0x56157a0f5820 2026-02-24T09:20:41.722 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e467fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a116400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e467fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a116400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:41992/0 (socket says 10.20.193.4:41992) 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e467fc640 1 -- 10.20.193.4:0/3131353259 learned_addr learned my addr 10.20.193.4:0/3131353259 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e467fc640 1 -- 10.20.193.4:0/3131353259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a0f5820 msgr2=0x56157a115ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e467fc640 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a0f5820 0x56157a115ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e467fc640 1 -- 10.20.193.4:0/3131353259 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a13add0 msgr2=0x56157a1193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e467fc640 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a13add0 0x56157a1193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e467fc640 1 -- 10.20.193.4:0/3131353259 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561579f7fbf0 con 0x56157a0f6130 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e467fc640 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a116400 secure :-1 s=READY pgs=1335 gs=1 cs=0 l=1 c_cookie=8858443468745963295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e30004690 tx=0x7f8e30004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aef8366997b771f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e10ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e10ff9640 1 -- 10.20.193.4:0/3131353259 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e30010d20 con 0x56157a0f6130 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e10ff9640 1 -- 10.20.193.4:0/3131353259 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e30022830 con 0x56157a0f6130 2026-02-24T09:20:41.723 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3131353259 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561579f916e0 con 0x56157a0f6130 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e10ff9640 1 -- 10.20.193.4:0/3131353259 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e30012720 con 0x56157a0f6130 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 10 client.18378 _ll_register_callbacks cb 0x561579f97160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3131353259 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e3c038e00 con 0x56157a0f6130 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e10ff9640 1 -- 10.20.193.4:0/3131353259 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8e300128a0 con 0x56157a0f6130 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e10ff9640 1 -- 10.20.193.4:0/3131353259 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8e30012a80 con 0x56157a0f6130 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 10 client.18378 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.709+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3131353259 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x561579f91940 con 0x56157a0f6130 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e10ff9640 1 -- 10.20.193.4:0/3131353259 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f8e30018070 con 0x56157a0f6130 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e4f500e00 10 client.18378 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e4f500e00 10 client.18378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e4f500e00 20 client.18378 populate_metadata read hostname 'trial004' 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56157a1e84f0 0x56157a208970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.724 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e4f500e00 4 client.18378 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3131353259 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561579d30160 con 0x56157a1e84f0 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56157a1e84f0 0x56157a208970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e10ff9640 10 client.18378 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e46ffd640 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56157a1e84f0 0x56157a208970 crc :-1 s=READY pgs=232 gs=4 cs=0 l=0 c_cookie=7065247579004155763 s_cookie=13211250253183813977 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=620ccd3d64bb3773 server_cookie=b757ca1bebcf8959 in_seq=0 out_seq=0 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e10ff9640 1 -- 10.20.193.4:0/3131353259 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6054 (crc 0 0 0) 0x561579d30160 con 0x56157a1e84f0 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e10ff9640 10 client.18378 handle_command_reply: tid=0 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.710+0000 7f8e4f500e00 1 client.18378 shutdown 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3131353259 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 msgr2=0x56157a116400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a116400 secure :-1 s=READY pgs=1335 gs=1 cs=0 l=1 c_cookie=8858443468745963295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e30004690 tx=0x7f8e30004130 comp rx=0 tx=0).stop 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3131353259 shutdown_connections 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x56157a1e84f0 0x56157a208970 crc :-1 s=READY pgs=232 gs=4 cs=0 l=0 c_cookie=7065247579004155763 s_cookie=13211250253183813977 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56157a13add0 0x56157a1193c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56157a0f6130 0x56157a116400 unknown :-1 s=CLOSED pgs=1335 gs=1 cs=0 l=1 c_cookie=8858443468745963295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 1 --2- 10.20.193.4:0/3131353259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56157a0f5820 0x56157a115ec0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e10ff9640 0 client.18378 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3131353259 >> 10.20.193.4:0/3131353259 conn(0x56157a0146b0 msgr2=0x56157a1399e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3131353259 shutdown_connections 2026-02-24T09:20:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 1 -- 10.20.193.4:0/3131353259 wait complete. 2026-02-24T09:20:41.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4f500e00 20 client.18378 trim_cache size 0 max 16384 2026-02-24T09:20:41.726 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: "50fcb56c-a674-4f78-aafd-69881ffc04d0": { 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:02.417630+0000", 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.727 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "b703ea3c-d980-4a3f-b2c3-714d8f9ad80d": { 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:58.321748+0000", 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.728 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.729 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.730 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "7f3fcd8b-96a7-4762-a5be-feb95dd814b9": { 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:20:10.919666+0000", 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.731 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:20:41.732 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:20:41.733 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.734 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:20:41.735 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:20:41.736 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "02c4bb30-7b42-4907-8bbf-d28c355c477b": { 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:36.960639+0000", 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:20:41.737 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:41.738 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 -- 10.20.193.4:0/2726563332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8e1c0b56e0 msgr2=0x7f8e1c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8e1c0b56e0 0x7f8e1c0d5b90 secure :-1 s=READY pgs=462 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e3c0023d0 tx=0x7f8e3c031040 comp rx=0 tx=0).stop 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 -- 10.20.193.4:0/2726563332 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8e48115930 msgr2=0x7f8e481239d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8e48115930 0x7f8e481239d0 secure :-1 s=READY pgs=1331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e38006e90 tx=0x7f8e3800edf0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 -- 10.20.193.4:0/2726563332 shutdown_connections 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8e1c0b56e0 0x7f8e1c0d5b90 unknown :-1 s=CLOSED pgs=462 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8e48115930 0x7f8e481239d0 unknown :-1 s=CLOSED pgs=1331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e48110130 0x7f8e4811e600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 --2- 10.20.193.4:0/2726563332 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8e4810f740 0x7f8e4811e0c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 -- 10.20.193.4:0/2726563332 >> 10.20.193.4:0/2726563332 conn(0x7f8e480ed050 msgr2=0x7f8e4810d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 -- 10.20.193.4:0/2726563332 shutdown_connections 2026-02-24T09:20:41.739 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.711+0000 7f8e4d506640 1 -- 10.20.193.4:0/2726563332 wait complete. 2026-02-24T09:20:41.749 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:20:41.749 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:20:41.864 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:41.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.960+0000 7f498b0e8640 1 -- 10.20.193.4:0/2357788419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4984115470 msgr2=0x7f4984175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.960+0000 7f498b0e8640 1 --2- 10.20.193.4:0/2357788419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4984115470 0x7f4984175e40 secure :-1 s=READY pgs=1336 gs=1 cs=0 l=1 c_cookie=3550054373143744738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f498000aa30 tx=0x7f4980030280 comp rx=0 tx=0).stop 2026-02-24T09:20:41.966 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.960+0000 7f498b0e8640 1 -- 10.20.193.4:0/2357788419 shutdown_connections 2026-02-24T09:20:41.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.960+0000 7f498b0e8640 1 --2- 10.20.193.4:0/2357788419 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4984115470 0x7f4984175e40 unknown :-1 s=CLOSED pgs=1336 gs=1 cs=0 l=1 c_cookie=3550054373143744738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.960+0000 7f498b0e8640 1 --2- 10.20.193.4:0/2357788419 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f498410fc70 0x7f4984114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.960+0000 7f498b0e8640 1 --2- 10.20.193.4:0/2357788419 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f498410f280 0x7f498410f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.960+0000 7f498b0e8640 1 -- 10.20.193.4:0/2357788419 >> 10.20.193.4:0/2357788419 conn(0x7f498405f830 msgr2=0x7f498410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:41.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.960+0000 7f498b0e8640 1 -- 10.20.193.4:0/2357788419 shutdown_connections 2026-02-24T09:20:41.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.960+0000 7f498b0e8640 1 -- 10.20.193.4:0/2357788419 wait complete. 2026-02-24T09:20:41.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f498b0e8640 1 Processor -- start 2026-02-24T09:20:41.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f498b0e8640 1 -- start start 2026-02-24T09:20:41.967 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f498b0e8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f498410f280 0x7f498411db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f498b0e8640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f498410fc70 0x7f498411e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f498b0e8640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4984115470 0x7f4984123470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f498b0e8640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4984123a90 con 0x7f498410fc70 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f498b0e8640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4984123c00 con 0x7f4984115470 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f498b0e8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4984123dc0 con 0x7f498410f280 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f497bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f498410fc70 0x7f498411e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f497bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f498410fc70 0x7f498411e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42000/0 (socket says 10.20.193.4:42000) 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f497bfff640 1 -- 10.20.193.4:0/3009757520 learned_addr learned my addr 10.20.193.4:0/3009757520 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f4988e5d640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f498410f280 0x7f498411db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f497bfff640 1 -- 10.20.193.4:0/3009757520 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f498410f280 msgr2=0x7f498411db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f497bfff640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f498410f280 0x7f498411db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f497bfff640 1 -- 10.20.193.4:0/3009757520 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4984115470 msgr2=0x7f4984123470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f497bfff640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4984115470 0x7f4984123470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f497bfff640 1 -- 10.20.193.4:0/3009757520 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498000a650 con 0x7f498410fc70 2026-02-24T09:20:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.961+0000 7f497bfff640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f498410fc70 0x7f498411e0a0 secure :-1 s=READY pgs=1337 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f496c00d950 tx=0x7f496c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.962+0000 7f4979ffb640 1 -- 10.20.193.4:0/3009757520 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f496c004540 con 0x7f498410fc70 2026-02-24T09:20:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.962+0000 7f498b0e8640 1 -- 10.20.193.4:0/3009757520 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49841240a0 con 0x7f498410fc70 2026-02-24T09:20:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.962+0000 7f4979ffb640 1 -- 10.20.193.4:0/3009757520 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f496c009d00 con 0x7f498410fc70 2026-02-24T09:20:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.962+0000 7f4979ffb640 1 -- 10.20.193.4:0/3009757520 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f496c0106e0 con 0x7f498410fc70 2026-02-24T09:20:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.962+0000 7f498b0e8640 1 -- 10.20.193.4:0/3009757520 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49841647a0 con 0x7f498410fc70 2026-02-24T09:20:41.969 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.962+0000 7f498b0e8640 1 -- 10.20.193.4:0/3009757520 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4984124310 con 0x7f498410fc70 2026-02-24T09:20:41.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.963+0000 7f4979ffb640 1 -- 10.20.193.4:0/3009757520 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f496c0027c0 con 0x7f498410fc70 2026-02-24T09:20:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.964+0000 7f4979ffb640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f49600b56e0 0x7f49600d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.964+0000 7f4988e5d640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f49600b56e0 0x7f49600d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.964+0000 7f4979ffb640 1 -- 10.20.193.4:0/3009757520 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f496c0e72e0 con 0x7f498410fc70 2026-02-24T09:20:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.964+0000 7f4988e5d640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f49600b56e0 0x7f49600d5b90 secure :-1 s=READY pgs=463 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4974005970 tx=0x7f4974005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:41.971 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:41.965+0000 7f4979ffb640 1 -- 10.20.193.4:0/3009757520 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f496c0a9c60 con 0x7f498410fc70 2026-02-24T09:20:42.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.096+0000 7f498b0e8640 1 -- 10.20.193.4:0/3009757520 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4984110560 con 0x7f498410fc70 2026-02-24T09:20:42.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.096+0000 7f4979ffb640 1 -- 10.20.193.4:0/3009757520 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f496c0ace10 con 0x7f498410fc70 2026-02-24T09:20:42.101 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:20:42.101 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:20:42.102 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:20:42.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.097+0000 7f498b0e8640 1 -- 10.20.193.4:0/3009757520 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f49600b56e0 msgr2=0x7f49600d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.097+0000 7f498b0e8640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f49600b56e0 0x7f49600d5b90 secure :-1 s=READY pgs=463 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4974005970 tx=0x7f4974005900 comp rx=0 tx=0).stop 2026-02-24T09:20:42.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.097+0000 7f498b0e8640 1 -- 10.20.193.4:0/3009757520 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f498410fc70 msgr2=0x7f498411e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.102 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.097+0000 7f498b0e8640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f498410fc70 0x7f498411e0a0 secure :-1 s=READY pgs=1337 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f496c00d950 tx=0x7f496c00de20 comp rx=0 tx=0).stop 2026-02-24T09:20:42.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.097+0000 7f498b0e8640 1 -- 10.20.193.4:0/3009757520 shutdown_connections 2026-02-24T09:20:42.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.097+0000 7f498b0e8640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f49600b56e0 0x7f49600d5b90 unknown :-1 s=CLOSED pgs=463 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.097+0000 7f498b0e8640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4984115470 0x7f4984123470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.097+0000 7f498b0e8640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f498410fc70 0x7f498411e0a0 unknown :-1 s=CLOSED pgs=1337 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.097+0000 7f498b0e8640 1 --2- 10.20.193.4:0/3009757520 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f498410f280 0x7f498411db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.097+0000 7f498b0e8640 1 -- 10.20.193.4:0/3009757520 >> 10.20.193.4:0/3009757520 conn(0x7f498405f830 msgr2=0x7f498410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.098+0000 7f498b0e8640 1 -- 10.20.193.4:0/3009757520 shutdown_connections 2026-02-24T09:20:42.103 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.098+0000 7f498b0e8640 1 -- 10.20.193.4:0/3009757520 wait complete. 2026-02-24T09:20:42.137 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:20:42.257 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:42.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.367+0000 7fba3c736640 1 -- 10.20.193.4:0/2863072752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba34110130 msgr2=0x7fba34115180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.367+0000 7fba3c736640 1 --2- 10.20.193.4:0/2863072752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba34110130 0x7fba34115180 secure :-1 s=READY pgs=1338 gs=1 cs=0 l=1 c_cookie=8366255516297253185 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba28009950 tx=0x7fba2802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.367+0000 7fba3c736640 1 -- 10.20.193.4:0/2863072752 shutdown_connections 2026-02-24T09:20:42.373 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.367+0000 7fba3c736640 1 --2- 10.20.193.4:0/2863072752 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba34115930 0x7fba34176300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.367+0000 7fba3c736640 1 --2- 10.20.193.4:0/2863072752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba34110130 0x7fba34115180 unknown :-1 s=CLOSED pgs=1338 gs=1 cs=0 l=1 c_cookie=8366255516297253185 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.367+0000 7fba3c736640 1 --2- 10.20.193.4:0/2863072752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba3410f740 0x7fba3410fb10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.367+0000 7fba3c736640 1 -- 10.20.193.4:0/2863072752 >> 10.20.193.4:0/2863072752 conn(0x7fba340ed050 msgr2=0x7fba3410d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.367+0000 7fba3c736640 1 -- 10.20.193.4:0/2863072752 shutdown_connections 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.367+0000 7fba3c736640 1 -- 10.20.193.4:0/2863072752 wait complete. 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3c736640 1 Processor -- start 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3c736640 1 -- start start 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3c736640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba3410f740 0x7fba340f5a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3c736640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba34110130 0x7fba34176200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3c736640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba34115930 0x7fba340f6130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.374 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3c736640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fba340fb340 con 0x7fba34110130 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3c736640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fba340fb4b0 con 0x7fba34115930 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3c736640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba340fb670 con 0x7fba3410f740 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba39caa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba34110130 0x7fba34176200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba39caa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba34110130 0x7fba34176200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42018/0 (socket says 10.20.193.4:42018) 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba39caa640 1 -- 10.20.193.4:0/2476253330 learned_addr learned my addr 10.20.193.4:0/2476253330 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba3410f740 0x7fba340f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba39caa640 1 -- 10.20.193.4:0/2476253330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba3410f740 msgr2=0x7fba340f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba39caa640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba3410f740 0x7fba340f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba39caa640 1 -- 10.20.193.4:0/2476253330 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba34115930 msgr2=0x7fba340f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba39caa640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba34115930 0x7fba340f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba39caa640 1 -- 10.20.193.4:0/2476253330 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba28009570 con 0x7fba34110130 2026-02-24T09:20:42.375 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba39caa640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba34110130 0x7fba34176200 secure :-1 s=READY pgs=1339 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba28038820 tx=0x7fba28004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba1b7fe640 1 -- 10.20.193.4:0/2476253330 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba2803d070 con 0x7fba34110130 2026-02-24T09:20:42.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba1b7fe640 1 -- 10.20.193.4:0/2476253330 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba28002ad0 con 0x7fba34110130 2026-02-24T09:20:42.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3c736640 1 -- 10.20.193.4:0/2476253330 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba340fb8f0 con 0x7fba34110130 2026-02-24T09:20:42.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba1b7fe640 1 -- 10.20.193.4:0/2476253330 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba28041940 con 0x7fba34110130 2026-02-24T09:20:42.376 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.368+0000 7fba3c736640 1 -- 10.20.193.4:0/2476253330 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba340fbdb0 con 0x7fba34110130 2026-02-24T09:20:42.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.370+0000 7fba1b7fe640 1 -- 10.20.193.4:0/2476253330 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fba28041ad0 con 0x7fba34110130 2026-02-24T09:20:42.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.371+0000 7fba1b7fe640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba100b5750 0x7fba100d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.383 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.371+0000 7fba1b7fe640 1 -- 10.20.193.4:0/2476253330 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fba2810b430 con 0x7fba34110130 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.371+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba100b5750 0x7fba100d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.371+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba100b5750 0x7fba100d5c00 secure :-1 s=READY pgs=464 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba24004740 tx=0x7fba24005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.372+0000 7fba3e730e00 1 Processor -- start 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.372+0000 7fba3e730e00 1 -- start start 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.372+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d4a7320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.372+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a7860 0x55bf1d4ebfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.372+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4ec500 0x55bf1d50c8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.372+0000 7fba3e730e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d3b7ee0 con 0x55bf1d4ec500 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.372+0000 7fba3e730e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d3b3c10 con 0x55bf1d4a7860 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.372+0000 7fba3e730e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d3add70 con 0x55bf1d4a6f50 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3acac640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4ec500 0x55bf1d50c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.384 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3acac640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4ec500 0x55bf1d50c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42024/0 (socket says 10.20.193.4:42024) 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3acac640 1 -- 10.20.193.4:0/1595629010 learned_addr learned my addr 10.20.193.4:0/1595629010 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba39caa640 1 --2- 10.20.193.4:0/1595629010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a7860 0x55bf1d4ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/1595629010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d4a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3acac640 1 -- 10.20.193.4:0/1595629010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 msgr2=0x55bf1d4a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3acac640 1 --2- 10.20.193.4:0/1595629010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d4a7320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3acac640 1 -- 10.20.193.4:0/1595629010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a7860 msgr2=0x55bf1d4ebfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3acac640 1 --2- 10.20.193.4:0/1595629010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a7860 0x55bf1d4ebfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3acac640 1 -- 10.20.193.4:0/1595629010 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1d359340 con 0x55bf1d4ec500 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba39caa640 1 --2- 10.20.193.4:0/1595629010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a7860 0x55bf1d4ebfc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3acac640 1 --2- 10.20.193.4:0/1595629010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4ec500 0x55bf1d50c8e0 secure :-1 s=READY pgs=1340 gs=1 cs=0 l=1 c_cookie=6985362043922977787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba30008b00 tx=0x7fba3000e2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f0fdc4d78693fb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba18cf3640 1 -- 10.20.193.4:0/1595629010 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba3000ed10 con 0x55bf1d4ec500 2026-02-24T09:20:42.385 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba18cf3640 1 -- 10.20.193.4:0/1595629010 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba3000ee70 con 0x55bf1d4ec500 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba18cf3640 1 -- 10.20.193.4:0/1595629010 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba30011800 con 0x55bf1d4ec500 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3e730e00 1 -- 10.20.193.4:0/1595629010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4ec500 msgr2=0x55bf1d50c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3e730e00 1 --2- 10.20.193.4:0/1595629010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4ec500 0x55bf1d50c8e0 secure :-1 s=READY pgs=1340 gs=1 cs=0 l=1 c_cookie=6985362043922977787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba30008b00 tx=0x7fba3000e2e0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3e730e00 1 -- 10.20.193.4:0/1595629010 shutdown_connections 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3e730e00 1 --2- 10.20.193.4:0/1595629010 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4ec500 0x55bf1d50c8e0 unknown :-1 s=CLOSED pgs=1340 gs=1 cs=0 l=1 c_cookie=6985362043922977787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3e730e00 1 --2- 10.20.193.4:0/1595629010 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a7860 0x55bf1d4ebfc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3e730e00 1 --2- 10.20.193.4:0/1595629010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d4a7320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3e730e00 1 -- 10.20.193.4:0/1595629010 >> 10.20.193.4:0/1595629010 conn(0x55bf1d3c5db0 msgr2=0x55bf1d4a5830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3e730e00 1 -- 10.20.193.4:0/1595629010 shutdown_connections 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.373+0000 7fba3e730e00 1 -- 10.20.193.4:0/1595629010 wait complete. 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba3e730e00 1 -- start start 2026-02-24T09:20:42.386 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba3e730e00 1 Processor -- start 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d503cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d504200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4ec500 0x55bf1d5091f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba3e730e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d509730 con 0x55bf1d4a7860 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba3e730e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d5098a0 con 0x55bf1d4ec500 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba3e730e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d509a60 con 0x55bf1d4a6f50 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba39caa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d504200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba39caa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d504200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42034/0 (socket says 10.20.193.4:42034) 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.374+0000 7fba39caa640 1 -- 10.20.193.4:0/3015805776 learned_addr learned my addr 10.20.193.4:0/3015805776 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d503cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba39caa640 1 -- 10.20.193.4:0/3015805776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 msgr2=0x55bf1d503cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.387 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba39caa640 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d503cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba39caa640 1 -- 10.20.193.4:0/3015805776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4ec500 msgr2=0x55bf1d5091f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba39caa640 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4ec500 0x55bf1d5091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba39caa640 1 -- 10.20.193.4:0/3015805776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1d3319d0 con 0x55bf1d4a7860 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba39caa640 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d504200 secure :-1 s=READY pgs=1341 gs=1 cs=0 l=1 c_cookie=11101869865845783955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba28038df0 tx=0x7fba28038bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a11c3d2a059fd93 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fb9e7fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fb9e7fff640 1 -- 10.20.193.4:0/3015805776 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba280d3530 con 0x55bf1d4a7860 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 1 -- 10.20.193.4:0/3015805776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba30008720 con 0x55bf1d4a7860 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fb9e7fff640 1 -- 10.20.193.4:0/3015805776 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba280da980 con 0x55bf1d4a7860 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fb9e7fff640 1 -- 10.20.193.4:0/3015805776 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba280d08e0 con 0x55bf1d4a7860 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 10 client.18396 _ll_register_callbacks cb 0x55bf1d358080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 1 -- 10.20.193.4:0/3015805776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bf1d0fd4a0 con 0x55bf1d4a7860 2026-02-24T09:20:42.388 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fb9e7fff640 1 -- 10.20.193.4:0/3015805776 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fba280d4070 con 0x55bf1d4a7860 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fb9e7fff640 1 -- 10.20.193.4:0/3015805776 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fba28097a00 con 0x55bf1d4a7860 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 10 client.18396 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 1 -- 10.20.193.4:0/3015805776 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55bf1d343710 con 0x55bf1d4a7860 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fb9e7fff640 1 -- 10.20.193.4:0/3015805776 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fba280dd330 con 0x55bf1d4a7860 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 10 client.18396 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 10 client.18396 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 20 client.18396 populate_metadata read hostname 'trial004' 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bf1d4e9250 0x55bf1d4e96f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 4 client.18396 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.375+0000 7fba3e730e00 1 -- 10.20.193.4:0/3015805776 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf1d3a37b0 con 0x55bf1d4e9250 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.376+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bf1d4e9250 0x55bf1d4e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.389 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.376+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bf1d4e9250 0x55bf1d4e96f0 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=441671088099443315 s_cookie=3992154061531131857 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6212183b9ba4273 server_cookie=3766faf7b6322fd1 in_seq=0 out_seq=0 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.376+0000 7fb9e7fff640 10 client.18396 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fb9e7fff640 1 -- 10.20.193.4:0/3015805776 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55bf1d3a37b0 con 0x55bf1d4e9250 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fb9e7fff640 10 client.18396 handle_command_reply: tid=0 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 client.18396 shutdown 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 -- 10.20.193.4:0/3015805776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 msgr2=0x55bf1d504200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d504200 secure :-1 s=READY pgs=1341 gs=1 cs=0 l=1 c_cookie=11101869865845783955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba28038df0 tx=0x7fba28038bb0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 -- 10.20.193.4:0/3015805776 shutdown_connections 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bf1d4e9250 0x55bf1d4e96f0 crc :-1 s=READY pgs=62 gs=4 cs=0 l=0 c_cookie=441671088099443315 s_cookie=3992154061531131857 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4ec500 0x55bf1d5091f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fb9e7fff640 0 client.18396 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d504200 unknown :-1 s=CLOSED pgs=1341 gs=1 cs=0 l=1 c_cookie=11101869865845783955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 --2- 10.20.193.4:0/3015805776 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d503cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.390 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 -- 10.20.193.4:0/3015805776 >> 10.20.193.4:0/3015805776 conn(0x55bf1d3c5db0 msgr2=0x55bf1d4a5040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 -- 10.20.193.4:0/3015805776 shutdown_connections 2026-02-24T09:20:42.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 1 -- 10.20.193.4:0/3015805776 wait complete. 2026-02-24T09:20:42.391 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.377+0000 7fba3e730e00 20 client.18396 trim_cache size 0 max 16384 2026-02-24T09:20:42.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba3e730e00 1 Processor -- start 2026-02-24T09:20:42.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba3e730e00 1 -- start start 2026-02-24T09:20:42.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d4eef50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d4a6460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4e9250 0x55bf1d4a69a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba3e730e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d3ab9a0 con 0x55bf1d4a7860 2026-02-24T09:20:42.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba3e730e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d187df0 con 0x55bf1d4e9250 2026-02-24T09:20:42.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba3e730e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d509920 con 0x55bf1d4a6f50 2026-02-24T09:20:42.397 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba39caa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d4a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba39caa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d4a6460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42050/0 (socket says 10.20.193.4:42050) 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba39caa640 1 -- 10.20.193.4:0/3847989490 learned_addr learned my addr 10.20.193.4:0/3847989490 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/3847989490 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d4eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba39caa640 1 -- 10.20.193.4:0/3847989490 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 msgr2=0x55bf1d4eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba39caa640 1 --2- 10.20.193.4:0/3847989490 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d4eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba39caa640 1 -- 10.20.193.4:0/3847989490 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4e9250 msgr2=0x55bf1d4a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba39caa640 1 --2- 10.20.193.4:0/3847989490 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4e9250 0x55bf1d4a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba39caa640 1 -- 10.20.193.4:0/3847989490 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1d33e190 con 0x55bf1d4a7860 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba39caa640 1 --2- 10.20.193.4:0/3847989490 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d4a6460 secure :-1 s=READY pgs=1342 gs=1 cs=0 l=1 c_cookie=15659914756807229454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba280d28f0 tx=0x7fba28094000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95331806464800e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba024e6640 1 -- 10.20.193.4:0/3847989490 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba280dd810 con 0x55bf1d4a7860 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba024e6640 1 -- 10.20.193.4:0/3847989490 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba280f0070 con 0x55bf1d4a7860 2026-02-24T09:20:42.398 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.384+0000 7fba024e6640 1 -- 10.20.193.4:0/3847989490 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba28097780 con 0x55bf1d4a7860 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 -- 10.20.193.4:0/3847989490 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 msgr2=0x55bf1d4a6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 --2- 10.20.193.4:0/3847989490 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d4a6460 secure :-1 s=READY pgs=1342 gs=1 cs=0 l=1 c_cookie=15659914756807229454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba280d28f0 tx=0x7fba28094000 comp rx=0 tx=0).stop 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 -- 10.20.193.4:0/3847989490 shutdown_connections 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 --2- 10.20.193.4:0/3847989490 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4e9250 0x55bf1d4a69a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 --2- 10.20.193.4:0/3847989490 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d4a6460 unknown :-1 s=CLOSED pgs=1342 gs=1 cs=0 l=1 c_cookie=15659914756807229454 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 --2- 10.20.193.4:0/3847989490 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4a6f50 0x55bf1d4eef50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 -- 10.20.193.4:0/3847989490 >> 10.20.193.4:0/3847989490 conn(0x55bf1d3c5db0 msgr2=0x55bf1d4ea7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 -- 10.20.193.4:0/3847989490 shutdown_connections 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 -- 10.20.193.4:0/3847989490 wait complete. 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 -- start start 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 Processor -- start 2026-02-24T09:20:42.399 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a6f50 0x55bf1d485cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d486230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4e9250 0x55bf1d531150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d4fcd70 con 0x55bf1d4a7860 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d531710 con 0x55bf1d4a6f50 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3e730e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55bf1d5318d0 con 0x55bf1d4e9250 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba39caa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d486230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba39caa640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d486230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42066/0 (socket says 10.20.193.4:42066) 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba39caa640 1 -- 10.20.193.4:0/178011467 learned_addr learned my addr 10.20.193.4:0/178011467 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.385+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a6f50 0x55bf1d485cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba39caa640 1 -- 10.20.193.4:0/178011467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4e9250 msgr2=0x55bf1d531150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba39caa640 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4e9250 0x55bf1d531150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.400 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba39caa640 1 -- 10.20.193.4:0/178011467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a6f50 msgr2=0x55bf1d485cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba39caa640 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a6f50 0x55bf1d485cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba39caa640 1 -- 10.20.193.4:0/178011467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1d331d00 con 0x55bf1d4a7860 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba39caa640 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d486230 secure :-1 s=READY pgs=1343 gs=1 cs=0 l=1 c_cookie=14284601094057828275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba28005b30 tx=0x7fba28038bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63d190311791fb3 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fb9e7fff640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fb9e7fff640 1 -- 10.20.193.4:0/178011467 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba28097780 con 0x55bf1d4a7860 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fb9e7fff640 1 -- 10.20.193.4:0/178011467 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55bf1d0fd4a0 con 0x55bf1d4a7860 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 1 -- 10.20.193.4:0/178011467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba30008720 con 0x55bf1d4a7860 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fb9e7fff640 1 -- 10.20.193.4:0/178011467 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba280d3590 con 0x55bf1d4a7860 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 10 client.18402 _ll_register_callbacks cb 0x55bf1d358080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 1 -- 10.20.193.4:0/178011467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba3000ee70 con 0x55bf1d4a7860 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fb9e7fff640 1 -- 10.20.193.4:0/178011467 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fba280d4070 con 0x55bf1d4a7860 2026-02-24T09:20:42.401 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fb9e7fff640 1 -- 10.20.193.4:0/178011467 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fba280d4230 con 0x55bf1d4a7860 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 10 client.18402 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 1 -- 10.20.193.4:0/178011467 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55bf1d343970 con 0x55bf1d4a7860 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fb9e7fff640 1 -- 10.20.193.4:0/178011467 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fba280d96c0 con 0x55bf1d4a7860 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 10 client.18402 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 10 client.18402 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 20 client.18402 populate_metadata read hostname 'trial004' 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bf1d4ec500 0x55bf1d552f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 4 client.18402 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3e730e00 1 -- 10.20.193.4:0/178011467 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf1d0e2160 con 0x55bf1d4ec500 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bf1d4ec500 0x55bf1d552f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fb9e7fff640 10 client.18402 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:20:42.402 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.386+0000 7fba3a4ab640 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bf1d4ec500 0x55bf1d552f10 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=3357360587719558624 s_cookie=11008421821717850521 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e97bdaa9debc5e0 server_cookie=98c5c5525d26a999 in_seq=0 out_seq=0 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fb9e7fff640 1 -- 10.20.193.4:0/178011467 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf1d0e2160 con 0x55bf1d4ec500 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fb9e7fff640 10 client.18402 handle_command_reply: tid=0 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 client.18402 shutdown 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 -- 10.20.193.4:0/178011467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 msgr2=0x55bf1d486230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d486230 secure :-1 s=READY pgs=1343 gs=1 cs=0 l=1 c_cookie=14284601094057828275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba28005b30 tx=0x7fba28038bb0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 -- 10.20.193.4:0/178011467 shutdown_connections 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55bf1d4ec500 0x55bf1d552f10 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=3357360587719558624 s_cookie=11008421821717850521 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55bf1d4e9250 0x55bf1d531150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fb9e7fff640 0 client.18402 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55bf1d4a7860 0x55bf1d486230 unknown :-1 s=CLOSED pgs=1343 gs=1 cs=0 l=1 c_cookie=14284601094057828275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 --2- 10.20.193.4:0/178011467 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55bf1d4a6f50 0x55bf1d485cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.403 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 -- 10.20.193.4:0/178011467 >> 10.20.193.4:0/178011467 conn(0x55bf1d3c5db0 msgr2=0x55bf1d4a5450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 -- 10.20.193.4:0/178011467 shutdown_connections 2026-02-24T09:20:42.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 1 -- 10.20.193.4:0/178011467 wait complete. 2026-02-24T09:20:42.404 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3e730e00 20 client.18402 trim_cache size 0 max 16384 2026-02-24T09:20:42.404 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:20:42.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 -- 10.20.193.4:0/2476253330 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba100b5750 msgr2=0x7fba100d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba100b5750 0x7fba100d5c00 secure :-1 s=READY pgs=464 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba24004740 tx=0x7fba24005f90 comp rx=0 tx=0).stop 2026-02-24T09:20:42.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 -- 10.20.193.4:0/2476253330 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba34110130 msgr2=0x7fba34176200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba34110130 0x7fba34176200 secure :-1 s=READY pgs=1339 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba28038820 tx=0x7fba28004300 comp rx=0 tx=0).stop 2026-02-24T09:20:42.405 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 -- 10.20.193.4:0/2476253330 shutdown_connections 2026-02-24T09:20:42.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fba100b5750 0x7fba100d5c00 unknown :-1 s=CLOSED pgs=464 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fba34115930 0x7fba340f6130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fba34110130 0x7fba34176200 unknown :-1 s=CLOSED pgs=1339 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 --2- 10.20.193.4:0/2476253330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fba3410f740 0x7fba340f5a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 -- 10.20.193.4:0/2476253330 >> 10.20.193.4:0/2476253330 conn(0x7fba340ed050 msgr2=0x7fba3410dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 -- 10.20.193.4:0/2476253330 shutdown_connections 2026-02-24T09:20:42.406 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.387+0000 7fba3c736640 1 -- 10.20.193.4:0/2476253330 wait complete. 2026-02-24T09:20:42.423 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:20:42.540 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:42.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 -- 10.20.193.4:0/4029956290 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff32010f650 msgr2=0x7ff32010fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.642 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 --2- 10.20.193.4:0/4029956290 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff32010f650 0x7ff32010fa20 secure :-1 s=READY pgs=1344 gs=1 cs=0 l=1 c_cookie=4338846556159682365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff30c009950 tx=0x7ff30c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 -- 10.20.193.4:0/4029956290 shutdown_connections 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 --2- 10.20.193.4:0/4029956290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff320115840 0x7ff320176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 --2- 10.20.193.4:0/4029956290 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff320110040 0x7ff320115090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 --2- 10.20.193.4:0/4029956290 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff32010f650 0x7ff32010fa20 unknown :-1 s=CLOSED pgs=1344 gs=1 cs=0 l=1 c_cookie=4338846556159682365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 -- 10.20.193.4:0/4029956290 >> 10.20.193.4:0/4029956290 conn(0x7ff3200ecf20 msgr2=0x7ff32010d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 -- 10.20.193.4:0/4029956290 shutdown_connections 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 -- 10.20.193.4:0/4029956290 wait complete. 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 Processor -- start 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 -- start start 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff32010f650 0x7ff32011df10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.643 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff320110040 0x7ff32011e450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff320115840 0x7ff320123820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff320123e40 con 0x7ff32010f650 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff320123fb0 con 0x7ff320110040 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff325af0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff320124170 con 0x7ff320115840 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff31f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff32010f650 0x7ff32011df10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff31f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff32010f650 0x7ff32011df10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42078/0 (socket says 10.20.193.4:42078) 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff31f7fe640 1 -- 10.20.193.4:0/1687329476 learned_addr learned my addr 10.20.193.4:0/1687329476 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.637+0000 7ff31effd640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff320110040 0x7ff32011e450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff31f7fe640 1 -- 10.20.193.4:0/1687329476 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff320115840 msgr2=0x7ff320123820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff320115840 0x7ff320123820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff31f7fe640 1 -- 10.20.193.4:0/1687329476 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff320110040 msgr2=0x7ff32011e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.644 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff320110040 0x7ff32011e450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff31f7fe640 1 -- 10.20.193.4:0/1687329476 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c009570 con 0x7ff32010f650 2026-02-24T09:20:42.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff32010f650 0x7ff32011df10 secure :-1 s=READY pgs=1345 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff30c0023d0 tx=0x7ff30c0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff31cff9640 1 -- 10.20.193.4:0/1687329476 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff30c03d070 con 0x7ff32010f650 2026-02-24T09:20:42.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff31cff9640 1 -- 10.20.193.4:0/1687329476 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff30c038920 con 0x7ff32010f650 2026-02-24T09:20:42.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff325af0640 1 -- 10.20.193.4:0/1687329476 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3201243f0 con 0x7ff32010f650 2026-02-24T09:20:42.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff31cff9640 1 -- 10.20.193.4:0/1687329476 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff30c0419d0 con 0x7ff32010f650 2026-02-24T09:20:42.645 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.638+0000 7ff325af0640 1 -- 10.20.193.4:0/1687329476 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff320164b50 con 0x7ff32010f650 2026-02-24T09:20:42.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.640+0000 7ff31cff9640 1 -- 10.20.193.4:0/1687329476 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff30c038a90 con 0x7ff32010f650 2026-02-24T09:20:42.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.640+0000 7ff31cff9640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f40b5760 0x7ff2f40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.651 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.640+0000 7ff31cff9640 1 -- 10.20.193.4:0/1687329476 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff30c10b2f0 con 0x7ff32010f650 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.640+0000 7ff31effd640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f40b5760 0x7ff2f40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.641+0000 7ff31effd640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f40b5760 0x7ff2f40d5c10 secure :-1 s=READY pgs=465 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff310005970 tx=0x7ff310005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.641+0000 7ff327aeae00 1 Processor -- start 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.641+0000 7ff327aeae00 1 -- start start 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f007320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f04bfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f04c500 0x56018f06c8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56018ef17ee0 con 0x56018f007860 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56018ef13c10 con 0x56018f006f50 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56018ef0dd70 con 0x56018f04c500 2026-02-24T09:20:42.652 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f04bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f04bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42080/0 (socket says 10.20.193.4:42080) 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31effd640 1 -- 10.20.193.4:0/3749958788 learned_addr learned my addr 10.20.193.4:0/3749958788 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31ffff640 1 --2- 10.20.193.4:0/3749958788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f04c500 0x56018f06c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31effd640 1 -- 10.20.193.4:0/3749958788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f04c500 msgr2=0x56018f06c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31effd640 1 --2- 10.20.193.4:0/3749958788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f04c500 0x56018f06c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/3749958788 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f007320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31effd640 1 -- 10.20.193.4:0/3749958788 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 msgr2=0x56018f007320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31effd640 1 --2- 10.20.193.4:0/3749958788 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f007320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31effd640 1 -- 10.20.193.4:0/3749958788 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56018eeb9340 con 0x56018f007860 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff31effd640 1 --2- 10.20.193.4:0/3749958788 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f04bfc0 secure :-1 s=READY pgs=1346 gs=1 cs=0 l=1 c_cookie=621987625811980479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff31000fd10 tx=0x7ff310012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1be73433630bf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff2e3fff640 1 -- 10.20.193.4:0/3749958788 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff31001e460 con 0x56018f007860 2026-02-24T09:20:42.653 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff2e3fff640 1 -- 10.20.193.4:0/3749958788 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff31001eaa0 con 0x56018f007860 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff2e3fff640 1 -- 10.20.193.4:0/3749958788 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff310010be0 con 0x56018f007860 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 -- 10.20.193.4:0/3749958788 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 msgr2=0x56018f04bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 --2- 10.20.193.4:0/3749958788 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f04bfc0 secure :-1 s=READY pgs=1346 gs=1 cs=0 l=1 c_cookie=621987625811980479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff31000fd10 tx=0x7ff310012000 comp rx=0 tx=0).stop 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 -- 10.20.193.4:0/3749958788 shutdown_connections 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 --2- 10.20.193.4:0/3749958788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f04c500 0x56018f06c8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 --2- 10.20.193.4:0/3749958788 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f04bfc0 unknown :-1 s=CLOSED pgs=1346 gs=1 cs=0 l=1 c_cookie=621987625811980479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 --2- 10.20.193.4:0/3749958788 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f007320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 -- 10.20.193.4:0/3749958788 >> 10.20.193.4:0/3749958788 conn(0x56018ef25db0 msgr2=0x56018f005830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 -- 10.20.193.4:0/3749958788 shutdown_connections 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.642+0000 7ff327aeae00 1 -- 10.20.193.4:0/3749958788 wait complete. 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.643+0000 7ff327aeae00 1 -- start start 2026-02-24T09:20:42.654 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.643+0000 7ff327aeae00 1 Processor -- start 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f063db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f007860 0x56018f0642f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f04c500 0x56018f0692e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56018f069820 con 0x56018f04c500 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56018f069990 con 0x56018f006f50 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56018f069b50 con 0x56018f007860 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff31ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f04c500 0x56018f0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff31ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f04c500 0x56018f0692e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42094/0 (socket says 10.20.193.4:42094) 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff31ffff640 1 -- 10.20.193.4:0/2582166586 learned_addr learned my addr 10.20.193.4:0/2582166586 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f063db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff31ffff640 1 -- 10.20.193.4:0/2582166586 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f007860 msgr2=0x56018f0642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.655 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff31ffff640 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f007860 0x56018f0642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff31ffff640 1 -- 10.20.193.4:0/2582166586 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 msgr2=0x56018f063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff31ffff640 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f063db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff31ffff640 1 -- 10.20.193.4:0/2582166586 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56018ee919d0 con 0x56018f04c500 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff31ffff640 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f04c500 0x56018f0692e0 secure :-1 s=READY pgs=1347 gs=1 cs=0 l=1 c_cookie=5720830168483999090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff314003b60 tx=0x7ff314010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6478ba5cd3ad72 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff2e17fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff2e17fa640 1 -- 10.20.193.4:0/2582166586 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff314012660 con 0x56018f04c500 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 -- 10.20.193.4:0/2582166586 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff31000f9b0 con 0x56018f04c500 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff2e17fa640 1 -- 10.20.193.4:0/2582166586 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff314003e70 con 0x56018f04c500 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff2e17fa640 1 -- 10.20.193.4:0/2582166586 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff314011dc0 con 0x56018f04c500 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 10 client.18414 _ll_register_callbacks cb 0x56018eeb8080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 -- 10.20.193.4:0/2582166586 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56018ec5d4a0 con 0x56018f04c500 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff2e17fa640 1 -- 10.20.193.4:0/2582166586 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff31400e370 con 0x56018f04c500 2026-02-24T09:20:42.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff2e17fa640 1 -- 10.20.193.4:0/2582166586 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff31400e530 con 0x56018f04c500 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 10 client.18414 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 -- 10.20.193.4:0/2582166586 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56018eea3710 con 0x56018f04c500 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff2e17fa640 1 -- 10.20.193.4:0/2582166586 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff31400e750 con 0x56018f04c500 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 10 client.18414 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 10 client.18414 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 20 client.18414 populate_metadata read hostname 'trial004' 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56018f049890 0x56018f049d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 4 client.18414 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.644+0000 7ff327aeae00 1 -- 10.20.193.4:0/2582166586 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56018ef037b0 con 0x56018f049890 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.645+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56018f049890 0x56018f049d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.645+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56018f049890 0x56018f049d30 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=1570391038384056815 s_cookie=14936841196560702954 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15cb26544156a9ef server_cookie=cf4a51edf36bddea in_seq=0 out_seq=0 2026-02-24T09:20:42.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.645+0000 7ff2e17fa640 10 client.18414 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff2e17fa640 1 -- 10.20.193.4:0/2582166586 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x56018ef037b0 con 0x56018f049890 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff2e17fa640 10 client.18414 handle_command_reply: tid=0 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 client.18414 shutdown 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 -- 10.20.193.4:0/2582166586 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f04c500 msgr2=0x56018f0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f04c500 0x56018f0692e0 secure :-1 s=READY pgs=1347 gs=1 cs=0 l=1 c_cookie=5720830168483999090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff314003b60 tx=0x7ff314010730 comp rx=0 tx=0).stop 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 -- 10.20.193.4:0/2582166586 shutdown_connections 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56018f049890 0x56018f049d30 crc :-1 s=READY pgs=63 gs=4 cs=0 l=0 c_cookie=1570391038384056815 s_cookie=14936841196560702954 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f04c500 0x56018f0692e0 unknown :-1 s=CLOSED pgs=1347 gs=1 cs=0 l=1 c_cookie=5720830168483999090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff2e17fa640 0 client.18414 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f007860 0x56018f0642f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 --2- 10.20.193.4:0/2582166586 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f063db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 -- 10.20.193.4:0/2582166586 >> 10.20.193.4:0/2582166586 conn(0x56018ef25db0 msgr2=0x56018f005040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 -- 10.20.193.4:0/2582166586 shutdown_connections 2026-02-24T09:20:42.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 1 -- 10.20.193.4:0/2582166586 wait complete. 2026-02-24T09:20:42.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.646+0000 7ff327aeae00 20 client.18414 trim_cache size 0 max 16384 2026-02-24T09:20:42.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 Processor -- start 2026-02-24T09:20:42.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 -- start start 2026-02-24T09:20:42.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f04ef50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f006350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f049890 0x56018f006890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56018ef0b9a0 con 0x56018f007860 2026-02-24T09:20:42.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56018ece7df0 con 0x56018f006f50 2026-02-24T09:20:42.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56018ef782f0 con 0x56018f049890 2026-02-24T09:20:42.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f006350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31effd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f006350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42108/0 (socket says 10.20.193.4:42108) 2026-02-24T09:20:42.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31effd640 1 -- 10.20.193.4:0/2380518069 learned_addr learned my addr 10.20.193.4:0/2380518069 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/2380518069 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f04ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31ffff640 1 --2- 10.20.193.4:0/2380518069 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f049890 0x56018f006890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31effd640 1 -- 10.20.193.4:0/2380518069 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f049890 msgr2=0x56018f006890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31effd640 1 --2- 10.20.193.4:0/2380518069 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f049890 0x56018f006890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31effd640 1 -- 10.20.193.4:0/2380518069 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 msgr2=0x56018f04ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31effd640 1 --2- 10.20.193.4:0/2380518069 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f04ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31effd640 1 -- 10.20.193.4:0/2380518069 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56018f056410 con 0x56018f007860 2026-02-24T09:20:42.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31ffff640 1 --2- 10.20.193.4:0/2380518069 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f049890 0x56018f006890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:42.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff31effd640 1 --2- 10.20.193.4:0/2380518069 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f006350 secure :-1 s=READY pgs=1348 gs=1 cs=0 l=1 c_cookie=15358397556308343243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3100045f0 tx=0x7ff310005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d523fd3486fc79cb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff2e37fe640 1 -- 10.20.193.4:0/2380518069 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff31001e460 con 0x56018f007860 2026-02-24T09:20:42.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff2e37fe640 1 -- 10.20.193.4:0/2380518069 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff310005050 con 0x56018f007860 2026-02-24T09:20:42.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff2e37fe640 1 -- 10.20.193.4:0/2380518069 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff310004bb0 con 0x56018f007860 2026-02-24T09:20:42.669 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 -- 10.20.193.4:0/2380518069 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 msgr2=0x56018f006350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.669 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 --2- 10.20.193.4:0/2380518069 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f006350 secure :-1 s=READY pgs=1348 gs=1 cs=0 l=1 c_cookie=15358397556308343243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3100045f0 tx=0x7ff310005d20 comp rx=0 tx=0).stop 2026-02-24T09:20:42.669 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 -- 10.20.193.4:0/2380518069 shutdown_connections 2026-02-24T09:20:42.669 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 --2- 10.20.193.4:0/2380518069 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f049890 0x56018f006890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.669 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 --2- 10.20.193.4:0/2380518069 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f007860 0x56018f006350 unknown :-1 s=CLOSED pgs=1348 gs=1 cs=0 l=1 c_cookie=15358397556308343243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.669 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 --2- 10.20.193.4:0/2380518069 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018f04ef50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.669 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 -- 10.20.193.4:0/2380518069 >> 10.20.193.4:0/2380518069 conn(0x56018ef25db0 msgr2=0x56018f005c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.669 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.654+0000 7ff327aeae00 1 -- 10.20.193.4:0/2380518069 shutdown_connections 2026-02-24T09:20:42.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff327aeae00 1 -- 10.20.193.4:0/2380518069 wait complete. 2026-02-24T09:20:42.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff327aeae00 1 -- start start 2026-02-24T09:20:42.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff327aeae00 1 Processor -- start 2026-02-24T09:20:42.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018efe8490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f007860 0x56018efe89d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff327aeae00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f049890 0x56018efe8f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff327aeae00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x56018f0b2110 con 0x56018f049890 2026-02-24T09:20:42.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff327aeae00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x56018f0b2280 con 0x56018f006f50 2026-02-24T09:20:42.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff327aeae00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56018f0b2440 con 0x56018f007860 2026-02-24T09:20:42.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff31ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f049890 0x56018efe8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff31ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f049890 0x56018efe8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42118/0 (socket says 10.20.193.4:42118) 2026-02-24T09:20:42.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff31ffff640 1 -- 10.20.193.4:0/14243613 learned_addr learned my addr 10.20.193.4:0/14243613 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018efe8490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff31ffff640 1 -- 10.20.193.4:0/14243613 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f007860 msgr2=0x56018efe89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.671 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff31ffff640 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f007860 0x56018efe89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff31ffff640 1 -- 10.20.193.4:0/14243613 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 msgr2=0x56018efe8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff31ffff640 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018efe8490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff31ffff640 1 -- 10.20.193.4:0/14243613 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56018ee9e190 con 0x56018f049890 2026-02-24T09:20:42.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.655+0000 7ff31ffff640 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f049890 0x56018efe8f10 secure :-1 s=READY pgs=1349 gs=1 cs=0 l=1 c_cookie=1689549801904547236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff314024f20 tx=0x7ff314003470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17727c97dcda25a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff2e17fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:42.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff2e17fa640 1 -- 10.20.193.4:0/14243613 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff314003e70 con 0x56018f049890 2026-02-24T09:20:42.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff2e17fa640 1 -- 10.20.193.4:0/14243613 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x56018ec5d4a0 con 0x56018f049890 2026-02-24T09:20:42.672 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 1 -- 10.20.193.4:0/14243613 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56018eeb9340 con 0x56018f049890 2026-02-24T09:20:42.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff2e17fa640 1 -- 10.20.193.4:0/14243613 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff314024650 con 0x56018f049890 2026-02-24T09:20:42.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 10 client.18420 _ll_register_callbacks cb 0x56018eeb8080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:42.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 1 -- 10.20.193.4:0/14243613 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff31001eaa0 con 0x56018f049890 2026-02-24T09:20:42.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff2e17fa640 1 -- 10.20.193.4:0/14243613 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff3140247e0 con 0x56018f049890 2026-02-24T09:20:42.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff2e17fa640 1 -- 10.20.193.4:0/14243613 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff3140249c0 con 0x56018f049890 2026-02-24T09:20:42.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 10 client.18420 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:42.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 1 -- 10.20.193.4:0/14243613 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56018ee91d00 con 0x56018f049890 2026-02-24T09:20:42.673 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff2e17fa640 1 -- 10.20.193.4:0/14243613 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff31401a3b0 con 0x56018f049890 2026-02-24T09:20:42.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 10 client.18420 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:42.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 10 client.18420 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:20:42.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 20 client.18420 populate_metadata read hostname 'trial004' 2026-02-24T09:20:42.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56018f04c500 0x56018f11a460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 4 client.18420 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:20:42.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff327aeae00 1 -- 10.20.193.4:0/14243613 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56018ec42160 con 0x56018f04c500 2026-02-24T09:20:42.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.656+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56018f04c500 0x56018f11a460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.674 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff31f7fe640 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56018f04c500 0x56018f11a460 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=14857160376255208109 s_cookie=3919517736354560287 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ce2f3ca545b35aad server_cookie=3664ec9d5e41b91f in_seq=0 out_seq=0 2026-02-24T09:20:42.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff2e17fa640 10 client.18420 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:20:42.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff2e17fa640 1 -- 10.20.193.4:0/14243613 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56018ec42160 con 0x56018f04c500 2026-02-24T09:20:42.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff2e17fa640 10 client.18420 handle_command_reply: tid=0 2026-02-24T09:20:42.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 client.18420 shutdown 2026-02-24T09:20:42.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 -- 10.20.193.4:0/14243613 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f049890 msgr2=0x56018efe8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f049890 0x56018efe8f10 secure :-1 s=READY pgs=1349 gs=1 cs=0 l=1 c_cookie=1689549801904547236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff314024f20 tx=0x7ff314003470 comp rx=0 tx=0).stop 2026-02-24T09:20:42.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 -- 10.20.193.4:0/14243613 shutdown_connections 2026-02-24T09:20:42.675 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x56018f04c500 0x56018f11a460 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=14857160376255208109 s_cookie=3919517736354560287 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x56018f049890 0x56018efe8f10 unknown :-1 s=CLOSED pgs=1349 gs=1 cs=0 l=1 c_cookie=1689549801904547236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff2e17fa640 0 client.18420 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:20:42.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x56018f007860 0x56018efe89d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 --2- 10.20.193.4:0/14243613 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x56018f006f50 0x56018efe8490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 -- 10.20.193.4:0/14243613 >> 10.20.193.4:0/14243613 conn(0x56018ef25db0 msgr2=0x56018f006350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 -- 10.20.193.4:0/14243613 shutdown_connections 2026-02-24T09:20:42.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 1 -- 10.20.193.4:0/14243613 wait complete. 2026-02-24T09:20:42.676 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff327aeae00 20 client.18420 trim_cache size 0 max 16384 2026-02-24T09:20:42.677 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:20:42.678 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff325af0640 1 -- 10.20.193.4:0/1687329476 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f40b5760 msgr2=0x7ff2f40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff325af0640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f40b5760 0x7ff2f40d5c10 secure :-1 s=READY pgs=465 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff310005970 tx=0x7ff310005900 comp rx=0 tx=0).stop 2026-02-24T09:20:42.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff325af0640 1 -- 10.20.193.4:0/1687329476 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff32010f650 msgr2=0x7ff32011df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.657+0000 7ff325af0640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff32010f650 0x7ff32011df10 secure :-1 s=READY pgs=1345 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff30c0023d0 tx=0x7ff30c0043d0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.658+0000 7ff325af0640 1 -- 10.20.193.4:0/1687329476 shutdown_connections 2026-02-24T09:20:42.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.658+0000 7ff325af0640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff2f40b5760 0x7ff2f40d5c10 unknown :-1 s=CLOSED pgs=465 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.658+0000 7ff325af0640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff320115840 0x7ff320123820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.658+0000 7ff325af0640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff320110040 0x7ff32011e450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.679 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.658+0000 7ff325af0640 1 --2- 10.20.193.4:0/1687329476 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff32010f650 0x7ff32011df10 unknown :-1 s=CLOSED pgs=1345 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.658+0000 7ff325af0640 1 -- 10.20.193.4:0/1687329476 >> 10.20.193.4:0/1687329476 conn(0x7ff3200ecf20 msgr2=0x7ff32010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.658+0000 7ff325af0640 1 -- 10.20.193.4:0/1687329476 shutdown_connections 2026-02-24T09:20:42.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.658+0000 7ff325af0640 1 -- 10.20.193.4:0/1687329476 wait complete. 2026-02-24T09:20:42.694 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:20:42.809 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:42.912 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.907+0000 7ff741656640 1 -- 10.20.193.4:0/2650705651 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff73c10f650 msgr2=0x7ff73c10fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.907+0000 7ff741656640 1 --2- 10.20.193.4:0/2650705651 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff73c10f650 0x7ff73c10fa20 secure :-1 s=READY pgs=1350 gs=1 cs=0 l=1 c_cookie=13233005291774212851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff730009950 tx=0x7ff73002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.907+0000 7ff741656640 1 -- 10.20.193.4:0/2650705651 shutdown_connections 2026-02-24T09:20:42.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.907+0000 7ff741656640 1 --2- 10.20.193.4:0/2650705651 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff73c115840 0x7ff73c176210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.907+0000 7ff741656640 1 --2- 10.20.193.4:0/2650705651 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff73c110040 0x7ff73c115090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.907+0000 7ff741656640 1 --2- 10.20.193.4:0/2650705651 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff73c10f650 0x7ff73c10fa20 unknown :-1 s=CLOSED pgs=1350 gs=1 cs=0 l=1 c_cookie=13233005291774212851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.907+0000 7ff741656640 1 -- 10.20.193.4:0/2650705651 >> 10.20.193.4:0/2650705651 conn(0x7ff73c0ecf20 msgr2=0x7ff73c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.913 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.907+0000 7ff741656640 1 -- 10.20.193.4:0/2650705651 shutdown_connections 2026-02-24T09:20:42.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.907+0000 7ff741656640 1 -- 10.20.193.4:0/2650705651 wait complete. 2026-02-24T09:20:42.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.907+0000 7ff741656640 1 Processor -- start 2026-02-24T09:20:42.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff741656640 1 -- start start 2026-02-24T09:20:42.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff741656640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff73c10f650 0x7ff73c11df00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff741656640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff73c110040 0x7ff73c11e440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff741656640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff73c115840 0x7ff73c123810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff741656640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff73c123e30 con 0x7ff73c110040 2026-02-24T09:20:42.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff741656640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff73c123fa0 con 0x7ff73c115840 2026-02-24T09:20:42.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff741656640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff73c124160 con 0x7ff73c10f650 2026-02-24T09:20:42.914 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff73a7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff73c110040 0x7ff73c11e440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff73a7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff73c110040 0x7ff73c11e440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42130/0 (socket says 10.20.193.4:42130) 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff73a7fc640 1 -- 10.20.193.4:0/3008165970 learned_addr learned my addr 10.20.193.4:0/3008165970 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff73b7fe640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff73c115840 0x7ff73c123810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff73a7fc640 1 -- 10.20.193.4:0/3008165970 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff73c10f650 msgr2=0x7ff73c11df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff73a7fc640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff73c10f650 0x7ff73c11df00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff73a7fc640 1 -- 10.20.193.4:0/3008165970 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff73c115840 msgr2=0x7ff73c123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff73a7fc640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff73c115840 0x7ff73c123810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff73a7fc640 1 -- 10.20.193.4:0/3008165970 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff730009570 con 0x7ff73c110040 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff73a7fc640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff73c110040 0x7ff73c11e440 secure :-1 s=READY pgs=1351 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff724005db0 tx=0x7ff72400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff71bfff640 1 -- 10.20.193.4:0/3008165970 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff724004500 con 0x7ff73c110040 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff741656640 1 -- 10.20.193.4:0/3008165970 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73c124440 con 0x7ff73c110040 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff71bfff640 1 -- 10.20.193.4:0/3008165970 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff724004d30 con 0x7ff73c110040 2026-02-24T09:20:42.915 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff71bfff640 1 -- 10.20.193.4:0/3008165970 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff724005310 con 0x7ff73c110040 2026-02-24T09:20:42.916 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.908+0000 7ff741656640 1 -- 10.20.193.4:0/3008165970 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff73c164b40 con 0x7ff73c110040 2026-02-24T09:20:42.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.910+0000 7ff71bfff640 1 -- 10.20.193.4:0/3008165970 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff7240054a0 con 0x7ff73c110040 2026-02-24T09:20:42.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.910+0000 7ff71bfff640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7100b56e0 0x7ff7100d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.911+0000 7ff71bfff640 1 -- 10.20.193.4:0/3008165970 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff7240e6ce0 con 0x7ff73c110040 2026-02-24T09:20:42.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.911+0000 7ff73affd640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7100b56e0 0x7ff7100d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.911+0000 7ff73affd640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7100b56e0 0x7ff7100d5b90 secure :-1 s=READY pgs=466 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff73002f6e0 tx=0x7ff730005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.912+0000 7ff743650e00 1 Processor -- start 2026-02-24T09:20:42.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff743650e00 1 -- start start 2026-02-24T09:20:42.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff743650e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c79547320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff743650e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c7958bfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff743650e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c795ac8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff743650e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557c79457ee0 con 0x557c79546f50 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff743650e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557c79453c10 con 0x557c7958c500 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff743650e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557c7944dd70 con 0x557c79547860 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c79547320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c79547320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42144/0 (socket says 10.20.193.4:42144) 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73affd640 1 -- 10.20.193.4:0/2921557917 learned_addr learned my addr 10.20.193.4:0/2921557917 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73a7fc640 1 --2- 10.20.193.4:0/2921557917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c7958bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73b7fe640 1 --2- 10.20.193.4:0/2921557917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c795ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73affd640 1 -- 10.20.193.4:0/2921557917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 msgr2=0x557c7958bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73affd640 1 --2- 10.20.193.4:0/2921557917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c7958bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73affd640 1 -- 10.20.193.4:0/2921557917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 msgr2=0x557c795ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73affd640 1 --2- 10.20.193.4:0/2921557917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c795ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73affd640 1 -- 10.20.193.4:0/2921557917 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c793f9340 con 0x557c79546f50 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73b7fe640 1 --2- 10.20.193.4:0/2921557917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c795ac8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff73affd640 1 --2- 10.20.193.4:0/2921557917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c79547320 secure :-1 s=READY pgs=1352 gs=1 cs=0 l=1 c_cookie=18207135357726371678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff730005ee0 tx=0x7ff73003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcacbd246ebc2f5e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff7077fe640 1 -- 10.20.193.4:0/2921557917 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff73003d070 con 0x557c79546f50 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff7077fe640 1 -- 10.20.193.4:0/2921557917 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff730002820 con 0x557c79546f50 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.913+0000 7ff7077fe640 1 -- 10.20.193.4:0/2921557917 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff73004f6e0 con 0x557c79546f50 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.914+0000 7ff743650e00 1 -- 10.20.193.4:0/2921557917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 msgr2=0x557c79547320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.914+0000 7ff743650e00 1 --2- 10.20.193.4:0/2921557917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c79547320 secure :-1 s=READY pgs=1352 gs=1 cs=0 l=1 c_cookie=18207135357726371678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff730005ee0 tx=0x7ff73003d000 comp rx=0 tx=0).stop 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.914+0000 7ff743650e00 1 -- 10.20.193.4:0/2921557917 shutdown_connections 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.914+0000 7ff743650e00 1 --2- 10.20.193.4:0/2921557917 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c795ac8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.914+0000 7ff743650e00 1 --2- 10.20.193.4:0/2921557917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c7958bfc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.914+0000 7ff743650e00 1 --2- 10.20.193.4:0/2921557917 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c79547320 unknown :-1 s=CLOSED pgs=1352 gs=1 cs=0 l=1 c_cookie=18207135357726371678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.914+0000 7ff743650e00 1 -- 10.20.193.4:0/2921557917 >> 10.20.193.4:0/2921557917 conn(0x557c79465db0 msgr2=0x557c79545830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.914+0000 7ff743650e00 1 -- 10.20.193.4:0/2921557917 shutdown_connections 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.914+0000 7ff743650e00 1 -- 10.20.193.4:0/2921557917 wait complete. 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 1 -- start start 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 1 Processor -- start 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c795a3dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c795a4310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c795a9300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557c795a9840 con 0x557c79546f50 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557c795a99b0 con 0x557c7958c500 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557c795a9b70 con 0x557c79547860 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c795a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.923 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c795a3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42150/0 (socket says 10.20.193.4:42150) 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73affd640 1 -- 10.20.193.4:0/4125316645 learned_addr learned my addr 10.20.193.4:0/4125316645 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73a7fc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c795a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73b7fe640 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c795a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73affd640 1 -- 10.20.193.4:0/4125316645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 msgr2=0x557c795a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73affd640 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c795a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73affd640 1 -- 10.20.193.4:0/4125316645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 msgr2=0x557c795a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73affd640 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c795a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73affd640 1 -- 10.20.193.4:0/4125316645 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c793d19d0 con 0x557c79546f50 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff73affd640 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c795a3dd0 secure :-1 s=READY pgs=1353 gs=1 cs=0 l=1 c_cookie=18327642929773967728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7300059f0 tx=0x7ff730009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe58de23ff607970 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff704ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff704ff9640 1 -- 10.20.193.4:0/4125316645 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff730038bb0 con 0x557c79546f50 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 1 -- 10.20.193.4:0/4125316645 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff73c176a80 con 0x557c79546f50 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff704ff9640 1 -- 10.20.193.4:0/4125316645 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff730038e90 con 0x557c79546f50 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff704ff9640 1 -- 10.20.193.4:0/4125316645 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff730043bc0 con 0x557c79546f50 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 10 client.18432 _ll_register_callbacks cb 0x557c793f8080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.915+0000 7ff743650e00 1 -- 10.20.193.4:0/4125316645 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c7919d4a0 con 0x557c79546f50 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff704ff9640 1 -- 10.20.193.4:0/4125316645 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff730043d50 con 0x557c79546f50 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff704ff9640 1 -- 10.20.193.4:0/4125316645 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff730061430 con 0x557c79546f50 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff743650e00 10 client.18432 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff743650e00 1 -- 10.20.193.4:0/4125316645 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557c793e3710 con 0x557c79546f50 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff704ff9640 1 -- 10.20.193.4:0/4125316645 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff7300433f0 con 0x557c79546f50 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff743650e00 10 client.18432 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff743650e00 10 client.18432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff743650e00 20 client.18432 populate_metadata read hostname 'trial004' 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff743650e00 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557c79589480 0x557c79589920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff743650e00 4 client.18432 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff743650e00 1 -- 10.20.193.4:0/4125316645 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c794437b0 con 0x557c79589480 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff73a7fc640 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557c79589480 0x557c79589920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff73a7fc640 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557c79589480 0x557c79589920 crc :-1 s=READY pgs=233 gs=4 cs=0 l=0 c_cookie=7951994176933882698 s_cookie=3215785430631610766 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e5b28928c1e6b4a server_cookie=2ca0c3cfaaac798e in_seq=0 out_seq=0 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.916+0000 7ff704ff9640 10 client.18432 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff704ff9640 1 -- 10.20.193.4:0/4125316645 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x557c794437b0 con 0x557c79589480 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff704ff9640 10 client.18432 handle_command_reply: tid=0 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 client.18432 shutdown 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 -- 10.20.193.4:0/4125316645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 msgr2=0x557c795a3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c795a3dd0 secure :-1 s=READY pgs=1353 gs=1 cs=0 l=1 c_cookie=18327642929773967728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7300059f0 tx=0x7ff730009310 comp rx=0 tx=0).stop 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 -- 10.20.193.4:0/4125316645 shutdown_connections 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557c79589480 0x557c79589920 crc :-1 s=READY pgs=233 gs=4 cs=0 l=0 c_cookie=7951994176933882698 s_cookie=3215785430631610766 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c795a9300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c795a4310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.924 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff704ff9640 0 client.18432 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:42.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 --2- 10.20.193.4:0/4125316645 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79546f50 0x557c795a3dd0 unknown :-1 s=CLOSED pgs=1353 gs=1 cs=0 l=1 c_cookie=18327642929773967728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 -- 10.20.193.4:0/4125316645 >> 10.20.193.4:0/4125316645 conn(0x557c79465db0 msgr2=0x557c79545040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 -- 10.20.193.4:0/4125316645 shutdown_connections 2026-02-24T09:20:42.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 1 -- 10.20.193.4:0/4125316645 wait complete. 2026-02-24T09:20:42.925 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.917+0000 7ff743650e00 20 client.18432 trim_cache size 0 max 16384 2026-02-24T09:20:42.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff743650e00 1 Processor -- start 2026-02-24T09:20:42.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff743650e00 1 -- start start 2026-02-24T09:20:42.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff743650e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c79546f50 0x557c795a11c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff743650e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c795a1700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff743650e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c7958c500 0x557c79546460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff743650e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557c7944b9a0 con 0x557c7958c500 2026-02-24T09:20:42.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff743650e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557c79227df0 con 0x557c79546f50 2026-02-24T09:20:42.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff743650e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557c795a9cb0 con 0x557c79547860 2026-02-24T09:20:42.927 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff73b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c7958c500 0x557c79546460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff73b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c7958c500 0x557c79546460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42166/0 (socket says 10.20.193.4:42166) 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff73b7fe640 1 -- 10.20.193.4:0/3510050523 learned_addr learned my addr 10.20.193.4:0/3510050523 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff73b7fe640 1 -- 10.20.193.4:0/3510050523 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 msgr2=0x557c795a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff73b7fe640 1 --2- 10.20.193.4:0/3510050523 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c795a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff73b7fe640 1 -- 10.20.193.4:0/3510050523 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c79546f50 msgr2=0x557c795a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff73b7fe640 1 --2- 10.20.193.4:0/3510050523 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c79546f50 0x557c795a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff73b7fe640 1 -- 10.20.193.4:0/3510050523 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c793de190 con 0x557c7958c500 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff73b7fe640 1 --2- 10.20.193.4:0/3510050523 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c7958c500 0x557c79546460 secure :-1 s=READY pgs=1354 gs=1 cs=0 l=1 c_cookie=14883512874010710917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff72c0039a0 tx=0x7ff72c003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8cdc1a495c9385 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.924+0000 7ff706ffd640 1 -- 10.20.193.4:0/3510050523 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff72c018070 con 0x557c7958c500 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff706ffd640 1 -- 10.20.193.4:0/3510050523 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff72c013cf0 con 0x557c7958c500 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff706ffd640 1 -- 10.20.193.4:0/3510050523 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff72c0128e0 con 0x557c7958c500 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 -- 10.20.193.4:0/3510050523 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c7958c500 msgr2=0x557c79546460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 --2- 10.20.193.4:0/3510050523 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c7958c500 0x557c79546460 secure :-1 s=READY pgs=1354 gs=1 cs=0 l=1 c_cookie=14883512874010710917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff72c0039a0 tx=0x7ff72c003e70 comp rx=0 tx=0).stop 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 -- 10.20.193.4:0/3510050523 shutdown_connections 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 --2- 10.20.193.4:0/3510050523 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c7958c500 0x557c79546460 unknown :-1 s=CLOSED pgs=1354 gs=1 cs=0 l=1 c_cookie=14883512874010710917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 --2- 10.20.193.4:0/3510050523 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79547860 0x557c795a1700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 --2- 10.20.193.4:0/3510050523 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c79546f50 0x557c795a11c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 -- 10.20.193.4:0/3510050523 >> 10.20.193.4:0/3510050523 conn(0x557c79465db0 msgr2=0x557c795a8950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 -- 10.20.193.4:0/3510050523 shutdown_connections 2026-02-24T09:20:42.928 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 -- 10.20.193.4:0/3510050523 wait complete. 2026-02-24T09:20:42.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 -- start start 2026-02-24T09:20:42.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 Processor -- start 2026-02-24T09:20:42.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79546f50 0x557c79525030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79547860 0x557c79525570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c79525ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x557c795f3140 con 0x557c79547860 2026-02-24T09:20:42.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.925+0000 7ff743650e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x557c795f32b0 con 0x557c7958c500 2026-02-24T09:20:42.929 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x557c7952a100 con 0x557c79546f50 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73a7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79547860 0x557c79525570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73a7fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79547860 0x557c79525570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42176/0 (socket says 10.20.193.4:42176) 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73a7fc640 1 -- 10.20.193.4:0/798078752 learned_addr learned my addr 10.20.193.4:0/798078752 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73affd640 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79546f50 0x557c79525030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73a7fc640 1 -- 10.20.193.4:0/798078752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79546f50 msgr2=0x557c79525030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73a7fc640 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79546f50 0x557c79525030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73a7fc640 1 -- 10.20.193.4:0/798078752 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 msgr2=0x557c79525ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73a7fc640 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c79525ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73a7fc640 1 -- 10.20.193.4:0/798078752 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c793d1d00 con 0x557c79547860 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73a7fc640 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79547860 0x557c79525570 secure :-1 s=READY pgs=1355 gs=1 cs=0 l=1 c_cookie=3417792506758440949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff724009610 tx=0x7ff724009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6e702d395427f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff704ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff704ff9640 1 -- 10.20.193.4:0/798078752 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7240ada10 con 0x557c79547860 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 1 -- 10.20.193.4:0/798078752 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72c005580 con 0x557c79547860 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff704ff9640 1 -- 10.20.193.4:0/798078752 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff724096040 con 0x557c79547860 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff704ff9640 1 -- 10.20.193.4:0/798078752 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7240721a0 con 0x557c79547860 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 10 client.18438 _ll_register_callbacks cb 0x557c793f8080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 1 -- 10.20.193.4:0/798078752 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff730002820 con 0x557c79547860 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff704ff9640 1 -- 10.20.193.4:0/798078752 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff7240adca0 con 0x557c79547860 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff704ff9640 1 -- 10.20.193.4:0/798078752 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff7240ade60 con 0x557c79547860 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 10 client.18438 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 1 -- 10.20.193.4:0/798078752 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x557c793e3970 con 0x557c79547860 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff704ff9640 1 -- 10.20.193.4:0/798078752 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ff7240b7cc0 con 0x557c79547860 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 10 client.18438 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 10 client.18438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 20 client.18438 populate_metadata read hostname 'trial004' 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557c7963a520 0x557c7965a9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 4 client.18438 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:20:42.930 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff743650e00 1 -- 10.20.193.4:0/798078752 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c79182160 con 0x557c7963a520 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.926+0000 7ff73affd640 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557c7963a520 0x557c7965a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff73affd640 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557c7963a520 0x557c7965a9d0 crc :-1 s=READY pgs=234 gs=4 cs=0 l=0 c_cookie=3346830179660105051 s_cookie=16400472316547957312 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e725450ee32855b server_cookie=e39a2eadb0780240 in_seq=0 out_seq=0 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff704ff9640 10 client.18438 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff704ff9640 1 -- 10.20.193.4:0/798078752 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c79182160 con 0x557c7963a520 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff704ff9640 10 client.18438 handle_command_reply: tid=0 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 client.18438 shutdown 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 -- 10.20.193.4:0/798078752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79547860 msgr2=0x557c79525570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79547860 0x557c79525570 secure :-1 s=READY pgs=1355 gs=1 cs=0 l=1 c_cookie=3417792506758440949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff724009610 tx=0x7ff724009de0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 -- 10.20.193.4:0/798078752 shutdown_connections 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x557c7963a520 0x557c7965a9d0 crc :-1 s=READY pgs=234 gs=4 cs=0 l=0 c_cookie=3346830179660105051 s_cookie=16400472316547957312 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x557c7958c500 0x557c79525ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x557c79547860 0x557c79525570 unknown :-1 s=CLOSED pgs=1355 gs=1 cs=0 l=1 c_cookie=3417792506758440949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 --2- 10.20.193.4:0/798078752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x557c79546f50 0x557c79525030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff704ff9640 0 client.18438 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 -- 10.20.193.4:0/798078752 >> 10.20.193.4:0/798078752 conn(0x557c79465db0 msgr2=0x557c795a7030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 -- 10.20.193.4:0/798078752 shutdown_connections 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 1 -- 10.20.193.4:0/798078752 wait complete. 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff743650e00 20 client.18438 trim_cache size 0 max 16384 2026-02-24T09:20:42.931 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 -- 10.20.193.4:0/3008165970 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7100b56e0 msgr2=0x7ff7100d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7100b56e0 0x7ff7100d5b90 secure :-1 s=READY pgs=466 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff73002f6e0 tx=0x7ff730005900 comp rx=0 tx=0).stop 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 -- 10.20.193.4:0/3008165970 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff73c110040 msgr2=0x7ff73c11e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff73c110040 0x7ff73c11e440 secure :-1 s=READY pgs=1351 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff724005db0 tx=0x7ff72400ddf0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 -- 10.20.193.4:0/3008165970 shutdown_connections 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff7100b56e0 0x7ff7100d5b90 unknown :-1 s=CLOSED pgs=466 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff73c115840 0x7ff73c123810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff73c110040 0x7ff73c11e440 unknown :-1 s=CLOSED pgs=1351 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 --2- 10.20.193.4:0/3008165970 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff73c10f650 0x7ff73c11df00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 -- 10.20.193.4:0/3008165970 >> 10.20.193.4:0/3008165970 conn(0x7ff73c0ecf20 msgr2=0x7ff73c10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 -- 10.20.193.4:0/3008165970 shutdown_connections 2026-02-24T09:20:42.932 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:42.927+0000 7ff741656640 1 -- 10.20.193.4:0/3008165970 wait complete. 2026-02-24T09:20:43.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:42 trial004 ceph-mon[41596]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 682 MiB/s wr, 195 op/s 2026-02-24T09:20:43.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:42 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3009757520' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:43.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:42 trial090 ceph-mon[47278]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 682 MiB/s wr, 195 op/s 2026-02-24T09:20:43.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:42 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3009757520' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:42 trial014 ceph-mon[46941]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 682 MiB/s wr, 195 op/s 2026-02-24T09:20:43.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:42 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3009757520' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:43.481 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:20:43.598 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:43.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 -- 10.20.193.4:0/1374966399 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8aa8115470 msgr2=0x7f8aa8175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 --2- 10.20.193.4:0/1374966399 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8aa8115470 0x7f8aa8175e40 secure :-1 s=READY pgs=1356 gs=1 cs=0 l=1 c_cookie=8068021365098604627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a9c00aa30 tx=0x7f8a9c030280 comp rx=0 tx=0).stop 2026-02-24T09:20:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 -- 10.20.193.4:0/1374966399 shutdown_connections 2026-02-24T09:20:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 --2- 10.20.193.4:0/1374966399 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8aa8115470 0x7f8aa8175e40 unknown :-1 s=CLOSED pgs=1356 gs=1 cs=0 l=1 c_cookie=8068021365098604627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 --2- 10.20.193.4:0/1374966399 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8aa810fc70 0x7f8aa8114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 --2- 10.20.193.4:0/1374966399 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8aa810f280 0x7f8aa810f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 -- 10.20.193.4:0/1374966399 >> 10.20.193.4:0/1374966399 conn(0x7f8aa805f830 msgr2=0x7f8aa810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 -- 10.20.193.4:0/1374966399 shutdown_connections 2026-02-24T09:20:43.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 -- 10.20.193.4:0/1374966399 wait complete. 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 Processor -- start 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 -- start start 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8aa810f280 0x7f8aa811dc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8aa810fc70 0x7f8aa811e150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8aa8115470 0x7f8aa8123520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa8123ab0 con 0x7f8aa8115470 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa8123c20 con 0x7f8aa810fc70 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aadedd640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa8123de0 con 0x7f8aa810f280 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8aa8115470 0x7f8aa8123520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa7fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8aa8115470 0x7f8aa8123520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51582/0 (socket says 10.20.193.4:51582) 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa7fff640 1 -- 10.20.193.4:0/885899222 learned_addr learned my addr 10.20.193.4:0/885899222 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:43.703 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa6ffd640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8aa810fc70 0x7f8aa811e150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa7fff640 1 -- 10.20.193.4:0/885899222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8aa810f280 msgr2=0x7f8aa811dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa77fe640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8aa810f280 0x7f8aa811dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa7fff640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8aa810f280 0x7f8aa811dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa7fff640 1 -- 10.20.193.4:0/885899222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8aa810fc70 msgr2=0x7f8aa811e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa7fff640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8aa810fc70 0x7f8aa811e150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa7fff640 1 -- 10.20.193.4:0/885899222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c00a650 con 0x7f8aa8115470 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa6ffd640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8aa810fc70 0x7f8aa811e150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.696+0000 7f8aa77fe640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8aa810f280 0x7f8aa811dc10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.697+0000 7f8aa7fff640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8aa8115470 0x7f8aa8123520 secure :-1 s=READY pgs=1357 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a9c00a330 tx=0x7f8a9c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.697+0000 7f8aa4ff9640 1 -- 10.20.193.4:0/885899222 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a9c03e070 con 0x7f8aa8115470 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.697+0000 7f8aadedd640 1 -- 10.20.193.4:0/885899222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa8124060 con 0x7f8aa8115470 2026-02-24T09:20:43.704 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.697+0000 7f8aa4ff9640 1 -- 10.20.193.4:0/885899222 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a9c0055a0 con 0x7f8aa8115470 2026-02-24T09:20:43.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.697+0000 7f8aa4ff9640 1 -- 10.20.193.4:0/885899222 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a9c042a70 con 0x7f8aa8115470 2026-02-24T09:20:43.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.697+0000 7f8aadedd640 1 -- 10.20.193.4:0/885899222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa81646b0 con 0x7f8aa8115470 2026-02-24T09:20:43.705 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.697+0000 7f8aadedd640 1 -- 10.20.193.4:0/885899222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa8110560 con 0x7f8aa8115470 2026-02-24T09:20:43.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.698+0000 7f8aa4ff9640 1 -- 10.20.193.4:0/885899222 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f8a9c0050c0 con 0x7f8aa8115470 2026-02-24T09:20:43.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.699+0000 7f8aa4ff9640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a7c0b56e0 0x7f8a7c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:43.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.699+0000 7f8aa77fe640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a7c0b56e0 0x7f8a7c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:43.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.699+0000 7f8aa4ff9640 1 -- 10.20.193.4:0/885899222 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f8a9c10d500 con 0x7f8aa8115470 2026-02-24T09:20:43.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.699+0000 7f8aa4ff9640 1 -- 10.20.193.4:0/885899222 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f8a9c0cfe80 con 0x7f8aa8115470 2026-02-24T09:20:43.706 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.699+0000 7f8aa77fe640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a7c0b56e0 0x7f8a7c0d5b90 secure :-1 s=READY pgs=467 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a94005fd0 tx=0x7f8a94005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:43.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.831+0000 7f8aadedd640 1 -- 10.20.193.4:0/885899222 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8aa810f650 con 0x7f8aa8115470 2026-02-24T09:20:43.834 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.831+0000 7f8aa4ff9640 1 -- 10.20.193.4:0/885899222 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f8a9c0d3030 con 0x7f8aa8115470 2026-02-24T09:20:43.835 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:20:43.835 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:20:43.835 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:20:43.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 -- 10.20.193.4:0/885899222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a7c0b56e0 msgr2=0x7f8a7c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:43.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a7c0b56e0 0x7f8a7c0d5b90 secure :-1 s=READY pgs=467 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a94005fd0 tx=0x7f8a94005e40 comp rx=0 tx=0).stop 2026-02-24T09:20:43.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 -- 10.20.193.4:0/885899222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8aa8115470 msgr2=0x7f8aa8123520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:43.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8aa8115470 0x7f8aa8123520 secure :-1 s=READY pgs=1357 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a9c00a330 tx=0x7f8a9c0039b0 comp rx=0 tx=0).stop 2026-02-24T09:20:43.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 -- 10.20.193.4:0/885899222 shutdown_connections 2026-02-24T09:20:43.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f8a7c0b56e0 0x7f8a7c0d5b90 unknown :-1 s=CLOSED pgs=467 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:43.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f8aa8115470 0x7f8aa8123520 unknown :-1 s=CLOSED pgs=1357 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:43.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f8aa810fc70 0x7f8aa811e150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:43.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 --2- 10.20.193.4:0/885899222 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8aa810f280 0x7f8aa811dc10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:43.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 -- 10.20.193.4:0/885899222 >> 10.20.193.4:0/885899222 conn(0x7f8aa805f830 msgr2=0x7f8aa810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:43.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 -- 10.20.193.4:0/885899222 shutdown_connections 2026-02-24T09:20:43.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:43.833+0000 7f8aadedd640 1 -- 10.20.193.4:0/885899222 wait complete. 2026-02-24T09:20:43.871 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --set-id fac655d2 --release --await' 2026-02-24T09:20:43.871 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --set-id fac655d2 --release --await 2026-02-24T09:20:43.965 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-24T09:20:43.966 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-24T09:20:43.986 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:44.087 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:44.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 -- 10.20.193.4:0/1648205065 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ee010fc70 msgr2=0x7f4ee0114cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 --2- 10.20.193.4:0/1648205065 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ee010fc70 0x7f4ee0114cc0 secure :-1 s=READY pgs=1358 gs=1 cs=0 l=1 c_cookie=11037438721138041230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ed4009950 tx=0x7f4ed402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.099 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 -- 10.20.193.4:0/1648205065 shutdown_connections 2026-02-24T09:20:44.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 --2- 10.20.193.4:0/1648205065 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ee0115470 0x7f4ee0175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 --2- 10.20.193.4:0/1648205065 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ee010fc70 0x7f4ee0114cc0 unknown :-1 s=CLOSED pgs=1358 gs=1 cs=0 l=1 c_cookie=11037438721138041230 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 --2- 10.20.193.4:0/1648205065 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ee010f280 0x7f4ee010f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 -- 10.20.193.4:0/1648205065 >> 10.20.193.4:0/1648205065 conn(0x7f4ee005f830 msgr2=0x7f4ee010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 -- 10.20.193.4:0/1648205065 shutdown_connections 2026-02-24T09:20:44.100 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 -- 10.20.193.4:0/1648205065 wait complete. 2026-02-24T09:20:44.100 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:43 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/885899222' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:44.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 Processor -- start 2026-02-24T09:20:44.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 -- start start 2026-02-24T09:20:44.111 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ee010f280 0x7f4ee00f5580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ee010fc70 0x7f4ee0175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ee0115470 0x7f4ee00f5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee00fae90 con 0x7f4ee010fc70 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee00fb000 con 0x7f4ee0115470 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.095+0000 7f4ee814e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee00fb1c0 con 0x7f4ee010f280 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee56c2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ee010fc70 0x7f4ee0175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee56c2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ee010fc70 0x7f4ee0175d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51586/0 (socket says 10.20.193.4:51586) 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee56c2640 1 -- 10.20.193.4:0/1345951400 learned_addr learned my addr 10.20.193.4:0/1345951400 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ee0115470 0x7f4ee00f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee56c2640 1 -- 10.20.193.4:0/1345951400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ee010f280 msgr2=0x7f4ee00f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.112 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee56c2640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ee010f280 0x7f4ee00f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee56c2640 1 -- 10.20.193.4:0/1345951400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ee0115470 msgr2=0x7f4ee00f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee56c2640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ee0115470 0x7f4ee00f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee56c2640 1 -- 10.20.193.4:0/1345951400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed4009570 con 0x7f4ee010fc70 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ee0115470 0x7f4ee00f5c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee56c2640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ee010fc70 0x7f4ee0175d40 secure :-1 s=READY pgs=1359 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ed40023d0 tx=0x7f4ed40043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4eceffd640 1 -- 10.20.193.4:0/1345951400 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ed403d070 con 0x7f4ee010fc70 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee814e640 1 -- 10.20.193.4:0/1345951400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee00fb440 con 0x7f4ee010fc70 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4eceffd640 1 -- 10.20.193.4:0/1345951400 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ed4038920 con 0x7f4ee010fc70 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4eceffd640 1 -- 10.20.193.4:0/1345951400 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ed40419d0 con 0x7f4ee010fc70 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.096+0000 7f4ee814e640 1 -- 10.20.193.4:0/1345951400 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee00fb900 con 0x7f4ee010fc70 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.098+0000 7f4eceffd640 1 -- 10.20.193.4:0/1345951400 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f4ed4038a90 con 0x7f4ee010fc70 2026-02-24T09:20:44.113 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.098+0000 7f4eceffd640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ebc0b5750 0x7f4ebc0d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.098+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ebc0b5750 0x7f4ebc0d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.099+0000 7f4eceffd640 1 -- 10.20.193.4:0/1345951400 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4ed410b3c0 con 0x7f4ee010fc70 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.099+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ebc0b5750 0x7f4ebc0d5c00 secure :-1 s=READY pgs=468 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ed0005970 tx=0x7f4ed0005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4eea148e00 1 Processor -- start 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4eea148e00 1 -- start start 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d1fb0 0x564d678d2380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d28c0 0x564d67917020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 0x564d67937940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4eea148e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564d677e3050 con 0x564d678d1fb0 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4eea148e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564d677ded80 con 0x564d67917560 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4eea148e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564d677d8ee0 con 0x564d678d28c0 2026-02-24T09:20:44.114 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee5ec3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d1fb0 0x564d678d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee5ec3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d1fb0 0x564d678d2380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51598/0 (socket says 10.20.193.4:51598) 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee5ec3640 1 -- 10.20.193.4:0/185194285 learned_addr learned my addr 10.20.193.4:0/185194285 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee56c2640 1 --2- 10.20.193.4:0/185194285 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d28c0 0x564d67917020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/185194285 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 0x564d67937940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee5ec3640 1 -- 10.20.193.4:0/185194285 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d28c0 msgr2=0x564d67917020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/185194285 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d28c0 0x564d67917020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee5ec3640 1 -- 10.20.193.4:0/185194285 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 msgr2=0x564d67937940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/185194285 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 0x564d67937940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee5ec3640 1 -- 10.20.193.4:0/185194285 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d67784540 con 0x564d678d1fb0 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.100+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/185194285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d1fb0 0x564d678d2380 secure :-1 s=READY pgs=1360 gs=1 cs=0 l=1 c_cookie=15626478894164620877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ed0004510 tx=0x7f4ed0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dc67c2f8d2364d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eae4e6640 1 -- 10.20.193.4:0/185194285 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ed0015040 con 0x564d678d1fb0 2026-02-24T09:20:44.115 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eae4e6640 1 -- 10.20.193.4:0/185194285 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ed0002c20 con 0x564d678d1fb0 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eae4e6640 1 -- 10.20.193.4:0/185194285 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ed001c760 con 0x564d678d1fb0 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eea148e00 1 -- 10.20.193.4:0/185194285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d1fb0 msgr2=0x564d678d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eea148e00 1 --2- 10.20.193.4:0/185194285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d1fb0 0x564d678d2380 secure :-1 s=READY pgs=1360 gs=1 cs=0 l=1 c_cookie=15626478894164620877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ed0004510 tx=0x7f4ed0010000 comp rx=0 tx=0).stop 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eea148e00 1 -- 10.20.193.4:0/185194285 shutdown_connections 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eea148e00 1 --2- 10.20.193.4:0/185194285 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 0x564d67937940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eea148e00 1 --2- 10.20.193.4:0/185194285 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d28c0 0x564d67917020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eea148e00 1 --2- 10.20.193.4:0/185194285 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d1fb0 0x564d678d2380 unknown :-1 s=CLOSED pgs=1360 gs=1 cs=0 l=1 c_cookie=15626478894164620877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eea148e00 1 -- 10.20.193.4:0/185194285 >> 10.20.193.4:0/185194285 conn(0x564d678b04b0 msgr2=0x564d678d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eea148e00 1 -- 10.20.193.4:0/185194285 shutdown_connections 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.101+0000 7f4eea148e00 1 -- 10.20.193.4:0/185194285 wait complete. 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.102+0000 7f4eea148e00 1 -- start start 2026-02-24T09:20:44.116 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.102+0000 7f4eea148e00 1 Processor -- start 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.102+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d6792eea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.102+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d678d28c0 0x564d6792f3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.102+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d679343d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564d67934910 con 0x564d67917560 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564d67934a80 con 0x564d678d28c0 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564d67934c40 con 0x564d678d1fb0 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee66c4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d679343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee66c4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d679343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51606/0 (socket says 10.20.193.4:51606) 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee66c4640 1 -- 10.20.193.4:0/2459364011 learned_addr learned my addr 10.20.193.4:0/2459364011 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d6792eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee56c2640 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d678d28c0 0x564d6792f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.117 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee66c4640 1 -- 10.20.193.4:0/2459364011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 msgr2=0x564d6792eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d6792eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee66c4640 1 -- 10.20.193.4:0/2459364011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d678d28c0 msgr2=0x564d6792f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d678d28c0 0x564d6792f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee66c4640 1 -- 10.20.193.4:0/2459364011 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d6775cbd0 con 0x564d67917560 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d6792eea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d679343d0 secure :-1 s=READY pgs=1361 gs=1 cs=0 l=1 c_cookie=16120600733048888266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4edc0051d0 tx=0x7f4edc0127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb7e0f4c347dbca server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4e9b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/2459364011 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4edc013880 con 0x564d67917560 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/2459364011 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4edc003e20 con 0x564d67917560 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 1 -- 10.20.193.4:0/2459364011 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed00041b0 con 0x564d67917560 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/2459364011 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4edc0103d0 con 0x564d67917560 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 10 client.18456 _ll_register_callbacks cb 0x564d677c7290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:44.118 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 1 -- 10.20.193.4:0/2459364011 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564d67528700 con 0x564d67917560 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/2459364011 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4edc010560 con 0x564d67917560 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/2459364011 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4edc010720 con 0x564d67917560 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 10 client.18456 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 1 -- 10.20.193.4:0/2459364011 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564d6776e910 con 0x564d67917560 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/2459364011 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4edc0139e0 con 0x564d67917560 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 10 client.18456 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 10 client.18456 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 20 client.18456 populate_metadata read hostname 'trial004' 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564d679148d0 0x564d67914d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 4 client.18456 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.103+0000 7f4eea148e00 1 -- 10.20.193.4:0/2459364011 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d677ce920 con 0x564d679148d0 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.104+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564d679148d0 0x564d67914d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.119 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.104+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564d679148d0 0x564d67914d40 crc :-1 s=READY pgs=235 gs=4 cs=0 l=0 c_cookie=13593060176324805106 s_cookie=3675243547719194168 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca44036145941f2 server_cookie=33011688ccd95638 in_seq=0 out_seq=0 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.104+0000 7f4e9b7fe640 10 client.18456 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.104+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/2459364011 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564d677ce920 con 0x564d679148d0 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.104+0000 7f4e9b7fe640 10 client.18456 handle_command_reply: tid=0 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.104+0000 7f4eea148e00 1 client.18456 shutdown 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 1 -- 10.20.193.4:0/2459364011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 msgr2=0x564d679343d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d679343d0 secure :-1 s=READY pgs=1361 gs=1 cs=0 l=1 c_cookie=16120600733048888266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4edc0051d0 tx=0x7f4edc0127b0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 1 -- 10.20.193.4:0/2459364011 shutdown_connections 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564d679148d0 0x564d67914d40 crc :-1 s=READY pgs=235 gs=4 cs=0 l=0 c_cookie=13593060176324805106 s_cookie=3675243547719194168 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d679343d0 unknown :-1 s=CLOSED pgs=1361 gs=1 cs=0 l=1 c_cookie=16120600733048888266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4e9b7fe640 0 client.18456 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.120 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d678d28c0 0x564d6792f3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 1 --2- 10.20.193.4:0/2459364011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d6792eea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 1 -- 10.20.193.4:0/2459364011 >> 10.20.193.4:0/2459364011 conn(0x564d678b04b0 msgr2=0x564d678d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 1 -- 10.20.193.4:0/2459364011 shutdown_connections 2026-02-24T09:20:44.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 1 -- 10.20.193.4:0/2459364011 wait complete. 2026-02-24T09:20:44.121 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.105+0000 7f4eea148e00 20 client.18456 trim_cache size 0 max 16384 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4eea148e00 1 Processor -- start 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4eea148e00 1 -- start start 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d6792c180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d28c0 0x564d6792c6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 0x564d679121a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4eea148e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564d677d6b10 con 0x564d678d28c0 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4eea148e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564d674a21b0 con 0x564d67917560 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4eea148e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564d678d2dd0 con 0x564d678d1fb0 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4ee56c2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d28c0 0x564d6792c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4ee56c2640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d28c0 0x564d6792c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51608/0 (socket says 10.20.193.4:51608) 2026-02-24T09:20:44.126 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.114+0000 7f4ee56c2640 1 -- 10.20.193.4:0/2894914759 learned_addr learned my addr 10.20.193.4:0/2894914759 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d6792c180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 0x564d679121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4ee56c2640 1 -- 10.20.193.4:0/2894914759 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 msgr2=0x564d6792c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4ee56c2640 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d6792c180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4ee56c2640 1 -- 10.20.193.4:0/2894914759 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 msgr2=0x564d679121a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4ee56c2640 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 0x564d679121a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4ee56c2640 1 -- 10.20.193.4:0/2894914759 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d67769390 con 0x564d678d28c0 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d6792c180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 0x564d679121a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4ee56c2640 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d28c0 0x564d6792c6c0 secure :-1 s=READY pgs=1362 gs=1 cs=0 l=1 c_cookie=5670562512972317938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ed4108e60 tx=0x7f4ed4002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb1e28fc65c84f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eadce5640 1 -- 10.20.193.4:0/2894914759 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ed40d20f0 con 0x564d678d28c0 2026-02-24T09:20:44.127 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eadce5640 1 -- 10.20.193.4:0/2894914759 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ed40d7410 con 0x564d678d28c0 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eadce5640 1 -- 10.20.193.4:0/2894914759 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ed40dc3a0 con 0x564d678d28c0 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eea148e00 1 -- 10.20.193.4:0/2894914759 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d28c0 msgr2=0x564d6792c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eea148e00 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d28c0 0x564d6792c6c0 secure :-1 s=READY pgs=1362 gs=1 cs=0 l=1 c_cookie=5670562512972317938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ed4108e60 tx=0x7f4ed4002b90 comp rx=0 tx=0).stop 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eea148e00 1 -- 10.20.193.4:0/2894914759 shutdown_connections 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eea148e00 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d67917560 0x564d679121a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eea148e00 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d678d28c0 0x564d6792c6c0 unknown :-1 s=CLOSED pgs=1362 gs=1 cs=0 l=1 c_cookie=5670562512972317938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eea148e00 1 --2- 10.20.193.4:0/2894914759 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d6792c180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eea148e00 1 -- 10.20.193.4:0/2894914759 >> 10.20.193.4:0/2894914759 conn(0x564d678b04b0 msgr2=0x564d6792ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eea148e00 1 -- 10.20.193.4:0/2894914759 shutdown_connections 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.115+0000 7f4eea148e00 1 -- 10.20.193.4:0/2894914759 wait complete. 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4eea148e00 1 -- start start 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4eea148e00 1 Processor -- start 2026-02-24T09:20:44.128 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d678b6650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d678d28c0 0x564d678b1bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4eea148e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d678b2320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4eea148e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564d677d6b10 con 0x564d67917560 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4eea148e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564d678b2a50 con 0x564d678d28c0 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4eea148e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564d6797d520 con 0x564d678d1fb0 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee66c4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d678b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee66c4640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d678b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51620/0 (socket says 10.20.193.4:51620) 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee66c4640 1 -- 10.20.193.4:0/3581401509 learned_addr learned my addr 10.20.193.4:0/3581401509 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee56c2640 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d678d28c0 0x564d678b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d678b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee66c4640 1 -- 10.20.193.4:0/3581401509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 msgr2=0x564d678b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.129 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d678b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee66c4640 1 -- 10.20.193.4:0/3581401509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d678d28c0 msgr2=0x564d678b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d678d28c0 0x564d678b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee66c4640 1 -- 10.20.193.4:0/3581401509 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d6775cf00 con 0x564d67917560 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4ee66c4640 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d678b2320 secure :-1 s=READY pgs=1363 gs=1 cs=0 l=1 c_cookie=4817687915699716609 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4edc026710 tx=0x7f4edc005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42dbdda255f94201 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4e9b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/3581401509 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4edc013ea0 con 0x564d67917560 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/3581401509 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4edc02b060 con 0x564d67917560 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.116+0000 7f4eea148e00 1 -- 10.20.193.4:0/3581401509 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee00fb900 con 0x564d67917560 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/3581401509 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4edc005d50 con 0x564d67917560 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4eea148e00 10 client.18462 _ll_register_callbacks cb 0x564d677c7290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4eea148e00 1 -- 10.20.193.4:0/3581401509 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ed0002c20 con 0x564d67917560 2026-02-24T09:20:44.130 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/3581401509 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4edc026870 con 0x564d67917560 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/3581401509 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4edc026a30 con 0x564d67917560 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4eea148e00 10 client.18462 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4eea148e00 1 -- 10.20.193.4:0/3581401509 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564d6776eb70 con 0x564d67917560 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/3581401509 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4edc040070 con 0x564d67917560 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4eea148e00 10 client.18462 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4eea148e00 10 client.18462 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4eea148e00 20 client.18462 populate_metadata read hostname 'trial004' 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4eea148e00 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564d679c5610 0x564d679e5ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4eea148e00 4 client.18462 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fac655d2", "release": true, "await": true}] 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4eea148e00 1 -- 10.20.193.4:0/3581401509 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fac655d2", "release": true, "await": true}) -- 0x564d6750d3c0 con 0x564d679c5610 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.117+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564d679c5610 0x564d679e5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.131 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.118+0000 7f4ee5ec3640 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564d679c5610 0x564d679e5ac0 crc :-1 s=READY pgs=236 gs=4 cs=0 l=0 c_cookie=14744275288345991631 s_cookie=4197588286386096446 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc9e3041986ed9cf server_cookie=3a40d44e8362493e in_seq=0 out_seq=0 2026-02-24T09:20:44.132 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.118+0000 7f4e9b7fe640 10 client.18462 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.133 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-24T09:20:44.133 DEBUG:teuthology.orchestra.run.trial004:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-24T09:20:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.119+0000 7f4e9b7fe640 1 -- 10.20.193.4:0/3581401509 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564d6750d3c0 con 0x564d679c5610 2026-02-24T09:20:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.119+0000 7f4e9b7fe640 10 client.18462 handle_command_reply: tid=0 2026-02-24T09:20:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.119+0000 7f4eea148e00 1 client.18462 shutdown 2026-02-24T09:20:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 1 -- 10.20.193.4:0/3581401509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 msgr2=0x564d678b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d678b2320 secure :-1 s=READY pgs=1363 gs=1 cs=0 l=1 c_cookie=4817687915699716609 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4edc026710 tx=0x7f4edc005130 comp rx=0 tx=0).stop 2026-02-24T09:20:44.134 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 1 -- 10.20.193.4:0/3581401509 shutdown_connections 2026-02-24T09:20:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564d679c5610 0x564d679e5ac0 crc :-1 s=READY pgs=236 gs=4 cs=0 l=0 c_cookie=14744275288345991631 s_cookie=4197588286386096446 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564d67917560 0x564d678b2320 unknown :-1 s=CLOSED pgs=1363 gs=1 cs=0 l=1 c_cookie=4817687915699716609 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564d678d28c0 0x564d678b1bb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 1 --2- 10.20.193.4:0/3581401509 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564d678d1fb0 0x564d678b6650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4e9b7fe640 0 client.18462 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 1 -- 10.20.193.4:0/3581401509 >> 10.20.193.4:0/3581401509 conn(0x564d678b04b0 msgr2=0x564d6792c180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 1 -- 10.20.193.4:0/3581401509 shutdown_connections 2026-02-24T09:20:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 1 -- 10.20.193.4:0/3581401509 wait complete. 2026-02-24T09:20:44.135 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4eea148e00 20 client.18462 trim_cache size 0 max 16384 2026-02-24T09:20:44.136 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:20:44.136 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:20:44.136 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:20:44.136 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 44, 2026-02-24T09:20:44.136 INFO:teuthology.orchestra.run.trial004.stdout: "sets": { 2026-02-24T09:20:44.136 INFO:teuthology.orchestra.run.trial004.stdout: "fac655d2": { 2026-02-24T09:20:44.136 INFO:teuthology.orchestra.run.trial004.stdout: "version": 44, 2026-02-24T09:20:44.136 INFO:teuthology.orchestra.run.trial004.stdout: "age_ref": 0.0, 2026-02-24T09:20:44.136 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:20:44.136 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: "timeout": 90.0, 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: "expiration": 130.1, 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: "members": { 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: "file:/": { 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: "excluded": false, 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: "state": { 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RELEASED", 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: "age": 0.0 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:44.137 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:44.138 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:44.138 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:44.138 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:20:44.138 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 -- 10.20.193.4:0/1345951400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ebc0b5750 msgr2=0x7f4ebc0d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ebc0b5750 0x7f4ebc0d5c00 secure :-1 s=READY pgs=468 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ed0005970 tx=0x7f4ed0005900 comp rx=0 tx=0).stop 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 -- 10.20.193.4:0/1345951400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ee010fc70 msgr2=0x7f4ee0175d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ee010fc70 0x7f4ee0175d40 secure :-1 s=READY pgs=1359 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ed40023d0 tx=0x7f4ed40043d0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 -- 10.20.193.4:0/1345951400 shutdown_connections 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ebc0b5750 0x7f4ebc0d5c00 unknown :-1 s=CLOSED pgs=468 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ee0115470 0x7f4ee00f5c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ee010fc70 0x7f4ee0175d40 unknown :-1 s=CLOSED pgs=1359 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 --2- 10.20.193.4:0/1345951400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ee010f280 0x7f4ee00f5580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 -- 10.20.193.4:0/1345951400 >> 10.20.193.4:0/1345951400 conn(0x7f4ee005f830 msgr2=0x7f4ee0111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 -- 10.20.193.4:0/1345951400 shutdown_connections 2026-02-24T09:20:44.139 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.120+0000 7f4ee814e640 1 -- 10.20.193.4:0/1345951400 wait complete. 2026-02-24T09:20:44.163 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fac655d2', total seconds elapsed: 10.8 2026-02-24T09:20:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 -- 10.20.193.4:0/29152385 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f94c410d010 msgr2=0x7f94c410d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 --2- 10.20.193.4:0/29152385 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f94c410d010 0x7f94c410d3e0 secure :-1 s=READY pgs=1364 gs=1 cs=0 l=1 c_cookie=16482755351200022084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b4009950 tx=0x7f94b402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 -- 10.20.193.4:0/29152385 shutdown_connections 2026-02-24T09:20:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 --2- 10.20.193.4:0/29152385 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c4113200 0x7f94c4173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 --2- 10.20.193.4:0/29152385 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f94c410da00 0x7f94c4112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 --2- 10.20.193.4:0/29152385 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f94c410d010 0x7f94c410d3e0 unknown :-1 s=CLOSED pgs=1364 gs=1 cs=0 l=1 c_cookie=16482755351200022084 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 -- 10.20.193.4:0/29152385 >> 10.20.193.4:0/29152385 conn(0x7f94c405f830 msgr2=0x7f94c410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 -- 10.20.193.4:0/29152385 shutdown_connections 2026-02-24T09:20:44.200 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 -- 10.20.193.4:0/29152385 wait complete. 2026-02-24T09:20:44.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 Processor -- start 2026-02-24T09:20:44.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 -- start start 2026-02-24T09:20:44.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f94c410d010 0x7f94c411b9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c410da00 0x7f94c411bef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.202 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f94c4113200 0x7f94c41212c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41218e0 con 0x7f94c4113200 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f94c4121a50 con 0x7f94c410d010 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94cb969640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94c4121c10 con 0x7f94c410da00 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94c9edf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f94c4113200 0x7f94c41212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94c9edf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f94c4113200 0x7f94c41212c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51628/0 (socket says 10.20.193.4:51628) 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94c9edf640 1 -- 10.20.193.4:0/2474936103 learned_addr learned my addr 10.20.193.4:0/2474936103 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94c96de640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f94c410d010 0x7f94c411b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94c9edf640 1 -- 10.20.193.4:0/2474936103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c410da00 msgr2=0x7f94c411bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94c9edf640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c410da00 0x7f94c411bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94c9edf640 1 -- 10.20.193.4:0/2474936103 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f94c410d010 msgr2=0x7f94c411b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94c9edf640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f94c410d010 0x7f94c411b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.203 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94c9edf640 1 -- 10.20.193.4:0/2474936103 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b4009570 con 0x7f94c4113200 2026-02-24T09:20:44.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.196+0000 7f94c96de640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f94c410d010 0x7f94c411b9b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:44.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.197+0000 7f94c9edf640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f94c4113200 0x7f94c41212c0 secure :-1 s=READY pgs=1365 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94c0006e90 tx=0x7f94c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.197+0000 7f94b27fc640 1 -- 10.20.193.4:0/2474936103 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94c0005500 con 0x7f94c4113200 2026-02-24T09:20:44.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.197+0000 7f94b27fc640 1 -- 10.20.193.4:0/2474936103 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f94c0005e10 con 0x7f94c4113200 2026-02-24T09:20:44.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.197+0000 7f94cb969640 1 -- 10.20.193.4:0/2474936103 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c4121ef0 con 0x7f94c4113200 2026-02-24T09:20:44.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.197+0000 7f94b27fc640 1 -- 10.20.193.4:0/2474936103 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94c0003a90 con 0x7f94c4113200 2026-02-24T09:20:44.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.197+0000 7f94cb969640 1 -- 10.20.193.4:0/2474936103 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c41625f0 con 0x7f94c4113200 2026-02-24T09:20:44.204 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.198+0000 7f94b27fc640 1 -- 10.20.193.4:0/2474936103 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f94c000c840 con 0x7f94c4113200 2026-02-24T09:20:44.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.199+0000 7f94b27fc640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f94a00b5760 0x7f94a00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.199+0000 7f94b27fc640 1 -- 10.20.193.4:0/2474936103 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f94c00e78a0 con 0x7f94c4113200 2026-02-24T09:20:44.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.199+0000 7f94c96de640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f94a00b5760 0x7f94a00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.199+0000 7f94c96de640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f94a00b5760 0x7f94a00d5c10 secure :-1 s=READY pgs=469 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b40098a0 tx=0x7f94b4031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.200+0000 7f94cd963e00 1 Processor -- start 2026-02-24T09:20:44.210 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.200+0000 7f94cd963e00 1 -- start start 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.200+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dac810 0x556527dacbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.200+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 0x556527df1880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.200+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527df1dc0 0x556527e121a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.200+0000 7f94cd963e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556527cb8520 con 0x556527dac810 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.200+0000 7f94cd963e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556527cb4250 con 0x556527dad120 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.200+0000 7f94cd963e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556527cae3b0 con 0x556527df1dc0 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c96de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dac810 0x556527dacbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c96de640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dac810 0x556527dacbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51630/0 (socket says 10.20.193.4:51630) 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c96de640 1 -- 10.20.193.4:0/749933591 learned_addr learned my addr 10.20.193.4:0/749933591 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c9edf640 1 --2- 10.20.193.4:0/749933591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527df1dc0 0x556527e121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.211 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c8edd640 1 --2- 10.20.193.4:0/749933591 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 0x556527df1880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c96de640 1 -- 10.20.193.4:0/749933591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527df1dc0 msgr2=0x556527e121a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c96de640 1 --2- 10.20.193.4:0/749933591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527df1dc0 0x556527e121a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c96de640 1 -- 10.20.193.4:0/749933591 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 msgr2=0x556527df1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c96de640 1 --2- 10.20.193.4:0/749933591 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 0x556527df1880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c96de640 1 -- 10.20.193.4:0/749933591 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556527c596e0 con 0x556527dac810 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94c96de640 1 --2- 10.20.193.4:0/749933591 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dac810 0x556527dacbe0 secure :-1 s=READY pgs=1366 gs=1 cs=0 l=1 c_cookie=6219201927945009193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b4002f30 tx=0x7f94b403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564f0b33e5963829 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f9491ce5640 1 -- 10.20.193.4:0/749933591 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94b404b070 con 0x556527dac810 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f9491ce5640 1 -- 10.20.193.4:0/749933591 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f94b4039930 con 0x556527dac810 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f9491ce5640 1 -- 10.20.193.4:0/749933591 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94b403f070 con 0x556527dac810 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94cd963e00 1 -- 10.20.193.4:0/749933591 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dac810 msgr2=0x556527dacbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94cd963e00 1 --2- 10.20.193.4:0/749933591 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dac810 0x556527dacbe0 secure :-1 s=READY pgs=1366 gs=1 cs=0 l=1 c_cookie=6219201927945009193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b4002f30 tx=0x7f94b403f000 comp rx=0 tx=0).stop 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94cd963e00 1 -- 10.20.193.4:0/749933591 shutdown_connections 2026-02-24T09:20:44.212 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94cd963e00 1 --2- 10.20.193.4:0/749933591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527df1dc0 0x556527e121a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94cd963e00 1 --2- 10.20.193.4:0/749933591 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 0x556527df1880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94cd963e00 1 --2- 10.20.193.4:0/749933591 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dac810 0x556527dacbe0 unknown :-1 s=CLOSED pgs=1366 gs=1 cs=0 l=1 c_cookie=6219201927945009193 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94cd963e00 1 -- 10.20.193.4:0/749933591 >> 10.20.193.4:0/749933591 conn(0x556527cc64f0 msgr2=0x556527da6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94cd963e00 1 -- 10.20.193.4:0/749933591 shutdown_connections 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.201+0000 7f94cd963e00 1 -- 10.20.193.4:0/749933591 wait complete. 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94cd963e00 1 -- start start 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94cd963e00 1 Processor -- start 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dac810 0x556527dc47c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dad120 0x556527dc4d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527df1dc0 0x556527dc9cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.213 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94cd963e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556527dca230 con 0x556527dad120 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94cd963e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556527dca3a0 con 0x556527dac810 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94cd963e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556527dca560 con 0x556527df1dc0 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94c8edd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dad120 0x556527dc4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94c8edd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dad120 0x556527dc4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51638/0 (socket says 10.20.193.4:51638) 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94c8edd640 1 -- 10.20.193.4:0/731808161 learned_addr learned my addr 10.20.193.4:0/731808161 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.202+0000 7f94c9edf640 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527df1dc0 0x556527dc9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94c96de640 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dac810 0x556527dc47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94c8edd640 1 -- 10.20.193.4:0/731808161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527df1dc0 msgr2=0x556527dc9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94c8edd640 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527df1dc0 0x556527dc9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94c8edd640 1 -- 10.20.193.4:0/731808161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dac810 msgr2=0x556527dc47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94c8edd640 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dac810 0x556527dc47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94c8edd640 1 -- 10.20.193.4:0/731808161 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556527c31cd0 con 0x556527dad120 2026-02-24T09:20:44.214 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94c8edd640 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dad120 0x556527dc4d00 secure :-1 s=READY pgs=1367 gs=1 cs=0 l=1 c_cookie=15159265770685703273 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b8002b20 tx=0x7f94b800f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26087e6b575a469 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f947effd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f947effd640 1 -- 10.20.193.4:0/731808161 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94b8011440 con 0x556527dad120 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f947effd640 1 -- 10.20.193.4:0/731808161 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f94b8011a80 con 0x556527dad120 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 1 -- 10.20.193.4:0/731808161 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c4174440 con 0x556527dad120 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f947effd640 1 -- 10.20.193.4:0/731808161 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94b8010c70 con 0x556527dad120 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 10 client.18474 _ll_register_callbacks cb 0x556527c2a790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 1 -- 10.20.193.4:0/731808161 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55652793b9d0 con 0x556527dad120 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f947effd640 1 -- 10.20.193.4:0/731808161 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f94b8010e00 con 0x556527dad120 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f947effd640 1 -- 10.20.193.4:0/731808161 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f94b801a450 con 0x556527dad120 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 10 client.18474 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 1 -- 10.20.193.4:0/731808161 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556527c43ab0 con 0x556527dad120 2026-02-24T09:20:44.215 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f947effd640 1 -- 10.20.193.4:0/731808161 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f94b801a5d0 con 0x556527dad120 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 10 client.18474 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 10 client.18474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 20 client.18474 populate_metadata read hostname 'trial004' 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556527def0a0 0x556527def540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 4 client.18474 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94cd963e00 1 -- 10.20.193.4:0/731808161 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556527cbeb70 con 0x556527def0a0 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.203+0000 7f94c96de640 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556527def0a0 0x556527def540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f94c96de640 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556527def0a0 0x556527def540 crc :-1 s=READY pgs=237 gs=4 cs=0 l=0 c_cookie=13869063037757559369 s_cookie=3490879012455008521 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c078cf59f50a1249 server_cookie=307217f7633f4909 in_seq=0 out_seq=0 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f947effd640 10 client.18474 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f947effd640 1 -- 10.20.193.4:0/731808161 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x556527cbeb70 con 0x556527def0a0 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f947effd640 10 client.18474 handle_command_reply: tid=0 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f94cd963e00 1 client.18474 shutdown 2026-02-24T09:20:44.216 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f94cd963e00 1 -- 10.20.193.4:0/731808161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dad120 msgr2=0x556527dc4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f94cd963e00 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dad120 0x556527dc4d00 secure :-1 s=READY pgs=1367 gs=1 cs=0 l=1 c_cookie=15159265770685703273 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b8002b20 tx=0x7f94b800f360 comp rx=0 tx=0).stop 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f94cd963e00 1 -- 10.20.193.4:0/731808161 shutdown_connections 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f94cd963e00 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556527def0a0 0x556527def540 crc :-1 s=READY pgs=237 gs=4 cs=0 l=0 c_cookie=13869063037757559369 s_cookie=3490879012455008521 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f94cd963e00 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527df1dc0 0x556527dc9cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f94cd963e00 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527dad120 0x556527dc4d00 unknown :-1 s=CLOSED pgs=1367 gs=1 cs=0 l=1 c_cookie=15159265770685703273 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f94cd963e00 1 --2- 10.20.193.4:0/731808161 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dac810 0x556527dc47c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f947effd640 0 client.18474 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.204+0000 7f94cd963e00 1 -- 10.20.193.4:0/731808161 >> 10.20.193.4:0/731808161 conn(0x556527cc64f0 msgr2=0x556527da72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.205+0000 7f94cd963e00 1 -- 10.20.193.4:0/731808161 shutdown_connections 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.205+0000 7f94cd963e00 1 -- 10.20.193.4:0/731808161 wait complete. 2026-02-24T09:20:44.217 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.205+0000 7f94cd963e00 20 client.18474 trim_cache size 0 max 16384 2026-02-24T09:20:44.221 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.214+0000 7f94cd963e00 1 Processor -- start 2026-02-24T09:20:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.214+0000 7f94cd963e00 1 -- start start 2026-02-24T09:20:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.214+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527dac810 0x556527dea120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.214+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 0x556527dea660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.214+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527da64e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.214+0000 7f94cd963e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556527cabfe0 con 0x556527df1dc0 2026-02-24T09:20:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.214+0000 7f94cd963e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556527976fe0 con 0x556527dad120 2026-02-24T09:20:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.214+0000 7f94cd963e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556527d1c4c0 con 0x556527dac810 2026-02-24T09:20:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c8edd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 0x556527dea660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c8edd640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 0x556527dea660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:57064/0 (socket says 10.20.193.4:57064) 2026-02-24T09:20:44.222 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c8edd640 1 -- 10.20.193.4:0/1024160404 learned_addr learned my addr 10.20.193.4:0/1024160404 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c9edf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527da64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c96de640 1 --2- 10.20.193.4:0/1024160404 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527dac810 0x556527dea120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c9edf640 1 -- 10.20.193.4:0/1024160404 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527dac810 msgr2=0x556527dea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c9edf640 1 --2- 10.20.193.4:0/1024160404 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527dac810 0x556527dea120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c9edf640 1 -- 10.20.193.4:0/1024160404 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 msgr2=0x556527dea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c9edf640 1 --2- 10.20.193.4:0/1024160404 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 0x556527dea660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c9edf640 1 -- 10.20.193.4:0/1024160404 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556527c3e530 con 0x556527df1dc0 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94c9edf640 1 --2- 10.20.193.4:0/1024160404 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527da64e0 secure :-1 s=READY pgs=1368 gs=2 cs=0 l=1 c_cookie=9390761540969808229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94c00aa1e0 tx=0x7f94c000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8252afddfbe7c165 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94914e4640 1 -- 10.20.193.4:0/1024160404 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94c00b3930 con 0x556527df1dc0 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94914e4640 1 -- 10.20.193.4:0/1024160404 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f94c00b5f10 con 0x556527df1dc0 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94914e4640 1 -- 10.20.193.4:0/1024160404 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94c00aeb20 con 0x556527df1dc0 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94cd963e00 1 -- 10.20.193.4:0/1024160404 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 msgr2=0x556527da64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.223 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94cd963e00 1 --2- 10.20.193.4:0/1024160404 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527da64e0 secure :-1 s=READY pgs=1368 gs=2 cs=0 l=1 c_cookie=9390761540969808229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94c00aa1e0 tx=0x7f94c000cd80 comp rx=0 tx=0).stop 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94cd963e00 1 -- 10.20.193.4:0/1024160404 shutdown_connections 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94cd963e00 1 --2- 10.20.193.4:0/1024160404 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527da64e0 unknown :-1 s=CLOSED pgs=1368 gs=2 cs=0 l=1 c_cookie=9390761540969808229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94cd963e00 1 --2- 10.20.193.4:0/1024160404 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dad120 0x556527dea660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94cd963e00 1 --2- 10.20.193.4:0/1024160404 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527dac810 0x556527dea120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94cd963e00 1 -- 10.20.193.4:0/1024160404 >> 10.20.193.4:0/1024160404 conn(0x556527cc64f0 msgr2=0x556527dc0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94cd963e00 1 -- 10.20.193.4:0/1024160404 shutdown_connections 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.215+0000 7f94cd963e00 1 -- 10.20.193.4:0/1024160404 wait complete. 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94cd963e00 1 -- start start 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94cd963e00 1 Processor -- start 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dac810 0x556527dcc9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527dad120 0x556527dccf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.224 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94cd963e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527e372d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94cd963e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x556527e37810 con 0x556527df1dc0 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94cd963e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x556527e37980 con 0x556527dac810 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94cd963e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x556527e37b40 con 0x556527dad120 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94c9edf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527e372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94c9edf640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527e372d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51656/0 (socket says 10.20.193.4:51656) 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94c9edf640 1 -- 10.20.193.4:0/1095610655 learned_addr learned my addr 10.20.193.4:0/1095610655 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94c8edd640 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527dad120 0x556527dccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94c9edf640 1 -- 10.20.193.4:0/1095610655 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527dad120 msgr2=0x556527dccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94c9edf640 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527dad120 0x556527dccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94c9edf640 1 -- 10.20.193.4:0/1095610655 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dac810 msgr2=0x556527dcc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94c9edf640 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dac810 0x556527dcc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94c9edf640 1 -- 10.20.193.4:0/1095610655 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556527c32000 con 0x556527df1dc0 2026-02-24T09:20:44.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f94c9edf640 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527e372d0 secure :-1 s=READY pgs=1369 gs=1 cs=0 l=1 c_cookie=11543148337174873932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94c00d30f0 tx=0x7f94c00aa380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a031804122f3074c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f947effd640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f947effd640 1 -- 10.20.193.4:0/1095610655 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94c0072070 con 0x556527df1dc0 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.216+0000 7f947effd640 1 -- 10.20.193.4:0/1095610655 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f94c00ad7b0 con 0x556527df1dc0 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f947effd640 1 -- 10.20.193.4:0/1095610655 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94c00aeac0 con 0x556527df1dc0 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 1 -- 10.20.193.4:0/1095610655 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c41625f0 con 0x556527df1dc0 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f947effd640 1 -- 10.20.193.4:0/1095610655 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f94c0072da0 con 0x556527df1dc0 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f947effd640 10 client.18480 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 10 client.18480 _ll_register_callbacks cb 0x556527c2a790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 1 -- 10.20.193.4:0/1095610655 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5565279fd530 con 0x556527df1dc0 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f947effd640 1 -- 10.20.193.4:0/1095610655 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f94c00b3930 con 0x556527df1dc0 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 10 client.18480 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:44.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 1 -- 10.20.193.4:0/1095610655 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x556527c43d10 con 0x556527df1dc0 2026-02-24T09:20:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f947effd640 1 -- 10.20.193.4:0/1095610655 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f94c00abbf0 con 0x556527df1dc0 2026-02-24T09:20:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 10 client.18480 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 10 client.18480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 20 client.18480 populate_metadata read hostname 'trial004' 2026-02-24T09:20:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556527e9f930 0x556527ebfdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 4 client.18480 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-24T09:20:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.217+0000 7f94cd963e00 1 -- 10.20.193.4:0/1095610655 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556527cc07e0 con 0x556527e9f930 2026-02-24T09:20:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.218+0000 7f94c96de640 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556527e9f930 0x556527ebfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.218+0000 7f94c96de640 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556527e9f930 0x556527ebfdb0 crc :-1 s=READY pgs=238 gs=4 cs=0 l=0 c_cookie=14967591577674160176 s_cookie=8074916909596091016 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfb7913cfa659830 server_cookie=700fde2583452288 in_seq=0 out_seq=0 2026-02-24T09:20:44.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.218+0000 7f947effd640 10 client.18480 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f947effd640 1 -- 10.20.193.4:0/1095610655 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556527cc07e0 con 0x556527e9f930 2026-02-24T09:20:44.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f947effd640 10 client.18480 handle_command_reply: tid=0 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 client.18480 shutdown 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 -- 10.20.193.4:0/1095610655 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 msgr2=0x556527e372d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527e372d0 secure :-1 s=READY pgs=1369 gs=1 cs=0 l=1 c_cookie=11543148337174873932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94c00d30f0 tx=0x7f94c00aa380 comp rx=0 tx=0).stop 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 -- 10.20.193.4:0/1095610655 shutdown_connections 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x556527e9f930 0x556527ebfdb0 crc :-1 s=READY pgs=238 gs=4 cs=0 l=0 c_cookie=14967591577674160176 s_cookie=8074916909596091016 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x556527df1dc0 0x556527e372d0 unknown :-1 s=CLOSED pgs=1369 gs=1 cs=0 l=1 c_cookie=11543148337174873932 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f947effd640 0 client.18480 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x556527dad120 0x556527dccf00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 --2- 10.20.193.4:0/1095610655 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x556527dac810 0x556527dcc9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 -- 10.20.193.4:0/1095610655 >> 10.20.193.4:0/1095610655 conn(0x556527cc64f0 msgr2=0x556527dc15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.229 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 -- 10.20.193.4:0/1095610655 shutdown_connections 2026-02-24T09:20:44.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 1 -- 10.20.193.4:0/1095610655 wait complete. 2026-02-24T09:20:44.230 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cd963e00 20 client.18480 trim_cache size 0 max 16384 2026-02-24T09:20:44.230 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:20:44.230 INFO:teuthology.orchestra.run.trial004.stdout: "return_code": 0, 2026-02-24T09:20:44.230 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_tag": "a296d7a4-fbbb-44ef-bf0f-53257475ad3a", 2026-02-24T09:20:44.230 INFO:teuthology.orchestra.run.trial004.stdout: "mode": "asynchronous" 2026-02-24T09:20:44.230 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:20:44.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 -- 10.20.193.4:0/2474936103 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f94a00b5760 msgr2=0x7f94a00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f94a00b5760 0x7f94a00d5c10 secure :-1 s=READY pgs=469 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b40098a0 tx=0x7f94b4031040 comp rx=0 tx=0).stop 2026-02-24T09:20:44.231 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 -- 10.20.193.4:0/2474936103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f94c4113200 msgr2=0x7f94c41212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f94c4113200 0x7f94c41212c0 secure :-1 s=READY pgs=1365 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94c0006e90 tx=0x7f94c000edf0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 -- 10.20.193.4:0/2474936103 shutdown_connections 2026-02-24T09:20:44.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f94a00b5760 0x7f94a00d5c10 unknown :-1 s=CLOSED pgs=469 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f94c4113200 0x7f94c41212c0 unknown :-1 s=CLOSED pgs=1365 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c410da00 0x7f94c411bef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 --2- 10.20.193.4:0/2474936103 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f94c410d010 0x7f94c411b9b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 -- 10.20.193.4:0/2474936103 >> 10.20.193.4:0/2474936103 conn(0x7f94c405f830 msgr2=0x7f94c410ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 -- 10.20.193.4:0/2474936103 shutdown_connections 2026-02-24T09:20:44.232 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.219+0000 7f94cb969640 1 -- 10.20.193.4:0/2474936103 wait complete. 2026-02-24T09:20:44.275 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2026-02-24T09:20:44.275 DEBUG:teuthology.orchestra.run.trial004:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-24T09:20:44.292 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:20:44.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:43 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/885899222' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:44.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:43 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/885899222' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:44.508 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:44.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.659+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2551784704 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6ca81135c0 msgr2=0x7f6ca8173f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.659+0000 7f6cb00f3640 1 --2- 10.20.193.4:0/2551784704 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6ca81135c0 0x7f6ca8173f90 secure :-1 s=READY pgs=1370 gs=1 cs=0 l=1 c_cookie=307563679152217761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca400aa30 tx=0x7f6ca4030280 comp rx=0 tx=0).stop 2026-02-24T09:20:44.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.659+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2551784704 shutdown_connections 2026-02-24T09:20:44.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.659+0000 7f6cb00f3640 1 --2- 10.20.193.4:0/2551784704 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6ca81135c0 0x7f6ca8173f90 unknown :-1 s=CLOSED pgs=1370 gs=1 cs=0 l=1 c_cookie=307563679152217761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.659+0000 7f6cb00f3640 1 --2- 10.20.193.4:0/2551784704 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ca810ddc0 0x7f6ca8112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.664 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.659+0000 7f6cb00f3640 1 --2- 10.20.193.4:0/2551784704 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6ca810d3d0 0x7f6ca810d7a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.659+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2551784704 >> 10.20.193.4:0/2551784704 conn(0x7f6ca80eaca0 msgr2=0x7f6ca810b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.659+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2551784704 shutdown_connections 2026-02-24T09:20:44.665 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.659+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2551784704 wait complete. 2026-02-24T09:20:44.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cb00f3640 1 Processor -- start 2026-02-24T09:20:44.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cb00f3640 1 -- start start 2026-02-24T09:20:44.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cb00f3640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6ca810d3d0 0x7f6ca811bc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cb00f3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6ca810ddc0 0x7f6ca811c170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.666 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cb00f3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ca81135c0 0x7f6ca8121540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cb00f3640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8121b60 con 0x7f6ca810ddc0 2026-02-24T09:20:44.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cb00f3640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8121cd0 con 0x7f6ca810d3d0 2026-02-24T09:20:44.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cb00f3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8121e90 con 0x7f6ca81135c0 2026-02-24T09:20:44.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cade68640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6ca810d3d0 0x7f6ca811bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cae669640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ca81135c0 0x7f6ca8121540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cae669640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ca81135c0 0x7f6ca8121540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.4:33362/0 (socket says 10.20.193.4:33362) 2026-02-24T09:20:44.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cade68640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6ca810d3d0 0x7f6ca811bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.14:3300/0 says I am v2:10.20.193.4:57088/0 (socket says 10.20.193.4:57088) 2026-02-24T09:20:44.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.660+0000 7f6cae669640 1 -- 10.20.193.4:0/2419395781 learned_addr learned my addr 10.20.193.4:0/2419395781 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.661+0000 7f6cad667640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6ca810ddc0 0x7f6ca811c170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.667 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.661+0000 7f6cae669640 1 -- 10.20.193.4:0/2419395781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6ca810d3d0 msgr2=0x7f6ca811bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.661+0000 7f6cae669640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6ca810d3d0 0x7f6ca811bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.661+0000 7f6cae669640 1 -- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6ca810ddc0 msgr2=0x7f6ca811c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.661+0000 7f6cae669640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6ca810ddc0 0x7f6ca811c170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.661+0000 7f6cae669640 1 -- 10.20.193.4:0/2419395781 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca400a650 con 0x7f6ca81135c0 2026-02-24T09:20:44.668 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.661+0000 7f6cad667640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6ca810ddc0 0x7f6ca811c170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:44.669 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.663+0000 7f6cae669640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ca81135c0 0x7f6ca8121540 secure :-1 s=READY pgs=125 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca400a330 tx=0x7f6ca40039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.665+0000 7f6c96ffd640 1 -- 10.20.193.4:0/2419395781 <== mon.1 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ca403e070 con 0x7f6ca81135c0 2026-02-24T09:20:44.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.665+0000 7f6c96ffd640 1 -- 10.20.193.4:0/2419395781 <== mon.1 v2:10.20.193.90:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6ca40055a0 con 0x7f6ca81135c0 2026-02-24T09:20:44.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.665+0000 7f6c96ffd640 1 -- 10.20.193.4:0/2419395781 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ca4042910 con 0x7f6ca81135c0 2026-02-24T09:20:44.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.665+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2419395781 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca8122110 con 0x7f6ca81135c0 2026-02-24T09:20:44.670 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.666+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2419395781 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca81626d0 con 0x7f6ca81135c0 2026-02-24T09:20:44.680 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.675+0000 7f6c96ffd640 1 -- 10.20.193.4:0/2419395781 <== mon.1 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f6ca40050c0 con 0x7f6ca81135c0 2026-02-24T09:20:44.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.678+0000 7f6c96ffd640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c840b5760 0x7f6c840d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.683 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.679+0000 7f6c96ffd640 1 -- 10.20.193.4:0/2419395781 <== mon.1 v2:10.20.193.90:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6ca410c8a0 con 0x7f6ca81135c0 2026-02-24T09:20:44.684 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.679+0000 7f6cade68640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c840b5760 0x7f6c840d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.684 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.679+0000 7f6cade68640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c840b5760 0x7f6c840d5c10 secure :-1 s=READY pgs=470 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c98004740 tx=0x7f6c98009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.685 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.680+0000 7f6cb20ede00 1 Processor -- start 2026-02-24T09:20:44.685 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.680+0000 7f6cb20ede00 1 -- start start 2026-02-24T09:20:44.687 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 0x564cbd4f3bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.687 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd538890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.687 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd5591b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.687 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564cbd403de0 con 0x564cbd4f4130 2026-02-24T09:20:44.687 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564cbd3ffb10 con 0x564cbd538dd0 2026-02-24T09:20:44.687 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564cbd3f9ab0 con 0x564cbd4f3820 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cad667640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd538890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cad667640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd538890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51692/0 (socket says 10.20.193.4:51692) 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cad667640 1 -- 10.20.193.4:0/727815042 learned_addr learned my addr 10.20.193.4:0/727815042 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cade68640 1 --2- 10.20.193.4:0/727815042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 0x564cbd4f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cae669640 1 --2- 10.20.193.4:0/727815042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd5591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cad667640 1 -- 10.20.193.4:0/727815042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 msgr2=0x564cbd4f3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cad667640 1 --2- 10.20.193.4:0/727815042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 0x564cbd4f3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cad667640 1 -- 10.20.193.4:0/727815042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 msgr2=0x564cbd5591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cad667640 1 --2- 10.20.193.4:0/727815042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd5591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cad667640 1 -- 10.20.193.4:0/727815042 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cbd3a5310 con 0x564cbd4f4130 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6cad667640 1 --2- 10.20.193.4:0/727815042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd538890 secure :-1 s=READY pgs=1371 gs=1 cs=0 l=1 c_cookie=7865424518774832989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9c00fa70 tx=0x7f6c9c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2799ed5138bf5d server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.688 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6c764e6640 1 -- 10.20.193.4:0/727815042 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9c01a410 con 0x564cbd4f4130 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6c764e6640 1 -- 10.20.193.4:0/727815042 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c9c015050 con 0x564cbd4f4130 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.681+0000 7f6c764e6640 1 -- 10.20.193.4:0/727815042 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9c009ae0 con 0x564cbd4f4130 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.682+0000 7f6cb20ede00 1 -- 10.20.193.4:0/727815042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 msgr2=0x564cbd538890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.682+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/727815042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd538890 secure :-1 s=READY pgs=1371 gs=1 cs=0 l=1 c_cookie=7865424518774832989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9c00fa70 tx=0x7f6c9c005f90 comp rx=0 tx=0).stop 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.682+0000 7f6cb20ede00 1 -- 10.20.193.4:0/727815042 shutdown_connections 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.682+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/727815042 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd5591b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.682+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/727815042 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd538890 unknown :-1 s=CLOSED pgs=1371 gs=1 cs=0 l=1 c_cookie=7865424518774832989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.682+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/727815042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 0x564cbd4f3bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.682+0000 7f6cb20ede00 1 -- 10.20.193.4:0/727815042 >> 10.20.193.4:0/727815042 conn(0x564cbd4126b0 msgr2=0x564cbd4f2100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.682+0000 7f6cb20ede00 1 -- 10.20.193.4:0/727815042 shutdown_connections 2026-02-24T09:20:44.689 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.682+0000 7f6cb20ede00 1 -- 10.20.193.4:0/727815042 wait complete. 2026-02-24T09:20:44.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cb20ede00 1 -- start start 2026-02-24T09:20:44.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cb20ede00 1 Processor -- start 2026-02-24T09:20:44.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd4f3820 0x564cbd50bdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.692 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f4130 0x564cbd50c300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd538dd0 0x564cbd5112f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564cbd511830 con 0x564cbd538dd0 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564cbd5119a0 con 0x564cbd4f3820 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564cbd511b60 con 0x564cbd4f4130 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cae669640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd538dd0 0x564cbd5112f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cae669640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd538dd0 0x564cbd5112f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51700/0 (socket says 10.20.193.4:51700) 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cae669640 1 -- 10.20.193.4:0/1091681347 learned_addr learned my addr 10.20.193.4:0/1091681347 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.684+0000 7f6cade68640 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd4f3820 0x564cbd50bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cad667640 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f4130 0x564cbd50c300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cae669640 1 -- 10.20.193.4:0/1091681347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f4130 msgr2=0x564cbd50c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cae669640 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f4130 0x564cbd50c300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.693 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cae669640 1 -- 10.20.193.4:0/1091681347 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd4f3820 msgr2=0x564cbd50bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cae669640 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd4f3820 0x564cbd50bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cae669640 1 -- 10.20.193.4:0/1091681347 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cbd37d8c0 con 0x564cbd538dd0 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cad667640 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f4130 0x564cbd50c300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cae669640 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd538dd0 0x564cbd5112f0 secure :-1 s=READY pgs=1372 gs=1 cs=0 l=1 c_cookie=10204859205747787225 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca400a980 tx=0x7f6ca400a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9ef1614578c5d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6c637fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6c637fe640 1 -- 10.20.193.4:0/1091681347 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ca40d35d0 con 0x564cbd538dd0 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cb20ede00 1 -- 10.20.193.4:0/1091681347 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c9c0044c0 con 0x564cbd538dd0 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6c637fe640 1 -- 10.20.193.4:0/1091681347 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6ca40d88f0 con 0x564cbd538dd0 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6c637fe640 1 -- 10.20.193.4:0/1091681347 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ca40d3ae0 con 0x564cbd538dd0 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cb20ede00 10 client.18492 _ll_register_callbacks cb 0x564cbd395160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cb20ede00 1 -- 10.20.193.4:0/1091681347 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564cbd1494a0 con 0x564cbd538dd0 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6c637fe640 1 -- 10.20.193.4:0/1091681347 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6ca40d0bb0 con 0x564cbd538dd0 2026-02-24T09:20:44.694 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6c637fe640 1 -- 10.20.193.4:0/1091681347 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6ca40d0db0 con 0x564cbd538dd0 2026-02-24T09:20:44.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cb20ede00 10 client.18492 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:44.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.685+0000 7f6cb20ede00 1 -- 10.20.193.4:0/1091681347 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564cbd38f6e0 con 0x564cbd538dd0 2026-02-24T09:20:44.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.686+0000 7f6c637fe640 1 -- 10.20.193.4:0/1091681347 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6ca40d45c0 con 0x564cbd538dd0 2026-02-24T09:20:44.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.686+0000 7f6cb20ede00 10 client.18492 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:44.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.686+0000 7f6cb20ede00 10 client.18492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:44.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.686+0000 7f6cb20ede00 20 client.18492 populate_metadata read hostname 'trial004' 2026-02-24T09:20:44.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.686+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564cbd536380 0x564cbd536820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.686+0000 7f6cb20ede00 4 client.18492 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:44.695 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.686+0000 7f6cb20ede00 1 -- 10.20.193.4:0/1091681347 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cbd3ef4f0 con 0x564cbd536380 2026-02-24T09:20:44.696 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.690+0000 7f6cade68640 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564cbd536380 0x564cbd536820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.696+0000 7f6c637fe640 10 client.18492 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.699 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.696+0000 7f6cade68640 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564cbd536380 0x564cbd536820 crc :-1 s=READY pgs=239 gs=4 cs=0 l=0 c_cookie=7003569031657238808 s_cookie=9942510388421097093 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6131aced83db3118 server_cookie=89fae48545787685 in_seq=0 out_seq=0 2026-02-24T09:20:44.700 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.696+0000 7f6c637fe640 1 -- 10.20.193.4:0/1091681347 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x564cbd3ef4f0 con 0x564cbd536380 2026-02-24T09:20:44.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.696+0000 7f6c637fe640 10 client.18492 handle_command_reply: tid=0 2026-02-24T09:20:44.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.696+0000 7f6cb20ede00 1 client.18492 shutdown 2026-02-24T09:20:44.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 1 -- 10.20.193.4:0/1091681347 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd538dd0 msgr2=0x564cbd5112f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd538dd0 0x564cbd5112f0 secure :-1 s=READY pgs=1372 gs=1 cs=0 l=1 c_cookie=10204859205747787225 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca400a980 tx=0x7f6ca400a390 comp rx=0 tx=0).stop 2026-02-24T09:20:44.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 1 -- 10.20.193.4:0/1091681347 shutdown_connections 2026-02-24T09:20:44.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564cbd536380 0x564cbd536820 crc :-1 s=READY pgs=239 gs=4 cs=0 l=0 c_cookie=7003569031657238808 s_cookie=9942510388421097093 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd538dd0 0x564cbd5112f0 unknown :-1 s=CLOSED pgs=1372 gs=1 cs=0 l=1 c_cookie=10204859205747787225 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f4130 0x564cbd50c300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/1091681347 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd4f3820 0x564cbd50bdc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.701 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6c637fe640 0 client.18492 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 1 -- 10.20.193.4:0/1091681347 >> 10.20.193.4:0/1091681347 conn(0x564cbd4126b0 msgr2=0x564cbd4f2810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 1 -- 10.20.193.4:0/1091681347 shutdown_connections 2026-02-24T09:20:44.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 1 -- 10.20.193.4:0/1091681347 wait complete. 2026-02-24T09:20:44.702 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.697+0000 7f6cb20ede00 20 client.18492 trim_cache size 0 max 16384 2026-02-24T09:20:44.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cb20ede00 1 Processor -- start 2026-02-24T09:20:44.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cb20ede00 1 -- start start 2026-02-24T09:20:44.719 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f3820 0x564cbd537100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f4130 0x564cbd537640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd537b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564cbd3f76e0 con 0x564cbd4f3820 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564cbd0c2f50 con 0x564cbd538dd0 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564cbd4f4500 con 0x564cbd4f4130 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cade68640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f3820 0x564cbd537100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cade68640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f3820 0x564cbd537100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51708/0 (socket says 10.20.193.4:51708) 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cade68640 1 -- 10.20.193.4:0/3055938448 learned_addr learned my addr 10.20.193.4:0/3055938448 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cade68640 1 -- 10.20.193.4:0/3055938448 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f4130 msgr2=0x564cbd537640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cade68640 1 --2- 10.20.193.4:0/3055938448 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f4130 0x564cbd537640 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.720 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cade68640 1 -- 10.20.193.4:0/3055938448 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 msgr2=0x564cbd537b80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-24T09:20:44.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cade68640 1 --2- 10.20.193.4:0/3055938448 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd537b80 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cade68640 1 -- 10.20.193.4:0/3055938448 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cbd38a160 con 0x564cbd4f3820 2026-02-24T09:20:44.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.715+0000 7f6cade68640 1 --2- 10.20.193.4:0/3055938448 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f3820 0x564cbd537100 secure :-1 s=READY pgs=1373 gs=1 cs=0 l=1 c_cookie=16067591960713819888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c98009ec0 tx=0x7f6c98004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defb8dc22e44f6f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.716+0000 7f6c75ce5640 1 -- 10.20.193.4:0/3055938448 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c98027070 con 0x564cbd4f3820 2026-02-24T09:20:44.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.716+0000 7f6c75ce5640 1 -- 10.20.193.4:0/3055938448 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c98022440 con 0x564cbd4f3820 2026-02-24T09:20:44.721 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.716+0000 7f6c75ce5640 1 -- 10.20.193.4:0/3055938448 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c98014660 con 0x564cbd4f3820 2026-02-24T09:20:44.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.717+0000 7f6cb20ede00 1 -- 10.20.193.4:0/3055938448 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f3820 msgr2=0x564cbd537100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.717+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/3055938448 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f3820 0x564cbd537100 secure :-1 s=READY pgs=1373 gs=1 cs=0 l=1 c_cookie=16067591960713819888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c98009ec0 tx=0x7f6c98004650 comp rx=0 tx=0).stop 2026-02-24T09:20:44.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.717+0000 7f6cb20ede00 1 -- 10.20.193.4:0/3055938448 shutdown_connections 2026-02-24T09:20:44.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.717+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/3055938448 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd537b80 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.717+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/3055938448 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f4130 0x564cbd537640 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.717+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/3055938448 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f3820 0x564cbd537100 unknown :-1 s=CLOSED pgs=1373 gs=1 cs=0 l=1 c_cookie=16067591960713819888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.717+0000 7f6cb20ede00 1 -- 10.20.193.4:0/3055938448 >> 10.20.193.4:0/3055938448 conn(0x564cbd4126b0 msgr2=0x564cbd4f1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.717+0000 7f6cb20ede00 1 -- 10.20.193.4:0/3055938448 shutdown_connections 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.717+0000 7f6cb20ede00 1 -- 10.20.193.4:0/3055938448 wait complete. 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.718+0000 7f6cb20ede00 1 -- start start 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.718+0000 7f6cb20ede00 1 Processor -- start 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.718+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 0x564cbd515f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.718+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd516470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.718+0000 7f6cb20ede00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd59e300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.718+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x564cbd516c30 con 0x564cbd4f4130 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.718+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x564cbd59e870 con 0x564cbd538dd0 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.718+0000 7f6cb20ede00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x564cbd59ea30 con 0x564cbd4f3820 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cad667640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd516470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cad667640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd516470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51716/0 (socket says 10.20.193.4:51716) 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cad667640 1 -- 10.20.193.4:0/394816211 learned_addr learned my addr 10.20.193.4:0/394816211 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cae669640 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd59e300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cade68640 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 0x564cbd515f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cad667640 1 -- 10.20.193.4:0/394816211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 msgr2=0x564cbd515f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cad667640 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 0x564cbd515f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cad667640 1 -- 10.20.193.4:0/394816211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 msgr2=0x564cbd59e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cad667640 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd59e300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cad667640 1 -- 10.20.193.4:0/394816211 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cbd37dbf0 con 0x564cbd4f4130 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cade68640 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 0x564cbd515f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cad667640 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd516470 secure :-1 s=READY pgs=1374 gs=1 cs=0 l=1 c_cookie=9734456590973384172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x564cbd512380 tx=0x7f6c9c005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8717bcb1b26db5ec server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6c637fe640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:44.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6c637fe640 1 -- 10.20.193.4:0/394816211 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9c004000 con 0x564cbd4f4130 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cb20ede00 1 -- 10.20.193.4:0/394816211 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c98009c40 con 0x564cbd4f4130 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6c637fe640 1 -- 10.20.193.4:0/394816211 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c9c029070 con 0x564cbd4f4130 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6c637fe640 1 -- 10.20.193.4:0/394816211 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9c004960 con 0x564cbd4f4130 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cb20ede00 10 client.18498 _ll_register_callbacks cb 0x564cbd395160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cb20ede00 1 -- 10.20.193.4:0/394816211 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564cbd084f40 con 0x564cbd4f4130 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6c637fe640 1 -- 10.20.193.4:0/394816211 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f6c9c004af0 con 0x564cbd4f4130 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6c637fe640 1 -- 10.20.193.4:0/394816211 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6c9c004cb0 con 0x564cbd4f4130 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cb20ede00 10 client.18498 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.719+0000 7f6cb20ede00 1 -- 10.20.193.4:0/394816211 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x564cbd38f940 con 0x564cbd4f4130 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.720+0000 7f6c637fe640 1 -- 10.20.193.4:0/394816211 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f6c9c00e760 con 0x564cbd4f4130 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.720+0000 7f6cb20ede00 10 client.18498 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:44.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.720+0000 7f6cb20ede00 10 client.18498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.720+0000 7f6cb20ede00 20 client.18498 populate_metadata read hostname 'trial004' 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.720+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564cbd5e67b0 0x564cbd606c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.720+0000 7f6cb20ede00 4 client.18498 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.720+0000 7f6cb20ede00 1 -- 10.20.193.4:0/394816211 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f6c9c015050 con 0x564cbd5e67b0 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.720+0000 7f6cade68640 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564cbd5e67b0 0x564cbd606c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6c637fe640 10 client.18498 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cade68640 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564cbd5e67b0 0x564cbd606c60 crc :-1 s=READY pgs=240 gs=4 cs=0 l=0 c_cookie=1771703776074370808 s_cookie=13622570955751693108 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18965b328c218ef8 server_cookie=bd0d181bd9221b34 in_seq=0 out_seq=0 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6c637fe640 1 -- 10.20.193.4:0/394816211 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6534 (crc 0 0 0) 0x7f6c9c015050 con 0x564cbd5e67b0 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6c637fe640 10 client.18498 handle_command_reply: tid=0 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 client.18498 shutdown 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 -- 10.20.193.4:0/394816211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 msgr2=0x564cbd516470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd516470 secure :-1 s=READY pgs=1374 gs=1 cs=0 l=1 c_cookie=9734456590973384172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x564cbd512380 tx=0x7f6c9c005820 comp rx=0 tx=0).stop 2026-02-24T09:20:44.729 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 -- 10.20.193.4:0/394816211 shutdown_connections 2026-02-24T09:20:44.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x564cbd5e67b0 0x564cbd606c60 crc :-1 s=READY pgs=240 gs=4 cs=0 l=0 c_cookie=1771703776074370808 s_cookie=13622570955751693108 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x564cbd538dd0 0x564cbd59e300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x564cbd4f4130 0x564cbd516470 unknown :-1 s=CLOSED pgs=1374 gs=1 cs=0 l=1 c_cookie=9734456590973384172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6c637fe640 0 client.18498 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:44.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 --2- 10.20.193.4:0/394816211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x564cbd4f3820 0x564cbd515f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 -- 10.20.193.4:0/394816211 >> 10.20.193.4:0/394816211 conn(0x564cbd4126b0 msgr2=0x564cbd4f21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 -- 10.20.193.4:0/394816211 shutdown_connections 2026-02-24T09:20:44.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 1 -- 10.20.193.4:0/394816211 wait complete. 2026-02-24T09:20:44.730 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.721+0000 7f6cb20ede00 20 client.18498 trim_cache size 0 max 16384 2026-02-24T09:20:44.731 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:20:44.731 INFO:teuthology.orchestra.run.trial004.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-24T09:20:44.731 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": { 2026-02-24T09:20:44.731 INFO:teuthology.orchestra.run.trial004.stdout: "a296d7a4-fbbb-44ef-bf0f-53257475ad3a": { 2026-02-24T09:20:44.731 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.731 INFO:teuthology.orchestra.run.trial004.stdout: "tag": "a296d7a4-fbbb-44ef-bf0f-53257475ad3a", 2026-02-24T09:20:44.731 INFO:teuthology.orchestra.run.trial004.stdout: "options": "recursive,force" 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: "50fcb56c-a674-4f78-aafd-69881ffc04d0": { 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:02.417630+0000", 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.732 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "a296d7a4-fbbb-44ef-bf0f-53257475ad3a": { 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:20:44.219717+0000", 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "b703ea3c-d980-4a3f-b2c3-714d8f9ad80d": { 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:58.321748+0000", 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.733 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.734 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.735 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:20:44.736 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "7f3fcd8b-96a7-4762-a5be-feb95dd814b9": { 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:20:10.919666+0000", 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.737 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.738 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.739 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.740 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.741 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.742 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.743 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "02c4bb30-7b42-4907-8bbf-d28c355c477b": { 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:36.960639+0000", 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.744 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:20:44.745 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:20:44.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c840b5760 msgr2=0x7f6c840d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c840b5760 0x7f6c840d5c10 secure :-1 s=READY pgs=470 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c98004740 tx=0x7f6c98009190 comp rx=0 tx=0).stop 2026-02-24T09:20:44.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2419395781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ca81135c0 msgr2=0x7f6ca8121540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:44.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ca81135c0 0x7f6ca8121540 secure :-1 s=READY pgs=125 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca400a330 tx=0x7f6ca40039b0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2419395781 shutdown_connections 2026-02-24T09:20:44.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f6c840b5760 0x7f6c840d5c10 unknown :-1 s=CLOSED pgs=470 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ca81135c0 0x7f6ca8121540 unknown :-1 s=CLOSED pgs=125 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f6ca810ddc0 0x7f6ca811c170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 --2- 10.20.193.4:0/2419395781 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f6ca810d3d0 0x7f6ca811bc30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:44.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2419395781 >> 10.20.193.4:0/2419395781 conn(0x7f6ca80eaca0 msgr2=0x7f6ca810b080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:44.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2419395781 shutdown_connections 2026-02-24T09:20:44.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:44.722+0000 7f6cb00f3640 1 -- 10.20.193.4:0/2419395781 wait complete. 2026-02-24T09:20:44.763 DEBUG:teuthology.parallel:result is None 2026-02-24T09:20:44.764 DEBUG:teuthology.orchestra.run.trial004:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T09:20:44.809 INFO:tasks.cephfs.filesystem:scrub status for tag:a296d7a4-fbbb-44ef-bf0f-53257475ad3a - {'path': '/', 'tag': 'a296d7a4-fbbb-44ef-bf0f-53257475ad3a', 'options': 'recursive,force'} 2026-02-24T09:20:44.814 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T09:20:44.814 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2026-02-24T09:20:44.832 INFO:tasks.quiescer:joining Quiescers 2026-02-24T09:20:44.832 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2026-02-24T09:20:44.832 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:20:45.044 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:45.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.153+0000 7ff154984640 1 -- 10.20.193.4:0/1974940174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff1501157f0 msgr2=0x7ff1501761c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.153+0000 7ff154984640 1 --2- 10.20.193.4:0/1974940174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff1501157f0 0x7ff1501761c0 secure :-1 s=READY pgs=1375 gs=1 cs=0 l=1 c_cookie=13257756374819307740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff14000aa30 tx=0x7ff140030280 comp rx=0 tx=0).stop 2026-02-24T09:20:45.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.153+0000 7ff154984640 1 -- 10.20.193.4:0/1974940174 shutdown_connections 2026-02-24T09:20:45.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.153+0000 7ff154984640 1 --2- 10.20.193.4:0/1974940174 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff1501157f0 0x7ff1501761c0 unknown :-1 s=CLOSED pgs=1375 gs=1 cs=0 l=1 c_cookie=13257756374819307740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.153+0000 7ff154984640 1 --2- 10.20.193.4:0/1974940174 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff15010fff0 0x7ff150115040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.153+0000 7ff154984640 1 --2- 10.20.193.4:0/1974940174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff15010f600 0x7ff15010f9d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.153+0000 7ff154984640 1 -- 10.20.193.4:0/1974940174 >> 10.20.193.4:0/1974940174 conn(0x7ff1500ecef0 msgr2=0x7ff15010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:45.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.153+0000 7ff154984640 1 -- 10.20.193.4:0/1974940174 shutdown_connections 2026-02-24T09:20:45.157 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.153+0000 7ff154984640 1 -- 10.20.193.4:0/1974940174 wait complete. 2026-02-24T09:20:45.157 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:44 trial004 ceph-mon[41596]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 557 MiB/s wr, 152 op/s 2026-02-24T09:20:45.157 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:44 trial004 ceph-mon[41596]: scrub queued for path: / 2026-02-24T09:20:45.158 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:44 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:45.158 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:44 trial004 ceph-mon[41596]: scrub summary: active paths [/] 2026-02-24T09:20:45.158 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:44 trial004 ceph-mon[41596]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:45.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff154984640 1 Processor -- start 2026-02-24T09:20:45.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff154984640 1 -- start start 2026-02-24T09:20:45.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff154984640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff15010f600 0x7ff1500f5810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff154984640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff15010fff0 0x7ff1501760c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff154984640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff1501157f0 0x7ff1500f5f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff154984640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff1500fb120 con 0x7ff15010fff0 2026-02-24T09:20:45.158 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff154984640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff1500fb290 con 0x7ff1501157f0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff154984640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff1500fb450 con 0x7ff15010f600 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff15010fff0 0x7ff1501760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14e575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff15010fff0 0x7ff1501760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51742/0 (socket says 10.20.193.4:51742) 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14e575640 1 -- 10.20.193.4:0/4203813180 learned_addr learned my addr 10.20.193.4:0/4203813180 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14ed76640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff15010f600 0x7ff1500f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14f577640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff1501157f0 0x7ff1500f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14e575640 1 -- 10.20.193.4:0/4203813180 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff15010f600 msgr2=0x7ff1500f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14e575640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff15010f600 0x7ff1500f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14e575640 1 -- 10.20.193.4:0/4203813180 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff1501157f0 msgr2=0x7ff1500f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14e575640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff1501157f0 0x7ff1500f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14e575640 1 -- 10.20.193.4:0/4203813180 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14000a650 con 0x7ff15010fff0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff14e575640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff15010fff0 0x7ff1501760c0 secure :-1 s=READY pgs=1376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff13800b500 tx=0x7ff13800b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff12ffff640 1 -- 10.20.193.4:0/4203813180 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1380044a0 con 0x7ff15010fff0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff12ffff640 1 -- 10.20.193.4:0/4203813180 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff138002b80 con 0x7ff15010fff0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff154984640 1 -- 10.20.193.4:0/4203813180 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1500fb730 con 0x7ff15010fff0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff12ffff640 1 -- 10.20.193.4:0/4203813180 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff13800fd90 con 0x7ff15010fff0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.154+0000 7ff154984640 1 -- 10.20.193.4:0/4203813180 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1500fbc50 con 0x7ff15010fff0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.155+0000 7ff154984640 1 -- 10.20.193.4:0/4203813180 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1501108e0 con 0x7ff15010fff0 2026-02-24T09:20:45.159 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.156+0000 7ff12ffff640 1 -- 10.20.193.4:0/4203813180 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff1380026a0 con 0x7ff15010fff0 2026-02-24T09:20:45.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.157+0000 7ff12ffff640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff1200b5750 0x7ff1200d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.157+0000 7ff12ffff640 1 -- 10.20.193.4:0/4203813180 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff1380e6800 con 0x7ff15010fff0 2026-02-24T09:20:45.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.157+0000 7ff14ed76640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff1200b5750 0x7ff1200d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.157+0000 7ff14ed76640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff1200b5750 0x7ff1200d5c00 secure :-1 s=READY pgs=471 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff144004740 tx=0x7ff144004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:45.160 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.157+0000 7ff12ffff640 1 -- 10.20.193.4:0/4203813180 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff1380a91c0 con 0x7ff15010fff0 2026-02-24T09:20:45.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.291+0000 7ff154984640 1 -- 10.20.193.4:0/4203813180 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1500f6970 con 0x7ff15010fff0 2026-02-24T09:20:45.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.291+0000 7ff12ffff640 1 -- 10.20.193.4:0/4203813180 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7ff138016310 con 0x7ff15010fff0 2026-02-24T09:20:45.296 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:20:45.296 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:20:45.297 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:20:45.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 -- 10.20.193.4:0/4203813180 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff1200b5750 msgr2=0x7ff1200d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff1200b5750 0x7ff1200d5c00 secure :-1 s=READY pgs=471 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff144004740 tx=0x7ff144004420 comp rx=0 tx=0).stop 2026-02-24T09:20:45.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 -- 10.20.193.4:0/4203813180 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff15010fff0 msgr2=0x7ff1501760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff15010fff0 0x7ff1501760c0 secure :-1 s=READY pgs=1376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff13800b500 tx=0x7ff13800b9d0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 -- 10.20.193.4:0/4203813180 shutdown_connections 2026-02-24T09:20:45.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff1200b5750 0x7ff1200d5c00 unknown :-1 s=CLOSED pgs=471 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff1501157f0 0x7ff1500f5f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff15010fff0 0x7ff1501760c0 unknown :-1 s=CLOSED pgs=1376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 --2- 10.20.193.4:0/4203813180 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff15010f600 0x7ff1500f5810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 -- 10.20.193.4:0/4203813180 >> 10.20.193.4:0/4203813180 conn(0x7ff1500ecef0 msgr2=0x7ff150111e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:45.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 -- 10.20.193.4:0/4203813180 shutdown_connections 2026-02-24T09:20:45.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.292+0000 7ff154984640 1 -- 10.20.193.4:0/4203813180 wait complete. 2026-02-24T09:20:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:44 trial090 ceph-mon[47278]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 557 MiB/s wr, 152 op/s 2026-02-24T09:20:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:44 trial090 ceph-mon[47278]: scrub queued for path: / 2026-02-24T09:20:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:44 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:45.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:44 trial090 ceph-mon[47278]: scrub summary: active paths [/] 2026-02-24T09:20:45.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:44 trial090 ceph-mon[47278]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:45.335 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24637 quiesce db --cancel --all' 2026-02-24T09:20:45.335 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- timeout 105 ceph tell mds.24637 quiesce db --cancel --all 2026-02-24T09:20:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:44 trial014 ceph-mon[46941]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 8.6 KiB/s rd, 557 MiB/s wr, 152 op/s 2026-02-24T09:20:45.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:44 trial014 ceph-mon[46941]: scrub queued for path: / 2026-02-24T09:20:45.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:44 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:45.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:44 trial014 ceph-mon[46941]: scrub summary: active paths [/] 2026-02-24T09:20:45.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:44 trial014 ceph-mon[46941]: scrub summary: idle+waiting paths [/] 2026-02-24T09:20:45.450 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.552+0000 7f82a253c640 1 -- 10.20.193.4:0/851722391 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829c1100b0 msgr2=0x7f829c115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.552+0000 7f82a253c640 1 --2- 10.20.193.4:0/851722391 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829c1100b0 0x7f829c115100 secure :-1 s=READY pgs=1377 gs=1 cs=0 l=1 c_cookie=15997223707403316451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c009950 tx=0x7f828c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.552+0000 7f82a253c640 1 -- 10.20.193.4:0/851722391 shutdown_connections 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.552+0000 7f82a253c640 1 --2- 10.20.193.4:0/851722391 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829c1158b0 0x7f829c176280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.552+0000 7f82a253c640 1 --2- 10.20.193.4:0/851722391 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829c1100b0 0x7f829c115100 unknown :-1 s=CLOSED pgs=1377 gs=1 cs=0 l=1 c_cookie=15997223707403316451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.552+0000 7f82a253c640 1 --2- 10.20.193.4:0/851722391 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829c10f6c0 0x7f829c10fa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.552+0000 7f82a253c640 1 -- 10.20.193.4:0/851722391 >> 10.20.193.4:0/851722391 conn(0x7f829c0ecfd0 msgr2=0x7f829c10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.552+0000 7f82a253c640 1 -- 10.20.193.4:0/851722391 shutdown_connections 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.552+0000 7f82a253c640 1 -- 10.20.193.4:0/851722391 wait complete. 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a253c640 1 Processor -- start 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a253c640 1 -- start start 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a253c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829c10f6c0 0x7f829c0f5a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a253c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829c1100b0 0x7f829c176180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a253c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829c1158b0 0x7f829c0f6100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a253c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f829c0fb310 con 0x7f829c10f6c0 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a253c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f829c0fb480 con 0x7f829c1100b0 2026-02-24T09:20:45.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a253c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f829c0fb640 con 0x7f829c1158b0 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f829bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829c10f6c0 0x7f829c0f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f829bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829c10f6c0 0x7f829c0f5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51758/0 (socket says 10.20.193.4:51758) 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f829bfff640 1 -- 10.20.193.4:0/3221767261 learned_addr learned my addr 10.20.193.4:0/3221767261 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a0ab2640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829c1158b0 0x7f829c0f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f829b7fe640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829c1100b0 0x7f829c176180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f829bfff640 1 -- 10.20.193.4:0/3221767261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829c1158b0 msgr2=0x7f829c0f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f829bfff640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829c1158b0 0x7f829c0f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f829bfff640 1 -- 10.20.193.4:0/3221767261 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829c1100b0 msgr2=0x7f829c176180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f829bfff640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829c1100b0 0x7f829c176180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f829bfff640 1 -- 10.20.193.4:0/3221767261 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828c009570 con 0x7f829c10f6c0 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f829bfff640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829c10f6c0 0x7f829c0f5a00 secure :-1 s=READY pgs=1378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828800c8c0 tx=0x7f828800cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82997fa640 1 -- 10.20.193.4:0/3221767261 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82880044a0 con 0x7f829c10f6c0 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82997fa640 1 -- 10.20.193.4:0/3221767261 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8288007c80 con 0x7f829c10f6c0 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a253c640 1 -- 10.20.193.4:0/3221767261 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829c0fb920 con 0x7f829c10f6c0 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82997fa640 1 -- 10.20.193.4:0/3221767261 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f828800f6d0 con 0x7f829c10f6c0 2026-02-24T09:20:45.557 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.553+0000 7f82a253c640 1 -- 10.20.193.4:0/3221767261 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c0fbdf0 con 0x7f829c10f6c0 2026-02-24T09:20:45.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.555+0000 7f82997fa640 1 -- 10.20.193.4:0/3221767261 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f828800f8a0 con 0x7f829c10f6c0 2026-02-24T09:20:45.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.556+0000 7f82997fa640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82700b5750 0x7f82700d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.556+0000 7f829b7fe640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82700b5750 0x7f82700d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.556+0000 7f82997fa640 1 -- 10.20.193.4:0/3221767261 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f82880e6be0 con 0x7f829c10f6c0 2026-02-24T09:20:45.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.556+0000 7f829b7fe640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82700b5750 0x7f82700d5c00 secure :-1 s=READY pgs=472 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c0023d0 tx=0x7f828c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:45.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f82a4536e00 1 Processor -- start 2026-02-24T09:20:45.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f82a4536e00 1 -- start start 2026-02-24T09:20:45.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50ce7cba0 0x55f50cf5e5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf5ef50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa3630 0x55f50cfc3a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f82a4536e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f50ce6e1f0 con 0x55f50cf5eb00 2026-02-24T09:20:45.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f82a4536e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f50ce69f20 con 0x55f50cfa3630 2026-02-24T09:20:45.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f82a4536e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f50ce64080 con 0x55f50ce7cba0 2026-02-24T09:20:45.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f829b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf5ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.564 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f829b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf5ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51762/0 (socket says 10.20.193.4:51762) 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f829b7fe640 1 -- 10.20.193.4:0/1342060719 learned_addr learned my addr 10.20.193.4:0/1342060719 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f829bfff640 1 --2- 10.20.193.4:0/1342060719 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50ce7cba0 0x55f50cf5e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f82a0ab2640 1 --2- 10.20.193.4:0/1342060719 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa3630 0x55f50cfc3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f829b7fe640 1 -- 10.20.193.4:0/1342060719 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50ce7cba0 msgr2=0x55f50cf5e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f829b7fe640 1 --2- 10.20.193.4:0/1342060719 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50ce7cba0 0x55f50cf5e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f829b7fe640 1 -- 10.20.193.4:0/1342060719 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa3630 msgr2=0x55f50cfc3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f829b7fe640 1 --2- 10.20.193.4:0/1342060719 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa3630 0x55f50cfc3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f829b7fe640 1 -- 10.20.193.4:0/1342060719 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f50ce0f6e0 con 0x55f50cf5eb00 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f829b7fe640 1 --2- 10.20.193.4:0/1342060719 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf5ef50 secure :-1 s=READY pgs=1379 gs=1 cs=0 l=1 c_cookie=6073471945895378367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c02f6e0 tx=0x7f828c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54494e8e6064fdbf server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f826cce3640 1 -- 10.20.193.4:0/1342060719 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f828c002b00 con 0x55f50cf5eb00 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f826cce3640 1 -- 10.20.193.4:0/1342060719 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f828c038920 con 0x55f50cf5eb00 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.557+0000 7f826cce3640 1 -- 10.20.193.4:0/1342060719 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f828c04f920 con 0x55f50cf5eb00 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.558+0000 7f82a4536e00 1 -- 10.20.193.4:0/1342060719 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 msgr2=0x55f50cf5ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.558+0000 7f82a4536e00 1 --2- 10.20.193.4:0/1342060719 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf5ef50 secure :-1 s=READY pgs=1379 gs=1 cs=0 l=1 c_cookie=6073471945895378367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c02f6e0 tx=0x7f828c040000 comp rx=0 tx=0).stop 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.558+0000 7f82a4536e00 1 -- 10.20.193.4:0/1342060719 shutdown_connections 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.558+0000 7f82a4536e00 1 --2- 10.20.193.4:0/1342060719 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa3630 0x55f50cfc3a10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.558+0000 7f82a4536e00 1 --2- 10.20.193.4:0/1342060719 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf5ef50 unknown :-1 s=CLOSED pgs=1379 gs=1 cs=0 l=1 c_cookie=6073471945895378367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.558+0000 7f82a4536e00 1 --2- 10.20.193.4:0/1342060719 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50ce7cba0 0x55f50cf5e5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.558+0000 7f82a4536e00 1 -- 10.20.193.4:0/1342060719 >> 10.20.193.4:0/1342060719 conn(0x55f50cf29950 msgr2=0x55f50cf5cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.558+0000 7f82a4536e00 1 -- 10.20.193.4:0/1342060719 shutdown_connections 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.558+0000 7f82a4536e00 1 -- 10.20.193.4:0/1342060719 wait complete. 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 -- start start 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 Processor -- start 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf76660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50cf5eb00 0x55f50cf76ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.565 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa3630 0x55f50cf7bb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f50cf7c0d0 con 0x55f50ce7cba0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f50cf7c240 con 0x55f50cfa3630 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f50cf7c400 con 0x55f50cf5eb00 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f829bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf76660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f829bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf76660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51766/0 (socket says 10.20.193.4:51766) 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f829bfff640 1 -- 10.20.193.4:0/493250442 learned_addr learned my addr 10.20.193.4:0/493250442 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f829b7fe640 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50cf5eb00 0x55f50cf76ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f829bfff640 1 -- 10.20.193.4:0/493250442 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50cf5eb00 msgr2=0x55f50cf76ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f829bfff640 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50cf5eb00 0x55f50cf76ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f829bfff640 1 -- 10.20.193.4:0/493250442 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa3630 msgr2=0x55f50cf7bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f829bfff640 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa3630 0x55f50cf7bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f829bfff640 1 -- 10.20.193.4:0/493250442 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f50cde7cd0 con 0x55f50ce7cba0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f829bfff640 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf76660 secure :-1 s=READY pgs=1380 gs=1 cs=0 l=1 c_cookie=7228411714914973364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82880e4740 tx=0x7f82880ae060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64507a282dc776b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f825dffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f825dffb640 1 -- 10.20.193.4:0/493250442 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82880b7e20 con 0x55f50ce7cba0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f825dffb640 1 -- 10.20.193.4:0/493250442 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82880d22e0 con 0x55f50ce7cba0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 -- 10.20.193.4:0/493250442 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c176af0 con 0x55f50ce7cba0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f825dffb640 1 -- 10.20.193.4:0/493250442 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82880aec40 con 0x55f50ce7cba0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 10 client.18516 _ll_register_callbacks cb 0x55f50cdecc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 -- 10.20.193.4:0/493250442 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f50caf1940 con 0x55f50ce7cba0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f825dffb640 1 -- 10.20.193.4:0/493250442 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f828800fb80 con 0x55f50ce7cba0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f825dffb640 1 -- 10.20.193.4:0/493250442 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f828800fd40 con 0x55f50ce7cba0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 10 client.18516 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 1 -- 10.20.193.4:0/493250442 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f50cdf9ab0 con 0x55f50ce7cba0 2026-02-24T09:20:45.566 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f825dffb640 1 -- 10.20.193.4:0/493250442 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f82880e4b60 con 0x55f50ce7cba0 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 10 client.18516 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 10 client.18516 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.559+0000 7f82a4536e00 20 client.18516 populate_metadata read hostname 'trial004' 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.560+0000 7f82a4536e00 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f50cfa0f40 0x55f50cfa13e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.560+0000 7f82a4536e00 4 client.18516 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.560+0000 7f82a4536e00 1 -- 10.20.193.4:0/493250442 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f50ce75470 con 0x55f50cfa0f40 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.560+0000 7f829b7fe640 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f50cfa0f40 0x55f50cfa13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.560+0000 7f825dffb640 10 client.18516 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.560+0000 7f829b7fe640 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f50cfa0f40 0x55f50cfa13e0 crc :-1 s=READY pgs=241 gs=4 cs=0 l=0 c_cookie=6587186193776218797 s_cookie=2287128344856108952 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b6a62f15d6392ad server_cookie=1fbd831ca6e01f98 in_seq=0 out_seq=0 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f825dffb640 1 -- 10.20.193.4:0/493250442 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55f50ce75470 con 0x55f50cfa0f40 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f825dffb640 10 client.18516 handle_command_reply: tid=0 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 client.18516 shutdown 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 -- 10.20.193.4:0/493250442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 msgr2=0x55f50cf76660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf76660 secure :-1 s=READY pgs=1380 gs=1 cs=0 l=1 c_cookie=7228411714914973364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82880e4740 tx=0x7f82880ae060 comp rx=0 tx=0).stop 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 -- 10.20.193.4:0/493250442 shutdown_connections 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f50cfa0f40 0x55f50cfa13e0 crc :-1 s=READY pgs=241 gs=4 cs=0 l=0 c_cookie=6587186193776218797 s_cookie=2287128344856108952 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa3630 0x55f50cf7bb90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50cf5eb00 0x55f50cf76ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f825dffb640 0 client.18516 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 --2- 10.20.193.4:0/493250442 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf76660 unknown :-1 s=CLOSED pgs=1380 gs=1 cs=0 l=1 c_cookie=7228411714914973364 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 -- 10.20.193.4:0/493250442 >> 10.20.193.4:0/493250442 conn(0x55f50cf29950 msgr2=0x55f50cf5d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 -- 10.20.193.4:0/493250442 shutdown_connections 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 1 -- 10.20.193.4:0/493250442 wait complete. 2026-02-24T09:20:45.567 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.561+0000 7f82a4536e00 20 client.18516 trim_cache size 0 max 16384 2026-02-24T09:20:45.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f82a4536e00 1 Processor -- start 2026-02-24T09:20:45.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f82a4536e00 1 -- start start 2026-02-24T09:20:45.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50ce7cba0 0x55f50cf9c070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf9c5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa0f40 0x55f50cfa1aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f82a4536e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f50ce61cb0 con 0x55f50cf5eb00 2026-02-24T09:20:45.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f82a4536e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f50cb2cf50 con 0x55f50cfa0f40 2026-02-24T09:20:45.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f82a4536e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f50cf5f350 con 0x55f50ce7cba0 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f829b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf9c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f829b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf9c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51774/0 (socket says 10.20.193.4:51774) 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f829b7fe640 1 -- 10.20.193.4:0/1752717572 learned_addr learned my addr 10.20.193.4:0/1752717572 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f82a0ab2640 1 --2- 10.20.193.4:0/1752717572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa0f40 0x55f50cfa1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f829bfff640 1 --2- 10.20.193.4:0/1752717572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50ce7cba0 0x55f50cf9c070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f829b7fe640 1 -- 10.20.193.4:0/1752717572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50ce7cba0 msgr2=0x55f50cf9c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f829b7fe640 1 --2- 10.20.193.4:0/1752717572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50ce7cba0 0x55f50cf9c070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f829b7fe640 1 -- 10.20.193.4:0/1752717572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa0f40 msgr2=0x55f50cfa1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f829b7fe640 1 --2- 10.20.193.4:0/1752717572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa0f40 0x55f50cfa1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f829b7fe640 1 -- 10.20.193.4:0/1752717572 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f50cdf4530 con 0x55f50cf5eb00 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f82a0ab2640 1 --2- 10.20.193.4:0/1752717572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa0f40 0x55f50cfa1aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:20:45.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f829b7fe640 1 --2- 10.20.193.4:0/1752717572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf9c5b0 secure :-1 s=READY pgs=1381 gs=1 cs=0 l=1 c_cookie=799903631683008017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c0093f0 tx=0x7f828c005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19d41d6d02b611 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f825ffff640 1 -- 10.20.193.4:0/1752717572 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f828c02f9f0 con 0x55f50cf5eb00 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f825ffff640 1 -- 10.20.193.4:0/1752717572 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f828c048070 con 0x55f50cf5eb00 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.571+0000 7f825ffff640 1 -- 10.20.193.4:0/1752717572 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f828c04f700 con 0x55f50cf5eb00 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 -- 10.20.193.4:0/1752717572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 msgr2=0x55f50cf9c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 --2- 10.20.193.4:0/1752717572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf9c5b0 secure :-1 s=READY pgs=1381 gs=1 cs=0 l=1 c_cookie=799903631683008017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c0093f0 tx=0x7f828c005900 comp rx=0 tx=0).stop 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 -- 10.20.193.4:0/1752717572 shutdown_connections 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 --2- 10.20.193.4:0/1752717572 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa0f40 0x55f50cfa1aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 --2- 10.20.193.4:0/1752717572 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50cf5eb00 0x55f50cf9c5b0 unknown :-1 s=CLOSED pgs=1381 gs=1 cs=0 l=1 c_cookie=799903631683008017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 --2- 10.20.193.4:0/1752717572 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50ce7cba0 0x55f50cf9c070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 -- 10.20.193.4:0/1752717572 >> 10.20.193.4:0/1752717572 conn(0x55f50cf29950 msgr2=0x55f50cf7b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 -- 10.20.193.4:0/1752717572 shutdown_connections 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 -- 10.20.193.4:0/1752717572 wait complete. 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 -- start start 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 Processor -- start 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf7e460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50cf5eb00 0x55f50cf7e9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa0f40 0x55f50d008b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55f50cf7f2f0 con 0x55f50ce7cba0 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55f50d009090 con 0x55f50cfa0f40 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f82a4536e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55f50d009250 con 0x55f50cf5eb00 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f829bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf7e460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f829bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf7e460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51776/0 (socket says 10.20.193.4:51776) 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f829bfff640 1 -- 10.20.193.4:0/2473693137 learned_addr learned my addr 10.20.193.4:0/2473693137 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f829bfff640 1 -- 10.20.193.4:0/2473693137 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50cf5eb00 msgr2=0x55f50cf7e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f829bfff640 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50cf5eb00 0x55f50cf7e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f829bfff640 1 -- 10.20.193.4:0/2473693137 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa0f40 msgr2=0x55f50d008b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f829bfff640 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa0f40 0x55f50d008b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.576 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.572+0000 7f829bfff640 1 -- 10.20.193.4:0/2473693137 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f50cde8000 con 0x55f50ce7cba0 2026-02-24T09:20:45.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f829bfff640 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf7e460 secure :-1 s=READY pgs=1382 gs=1 cs=0 l=1 c_cookie=13825378106794843842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82880aa650 tx=0x7f82880b2df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdd9c235cf81ec2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:20:45.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f825dffb640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:20:45.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f825dffb640 1 -- 10.20.193.4:0/2473693137 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82880d22e0 con 0x55f50ce7cba0 2026-02-24T09:20:45.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f825dffb640 1 -- 10.20.193.4:0/2473693137 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82880c8060 con 0x55f50ce7cba0 2026-02-24T09:20:45.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 1 -- 10.20.193.4:0/2473693137 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f50ce0f6e0 con 0x55f50ce7cba0 2026-02-24T09:20:45.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f825dffb640 1 -- 10.20.193.4:0/2473693137 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82880b7c00 con 0x55f50ce7cba0 2026-02-24T09:20:45.577 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 10 client.18522 _ll_register_callbacks cb 0x55f50cdecc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 1 -- 10.20.193.4:0/2473693137 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f50cbb34a0 con 0x55f50ce7cba0 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f825dffb640 1 -- 10.20.193.4:0/2473693137 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f82880b7d60 con 0x55f50ce7cba0 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f825dffb640 1 -- 10.20.193.4:0/2473693137 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f828800fb80 con 0x55f50ce7cba0 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 10 client.18522 fetch_fsmap learned FSMap version 19 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 1 -- 10.20.193.4:0/2473693137 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55f50cdf9d10 con 0x55f50ce7cba0 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f825dffb640 1 -- 10.20.193.4:0/2473693137 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f8288007740 con 0x55f50ce7cba0 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 10 client.18522 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 10 client.18522 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 20 client.18522 populate_metadata read hostname 'trial004' 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f50cfa3630 0x55f50d070c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 4 client.18522 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f82a4536e00 1 -- 10.20.193.4:0/2473693137 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x7f828c038920 con 0x55f50cfa3630 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.573+0000 7f829b7fe640 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f50cfa3630 0x55f50d070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f829b7fe640 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f50cfa3630 0x55f50d070c00 crc :-1 s=READY pgs=242 gs=4 cs=0 l=0 c_cookie=8171554707014565165 s_cookie=2147693811924845036 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=716731b616463d2d server_cookie=1dce24249a15c1ec in_seq=0 out_seq=0 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f825dffb640 10 client.18522 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f825dffb640 1 -- 10.20.193.4:0/2473693137 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x7f828c038920 con 0x55f50cfa3630 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f825dffb640 10 client.18522 handle_command_reply: tid=0 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 client.18522 shutdown 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 -- 10.20.193.4:0/2473693137 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 msgr2=0x55f50cf7e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf7e460 secure :-1 s=READY pgs=1382 gs=1 cs=0 l=1 c_cookie=13825378106794843842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82880aa650 tx=0x7f82880b2df0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 -- 10.20.193.4:0/2473693137 shutdown_connections 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55f50cfa3630 0x55f50d070c00 crc :-1 s=READY pgs=242 gs=4 cs=0 l=0 c_cookie=8171554707014565165 s_cookie=2147693811924845036 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55f50cfa0f40 0x55f50d008b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55f50cf5eb00 0x55f50cf7e9a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 --2- 10.20.193.4:0/2473693137 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55f50ce7cba0 0x55f50cf7e460 unknown :-1 s=CLOSED pgs=1382 gs=1 cs=0 l=1 c_cookie=13825378106794843842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f825dffb640 0 client.18522 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 -- 10.20.193.4:0/2473693137 >> 10.20.193.4:0/2473693137 conn(0x55f50cf29950 msgr2=0x55f50cfa29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 -- 10.20.193.4:0/2473693137 shutdown_connections 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 1 -- 10.20.193.4:0/2473693137 wait complete. 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a4536e00 20 client.18522 trim_cache size 0 max 16384 2026-02-24T09:20:45.578 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 19, 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stdout: "leader": 24637, 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stdout: "set_version": 44, 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stdout: "sets": {} 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 -- 10.20.193.4:0/3221767261 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82700b5750 msgr2=0x7f82700d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82700b5750 0x7f82700d5c00 secure :-1 s=READY pgs=472 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c0023d0 tx=0x7f828c031040 comp rx=0 tx=0).stop 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 -- 10.20.193.4:0/3221767261 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829c10f6c0 msgr2=0x7f829c0f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829c10f6c0 0x7f829c0f5a00 secure :-1 s=READY pgs=1378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828800c8c0 tx=0x7f828800cd90 comp rx=0 tx=0).stop 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 -- 10.20.193.4:0/3221767261 shutdown_connections 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f82700b5750 0x7f82700d5c00 unknown :-1 s=CLOSED pgs=472 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f829c1158b0 0x7f829c0f6100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f829c1100b0 0x7f829c176180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 --2- 10.20.193.4:0/3221767261 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f829c10f6c0 0x7f829c0f5a00 unknown :-1 s=CLOSED pgs=1378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 -- 10.20.193.4:0/3221767261 >> 10.20.193.4:0/3221767261 conn(0x7f829c0ecfd0 msgr2=0x7f829c112f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 -- 10.20.193.4:0/3221767261 shutdown_connections 2026-02-24T09:20:45.579 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:20:45.574+0000 7f82a253c640 1 -- 10.20.193.4:0/3221767261 wait complete. 2026-02-24T09:20:45.612 INFO:tasks.quiescer:done joining Quiescers 2026-02-24T09:20:45.612 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2026-02-24T09:20:45.628 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2026-02-24T09:20:46.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:45 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4203813180' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:46.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:45 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4203813180' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:46.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:45 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4203813180' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:20:47.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:46 trial004 ceph-mon[41596]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 572 MiB/s wr, 163 op/s 2026-02-24T09:20:47.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:46 trial090 ceph-mon[47278]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 572 MiB/s wr, 163 op/s 2026-02-24T09:20:47.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:46 trial014 ceph-mon[46941]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 9.6 KiB/s rd, 572 MiB/s wr, 163 op/s 2026-02-24T09:20:48.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:47 trial004 ceph-mon[41596]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 556 MiB/s wr, 170 op/s 2026-02-24T09:20:48.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:47 trial090 ceph-mon[47278]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 556 MiB/s wr, 170 op/s 2026-02-24T09:20:48.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:47 trial014 ceph-mon[46941]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 556 MiB/s wr, 170 op/s 2026-02-24T09:20:49.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:48 trial004 ceph-mon[41596]: scrub summary: idle 2026-02-24T09:20:49.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:48 trial090 ceph-mon[47278]: scrub summary: idle 2026-02-24T09:20:49.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:48 trial014 ceph-mon[46941]: scrub summary: idle 2026-02-24T09:20:50.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:49 trial090 ceph-mon[47278]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 447 MiB/s wr, 151 op/s 2026-02-24T09:20:50.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:49 trial014 ceph-mon[46941]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 447 MiB/s wr, 151 op/s 2026-02-24T09:20:50.464 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:49 trial004 ceph-mon[41596]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 20 KiB/s rd, 447 MiB/s wr, 151 op/s 2026-02-24T09:20:53.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:52 trial004 ceph-mon[41596]: pgmap v484: 97 pgs: 97 active+clean; 7.9 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 296 MiB/s wr, 157 op/s 2026-02-24T09:20:53.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:52 trial090 ceph-mon[47278]: pgmap v484: 97 pgs: 97 active+clean; 7.9 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 296 MiB/s wr, 157 op/s 2026-02-24T09:20:53.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:52 trial014 ceph-mon[46941]: pgmap v484: 97 pgs: 97 active+clean; 7.9 GiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 296 MiB/s wr, 157 op/s 2026-02-24T09:20:55.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:54 trial004 ceph-mon[41596]: pgmap v485: 97 pgs: 97 active+clean; 6.5 GiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 147 MiB/s wr, 148 op/s 2026-02-24T09:20:55.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:54 trial090 ceph-mon[47278]: pgmap v485: 97 pgs: 97 active+clean; 6.5 GiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 147 MiB/s wr, 148 op/s 2026-02-24T09:20:55.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:54 trial014 ceph-mon[46941]: pgmap v485: 97 pgs: 97 active+clean; 6.5 GiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 147 MiB/s wr, 148 op/s 2026-02-24T09:20:57.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:56 trial004 ceph-mon[41596]: pgmap v486: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 129 MiB/s wr, 156 op/s 2026-02-24T09:20:57.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:56 trial090 ceph-mon[47278]: pgmap v486: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 129 MiB/s wr, 156 op/s 2026-02-24T09:20:57.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:56 trial014 ceph-mon[46941]: pgmap v486: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 129 MiB/s wr, 156 op/s 2026-02-24T09:20:59.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:20:58 trial004 ceph-mon[41596]: pgmap v487: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 90 MiB/s wr, 136 op/s 2026-02-24T09:20:59.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:20:58 trial090 ceph-mon[47278]: pgmap v487: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 90 MiB/s wr, 136 op/s 2026-02-24T09:20:59.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:20:58 trial014 ceph-mon[46941]: pgmap v487: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 90 MiB/s wr, 136 op/s 2026-02-24T09:21:01.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:00 trial004 ceph-mon[41596]: pgmap v488: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 112 op/s 2026-02-24T09:21:01.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:00 trial090 ceph-mon[47278]: pgmap v488: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 112 op/s 2026-02-24T09:21:01.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:00 trial014 ceph-mon[46941]: pgmap v488: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 112 op/s 2026-02-24T09:21:03.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:02 trial004 ceph-mon[41596]: pgmap v489: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 93 op/s 2026-02-24T09:21:03.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:02 trial090 ceph-mon[47278]: pgmap v489: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 93 op/s 2026-02-24T09:21:03.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:02 trial014 ceph-mon[46941]: pgmap v489: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 93 op/s 2026-02-24T09:21:05.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:04 trial004 ceph-mon[41596]: pgmap v490: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 46 op/s 2026-02-24T09:21:05.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:04 trial090 ceph-mon[47278]: pgmap v490: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 46 op/s 2026-02-24T09:21:05.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:04 trial014 ceph-mon[46941]: pgmap v490: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 46 op/s 2026-02-24T09:21:07.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:06 trial004 ceph-mon[41596]: pgmap v491: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 17 op/s 2026-02-24T09:21:07.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:06 trial090 ceph-mon[47278]: pgmap v491: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 17 op/s 2026-02-24T09:21:07.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:06 trial014 ceph-mon[46941]: pgmap v491: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 17 op/s 2026-02-24T09:21:09.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:08 trial004 ceph-mon[41596]: pgmap v492: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2026-02-24T09:21:09.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:08 trial090 ceph-mon[47278]: pgmap v492: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2026-02-24T09:21:09.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:08 trial014 ceph-mon[46941]: pgmap v492: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2026-02-24T09:21:11.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:10 trial004 ceph-mon[41596]: pgmap v493: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 3.7 MiB/s wr, 6 op/s 2026-02-24T09:21:11.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:10 trial090 ceph-mon[47278]: pgmap v493: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 3.7 MiB/s wr, 6 op/s 2026-02-24T09:21:11.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:10 trial014 ceph-mon[46941]: pgmap v493: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 3.7 MiB/s wr, 6 op/s 2026-02-24T09:21:13.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:12 trial004 ceph-mon[41596]: pgmap v494: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 105 MiB/s wr, 53 op/s 2026-02-24T09:21:13.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:12 trial090 ceph-mon[47278]: pgmap v494: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 105 MiB/s wr, 53 op/s 2026-02-24T09:21:13.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:12 trial014 ceph-mon[46941]: pgmap v494: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 105 MiB/s wr, 53 op/s 2026-02-24T09:21:14.810 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-24T09:21:14.927 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:15.037 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.031+0000 7f0793fff640 1 -- 10.20.193.4:0/4272275979 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f079410fc30 msgr2=0x7f0794114c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.031+0000 7f0793fff640 1 --2- 10.20.193.4:0/4272275979 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f079410fc30 0x7f0794114c80 secure :-1 s=READY pgs=1383 gs=1 cs=0 l=1 c_cookie=8258166920042608328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077c009950 tx=0x7f077c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 -- 10.20.193.4:0/4272275979 shutdown_connections 2026-02-24T09:21:15.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 --2- 10.20.193.4:0/4272275979 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0794115430 0x7f0794175e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 --2- 10.20.193.4:0/4272275979 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f079410fc30 0x7f0794114c80 unknown :-1 s=CLOSED pgs=1383 gs=1 cs=0 l=1 c_cookie=8258166920042608328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 --2- 10.20.193.4:0/4272275979 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f079410f240 0x7f079410f610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 -- 10.20.193.4:0/4272275979 >> 10.20.193.4:0/4272275979 conn(0x7f07940ecaf0 msgr2=0x7f079410cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 -- 10.20.193.4:0/4272275979 shutdown_connections 2026-02-24T09:21:15.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 -- 10.20.193.4:0/4272275979 wait complete. 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 Processor -- start 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 -- start start 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f079410f240 0x7f07940f5490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f079410fc30 0x7f0794175d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0794115430 0x7f07940f5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f07940fada0 con 0x7f0794115430 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f07940faf10 con 0x7f079410f240 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0793fff640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f07940fb0d0 con 0x7f079410fc30 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f07937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0794115430 0x7f07940f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f07937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0794115430 0x7f07940f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42312/0 (socket says 10.20.193.4:42312) 2026-02-24T09:21:15.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f07937fe640 1 -- 10.20.193.4:0/3427329621 learned_addr learned my addr 10.20.193.4:0/3427329621 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f0792ffd640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f079410f240 0x7f07940f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f07927fc640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f079410fc30 0x7f0794175d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f07937fe640 1 -- 10.20.193.4:0/3427329621 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f079410fc30 msgr2=0x7f0794175d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f07937fe640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f079410fc30 0x7f0794175d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f07937fe640 1 -- 10.20.193.4:0/3427329621 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f079410f240 msgr2=0x7f07940f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f07937fe640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f079410f240 0x7f07940f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.032+0000 7f07937fe640 1 -- 10.20.193.4:0/3427329621 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c009570 con 0x7f0794115430 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.033+0000 7f07937fe640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0794115430 0x7f07940f5b90 secure :-1 s=READY pgs=1384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0784006e90 tx=0x7f078400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.033+0000 7f0773fff640 1 -- 10.20.193.4:0/3427329621 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0784005500 con 0x7f0794115430 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.033+0000 7f0773fff640 1 -- 10.20.193.4:0/3427329621 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0784005e10 con 0x7f0794115430 2026-02-24T09:21:15.040 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.033+0000 7f0773fff640 1 -- 10.20.193.4:0/3427329621 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0784003a90 con 0x7f0794115430 2026-02-24T09:21:15.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.033+0000 7f0793fff640 1 -- 10.20.193.4:0/3427329621 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07940fb3b0 con 0x7f0794115430 2026-02-24T09:21:15.041 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.033+0000 7f0793fff640 1 -- 10.20.193.4:0/3427329621 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07940fb830 con 0x7f0794115430 2026-02-24T09:21:15.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.034+0000 7f0773fff640 1 -- 10.20.193.4:0/3427329621 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f078400c840 con 0x7f0794115430 2026-02-24T09:21:15.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.035+0000 7f0773fff640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f07680b5750 0x7f07680d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.035+0000 7f0773fff640 1 -- 10.20.193.4:0/3427329621 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f07840e78e0 con 0x7f0794115430 2026-02-24T09:21:15.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.035+0000 7f0792ffd640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f07680b5750 0x7f07680d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.036+0000 7f0792ffd640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f07680b5750 0x7f07680d5c00 secure :-1 s=READY pgs=473 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0788004740 tx=0x7f0788009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.036+0000 7f079b3cee00 1 Processor -- start 2026-02-24T09:21:15.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.036+0000 7f079b3cee00 1 -- start start 2026-02-24T09:21:15.049 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0a58bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a59130 0x555ac0a9d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0abe1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555ac0968de0 con 0x555ac0a9ddd0 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555ac0964b10 con 0x555ac0a59130 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555ac095eab0 con 0x555ac0a58820 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f07937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0abe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f07937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0abe1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42314/0 (socket says 10.20.193.4:42314) 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f07937fe640 1 -- 10.20.193.4:0/2404720211 learned_addr learned my addr 10.20.193.4:0/2404720211 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f0792ffd640 1 --2- 10.20.193.4:0/2404720211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0a58bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f07927fc640 1 --2- 10.20.193.4:0/2404720211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a59130 0x555ac0a9d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f07937fe640 1 -- 10.20.193.4:0/2404720211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 msgr2=0x555ac0a58bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f07937fe640 1 --2- 10.20.193.4:0/2404720211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0a58bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f07937fe640 1 -- 10.20.193.4:0/2404720211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a59130 msgr2=0x555ac0a9d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f07937fe640 1 --2- 10.20.193.4:0/2404720211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a59130 0x555ac0a9d890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f07937fe640 1 -- 10.20.193.4:0/2404720211 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ac090a310 con 0x555ac0a9ddd0 2026-02-24T09:21:15.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f0792ffd640 1 --2- 10.20.193.4:0/2404720211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0a58bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:15.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f07937fe640 1 --2- 10.20.193.4:0/2404720211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0abe1b0 secure :-1 s=READY pgs=1385 gs=1 cs=0 l=1 c_cookie=18423255473968621558 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07840aa1e0 tx=0x7f07840a9b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffac8d3e342ba7f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f075f7fe640 1 -- 10.20.193.4:0/2404720211 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07840ae610 con 0x555ac0a9ddd0 2026-02-24T09:21:15.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f075f7fe640 1 -- 10.20.193.4:0/2404720211 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f07840b3930 con 0x555ac0a9ddd0 2026-02-24T09:21:15.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f075f7fe640 1 -- 10.20.193.4:0/2404720211 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07840b88c0 con 0x555ac0a9ddd0 2026-02-24T09:21:15.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 -- 10.20.193.4:0/2404720211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 msgr2=0x555ac0abe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 --2- 10.20.193.4:0/2404720211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0abe1b0 secure :-1 s=READY pgs=1385 gs=1 cs=0 l=1 c_cookie=18423255473968621558 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07840aa1e0 tx=0x7f07840a9b80 comp rx=0 tx=0).stop 2026-02-24T09:21:15.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 -- 10.20.193.4:0/2404720211 shutdown_connections 2026-02-24T09:21:15.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 --2- 10.20.193.4:0/2404720211 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0abe1b0 unknown :-1 s=CLOSED pgs=1385 gs=1 cs=0 l=1 c_cookie=18423255473968621558 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 --2- 10.20.193.4:0/2404720211 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a59130 0x555ac0a9d890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 --2- 10.20.193.4:0/2404720211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0a58bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 -- 10.20.193.4:0/2404720211 >> 10.20.193.4:0/2404720211 conn(0x555ac09776b0 msgr2=0x555ac0a57100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.037+0000 7f079b3cee00 1 -- 10.20.193.4:0/2404720211 shutdown_connections 2026-02-24T09:21:15.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.038+0000 7f079b3cee00 1 -- 10.20.193.4:0/2404720211 wait complete. 2026-02-24T09:21:15.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.038+0000 7f079b3cee00 1 -- start start 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.038+0000 7f079b3cee00 1 Processor -- start 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.038+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0ab58a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.038+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a59130 0x555ac0ab5de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.038+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a9ddd0 0x555ac0abadd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.038+0000 7f079b3cee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555ac0abb310 con 0x555ac0a59130 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.038+0000 7f079b3cee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555ac0abb480 con 0x555ac0a9ddd0 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.038+0000 7f079b3cee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555ac0abb640 con 0x555ac0a58820 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07927fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a59130 0x555ac0ab5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07927fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a59130 0x555ac0ab5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42324/0 (socket says 10.20.193.4:42324) 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07927fc640 1 -- 10.20.193.4:0/3290645095 learned_addr learned my addr 10.20.193.4:0/3290645095 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f0792ffd640 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0ab58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07937fe640 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a9ddd0 0x555ac0abadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07927fc640 1 -- 10.20.193.4:0/3290645095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 msgr2=0x555ac0ab58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07927fc640 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0ab58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07927fc640 1 -- 10.20.193.4:0/3290645095 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a9ddd0 msgr2=0x555ac0abadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07927fc640 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a9ddd0 0x555ac0abadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07927fc640 1 -- 10.20.193.4:0/3290645095 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ac08e28c0 con 0x555ac0a59130 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f0792ffd640 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0ab58a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07937fe640 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a9ddd0 0x555ac0abadd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f07927fc640 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a59130 0x555ac0ab5de0 secure :-1 s=READY pgs=1386 gs=1 cs=0 l=1 c_cookie=17099569352065343734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077c0042f0 tx=0x7f077c004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4ddfba7202e0f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f075cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f075cff9640 1 -- 10.20.193.4:0/3290645095 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f077c005dd0 con 0x555ac0a59130 2026-02-24T09:21:15.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f075cff9640 1 -- 10.20.193.4:0/3290645095 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f077c038c20 con 0x555ac0a59130 2026-02-24T09:21:15.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f075cff9640 1 -- 10.20.193.4:0/3290645095 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f077c044c00 con 0x555ac0a59130 2026-02-24T09:21:15.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f079b3cee00 1 -- 10.20.193.4:0/3290645095 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07940fb830 con 0x555ac0a59130 2026-02-24T09:21:15.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f075cff9640 1 -- 10.20.193.4:0/3290645095 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f077c044d90 con 0x555ac0a59130 2026-02-24T09:21:15.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f075cff9640 10 client.18534 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:21:15.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f079b3cee00 10 client.18534 _ll_register_callbacks cb 0x555ac08fa160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:15.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f079b3cee00 1 -- 10.20.193.4:0/3290645095 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555ac06ae4a0 con 0x555ac0a59130 2026-02-24T09:21:15.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f075cff9640 1 -- 10.20.193.4:0/3290645095 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f077c038d90 con 0x555ac0a59130 2026-02-24T09:21:15.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f079b3cee00 10 client.18534 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:15.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f079b3cee00 1 -- 10.20.193.4:0/3290645095 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x555ac08f46e0 con 0x555ac0a59130 2026-02-24T09:21:15.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.039+0000 7f075cff9640 1 -- 10.20.193.4:0/3290645095 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f077c044420 con 0x555ac0a59130 2026-02-24T09:21:15.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.040+0000 7f079b3cee00 10 client.18534 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:15.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.040+0000 7f079b3cee00 10 client.18534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:21:15.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.040+0000 7f079b3cee00 20 client.18534 populate_metadata read hostname 'trial004' 2026-02-24T09:21:15.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.040+0000 7f079b3cee00 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555ac0a9b2a0 0x555ac0a9b710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.040+0000 7f079b3cee00 4 client.18534 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:15.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.040+0000 7f079b3cee00 1 -- 10.20.193.4:0/3290645095 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ac09544f0 con 0x555ac0a9b2a0 2026-02-24T09:21:15.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.040+0000 7f0792ffd640 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555ac0a9b2a0 0x555ac0a9b710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.040+0000 7f0792ffd640 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555ac0a9b2a0 0x555ac0a9b710 crc :-1 s=READY pgs=243 gs=4 cs=0 l=0 c_cookie=18364361014929139553 s_cookie=4708994836722526794 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fedb510b65e22761 server_cookie=4159b5dacbfeaa4a in_seq=0 out_seq=0 2026-02-24T09:21:15.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.040+0000 7f075cff9640 10 client.18534 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:15.056 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f075cff9640 1 -- 10.20.193.4:0/3290645095 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x555ac09544f0 con 0x555ac0a9b2a0 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f075cff9640 10 client.18534 handle_command_reply: tid=0 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 client.18534 shutdown 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 -- 10.20.193.4:0/3290645095 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a59130 msgr2=0x555ac0ab5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a59130 0x555ac0ab5de0 secure :-1 s=READY pgs=1386 gs=1 cs=0 l=1 c_cookie=17099569352065343734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077c0042f0 tx=0x7f077c004320 comp rx=0 tx=0).stop 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 -- 10.20.193.4:0/3290645095 shutdown_connections 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555ac0a9b2a0 0x555ac0a9b710 crc :-1 s=READY pgs=243 gs=4 cs=0 l=0 c_cookie=18364361014929139553 s_cookie=4708994836722526794 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a9ddd0 0x555ac0abadd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a59130 0x555ac0ab5de0 unknown :-1 s=CLOSED pgs=1386 gs=1 cs=0 l=1 c_cookie=17099569352065343734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 --2- 10.20.193.4:0/3290645095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0ab58a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f075cff9640 0 client.18534 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:15.057 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 -- 10.20.193.4:0/3290645095 >> 10.20.193.4:0/3290645095 conn(0x555ac09776b0 msgr2=0x555ac0a56910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 -- 10.20.193.4:0/3290645095 shutdown_connections 2026-02-24T09:21:15.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 1 -- 10.20.193.4:0/3290645095 wait complete. 2026-02-24T09:21:15.058 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.041+0000 7f079b3cee00 20 client.18534 trim_cache size 0 max 16384 2026-02-24T09:21:15.064 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.050+0000 7f079b3cee00 1 Processor -- start 2026-02-24T09:21:15.064 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.050+0000 7f079b3cee00 1 -- start start 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0ab3380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a59130 0x555ac0a989d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0a98f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555ac095c6e0 con 0x555ac0a9ddd0 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555ac0627f50 con 0x555ac0a59130 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555ac0aae950 con 0x555ac0a58820 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f07937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0a98f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f07937fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0a98f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42338/0 (socket says 10.20.193.4:42338) 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f07937fe640 1 -- 10.20.193.4:0/460762885 learned_addr learned my addr 10.20.193.4:0/460762885 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f0792ffd640 1 --2- 10.20.193.4:0/460762885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0ab3380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.065 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f07937fe640 1 -- 10.20.193.4:0/460762885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 msgr2=0x555ac0ab3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f07937fe640 1 --2- 10.20.193.4:0/460762885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0ab3380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f07937fe640 1 -- 10.20.193.4:0/460762885 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a59130 msgr2=0x555ac0a989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f07937fe640 1 --2- 10.20.193.4:0/460762885 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a59130 0x555ac0a989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f07937fe640 1 -- 10.20.193.4:0/460762885 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ac08ef160 con 0x555ac0a9ddd0 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f0792ffd640 1 --2- 10.20.193.4:0/460762885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0ab3380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f07937fe640 1 --2- 10.20.193.4:0/460762885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0a98f10 secure :-1 s=READY pgs=1387 gs=1 cs=0 l=1 c_cookie=7398768895003549609 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f078400c630 tx=0x7f0784008510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66adb51c11e55fa9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f075effd640 1 -- 10.20.193.4:0/460762885 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07840ae690 con 0x555ac0a9ddd0 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f075effd640 1 -- 10.20.193.4:0/460762885 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f07840b8d50 con 0x555ac0a9ddd0 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f075effd640 1 -- 10.20.193.4:0/460762885 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f07840ae8a0 con 0x555ac0a9ddd0 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 -- 10.20.193.4:0/460762885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 msgr2=0x555ac0a98f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 --2- 10.20.193.4:0/460762885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0a98f10 secure :-1 s=READY pgs=1387 gs=1 cs=0 l=1 c_cookie=7398768895003549609 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f078400c630 tx=0x7f0784008510 comp rx=0 tx=0).stop 2026-02-24T09:21:15.066 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 -- 10.20.193.4:0/460762885 shutdown_connections 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 --2- 10.20.193.4:0/460762885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a9ddd0 0x555ac0a98f10 unknown :-1 s=CLOSED pgs=1387 gs=1 cs=0 l=1 c_cookie=7398768895003549609 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 --2- 10.20.193.4:0/460762885 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a59130 0x555ac0a989d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 --2- 10.20.193.4:0/460762885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a58820 0x555ac0ab3380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 -- 10.20.193.4:0/460762885 >> 10.20.193.4:0/460762885 conn(0x555ac09776b0 msgr2=0x555ac0ab1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 -- 10.20.193.4:0/460762885 shutdown_connections 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.051+0000 7f079b3cee00 1 -- 10.20.193.4:0/460762885 wait complete. 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f079b3cee00 1 -- start start 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f079b3cee00 1 Processor -- start 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a58820 0x555ac0a385a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a59130 0x555ac0a38ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f079b3cee00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a9ddd0 0x555ac0ae37c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.067 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f079b3cee00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x555ac0a99910 con 0x555ac0a58820 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f079b3cee00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x555ac095c6e0 con 0x555ac0a9ddd0 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f079b3cee00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x555ac0627f50 con 0x555ac0a59130 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f0792ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a58820 0x555ac0a385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f0792ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a58820 0x555ac0a385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42346/0 (socket says 10.20.193.4:42346) 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f0792ffd640 1 -- 10.20.193.4:0/2181496899 learned_addr learned my addr 10.20.193.4:0/2181496899 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f0792ffd640 1 -- 10.20.193.4:0/2181496899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a59130 msgr2=0x555ac0a38ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f0792ffd640 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a59130 0x555ac0a38ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f0792ffd640 1 -- 10.20.193.4:0/2181496899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a9ddd0 msgr2=0x555ac0ae37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f0792ffd640 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a9ddd0 0x555ac0ae37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f0792ffd640 1 -- 10.20.193.4:0/2181496899 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ac08e2bf0 con 0x555ac0a58820 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f0792ffd640 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a58820 0x555ac0a385a0 secure :-1 s=READY pgs=1388 gs=1 cs=0 l=1 c_cookie=1770881017110765218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x555ac0a9bf90 tx=0x7f0788004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18936ee70c5e9ea2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.052+0000 7f075cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f075cff9640 1 -- 10.20.193.4:0/2181496899 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0788023b40 con 0x555ac0a58820 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f075cff9640 1 -- 10.20.193.4:0/2181496899 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0788023ca0 con 0x555ac0a58820 2026-02-24T09:21:15.068 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f075cff9640 1 -- 10.20.193.4:0/2181496899 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0788013b40 con 0x555ac0a58820 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 1 -- 10.20.193.4:0/2181496899 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07840b3040 con 0x555ac0a58820 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f075cff9640 1 -- 10.20.193.4:0/2181496899 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f0788013cd0 con 0x555ac0a58820 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f075cff9640 10 client.18540 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 10 client.18540 _ll_register_callbacks cb 0x555ac08fa160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 1 -- 10.20.193.4:0/2181496899 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07840b3930 con 0x555ac0a58820 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f075cff9640 1 -- 10.20.193.4:0/2181496899 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0788023e10 con 0x555ac0a58820 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 10 client.18540 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 1 -- 10.20.193.4:0/2181496899 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x555ac08f4940 con 0x555ac0a58820 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f075cff9640 1 -- 10.20.193.4:0/2181496899 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f0788002d20 con 0x555ac0a58820 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 10 client.18540 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 10 client.18540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 20 client.18540 populate_metadata read hostname 'trial004' 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555ac0b4bfa0 0x555ac0b6c420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 4 client.18540 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f079b3cee00 1 -- 10.20.193.4:0/2181496899 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555ac0693160 con 0x555ac0b4bfa0 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.053+0000 7f07927fc640 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555ac0b4bfa0 0x555ac0b6c420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f07927fc640 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555ac0b4bfa0 0x555ac0b6c420 crc :-1 s=READY pgs=244 gs=4 cs=0 l=0 c_cookie=15400971881641700353 s_cookie=14788656557068128284 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5bb3e5419086c01 server_cookie=cd3bdcc8f54c101c in_seq=0 out_seq=0 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f075cff9640 10 client.18540 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:15.069 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f075cff9640 1 -- 10.20.193.4:0/2181496899 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6338 (crc 0 0 0) 0x555ac0693160 con 0x555ac0b4bfa0 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f075cff9640 10 client.18540 handle_command_reply: tid=0 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 client.18540 shutdown 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 -- 10.20.193.4:0/2181496899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a58820 msgr2=0x555ac0a385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a58820 0x555ac0a385a0 secure :-1 s=READY pgs=1388 gs=1 cs=0 l=1 c_cookie=1770881017110765218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x555ac0a9bf90 tx=0x7f0788004770 comp rx=0 tx=0).stop 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 -- 10.20.193.4:0/2181496899 shutdown_connections 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x555ac0b4bfa0 0x555ac0b6c420 crc :-1 s=READY pgs=244 gs=4 cs=0 l=0 c_cookie=15400971881641700353 s_cookie=14788656557068128284 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x555ac0a9ddd0 0x555ac0ae37c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x555ac0a59130 0x555ac0a38ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f075cff9640 0 client.18540 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 --2- 10.20.193.4:0/2181496899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x555ac0a58820 0x555ac0a385a0 unknown :-1 s=CLOSED pgs=1388 gs=1 cs=0 l=1 c_cookie=1770881017110765218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 -- 10.20.193.4:0/2181496899 >> 10.20.193.4:0/2181496899 conn(0x555ac09776b0 msgr2=0x555ac0ab2450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 -- 10.20.193.4:0/2181496899 shutdown_connections 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 1 -- 10.20.193.4:0/2181496899 wait complete. 2026-02-24T09:21:15.070 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.054+0000 7f079b3cee00 20 client.18540 trim_cache size 0 max 16384 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "status": "no active scrubs running", 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "scrubs": {}, 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_stats": { 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "50fcb56c-a674-4f78-aafd-69881ffc04d0": { 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:02.417630+0000", 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "a296d7a4-fbbb-44ef-bf0f-53257475ad3a": { 2026-02-24T09:21:15.071 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:20:44.219717+0000", 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "b703ea3c-d980-4a3f-b2c3-714d8f9ad80d": { 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:58.321748+0000", 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "1e753e7d-de39-4483-82a7-d40f8a0cf87e": { 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:18:24.171738+0000", 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.072 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "8a74e81b-c932-4485-9cf4-fe6952a41dd1": { 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:51.115696+0000", 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "b6915c9c-aada-4229-b2d4-e708c7197df4": { 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:44.292636+0000", 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "04559c85-9dcc-42e4-b7df-73a410372b47": { 2026-02-24T09:21:15.073 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:09:53.950606+0000", 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "6a3e476f-236c-4f0d-be47-9df08723e765": { 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:16:10.005631+0000", 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "7f3fcd8b-96a7-4762-a5be-feb95dd814b9": { 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:20:10.919666+0000", 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.074 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "b89351e3-8bfb-4aeb-abff-026d3e31e37b": { 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:34.742667+0000", 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "7814ad38-6799-499f-8516-f4981ab6b146": { 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:11:01.404640+0000", 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "1b96bf61-9a9e-4b35-92f5-cc2dbdb8a23a": { 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:43.221665+0000", 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.075 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "d858422f-a1fb-4a4f-9552-50c4ec759bed": { 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:08.958668+0000", 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "401d3135-d6c9-48d4-ba02-eb0a9aee9051": { 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:12:46.963555+0000", 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.076 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "771efb4b-4e74-4728-bdd5-b424e1f6ef1d": { 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:17:17.594669+0000", 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "8a539be5-29bd-4316-82f2-87aec88aa8d9": { 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:55.430547+0000", 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "cd6acc8a-6f69-46f8-804a-f8a1e029e7ad": { 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:13:21.147551+0000", 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.077 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "2f927036-df4b-4f13-8dfb-f86e239bd88a": { 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:10:27.037642+0000", 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "8cb15914-baf4-40f4-a213-ea7a448da074": { 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:35.755625+0000", 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "02c4bb30-7b42-4907-8bbf-d28c355c477b": { 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:19:36.960639+0000", 2026-02-24T09:21:15.078 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "decad7a7-69bd-4dbf-948b-081612f34ad7": { 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:15:01.834609+0000", 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "5b1b5ffd-dbda-4049-9d28-adbb3bc41adf": { 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "start_time": "2026-02-24T09:14:28.725572+0000", 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "path": "/", 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_passed": 0, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_failed": 0, 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_skipped": 0 2026-02-24T09:21:15.079 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 -- 10.20.193.4:0/3427329621 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f07680b5750 msgr2=0x7f07680d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f07680b5750 0x7f07680d5c00 secure :-1 s=READY pgs=473 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0788004740 tx=0x7f0788009190 comp rx=0 tx=0).stop 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 -- 10.20.193.4:0/3427329621 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0794115430 msgr2=0x7f07940f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0794115430 0x7f07940f5b90 secure :-1 s=READY pgs=1384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0784006e90 tx=0x7f078400edf0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 -- 10.20.193.4:0/3427329621 shutdown_connections 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f07680b5750 0x7f07680d5c00 unknown :-1 s=CLOSED pgs=473 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f0794115430 0x7f07940f5b90 unknown :-1 s=CLOSED pgs=1384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f079410fc30 0x7f0794175d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 --2- 10.20.193.4:0/3427329621 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f079410f240 0x7f07940f5490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 -- 10.20.193.4:0/3427329621 >> 10.20.193.4:0/3427329621 conn(0x7f07940ecaf0 msgr2=0x7f0794111a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 -- 10.20.193.4:0/3427329621 shutdown_connections 2026-02-24T09:21:15.080 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.055+0000 7f0793fff640 1 -- 10.20.193.4:0/3427329621 wait complete. 2026-02-24T09:21:15.094 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:14 trial004 ceph-mon[41596]: pgmap v495: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 174 MiB/s wr, 84 op/s 2026-02-24T09:21:15.118 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-24T09:21:15.118 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:21:15.233 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:15.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:14 trial090 ceph-mon[47278]: pgmap v495: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 174 MiB/s wr, 84 op/s 2026-02-24T09:21:15.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 -- 10.20.193.4:0/1252808995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9654115470 msgr2=0x7f9654175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.338 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 --2- 10.20.193.4:0/1252808995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9654115470 0x7f9654175e40 secure :-1 s=READY pgs=1389 gs=1 cs=0 l=1 c_cookie=2793310026590054179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964800aa30 tx=0x7f9648030280 comp rx=0 tx=0).stop 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 -- 10.20.193.4:0/1252808995 shutdown_connections 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 --2- 10.20.193.4:0/1252808995 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9654115470 0x7f9654175e40 unknown :-1 s=CLOSED pgs=1389 gs=1 cs=0 l=1 c_cookie=2793310026590054179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 --2- 10.20.193.4:0/1252808995 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965410fc70 0x7f9654114cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 --2- 10.20.193.4:0/1252808995 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965410f280 0x7f965410f650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 -- 10.20.193.4:0/1252808995 >> 10.20.193.4:0/1252808995 conn(0x7f965405f830 msgr2=0x7f965410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 -- 10.20.193.4:0/1252808995 shutdown_connections 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 -- 10.20.193.4:0/1252808995 wait complete. 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 Processor -- start 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 -- start start 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965410f280 0x7f965411dc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.339 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965410fc70 0x7f965411e150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9654115470 0x7f9654123520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9654123b40 con 0x7f9654115470 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9654123cb0 con 0x7f965410f280 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.333+0000 7f9659f07640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9654123e70 con 0x7f965410fc70 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9653fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9654115470 0x7f9654123520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9653fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9654115470 0x7f9654123520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42364/0 (socket says 10.20.193.4:42364) 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9653fff640 1 -- 10.20.193.4:0/441805354 learned_addr learned my addr 10.20.193.4:0/441805354 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f96537fe640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965410f280 0x7f965411dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9652ffd640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965410fc70 0x7f965411e150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9653fff640 1 -- 10.20.193.4:0/441805354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965410fc70 msgr2=0x7f965411e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9653fff640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965410fc70 0x7f965411e150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.340 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9653fff640 1 -- 10.20.193.4:0/441805354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965410f280 msgr2=0x7f965411dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9653fff640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965410f280 0x7f965411dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9653fff640 1 -- 10.20.193.4:0/441805354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964800a650 con 0x7f9654115470 2026-02-24T09:21:15.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f96537fe640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965410f280 0x7f965411dc10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:15.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9653fff640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9654115470 0x7f9654123520 secure :-1 s=READY pgs=1390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964800a330 tx=0x7f96480039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9650ff9640 1 -- 10.20.193.4:0/441805354 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f964803e070 con 0x7f9654115470 2026-02-24T09:21:15.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9659f07640 1 -- 10.20.193.4:0/441805354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96541240f0 con 0x7f9654115470 2026-02-24T09:21:15.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9650ff9640 1 -- 10.20.193.4:0/441805354 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f96480055a0 con 0x7f9654115470 2026-02-24T09:21:15.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9650ff9640 1 -- 10.20.193.4:0/441805354 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9648042910 con 0x7f9654115470 2026-02-24T09:21:15.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9659f07640 1 -- 10.20.193.4:0/441805354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9654164850 con 0x7f9654115470 2026-02-24T09:21:15.341 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.334+0000 7f9659f07640 1 -- 10.20.193.4:0/441805354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96541243c0 con 0x7f9654115470 2026-02-24T09:21:15.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.336+0000 7f9650ff9640 1 -- 10.20.193.4:0/441805354 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9648042b20 con 0x7f9654115470 2026-02-24T09:21:15.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.336+0000 7f9650ff9640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96280b56e0 0x7f96280d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.342 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.336+0000 7f96537fe640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96280b56e0 0x7f96280d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.336+0000 7f9650ff9640 1 -- 10.20.193.4:0/441805354 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f964810ce00 con 0x7f9654115470 2026-02-24T09:21:15.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.337+0000 7f96537fe640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96280b56e0 0x7f96280d5b90 secure :-1 s=READY pgs=474 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9640004740 tx=0x7f9640005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.337+0000 7f9650ff9640 1 -- 10.20.193.4:0/441805354 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f96480cf780 con 0x7f9654115470 2026-02-24T09:21:15.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:14 trial014 ceph-mon[46941]: pgmap v495: 97 pgs: 97 active+clean; 6.0 GiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 174 MiB/s wr, 84 op/s 2026-02-24T09:21:15.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.468+0000 7f9659f07640 1 -- 10.20.193.4:0/441805354 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f965411ed70 con 0x7f9654115470 2026-02-24T09:21:15.472 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.469+0000 7f9650ff9640 1 -- 10.20.193.4:0/441805354 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f96480d2930 con 0x7f9654115470 2026-02-24T09:21:15.473 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:21:15.473 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:21:15.474 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:21:15.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 -- 10.20.193.4:0/441805354 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96280b56e0 msgr2=0x7f96280d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96280b56e0 0x7f96280d5b90 secure :-1 s=READY pgs=474 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9640004740 tx=0x7f9640005f90 comp rx=0 tx=0).stop 2026-02-24T09:21:15.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 -- 10.20.193.4:0/441805354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9654115470 msgr2=0x7f9654123520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9654115470 0x7f9654123520 secure :-1 s=READY pgs=1390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964800a330 tx=0x7f96480039b0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 -- 10.20.193.4:0/441805354 shutdown_connections 2026-02-24T09:21:15.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f96280b56e0 0x7f96280d5b90 unknown :-1 s=CLOSED pgs=474 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.474 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9654115470 0x7f9654123520 unknown :-1 s=CLOSED pgs=1390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f965410fc70 0x7f965411e150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 --2- 10.20.193.4:0/441805354 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f965410f280 0x7f965411dc10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 -- 10.20.193.4:0/441805354 >> 10.20.193.4:0/441805354 conn(0x7f965405f830 msgr2=0x7f965410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 -- 10.20.193.4:0/441805354 shutdown_connections 2026-02-24T09:21:15.475 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.470+0000 7f9659f07640 1 -- 10.20.193.4:0/441805354 wait complete. 2026-02-24T09:21:15.511 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-24T09:21:15.625 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:15.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.726+0000 7f50e9f1a640 1 -- 10.20.193.4:0/2439903970 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f50e4110040 msgr2=0x7f50e4115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.726+0000 7f50e9f1a640 1 --2- 10.20.193.4:0/2439903970 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f50e4110040 0x7f50e4115090 secure :-1 s=READY pgs=1391 gs=1 cs=0 l=1 c_cookie=8277794724141647715 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d4009950 tx=0x7f50d402f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.726+0000 7f50e9f1a640 1 -- 10.20.193.4:0/2439903970 shutdown_connections 2026-02-24T09:21:15.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.726+0000 7f50e9f1a640 1 --2- 10.20.193.4:0/2439903970 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50e4115840 0x7f50e4176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.732 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.726+0000 7f50e9f1a640 1 --2- 10.20.193.4:0/2439903970 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f50e4110040 0x7f50e4115090 unknown :-1 s=CLOSED pgs=1391 gs=1 cs=0 l=1 c_cookie=8277794724141647715 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.726+0000 7f50e9f1a640 1 --2- 10.20.193.4:0/2439903970 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50e410f650 0x7f50e410fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.726+0000 7f50e9f1a640 1 -- 10.20.193.4:0/2439903970 >> 10.20.193.4:0/2439903970 conn(0x7f50e40ecf20 msgr2=0x7f50e410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.726+0000 7f50e9f1a640 1 -- 10.20.193.4:0/2439903970 shutdown_connections 2026-02-24T09:21:15.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.726+0000 7f50e9f1a640 1 -- 10.20.193.4:0/2439903970 wait complete. 2026-02-24T09:21:15.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e9f1a640 1 Processor -- start 2026-02-24T09:21:15.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e9f1a640 1 -- start start 2026-02-24T09:21:15.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e9f1a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50e410f650 0x7f50e40f5890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e9f1a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50e4110040 0x7f50e4176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e9f1a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f50e4115840 0x7f50e40f5f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.733 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e9f1a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40fb1a0 con 0x7f50e4115840 2026-02-24T09:21:15.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e9f1a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40fb310 con 0x7f50e4110040 2026-02-24T09:21:15.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e9f1a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40fb4d0 con 0x7f50e410f650 2026-02-24T09:21:15.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f50e4115840 0x7f50e40f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e3fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f50e4115840 0x7f50e40f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42372/0 (socket says 10.20.193.4:42372) 2026-02-24T09:21:15.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e3fff640 1 -- 10.20.193.4:0/3910003936 learned_addr learned my addr 10.20.193.4:0/3910003936 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e37fe640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50e410f650 0x7f50e40f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50e4110040 0x7f50e4176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e3fff640 1 -- 10.20.193.4:0/3910003936 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50e410f650 msgr2=0x7f50e40f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e3fff640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50e410f650 0x7f50e40f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.734 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e3fff640 1 -- 10.20.193.4:0/3910003936 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50e4110040 msgr2=0x7f50e4176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e3fff640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50e4110040 0x7f50e4176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e3fff640 1 -- 10.20.193.4:0/3910003936 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d4009570 con 0x7f50e4115840 2026-02-24T09:21:15.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50e4110040 0x7f50e4176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:15.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e3fff640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f50e4115840 0x7f50e40f5f90 secure :-1 s=READY pgs=1392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d8006e90 tx=0x7f50d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e0ff9640 1 -- 10.20.193.4:0/3910003936 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d8005500 con 0x7f50e4115840 2026-02-24T09:21:15.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e9f1a640 1 -- 10.20.193.4:0/3910003936 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e40fb7b0 con 0x7f50e4115840 2026-02-24T09:21:15.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e0ff9640 1 -- 10.20.193.4:0/3910003936 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f50d8005e10 con 0x7f50e4115840 2026-02-24T09:21:15.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e0ff9640 1 -- 10.20.193.4:0/3910003936 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d8003a90 con 0x7f50e4115840 2026-02-24T09:21:15.735 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.727+0000 7f50e9f1a640 1 -- 10.20.193.4:0/3910003936 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e40fbcd0 con 0x7f50e4115840 2026-02-24T09:21:15.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.729+0000 7f50e0ff9640 1 -- 10.20.193.4:0/3910003936 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f50d8003c20 con 0x7f50e4115840 2026-02-24T09:21:15.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.730+0000 7f50e0ff9640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50b80b56d0 0x7f50b80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.742 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.730+0000 7f50e0ff9640 1 -- 10.20.193.4:0/3910003936 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f50d80e7a60 con 0x7f50e4115840 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.730+0000 7f50e37fe640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50b80b56d0 0x7f50b80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.730+0000 7f50e37fe640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50b80b56d0 0x7f50b80d5b80 secure :-1 s=READY pgs=475 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d0004740 tx=0x7f50d0004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50ebf14e00 1 Processor -- start 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50ebf14e00 1 -- start start 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639babccf50 0x5639babcd320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639bac11fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639bac12500 0x5639bac328e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5639baaddee0 con 0x5639babcd860 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5639baad9c10 con 0x5639babccf50 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5639baad3d70 con 0x5639bac12500 2026-02-24T09:21:15.743 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50e2ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639bac11fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50e2ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639bac11fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42384/0 (socket says 10.20.193.4:42384) 2026-02-24T09:21:15.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50e2ffd640 1 -- 10.20.193.4:0/2703531957 learned_addr learned my addr 10.20.193.4:0/2703531957 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50e37fe640 1 --2- 10.20.193.4:0/2703531957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639babccf50 0x5639babcd320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50e2ffd640 1 -- 10.20.193.4:0/2703531957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639bac12500 msgr2=0x5639bac328e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/2703531957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639bac12500 0x5639bac328e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50e2ffd640 1 -- 10.20.193.4:0/2703531957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639babccf50 msgr2=0x5639babcd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/2703531957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639babccf50 0x5639babcd320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.731+0000 7f50e2ffd640 1 -- 10.20.193.4:0/2703531957 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639baa7f340 con 0x5639babcd860 2026-02-24T09:21:15.744 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/2703531957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639bac11fc0 secure :-1 s=READY pgs=1393 gs=1 cs=0 l=1 c_cookie=7040530329828714695 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d4005cc0 tx=0x7f50d4005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b4fd085bcde8c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50a7fff640 1 -- 10.20.193.4:0/2703531957 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d4038690 con 0x5639babcd860 2026-02-24T09:21:15.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50a7fff640 1 -- 10.20.193.4:0/2703531957 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f50d40026a0 con 0x5639babcd860 2026-02-24T09:21:15.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50a7fff640 1 -- 10.20.193.4:0/2703531957 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d4038ba0 con 0x5639babcd860 2026-02-24T09:21:15.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2703531957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 msgr2=0x5639bac11fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/2703531957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639bac11fc0 secure :-1 s=READY pgs=1393 gs=1 cs=0 l=1 c_cookie=7040530329828714695 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d4005cc0 tx=0x7f50d4005dd0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2703531957 shutdown_connections 2026-02-24T09:21:15.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/2703531957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639bac12500 0x5639bac328e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/2703531957 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639bac11fc0 unknown :-1 s=CLOSED pgs=1393 gs=1 cs=0 l=1 c_cookie=7040530329828714695 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/2703531957 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639babccf50 0x5639babcd320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.745 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2703531957 >> 10.20.193.4:0/2703531957 conn(0x5639baaebdb0 msgr2=0x5639babcb830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2703531957 shutdown_connections 2026-02-24T09:21:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.732+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2703531957 wait complete. 2026-02-24T09:21:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50ebf14e00 1 -- start start 2026-02-24T09:21:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50ebf14e00 1 Processor -- start 2026-02-24T09:21:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac29de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babcd860 0x5639bac2a320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bac2f310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5639bac2f850 con 0x5639babccf50 2026-02-24T09:21:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5639bac2f9c0 con 0x5639bac12500 2026-02-24T09:21:15.746 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5639bac2fb80 con 0x5639babcd860 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50e37fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac29de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50e37fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac29de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42388/0 (socket says 10.20.193.4:42388) 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50e37fe640 1 -- 10.20.193.4:0/2457400901 learned_addr learned my addr 10.20.193.4:0/2457400901 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babcd860 0x5639bac2a320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50e37fe640 1 -- 10.20.193.4:0/2457400901 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babcd860 msgr2=0x5639bac2a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50e37fe640 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babcd860 0x5639bac2a320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50e37fe640 1 -- 10.20.193.4:0/2457400901 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 msgr2=0x5639bac2f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50e37fe640 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bac2f310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50e37fe640 1 -- 10.20.193.4:0/2457400901 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639baa579d0 con 0x5639babccf50 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50e37fe640 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac29de0 secure :-1 s=READY pgs=1394 gs=1 cs=0 l=1 c_cookie=5080262514781550608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d0005d30 tx=0x7f50d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4680b7d73f497810 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.747 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.733+0000 7f50a57fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50a57fa640 1 -- 10.20.193.4:0/2457400901 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d001f870 con 0x5639babccf50 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2457400901 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e4176a80 con 0x5639babccf50 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50a57fa640 1 -- 10.20.193.4:0/2457400901 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f50d001e3d0 con 0x5639babccf50 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50a57fa640 1 -- 10.20.193.4:0/2457400901 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d0010650 con 0x5639babccf50 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 10 client.18558 _ll_register_callbacks cb 0x5639baa7e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2457400901 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5639ba8234a0 con 0x5639babccf50 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50a57fa640 1 -- 10.20.193.4:0/2457400901 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f50d00107e0 con 0x5639babccf50 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50a57fa640 1 -- 10.20.193.4:0/2457400901 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f50d00109c0 con 0x5639babccf50 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 10 client.18558 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2457400901 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5639baa69710 con 0x5639babccf50 2026-02-24T09:21:15.748 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50a57fa640 1 -- 10.20.193.4:0/2457400901 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f50d0010b60 con 0x5639babccf50 2026-02-24T09:21:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 10 client.18558 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 10 client.18558 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:21:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 20 client.18558 populate_metadata read hostname 'trial004' 2026-02-24T09:21:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5639bac0f940 0x5639bac0fdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 4 client.18558 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2457400901 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639baac97b0 con 0x5639bac0f940 2026-02-24T09:21:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.734+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5639bac0f940 0x5639bac0fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.735+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5639bac0f940 0x5639bac0fdb0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=9934533751392994673 s_cookie=2604095378732469148 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89de8dcfbce88571 server_cookie=24239af32a95cb9c in_seq=0 out_seq=0 2026-02-24T09:21:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.735+0000 7f50a57fa640 10 client.18558 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:21:15.749 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.735+0000 7f50a57fa640 1 -- 10.20.193.4:0/2457400901 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5639baac97b0 con 0x5639bac0f940 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.735+0000 7f50a57fa640 10 client.18558 handle_command_reply: tid=0 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.735+0000 7f50ebf14e00 1 client.18558 shutdown 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.735+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2457400901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 msgr2=0x5639bac29de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.735+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac29de0 secure :-1 s=READY pgs=1394 gs=1 cs=0 l=1 c_cookie=5080262514781550608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d0005d30 tx=0x7f50d0004770 comp rx=0 tx=0).stop 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.736+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2457400901 shutdown_connections 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.736+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5639bac0f940 0x5639bac0fdb0 crc :-1 s=READY pgs=64 gs=4 cs=0 l=0 c_cookie=9934533751392994673 s_cookie=2604095378732469148 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.736+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bac2f310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.736+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babcd860 0x5639bac2a320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.736+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/2457400901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac29de0 unknown :-1 s=CLOSED pgs=1394 gs=1 cs=0 l=1 c_cookie=5080262514781550608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.736+0000 7f50a57fa640 0 client.18558 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:21:15.750 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.736+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2457400901 >> 10.20.193.4:0/2457400901 conn(0x5639baaebdb0 msgr2=0x5639babcb040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.736+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2457400901 shutdown_connections 2026-02-24T09:21:15.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.736+0000 7f50ebf14e00 1 -- 10.20.193.4:0/2457400901 wait complete. 2026-02-24T09:21:15.751 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.736+0000 7f50ebf14e00 20 client.18558 trim_cache size 0 max 16384 2026-02-24T09:21:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50ebf14e00 1 Processor -- start 2026-02-24T09:21:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50ebf14e00 1 -- start start 2026-02-24T09:21:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac2e880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babcd860 0x5639bac0d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bac0d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.758 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5639baad19a0 con 0x5639babccf50 2026-02-24T09:21:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5639ba8addf0 con 0x5639bac12500 2026-02-24T09:21:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5639bab66f70 con 0x5639babcd860 2026-02-24T09:21:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50e37fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac2e880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50e37fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac2e880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42396/0 (socket says 10.20.193.4:42396) 2026-02-24T09:21:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.742+0000 7f50e37fe640 1 -- 10.20.193.4:0/1677623317 learned_addr learned my addr 10.20.193.4:0/1677623317 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50e3fff640 1 --2- 10.20.193.4:0/1677623317 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bac0d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50e37fe640 1 -- 10.20.193.4:0/1677623317 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babcd860 msgr2=0x5639bac0d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50e37fe640 1 --2- 10.20.193.4:0/1677623317 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babcd860 0x5639bac0d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50e37fe640 1 -- 10.20.193.4:0/1677623317 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 msgr2=0x5639bac0d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.759 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50e37fe640 1 --2- 10.20.193.4:0/1677623317 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bac0d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50e37fe640 1 -- 10.20.193.4:0/1677623317 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639bac1c440 con 0x5639babccf50 2026-02-24T09:21:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50e37fe640 1 --2- 10.20.193.4:0/1677623317 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac2e880 secure :-1 s=READY pgs=1395 gs=1 cs=0 l=1 c_cookie=838894700037783986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d0010f80 tx=0x7f50d002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba45a48f7b5c1b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50a77fe640 1 -- 10.20.193.4:0/1677623317 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d000fdb0 con 0x5639babccf50 2026-02-24T09:21:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50a77fe640 1 -- 10.20.193.4:0/1677623317 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x5639ba8234a0 con 0x5639babccf50 2026-02-24T09:21:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50a77fe640 1 -- 10.20.193.4:0/1677623317 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d00107e0 con 0x5639babccf50 2026-02-24T09:21:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50ebf14e00 1 -- 10.20.193.4:0/1677623317 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 msgr2=0x5639bac2e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/1677623317 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac2e880 secure :-1 s=READY pgs=1395 gs=1 cs=0 l=1 c_cookie=838894700037783986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d0010f80 tx=0x7f50d002b000 comp rx=0 tx=0).stop 2026-02-24T09:21:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50ebf14e00 1 -- 10.20.193.4:0/1677623317 shutdown_connections 2026-02-24T09:21:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/1677623317 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bac0d650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.760 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/1677623317 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babcd860 0x5639bac0d110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/1677623317 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babccf50 0x5639bac2e880 unknown :-1 s=CLOSED pgs=1395 gs=1 cs=0 l=1 c_cookie=838894700037783986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50ebf14e00 1 -- 10.20.193.4:0/1677623317 >> 10.20.193.4:0/1677623317 conn(0x5639baaebdb0 msgr2=0x5639bac2e170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50ebf14e00 1 -- 10.20.193.4:0/1677623317 shutdown_connections 2026-02-24T09:21:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.743+0000 7f50ebf14e00 1 -- 10.20.193.4:0/1677623317 wait complete. 2026-02-24T09:21:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 1 -- start start 2026-02-24T09:21:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 1 Processor -- start 2026-02-24T09:21:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babccf50 0x5639babab030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639babab570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bababab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.761 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5639bac790c0 con 0x5639babcd860 2026-02-24T09:21:15.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5639bac79200 con 0x5639bac12500 2026-02-24T09:21:15.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5639babb0080 con 0x5639babccf50 2026-02-24T09:21:15.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e2ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639babab570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e2ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639babab570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42398/0 (socket says 10.20.193.4:42398) 2026-02-24T09:21:15.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e2ffd640 1 -- 10.20.193.4:0/827234017 learned_addr learned my addr 10.20.193.4:0/827234017 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:15.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e3fff640 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bababab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e37fe640 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babccf50 0x5639babab030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e2ffd640 1 -- 10.20.193.4:0/827234017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babccf50 msgr2=0x5639babab030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babccf50 0x5639babab030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.762 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e2ffd640 1 -- 10.20.193.4:0/827234017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 msgr2=0x5639bababab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bababab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e2ffd640 1 -- 10.20.193.4:0/827234017 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639baa64190 con 0x5639babcd860 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e37fe640 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babccf50 0x5639babab030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50e2ffd640 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639babab570 secure :-1 s=READY pgs=1396 gs=1 cs=0 l=1 c_cookie=9207200349117615792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d4005e40 tx=0x7f50d4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc68bef89020eb0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50a57fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50a57fa640 1 -- 10.20.193.4:0/827234017 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d4002a30 con 0x5639babcd860 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 1 -- 10.20.193.4:0/827234017 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639baa69710 con 0x5639babcd860 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50a57fa640 1 -- 10.20.193.4:0/827234017 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f50d403c070 con 0x5639babcd860 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50a57fa640 1 -- 10.20.193.4:0/827234017 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50d4058740 con 0x5639babcd860 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 10 client.18564 _ll_register_callbacks cb 0x5639baa7e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:15.763 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50ebf14e00 1 -- 10.20.193.4:0/827234017 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50d40026a0 con 0x5639babcd860 2026-02-24T09:21:15.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.744+0000 7f50a57fa640 1 -- 10.20.193.4:0/827234017 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f50d40588a0 con 0x5639babcd860 2026-02-24T09:21:15.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50a57fa640 1 -- 10.20.193.4:0/827234017 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f50d4058a60 con 0x5639babcd860 2026-02-24T09:21:15.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 10 client.18564 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:15.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 1 -- 10.20.193.4:0/827234017 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5639baa57d00 con 0x5639babcd860 2026-02-24T09:21:15.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50a57fa640 1 -- 10.20.193.4:0/827234017 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f50d4058c40 con 0x5639babcd860 2026-02-24T09:21:15.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 10 client.18564 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:15.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 10 client.18564 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2026-02-24T09:21:15.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 20 client.18564 populate_metadata read hostname 'trial004' 2026-02-24T09:21:15.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5639bacc01c0 0x5639bace0670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:15.764 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 4 client.18564 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:21:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 1 -- 10.20.193.4:0/827234017 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5639ba808160 con 0x5639bacc01c0 2026-02-24T09:21:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50e37fe640 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5639bacc01c0 0x5639bace0670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50e37fe640 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5639bacc01c0 0x5639bace0670 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=3337275853506599456 s_cookie=12539385557095077146 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e5062b505bfda20 server_cookie=ae04d8ba4850d51a in_seq=0 out_seq=0 2026-02-24T09:21:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50a57fa640 10 client.18564 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:21:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50a57fa640 1 -- 10.20.193.4:0/827234017 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5639ba808160 con 0x5639bacc01c0 2026-02-24T09:21:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50a57fa640 10 client.18564 handle_command_reply: tid=0 2026-02-24T09:21:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 1 client.18564 shutdown 2026-02-24T09:21:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 1 -- 10.20.193.4:0/827234017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 msgr2=0x5639babab570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.745+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639babab570 secure :-1 s=READY pgs=1396 gs=1 cs=0 l=1 c_cookie=9207200349117615792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d4005e40 tx=0x7f50d4004740 comp rx=0 tx=0).stop 2026-02-24T09:21:15.765 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50ebf14e00 1 -- 10.20.193.4:0/827234017 shutdown_connections 2026-02-24T09:21:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x5639bacc01c0 0x5639bace0670 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=3337275853506599456 s_cookie=12539385557095077146 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5639bac12500 0x5639bababab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5639babcd860 0x5639babab570 unknown :-1 s=CLOSED pgs=1396 gs=1 cs=0 l=1 c_cookie=9207200349117615792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50a57fa640 0 client.18564 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:21:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50ebf14e00 1 --2- 10.20.193.4:0/827234017 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5639babccf50 0x5639babab030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50ebf14e00 1 -- 10.20.193.4:0/827234017 >> 10.20.193.4:0/827234017 conn(0x5639baaebdb0 msgr2=0x5639babcbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50ebf14e00 1 -- 10.20.193.4:0/827234017 shutdown_connections 2026-02-24T09:21:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50ebf14e00 1 -- 10.20.193.4:0/827234017 wait complete. 2026-02-24T09:21:15.766 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50ebf14e00 20 client.18564 trim_cache size 0 max 16384 2026-02-24T09:21:15.767 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:21:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 -- 10.20.193.4:0/3910003936 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50b80b56d0 msgr2=0x7f50b80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50b80b56d0 0x7f50b80d5b80 secure :-1 s=READY pgs=475 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d0004740 tx=0x7f50d0004420 comp rx=0 tx=0).stop 2026-02-24T09:21:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 -- 10.20.193.4:0/3910003936 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f50e4115840 msgr2=0x7f50e40f5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f50e4115840 0x7f50e40f5f90 secure :-1 s=READY pgs=1392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50d8006e90 tx=0x7f50d800edf0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 -- 10.20.193.4:0/3910003936 shutdown_connections 2026-02-24T09:21:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f50b80b56d0 0x7f50b80d5b80 unknown :-1 s=CLOSED pgs=475 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f50e4115840 0x7f50e40f5f90 unknown :-1 s=CLOSED pgs=1392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.768 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f50e4110040 0x7f50e4176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 --2- 10.20.193.4:0/3910003936 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50e410f650 0x7f50e40f5890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 -- 10.20.193.4:0/3910003936 >> 10.20.193.4:0/3910003936 conn(0x7f50e40ecf20 msgr2=0x7f50e4111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 -- 10.20.193.4:0/3910003936 shutdown_connections 2026-02-24T09:21:15.769 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.746+0000 7f50e9f1a640 1 -- 10.20.193.4:0/3910003936 wait complete. 2026-02-24T09:21:15.784 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-24T09:21:15.897 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:16.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.995+0000 7fae71f69640 1 -- 10.20.193.4:0/2023604987 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fae6c110040 msgr2=0x7fae6c115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.001 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.995+0000 7fae71f69640 1 --2- 10.20.193.4:0/2023604987 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fae6c110040 0x7fae6c115090 secure :-1 s=READY pgs=1397 gs=1 cs=0 l=1 c_cookie=16574832658673707500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae5c009950 tx=0x7fae5c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.995+0000 7fae71f69640 1 -- 10.20.193.4:0/2023604987 shutdown_connections 2026-02-24T09:21:16.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.995+0000 7fae71f69640 1 --2- 10.20.193.4:0/2023604987 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fae6c115840 0x7fae6c176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.995+0000 7fae71f69640 1 --2- 10.20.193.4:0/2023604987 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fae6c110040 0x7fae6c115090 unknown :-1 s=CLOSED pgs=1397 gs=1 cs=0 l=1 c_cookie=16574832658673707500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.995+0000 7fae71f69640 1 --2- 10.20.193.4:0/2023604987 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fae6c10f650 0x7fae6c10fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.995+0000 7fae71f69640 1 -- 10.20.193.4:0/2023604987 >> 10.20.193.4:0/2023604987 conn(0x7fae6c0ecf20 msgr2=0x7fae6c10d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.995+0000 7fae71f69640 1 -- 10.20.193.4:0/2023604987 shutdown_connections 2026-02-24T09:21:16.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.995+0000 7fae71f69640 1 -- 10.20.193.4:0/2023604987 wait complete. 2026-02-24T09:21:16.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.995+0000 7fae71f69640 1 Processor -- start 2026-02-24T09:21:16.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae71f69640 1 -- start start 2026-02-24T09:21:16.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae71f69640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fae6c10f650 0x7fae6c0f5860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae71f69640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fae6c110040 0x7fae6c176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae71f69640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fae6c115840 0x7fae6c0f5f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae71f69640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c0fb170 con 0x7fae6c10f650 2026-02-24T09:21:16.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae71f69640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c0fb2e0 con 0x7fae6c115840 2026-02-24T09:21:16.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae71f69640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c0fb4a0 con 0x7fae6c110040 2026-02-24T09:21:16.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fae6c10f650 0x7fae6c0f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6b7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fae6c10f650 0x7fae6c0f5860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42416/0 (socket says 10.20.193.4:42416) 2026-02-24T09:21:16.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6b7fe640 1 -- 10.20.193.4:0/4098201479 learned_addr learned my addr 10.20.193.4:0/4098201479 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6affd640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fae6c110040 0x7fae6c176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6bfff640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fae6c115840 0x7fae6c0f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6b7fe640 1 -- 10.20.193.4:0/4098201479 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fae6c110040 msgr2=0x7fae6c176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fae6c110040 0x7fae6c176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6b7fe640 1 -- 10.20.193.4:0/4098201479 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fae6c115840 msgr2=0x7fae6c0f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fae6c115840 0x7fae6c0f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6b7fe640 1 -- 10.20.193.4:0/4098201479 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5c009570 con 0x7fae6c10f650 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6affd640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fae6c110040 0x7fae6c176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6bfff640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fae6c115840 0x7fae6c0f5f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fae6c10f650 0x7fae6c0f5860 secure :-1 s=READY pgs=1398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae5800d950 tx=0x7fae5800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae68ff9640 1 -- 10.20.193.4:0/4098201479 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae58004540 con 0x7fae6c10f650 2026-02-24T09:21:16.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae68ff9640 1 -- 10.20.193.4:0/4098201479 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fae58009d00 con 0x7fae6c10f650 2026-02-24T09:21:16.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae71f69640 1 -- 10.20.193.4:0/4098201479 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6c0fb780 con 0x7fae6c10f650 2026-02-24T09:21:16.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae68ff9640 1 -- 10.20.193.4:0/4098201479 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae580106e0 con 0x7fae6c10f650 2026-02-24T09:21:16.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.996+0000 7fae71f69640 1 -- 10.20.193.4:0/4098201479 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6c0fbc50 con 0x7fae6c10f650 2026-02-24T09:21:16.012 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.998+0000 7fae68ff9640 1 -- 10.20.193.4:0/4098201479 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fae58010870 con 0x7fae6c10f650 2026-02-24T09:21:16.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.999+0000 7fae68ff9640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fae400b56d0 0x7fae400d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.999+0000 7fae6affd640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fae400b56d0 0x7fae400d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.999+0000 7fae68ff9640 1 -- 10.20.193.4:0/4098201479 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fae580e6f60 con 0x7fae6c10f650 2026-02-24T09:21:16.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:15.999+0000 7fae6affd640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fae400b56d0 0x7fae400d5b80 secure :-1 s=READY pgs=476 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae5c0098a0 tx=0x7fae5c031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae73f63e00 1 Processor -- start 2026-02-24T09:21:16.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae73f63e00 1 -- start start 2026-02-24T09:21:16.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 0x5654051a4320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.013 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a4860 0x5654051e8fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654052098e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae73f63e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5654050b4ee0 con 0x5654051e9500 2026-02-24T09:21:16.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae73f63e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5654050b0c10 con 0x5654051a3f50 2026-02-24T09:21:16.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae73f63e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5654050aad70 con 0x5654051a4860 2026-02-24T09:21:16.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654052098e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654052098e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42420/0 (socket says 10.20.193.4:42420) 2026-02-24T09:21:16.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6bfff640 1 -- 10.20.193.4:0/4036506171 learned_addr learned my addr 10.20.193.4:0/4036506171 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6affd640 1 --2- 10.20.193.4:0/4036506171 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a4860 0x5654051e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/4036506171 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 0x5654051a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.014 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6bfff640 1 -- 10.20.193.4:0/4036506171 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a4860 msgr2=0x5654051e8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6bfff640 1 --2- 10.20.193.4:0/4036506171 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a4860 0x5654051e8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6bfff640 1 -- 10.20.193.4:0/4036506171 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 msgr2=0x5654051a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6bfff640 1 --2- 10.20.193.4:0/4036506171 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 0x5654051a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6bfff640 1 -- 10.20.193.4:0/4036506171 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565405056340 con 0x5654051e9500 2026-02-24T09:21:16.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae6bfff640 1 --2- 10.20.193.4:0/4036506171 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654052098e0 secure :-1 s=READY pgs=1399 gs=1 cs=0 l=1 c_cookie=12157724773565562767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae60004b70 tx=0x7fae6000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b8ea4465577f8f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae2ffff640 1 -- 10.20.193.4:0/4036506171 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae60004c70 con 0x5654051e9500 2026-02-24T09:21:16.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae2ffff640 1 -- 10.20.193.4:0/4036506171 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fae60004dd0 con 0x5654051e9500 2026-02-24T09:21:16.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.000+0000 7fae2ffff640 1 -- 10.20.193.4:0/4036506171 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae60011920 con 0x5654051e9500 2026-02-24T09:21:16.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.001+0000 7fae73f63e00 1 -- 10.20.193.4:0/4036506171 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 msgr2=0x5654052098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.015 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.001+0000 7fae73f63e00 1 --2- 10.20.193.4:0/4036506171 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654052098e0 secure :-1 s=READY pgs=1399 gs=1 cs=0 l=1 c_cookie=12157724773565562767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae60004b70 tx=0x7fae6000f6c0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.001+0000 7fae73f63e00 1 -- 10.20.193.4:0/4036506171 shutdown_connections 2026-02-24T09:21:16.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.001+0000 7fae73f63e00 1 --2- 10.20.193.4:0/4036506171 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654052098e0 unknown :-1 s=CLOSED pgs=1399 gs=1 cs=0 l=1 c_cookie=12157724773565562767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.001+0000 7fae73f63e00 1 --2- 10.20.193.4:0/4036506171 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a4860 0x5654051e8fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.001+0000 7fae73f63e00 1 --2- 10.20.193.4:0/4036506171 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 0x5654051a4320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.001+0000 7fae73f63e00 1 -- 10.20.193.4:0/4036506171 >> 10.20.193.4:0/4036506171 conn(0x5654050c2db0 msgr2=0x5654051a2830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.001+0000 7fae73f63e00 1 -- 10.20.193.4:0/4036506171 shutdown_connections 2026-02-24T09:21:16.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.001+0000 7fae73f63e00 1 -- 10.20.193.4:0/4036506171 wait complete. 2026-02-24T09:21:16.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae73f63e00 1 -- start start 2026-02-24T09:21:16.016 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae73f63e00 1 Processor -- start 2026-02-24T09:21:16.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 0x565405200cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405201230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051e9500 0x565405206220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae73f63e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x565405206760 con 0x5654051a4860 2026-02-24T09:21:16.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae73f63e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5654052068d0 con 0x5654051e9500 2026-02-24T09:21:16.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae73f63e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x565405206a90 con 0x5654051a3f50 2026-02-24T09:21:16.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405201230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405201230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42424/0 (socket says 10.20.193.4:42424) 2026-02-24T09:21:16.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6affd640 1 -- 10.20.193.4:0/1981142612 learned_addr learned my addr 10.20.193.4:0/1981142612 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6bfff640 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051e9500 0x565405206220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 0x565405200cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6affd640 1 -- 10.20.193.4:0/1981142612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 msgr2=0x565405200cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6affd640 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 0x565405200cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6affd640 1 -- 10.20.193.4:0/1981142612 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051e9500 msgr2=0x565405206220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6affd640 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051e9500 0x565405206220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6affd640 1 -- 10.20.193.4:0/1981142612 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56540502e9d0 con 0x5654051a4860 2026-02-24T09:21:16.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 0x565405200cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:16.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae6affd640 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405201230 secure :-1 s=READY pgs=1400 gs=1 cs=0 l=1 c_cookie=7795670628836458763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae5c0042d0 tx=0x7fae5c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2fc92239be410b server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae2d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:16.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.002+0000 7fae2d7fa640 1 -- 10.20.193.4:0/1981142612 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae5c03f070 con 0x5654051a4860 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae2d7fa640 1 -- 10.20.193.4:0/1981142612 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fae5c04c040 con 0x5654051a4860 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 1 -- 10.20.193.4:0/1981142612 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae60004790 con 0x5654051a4860 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae2d7fa640 1 -- 10.20.193.4:0/1981142612 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae5c0503f0 con 0x5654051a4860 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 10 client.18576 _ll_register_callbacks cb 0x565405055080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 1 -- 10.20.193.4:0/1981142612 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565404dfa4a0 con 0x5654051a4860 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae2d7fa640 1 -- 10.20.193.4:0/1981142612 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fae5c050580 con 0x5654051a4860 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae2d7fa640 1 -- 10.20.193.4:0/1981142612 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fae5c050740 con 0x5654051a4860 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 10 client.18576 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 1 -- 10.20.193.4:0/1981142612 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x565405040710 con 0x5654051a4860 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae2d7fa640 1 -- 10.20.193.4:0/1981142612 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fae5c0433f0 con 0x5654051a4860 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 10 client.18576 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:16.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 10 client.18576 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:21:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 20 client.18576 populate_metadata read hostname 'trial004' 2026-02-24T09:21:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5654051e66f0 0x5654051e6b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 4 client.18576 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae73f63e00 1 -- 10.20.193.4:0/1981142612 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654050a07b0 con 0x5654051e66f0 2026-02-24T09:21:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5654051e66f0 0x5654051e6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5654051e66f0 0x5654051e6b90 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=10446981933939200370 s_cookie=7561068290464389117 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90fb22b7eb5e9172 server_cookie=68ee4f8cc79997fd in_seq=0 out_seq=0 2026-02-24T09:21:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.003+0000 7fae2d7fa640 10 client.18576 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:21:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae2d7fa640 1 -- 10.20.193.4:0/1981142612 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5654050a07b0 con 0x5654051e66f0 2026-02-24T09:21:16.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae2d7fa640 10 client.18576 handle_command_reply: tid=0 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 client.18576 shutdown 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 -- 10.20.193.4:0/1981142612 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 msgr2=0x565405201230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405201230 secure :-1 s=READY pgs=1400 gs=1 cs=0 l=1 c_cookie=7795670628836458763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae5c0042d0 tx=0x7fae5c009310 comp rx=0 tx=0).stop 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 -- 10.20.193.4:0/1981142612 shutdown_connections 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x5654051e66f0 0x5654051e6b90 crc :-1 s=READY pgs=65 gs=4 cs=0 l=0 c_cookie=10446981933939200370 s_cookie=7561068290464389117 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051e9500 0x565405206220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae2d7fa640 0 client.18576 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405201230 unknown :-1 s=CLOSED pgs=1400 gs=1 cs=0 l=1 c_cookie=7795670628836458763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 --2- 10.20.193.4:0/1981142612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 0x565405200cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 -- 10.20.193.4:0/1981142612 >> 10.20.193.4:0/1981142612 conn(0x5654050c2db0 msgr2=0x5654051a2040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.021 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 -- 10.20.193.4:0/1981142612 shutdown_connections 2026-02-24T09:21:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 1 -- 10.20.193.4:0/1981142612 wait complete. 2026-02-24T09:21:16.022 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.004+0000 7fae73f63e00 20 client.18576 trim_cache size 0 max 16384 2026-02-24T09:21:16.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae73f63e00 1 Processor -- start 2026-02-24T09:21:16.028 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae73f63e00 1 -- start start 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 0x5654051fdfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a4860 0x5654051fe510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654051e8260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae73f63e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5654050a89a0 con 0x5654051e9500 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae73f63e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x565404e84df0 con 0x5654051a4860 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae73f63e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x565405206bd0 con 0x5654051a3f50 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654051e8260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654051e8260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42426/0 (socket says 10.20.193.4:42426) 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6bfff640 1 -- 10.20.193.4:0/1882361955 learned_addr learned my addr 10.20.193.4:0/1882361955 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 0x5654051fdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.029 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6bfff640 1 -- 10.20.193.4:0/1882361955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 msgr2=0x5654051fdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6affd640 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a4860 0x5654051fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6bfff640 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 0x5654051fdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6bfff640 1 -- 10.20.193.4:0/1882361955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a4860 msgr2=0x5654051fe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6bfff640 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a4860 0x5654051fe510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6bfff640 1 -- 10.20.193.4:0/1882361955 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654051f3350 con 0x5654051e9500 2026-02-24T09:21:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 0x5654051fdfd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6affd640 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a4860 0x5654051fe510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae6bfff640 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654051e8260 secure :-1 s=READY pgs=1401 gs=1 cs=0 l=1 c_cookie=6385332341806710164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae60005430 tx=0x7fae6000fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589d41ef1633bd94 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae2f7fe640 1 -- 10.20.193.4:0/1882361955 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae600057e0 con 0x5654051e9500 2026-02-24T09:21:16.030 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae2f7fe640 1 -- 10.20.193.4:0/1882361955 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fae60022040 con 0x5654051e9500 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.011+0000 7fae2f7fe640 1 -- 10.20.193.4:0/1882361955 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae600067e0 con 0x5654051e9500 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 -- 10.20.193.4:0/1882361955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 msgr2=0x5654051e8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654051e8260 secure :-1 s=READY pgs=1401 gs=1 cs=0 l=1 c_cookie=6385332341806710164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae60005430 tx=0x7fae6000fde0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 -- 10.20.193.4:0/1882361955 shutdown_connections 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051e9500 0x5654051e8260 unknown :-1 s=CLOSED pgs=1401 gs=1 cs=0 l=1 c_cookie=6385332341806710164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a4860 0x5654051fe510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 --2- 10.20.193.4:0/1882361955 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051a3f50 0x5654051fdfd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 -- 10.20.193.4:0/1882361955 >> 10.20.193.4:0/1882361955 conn(0x5654050c2db0 msgr2=0x5654051fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 -- 10.20.193.4:0/1882361955 shutdown_connections 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 -- 10.20.193.4:0/1882361955 wait complete. 2026-02-24T09:21:16.031 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 -- start start 2026-02-24T09:21:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 Processor -- start 2026-02-24T09:21:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 0x565405185700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405185c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051e9500 0x56540524f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x565405186430 con 0x5654051a4860 2026-02-24T09:21:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5654051865a0 con 0x5654051a3f50 2026-02-24T09:21:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae73f63e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x56540524f6a0 con 0x5654051e9500 2026-02-24T09:21:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae6affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405185c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae6affd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405185c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42428/0 (socket says 10.20.193.4:42428) 2026-02-24T09:21:16.032 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae6affd640 1 -- 10.20.193.4:0/2638466423 learned_addr learned my addr 10.20.193.4:0/2638466423 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.012+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 0x565405185700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae6bfff640 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051e9500 0x56540524f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae6affd640 1 -- 10.20.193.4:0/2638466423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051e9500 msgr2=0x56540524f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae6affd640 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051e9500 0x56540524f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae6affd640 1 -- 10.20.193.4:0/2638466423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 msgr2=0x565405185700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae6affd640 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 0x565405185700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae6affd640 1 -- 10.20.193.4:0/2638466423 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56540503b190 con 0x5654051a4860 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae6bfff640 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051e9500 0x56540524f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 0x565405185700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae6affd640 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405185c40 secure :-1 s=READY pgs=1402 gs=1 cs=0 l=1 c_cookie=227845934723950840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae5c02fdc0 tx=0x7fae5c059f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32978aba2bce8f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.033 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae2d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae2d7fa640 1 -- 10.20.193.4:0/2638466423 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae5c0043d0 con 0x5654051a4860 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae2d7fa640 1 -- 10.20.193.4:0/2638466423 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fae5c04c070 con 0x5654051a4860 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 1 -- 10.20.193.4:0/2638466423 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565405056340 con 0x5654051a4860 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae2d7fa640 1 -- 10.20.193.4:0/2638466423 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae5c0596a0 con 0x5654051a4860 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 10 client.18582 _ll_register_callbacks cb 0x565405055080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 1 -- 10.20.193.4:0/2638466423 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae60004dd0 con 0x5654051a4860 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae2d7fa640 1 -- 10.20.193.4:0/2638466423 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fae5c059830 con 0x5654051a4860 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae2d7fa640 1 -- 10.20.193.4:0/2638466423 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fae5c0438b0 con 0x5654051a4860 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 10 client.18582 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 1 -- 10.20.193.4:0/2638466423 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56540502ed00 con 0x5654051a4860 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae2d7fa640 1 -- 10.20.193.4:0/2638466423 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fae5c039b40 con 0x5654051a4860 2026-02-24T09:21:16.034 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 10 client.18582 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 10 client.18582 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 20 client.18582 populate_metadata read hostname 'trial004' 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x565405297280 0x5654052b7730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 4 client.18582 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae73f63e00 1 -- 10.20.193.4:0/2638466423 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565404ddf160 con 0x565405297280 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.013+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x565405297280 0x5654052b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae2d7fa640 10 client.18582 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae6b7fe640 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x565405297280 0x5654052b7730 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=11996716547719653562 s_cookie=2159425761520322504 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a67ce62389e168ba server_cookie=1df7d249fa3f07c8 in_seq=0 out_seq=0 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae2d7fa640 1 -- 10.20.193.4:0/2638466423 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565404ddf160 con 0x565405297280 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae2d7fa640 10 client.18582 handle_command_reply: tid=0 2026-02-24T09:21:16.035 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 client.18582 shutdown 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 -- 10.20.193.4:0/2638466423 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 msgr2=0x565405185c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405185c40 secure :-1 s=READY pgs=1402 gs=1 cs=0 l=1 c_cookie=227845934723950840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae5c02fdc0 tx=0x7fae5c059f10 comp rx=0 tx=0).stop 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 -- 10.20.193.4:0/2638466423 shutdown_connections 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x565405297280 0x5654052b7730 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=11996716547719653562 s_cookie=2159425761520322504 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5654051e9500 0x56540524f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5654051a4860 0x565405185c40 unknown :-1 s=CLOSED pgs=1402 gs=1 cs=0 l=1 c_cookie=227845934723950840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae2d7fa640 0 client.18582 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 --2- 10.20.193.4:0/2638466423 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5654051a3f50 0x565405185700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 -- 10.20.193.4:0/2638466423 >> 10.20.193.4:0/2638466423 conn(0x5654050c2db0 msgr2=0x5654051fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 -- 10.20.193.4:0/2638466423 shutdown_connections 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 1 -- 10.20.193.4:0/2638466423 wait complete. 2026-02-24T09:21:16.036 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae73f63e00 20 client.18582 trim_cache size 0 max 16384 2026-02-24T09:21:16.037 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:21:16.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 -- 10.20.193.4:0/4098201479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fae400b56d0 msgr2=0x7fae400d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fae400b56d0 0x7fae400d5b80 secure :-1 s=READY pgs=476 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae5c0098a0 tx=0x7fae5c031040 comp rx=0 tx=0).stop 2026-02-24T09:21:16.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 -- 10.20.193.4:0/4098201479 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fae6c10f650 msgr2=0x7fae6c0f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fae6c10f650 0x7fae6c0f5860 secure :-1 s=READY pgs=1398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae5800d950 tx=0x7fae5800de20 comp rx=0 tx=0).stop 2026-02-24T09:21:16.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 -- 10.20.193.4:0/4098201479 shutdown_connections 2026-02-24T09:21:16.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fae400b56d0 0x7fae400d5b80 unknown :-1 s=CLOSED pgs=476 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fae6c115840 0x7fae6c0f5f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fae6c110040 0x7fae6c176110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.038 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 --2- 10.20.193.4:0/4098201479 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fae6c10f650 0x7fae6c0f5860 unknown :-1 s=CLOSED pgs=1398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 -- 10.20.193.4:0/4098201479 >> 10.20.193.4:0/4098201479 conn(0x7fae6c0ecf20 msgr2=0x7fae6c111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 -- 10.20.193.4:0/4098201479 shutdown_connections 2026-02-24T09:21:16.039 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.014+0000 7fae71f69640 1 -- 10.20.193.4:0/4098201479 wait complete. 2026-02-24T09:21:16.052 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-24T09:21:16.170 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:16.193 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:15 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/441805354' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:16.279 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.276+0000 7ffa891d6640 1 -- 10.20.193.4:0/354449534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa8410d3d0 msgr2=0x7ffa8410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.276+0000 7ffa891d6640 1 --2- 10.20.193.4:0/354449534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa8410d3d0 0x7ffa8410d7a0 secure :-1 s=READY pgs=1403 gs=1 cs=0 l=1 c_cookie=5236312419781234665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa78009950 tx=0x7ffa7802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.276+0000 7ffa891d6640 1 -- 10.20.193.4:0/354449534 shutdown_connections 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.276+0000 7ffa891d6640 1 --2- 10.20.193.4:0/354449534 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa841135c0 0x7ffa84173f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.276+0000 7ffa891d6640 1 --2- 10.20.193.4:0/354449534 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa8410ddc0 0x7ffa84112e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.276+0000 7ffa891d6640 1 --2- 10.20.193.4:0/354449534 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa8410d3d0 0x7ffa8410d7a0 unknown :-1 s=CLOSED pgs=1403 gs=1 cs=0 l=1 c_cookie=5236312419781234665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.276+0000 7ffa891d6640 1 -- 10.20.193.4:0/354449534 >> 10.20.193.4:0/354449534 conn(0x7ffa840eaca0 msgr2=0x7ffa8410b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.276+0000 7ffa891d6640 1 -- 10.20.193.4:0/354449534 shutdown_connections 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.276+0000 7ffa891d6640 1 -- 10.20.193.4:0/354449534 wait complete. 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa891d6640 1 Processor -- start 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa891d6640 1 -- start start 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa891d6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa8410d3d0 0x7ffa840f5850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa891d6640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa8410ddc0 0x7ffa84173e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.280 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa891d6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa841135c0 0x7ffa840f5f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa891d6640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ffa840fb160 con 0x7ffa8410d3d0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa891d6640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ffa840fb2d0 con 0x7ffa8410ddc0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa891d6640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa840fb490 con 0x7ffa841135c0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa82d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa8410d3d0 0x7ffa840f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa82d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa8410d3d0 0x7ffa840f5850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42448/0 (socket says 10.20.193.4:42448) 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa82d76640 1 -- 10.20.193.4:0/1731553555 learned_addr learned my addr 10.20.193.4:0/1731553555 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa82575640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa8410ddc0 0x7ffa84173e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa82d76640 1 -- 10.20.193.4:0/1731553555 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa841135c0 msgr2=0x7ffa840f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa82d76640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa841135c0 0x7ffa840f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa82d76640 1 -- 10.20.193.4:0/1731553555 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa8410ddc0 msgr2=0x7ffa84173e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa82d76640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa8410ddc0 0x7ffa84173e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa82d76640 1 -- 10.20.193.4:0/1731553555 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa78009570 con 0x7ffa8410d3d0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa82d76640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa8410d3d0 0x7ffa840f5850 secure :-1 s=READY pgs=1404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa780023d0 tx=0x7ffa780043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa63fff640 1 -- 10.20.193.4:0/1731553555 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa7803d070 con 0x7ffa8410d3d0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa63fff640 1 -- 10.20.193.4:0/1731553555 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa78038920 con 0x7ffa8410d3d0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa891d6640 1 -- 10.20.193.4:0/1731553555 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa840fb710 con 0x7ffa8410d3d0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa63fff640 1 -- 10.20.193.4:0/1731553555 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa780419d0 con 0x7ffa8410d3d0 2026-02-24T09:21:16.281 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.277+0000 7ffa891d6640 1 -- 10.20.193.4:0/1731553555 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa840fbbd0 con 0x7ffa8410d3d0 2026-02-24T09:21:16.282 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.279+0000 7ffa63fff640 1 -- 10.20.193.4:0/1731553555 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ffa78038a90 con 0x7ffa8410d3d0 2026-02-24T09:21:16.283 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.280+0000 7ffa63fff640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa580b5750 0x7ffa580d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.280+0000 7ffa82575640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa580b5750 0x7ffa580d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.280+0000 7ffa63fff640 1 -- 10.20.193.4:0/1731553555 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ffa7810b3c0 con 0x7ffa8410d3d0 2026-02-24T09:21:16.284 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.280+0000 7ffa82575640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa580b5750 0x7ffa580d5c00 secure :-1 s=READY pgs=477 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa840fc1f0 tx=0x7ffa6c005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa8b1d0e00 1 Processor -- start 2026-02-24T09:21:16.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa8b1d0e00 1 -- start start 2026-02-24T09:21:16.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 0x5607dbaaf320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaf860 0x5607dbaf3fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf4500 0x5607dbb148e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5607db9bfee0 con 0x5607dbaf4500 2026-02-24T09:21:16.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5607db9bbc10 con 0x5607dbaaef50 2026-02-24T09:21:16.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5607db9b5d70 con 0x5607dbaaf860 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa83577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf4500 0x5607dbb148e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa83577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf4500 0x5607dbb148e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42450/0 (socket says 10.20.193.4:42450) 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa83577640 1 -- 10.20.193.4:0/201968812 learned_addr learned my addr 10.20.193.4:0/201968812 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa82d76640 1 --2- 10.20.193.4:0/201968812 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 0x5607dbaaf320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa82575640 1 --2- 10.20.193.4:0/201968812 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaf860 0x5607dbaf3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa83577640 1 -- 10.20.193.4:0/201968812 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaf860 msgr2=0x5607dbaf3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa83577640 1 --2- 10.20.193.4:0/201968812 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaf860 0x5607dbaf3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa83577640 1 -- 10.20.193.4:0/201968812 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 msgr2=0x5607dbaaf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa83577640 1 --2- 10.20.193.4:0/201968812 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 0x5607dbaaf320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa83577640 1 -- 10.20.193.4:0/201968812 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607db961340 con 0x5607dbaf4500 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa82d76640 1 --2- 10.20.193.4:0/201968812 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 0x5607dbaaf320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa83577640 1 --2- 10.20.193.4:0/201968812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf4500 0x5607dbb148e0 secure :-1 s=READY pgs=1405 gs=1 cs=0 l=1 c_cookie=887811925659517494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa7400ab00 tx=0x7ffa7400e2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52243e184a8236 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa4f7fe640 1 -- 10.20.193.4:0/201968812 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa7400ed10 con 0x5607dbaf4500 2026-02-24T09:21:16.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa4f7fe640 1 -- 10.20.193.4:0/201968812 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa7400ee70 con 0x5607dbaf4500 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.282+0000 7ffa4f7fe640 1 -- 10.20.193.4:0/201968812 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa740116e0 con 0x5607dbaf4500 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.283+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/201968812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf4500 msgr2=0x5607dbb148e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.283+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/201968812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf4500 0x5607dbb148e0 secure :-1 s=READY pgs=1405 gs=1 cs=0 l=1 c_cookie=887811925659517494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa7400ab00 tx=0x7ffa7400e2e0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.283+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/201968812 shutdown_connections 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.283+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/201968812 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf4500 0x5607dbb148e0 unknown :-1 s=CLOSED pgs=1405 gs=1 cs=0 l=1 c_cookie=887811925659517494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.283+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/201968812 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaf860 0x5607dbaf3fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.283+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/201968812 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 0x5607dbaaf320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.283+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/201968812 >> 10.20.193.4:0/201968812 conn(0x5607db9cddb0 msgr2=0x5607dbaad830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.283+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/201968812 shutdown_connections 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.283+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/201968812 wait complete. 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa8b1d0e00 1 -- start start 2026-02-24T09:21:16.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa8b1d0e00 1 Processor -- start 2026-02-24T09:21:16.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaef50 0x5607dbb0bd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaf860 0x5607dbb0c250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaf4500 0x5607dbb11240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5607dbb11780 con 0x5607dbaaf860 2026-02-24T09:21:16.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5607dbb118f0 con 0x5607dbaf4500 2026-02-24T09:21:16.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5607dbb11ab0 con 0x5607dbaaef50 2026-02-24T09:21:16.293 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa82575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaf860 0x5607dbb0c250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa82575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaf860 0x5607dbb0c250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42452/0 (socket says 10.20.193.4:42452) 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa82575640 1 -- 10.20.193.4:0/2192901234 learned_addr learned my addr 10.20.193.4:0/2192901234 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa82d76640 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaef50 0x5607dbb0bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa82575640 1 -- 10.20.193.4:0/2192901234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaef50 msgr2=0x5607dbb0bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa82575640 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaef50 0x5607dbb0bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa83577640 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaf4500 0x5607dbb11240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa82575640 1 -- 10.20.193.4:0/2192901234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaf4500 msgr2=0x5607dbb11240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa82575640 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaf4500 0x5607dbb11240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa82575640 1 -- 10.20.193.4:0/2192901234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607db9399d0 con 0x5607dbaaf860 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa83577640 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaf4500 0x5607dbb11240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa82575640 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaf860 0x5607dbb0c250 secure :-1 s=READY pgs=1406 gs=1 cs=0 l=1 c_cookie=5817340876825647893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa6c00fea0 tx=0x7ffa6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bb58b4b48d5b15 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa4cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:16.294 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa4cff9640 1 -- 10.20.193.4:0/2192901234 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa6c01f870 con 0x5607dbaaf860 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa4cff9640 1 -- 10.20.193.4:0/2192901234 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa6c011e60 con 0x5607dbaaf860 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa4cff9640 1 -- 10.20.193.4:0/2192901234 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa6c0103d0 con 0x5607dbaaf860 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2192901234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7400a720 con 0x5607dbaaf860 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa4cff9640 1 -- 10.20.193.4:0/2192901234 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ffa6c010560 con 0x5607dbaaf860 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.284+0000 7ffa4cff9640 10 client.18594 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa8b1d0e00 10 client.18594 _ll_register_callbacks cb 0x5607db960080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2192901234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5607db7054a0 con 0x5607dbaaf860 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa4cff9640 1 -- 10.20.193.4:0/2192901234 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffa6c01eb30 con 0x5607dbaaf860 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa8b1d0e00 10 client.18594 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2192901234 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5607db94b710 con 0x5607dbaaf860 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa4cff9640 1 -- 10.20.193.4:0/2192901234 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ffa6c030020 con 0x5607dbaaf860 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa8b1d0e00 10 client.18594 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa8b1d0e00 10 client.18594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa8b1d0e00 20 client.18594 populate_metadata read hostname 'trial004' 2026-02-24T09:21:16.295 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5607dbaf16c0 0x5607dbaf1b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa8b1d0e00 4 client.18594 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2192901234 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607db9ab7b0 con 0x5607dbaf16c0 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa82d76640 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5607dbaf16c0 0x5607dbaf1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa4cff9640 10 client.18594 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.285+0000 7ffa82d76640 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5607dbaf16c0 0x5607dbaf1b60 crc :-1 s=READY pgs=245 gs=4 cs=0 l=0 c_cookie=656361630470050689 s_cookie=7092598700977861690 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91bdd6ce45d1381 server_cookie=626df8f0ba2eb43a in_seq=0 out_seq=0 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa4cff9640 1 -- 10.20.193.4:0/2192901234 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x5607db9ab7b0 con 0x5607dbaf16c0 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa4cff9640 10 client.18594 handle_command_reply: tid=0 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 client.18594 shutdown 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2192901234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaf860 msgr2=0x5607dbb0c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaf860 0x5607dbb0c250 secure :-1 s=READY pgs=1406 gs=1 cs=0 l=1 c_cookie=5817340876825647893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa6c00fea0 tx=0x7ffa6c004770 comp rx=0 tx=0).stop 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2192901234 shutdown_connections 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5607dbaf16c0 0x5607dbaf1b60 crc :-1 s=READY pgs=245 gs=4 cs=0 l=0 c_cookie=656361630470050689 s_cookie=7092598700977861690 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.296 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaf4500 0x5607dbb11240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaf860 0x5607dbb0c250 unknown :-1 s=CLOSED pgs=1406 gs=1 cs=0 l=1 c_cookie=5817340876825647893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa4cff9640 0 client.18594 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:16.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/2192901234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaef50 0x5607dbb0bd10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2192901234 >> 10.20.193.4:0/2192901234 conn(0x5607db9cddb0 msgr2=0x5607dbaad040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2192901234 shutdown_connections 2026-02-24T09:21:16.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2192901234 wait complete. 2026-02-24T09:21:16.297 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.286+0000 7ffa8b1d0e00 20 client.18594 trim_cache size 0 max 16384 2026-02-24T09:21:16.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.293+0000 7ffa8b1d0e00 1 Processor -- start 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.293+0000 7ffa8b1d0e00 1 -- start start 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.293+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 0x5607dbaef160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.293+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaf860 0x5607dbaef6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.293+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf16c0 0x5607dbb08fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5607dbb11640 con 0x5607dbaf16c0 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5607db9b39a0 con 0x5607dbaaef50 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5607db78fdf0 con 0x5607dbaaf860 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa83577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf16c0 0x5607dbb08fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa83577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf16c0 0x5607dbb08fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42458/0 (socket says 10.20.193.4:42458) 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa83577640 1 -- 10.20.193.4:0/2559027398 learned_addr learned my addr 10.20.193.4:0/2559027398 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa82575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaf860 0x5607dbaef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa82d76640 1 --2- 10.20.193.4:0/2559027398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 0x5607dbaef160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa83577640 1 -- 10.20.193.4:0/2559027398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaf860 msgr2=0x5607dbaef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa83577640 1 --2- 10.20.193.4:0/2559027398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaf860 0x5607dbaef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa83577640 1 -- 10.20.193.4:0/2559027398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 msgr2=0x5607dbaef160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa83577640 1 --2- 10.20.193.4:0/2559027398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 0x5607dbaef160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa83577640 1 -- 10.20.193.4:0/2559027398 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607dbaf97e0 con 0x5607dbaf16c0 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa83577640 1 --2- 10.20.193.4:0/2559027398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf16c0 0x5607dbb08fd0 secure :-1 s=READY pgs=1407 gs=1 cs=0 l=1 c_cookie=374690104433678880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa74003490 tx=0x7ffa74006e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5332aaa2f9f9a20 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa4effd640 1 -- 10.20.193.4:0/2559027398 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa74020070 con 0x5607dbaf16c0 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa4effd640 1 -- 10.20.193.4:0/2559027398 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa74003c60 con 0x5607dbaf16c0 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa4effd640 1 -- 10.20.193.4:0/2559027398 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa74011850 con 0x5607dbaf16c0 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2559027398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf16c0 msgr2=0x5607dbb08fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/2559027398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf16c0 0x5607dbb08fd0 secure :-1 s=READY pgs=1407 gs=1 cs=0 l=1 c_cookie=374690104433678880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa74003490 tx=0x7ffa74006e20 comp rx=0 tx=0).stop 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2559027398 shutdown_connections 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/2559027398 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaf16c0 0x5607dbb08fd0 unknown :-1 s=CLOSED pgs=1407 gs=1 cs=0 l=1 c_cookie=374690104433678880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/2559027398 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaaf860 0x5607dbaef6a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/2559027398 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaef50 0x5607dbaef160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2559027398 >> 10.20.193.4:0/2559027398 conn(0x5607db9cddb0 msgr2=0x5607dbb088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2559027398 shutdown_connections 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.294+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/2559027398 wait complete. 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa8b1d0e00 1 -- start start 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa8b1d0e00 1 Processor -- start 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaef50 0x5607dba8e720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaf860 0x5607dba8ec60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa8b1d0e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaf16c0 0x5607dbb5a100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x5607dba8f4a0 con 0x5607dbaaef50 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x5607dbb5a640 con 0x5607dbaaf860 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa8b1d0e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x5607dbb5a800 con 0x5607dbaf16c0 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa82d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaef50 0x5607dba8e720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa82d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaef50 0x5607dba8e720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42466/0 (socket says 10.20.193.4:42466) 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa82d76640 1 -- 10.20.193.4:0/510301604 learned_addr learned my addr 10.20.193.4:0/510301604 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa82d76640 1 -- 10.20.193.4:0/510301604 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaf16c0 msgr2=0x5607dbb5a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa82d76640 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaf16c0 0x5607dbb5a100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa82d76640 1 -- 10.20.193.4:0/510301604 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaf860 msgr2=0x5607dba8ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa82d76640 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaf860 0x5607dba8ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa82d76640 1 -- 10.20.193.4:0/510301604 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607db946190 con 0x5607dbaaef50 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa82d76640 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaef50 0x5607dba8e720 secure :-1 s=READY pgs=1408 gs=1 cs=0 l=1 c_cookie=18307859442629571300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa78005b30 tx=0x7ffa78002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe129529f3b772e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.295+0000 7ffa4cff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa4cff9640 1 -- 10.20.193.4:0/510301604 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa780d25a0 con 0x5607dbaaef50 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/510301604 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607db961340 con 0x5607dbaaef50 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa4cff9640 1 -- 10.20.193.4:0/510301604 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa780d7410 con 0x5607dbaaef50 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa4cff9640 1 -- 10.20.193.4:0/510301604 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa78096b00 con 0x5607dbaaef50 2026-02-24T09:21:16.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 10 client.18600 _ll_register_callbacks cb 0x5607db960080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/510301604 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa7400ee70 con 0x5607dbaaef50 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa4cff9640 1 -- 10.20.193.4:0/510301604 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ffa780cf6d0 con 0x5607dbaaef50 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa4cff9640 1 -- 10.20.193.4:0/510301604 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffa780cf890 con 0x5607dbaaef50 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 10 client.18600 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/510301604 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x5607db939d00 con 0x5607dbaaef50 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa4cff9640 1 -- 10.20.193.4:0/510301604 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7ffa780d30e0 con 0x5607dbaaef50 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 10 client.18600 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 10 client.18600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 20 client.18600 populate_metadata read hostname 'trial004' 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5607dbaf4500 0x5607dbbc2750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 4 client.18600 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/510301604 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5607db6ea160 con 0x5607dbaf4500 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.296+0000 7ffa82575640 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5607dbaf4500 0x5607dbbc2750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa82575640 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5607dbaf4500 0x5607dbbc2750 crc :-1 s=READY pgs=246 gs=4 cs=0 l=0 c_cookie=7340493654834721048 s_cookie=17478473241085642696 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65deac16646eb118 server_cookie=f29002cecf1487c8 in_seq=0 out_seq=0 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa4cff9640 10 client.18600 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa4cff9640 1 -- 10.20.193.4:0/510301604 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5607db6ea160 con 0x5607dbaf4500 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa4cff9640 10 client.18600 handle_command_reply: tid=0 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 client.18600 shutdown 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/510301604 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaef50 msgr2=0x5607dba8e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaef50 0x5607dba8e720 secure :-1 s=READY pgs=1408 gs=1 cs=0 l=1 c_cookie=18307859442629571300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa78005b30 tx=0x7ffa78002b90 comp rx=0 tx=0).stop 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/510301604 shutdown_connections 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x5607dbaf4500 0x5607dbbc2750 crc :-1 s=READY pgs=246 gs=4 cs=0 l=0 c_cookie=7340493654834721048 s_cookie=17478473241085642696 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x5607dbaf16c0 0x5607dbb5a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x5607dbaaf860 0x5607dba8ec60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa4cff9640 0 client.18600 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 --2- 10.20.193.4:0/510301604 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x5607dbaaef50 0x5607dba8e720 unknown :-1 s=CLOSED pgs=1408 gs=1 cs=0 l=1 c_cookie=18307859442629571300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/510301604 >> 10.20.193.4:0/510301604 conn(0x5607db9cddb0 msgr2=0x5607dbb08fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/510301604 shutdown_connections 2026-02-24T09:21:16.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 1 -- 10.20.193.4:0/510301604 wait complete. 2026-02-24T09:21:16.308 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.297+0000 7ffa8b1d0e00 20 client.18600 trim_cache size 0 max 16384 2026-02-24T09:21:16.308 INFO:teuthology.orchestra.run.trial004.stdout:[] 2026-02-24T09:21:16.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 -- 10.20.193.4:0/1731553555 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa580b5750 msgr2=0x7ffa580d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa580b5750 0x7ffa580d5c00 secure :-1 s=READY pgs=477 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa840fc1f0 tx=0x7ffa6c005d00 comp rx=0 tx=0).stop 2026-02-24T09:21:16.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 -- 10.20.193.4:0/1731553555 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa8410d3d0 msgr2=0x7ffa840f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa8410d3d0 0x7ffa840f5850 secure :-1 s=READY pgs=1404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa780023d0 tx=0x7ffa780043d0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 -- 10.20.193.4:0/1731553555 shutdown_connections 2026-02-24T09:21:16.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ffa580b5750 0x7ffa580d5c00 unknown :-1 s=CLOSED pgs=477 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffa841135c0 0x7ffa840f5f50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ffa8410ddc0 0x7ffa84173e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.309 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 --2- 10.20.193.4:0/1731553555 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ffa8410d3d0 0x7ffa840f5850 unknown :-1 s=CLOSED pgs=1404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 -- 10.20.193.4:0/1731553555 >> 10.20.193.4:0/1731553555 conn(0x7ffa840eaca0 msgr2=0x7ffa84110520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 -- 10.20.193.4:0/1731553555 shutdown_connections 2026-02-24T09:21:16.310 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.298+0000 7ffa891d6640 1 -- 10.20.193.4:0/1731553555 wait complete. 2026-02-24T09:21:16.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:15 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/441805354' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:16.340 INFO:tasks.fwd_scrub:done joining 2026-02-24T09:21:16.340 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2026-02-24T09:21:16.358 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T09:21:16.359 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:15 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/441805354' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.422+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1784761898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce341103a0 msgr2=0x7fce34110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.422+0000 7fce3c9f6640 1 --2- 10.20.193.4:0/1784761898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce341103a0 0x7fce34110810 secure :-1 s=READY pgs=1409 gs=1 cs=0 l=1 c_cookie=8110997328851718127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce20009950 tx=0x7fce2002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.422+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1784761898 shutdown_connections 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.422+0000 7fce3c9f6640 1 --2- 10.20.193.4:0/1784761898 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce34110d50 0x7fce341716e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.422+0000 7fce3c9f6640 1 --2- 10.20.193.4:0/1784761898 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce341103a0 0x7fce34110810 unknown :-1 s=CLOSED pgs=1409 gs=1 cs=0 l=1 c_cookie=8110997328851718127 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.422+0000 7fce3c9f6640 1 --2- 10.20.193.4:0/1784761898 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce3410f210 0x7fce3410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.422+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1784761898 >> 10.20.193.4:0/1784761898 conn(0x7fce340ec920 msgr2=0x7fce3410cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.422+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1784761898 shutdown_connections 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.422+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1784761898 wait complete. 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3c9f6640 1 Processor -- start 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3c9f6640 1 -- start start 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3c9f6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce3410f210 0x7fce340f88e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3c9f6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce341103a0 0x7fce341716c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3c9f6640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce34110d50 0x7fce340f9120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3c9f6640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fce340f9d80 con 0x7fce341103a0 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3c9f6640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fce340f9ef0 con 0x7fce34110d50 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3c9f6640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce340fa0b0 con 0x7fce3410f210 2026-02-24T09:21:16.427 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce39f6a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce341103a0 0x7fce341716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce39f6a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce341103a0 0x7fce341716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42482/0 (socket says 10.20.193.4:42482) 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce39f6a640 1 -- 10.20.193.4:0/1006092625 learned_addr learned my addr 10.20.193.4:0/1006092625 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3af6c640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce34110d50 0x7fce340f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3a76b640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce3410f210 0x7fce340f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce39f6a640 1 -- 10.20.193.4:0/1006092625 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce3410f210 msgr2=0x7fce340f88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce39f6a640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce3410f210 0x7fce340f88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce39f6a640 1 -- 10.20.193.4:0/1006092625 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce34110d50 msgr2=0x7fce340f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce39f6a640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce34110d50 0x7fce340f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce39f6a640 1 -- 10.20.193.4:0/1006092625 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce20009570 con 0x7fce341103a0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce39f6a640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce341103a0 0x7fce341716c0 secure :-1 s=READY pgs=1410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce200023d0 tx=0x7fce20004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce1f7fe640 1 -- 10.20.193.4:0/1006092625 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce2003d070 con 0x7fce341103a0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce1f7fe640 1 -- 10.20.193.4:0/1006092625 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce20038920 con 0x7fce341103a0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce1f7fe640 1 -- 10.20.193.4:0/1006092625 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce200419d0 con 0x7fce341103a0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1006092625 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce340fa330 con 0x7fce341103a0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.423+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1006092625 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce340fa750 con 0x7fce341103a0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.424+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1006092625 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce340fa9d0 con 0x7fce341103a0 2026-02-24T09:21:16.428 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.425+0000 7fce1f7fe640 1 -- 10.20.193.4:0/1006092625 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fce20038a90 con 0x7fce341103a0 2026-02-24T09:21:16.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.426+0000 7fce1f7fe640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce100b5760 0x7fce100d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.426+0000 7fce1f7fe640 1 -- 10.20.193.4:0/1006092625 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fce2010b810 con 0x7fce341103a0 2026-02-24T09:21:16.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.426+0000 7fce3a76b640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce100b5760 0x7fce100d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.426+0000 7fce1f7fe640 1 -- 10.20.193.4:0/1006092625 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fce200ce1d0 con 0x7fce341103a0 2026-02-24T09:21:16.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.426+0000 7fce3a76b640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce100b5760 0x7fce100d5c10 secure :-1 s=READY pgs=478 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce2c004740 tx=0x7fce2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.533 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.529+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1006092625 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce3405ee60 con 0x7fce341103a0 2026-02-24T09:21:16.534 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.530+0000 7fce1f7fe640 1 -- 10.20.193.4:0/1006092625 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22823 (secure 0 0 0) 0x7fce3405ee60 con 0x7fce341103a0 2026-02-24T09:21:16.534 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:21:16.534 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":79,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:11:02.784264+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.12","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:21:16.535 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1006092625 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce100b5760 msgr2=0x7fce100d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce100b5760 0x7fce100d5c10 secure :-1 s=READY pgs=478 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce2c004740 tx=0x7fce2c005f90 comp rx=0 tx=0).stop 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1006092625 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce341103a0 msgr2=0x7fce341716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce341103a0 0x7fce341716c0 secure :-1 s=READY pgs=1410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce200023d0 tx=0x7fce20004360 comp rx=0 tx=0).stop 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1006092625 shutdown_connections 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fce100b5760 0x7fce100d5c10 unknown :-1 s=CLOSED pgs=478 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fce34110d50 0x7fce340f9120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fce341103a0 0x7fce341716c0 unknown :-1 s=CLOSED pgs=1410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 --2- 10.20.193.4:0/1006092625 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fce3410f210 0x7fce340f88e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1006092625 >> 10.20.193.4:0/1006092625 conn(0x7fce340ec920 msgr2=0x7fce340eeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1006092625 shutdown_connections 2026-02-24T09:21:16.536 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.531+0000 7fce3c9f6640 1 -- 10.20.193.4:0/1006092625 wait complete. 2026-02-24T09:21:16.543 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-24T09:07:59.854959+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2026-02-24T09:09:22.406160+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2026-02-24T09:09:23.651007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-24T09:21:16.544 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-24T09:21:16.613 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 -- 10.20.193.4:0/1049178291 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff548110380 msgr2=0x7ff5481107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 --2- 10.20.193.4:0/1049178291 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff548110380 0x7ff5481107f0 secure :-1 s=READY pgs=1411 gs=1 cs=0 l=1 c_cookie=9927504907247389668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff53c009950 tx=0x7ff53c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 -- 10.20.193.4:0/1049178291 shutdown_connections 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 --2- 10.20.193.4:0/1049178291 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff548110d30 0x7ff5481716c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 --2- 10.20.193.4:0/1049178291 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff548110380 0x7ff5481107f0 unknown :-1 s=CLOSED pgs=1411 gs=1 cs=0 l=1 c_cookie=9927504907247389668 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 --2- 10.20.193.4:0/1049178291 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff54810f1f0 0x7ff54810f5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 -- 10.20.193.4:0/1049178291 >> 10.20.193.4:0/1049178291 conn(0x7ff5480ec920 msgr2=0x7ff54810cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 -- 10.20.193.4:0/1049178291 shutdown_connections 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 -- 10.20.193.4:0/1049178291 wait complete. 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 Processor -- start 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 -- start start 2026-02-24T09:21:16.614 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff54810f1f0 0x7ff5480f8820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff548110380 0x7ff5481716c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff548110d30 0x7ff5480f9080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7ff5480f9c70 con 0x7ff548110380 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7ff5480f9de0 con 0x7ff54810f1f0 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54f54c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5480f9fa0 con 0x7ff548110d30 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54cac0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff548110380 0x7ff5481716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54cac0640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff548110380 0x7ff5481716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42506/0 (socket says 10.20.193.4:42506) 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54cac0640 1 -- 10.20.193.4:0/108639603 learned_addr learned my addr 10.20.193.4:0/108639603 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54d2c1640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff54810f1f0 0x7ff5480f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54cac0640 1 -- 10.20.193.4:0/108639603 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff548110d30 msgr2=0x7ff5480f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54cac0640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff548110d30 0x7ff5480f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.615 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54cac0640 1 -- 10.20.193.4:0/108639603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff54810f1f0 msgr2=0x7ff5480f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54cac0640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff54810f1f0 0x7ff5480f8820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54cac0640 1 -- 10.20.193.4:0/108639603 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c009570 con 0x7ff548110380 2026-02-24T09:21:16.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54d2c1640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff54810f1f0 0x7ff5480f8820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:16.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.608+0000 7ff54cac0640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff548110380 0x7ff5481716c0 secure :-1 s=READY pgs=1412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff53c038820 tx=0x7ff53c0028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.609+0000 7ff5367fc640 1 -- 10.20.193.4:0/108639603 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff53c03d070 con 0x7ff548110380 2026-02-24T09:21:16.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.609+0000 7ff5367fc640 1 -- 10.20.193.4:0/108639603 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff53c0043d0 con 0x7ff548110380 2026-02-24T09:21:16.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.609+0000 7ff5367fc640 1 -- 10.20.193.4:0/108639603 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff53c041b70 con 0x7ff548110380 2026-02-24T09:21:16.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.609+0000 7ff54f54c640 1 -- 10.20.193.4:0/108639603 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5480fa220 con 0x7ff548110380 2026-02-24T09:21:16.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.609+0000 7ff54f54c640 1 -- 10.20.193.4:0/108639603 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5480fa6e0 con 0x7ff548110380 2026-02-24T09:21:16.616 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.609+0000 7ff54f54c640 1 -- 10.20.193.4:0/108639603 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff548060010 con 0x7ff548110380 2026-02-24T09:21:16.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.610+0000 7ff5367fc640 1 -- 10.20.193.4:0/108639603 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7ff53c038920 con 0x7ff548110380 2026-02-24T09:21:16.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.611+0000 7ff5367fc640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5240b5760 0x7ff5240d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.617 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.611+0000 7ff54d2c1640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5240b5760 0x7ff5240d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.611+0000 7ff5367fc640 1 -- 10.20.193.4:0/108639603 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7ff53c10b960 con 0x7ff548110380 2026-02-24T09:21:16.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.611+0000 7ff54d2c1640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5240b5760 0x7ff5240d5c10 secure :-1 s=READY pgs=479 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff538004740 tx=0x7ff538005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.618 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.612+0000 7ff5367fc640 1 -- 10.20.193.4:0/108639603 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7ff53c0ce320 con 0x7ff548110380 2026-02-24T09:21:16.725 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.722+0000 7ff54f54c640 1 -- 10.20.193.4:0/108639603 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff54805ee70 con 0x7ff548110380 2026-02-24T09:21:16.726 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.722+0000 7ff5367fc640 1 -- 10.20.193.4:0/108639603 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7ff53c0d14d0 con 0x7ff548110380 2026-02-24T09:21:16.726 INFO:teuthology.orchestra.run.trial004.stdout:pg_num: 1 2026-02-24T09:21:16.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 -- 10.20.193.4:0/108639603 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5240b5760 msgr2=0x7ff5240d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5240b5760 0x7ff5240d5c10 secure :-1 s=READY pgs=479 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff538004740 tx=0x7ff538005f00 comp rx=0 tx=0).stop 2026-02-24T09:21:16.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 -- 10.20.193.4:0/108639603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff548110380 msgr2=0x7ff5481716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff548110380 0x7ff5481716c0 secure :-1 s=READY pgs=1412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff53c038820 tx=0x7ff53c0028d0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.727 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 -- 10.20.193.4:0/108639603 shutdown_connections 2026-02-24T09:21:16.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7ff5240b5760 0x7ff5240d5c10 unknown :-1 s=CLOSED pgs=479 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff548110d30 0x7ff5480f9080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7ff548110380 0x7ff5481716c0 unknown :-1 s=CLOSED pgs=1412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 --2- 10.20.193.4:0/108639603 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7ff54810f1f0 0x7ff5480f8820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 -- 10.20.193.4:0/108639603 >> 10.20.193.4:0/108639603 conn(0x7ff5480ec920 msgr2=0x7ff5480eeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 -- 10.20.193.4:0/108639603 shutdown_connections 2026-02-24T09:21:16.728 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.723+0000 7ff54f54c640 1 -- 10.20.193.4:0/108639603 wait complete. 2026-02-24T09:21:16.736 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2026-02-24T09:21:16.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.803+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/2131666529 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a9c110d30 msgr2=0x7f3a9c1716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.803+0000 7f3aa1f0c640 1 --2- 10.20.193.4:0/2131666529 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a9c110d30 0x7f3a9c1716c0 secure :-1 s=READY pgs=1413 gs=1 cs=0 l=1 c_cookie=9357989006857157716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a9000aa30 tx=0x7f3a90030280 comp rx=0 tx=0).stop 2026-02-24T09:21:16.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.803+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/2131666529 shutdown_connections 2026-02-24T09:21:16.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.803+0000 7f3aa1f0c640 1 --2- 10.20.193.4:0/2131666529 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a9c110d30 0x7f3a9c1716c0 unknown :-1 s=CLOSED pgs=1413 gs=1 cs=0 l=1 c_cookie=9357989006857157716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.803+0000 7f3aa1f0c640 1 --2- 10.20.193.4:0/2131666529 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a9c110380 0x7f3a9c1107f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.809 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.803+0000 7f3aa1f0c640 1 --2- 10.20.193.4:0/2131666529 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a9c10f1f0 0x7f3a9c10f5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.803+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/2131666529 >> 10.20.193.4:0/2131666529 conn(0x7f3a9c0ec920 msgr2=0x7f3a9c10cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.803+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/2131666529 shutdown_connections 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.803+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/2131666529 wait complete. 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3aa1f0c640 1 Processor -- start 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3aa1f0c640 1 -- start start 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3aa1f0c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a9c10f1f0 0x7f3a9c0f87d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3aa1f0c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a9c110380 0x7f3a9c1716a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3aa1f0c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a9c110d30 0x7f3a9c0f9010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3aa1f0c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c0f9be0 con 0x7f3a9c110d30 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3aa1f0c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c0f9d50 con 0x7f3a9c110380 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3aa1f0c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c0f9f10 con 0x7f3a9c10f1f0 2026-02-24T09:21:16.810 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a9c110d30 0x7f3a9c0f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a9c110d30 0x7f3a9c0f9010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42522/0 (socket says 10.20.193.4:42522) 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9bfff640 1 -- 10.20.193.4:0/4034989997 learned_addr learned my addr 10.20.193.4:0/4034989997 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9b7fe640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a9c10f1f0 0x7f3a9c0f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9affd640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a9c110380 0x7f3a9c1716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9bfff640 1 -- 10.20.193.4:0/4034989997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a9c10f1f0 msgr2=0x7f3a9c0f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9bfff640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a9c10f1f0 0x7f3a9c0f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9bfff640 1 -- 10.20.193.4:0/4034989997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a9c110380 msgr2=0x7f3a9c1716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9bfff640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a9c110380 0x7f3a9c1716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9bfff640 1 -- 10.20.193.4:0/4034989997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9000a650 con 0x7f3a9c110d30 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a9bfff640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a9c110d30 0x7f3a9c0f9010 secure :-1 s=READY pgs=1414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a9000a330 tx=0x7f3a900039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a98ff9640 1 -- 10.20.193.4:0/4034989997 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a9003e070 con 0x7f3a9c110d30 2026-02-24T09:21:16.811 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a98ff9640 1 -- 10.20.193.4:0/4034989997 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3a90003ae0 con 0x7f3a9c110d30 2026-02-24T09:21:16.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/4034989997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9c0fa190 con 0x7f3a9c110d30 2026-02-24T09:21:16.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3a98ff9640 1 -- 10.20.193.4:0/4034989997 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a90042bf0 con 0x7f3a9c110d30 2026-02-24T09:21:16.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.804+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/4034989997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9c0fa5b0 con 0x7f3a9c110d30 2026-02-24T09:21:16.812 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.805+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/4034989997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9c060010 con 0x7f3a9c110d30 2026-02-24T09:21:16.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.806+0000 7f3a98ff9640 1 -- 10.20.193.4:0/4034989997 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f3a900050c0 con 0x7f3a9c110d30 2026-02-24T09:21:16.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.806+0000 7f3a98ff9640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a700b56e0 0x7f3a700d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:16.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.807+0000 7f3a9b7fe640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a700b56e0 0x7f3a700d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:16.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.807+0000 7f3a98ff9640 1 -- 10.20.193.4:0/4034989997 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f3a9010d2f0 con 0x7f3a9c110d30 2026-02-24T09:21:16.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.807+0000 7f3a9b7fe640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a700b56e0 0x7f3a700d5b90 secure :-1 s=READY pgs=480 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a88004740 tx=0x7f3a8800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:16.813 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.807+0000 7f3a98ff9640 1 -- 10.20.193.4:0/4034989997 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f3a900cfcb0 con 0x7f3a9c110d30 2026-02-24T09:21:16.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.915+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/4034989997 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3a9c10f5e0 con 0x7f3a9c110d30 2026-02-24T09:21:16.919 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.915+0000 7f3a98ff9640 1 -- 10.20.193.4:0/4034989997 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) ==== 104+0+11 (secure 0 0 0) 0x7f3a9c10f5e0 con 0x7f3a9c110d30 2026-02-24T09:21:16.919 INFO:teuthology.orchestra.run.trial004.stdout:pg_num: 32 2026-02-24T09:21:16.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/4034989997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a700b56e0 msgr2=0x7f3a700d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a700b56e0 0x7f3a700d5b90 secure :-1 s=READY pgs=480 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a88004740 tx=0x7f3a8800a380 comp rx=0 tx=0).stop 2026-02-24T09:21:16.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/4034989997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a9c110d30 msgr2=0x7f3a9c0f9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:16.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a9c110d30 0x7f3a9c0f9010 secure :-1 s=READY pgs=1414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a9000a330 tx=0x7f3a900039b0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/4034989997 shutdown_connections 2026-02-24T09:21:16.921 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f3a700b56e0 0x7f3a700d5b90 unknown :-1 s=CLOSED pgs=480 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f3a9c110d30 0x7f3a9c0f9010 unknown :-1 s=CLOSED pgs=1414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f3a9c110380 0x7f3a9c1716a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 --2- 10.20.193.4:0/4034989997 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a9c10f1f0 0x7f3a9c0f87d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:16.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/4034989997 >> 10.20.193.4:0/4034989997 conn(0x7f3a9c0ec920 msgr2=0x7f3a9c0eee60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:16.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/4034989997 shutdown_connections 2026-02-24T09:21:16.922 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.917+0000 7f3aa1f0c640 1 -- 10.20.193.4:0/4034989997 wait complete. 2026-02-24T09:21:16.930 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2026-02-24T09:21:17.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.995+0000 7f0634052640 1 -- 10.20.193.4:0/2238778342 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f062c110380 msgr2=0x7f062c1107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:17.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.995+0000 7f0634052640 1 --2- 10.20.193.4:0/2238778342 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f062c110380 0x7f062c1107f0 secure :-1 s=READY pgs=1415 gs=1 cs=0 l=1 c_cookie=10155183708453551264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0620009950 tx=0x7f062002f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.995+0000 7f0634052640 1 -- 10.20.193.4:0/2238778342 shutdown_connections 2026-02-24T09:21:17.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.995+0000 7f0634052640 1 --2- 10.20.193.4:0/2238778342 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f062c110d30 0x7f062c1716c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.995+0000 7f0634052640 1 --2- 10.20.193.4:0/2238778342 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f062c110380 0x7f062c1107f0 unknown :-1 s=CLOSED pgs=1415 gs=1 cs=0 l=1 c_cookie=10155183708453551264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.995+0000 7f0634052640 1 --2- 10.20.193.4:0/2238778342 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f062c10f1f0 0x7f062c10f5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.995+0000 7f0634052640 1 -- 10.20.193.4:0/2238778342 >> 10.20.193.4:0/2238778342 conn(0x7f062c0ec920 msgr2=0x7f062c10cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:17.002 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.995+0000 7f0634052640 1 -- 10.20.193.4:0/2238778342 shutdown_connections 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.995+0000 7f0634052640 1 -- 10.20.193.4:0/2238778342 wait complete. 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0634052640 1 Processor -- start 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0634052640 1 -- start start 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0634052640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f062c10f1f0 0x7f062c0f8850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0634052640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f062c110380 0x7f062c1716c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0634052640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f062c110d30 0x7f062c0f90b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0634052640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f062c0f9ca0 con 0x7f062c110380 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0634052640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f062c0f9e10 con 0x7f062c10f1f0 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0634052640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f062c0f9fd0 con 0x7f062c110d30 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06315c6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f062c110380 0x7f062c1716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06315c6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f062c110380 0x7f062c1716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42548/0 (socket says 10.20.193.4:42548) 2026-02-24T09:21:17.003 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06315c6640 1 -- 10.20.193.4:0/816048304 learned_addr learned my addr 10.20.193.4:0/816048304 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0631dc7640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f062c10f1f0 0x7f062c0f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06325c8640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f062c110d30 0x7f062c0f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06315c6640 1 -- 10.20.193.4:0/816048304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f062c110d30 msgr2=0x7f062c0f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06315c6640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f062c110d30 0x7f062c0f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06315c6640 1 -- 10.20.193.4:0/816048304 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f062c10f1f0 msgr2=0x7f062c0f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06315c6640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f062c10f1f0 0x7f062c0f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06315c6640 1 -- 10.20.193.4:0/816048304 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0620009570 con 0x7f062c110380 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06325c8640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f062c110d30 0x7f062c0f90b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0631dc7640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f062c10f1f0 0x7f062c0f8850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f06315c6640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f062c110380 0x7f062c1716c0 secure :-1 s=READY pgs=1416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06200023d0 tx=0x7f06200028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f061affd640 1 -- 10.20.193.4:0/816048304 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f062003d070 con 0x7f062c110380 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f061affd640 1 -- 10.20.193.4:0/816048304 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f06200043d0 con 0x7f062c110380 2026-02-24T09:21:17.004 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f061affd640 1 -- 10.20.193.4:0/816048304 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0620041b00 con 0x7f062c110380 2026-02-24T09:21:17.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0634052640 1 -- 10.20.193.4:0/816048304 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062c0fa250 con 0x7f062c110380 2026-02-24T09:21:17.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.996+0000 7f0634052640 1 -- 10.20.193.4:0/816048304 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f062c0fa670 con 0x7f062c110380 2026-02-24T09:21:17.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.997+0000 7f0634052640 1 -- 10.20.193.4:0/816048304 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062c060010 con 0x7f062c110380 2026-02-24T09:21:17.005 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.998+0000 7f061affd640 1 -- 10.20.193.4:0/816048304 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f0620038920 con 0x7f062c110380 2026-02-24T09:21:17.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.999+0000 7f061affd640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f06080b5760 0x7f06080d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:17.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.999+0000 7f0631dc7640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f06080b5760 0x7f06080d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:17.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.999+0000 7f061affd640 1 -- 10.20.193.4:0/816048304 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f062010be00 con 0x7f062c110380 2026-02-24T09:21:17.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.999+0000 7f0631dc7640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f06080b5760 0x7f06080d5c10 secure :-1 s=READY pgs=481 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f061c005970 tx=0x7f061c005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:17.006 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:16.999+0000 7f061affd640 1 -- 10.20.193.4:0/816048304 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f06200ce780 con 0x7f062c110380 2026-02-24T09:21:17.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.103+0000 7f0634052640 1 -- 10.20.193.4:0/816048304 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f062c1756e0 con 0x7f062c110380 2026-02-24T09:21:17.107 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.104+0000 7f061affd640 1 -- 10.20.193.4:0/816048304 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) ==== 100+0+11 (secure 0 0 0) 0x7f06200d1930 con 0x7f062c110380 2026-02-24T09:21:17.107 INFO:teuthology.orchestra.run.trial004.stdout:pg_num: 64 2026-02-24T09:21:17.108 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 -- 10.20.193.4:0/816048304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f06080b5760 msgr2=0x7f06080d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f06080b5760 0x7f06080d5c10 secure :-1 s=READY pgs=481 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f061c005970 tx=0x7f061c005900 comp rx=0 tx=0).stop 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 -- 10.20.193.4:0/816048304 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f062c110380 msgr2=0x7f062c1716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f062c110380 0x7f062c1716c0 secure :-1 s=READY pgs=1416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06200023d0 tx=0x7f06200028d0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 -- 10.20.193.4:0/816048304 shutdown_connections 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f06080b5760 0x7f06080d5c10 unknown :-1 s=CLOSED pgs=481 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f062c110d30 0x7f062c0f90b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f062c110380 0x7f062c1716c0 unknown :-1 s=CLOSED pgs=1416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 --2- 10.20.193.4:0/816048304 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f062c10f1f0 0x7f062c0f8850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 -- 10.20.193.4:0/816048304 >> 10.20.193.4:0/816048304 conn(0x7f062c0ec920 msgr2=0x7f062c0eeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 -- 10.20.193.4:0/816048304 shutdown_connections 2026-02-24T09:21:17.109 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.105+0000 7f0634052640 1 -- 10.20.193.4:0/816048304 wait complete. 2026-02-24T09:21:17.117 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2026-02-24T09:21:17.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 -- 10.20.193.4:0/924605656 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f51781103a0 msgr2=0x7f5178110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 --2- 10.20.193.4:0/924605656 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f51781103a0 0x7f5178110810 secure :-1 s=READY pgs=1417 gs=1 cs=0 l=1 c_cookie=17557690480468298013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f516c009950 tx=0x7f516c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 -- 10.20.193.4:0/924605656 shutdown_connections 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 --2- 10.20.193.4:0/924605656 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5178110d50 0x7f51781716e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 --2- 10.20.193.4:0/924605656 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f51781103a0 0x7f5178110810 unknown :-1 s=CLOSED pgs=1417 gs=1 cs=0 l=1 c_cookie=17557690480468298013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 --2- 10.20.193.4:0/924605656 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f517810f210 0x7f517810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 -- 10.20.193.4:0/924605656 >> 10.20.193.4:0/924605656 conn(0x7f51780ec920 msgr2=0x7f517810cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 -- 10.20.193.4:0/924605656 shutdown_connections 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 -- 10.20.193.4:0/924605656 wait complete. 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 Processor -- start 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 -- start start 2026-02-24T09:21:17.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f517810f210 0x7f51780f88c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f51781103a0 0x7f51781716c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5178110d50 0x7f51780f9100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f51780f9d60 con 0x7f517810f210 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f51780f9ed0 con 0x7f51781103a0 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f518010c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51780fa090 con 0x7f5178110d50 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f517de81640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f517810f210 0x7f51780f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f517de81640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f517810f210 0x7f51780f88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42572/0 (socket says 10.20.193.4:42572) 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f517de81640 1 -- 10.20.193.4:0/2253090099 learned_addr learned my addr 10.20.193.4:0/2253090099 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f517de81640 1 -- 10.20.193.4:0/2253090099 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5178110d50 msgr2=0x7f51780f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f517de81640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5178110d50 0x7f51780f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f517de81640 1 -- 10.20.193.4:0/2253090099 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f51781103a0 msgr2=0x7f51781716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:17.188 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f517de81640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f51781103a0 0x7f51781716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.181+0000 7f517de81640 1 -- 10.20.193.4:0/2253090099 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c009570 con 0x7f517810f210 2026-02-24T09:21:17.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.182+0000 7f517de81640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f517810f210 0x7f51780f88c0 secure :-1 s=READY pgs=1418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f516800d950 tx=0x7f516800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:17.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.182+0000 7f5166ffd640 1 -- 10.20.193.4:0/2253090099 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5168004540 con 0x7f517810f210 2026-02-24T09:21:17.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.182+0000 7f5166ffd640 1 -- 10.20.193.4:0/2253090099 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5168009d00 con 0x7f517810f210 2026-02-24T09:21:17.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.182+0000 7f518010c640 1 -- 10.20.193.4:0/2253090099 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51780fa370 con 0x7f517810f210 2026-02-24T09:21:17.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.182+0000 7f5166ffd640 1 -- 10.20.193.4:0/2253090099 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f51680106e0 con 0x7f517810f210 2026-02-24T09:21:17.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.182+0000 7f518010c640 1 -- 10.20.193.4:0/2253090099 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51780fa890 con 0x7f517810f210 2026-02-24T09:21:17.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.182+0000 7f518010c640 1 -- 10.20.193.4:0/2253090099 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5178175750 con 0x7f517810f210 2026-02-24T09:21:17.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.184+0000 7f5166ffd640 1 -- 10.20.193.4:0/2253090099 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f51680097c0 con 0x7f517810f210 2026-02-24T09:21:17.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.184+0000 7f5166ffd640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51540b5760 0x7f51540d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:17.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.184+0000 7f517d680640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51540b5760 0x7f51540d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:17.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.184+0000 7f5166ffd640 1 -- 10.20.193.4:0/2253090099 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f51680e7190 con 0x7f517810f210 2026-02-24T09:21:17.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.185+0000 7f517d680640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51540b5760 0x7f51540d5c10 secure :-1 s=READY pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f516c02f6e0 tx=0x7f516c005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:17.191 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.185+0000 7f5166ffd640 1 -- 10.20.193.4:0/2253090099 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f51680a9b50 con 0x7f517810f210 2026-02-24T09:21:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:16 trial004 ceph-mon[41596]: pgmap v496: 97 pgs: 97 active+clean; 4.1 GiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 196 MiB/s wr, 143 op/s 2026-02-24T09:21:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:16 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1006092625' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:21:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:16 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/108639603' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:21:17.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:16 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4034989997' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-24T09:21:17.324 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.321+0000 7f518010c640 1 -- 10.20.193.4:0/2253090099 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f5178174e10 con 0x7f517810f210 2026-02-24T09:21:17.329 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.326+0000 7f5166ffd640 1 -- 10.20.193.4:0/2253090099 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+827122 (secure 0 0 0) 0x7f51680acd00 con 0x7f517810f210 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "epoch": 18, 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "active_gid": 14152, 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "active_name": "x", 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "active_addrs": { 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "addrvec": [ 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "type": "v2", 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "addr": "10.20.193.4:6800", 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "nonce": 2848002115 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "type": "v1", 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "addr": "10.20.193.4:6801", 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "nonce": 2848002115 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: ] 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "active_addr": "10.20.193.4:6801/2848002115", 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "active_change": "2026-02-24T09:07:01.644764+0000", 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "active_mgr_features": 4544132024016699391, 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "available": true, 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "standbys": [ 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.334 INFO:teuthology.orchestra.run.trial004.stdout: "gid": 24145, 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "name": "z", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "mgr_features": 4544132024016699391, 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "available_modules": [ 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "name": "alerts", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently to reexamine health status", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.335 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.336 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_destination": { 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_destination", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.337 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_from_name": { 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_from_name", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "Ceph", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Email From: name", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_host": { 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_host", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "SMTP server", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_password": { 2026-02-24T09:21:17.338 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_password", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Password to authenticate with", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_port": { 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_port", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "465", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "SMTP port", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_sender": { 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_sender", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.339 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "SMTP envelope sender", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_ssl": { 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_ssl", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_user": { 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_user", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "User to authenticate as", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.340 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "name": "balancer", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "active": { 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "name": "active", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "automatically balance PGs across cluster", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.341 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "begin_time": { 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "name": "begin_time", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0000", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "beginning time of day to automatically balance", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "begin_weekday": { 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "name": "begin_weekday", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "max": "6", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "crush_compat_max_iterations": { 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crush_compat_max_iterations", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.342 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "25", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "max": "250", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "crush_compat_metrics": { 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crush_compat_metrics", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "pgs,objects,bytes", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "crush_compat_step": { 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crush_compat_step", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0.5", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0.001", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "max": "0.999", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "aggressiveness of optimization", 2026-02-24T09:21:17.343 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "end_time": { 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "name": "end_time", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "2359", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "ending time of day to automatically balance", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "end_weekday": { 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "name": "end_weekday", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "max": "6", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.344 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.345 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.346 INFO:teuthology.orchestra.run.trial004.stdout: "min_score": { 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "name": "min_score", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "mode": { 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mode", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "upmap", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "crush-compat", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "none", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "read", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "upmap", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "upmap-read" 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Balancer mode", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "pool_ids": { 2026-02-24T09:21:17.347 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pool_ids", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.348 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "update_pg_upmap_activity": { 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "name": "update_pg_upmap_activity", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "upmap_max_deviation": { 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "name": "upmap_max_deviation", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.349 INFO:teuthology.orchestra.run.trial004.stdout: "upmap_max_optimizations": { 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "name": "upmap_max_optimizations", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cephadm", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "agent_down_multiplier": { 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "name": "agent_down_multiplier", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3.0", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.350 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "agent_refresh_rate": { 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "name": "agent_refresh_rate", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "20", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How often the agent on each host will gather and send metadata", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "agent_starting_port": { 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "name": "agent_starting_port", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "4721", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "allow_ptrace": { 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "name": "allow_ptrace", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.351 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "autotune_interval": { 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "name": "autotune_interval", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently to autotune daemon memory", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "autotune_memory_target_ratio": { 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "name": "autotune_memory_target_ratio", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0.7", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.352 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "cephadm_log_destination": { 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cephadm_log_destination", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "file", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "file,syslog", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "syslog" 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Destination for cephadm command persistent logging", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_automated_rotation_enabled": { 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_automated_rotation_enabled", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "This flag controls whether cephadm automatically rotates certificates upon expiration.", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.353 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_check_debug_mode": { 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_check_debug_mode", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_check_period": { 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_check_period", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "max": "30", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Specifies how often (in days) the certificate should be checked for validity.", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_duration_days": { 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_duration_days", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.354 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1095", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "min": "90", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "max": "3650", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Specifies the duration of self-signed certificates generated and signed by the cephadm root CA", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_renewal_threshold_days": { 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_renewal_threshold_days", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "30", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "min": "10", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "max": "90", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Specifies the lead time in days to initiate certificate renewal before expiration.", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "cgroups_split": { 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cgroups_split", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.355 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently Podman only)", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "config_checks_enabled": { 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "name": "config_checks_enabled", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable or disable cephadm configuration analysis", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "config_dashboard": { 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "name": "config_dashboard", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Manage configs like API endpoints in Dashboard.", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_alertmanager": { 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_alertmanager", 2026-02-24T09:21:17.356 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.28.1", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Alertmanager container image", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_alloy": { 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_alloy", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/grafana/alloy:latest", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Alloy container image", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_base": { 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_base", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.357 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Container image name, without the tag", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_elasticsearch": { 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_elasticsearch", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Elasticsearch container image", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_grafana": { 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_grafana", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/grafana:12.3.1", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Grafana container image", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_haproxy": { 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_haproxy", 2026-02-24T09:21:17.358 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Haproxy container image", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_jaeger_agent": { 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_jaeger_agent", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Jaeger agent container image", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_jaeger_collector": { 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_jaeger_collector", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Jaeger collector container image", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.359 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_jaeger_query": { 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_jaeger_query", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Jaeger query container image", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_keepalived": { 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_keepalived", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Keepalived container image", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_loki": { 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_loki", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2026-02-24T09:21:17.360 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Loki container image", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_nginx": { 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_nginx", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Nginx container image", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_node_exporter": { 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_node_exporter", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.9.1", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Node exporter container image", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_nvmeof": { 2026-02-24T09:21:17.361 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_nvmeof", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/nvmeof:1.6", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Nvmeof container image", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_oauth2_proxy": { 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_oauth2_proxy", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Oauth2 proxy container image", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_prometheus": { 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_prometheus", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/prometheus/prometheus:v3.6.0", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Prometheus container image", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.362 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_promtail": { 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_promtail", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Promtail container image", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_samba": { 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_samba", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Samba container image", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_samba_metrics": { 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_samba_metrics", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/samba.org/samba-metrics:devbuilds-centos-amd64", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.363 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Samba metrics container image", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_snmp_gateway": { 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_snmp_gateway", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Snmp gateway container image", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "container_init": { 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_init", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Run podman/docker with `--init`", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "daemon_cache_timeout": { 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "name": "daemon_cache_timeout", 2026-02-24T09:21:17.364 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Seconds for which to cache service (daemon) inventory", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "default_cephadm_command_timeout": { 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "name": "default_cephadm_command_timeout", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "900", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "default_registry": { 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "name": "default_registry", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.365 INFO:teuthology.orchestra.run.trial004.stdout: "device_cache_timeout": { 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "name": "device_cache_timeout", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1800", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Seconds for which to cache device inventory", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "device_enhanced_scan": { 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "name": "device_enhanced_scan", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "facts_cache_timeout": { 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "name": "facts_cache_timeout", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Seconds for which to cache host facts data", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.366 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "grafana_dashboards_path": { 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "name": "grafana_dashboards_path", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Location of dashboards to include in Grafana", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "host_check_interval": { 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "name": "host_check_interval", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently to perform a host check", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "hw_monitoring": { 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "name": "hw_monitoring", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Whether the hardware monitoring daemon be deployed on every host?", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "inventory_list_all": { 2026-02-24T09:21:17.367 INFO:teuthology.orchestra.run.trial004.stdout: "name": "inventory_list_all", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "log_refresh_metadata": { 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_refresh_metadata", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.368 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Log to the \"cephadm\" cluster log channel\"", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.369 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on hosts.", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "*", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.370 INFO:teuthology.orchestra.run.trial004.stdout: "max_count_per_host": { 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_count_per_host", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Max number of daemons per service per host: guard against mistakes and runaways", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "max_osd_draining_count": { 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_osd_draining_count", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Max number of OSDs that will be drained simultaneously when OSDs are removed", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "max_parallel_osd_upgrades": { 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_parallel_osd_upgrades", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "16", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Maximum number of OSD daemons upgraded in parallel.", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "migration_current": { 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "name": "migration_current", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.371 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Internal - do not modify", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "mode": { 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mode", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "root", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "cephadm-package", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "root" 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Mode for remote execution of cephadm", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "oob_default_addr": { 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "name": "oob_default_addr", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "169.254.1.1", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Default IP address for RedFish API (OOB management).", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "prometheus_alerts_path": { 2026-02-24T09:21:17.372 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prometheus_alerts_path", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Location of alerts to include in Prometheus Alertmanager", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "registry_insecure": { 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_insecure", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "registry_password": { 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_password", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "registry_url": { 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_url", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.373 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Registry URL for login purposes. This is not the default registry.", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "registry_username": { 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_username", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "secure_monitoring_stack": { 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable TLS security for all monitoring stack daemons", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "service_discovery_port": { 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "name": "service_discovery_port", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8765", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.374 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Cephadm service discovery port", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "ssh_config_file": { 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssh_config_file", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Customized SSH config file to distribute to managed hosts", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "ssh_keepalive_count_max": { 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssh_keepalive_count_max", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How many sequential SSH connection liveness check failures before the host is marked offline", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.375 INFO:teuthology.orchestra.run.trial004.stdout: "ssh_keepalive_interval": { 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssh_keepalive_interval", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "7", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How often SSH connections are checked for liveness", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "stray_daemon_check_interval": { 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "name": "stray_daemon_check_interval", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1800", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently cephadm should check for the presence of stray daemons", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "use_agent": { 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "name": "use_agent", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use the cephadm agent on each host to gather and send metadata", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "use_repo_digest": { 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "name": "use_repo_digest", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.376 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Automatically convert image tags to image digest to ensure that all daemons use the same image", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "warn_on_failed_host_check": { 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_on_failed_host_check", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Raise a health warning if the host check fails", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "warn_on_stray_daemons": { 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_on_stray_daemons", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "warn_on_stray_hosts": { 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_on_stray_hosts", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.377 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crash", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.378 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "retain_interval": { 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "name": "retain_interval", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "31536000", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.379 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "warn_recent_interval": { 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_recent_interval", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1209600", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "name": "dashboard", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.380 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "ALERTMANAGER_API_HOST": { 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "AUDIT_API_ENABLED": { 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "name": "AUDIT_API_ENABLED", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.381 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "ENABLE_BROWSABLE_API": { 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.382 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.383 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_PASSWORD": { 2026-02-24T09:21:17.384 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "admin", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_URL": { 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_URL", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_USERNAME": { 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "admin", 2026-02-24T09:21:17.385 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.386 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "MANAGED_BY_CLUSTERS": { 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "name": "MANAGED_BY_CLUSTERS", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "[]", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "MULTICLUSTER_CONFIG": { 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "name": "MULTICLUSTER_CONFIG", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "{}", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "PROMETHEUS_API_HOST": { 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.387 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "PROM_ALERT_CREDENTIAL_CACHE_TTL": { 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PROM_ALERT_CREDENTIAL_CACHE_TTL", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.388 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.389 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_ENABLED": { 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.390 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.391 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "45", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_ACCESS_KEY": { 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "admin", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.392 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_SECRET_KEY": { 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_SSL_VERIFY": { 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_HOSTNAME_PER_DAEMON": { 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_HOSTNAME_PER_DAEMON", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "UNSAFE_TLS_v1_2": { 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "name": "UNSAFE_TLS_v1_2", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.393 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.394 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "cross_origin_url": { 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cross_origin_url", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "crt_file": { 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crt_file", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "crypto_caller": { 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crypto_caller", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.395 INFO:teuthology.orchestra.run.trial004.stdout: "debug": { 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "name": "debug", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable/disable debug options", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "jwt_token_ttl": { 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "name": "jwt_token_ttl", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "28800", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "key_file": { 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "name": "key_file", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.396 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.397 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "motd": { 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "name": "motd", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "The message of the day", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "redirect_resolve_ip_addr": { 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "name": "redirect_resolve_ip_addr", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.398 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "server_addr": { 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_addr", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "::", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "server_port": { 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_port", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8080", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "ssl": { 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssl", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.399 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "ssl_server_port": { 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssl_server_port", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8443", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "sso_oauth2": { 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sso_oauth2", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "standby_behaviour": { 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_behaviour", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "redirect", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.400 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "redirect" 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "standby_error_status_code": { 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_error_status_code", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "500", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "min": "400", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "max": "599", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "url_prefix": { 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "name": "url_prefix", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "name": "devicehealth", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "enable_monitoring": { 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "name": "enable_monitoring", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.401 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "monitor device health metrics", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.402 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "mark_out_threshold": { 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mark_out_threshold", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "2419200", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "pool_name": { 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pool_name", 2026-02-24T09:21:17.403 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "device_health_metrics", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "retention_period": { 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "name": "retention_period", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "15552000", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how long to retain device health metrics", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "scrape_frequency": { 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "name": "scrape_frequency", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "86400", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "self_heal": { 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "name": "self_heal", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.404 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how frequently to wake up and check device health", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "warn_threshold": { 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_threshold", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "7257600", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.405 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "name": "diskprediction_local", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.406 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "predict_interval": { 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "name": "predict_interval", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "86400", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "predictor_model": { 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "name": "predictor_model", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.407 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "prophetstor", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "name": "influx", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": false, 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "influxdb python module not found", 2026-02-24T09:21:17.408 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "batch_size": { 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "name": "batch_size", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5000", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "database": { 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "name": "database", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "ceph", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": { 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "name": "hostname", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "InfluxDB server hostname", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.409 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "30", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "min": "5", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.410 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "password": { 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "name": "password", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "password of InfluxDB server user", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.411 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "port": { 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "name": "port", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8086", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "InfluxDB server port", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "ssl": { 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssl", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "false", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "threads": { 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "name": "threads", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.412 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "max": "32", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "username": { 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "name": "username", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "username of InfluxDB server user", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "verify_ssl": { 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "name": "verify_ssl", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "true", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "name": "insights", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.413 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.414 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "name": "iostat", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.415 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.416 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "name": "k8sevents", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_event_retention_days": { 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ceph_event_retention_days", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "7", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.417 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "config_check_secs": { 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "name": "config_check_secs", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "min": "10", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.418 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.419 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "name": "localpool", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "failure_domain": { 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "name": "failure_domain", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "host", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "failure domain for any created local pool", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.420 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.421 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "min_size": { 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "name": "min_size", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "default min_size for any created local pool", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "num_rep": { 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "name": "num_rep", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "default replica count for any created local pool", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "pg_num": { 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pg_num", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "128", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "default pg_num for any created local pool", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.422 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "prefix": { 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prefix", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "name prefix for any created local pool", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "subtree": { 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "name": "subtree", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "rack", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.423 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mds_autoscaler", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.424 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.425 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mirroring", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.426 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "name": "nfs", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.427 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.428 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "name": "orchestrator", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.429 INFO:teuthology.orchestra.run.trial004.stdout: "fail_fs": { 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "name": "fail_fs", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.430 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "orchestrator": { 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "name": "orchestrator", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "cephadm", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "rook", 2026-02-24T09:21:17.431 INFO:teuthology.orchestra.run.trial004.stdout: "test_orchestrator" 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Orchestrator backend", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "name": "osd_perf_query", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.432 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.433 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "name": "osd_support", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.434 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.435 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pg_autoscaler", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.436 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.437 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "threshold": { 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "name": "threshold", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3.0", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1.0", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "scaling threshold", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.438 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "name": "progress", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "allow_pg_recovery_event": { 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "name": "allow_pg_recovery_event", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "enabled": { 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "name": "enabled", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.439 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.440 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "max_completed_events": { 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_completed_events", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "50", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "number of past completed events to remember", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how long the module is going to sleep", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.441 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prometheus", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "cache": { 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cache", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "exclude_perf_counters": { 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "name": "exclude_perf_counters", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "healthcheck_history_max_entries": { 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "name": "healthcheck_history_max_entries", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.442 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1000", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Maximum number of health check history entries to keep", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.443 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_stats_pools": { 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rbd_stats_pools", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.444 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "300", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "scrape_interval": { 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "name": "scrape_interval", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "15.0", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "server_addr": { 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_addr", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "::", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "server_port": { 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_port", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "9283", 2026-02-24T09:21:17.445 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "stale_cache_strategy": { 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "name": "stale_cache_strategy", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "log", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "standby_behaviour": { 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_behaviour", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.446 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "default", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "default", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "error" 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "standby_error_status_code": { 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_error_status_code", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "500", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "min": "400", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "max": "599", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rbd_support", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.447 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.448 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "max_concurrent_snap_create": { 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_concurrent_snap_create", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "mirror_snapshot_schedule": { 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mirror_snapshot_schedule", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.449 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "trash_purge_schedule": { 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "name": "trash_purge_schedule", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rgw", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.450 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.451 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "secondary_zone_period_retry_limit": { 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rook", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.452 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.453 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "prometheus_tls_secret_name": { 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prometheus_tls_secret_name", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "rook-ceph-prometheus-server-tls", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "name of tls secret in k8s for prometheus", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "secure_monitoring_stack": { 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.454 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "storage_class": { 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "name": "storage_class", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "local", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "name": "selftest", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.455 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.456 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "roption1": { 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "name": "roption1", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "roption2": { 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "name": "roption2", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "xyz", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption1": { 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption1", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.457 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption2": { 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption2", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption3": { 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption3", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption4": { 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption4", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.458 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption5": { 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption5", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption6": { 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption6", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption7": { 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption7", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "max": "42", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.459 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "testkey": { 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "name": "testkey", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "testlkey": { 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "name": "testlkey", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "testnewline": { 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "name": "testnewline", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.460 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smb", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "internal_store_backend": { 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "name": "internal_store_backend", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "set internal store backend. for develoment and testing only", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.461 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.462 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "update_orchestration": { 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "name": "update_orchestration", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "automatically update orchestration when smb resources are changed", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "name": "snap_schedule", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "allow_m_granularity": { 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "name": "allow_m_granularity", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.463 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "allow minute scheduled snapshots", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "dump_on_update": { 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "name": "dump_on_update", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "dump database to debug log on update", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.464 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.465 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "name": "stats", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.466 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.467 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "name": "status", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.468 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.469 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "name": "telegraf", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "address": { 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "name": "address", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "15", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.470 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.471 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "name": "telemetry", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "channel_basic": { 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_basic", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-24T09:21:17.472 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "channel_crash": { 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_crash", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "channel_device": { 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_device", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "channel_ident": { 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_ident", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.473 INFO:teuthology.orchestra.run.trial004.stdout: "channel_perf": { 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_perf", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "contact": { 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "name": "contact", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "description": { 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "name": "description", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "device_url": { 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "name": "device_url", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.474 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "enabled": { 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "name": "enabled", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "24", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "min": "8", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "last_opt_revision": { 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "name": "last_opt_revision", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.475 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "leaderboard": { 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "name": "leaderboard", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "leaderboard_description": { 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "name": "leaderboard_description", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.476 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.477 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "organization": { 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "name": "organization", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "proxy": { 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "name": "proxy", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.478 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "url": { 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "name": "url", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "name": "test_orchestrator", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.479 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.480 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "name": "volumes", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.481 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.482 INFO:teuthology.orchestra.run.trial004.stdout: "max_concurrent_clones": { 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_concurrent_clones", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "4", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "pause_cloning": { 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pause_cloning", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Pause asynchronous cloner threads", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "pause_purging": { 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pause_purging", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Pause asynchronous subvolume purge threads", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "periodic_async_work": { 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "name": "periodic_async_work", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.483 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Periodically check for async work", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "snapshot_clone_delay": { 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "name": "snapshot_clone_delay", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "snapshot_clone_no_wait": { 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "name": "snapshot_clone_no_wait", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.484 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: ] 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "gid": 24203, 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "name": "y", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "mgr_features": 4544132024016699391, 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "available_modules": [ 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "name": "alerts", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently to reexamine health status", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.485 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.486 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_destination": { 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_destination", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_from_name": { 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_from_name", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "Ceph", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Email From: name", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_host": { 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_host", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.487 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "SMTP server", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_password": { 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_password", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Password to authenticate with", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_port": { 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_port", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "465", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "SMTP port", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_sender": { 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_sender", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "SMTP envelope sender", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.488 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_ssl": { 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_ssl", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_user": { 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_user", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "User to authenticate as", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.489 INFO:teuthology.orchestra.run.trial004.stdout: "name": "balancer", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "active": { 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "name": "active", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "automatically balance PGs across cluster", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "begin_time": { 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "name": "begin_time", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0000", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "beginning time of day to automatically balance", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "begin_weekday": { 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "name": "begin_weekday", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "max": "6", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.490 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "crush_compat_max_iterations": { 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crush_compat_max_iterations", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "25", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "max": "250", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "crush_compat_metrics": { 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crush_compat_metrics", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "pgs,objects,bytes", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "crush_compat_step": { 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crush_compat_step", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0.5", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0.001", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "max": "0.999", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "aggressiveness of optimization", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "end_time": { 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "name": "end_time", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.491 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "2359", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "ending time of day to automatically balance", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "end_weekday": { 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "name": "end_weekday", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "max": "6", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.492 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.493 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "min_score": { 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "name": "min_score", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "mode": { 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mode", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "upmap", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "crush-compat", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "none", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "read", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "upmap", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "upmap-read" 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Balancer mode", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "pool_ids": { 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pool_ids", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-24T09:21:17.494 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "update_pg_upmap_activity": { 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "name": "update_pg_upmap_activity", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "upmap_max_deviation": { 2026-02-24T09:21:17.495 INFO:teuthology.orchestra.run.trial004.stdout: "name": "upmap_max_deviation", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "upmap_max_optimizations": { 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "name": "upmap_max_optimizations", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cephadm", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "agent_down_multiplier": { 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "name": "agent_down_multiplier", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3.0", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.496 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "agent_refresh_rate": { 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "name": "agent_refresh_rate", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "20", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How often the agent on each host will gather and send metadata", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "agent_starting_port": { 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "name": "agent_starting_port", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "4721", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "allow_ptrace": { 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "name": "allow_ptrace", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.", 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.497 INFO:teuthology.orchestra.run.trial004.stdout: "autotune_interval": { 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "name": "autotune_interval", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently to autotune daemon memory", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "autotune_memory_target_ratio": { 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "name": "autotune_memory_target_ratio", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0.7", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "cephadm_log_destination": { 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cephadm_log_destination", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "file", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "file,syslog", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "syslog" 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Destination for cephadm command persistent logging", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.498 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_automated_rotation_enabled": { 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_automated_rotation_enabled", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "This flag controls whether cephadm automatically rotates certificates upon expiration.", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_check_debug_mode": { 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_check_debug_mode", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_check_period": { 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_check_period", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "max": "30", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Specifies how often (in days) the certificate should be checked for validity.", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_duration_days": { 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_duration_days", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.499 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1095", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "min": "90", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "max": "3650", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Specifies the duration of self-signed certificates generated and signed by the cephadm root CA", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_renewal_threshold_days": { 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_renewal_threshold_days", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "30", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "min": "10", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "max": "90", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Specifies the lead time in days to initiate certificate renewal before expiration.", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "cgroups_split": { 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cgroups_split", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently Podman only)", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "config_checks_enabled": { 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "name": "config_checks_enabled", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable or disable cephadm configuration analysis", 2026-02-24T09:21:17.500 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "config_dashboard": { 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "name": "config_dashboard", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Manage configs like API endpoints in Dashboard.", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_alertmanager": { 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_alertmanager", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.28.1", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Alertmanager container image", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_alloy": { 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_alloy", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/grafana/alloy:latest", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Alloy container image", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.501 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_base": { 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_base", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Container image name, without the tag", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_elasticsearch": { 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_elasticsearch", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Elasticsearch container image", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_grafana": { 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_grafana", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/grafana:12.3.1", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Grafana container image", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_haproxy": { 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_haproxy", 2026-02-24T09:21:17.502 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Haproxy container image", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_jaeger_agent": { 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_jaeger_agent", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Jaeger agent container image", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_jaeger_collector": { 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_jaeger_collector", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Jaeger collector container image", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_jaeger_query": { 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_jaeger_query", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-24T09:21:17.503 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Jaeger query container image", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_keepalived": { 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_keepalived", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Keepalived container image", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_loki": { 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_loki", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Loki container image", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_nginx": { 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_nginx", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Nginx container image", 2026-02-24T09:21:17.504 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_node_exporter": { 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_node_exporter", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.9.1", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Node exporter container image", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_nvmeof": { 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_nvmeof", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/nvmeof:1.6", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Nvmeof container image", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_oauth2_proxy": { 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_oauth2_proxy", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Oauth2 proxy container image", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.505 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_prometheus": { 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_prometheus", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/prometheus/prometheus:v3.6.0", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Prometheus container image", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_promtail": { 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_promtail", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Promtail container image", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_samba": { 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_samba", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Samba container image", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_samba_metrics": { 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_samba_metrics", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.506 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/samba.org/samba-metrics:devbuilds-centos-amd64", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Samba metrics container image", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_snmp_gateway": { 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_snmp_gateway", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Snmp gateway container image", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "container_init": { 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_init", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Run podman/docker with `--init`", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "daemon_cache_timeout": { 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "name": "daemon_cache_timeout", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.507 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Seconds for which to cache service (daemon) inventory", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "default_cephadm_command_timeout": { 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "name": "default_cephadm_command_timeout", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "900", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "default_registry": { 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "name": "default_registry", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.508 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "device_cache_timeout": { 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "name": "device_cache_timeout", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1800", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Seconds for which to cache device inventory", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "device_enhanced_scan": { 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "name": "device_enhanced_scan", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "facts_cache_timeout": { 2026-02-24T09:21:17.509 INFO:teuthology.orchestra.run.trial004.stdout: "name": "facts_cache_timeout", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Seconds for which to cache host facts data", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "grafana_dashboards_path": { 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "name": "grafana_dashboards_path", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Location of dashboards to include in Grafana", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "host_check_interval": { 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "name": "host_check_interval", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.510 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently to perform a host check", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "hw_monitoring": { 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "name": "hw_monitoring", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Whether the hardware monitoring daemon be deployed on every host?", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "inventory_list_all": { 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "name": "inventory_list_all", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.511 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "log_refresh_metadata": { 2026-02-24T09:21:17.512 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_refresh_metadata", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Log to the \"cephadm\" cluster log channel\"", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.513 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.514 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on hosts.", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "*", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "max_count_per_host": { 2026-02-24T09:21:17.515 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_count_per_host", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Max number of daemons per service per host: guard against mistakes and runaways", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "max_osd_draining_count": { 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_osd_draining_count", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Max number of OSDs that will be drained simultaneously when OSDs are removed", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "max_parallel_osd_upgrades": { 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_parallel_osd_upgrades", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "16", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Maximum number of OSD daemons upgraded in parallel.", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "migration_current": { 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "name": "migration_current", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.516 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Internal - do not modify", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "mode": { 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mode", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "root", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "cephadm-package", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "root" 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Mode for remote execution of cephadm", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "oob_default_addr": { 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "name": "oob_default_addr", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "169.254.1.1", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Default IP address for RedFish API (OOB management).", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "prometheus_alerts_path": { 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prometheus_alerts_path", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.517 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Location of alerts to include in Prometheus Alertmanager", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "registry_insecure": { 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_insecure", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "registry_password": { 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_password", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "registry_url": { 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_url", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Registry URL for login purposes. This is not the default registry.", 2026-02-24T09:21:17.518 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "registry_username": { 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_username", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "secure_monitoring_stack": { 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable TLS security for all monitoring stack daemons", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "service_discovery_port": { 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "name": "service_discovery_port", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8765", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Cephadm service discovery port", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.519 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "ssh_config_file": { 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssh_config_file", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Customized SSH config file to distribute to managed hosts", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "ssh_keepalive_count_max": { 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssh_keepalive_count_max", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How many sequential SSH connection liveness check failures before the host is marked offline", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "ssh_keepalive_interval": { 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssh_keepalive_interval", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "7", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.520 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How often SSH connections are checked for liveness", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "stray_daemon_check_interval": { 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "name": "stray_daemon_check_interval", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1800", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently cephadm should check for the presence of stray daemons", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "use_agent": { 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "name": "use_agent", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use the cephadm agent on each host to gather and send metadata", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "use_repo_digest": { 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "name": "use_repo_digest", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Automatically convert image tags to image digest to ensure that all daemons use the same image", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.521 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "warn_on_failed_host_check": { 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_on_failed_host_check", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Raise a health warning if the host check fails", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "warn_on_stray_daemons": { 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_on_stray_daemons", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "warn_on_stray_hosts": { 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_on_stray_hosts", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.522 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crash", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.523 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "retain_interval": { 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "name": "retain_interval", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "31536000", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.524 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "warn_recent_interval": { 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_recent_interval", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1209600", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "name": "dashboard", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "ALERTMANAGER_API_HOST": { 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.525 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "AUDIT_API_ENABLED": { 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "name": "AUDIT_API_ENABLED", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.526 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "ENABLE_BROWSABLE_API": { 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.527 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.528 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_PASSWORD": { 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "admin", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.529 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_URL": { 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_URL", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_USERNAME": { 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "admin", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.530 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.531 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "MANAGED_BY_CLUSTERS": { 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "name": "MANAGED_BY_CLUSTERS", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "[]", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "MULTICLUSTER_CONFIG": { 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "name": "MULTICLUSTER_CONFIG", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "{}", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "PROMETHEUS_API_HOST": { 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.532 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "PROM_ALERT_CREDENTIAL_CACHE_TTL": { 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PROM_ALERT_CREDENTIAL_CACHE_TTL", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-24T09:21:17.533 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.534 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_ENABLED": { 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.535 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-24T09:21:17.536 INFO:teuthology.orchestra.run.trial004.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "45", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_ACCESS_KEY": { 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "admin", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_SECRET_KEY": { 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.537 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_SSL_VERIFY": { 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_HOSTNAME_PER_DAEMON": { 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_HOSTNAME_PER_DAEMON", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "UNSAFE_TLS_v1_2": { 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "name": "UNSAFE_TLS_v1_2", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.538 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "cross_origin_url": { 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cross_origin_url", 2026-02-24T09:21:17.539 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "crt_file": { 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crt_file", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "crypto_caller": { 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crypto_caller", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "debug": { 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "name": "debug", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.540 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable/disable debug options", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "jwt_token_ttl": { 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "name": "jwt_token_ttl", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "28800", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "key_file": { 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "name": "key_file", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.541 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.542 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "motd": { 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "name": "motd", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "The message of the day", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "redirect_resolve_ip_addr": { 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "name": "redirect_resolve_ip_addr", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "server_addr": { 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_addr", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "::", 2026-02-24T09:21:17.543 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "server_port": { 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_port", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8080", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "ssl": { 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssl", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.544 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "ssl_server_port": { 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssl_server_port", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8443", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "sso_oauth2": { 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sso_oauth2", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "standby_behaviour": { 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_behaviour", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "redirect", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "redirect" 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "standby_error_status_code": { 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_error_status_code", 2026-02-24T09:21:17.545 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "500", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "min": "400", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "max": "599", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "url_prefix": { 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "name": "url_prefix", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "name": "devicehealth", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "enable_monitoring": { 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "name": "enable_monitoring", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "monitor device health metrics", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.546 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.547 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "mark_out_threshold": { 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mark_out_threshold", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "2419200", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "pool_name": { 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pool_name", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "device_health_metrics", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.548 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "retention_period": { 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "name": "retention_period", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "15552000", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how long to retain device health metrics", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "scrape_frequency": { 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "name": "scrape_frequency", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "86400", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "self_heal": { 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "name": "self_heal", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.549 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how frequently to wake up and check device health", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "warn_threshold": { 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_threshold", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "7257600", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "name": "diskprediction_local", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.550 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.551 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "predict_interval": { 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "name": "predict_interval", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "86400", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "predictor_model": { 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "name": "predictor_model", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "prophetstor", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.552 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "name": "influx", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": false, 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "influxdb python module not found", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "batch_size": { 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "name": "batch_size", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5000", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.553 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "database": { 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "name": "database", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "ceph", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": { 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "name": "hostname", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "InfluxDB server hostname", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "30", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "min": "5", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.554 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.555 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "password": { 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "name": "password", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "password of InfluxDB server user", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "port": { 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "name": "port", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8086", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "InfluxDB server port", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.556 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "ssl": { 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssl", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "false", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "threads": { 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "name": "threads", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "max": "32", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "username": { 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "name": "username", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.557 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "username of InfluxDB server user", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "verify_ssl": { 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "name": "verify_ssl", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "true", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "name": "insights", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.558 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.559 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "name": "iostat", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.560 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.561 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "name": "k8sevents", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_event_retention_days": { 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ceph_event_retention_days", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "7", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "config_check_secs": { 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "name": "config_check_secs", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "min": "10", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.562 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.563 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "name": "localpool", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.564 INFO:teuthology.orchestra.run.trial004.stdout: "failure_domain": { 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "name": "failure_domain", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "host", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "failure domain for any created local pool", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.565 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "min_size": { 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "name": "min_size", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "default min_size for any created local pool", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-24T09:21:17.566 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "num_rep": { 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "name": "num_rep", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "default replica count for any created local pool", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "pg_num": { 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pg_num", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "128", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "default pg_num for any created local pool", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "prefix": { 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prefix", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "name prefix for any created local pool", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.567 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "subtree": { 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "name": "subtree", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "rack", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mds_autoscaler", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.568 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.569 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mirroring", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.570 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.571 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "name": "nfs", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.572 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.573 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "name": "orchestrator", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "fail_fs": { 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "name": "fail_fs", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.574 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.575 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "orchestrator": { 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "name": "orchestrator", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "cephadm", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "rook", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "test_orchestrator" 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Orchestrator backend", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "name": "osd_perf_query", 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.576 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.577 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "name": "osd_support", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.578 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.579 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pg_autoscaler", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.580 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.581 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.582 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "threshold": { 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "name": "threshold", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3.0", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1.0", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "scaling threshold", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "name": "progress", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "allow_pg_recovery_event": { 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "name": "allow_pg_recovery_event", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "enabled": { 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "name": "enabled", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.583 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.584 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "max_completed_events": { 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_completed_events", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "50", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "number of past completed events to remember", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.585 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how long the module is going to sleep", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prometheus", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "cache": { 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cache", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "exclude_perf_counters": { 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "name": "exclude_perf_counters", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.586 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "healthcheck_history_max_entries": { 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "name": "healthcheck_history_max_entries", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1000", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Maximum number of health check history entries to keep", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.587 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_stats_pools": { 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rbd_stats_pools", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.588 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "300", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "scrape_interval": { 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "name": "scrape_interval", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "15.0", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "server_addr": { 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_addr", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "::", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-24T09:21:17.589 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "server_port": { 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_port", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "9283", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "stale_cache_strategy": { 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "name": "stale_cache_strategy", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "log", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "standby_behaviour": { 2026-02-24T09:21:17.590 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_behaviour", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "default", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "default", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "error" 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "standby_error_status_code": { 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_error_status_code", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "500", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "min": "400", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "max": "599", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rbd_support", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.591 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.592 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "max_concurrent_snap_create": { 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_concurrent_snap_create", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "mirror_snapshot_schedule": { 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mirror_snapshot_schedule", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.593 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "trash_purge_schedule": { 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "name": "trash_purge_schedule", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rgw", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.594 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "secondary_zone_period_retry_limit": { 2026-02-24T09:21:17.595 INFO:teuthology.orchestra.run.trial004.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rook", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.596 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.597 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "prometheus_tls_secret_name": { 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prometheus_tls_secret_name", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "rook-ceph-prometheus-server-tls", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "name of tls secret in k8s for prometheus", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "secure_monitoring_stack": { 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.598 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "storage_class": { 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "name": "storage_class", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "local", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "name": "selftest", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.599 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "roption1": { 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "name": "roption1", 2026-02-24T09:21:17.600 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "roption2": { 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "name": "roption2", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "xyz", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption1": { 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption1", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption2": { 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption2", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.601 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption3": { 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption3", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption4": { 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption4", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption5": { 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption5", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.602 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption6": { 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption6", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption7": { 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption7", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "max": "42", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "testkey": { 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "name": "testkey", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.603 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "testlkey": { 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "name": "testlkey", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "testnewline": { 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "name": "testnewline", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smb", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "internal_store_backend": { 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "name": "internal_store_backend", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.604 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "set internal store backend. for develoment and testing only", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.605 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.606 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "update_orchestration": { 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "name": "update_orchestration", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "automatically update orchestration when smb resources are changed", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "name": "snap_schedule", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "allow_m_granularity": { 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "name": "allow_m_granularity", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "allow minute scheduled snapshots", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "dump_on_update": { 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "name": "dump_on_update", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "dump database to debug log on update", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.607 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.608 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "name": "stats", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.609 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.610 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "name": "status", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.611 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.612 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "name": "telegraf", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "address": { 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "name": "address", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.613 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "15", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.614 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.615 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "name": "telemetry", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "channel_basic": { 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_basic", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "channel_crash": { 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_crash", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.616 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "channel_device": { 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_device", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "channel_ident": { 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_ident", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "channel_perf": { 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_perf", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "contact": { 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "name": "contact", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.617 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "description": { 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "name": "description", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "device_url": { 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "name": "device_url", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "enabled": { 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "name": "enabled", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.618 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "24", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "min": "8", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "last_opt_revision": { 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "name": "last_opt_revision", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "leaderboard": { 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "name": "leaderboard", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.619 INFO:teuthology.orchestra.run.trial004.stdout: "leaderboard_description": { 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "name": "leaderboard_description", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.620 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "organization": { 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "name": "organization", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.621 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "proxy": { 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "name": "proxy", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "url": { 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "name": "url", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.622 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "name": "test_orchestrator", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.623 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.624 INFO:teuthology.orchestra.run.trial004.stdout: "name": "volumes", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.625 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "max_concurrent_clones": { 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_concurrent_clones", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "4", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "pause_cloning": { 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pause_cloning", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.626 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Pause asynchronous cloner threads", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "pause_purging": { 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pause_purging", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Pause asynchronous subvolume purge threads", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "periodic_async_work": { 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "name": "periodic_async_work", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Periodically check for async work", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "snapshot_clone_delay": { 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "name": "snapshot_clone_delay", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.627 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "snapshot_clone_no_wait": { 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "name": "snapshot_clone_no_wait", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: ] 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "modules": [ 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "cephadm", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "dashboard", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "iostat", 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "nfs" 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: "available_modules": [ 2026-02-24T09:21:17.628 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "name": "alerts", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently to reexamine health status", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.629 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_destination": { 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_destination", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.630 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_from_name": { 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_from_name", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "Ceph", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Email From: name", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_host": { 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_host", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "SMTP server", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_password": { 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_password", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.631 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Password to authenticate with", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_port": { 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_port", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "465", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "SMTP port", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_sender": { 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_sender", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "SMTP envelope sender", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_ssl": { 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_ssl", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.632 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "smtp_user": { 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smtp_user", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "User to authenticate as", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "name": "balancer", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "active": { 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "name": "active", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "automatically balance PGs across cluster", 2026-02-24T09:21:17.633 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "begin_time": { 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "name": "begin_time", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0000", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "beginning time of day to automatically balance", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "begin_weekday": { 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "name": "begin_weekday", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "max": "6", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "crush_compat_max_iterations": { 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crush_compat_max_iterations", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "25", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "max": "250", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "crush_compat_metrics": { 2026-02-24T09:21:17.634 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crush_compat_metrics", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "pgs,objects,bytes", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "crush_compat_step": { 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crush_compat_step", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0.5", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0.001", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "max": "0.999", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "aggressiveness of optimization", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "end_time": { 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "name": "end_time", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "2359", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "ending time of day to automatically balance", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "end_weekday": { 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "name": "end_weekday", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.635 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "max": "6", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.636 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "min_score": { 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "name": "min_score", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.637 INFO:teuthology.orchestra.run.trial004.stdout: "mode": { 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mode", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "upmap", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "crush-compat", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "none", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "read", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "upmap", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "upmap-read" 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Balancer mode", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "pool_ids": { 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pool_ids", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.638 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "update_pg_upmap_activity": { 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "name": "update_pg_upmap_activity", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "upmap_max_deviation": { 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "name": "upmap_max_deviation", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "upmap_max_optimizations": { 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "name": "upmap_max_optimizations", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "type": "uint", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.639 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cephadm", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "agent_down_multiplier": { 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "name": "agent_down_multiplier", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3.0", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "agent_refresh_rate": { 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "name": "agent_refresh_rate", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "20", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How often the agent on each host will gather and send metadata", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "agent_starting_port": { 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "name": "agent_starting_port", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.640 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "4721", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "allow_ptrace": { 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "name": "allow_ptrace", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "autotune_interval": { 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "name": "autotune_interval", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently to autotune daemon memory", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "autotune_memory_target_ratio": { 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "name": "autotune_memory_target_ratio", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.641 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0.7", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "cephadm_log_destination": { 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cephadm_log_destination", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "file", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "file,syslog", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "syslog" 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Destination for cephadm command persistent logging", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_automated_rotation_enabled": { 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_automated_rotation_enabled", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "This flag controls whether cephadm automatically rotates certificates upon expiration.", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_check_debug_mode": { 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_check_debug_mode", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.642 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_check_period": { 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_check_period", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "min": "0", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "max": "30", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Specifies how often (in days) the certificate should be checked for validity.", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_duration_days": { 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_duration_days", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1095", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "min": "90", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "max": "3650", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Specifies the duration of self-signed certificates generated and signed by the cephadm root CA", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "certificate_renewal_threshold_days": { 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "name": "certificate_renewal_threshold_days", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "30", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "min": "10", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "max": "90", 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.643 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Specifies the lead time in days to initiate certificate renewal before expiration.", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "cgroups_split": { 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cgroups_split", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently Podman only)", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "config_checks_enabled": { 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "name": "config_checks_enabled", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable or disable cephadm configuration analysis", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "config_dashboard": { 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "name": "config_dashboard", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Manage configs like API endpoints in Dashboard.", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.644 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_alertmanager": { 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_alertmanager", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.28.1", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Alertmanager container image", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_alloy": { 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_alloy", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/grafana/alloy:latest", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Alloy container image", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_base": { 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_base", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Container image name, without the tag", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_elasticsearch": { 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_elasticsearch", 2026-02-24T09:21:17.645 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Elasticsearch container image", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_grafana": { 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_grafana", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/grafana:12.3.1", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Grafana container image", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_haproxy": { 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_haproxy", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Haproxy container image", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_jaeger_agent": { 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_jaeger_agent", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.646 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Jaeger agent container image", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_jaeger_collector": { 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_jaeger_collector", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Jaeger collector container image", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_jaeger_query": { 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_jaeger_query", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Jaeger query container image", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_keepalived": { 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_keepalived", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.647 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Keepalived container image", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_loki": { 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_loki", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Loki container image", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_nginx": { 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_nginx", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Nginx container image", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_node_exporter": { 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_node_exporter", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.9.1", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Node exporter container image", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.648 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_nvmeof": { 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_nvmeof", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/ceph/nvmeof:1.6", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Nvmeof container image", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_oauth2_proxy": { 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_oauth2_proxy", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Oauth2 proxy container image", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_prometheus": { 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_prometheus", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/prometheus/prometheus:v3.6.0", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Prometheus container image", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.649 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_promtail": { 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_promtail", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Promtail container image", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_samba": { 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_samba", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Samba container image", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_samba_metrics": { 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_samba_metrics", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io/samba.org/samba-metrics:devbuilds-centos-amd64", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Samba metrics container image", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "container_image_snmp_gateway": { 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_image_snmp_gateway", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.650 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Snmp gateway container image", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "container_init": { 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "name": "container_init", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Run podman/docker with `--init`", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "daemon_cache_timeout": { 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "name": "daemon_cache_timeout", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Seconds for which to cache service (daemon) inventory", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "default_cephadm_command_timeout": { 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "name": "default_cephadm_command_timeout", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "900", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.651 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "default_registry": { 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "name": "default_registry", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "quay.io", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "device_cache_timeout": { 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "name": "device_cache_timeout", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1800", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Seconds for which to cache device inventory", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "device_enhanced_scan": { 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "name": "device_enhanced_scan", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.652 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "facts_cache_timeout": { 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "name": "facts_cache_timeout", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Seconds for which to cache host facts data", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "grafana_dashboards_path": { 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "name": "grafana_dashboards_path", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Location of dashboards to include in Grafana", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "host_check_interval": { 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "name": "host_check_interval", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently to perform a host check", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.653 INFO:teuthology.orchestra.run.trial004.stdout: "hw_monitoring": { 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "name": "hw_monitoring", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Whether the hardware monitoring daemon be deployed on every host?", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "inventory_list_all": { 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "name": "inventory_list_all", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.654 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "log_refresh_metadata": { 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_refresh_metadata", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Log to the \"cephadm\" cluster log channel\"", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.655 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on hosts.", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "*", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.656 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "max_count_per_host": { 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_count_per_host", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Max number of daemons per service per host: guard against mistakes and runaways", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "max_osd_draining_count": { 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_osd_draining_count", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Max number of OSDs that will be drained simultaneously when OSDs are removed", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "max_parallel_osd_upgrades": { 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_parallel_osd_upgrades", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "16", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Maximum number of OSD daemons upgraded in parallel.", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.657 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "migration_current": { 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "name": "migration_current", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Internal - do not modify", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "mode": { 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mode", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "root", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "cephadm-package", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "root" 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Mode for remote execution of cephadm", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "oob_default_addr": { 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "name": "oob_default_addr", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "169.254.1.1", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Default IP address for RedFish API (OOB management).", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.658 INFO:teuthology.orchestra.run.trial004.stdout: "prometheus_alerts_path": { 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prometheus_alerts_path", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Location of alerts to include in Prometheus Alertmanager", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "registry_insecure": { 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_insecure", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "registry_password": { 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_password", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "registry_url": { 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_url", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.659 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Registry URL for login purposes. This is not the default registry.", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "registry_username": { 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "name": "registry_username", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "secure_monitoring_stack": { 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable TLS security for all monitoring stack daemons", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "service_discovery_port": { 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "name": "service_discovery_port", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8765", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.660 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Cephadm service discovery port", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "ssh_config_file": { 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssh_config_file", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Customized SSH config file to distribute to managed hosts", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "ssh_keepalive_count_max": { 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssh_keepalive_count_max", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How many sequential SSH connection liveness check failures before the host is marked offline", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.661 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "ssh_keepalive_interval": { 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssh_keepalive_interval", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "7", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How often SSH connections are checked for liveness", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "stray_daemon_check_interval": { 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "name": "stray_daemon_check_interval", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1800", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How frequently cephadm should check for the presence of stray daemons", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "use_agent": { 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "name": "use_agent", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use the cephadm agent on each host to gather and send metadata", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "use_repo_digest": { 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "name": "use_repo_digest", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.662 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Automatically convert image tags to image digest to ensure that all daemons use the same image", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "warn_on_failed_host_check": { 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_on_failed_host_check", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Raise a health warning if the host check fails", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "warn_on_stray_daemons": { 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_on_stray_daemons", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "warn_on_stray_hosts": { 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_on_stray_hosts", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.663 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crash", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.664 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "retain_interval": { 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "name": "retain_interval", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "31536000", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-24T09:21:17.665 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "warn_recent_interval": { 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_recent_interval", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1209600", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "name": "dashboard", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.666 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "ALERTMANAGER_API_HOST": { 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "AUDIT_API_ENABLED": { 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "name": "AUDIT_API_ENABLED", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.667 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "ENABLE_BROWSABLE_API": { 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.668 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.669 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.670 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_PASSWORD": { 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "admin", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_URL": { 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_URL", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_API_USERNAME": { 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.671 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "admin", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.672 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "MANAGED_BY_CLUSTERS": { 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "name": "MANAGED_BY_CLUSTERS", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "[]", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "MULTICLUSTER_CONFIG": { 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "name": "MULTICLUSTER_CONFIG", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "{}", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.673 INFO:teuthology.orchestra.run.trial004.stdout: "PROMETHEUS_API_HOST": { 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "PROM_ALERT_CREDENTIAL_CACHE_TTL": { 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PROM_ALERT_CREDENTIAL_CACHE_TTL", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.674 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.675 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.676 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_ENABLED": { 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.677 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "45", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_ACCESS_KEY": { 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "admin", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.678 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_SECRET_KEY": { 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_API_SSL_VERIFY": { 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "RGW_HOSTNAME_PER_DAEMON": { 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "name": "RGW_HOSTNAME_PER_DAEMON", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.679 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "UNSAFE_TLS_v1_2": { 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "name": "UNSAFE_TLS_v1_2", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.680 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "cross_origin_url": { 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cross_origin_url", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "crt_file": { 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crt_file", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "crypto_caller": { 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "name": "crypto_caller", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.681 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "debug": { 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "name": "debug", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable/disable debug options", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "jwt_token_ttl": { 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "name": "jwt_token_ttl", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "28800", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "key_file": { 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "name": "key_file", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.682 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.683 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "motd": { 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "name": "motd", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "The message of the day", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "redirect_resolve_ip_addr": { 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "name": "redirect_resolve_ip_addr", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.684 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "server_addr": { 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_addr", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "::", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "server_port": { 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_port", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8080", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "ssl": { 2026-02-24T09:21:17.685 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssl", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "ssl_server_port": { 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssl_server_port", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8443", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "sso_oauth2": { 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sso_oauth2", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "standby_behaviour": { 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_behaviour", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.686 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "redirect", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "redirect" 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "standby_error_status_code": { 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_error_status_code", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "500", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "min": "400", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "max": "599", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "url_prefix": { 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "name": "url_prefix", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "name": "devicehealth", 2026-02-24T09:21:17.687 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "enable_monitoring": { 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "name": "enable_monitoring", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "monitor device health metrics", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.688 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "mark_out_threshold": { 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mark_out_threshold", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.689 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "2419200", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "pool_name": { 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pool_name", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "device_health_metrics", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "retention_period": { 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "name": "retention_period", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "15552000", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how long to retain device health metrics", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "scrape_frequency": { 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "name": "scrape_frequency", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "86400", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.690 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "self_heal": { 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "name": "self_heal", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how frequently to wake up and check device health", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.691 INFO:teuthology.orchestra.run.trial004.stdout: "warn_threshold": { 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "name": "warn_threshold", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "7257600", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "name": "diskprediction_local", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.692 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.693 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "predict_interval": { 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "name": "predict_interval", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "86400", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "predictor_model": { 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "name": "predictor_model", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "prophetstor", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "600", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.694 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "name": "influx", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": false, 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "influxdb python module not found", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "batch_size": { 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "name": "batch_size", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5000", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "database": { 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "name": "database", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "ceph", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.695 INFO:teuthology.orchestra.run.trial004.stdout: "hostname": { 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "name": "hostname", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "InfluxDB server hostname", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "30", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "min": "5", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.696 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.697 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "password": { 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "name": "password", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "password of InfluxDB server user", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "port": { 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "name": "port", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "8086", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "InfluxDB server port", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.698 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "ssl": { 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ssl", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "false", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "threads": { 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "name": "threads", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "max": "32", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "username": { 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "name": "username", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "username of InfluxDB server user", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.699 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "verify_ssl": { 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "name": "verify_ssl", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "true", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "name": "insights", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.700 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.701 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "name": "iostat", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.702 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.703 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "name": "k8sevents", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_event_retention_days": { 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "name": "ceph_event_retention_days", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "7", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "config_check_secs": { 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "name": "config_check_secs", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "min": "10", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.704 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.705 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.706 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "name": "localpool", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "failure_domain": { 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "name": "failure_domain", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "host", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "failure domain for any created local pool", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.707 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "min_size": { 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "name": "min_size", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.708 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "default min_size for any created local pool", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "num_rep": { 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "name": "num_rep", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "default replica count for any created local pool", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "pg_num": { 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pg_num", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "128", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "default pg_num for any created local pool", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "prefix": { 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prefix", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.709 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "name prefix for any created local pool", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "subtree": { 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "name": "subtree", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "rack", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mds_autoscaler", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.710 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.711 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mirroring", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.712 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.713 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "name": "nfs", 2026-02-24T09:21:17.714 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.715 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.716 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "name": "orchestrator", 2026-02-24T09:21:17.717 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "fail_fs": { 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "name": "fail_fs", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.718 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.719 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "orchestrator": { 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "name": "orchestrator", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.720 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "cephadm", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "rook", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "test_orchestrator" 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Orchestrator backend", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "name": "osd_perf_query", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.721 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.722 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "name": "osd_support", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.723 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.724 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pg_autoscaler", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.725 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.726 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "60", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "threshold": { 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "name": "threshold", 2026-02-24T09:21:17.727 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "3.0", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1.0", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "scaling threshold", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "name": "progress", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "allow_pg_recovery_event": { 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "name": "allow_pg_recovery_event", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "enabled": { 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "name": "enabled", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.728 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.729 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "max_completed_events": { 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_completed_events", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "50", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "number of past completed events to remember", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "sleep_interval": { 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sleep_interval", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "how long the module is going to sleep", 2026-02-24T09:21:17.730 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prometheus", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "cache": { 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "name": "cache", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "exclude_perf_counters": { 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "name": "exclude_perf_counters", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.731 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "healthcheck_history_max_entries": { 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "name": "healthcheck_history_max_entries", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1000", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Maximum number of health check history entries to keep", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.732 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_stats_pools": { 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rbd_stats_pools", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.733 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "300", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "scrape_interval": { 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "name": "scrape_interval", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "15.0", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "server_addr": { 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_addr", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "::", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.734 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "server_port": { 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "name": "server_port", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "9283", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "stale_cache_strategy": { 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "name": "stale_cache_strategy", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "log", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "standby_behaviour": { 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_behaviour", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.735 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "default", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "default", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "error" 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "standby_error_status_code": { 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "name": "standby_error_status_code", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "500", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "min": "400", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "max": "599", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rbd_support", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.736 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.737 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "max_concurrent_snap_create": { 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_concurrent_snap_create", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "10", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "mirror_snapshot_schedule": { 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "name": "mirror_snapshot_schedule", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.738 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "trash_purge_schedule": { 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "name": "trash_purge_schedule", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rgw", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.739 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "secondary_zone_period_retry_limit": { 2026-02-24T09:21:17.740 INFO:teuthology.orchestra.run.trial004.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "5", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rook", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.741 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.742 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "prometheus_tls_secret_name": { 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "name": "prometheus_tls_secret_name", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "rook-ceph-prometheus-server-tls", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "name of tls secret in k8s for prometheus", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "secure_monitoring_stack": { 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "name": "secure_monitoring_stack", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.743 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "storage_class": { 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "name": "storage_class", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "local", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "name": "selftest", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.744 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.745 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "roption1": { 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "name": "roption1", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "roption2": { 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "name": "roption2", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "xyz", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption1": { 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption1", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption2": { 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption2", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.746 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption3": { 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption3", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "type": "float", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption4": { 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption4", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption5": { 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption5", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.747 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption6": { 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption6", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "rwoption7": { 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rwoption7", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "min": "1", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "max": "42", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "testkey": { 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "name": "testkey", 2026-02-24T09:21:17.748 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "testlkey": { 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "name": "testlkey", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "testnewline": { 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "name": "testnewline", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "name": "smb", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "internal_store_backend": { 2026-02-24T09:21:17.749 INFO:teuthology.orchestra.run.trial004.stdout: "name": "internal_store_backend", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "set internal store backend. for develoment and testing only", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.750 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.751 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "update_orchestration": { 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "name": "update_orchestration", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "automatically update orchestration when smb resources are changed", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "name": "snap_schedule", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "allow_m_granularity": { 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "name": "allow_m_granularity", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "allow minute scheduled snapshots", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "dump_on_update": { 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "name": "dump_on_update", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "dump database to debug log on update", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.752 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.753 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "name": "stats", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.754 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.755 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "name": "status", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.756 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.757 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "name": "telegraf", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "address": { 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "name": "address", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.758 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "type": "secs", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "15", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.759 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.760 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "name": "telemetry", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "channel_basic": { 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_basic", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "channel_crash": { 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_crash", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "channel_device": { 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_device", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.761 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "channel_ident": { 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_ident", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "channel_perf": { 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "name": "channel_perf", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "contact": { 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "name": "contact", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.762 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "description": { 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "name": "description", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "device_url": { 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "name": "device_url", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "enabled": { 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "name": "enabled", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.763 INFO:teuthology.orchestra.run.trial004.stdout: "interval": { 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "name": "interval", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "24", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "min": "8", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "last_opt_revision": { 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "name": "last_opt_revision", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "1", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "leaderboard": { 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "name": "leaderboard", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "leaderboard_description": { 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "name": "leaderboard_description", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.764 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.765 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "organization": { 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "name": "organization", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "proxy": { 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "name": "proxy", 2026-02-24T09:21:17.766 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "url": { 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "name": "url", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "name": "test_orchestrator", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.767 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.768 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "name": "volumes", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "can_run": true, 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "error_string": "", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "module_options": { 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "log_level": { 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_level", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.769 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster": { 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_cluster_level": { 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_cluster_level", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "type": "str", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "info", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [ 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "critical", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "debug", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "error", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "info", 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: "warning" 2026-02-24T09:21:17.770 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "log_to_file": { 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "name": "log_to_file", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "max_concurrent_clones": { 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "name": "max_concurrent_clones", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "4", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "pause_cloning": { 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pause_cloning", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Pause asynchronous cloner threads", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.771 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "pause_purging": { 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "name": "pause_purging", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Pause asynchronous subvolume purge threads", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "periodic_async_work": { 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "name": "periodic_async_work", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "False", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Periodically check for async work", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "snapshot_clone_delay": { 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "name": "snapshot_clone_delay", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "snapshot_clone_no_wait": { 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "name": "snapshot_clone_no_wait", 2026-02-24T09:21:17.772 INFO:teuthology.orchestra.run.trial004.stdout: "type": "bool", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "level": "advanced", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 0, 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "True", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "sqlite3_killpoint": { 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "name": "sqlite3_killpoint", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "type": "int", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "level": "dev", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "flags": 1, 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "default_value": "0", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "min": "", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "max": "", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "enum_allowed": [], 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "desc": "", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "long_desc": "", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "tags": [], 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "see_also": [] 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "services": { 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "dashboard": "https://10.20.193.4:8443/" 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "always_on_modules": { 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "octopus": [ 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "balancer", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "crash", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "devicehealth", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "orchestrator", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "pg_autoscaler", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "progress", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_support", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "status", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "telemetry", 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "volumes" 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "pacific": [ 2026-02-24T09:21:17.773 INFO:teuthology.orchestra.run.trial004.stdout: "balancer", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "crash", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "devicehealth", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "orchestrator", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "pg_autoscaler", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "progress", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_support", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "status", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "telemetry", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "volumes" 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "quincy": [ 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "balancer", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "crash", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "devicehealth", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "orchestrator", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "pg_autoscaler", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "progress", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_support", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "status", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "telemetry", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "volumes" 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "reef": [ 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "balancer", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "crash", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "devicehealth", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "orchestrator", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "pg_autoscaler", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "progress", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_support", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "status", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "telemetry", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "volumes" 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "squid": [ 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "balancer", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "crash", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "devicehealth", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "orchestrator", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "pg_autoscaler", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "progress", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_support", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "status", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "telemetry", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "volumes" 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: ], 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "tentacle": [ 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "balancer", 2026-02-24T09:21:17.774 INFO:teuthology.orchestra.run.trial004.stdout: "crash", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "devicehealth", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "orchestrator", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "pg_autoscaler", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "progress", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "rbd_support", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "status", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "telemetry", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "volumes" 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: ] 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "force_disabled_modules": {}, 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "last_failure_osd_epoch": 3, 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "active_clients": [ 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "name": "devicehealth", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "addrvec": [ 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "type": "v2", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "addr": "10.20.193.4:0", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "nonce": 3295951478 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: ] 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "name": "libcephsqlite", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "addrvec": [ 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "type": "v2", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "addr": "10.20.193.4:0", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "nonce": 2371257539 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: ] 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "name": "rbd_support", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "addrvec": [ 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "type": "v2", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "addr": "10.20.193.4:0", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "nonce": 741636303 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: ] 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "name": "volumes", 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: "addrvec": [ 2026-02-24T09:21:17.775 INFO:teuthology.orchestra.run.trial004.stdout: { 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stdout: "type": "v2", 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stdout: "addr": "10.20.193.4:0", 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stdout: "nonce": 143268591 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stdout: ] 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stdout: ] 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 -- 10.20.193.4:0/2253090099 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51540b5760 msgr2=0x7f51540d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51540b5760 0x7f51540d5c10 secure :-1 s=READY pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f516c02f6e0 tx=0x7f516c005c50 comp rx=0 tx=0).stop 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 -- 10.20.193.4:0/2253090099 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f517810f210 msgr2=0x7f51780f88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f517810f210 0x7f51780f88c0 secure :-1 s=READY pgs=1418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f516800d950 tx=0x7f516800de20 comp rx=0 tx=0).stop 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 -- 10.20.193.4:0/2253090099 shutdown_connections 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51540b5760 0x7f51540d5c10 unknown :-1 s=CLOSED pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5178110d50 0x7f51780f9100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f51781103a0 0x7f51781716c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 --2- 10.20.193.4:0/2253090099 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f517810f210 0x7f51780f88c0 unknown :-1 s=CLOSED pgs=1418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:17.776 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 -- 10.20.193.4:0/2253090099 >> 10.20.193.4:0/2253090099 conn(0x7f51780ec920 msgr2=0x7f51780eeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:17.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 -- 10.20.193.4:0/2253090099 shutdown_connections 2026-02-24T09:21:17.777 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:17.329+0000 7f518010c640 1 -- 10.20.193.4:0/2253090099 wait complete. 2026-02-24T09:21:17.780 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:21:17.781 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:16 trial014 ceph-mon[46941]: pgmap v496: 97 pgs: 97 active+clean; 4.1 GiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 196 MiB/s wr, 143 op/s 2026-02-24T09:21:17.781 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:16 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1006092625' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:21:17.781 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:16 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/108639603' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:21:17.781 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:16 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4034989997' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-24T09:21:17.781 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:16 trial090 ceph-mon[47278]: pgmap v496: 97 pgs: 97 active+clean; 4.1 GiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 196 MiB/s wr, 143 op/s 2026-02-24T09:21:17.781 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:16 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1006092625' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:21:17.781 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:16 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/108639603' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T09:21:17.781 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:16 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4034989997' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2026-02-24T09:21:17.900 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.011+0000 7f0525fda640 1 -- 10.20.193.4:0/247880046 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f052010f280 msgr2=0x7f052010f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.011+0000 7f0525fda640 1 --2- 10.20.193.4:0/247880046 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f052010f280 0x7f052010f650 secure :-1 s=READY pgs=1419 gs=1 cs=0 l=1 c_cookie=3787021279167254425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f050c009950 tx=0x7f050c02f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.011+0000 7f0525fda640 1 -- 10.20.193.4:0/247880046 shutdown_connections 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 --2- 10.20.193.4:0/247880046 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f0520115470 0x7f0520175e40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 --2- 10.20.193.4:0/247880046 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f052010fc70 0x7f0520114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 --2- 10.20.193.4:0/247880046 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f052010f280 0x7f052010f650 unknown :-1 s=CLOSED pgs=1419 gs=1 cs=0 l=1 c_cookie=3787021279167254425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 -- 10.20.193.4:0/247880046 >> 10.20.193.4:0/247880046 conn(0x7f052005f830 msgr2=0x7f052010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 -- 10.20.193.4:0/247880046 shutdown_connections 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 -- 10.20.193.4:0/247880046 wait complete. 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 Processor -- start 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 -- start start 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f052010f280 0x7f052011dc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.017 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f052010fc70 0x7f052011e150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0520115470 0x7f0520123520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f0520123b40 con 0x7f052010f280 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f0520123cb0 con 0x7f052010fc70 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f0525fda640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0520123e70 con 0x7f0520115470 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f052010f280 0x7f052011dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051f7fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f052010f280 0x7f052011dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42586/0 (socket says 10.20.193.4:42586) 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051f7fe640 1 -- 10.20.193.4:0/1052090303 learned_addr learned my addr 10.20.193.4:0/1052090303 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051effd640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f052010fc70 0x7f052011e150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051f7fe640 1 -- 10.20.193.4:0/1052090303 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0520115470 msgr2=0x7f0520123520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051ffff640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0520115470 0x7f0520123520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051f7fe640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0520115470 0x7f0520123520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051f7fe640 1 -- 10.20.193.4:0/1052090303 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f052010fc70 msgr2=0x7f052011e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051f7fe640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f052010fc70 0x7f052011e150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051f7fe640 1 -- 10.20.193.4:0/1052090303 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c009570 con 0x7f052010f280 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051effd640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f052010fc70 0x7f052011e150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.012+0000 7f051ffff640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0520115470 0x7f0520123520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.013+0000 7f051f7fe640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f052010f280 0x7f052011dc10 secure :-1 s=READY pgs=1420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f050c038820 tx=0x7f050c004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.013+0000 7f051cff9640 1 -- 10.20.193.4:0/1052090303 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f050c03d070 con 0x7f052010f280 2026-02-24T09:21:18.018 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.013+0000 7f051cff9640 1 -- 10.20.193.4:0/1052090303 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f050c002ad0 con 0x7f052010f280 2026-02-24T09:21:18.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.013+0000 7f0525fda640 1 -- 10.20.193.4:0/1052090303 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05201240f0 con 0x7f052010f280 2026-02-24T09:21:18.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.013+0000 7f051cff9640 1 -- 10.20.193.4:0/1052090303 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f050c041940 con 0x7f052010f280 2026-02-24T09:21:18.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.013+0000 7f0525fda640 1 -- 10.20.193.4:0/1052090303 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0520164850 con 0x7f052010f280 2026-02-24T09:21:18.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.013+0000 7f0525fda640 1 -- 10.20.193.4:0/1052090303 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0520110560 con 0x7f052010f280 2026-02-24T09:21:18.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.014+0000 7f051cff9640 1 -- 10.20.193.4:0/1052090303 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f050c041ad0 con 0x7f052010f280 2026-02-24T09:21:18.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.015+0000 7f051cff9640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f40b5760 0x7f04f40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.019 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.015+0000 7f051effd640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f40b5760 0x7f04f40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.015+0000 7f051cff9640 1 -- 10.20.193.4:0/1052090303 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f050c10b7e0 con 0x7f052010f280 2026-02-24T09:21:18.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.016+0000 7f051effd640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f40b5760 0x7f04f40d5c10 secure :-1 s=READY pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05201245b0 tx=0x7f0510005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.020 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.016+0000 7f051cff9640 1 -- 10.20.193.4:0/1052090303 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f050c0ce160 con 0x7f052010f280 2026-02-24T09:21:18.151 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.147+0000 7f0525fda640 1 -- 10.20.193.4:0/1052090303 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f052010f650 con 0x7f052010f280 2026-02-24T09:21:18.152 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:17 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/816048304' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-24T09:21:18.152 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:17 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2253090099' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2026-02-24T09:21:18.152 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.148+0000 7f051cff9640 1 -- 10.20.193.4:0/1052090303 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f050c0d1310 con 0x7f052010f280 2026-02-24T09:21:18.153 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:21:18.153 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:21:18.154 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:21:18.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.149+0000 7f0525fda640 1 -- 10.20.193.4:0/1052090303 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f40b5760 msgr2=0x7f04f40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.149+0000 7f0525fda640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f40b5760 0x7f04f40d5c10 secure :-1 s=READY pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05201245b0 tx=0x7f0510005f90 comp rx=0 tx=0).stop 2026-02-24T09:21:18.154 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.149+0000 7f0525fda640 1 -- 10.20.193.4:0/1052090303 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f052010f280 msgr2=0x7f052011dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.149+0000 7f0525fda640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f052010f280 0x7f052011dc10 secure :-1 s=READY pgs=1420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f050c038820 tx=0x7f050c004300 comp rx=0 tx=0).stop 2026-02-24T09:21:18.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.150+0000 7f0525fda640 1 -- 10.20.193.4:0/1052090303 shutdown_connections 2026-02-24T09:21:18.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.150+0000 7f0525fda640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f04f40b5760 0x7f04f40d5c10 unknown :-1 s=CLOSED pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.150+0000 7f0525fda640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0520115470 0x7f0520123520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.150+0000 7f0525fda640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f052010fc70 0x7f052011e150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.150+0000 7f0525fda640 1 --2- 10.20.193.4:0/1052090303 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f052010f280 0x7f052011dc10 unknown :-1 s=CLOSED pgs=1420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.150+0000 7f0525fda640 1 -- 10.20.193.4:0/1052090303 >> 10.20.193.4:0/1052090303 conn(0x7f052005f830 msgr2=0x7f052010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.150+0000 7f0525fda640 1 -- 10.20.193.4:0/1052090303 shutdown_connections 2026-02-24T09:21:18.155 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.150+0000 7f0525fda640 1 -- 10.20.193.4:0/1052090303 wait complete. 2026-02-24T09:21:18.189 DEBUG:tasks.check_counter:Getting stats from a 2026-02-24T09:21:18.189 DEBUG:tasks.check_counter:skipping mds.14796 2026-02-24T09:21:18.189 DEBUG:tasks.check_counter:Getting stats from d 2026-02-24T09:21:18.189 DEBUG:tasks.check_counter:skipping mds.14748 2026-02-24T09:21:18.189 DEBUG:tasks.check_counter:Getting stats from g 2026-02-24T09:21:18.189 DEBUG:tasks.check_counter:skipping mds.14790 2026-02-24T09:21:18.189 DEBUG:tasks.check_counter:Getting stats from j 2026-02-24T09:21:18.189 DEBUG:tasks.check_counter:skipping mds.14742 2026-02-24T09:21:18.189 DEBUG:tasks.check_counter:Getting stats from b 2026-02-24T09:21:18.189 DEBUG:tasks.check_counter:Getting stats from mds.24620 2026-02-24T09:21:18.190 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24620 perf dump --format=json-pretty 2026-02-24T09:21:18.261 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.255+0000 7f4aef41b640 1 -- 10.20.193.4:0/2022854885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ae810cf90 msgr2=0x7f4ae810d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.255+0000 7f4aef41b640 1 --2- 10.20.193.4:0/2022854885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ae810cf90 0x7f4ae810d380 secure :-1 s=READY pgs=1421 gs=1 cs=0 l=1 c_cookie=3860500373716652639 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad8009950 tx=0x7f4ad802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.255+0000 7f4aef41b640 1 -- 10.20.193.4:0/2022854885 shutdown_connections 2026-02-24T09:21:18.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.255+0000 7f4aef41b640 1 --2- 10.20.193.4:0/2022854885 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ae810ead0 0x7f4ae816f460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.255+0000 7f4aef41b640 1 --2- 10.20.193.4:0/2022854885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ae810e120 0x7f4ae810e590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.255+0000 7f4aef41b640 1 --2- 10.20.193.4:0/2022854885 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ae810cf90 0x7f4ae810d380 unknown :-1 s=CLOSED pgs=1421 gs=1 cs=0 l=1 c_cookie=3860500373716652639 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.255+0000 7f4aef41b640 1 -- 10.20.193.4:0/2022854885 >> 10.20.193.4:0/2022854885 conn(0x7f4ae80ea6c0 msgr2=0x7f4ae810aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.255+0000 7f4aef41b640 1 -- 10.20.193.4:0/2022854885 shutdown_connections 2026-02-24T09:21:18.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.255+0000 7f4aef41b640 1 -- 10.20.193.4:0/2022854885 wait complete. 2026-02-24T09:21:18.262 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aef41b640 1 Processor -- start 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aef41b640 1 -- start start 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aef41b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ae810cf90 0x7f4ae80f6670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aef41b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ae810e120 0x7f4ae816f460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aef41b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ae810ead0 0x7f4ae80f6ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aef41b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae80f7a30 con 0x7f4ae810cf90 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aef41b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae80f7ba0 con 0x7f4ae810e120 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aef41b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae80f7d60 con 0x7f4ae810ead0 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aed190640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ae810cf90 0x7f4ae80f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aed190640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ae810cf90 0x7f4ae80f6670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42598/0 (socket says 10.20.193.4:42598) 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aed190640 1 -- 10.20.193.4:0/2510106789 learned_addr learned my addr 10.20.193.4:0/2510106789 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.263 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aec98f640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ae810e120 0x7f4ae816f460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aed991640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ae810ead0 0x7f4ae80f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aed190640 1 -- 10.20.193.4:0/2510106789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ae810ead0 msgr2=0x7f4ae80f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aed190640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ae810ead0 0x7f4ae80f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aed190640 1 -- 10.20.193.4:0/2510106789 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ae810e120 msgr2=0x7f4ae816f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aed190640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ae810e120 0x7f4ae816f460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aed190640 1 -- 10.20.193.4:0/2510106789 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad8009570 con 0x7f4ae810cf90 2026-02-24T09:21:18.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.256+0000 7f4aed190640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ae810cf90 0x7f4ae80f6670 secure :-1 s=READY pgs=1422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad80023d0 tx=0x7f4ad80028d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.257+0000 7f4ad67fc640 1 -- 10.20.193.4:0/2510106789 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ad803d070 con 0x7f4ae810cf90 2026-02-24T09:21:18.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.257+0000 7f4aef41b640 1 -- 10.20.193.4:0/2510106789 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae80f7fe0 con 0x7f4ae810cf90 2026-02-24T09:21:18.264 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.257+0000 7f4ad67fc640 1 -- 10.20.193.4:0/2510106789 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ad80043d0 con 0x7f4ae810cf90 2026-02-24T09:21:18.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.257+0000 7f4ad67fc640 1 -- 10.20.193.4:0/2510106789 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ad8041b00 con 0x7f4ae810cf90 2026-02-24T09:21:18.265 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.257+0000 7f4aef41b640 1 -- 10.20.193.4:0/2510106789 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae80f8450 con 0x7f4ae810cf90 2026-02-24T09:21:18.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.259+0000 7f4ad67fc640 1 -- 10.20.193.4:0/2510106789 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f4ad804a3f0 con 0x7f4ae810cf90 2026-02-24T09:21:18.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.259+0000 7f4ad67fc640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ac40b56e0 0x7f4ac40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.259+0000 7f4aec98f640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ac40b56e0 0x7f4ac40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.266 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.260+0000 7f4ad67fc640 1 -- 10.20.193.4:0/2510106789 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4ad810c7f0 con 0x7f4ae810cf90 2026-02-24T09:21:18.267 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.263+0000 7f4aec98f640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ac40b56e0 0x7f4ac40d5b90 secure :-1 s=READY pgs=484 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4adc005970 tx=0x7f4adc005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4af1a12e00 1 Processor -- start 2026-02-24T09:21:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4af1a12e00 1 -- start start 2026-02-24T09:21:18.271 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10446a850 0x55e10448ac30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10448b170 0x55e1044ab550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1044aba90 0x55e1044cbe70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e1043764b0 con 0x55e10446a850 2026-02-24T09:21:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e1043721e0 con 0x55e1044aba90 2026-02-24T09:21:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e10436c340 con 0x55e10448b170 2026-02-24T09:21:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4aed190640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10446a850 0x55e10448ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4aed190640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10446a850 0x55e10448ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42606/0 (socket says 10.20.193.4:42606) 2026-02-24T09:21:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4aed190640 1 -- 10.20.193.4:0/102246276 learned_addr learned my addr 10.20.193.4:0/102246276 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4aec98f640 1 --2- 10.20.193.4:0/102246276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10448b170 0x55e1044ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.272 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.265+0000 7f4aed991640 1 --2- 10.20.193.4:0/102246276 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1044aba90 0x55e1044cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4aed190640 1 -- 10.20.193.4:0/102246276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10448b170 msgr2=0x55e1044ab550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4aed190640 1 --2- 10.20.193.4:0/102246276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10448b170 0x55e1044ab550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4aed190640 1 -- 10.20.193.4:0/102246276 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1044aba90 msgr2=0x55e1044cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4aed190640 1 --2- 10.20.193.4:0/102246276 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1044aba90 0x55e1044cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4aed190640 1 -- 10.20.193.4:0/102246276 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e104317990 con 0x55e10446a850 2026-02-24T09:21:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4aed991640 1 --2- 10.20.193.4:0/102246276 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1044aba90 0x55e1044cbe70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4aed190640 1 --2- 10.20.193.4:0/102246276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10446a850 0x55e10448ac30 secure :-1 s=READY pgs=1423 gs=1 cs=0 l=1 c_cookie=11995548343980662039 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad810a380 tx=0x7f4ad8041510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a678bfa9e8fe1d17 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4ab57fe640 1 -- 10.20.193.4:0/102246276 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ad810a0d0 con 0x55e10446a850 2026-02-24T09:21:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4ab57fe640 1 -- 10.20.193.4:0/102246276 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ad80dbe90 con 0x55e10446a850 2026-02-24T09:21:18.273 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4ab57fe640 1 -- 10.20.193.4:0/102246276 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ad803f310 con 0x55e10446a850 2026-02-24T09:21:18.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4af1a12e00 1 -- 10.20.193.4:0/102246276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10446a850 msgr2=0x55e10448ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/102246276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10446a850 0x55e10448ac30 secure :-1 s=READY pgs=1423 gs=1 cs=0 l=1 c_cookie=11995548343980662039 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad810a380 tx=0x7f4ad8041510 comp rx=0 tx=0).stop 2026-02-24T09:21:18.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4af1a12e00 1 -- 10.20.193.4:0/102246276 shutdown_connections 2026-02-24T09:21:18.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/102246276 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e1044aba90 0x55e1044cbe70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/102246276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10448b170 0x55e1044ab550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/102246276 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10446a850 0x55e10448ac30 unknown :-1 s=CLOSED pgs=1423 gs=1 cs=0 l=1 c_cookie=11995548343980662039 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4af1a12e00 1 -- 10.20.193.4:0/102246276 >> 10.20.193.4:0/102246276 conn(0x55e104381d30 msgr2=0x55e104464c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4af1a12e00 1 -- 10.20.193.4:0/102246276 shutdown_connections 2026-02-24T09:21:18.274 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.266+0000 7f4af1a12e00 1 -- 10.20.193.4:0/102246276 wait complete. 2026-02-24T09:21:18.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.278+0000 7f4af1a12e00 1 -- start start 2026-02-24T09:21:18.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.278+0000 7f4af1a12e00 1 Processor -- start 2026-02-24T09:21:18.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e10446a850 0x55e104483cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10448b170 0x55e104484300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.286 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1044aba90 0x55e104484d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e1044853c0 con 0x55e1044aba90 2026-02-24T09:21:18.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e104485530 con 0x55e10446a850 2026-02-24T09:21:18.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e1044856f0 con 0x55e10448b170 2026-02-24T09:21:18.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aed991640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1044aba90 0x55e104484d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aed991640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1044aba90 0x55e104484d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42614/0 (socket says 10.20.193.4:42614) 2026-02-24T09:21:18.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aed991640 1 -- 10.20.193.4:0/3884822940 learned_addr learned my addr 10.20.193.4:0/3884822940 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aec98f640 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10448b170 0x55e104484300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aed190640 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e10446a850 0x55e104483cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aed991640 1 -- 10.20.193.4:0/3884822940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10448b170 msgr2=0x55e104484300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.287 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aed991640 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10448b170 0x55e104484300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aed991640 1 -- 10.20.193.4:0/3884822940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e10446a850 msgr2=0x55e104483cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aed991640 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e10446a850 0x55e104483cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aed991640 1 -- 10.20.193.4:0/3884822940 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1042efd50 con 0x55e1044aba90 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aed991640 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1044aba90 0x55e104484d60 secure :-1 s=READY pgs=1424 gs=1 cs=0 l=1 c_cookie=15474290177799679286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae400efd0 tx=0x7f4ae4010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bfb8ee2f10ed36 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aa27fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aa27fc640 1 -- 10.20.193.4:0/3884822940 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ae4005500 con 0x55e1044aba90 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aa27fc640 1 -- 10.20.193.4:0/3884822940 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ae400cde0 con 0x55e1044aba90 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 1 -- 10.20.193.4:0/3884822940 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae80f8450 con 0x55e1044aba90 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aa27fc640 1 -- 10.20.193.4:0/3884822940 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ae401a780 con 0x55e1044aba90 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 10 client.18648 _ll_register_callbacks cb 0x55e1042e1fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:18.288 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 1 -- 10.20.193.4:0/3884822940 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e1040469e0 con 0x55e1044aba90 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aa27fc640 1 -- 10.20.193.4:0/3884822940 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4ae4005930 con 0x55e1044aba90 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aa27fc640 1 -- 10.20.193.4:0/3884822940 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4ae4005af0 con 0x55e1044aba90 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 10 client.18648 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 1 -- 10.20.193.4:0/3884822940 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e104301ea0 con 0x55e1044aba90 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4aa27fc640 1 -- 10.20.193.4:0/3884822940 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4ae4005cd0 con 0x55e1044aba90 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.279+0000 7f4af1a12e00 10 client.18648 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.280+0000 7f4af1a12e00 10 client.18648 resolve_mds: validated gid 24620 aka daemon mds.b 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.280+0000 7f4af1a12e00 20 client.18648 populate_metadata read hostname 'trial004' 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.280+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e104488450 0x55e1044888f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.280+0000 7f4af1a12e00 4 client.18648 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:18.289 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.280+0000 7f4af1a12e00 1 -- 10.20.193.4:0/3884822940 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e10437d850 con 0x55e104488450 2026-02-24T09:21:18.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.280+0000 7f4aed190640 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e104488450 0x55e1044888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.280+0000 7f4aa27fc640 10 client.18648 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:21:18.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.280+0000 7f4aed190640 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e104488450 0x55e1044888f0 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=22187800734220594 s_cookie=12062486916659963371 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ed3afed1c4132 server_cookie=a7668ff0df5065eb in_seq=0 out_seq=0 2026-02-24T09:21:18.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4aa27fc640 1 -- 10.20.193.4:0/3884822940 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55e10437d850 con 0x55e104488450 2026-02-24T09:21:18.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4aa27fc640 10 client.18648 handle_command_reply: tid=0 2026-02-24T09:21:18.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 client.18648 shutdown 2026-02-24T09:21:18.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 -- 10.20.193.4:0/3884822940 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1044aba90 msgr2=0x55e104484d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1044aba90 0x55e104484d60 secure :-1 s=READY pgs=1424 gs=1 cs=0 l=1 c_cookie=15474290177799679286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae400efd0 tx=0x7f4ae4010ca0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.290 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 -- 10.20.193.4:0/3884822940 shutdown_connections 2026-02-24T09:21:18.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e104488450 0x55e1044888f0 crc :-1 s=READY pgs=66 gs=4 cs=0 l=0 c_cookie=22187800734220594 s_cookie=12062486916659963371 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e1044aba90 0x55e104484d60 unknown :-1 s=CLOSED pgs=1424 gs=1 cs=0 l=1 c_cookie=15474290177799679286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10448b170 0x55e104484300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/3884822940 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e10446a850 0x55e104483cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4aa27fc640 0 client.18648 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:21:18.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 -- 10.20.193.4:0/3884822940 >> 10.20.193.4:0/3884822940 conn(0x55e104381d30 msgr2=0x55e10446bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 -- 10.20.193.4:0/3884822940 shutdown_connections 2026-02-24T09:21:18.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 1 -- 10.20.193.4:0/3884822940 wait complete. 2026-02-24T09:21:18.291 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.281+0000 7f4af1a12e00 20 client.18648 trim_cache size 0 max 16384 2026-02-24T09:21:18.298 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4af1a12e00 1 Processor -- start 2026-02-24T09:21:18.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4af1a12e00 1 -- start start 2026-02-24T09:21:18.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10446a850 0x55e104483b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e104488450 0x55e10447fe60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e1044803a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e104369f70 con 0x55e10448b170 2026-02-24T09:21:18.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e1040389f0 con 0x55e104488450 2026-02-24T09:21:18.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e1043721e0 con 0x55e10446a850 2026-02-24T09:21:18.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aed991640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e1044803a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.299 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aed991640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e1044803a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42624/0 (socket says 10.20.193.4:42624) 2026-02-24T09:21:18.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aed991640 1 -- 10.20.193.4:0/2061839815 learned_addr learned my addr 10.20.193.4:0/2061839815 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aed190640 1 --2- 10.20.193.4:0/2061839815 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10446a850 0x55e104483b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aec98f640 1 --2- 10.20.193.4:0/2061839815 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e104488450 0x55e10447fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aed991640 1 -- 10.20.193.4:0/2061839815 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10446a850 msgr2=0x55e104483b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aed991640 1 --2- 10.20.193.4:0/2061839815 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10446a850 0x55e104483b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aed991640 1 -- 10.20.193.4:0/2061839815 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e104488450 msgr2=0x55e10447fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aed991640 1 --2- 10.20.193.4:0/2061839815 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e104488450 0x55e10447fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aed991640 1 -- 10.20.193.4:0/2061839815 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1042fc740 con 0x55e10448b170 2026-02-24T09:21:18.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4aed991640 1 --2- 10.20.193.4:0/2061839815 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e1044803a0 secure :-1 s=READY pgs=1425 gs=1 cs=0 l=1 c_cookie=12682780551164507553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae400c6f0 tx=0x7f4ae401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00249b70c64b5a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.300 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4ab4ffd640 1 -- 10.20.193.4:0/2061839815 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ae401acc0 con 0x55e10448b170 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4ab4ffd640 1 -- 10.20.193.4:0/2061839815 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x55e1040469e0 con 0x55e10448b170 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.289+0000 7f4ab4ffd640 1 -- 10.20.193.4:0/2061839815 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ae4005560 con 0x55e10448b170 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 -- 10.20.193.4:0/2061839815 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 msgr2=0x55e1044803a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/2061839815 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e1044803a0 secure :-1 s=READY pgs=1425 gs=1 cs=0 l=1 c_cookie=12682780551164507553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae400c6f0 tx=0x7f4ae401e000 comp rx=0 tx=0).stop 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 -- 10.20.193.4:0/2061839815 shutdown_connections 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/2061839815 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e1044803a0 unknown :-1 s=CLOSED pgs=1425 gs=1 cs=0 l=1 c_cookie=12682780551164507553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/2061839815 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e104488450 0x55e10447fe60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/2061839815 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e10446a850 0x55e104483b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 -- 10.20.193.4:0/2061839815 >> 10.20.193.4:0/2061839815 conn(0x55e104381d30 msgr2=0x55e1044a9950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 -- 10.20.193.4:0/2061839815 shutdown_connections 2026-02-24T09:21:18.301 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 -- 10.20.193.4:0/2061839815 wait complete. 2026-02-24T09:21:18.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 -- start start 2026-02-24T09:21:18.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 Processor -- start 2026-02-24T09:21:18.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e10446a850 0x55e10448ca90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e104488450 0x55e10448d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e10448dae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55e10448e1e0 con 0x55e10448b170 2026-02-24T09:21:18.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55e10448e350 con 0x55e10446a850 2026-02-24T09:21:18.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4af1a12e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55e10448e510 con 0x55e104488450 2026-02-24T09:21:18.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4aed991640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e10448dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.302 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4aed991640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e10448dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42632/0 (socket says 10.20.193.4:42632) 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4aed991640 1 -- 10.20.193.4:0/941425583 learned_addr learned my addr 10.20.193.4:0/941425583 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4aed190640 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e10446a850 0x55e10448ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4aec98f640 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e104488450 0x55e10448d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4aed991640 1 -- 10.20.193.4:0/941425583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e104488450 msgr2=0x55e10448d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4aed991640 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e104488450 0x55e10448d130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4aed991640 1 -- 10.20.193.4:0/941425583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e10446a850 msgr2=0x55e10448ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4aed991640 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e10446a850 0x55e10448ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.290+0000 7f4aed991640 1 -- 10.20.193.4:0/941425583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1042f0080 con 0x55e10448b170 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4aed991640 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e10448dae0 secure :-1 s=READY pgs=1426 gs=1 cs=0 l=1 c_cookie=14519259011889122014 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae4010ce0 tx=0x7f4ae4006e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97ec5251d8a4ade server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4aa27fc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:18.303 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4aa27fc640 1 -- 10.20.193.4:0/941425583 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ae401acc0 con 0x55e10448b170 2026-02-24T09:21:18.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4aa27fc640 1 -- 10.20.193.4:0/941425583 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ae40057e0 con 0x55e10448b170 2026-02-24T09:21:18.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4aa27fc640 1 -- 10.20.193.4:0/941425583 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ae4019ba0 con 0x55e10448b170 2026-02-24T09:21:18.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 1 -- 10.20.193.4:0/941425583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e104301ea0 con 0x55e10448b170 2026-02-24T09:21:18.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4aa27fc640 1 -- 10.20.193.4:0/941425583 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f4ae4019d30 con 0x55e10448b170 2026-02-24T09:21:18.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4aa27fc640 10 client.18654 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:21:18.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 10 client.18654 _ll_register_callbacks cb 0x55e1042f6d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:18.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 1 -- 10.20.193.4:0/941425583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e1043a3850 con 0x55e10448b170 2026-02-24T09:21:18.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4aa27fc640 1 -- 10.20.193.4:0/941425583 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4ae400cb10 con 0x55e10448b170 2026-02-24T09:21:18.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 10 client.18654 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:18.304 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 1 -- 10.20.193.4:0/941425583 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55e104302100 con 0x55e10448b170 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4aa27fc640 1 -- 10.20.193.4:0/941425583 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7f4ae400ccf0 con 0x55e10448b170 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 10 client.18654 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 10 client.18654 resolve_mds: validated gid 24620 aka daemon mds.b 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 20 client.18654 populate_metadata read hostname 'trial004' 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e1044aba90 0x55e1044900d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 4 client.18654 mds_command: new command op to 24620 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4af1a12e00 1 -- 10.20.193.4:0/941425583 --> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x55e104094740 con 0x55e1044aba90 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.291+0000 7f4aed190640 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e1044aba90 0x55e1044900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aed190640 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e1044aba90 0x55e1044900d0 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=10094607511744234587 s_cookie=2660764157564808434 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c17400c6481445b server_cookie=24eceee76abdecf2 in_seq=0 out_seq=0 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aa27fc640 10 client.18654 ms_handle_connect on v2:10.20.193.14:6838/2269480307 2026-02-24T09:21:18.305 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aa27fc640 1 -- 10.20.193.4:0/941425583 <== mds.2 v2:10.20.193.14:6838/2269480307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18292 (crc 0 0 0) 0x55e104094740 con 0x55e1044aba90 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aa27fc640 10 client.18654 handle_command_reply: tid=0 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 client.18654 shutdown 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 -- 10.20.193.4:0/941425583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 msgr2=0x55e10448dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e10448dae0 secure :-1 s=READY pgs=1426 gs=1 cs=0 l=1 c_cookie=14519259011889122014 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae4010ce0 tx=0x7f4ae4006e20 comp rx=0 tx=0).stop 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 -- 10.20.193.4:0/941425583 shutdown_connections 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.14:6838/2269480307,v1:10.20.193.14:6839/2269480307] conn(0x55e1044aba90 0x55e1044900d0 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=10094607511744234587 s_cookie=2660764157564808434 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55e10448b170 0x55e10448dae0 unknown :-1 s=CLOSED pgs=1426 gs=1 cs=0 l=1 c_cookie=14519259011889122014 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55e104488450 0x55e10448d130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 --2- 10.20.193.4:0/941425583 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55e10446a850 0x55e10448ca90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aa27fc640 0 client.18654 ms_handle_reset on v2:10.20.193.14:6838/2269480307 2026-02-24T09:21:18.306 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 -- 10.20.193.4:0/941425583 >> 10.20.193.4:0/941425583 conn(0x55e104381d30 msgr2=0x55e1044a9950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 -- 10.20.193.4:0/941425583 shutdown_connections 2026-02-24T09:21:18.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 1 -- 10.20.193.4:0/941425583 wait complete. 2026-02-24T09:21:18.307 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4af1a12e00 20 client.18654 trim_cache size 0 max 16384 2026-02-24T09:21:18.307 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:21:18.307 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:21:18.307 INFO:teuthology.orchestra.run.trial004.stdout: "AsyncMessenger::Worker-0": { 2026-02-24T09:21:18.308 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_messages": 424, 2026-02-24T09:21:18.308 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages": 558, 2026-02-24T09:21:18.308 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_bytes": 91491, 2026-02-24T09:21:18.308 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_bytes": 219972, 2026-02-24T09:21:18.308 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_created_connections": 6, 2026-02-24T09:21:18.308 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_active_connections": 4, 2026-02-24T09:21:18.308 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_total_time": 0.033674082, 2026-02-24T09:21:18.308 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_send_time": 0.016110995, 2026-02-24T09:21:18.308 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_recv_time": 0.016003291, 2026-02-24T09:21:18.308 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_fast_dispatch_time": 0.000161118, 2026-02-24T09:21:18.309 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:21:18.309 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 557, 2026-02-24T09:21:18.309 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.020453477, 2026-02-24T09:21:18.309 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000036720 2026-02-24T09:21:18.309 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.309 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:21:18.309 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 929, 2026-02-24T09:21:18.309 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000085962, 2026-02-24T09:21:18.309 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000092 2026-02-24T09:21:18.309 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_encrypted_bytes": 0 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "AsyncMessenger::Worker-1": { 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_messages": 264, 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages": 257, 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_bytes": 564570, 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_bytes": 192518, 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_created_connections": 9, 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_active_connections": 5, 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_total_time": 0.024417660, 2026-02-24T09:21:18.310 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_send_time": 0.011218139, 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_recv_time": 0.015756618, 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_fast_dispatch_time": 0.000118439, 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 257, 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.019227410, 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000074814 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 23, 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000001863, 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000081 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.311 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_encrypted_bytes": 560208, 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_encrypted_bytes": 126768 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "AsyncMessenger::Worker-2": { 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_messages": 60, 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages": 204, 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_bytes": 10116, 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_bytes": 986724, 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_created_connections": 54, 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_active_connections": 4, 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_total_time": 0.017581157, 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_send_time": 0.006334425, 2026-02-24T09:21:18.312 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_recv_time": 0.010064192, 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_fast_dispatch_time": 0.000080298, 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 203, 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.005455559, 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000026874 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 59, 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000003670, 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000062 2026-02-24T09:21:18.313 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_encrypted_bytes": 1760, 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_encrypted_bytes": 369744 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "cct": { 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "total_workers": 1, 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "unhealthy_workers": 0 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "finisher-MDSRank": { 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "queue_len": 0, 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "complete_latency": { 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 56, 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000687990, 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000012285 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.314 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "finisher-PurgeQueue": { 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "queue_len": 0, 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "complete_latency": { 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 2, 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000009809, 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000004904 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "mds": { 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "request": 3, 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "reply": 1, 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "reply_latency": { 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 1, 2026-02-24T09:21:18.315 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000074978, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000074978 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "slow_reply": 0, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "forward": 2, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "dir_fetch_complete": 0, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "dir_fetch_keys": 0, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "dir_commit": 11, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "dir_split": 0, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "dir_merge": 0, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "inodes": 10, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_top": 0, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_bottom": 10, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_pin_tail": 0, 2026-02-24T09:21:18.316 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_pinned": 10, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_expired": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_with_caps": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "caps": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "subtrees": 1, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "traverse": 25, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_hit": 24, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_forward": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_discover": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_dir_fetch": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_remote_ino": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_lock": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "load_cent": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "q": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "exported": 0, 2026-02-24T09:21:18.317 INFO:teuthology.orchestra.run.trial004.stdout: "exported_inodes": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "imported": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "imported_inodes": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "openino_dir_fetch": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "openino_backtrace_fetch": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "openino_peer_discover": 1, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "root_rfiles": 22, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "root_rbytes": 10738144067, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "root_rsnaps": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_backtrace_fetch": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_set_tag": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_backtrace_repaired": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_inotable_repaired": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_dir_inodes": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_dir_base_inodes": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_dirfrag_rstats": 0, 2026-02-24T09:21:18.318 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_file_inodes": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "handle_inode_file_caps": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_revoke": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_grant": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_trunc": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_caps": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_caps_dirty": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_cap_release": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "process_request_cap_release": 1 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "mds_cache": { 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "dir_update": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "dir_update_receipt": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "dir_try_discover": 0, 2026-02-24T09:21:18.319 INFO:teuthology.orchestra.run.trial004.stdout: "dir_send_discover": 1, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "dir_handle_discover": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "num_strays": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "num_strays_delayed": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "num_strays_enqueuing": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "strays_created": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "strays_enqueued": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "strays_reintegrated": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "strays_migrated": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "num_recovering_processing": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "num_recovering_enqueued": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "num_recovering_prioritized": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "recovery_started": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "recovery_completed": 0, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_quiesce_path": 11, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_quiesce_inode": 11, 2026-02-24T09:21:18.320 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_enqueue_scrub": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_exportdir": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_flush": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_fragmentdir": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_fragstats": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_inodestats": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_succeeded": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_write_failed": 0 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "mds_log": { 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "evlrg": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "evadd": 5, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "evex": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "evtrm": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "ev": 5, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "evexg": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "evexd": 0, 2026-02-24T09:21:18.321 INFO:teuthology.orchestra.run.trial004.stdout: "segadd": 2, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "segex": 0, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "segtrm": 0, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "seg": 2, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "segmjr": 2, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "segexg": 0, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "segexd": 0, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "expos": 4194304, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "wrpos": 4195750, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "rdpos": 0, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "jlat": { 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 4, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.003527436, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000881859 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "replayed": 0 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "mds_mem": { 2026-02-24T09:21:18.322 INFO:teuthology.orchestra.run.trial004.stdout: "ino": 13, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "ino+": 13, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "ino-": 0, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "dir": 11, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "dir+": 12, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "dir-": 1, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "dn": 10, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "dn+": 10, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "dn-": 0, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "cap": 0, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "cap+": 1, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "cap-": 1, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "rss": 48816, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "heap": 259747840 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "mds_server": { 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "dispatch_client_request": 3, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "dispatch_server_request": 0, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_request": 3, 2026-02-24T09:21:18.323 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_session": 13, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "handle_peer_request": 0, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "req_create_latency": { 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "req_getattr_latency": { 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 1, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000074978, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000074978 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "req_getfilelock_latency": { 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "req_link_latency": { 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.324 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookup_latency": { 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookuphash_latency": { 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupino_latency": { 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupname_latency": { 2026-02-24T09:21:18.325 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupparent_latency": { 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupsnap_latency": { 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "req_lssnap_latency": { 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.326 INFO:teuthology.orchestra.run.trial004.stdout: "req_mkdir_latency": { 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "req_mknod_latency": { 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "req_mksnap_latency": { 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "req_open_latency": { 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.327 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "req_readdir_latency": { 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "req_rename_latency": { 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "req_renamesnap_latency": { 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "req_snapdiff_latency": { 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.328 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "req_rmdir_latency": { 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "req_rmsnap_latency": { 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "req_rmxattr_latency": { 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "req_setattr_latency": { 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.329 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "req_setdirlayout_latency": { 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "req_setfilelock_latency": { 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "req_setlayout_latency": { 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "req_setxattr_latency": { 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.330 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "req_symlink_latency": { 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "req_unlink_latency": { 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "cap_revoke_eviction": 0, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "cache_trim_throttle": 0, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "session_recall_throttle": 0, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "session_recall_throttle2o": 0, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "global_recall_throttle": 0, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "cap_acquisition_throttle": 0, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "req_getvxattr_latency": { 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.331 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "req_blockdiff_latency": { 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "mds_sessions": { 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "session_count": 1, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "session_add": 2, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "session_remove": 1, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "sessions_open": 1, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "sessions_stale": 0, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "total_load": 1, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "average_load": 1, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "avg_session_uptime": 679, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "mdthresh_evicted": 0 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "mempool": { 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "bloom_filter_bytes": 0, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "bloom_filter_items": 0, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_alloc_bytes": 0, 2026-02-24T09:21:18.332 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_alloc_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_data_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_data_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_onode_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_meta_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_other_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_other_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_buffer_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_extent_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_extent_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_blob_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_blob_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_shared_blob_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_inline_bl_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_fsck_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_fsck_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_txc_bytes": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_txc_items": 0, 2026-02-24T09:21:18.333 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_deferred_items": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_bytes": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_items": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_bytes": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_items": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_reader_bytes": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_reader_items": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_writer_bytes": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_writer_items": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_anon_bytes": 238199, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_anon_items": 76, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_meta_bytes": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_meta_items": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "osd_bytes": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "osd_items": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "osd_mapbl_bytes": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "osd_mapbl_items": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "osd_pglog_bytes": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "osd_pglog_items": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_bytes": 7888, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_items": 161, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_mapping_bytes": 0, 2026-02-24T09:21:18.334 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_mapping_items": 0, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "pgmap_bytes": 0, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "pgmap_items": 0, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "mds_co_bytes": 51872, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "mds_co_items": 200, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "ec_extent_cache_bytes": 0, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "ec_extent_cache_items": 0, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_1_bytes": 0, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_1_items": 0, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_2_bytes": 0, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_2_items": 0 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "objecter": { 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "op_active": 0, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "op_laggy": 0, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "op_send": 40, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "op_send_bytes": 11858, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "op_resend": 31, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "op_reply": 40, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "op_latency": { 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 40, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.066998156, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.001674953 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.335 INFO:teuthology.orchestra.run.trial004.stdout: "op_inflight": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "oplen_avg": { 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 62, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 40 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "op": 40, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "op_r": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "op_w": 40, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "op_rmw": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "op_pg": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_stat": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_create": 10, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_read": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_write": 4, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_writefull": 7, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_writesame": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_append": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_zero": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_truncate": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_delete": 6, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_mapext": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_sparse_read": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_clonerange": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_getxattr": 0, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_setxattr": 20, 2026-02-24T09:21:18.336 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_cmpxattr": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_rmxattr": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_resetxattrs": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_call": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_watch": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_notify": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_src_cmpxattr": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_pgls": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_pgls_filter": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_other": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "linger_active": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "linger_send": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "linger_resend": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "linger_ping": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "poolop_active": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "poolop_send": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "poolop_resend": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "poolstat_active": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "poolstat_send": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "poolstat_resend": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "statfs_active": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "statfs_send": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "statfs_resend": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "command_active": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "command_send": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "command_resend": 0, 2026-02-24T09:21:18.337 INFO:teuthology.orchestra.run.trial004.stdout: "map_epoch": 79, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "map_full": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "map_inc": 4, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "osd_sessions": 8, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "osd_session_open": 8, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "osd_session_close": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "osd_laggy": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "omap_wr": 14, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "omap_rd": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "omap_del": 1, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "replica_read_sent": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "replica_read_bounced": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "replica_read_completed": 0 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "oft": { 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_objs": 1, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_kv_pairs": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_updates": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_removes": 0 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "purge_queue": { 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing_ops": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing_ops_high_water": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing_high_water": 0, 2026-02-24T09:21:18.338 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executed_ops": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executed": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "pq_item_in_journal": 0 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "max": 104857600, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "get": 748, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 586162, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 748, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "take": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "put": 748, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 586162, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-objecter_bytes": { 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "max": 104857600, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "get": 0, 2026-02-24T09:21:18.339 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "take": 40, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 11858, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "put": 40, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 11858, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-objecter_ops": { 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "max": 1024, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "get": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "take": 40, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 40, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "put": 40, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 40, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.340 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-write_buf_throttle": { 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "max": 3758096384, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "get": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "take": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "put": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-write_buf_throttle-0x33cc3c0": { 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "max": 3758096384, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "get": 5, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 1446, 2026-02-24T09:21:18.341 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 5, 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "take": 0, 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 0, 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "put": 4, 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 1446, 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "trackedop": { 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: "slow_ops_count": 20 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.342 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aef41b640 1 -- 10.20.193.4:0/2510106789 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ac40b56e0 msgr2=0x7f4ac40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aef41b640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ac40b56e0 0x7f4ac40d5b90 secure :-1 s=READY pgs=484 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4adc005970 tx=0x7f4adc005900 comp rx=0 tx=0).stop 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aef41b640 1 -- 10.20.193.4:0/2510106789 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ae810cf90 msgr2=0x7f4ae80f6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aef41b640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ae810cf90 0x7f4ae80f6670 secure :-1 s=READY pgs=1422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad80023d0 tx=0x7f4ad80028d0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aef41b640 1 -- 10.20.193.4:0/2510106789 shutdown_connections 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aef41b640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f4ac40b56e0 0x7f4ac40d5b90 unknown :-1 s=CLOSED pgs=484 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aef41b640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4ae810ead0 0x7f4ae80f6ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aef41b640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f4ae810e120 0x7f4ae816f460 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aef41b640 1 --2- 10.20.193.4:0/2510106789 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f4ae810cf90 0x7f4ae80f6670 unknown :-1 s=CLOSED pgs=1422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.292+0000 7f4aef41b640 1 -- 10.20.193.4:0/2510106789 >> 10.20.193.4:0/2510106789 conn(0x7f4ae80ea6c0 msgr2=0x7f4ae80ecca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.293+0000 7f4aef41b640 1 -- 10.20.193.4:0/2510106789 shutdown_connections 2026-02-24T09:21:18.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.293+0000 7f4aef41b640 1 -- 10.20.193.4:0/2510106789 wait complete. 2026-02-24T09:21:18.344 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2026-02-24T09:21:18.344 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2026-02-24T09:21:18.344 DEBUG:tasks.check_counter:Getting stats from e 2026-02-24T09:21:18.344 DEBUG:tasks.check_counter:skipping mds.24575 2026-02-24T09:21:18.344 DEBUG:tasks.check_counter:Getting stats from h 2026-02-24T09:21:18.344 DEBUG:tasks.check_counter:skipping mds.24596 2026-02-24T09:21:18.344 DEBUG:tasks.check_counter:Getting stats from k 2026-02-24T09:21:18.344 DEBUG:tasks.check_counter:skipping mds.24557 2026-02-24T09:21:18.344 DEBUG:tasks.check_counter:Getting stats from c 2026-02-24T09:21:18.344 DEBUG:tasks.check_counter:Getting stats from mds.24625 2026-02-24T09:21:18.344 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24625 perf dump --format=json-pretty 2026-02-24T09:21:18.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:17 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/816048304' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-24T09:21:18.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:17 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2253090099' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2026-02-24T09:21:18.345 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:17 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/816048304' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2026-02-24T09:21:18.345 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:17 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2253090099' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2026-02-24T09:21:18.412 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 -- 10.20.193.4:0/1761523214 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd3181103a0 msgr2=0x7fd318110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 --2- 10.20.193.4:0/1761523214 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd3181103a0 0x7fd318110810 secure :-1 s=READY pgs=1427 gs=1 cs=0 l=1 c_cookie=17175035206658952540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd308009950 tx=0x7fd30802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 -- 10.20.193.4:0/1761523214 shutdown_connections 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 --2- 10.20.193.4:0/1761523214 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd318110d50 0x7fd3181716e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 --2- 10.20.193.4:0/1761523214 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd3181103a0 0x7fd318110810 unknown :-1 s=CLOSED pgs=1427 gs=1 cs=0 l=1 c_cookie=17175035206658952540 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 --2- 10.20.193.4:0/1761523214 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd31810f210 0x7fd31810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 -- 10.20.193.4:0/1761523214 >> 10.20.193.4:0/1761523214 conn(0x7fd3180ec960 msgr2=0x7fd31810cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 -- 10.20.193.4:0/1761523214 shutdown_connections 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 -- 10.20.193.4:0/1761523214 wait complete. 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 Processor -- start 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 -- start start 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd31810f210 0x7fd3180f8890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3181103a0 0x7fd3181716e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd318110d50 0x7fd3180f90f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180f9ce0 con 0x7fd31810f210 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180f9e50 con 0x7fd318110d50 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd31dcc3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180fa010 con 0x7fd3181103a0 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd3177fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd31810f210 0x7fd3180f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd3177fe640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd31810f210 0x7fd3180f8890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42646/0 (socket says 10.20.193.4:42646) 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd3177fe640 1 -- 10.20.193.4:0/2340812915 learned_addr learned my addr 10.20.193.4:0/2340812915 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd316ffd640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3181103a0 0x7fd3181716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd3177fe640 1 -- 10.20.193.4:0/2340812915 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3181103a0 msgr2=0x7fd3181716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd317fff640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd318110d50 0x7fd3180f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd3177fe640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3181103a0 0x7fd3181716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd3177fe640 1 -- 10.20.193.4:0/2340812915 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd318110d50 msgr2=0x7fd3180f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.413 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd3177fe640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd318110d50 0x7fd3180f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd3177fe640 1 -- 10.20.193.4:0/2340812915 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd308009570 con 0x7fd31810f210 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd316ffd640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3181103a0 0x7fd3181716e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.408+0000 7fd317fff640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd318110d50 0x7fd3180f90f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.409+0000 7fd3177fe640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd31810f210 0x7fd3180f8890 secure :-1 s=READY pgs=1428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd30400d950 tx=0x7fd30400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.409+0000 7fd314ff9640 1 -- 10.20.193.4:0/2340812915 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd304004540 con 0x7fd31810f210 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.409+0000 7fd31dcc3640 1 -- 10.20.193.4:0/2340812915 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3180fa2f0 con 0x7fd31810f210 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.409+0000 7fd314ff9640 1 -- 10.20.193.4:0/2340812915 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd304009d00 con 0x7fd31810f210 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.409+0000 7fd314ff9640 1 -- 10.20.193.4:0/2340812915 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3040106e0 con 0x7fd31810f210 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.409+0000 7fd31dcc3640 1 -- 10.20.193.4:0/2340812915 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3180fa810 con 0x7fd31810f210 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.410+0000 7fd314ff9640 1 -- 10.20.193.4:0/2340812915 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fd3040097c0 con 0x7fd31810f210 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.411+0000 7fd314ff9640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd2ec0b56e0 0x7fd2ec0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.411+0000 7fd314ff9640 1 -- 10.20.193.4:0/2340812915 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd3040e6e20 con 0x7fd31810f210 2026-02-24T09:21:18.414 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.411+0000 7fd316ffd640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd2ec0b56e0 0x7fd2ec0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.415 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.411+0000 7fd316ffd640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd2ec0b56e0 0x7fd2ec0d5b90 secure :-1 s=READY pgs=485 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3080098a0 tx=0x7fd308031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd3202a5e00 1 Processor -- start 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd3202a5e00 1 -- start start 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e677720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e698040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e6b8960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55784e5674b0 con 0x55784e698580 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55784e5631e0 con 0x55784e657340 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55784e55d340 con 0x55784e677c60 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd317fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e6b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd317fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e6b8960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42658/0 (socket says 10.20.193.4:42658) 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd317fff640 1 -- 10.20.193.4:0/2062233969 learned_addr learned my addr 10.20.193.4:0/2062233969 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd3177fe640 1 --2- 10.20.193.4:0/2062233969 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e677720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd316ffd640 1 --2- 10.20.193.4:0/2062233969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e698040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd317fff640 1 -- 10.20.193.4:0/2062233969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 msgr2=0x55784e698040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd317fff640 1 --2- 10.20.193.4:0/2062233969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e698040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd317fff640 1 -- 10.20.193.4:0/2062233969 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 msgr2=0x55784e677720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd317fff640 1 --2- 10.20.193.4:0/2062233969 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e677720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd317fff640 1 -- 10.20.193.4:0/2062233969 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55784e508990 con 0x55784e698580 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd316ffd640 1 --2- 10.20.193.4:0/2062233969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e698040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:18.417 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd317fff640 1 --2- 10.20.193.4:0/2062233969 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e6b8960 secure :-1 s=READY pgs=1429 gs=1 cs=0 l=1 c_cookie=5129126143086978142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd30c004b70 tx=0x7fd30c00f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472e510d46de645e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd2e37fe640 1 -- 10.20.193.4:0/2062233969 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd30c00fea0 con 0x55784e698580 2026-02-24T09:21:18.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd2e37fe640 1 -- 10.20.193.4:0/2062233969 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd30c004e90 con 0x55784e698580 2026-02-24T09:21:18.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.413+0000 7fd2e37fe640 1 -- 10.20.193.4:0/2062233969 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd30c011920 con 0x55784e698580 2026-02-24T09:21:18.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.414+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2062233969 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 msgr2=0x55784e6b8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.418 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.414+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2062233969 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e6b8960 secure :-1 s=READY pgs=1429 gs=1 cs=0 l=1 c_cookie=5129126143086978142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd30c004b70 tx=0x7fd30c00f6c0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.414+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2062233969 shutdown_connections 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.414+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2062233969 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e6b8960 unknown :-1 s=CLOSED pgs=1429 gs=1 cs=0 l=1 c_cookie=5129126143086978142 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.414+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2062233969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e698040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.414+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2062233969 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e677720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.414+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2062233969 >> 10.20.193.4:0/2062233969 conn(0x55784e572d30 msgr2=0x55784e655c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.414+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2062233969 shutdown_connections 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.414+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2062233969 wait complete. 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd3202a5e00 1 -- start start 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd3202a5e00 1 Processor -- start 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e6708c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e670f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.420 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e671970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55784e671fd0 con 0x55784e698580 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55784e672140 con 0x55784e657340 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55784e672300 con 0x55784e677c60 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd317fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e671970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd317fff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e671970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42672/0 (socket says 10.20.193.4:42672) 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd317fff640 1 -- 10.20.193.4:0/2263781123 learned_addr learned my addr 10.20.193.4:0/2263781123 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd316ffd640 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e670f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd3177fe640 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e6708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd317fff640 1 -- 10.20.193.4:0/2263781123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 msgr2=0x55784e670f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd317fff640 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e670f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd317fff640 1 -- 10.20.193.4:0/2263781123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 msgr2=0x55784e6708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd317fff640 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e6708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd317fff640 1 -- 10.20.193.4:0/2263781123 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55784e4e0d50 con 0x55784e698580 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd317fff640 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e671970 secure :-1 s=READY pgs=1430 gs=1 cs=0 l=1 c_cookie=18269820266735657523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd30c006e20 tx=0x7fd30c004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8b70bc2502e233 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd2e0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.415+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2263781123 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd30c022070 con 0x55784e698580 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2263781123 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd30c011ee0 con 0x55784e698580 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2263781123 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30c004790 con 0x55784e698580 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2263781123 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd30c006730 con 0x55784e698580 2026-02-24T09:21:18.421 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 10 client.18666 _ll_register_callbacks cb 0x55784e4d2fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2263781123 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55784e2379e0 con 0x55784e698580 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2263781123 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd30c012470 con 0x55784e698580 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2263781123 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd30c012630 con 0x55784e698580 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 10 client.18666 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2263781123 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55784e4f2ea0 con 0x55784e698580 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2263781123 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd30c00d070 con 0x55784e698580 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 10 client.18666 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 10 client.18666 resolve_mds: validated gid 24625 aka daemon mds.c 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 20 client.18666 populate_metadata read hostname 'trial004' 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55784e674ed0 0x55784e675370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 4 client.18666 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2263781123 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55784e56e850 con 0x55784e674ed0 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.416+0000 7fd3177fe640 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55784e674ed0 0x55784e675370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd2e0ff9640 10 client.18666 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:21:18.422 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3177fe640 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55784e674ed0 0x55784e675370 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=8709120190153116747 s_cookie=4774287994554655496 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78dd02ab88424c4b server_cookie=4241ada2c2d7a308 in_seq=0 out_seq=0 2026-02-24T09:21:18.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2263781123 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55784e56e850 con 0x55784e674ed0 2026-02-24T09:21:18.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd2e0ff9640 10 client.18666 handle_command_reply: tid=0 2026-02-24T09:21:18.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 client.18666 shutdown 2026-02-24T09:21:18.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2263781123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 msgr2=0x55784e671970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e671970 secure :-1 s=READY pgs=1430 gs=1 cs=0 l=1 c_cookie=18269820266735657523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd30c006e20 tx=0x7fd30c004ea0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2263781123 shutdown_connections 2026-02-24T09:21:18.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55784e674ed0 0x55784e675370 crc :-1 s=READY pgs=67 gs=4 cs=0 l=0 c_cookie=8709120190153116747 s_cookie=4774287994554655496 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e698580 0x55784e671970 unknown :-1 s=CLOSED pgs=1430 gs=1 cs=0 l=1 c_cookie=18269820266735657523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.423 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e670f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd2e0ff9640 0 client.18666 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:21:18.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2263781123 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e6708c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2263781123 >> 10.20.193.4:0/2263781123 conn(0x55784e572d30 msgr2=0x55784e658610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2263781123 shutdown_connections 2026-02-24T09:21:18.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2263781123 wait complete. 2026-02-24T09:21:18.424 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.417+0000 7fd3202a5e00 20 client.18666 trim_cache size 0 max 16384 2026-02-24T09:21:18.429 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd3202a5e00 1 Processor -- start 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd3202a5e00 1 -- start start 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e66ca70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e66cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e66d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55784e55af70 con 0x55784e674ed0 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55784e2299f0 con 0x55784e657340 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55784e669930 con 0x55784e677c60 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd316ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e66cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd316ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e66cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42678/0 (socket says 10.20.193.4:42678) 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd316ffd640 1 -- 10.20.193.4:0/3342844299 learned_addr learned my addr 10.20.193.4:0/3342844299 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd317fff640 1 --2- 10.20.193.4:0/3342844299 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e66d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd316ffd640 1 -- 10.20.193.4:0/3342844299 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 msgr2=0x55784e66d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd316ffd640 1 --2- 10.20.193.4:0/3342844299 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e66d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd316ffd640 1 -- 10.20.193.4:0/3342844299 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 msgr2=0x55784e66ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd316ffd640 1 --2- 10.20.193.4:0/3342844299 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e66ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd316ffd640 1 -- 10.20.193.4:0/3342844299 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55784e4ed740 con 0x55784e674ed0 2026-02-24T09:21:18.430 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd316ffd640 1 --2- 10.20.193.4:0/3342844299 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e66cfb0 secure :-1 s=READY pgs=1431 gs=1 cs=0 l=1 c_cookie=8211964951043790214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3080093e0 tx=0x7fd30803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f6c29d36ec5586 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd2e2ffd640 1 -- 10.20.193.4:0/3342844299 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd30803f070 con 0x55784e674ed0 2026-02-24T09:21:18.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd2e2ffd640 1 -- 10.20.193.4:0/3342844299 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd308039930 con 0x55784e674ed0 2026-02-24T09:21:18.431 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd2e2ffd640 1 -- 10.20.193.4:0/3342844299 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3080518d0 con 0x55784e674ed0 2026-02-24T09:21:18.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd3202a5e00 1 -- 10.20.193.4:0/3342844299 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 msgr2=0x55784e66cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.426+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/3342844299 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e66cfb0 secure :-1 s=READY pgs=1431 gs=1 cs=0 l=1 c_cookie=8211964951043790214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3080093e0 tx=0x7fd30803a000 comp rx=0 tx=0).stop 2026-02-24T09:21:18.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 -- 10.20.193.4:0/3342844299 shutdown_connections 2026-02-24T09:21:18.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/3342844299 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e677c60 0x55784e66d4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/3342844299 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e66cfb0 unknown :-1 s=CLOSED pgs=1431 gs=1 cs=0 l=1 c_cookie=8211964951043790214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/3342844299 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e657340 0x55784e66ca70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 -- 10.20.193.4:0/3342844299 >> 10.20.193.4:0/3342844299 conn(0x55784e572d30 msgr2=0x55784e696440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.434 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 -- 10.20.193.4:0/3342844299 shutdown_connections 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 -- 10.20.193.4:0/3342844299 wait complete. 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 -- start start 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 Processor -- start 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e657340 0x55784e679550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e679bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e677c60 0x55784e67a620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55784e67ad20 con 0x55784e674ed0 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55784e67ae90 con 0x55784e677c60 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd3202a5e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55784e67b050 con 0x55784e657340 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd316ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e679bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd316ffd640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e679bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42682/0 (socket says 10.20.193.4:42682) 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.427+0000 7fd316ffd640 1 -- 10.20.193.4:0/2276532513 learned_addr learned my addr 10.20.193.4:0/2276532513 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3177fe640 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e657340 0x55784e679550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd317fff640 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e677c60 0x55784e67a620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd316ffd640 1 -- 10.20.193.4:0/2276532513 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e657340 msgr2=0x55784e679550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd316ffd640 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e657340 0x55784e679550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.435 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd316ffd640 1 -- 10.20.193.4:0/2276532513 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e677c60 msgr2=0x55784e67a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd316ffd640 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e677c60 0x55784e67a620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd316ffd640 1 -- 10.20.193.4:0/2276532513 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55784e4e1080 con 0x55784e674ed0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd317fff640 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e677c60 0x55784e67a620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd316ffd640 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e679bf0 secure :-1 s=READY pgs=1432 gs=1 cs=0 l=1 c_cookie=9598565562639815914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3080023b0 tx=0x7fd308051670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8534f4861a7194ea server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd2e0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2276532513 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd30803f070 con 0x55784e674ed0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2276532513 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd308051890 con 0x55784e674ed0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2276532513 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30804c040 con 0x55784e674ed0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2276532513 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd30805ba20 con 0x55784e674ed0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 10 client.18672 _ll_register_callbacks cb 0x55784e4e7d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2276532513 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55784e594850 con 0x55784e674ed0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2276532513 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd30805bbb0 con 0x55784e674ed0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2276532513 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd30805bd70 con 0x55784e674ed0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 10 client.18672 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2276532513 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55784e4f3100 con 0x55784e674ed0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2276532513 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fd308062020 con 0x55784e674ed0 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 10 client.18672 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 10 client.18672 resolve_mds: validated gid 24625 aka daemon mds.c 2026-02-24T09:21:18.436 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 20 client.18672 populate_metadata read hostname 'trial004' 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55784e698580 0x55784e67cdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 4 client.18672 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2276532513 --> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x55784e285740 con 0x55784e698580 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.428+0000 7fd3177fe640 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55784e698580 0x55784e67cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd3177fe640 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55784e698580 0x55784e67cdc0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=3952294256228034762 s_cookie=12268902031674423817 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36d95eaf9649e8ca server_cookie=aa43e564f605ba09 in_seq=0 out_seq=0 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd2e0ff9640 10 client.18672 ms_handle_connect on v2:10.20.193.90:6836/4190330264 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd2e0ff9640 1 -- 10.20.193.4:0/2276532513 <== mds.1 v2:10.20.193.90:6836/4190330264 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18280 (crc 0 0 0) 0x55784e285740 con 0x55784e698580 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd2e0ff9640 10 client.18672 handle_command_reply: tid=0 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd3202a5e00 1 client.18672 shutdown 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2276532513 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 msgr2=0x55784e679bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e679bf0 secure :-1 s=READY pgs=1432 gs=1 cs=0 l=1 c_cookie=9598565562639815914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3080023b0 tx=0x7fd308051670 comp rx=0 tx=0).stop 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2276532513 shutdown_connections 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.90:6836/4190330264,v1:10.20.193.90:6837/4190330264] conn(0x55784e698580 0x55784e67cdc0 crc :-1 s=READY pgs=68 gs=4 cs=0 l=0 c_cookie=3952294256228034762 s_cookie=12268902031674423817 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55784e677c60 0x55784e67a620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55784e674ed0 0x55784e679bf0 unknown :-1 s=CLOSED pgs=1432 gs=1 cs=0 l=1 c_cookie=9598565562639815914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd2e0ff9640 0 client.18672 ms_handle_reset on v2:10.20.193.90:6836/4190330264 2026-02-24T09:21:18.437 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.429+0000 7fd3202a5e00 1 --2- 10.20.193.4:0/2276532513 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55784e657340 0x55784e679550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2276532513 >> 10.20.193.4:0/2276532513 conn(0x55784e572d30 msgr2=0x55784e696c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2276532513 shutdown_connections 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd3202a5e00 1 -- 10.20.193.4:0/2276532513 wait complete. 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd3202a5e00 20 client.18672 trim_cache size 0 max 16384 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stdout: "AsyncMessenger::Worker-0": { 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_messages": 69, 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages": 71, 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_bytes": 12055, 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_bytes": 676655, 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_created_connections": 58, 2026-02-24T09:21:18.438 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_active_connections": 9, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_total_time": 0.014396881, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_send_time": 0.001157539, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_recv_time": 0.009817532, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_fast_dispatch_time": 0.000155947, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 68, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.009028091, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000132766 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 52, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000002313, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000044 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_encrypted_bytes": 0 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.439 INFO:teuthology.orchestra.run.trial004.stdout: "AsyncMessenger::Worker-1": { 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_messages": 656, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages": 779, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_bytes": 651747, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_bytes": 214146, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_created_connections": 5, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_active_connections": 4, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_total_time": 0.050607549, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_send_time": 0.027879512, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_recv_time": 0.028826282, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_fast_dispatch_time": 0.000102500, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 781, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.020085264, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000025717 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 930, 2026-02-24T09:21:18.440 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000092051, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000098 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_encrypted_bytes": 563472, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_encrypted_bytes": 125744 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "AsyncMessenger::Worker-2": { 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_messages": 9, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages": 155, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_bytes": 2387, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_bytes": 377671, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_created_connections": 5, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_active_connections": 4, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_total_time": 0.008131620, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_send_time": 0.005870177, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_recv_time": 0.001430245, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_fast_dispatch_time": 0.000079076, 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:21:18.441 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 154, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.008947534, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000058100 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_encrypted_bytes": 160, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_encrypted_bytes": 368512 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "cct": { 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "total_workers": 1, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "unhealthy_workers": 0 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "finisher-MDSRank": { 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "queue_len": 0, 2026-02-24T09:21:18.442 INFO:teuthology.orchestra.run.trial004.stdout: "complete_latency": { 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 46, 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000591284, 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000012854 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "finisher-PurgeQueue": { 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "queue_len": 0, 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "complete_latency": { 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 2, 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000007954, 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000003977 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "mds": { 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "request": 0, 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "reply": 0, 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "reply_latency": { 2026-02-24T09:21:18.443 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "slow_reply": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "forward": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "dir_fetch_complete": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "dir_fetch_keys": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "dir_commit": 11, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "dir_split": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "dir_merge": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "inodes": 10, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_top": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_bottom": 10, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_pin_tail": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_pinned": 10, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_expired": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_with_caps": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "caps": 0, 2026-02-24T09:21:18.444 INFO:teuthology.orchestra.run.trial004.stdout: "subtrees": 1, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "traverse": 22, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_hit": 22, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_forward": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_discover": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_dir_fetch": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_remote_ino": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_lock": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "load_cent": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "q": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "exported": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "exported_inodes": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "imported": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "imported_inodes": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "openino_dir_fetch": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "openino_backtrace_fetch": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "openino_peer_discover": 0, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "root_rfiles": 22, 2026-02-24T09:21:18.445 INFO:teuthology.orchestra.run.trial004.stdout: "root_rbytes": 10738144067, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "root_rsnaps": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_backtrace_fetch": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_set_tag": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_backtrace_repaired": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_inotable_repaired": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_dir_inodes": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_dir_base_inodes": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_dirfrag_rstats": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_file_inodes": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "handle_inode_file_caps": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_revoke": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_grant": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_trunc": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_caps": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_caps_dirty": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_cap_release": 0, 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: "process_request_cap_release": 0 2026-02-24T09:21:18.446 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "mds_cache": { 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "dir_update": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "dir_update_receipt": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "dir_try_discover": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "dir_send_discover": 1, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "dir_handle_discover": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "num_strays": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "num_strays_delayed": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "num_strays_enqueuing": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "strays_created": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "strays_enqueued": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "strays_reintegrated": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "strays_migrated": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "num_recovering_processing": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "num_recovering_enqueued": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "num_recovering_prioritized": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "recovery_started": 0, 2026-02-24T09:21:18.447 INFO:teuthology.orchestra.run.trial004.stdout: "recovery_completed": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_quiesce_path": 11, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_quiesce_inode": 11, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_enqueue_scrub": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_exportdir": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_flush": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_fragmentdir": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_fragstats": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_inodestats": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_succeeded": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_write_failed": 0 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "mds_log": { 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "evlrg": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "evadd": 2, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "evex": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "evtrm": 0, 2026-02-24T09:21:18.448 INFO:teuthology.orchestra.run.trial004.stdout: "ev": 2, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "evexg": 0, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "evexd": 0, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "segadd": 2, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "segex": 0, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "segtrm": 0, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "seg": 2, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "segmjr": 2, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "segexg": 0, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "segexd": 0, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "expos": 4194304, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "wrpos": 4194892, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "rdpos": 0, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "jlat": { 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 1, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000617596, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000617596 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: "replayed": 0 2026-02-24T09:21:18.449 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "mds_mem": { 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "ino": 13, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "ino+": 13, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "ino-": 0, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "dir": 11, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "dir+": 12, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "dir-": 1, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "dn": 10, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "dn+": 10, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "dn-": 0, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "cap": 0, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "cap+": 0, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "cap-": 0, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "rss": 52076, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "heap": 259756032 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "mds_server": { 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "dispatch_client_request": 0, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "dispatch_server_request": 0, 2026-02-24T09:21:18.450 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_request": 0, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_session": 0, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "handle_peer_request": 0, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "req_create_latency": { 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "req_getattr_latency": { 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "req_getfilelock_latency": { 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "req_link_latency": { 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.451 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookup_latency": { 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookuphash_latency": { 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupino_latency": { 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupname_latency": { 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.452 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupparent_latency": { 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupsnap_latency": { 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "req_lssnap_latency": { 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "req_mkdir_latency": { 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.453 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "req_mknod_latency": { 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "req_mksnap_latency": { 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "req_open_latency": { 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "req_readdir_latency": { 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.454 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "req_rename_latency": { 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "req_renamesnap_latency": { 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "req_snapdiff_latency": { 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "req_rmdir_latency": { 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.455 INFO:teuthology.orchestra.run.trial004.stdout: "req_rmsnap_latency": { 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "req_rmxattr_latency": { 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "req_setattr_latency": { 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "req_setdirlayout_latency": { 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "req_setfilelock_latency": { 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.456 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "req_setlayout_latency": { 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "req_setxattr_latency": { 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "req_symlink_latency": { 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "req_unlink_latency": { 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.457 INFO:teuthology.orchestra.run.trial004.stdout: "cap_revoke_eviction": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "cache_trim_throttle": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "session_recall_throttle": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "session_recall_throttle2o": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "global_recall_throttle": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "cap_acquisition_throttle": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "req_getvxattr_latency": { 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "req_blockdiff_latency": { 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "mds_sessions": { 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "session_count": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "session_add": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "session_remove": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "sessions_open": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "sessions_stale": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "total_load": 0, 2026-02-24T09:21:18.458 INFO:teuthology.orchestra.run.trial004.stdout: "average_load": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "avg_session_uptime": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "mdthresh_evicted": 0 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "mempool": { 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bloom_filter_bytes": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bloom_filter_items": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_alloc_bytes": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_alloc_items": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_data_bytes": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_data_items": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_onode_items": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_meta_items": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_other_bytes": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_other_items": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_buffer_items": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_extent_bytes": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_extent_items": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_blob_bytes": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_blob_items": 0, 2026-02-24T09:21:18.459 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_shared_blob_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_inline_bl_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_fsck_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_fsck_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_txc_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_txc_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_deferred_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_reader_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_reader_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_writer_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_writer_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_anon_bytes": 230119, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_anon_items": 73, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_meta_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_meta_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "osd_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "osd_items": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "osd_mapbl_bytes": 0, 2026-02-24T09:21:18.460 INFO:teuthology.orchestra.run.trial004.stdout: "osd_mapbl_items": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "osd_pglog_bytes": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "osd_pglog_items": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_bytes": 7888, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_items": 161, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_mapping_bytes": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_mapping_items": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "pgmap_bytes": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "pgmap_items": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "mds_co_bytes": 51856, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "mds_co_items": 198, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "ec_extent_cache_bytes": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "ec_extent_cache_items": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_1_bytes": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_1_items": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_2_bytes": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_2_items": 0 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "objecter": { 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "op_active": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "op_laggy": 0, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "op_send": 35, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "op_send_bytes": 10820, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "op_resend": 33, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "op_reply": 35, 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "op_latency": { 2026-02-24T09:21:18.461 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 35, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.074997825, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.002142795 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "op_inflight": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "oplen_avg": { 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 57, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 35 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "op": 35, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "op_r": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "op_w": 35, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "op_rmw": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "op_pg": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_stat": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_create": 10, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_read": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_write": 1, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_writefull": 5, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_writesame": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_append": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_zero": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_truncate": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_delete": 6, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_mapext": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_sparse_read": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_clonerange": 0, 2026-02-24T09:21:18.462 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_getxattr": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_setxattr": 20, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_cmpxattr": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_rmxattr": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_resetxattrs": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_call": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_watch": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_notify": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_src_cmpxattr": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_pgls": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_pgls_filter": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_other": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "linger_active": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "linger_send": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "linger_resend": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "linger_ping": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "poolop_active": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "poolop_send": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "poolop_resend": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "poolstat_active": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "poolstat_send": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "poolstat_resend": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "statfs_active": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "statfs_send": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "statfs_resend": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "command_active": 0, 2026-02-24T09:21:18.463 INFO:teuthology.orchestra.run.trial004.stdout: "command_send": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "command_resend": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "map_epoch": 79, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "map_full": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "map_inc": 4, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "osd_sessions": 9, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "osd_session_open": 9, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "osd_session_close": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "osd_laggy": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "omap_wr": 14, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "omap_rd": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "omap_del": 1, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "replica_read_sent": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "replica_read_bounced": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "replica_read_completed": 0 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "oft": { 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_objs": 1, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_kv_pairs": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_updates": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_removes": 0 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "purge_queue": { 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing_ops": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing_ops_high_water": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing_high_water": 0, 2026-02-24T09:21:18.464 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executed_ops": 0, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executed": 0, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "pq_item_in_journal": 0 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "max": 104857600, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "get": 734, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 587899, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 734, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "take": 0, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 0, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "put": 734, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 587899, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-objecter_bytes": { 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "max": 104857600, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.465 INFO:teuthology.orchestra.run.trial004.stdout: "get": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "take": 35, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 10820, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "put": 35, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 10820, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-objecter_ops": { 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "max": 1024, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "get": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "take": 35, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 35, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "put": 35, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 35, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.466 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-write_buf_throttle": { 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "max": 3758096384, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "get": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "take": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "put": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-write_buf_throttle-0x3eac3c0": { 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "max": 3758096384, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "get": 2, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 588, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 2, 2026-02-24T09:21:18.467 INFO:teuthology.orchestra.run.trial004.stdout: "take": 0, 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 0, 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: "put": 1, 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 588, 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: "trackedop": { 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: "slow_ops_count": 20 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.468 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 -- 10.20.193.4:0/2340812915 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd2ec0b56e0 msgr2=0x7fd2ec0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd2ec0b56e0 0x7fd2ec0d5b90 secure :-1 s=READY pgs=485 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3080098a0 tx=0x7fd308031040 comp rx=0 tx=0).stop 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 -- 10.20.193.4:0/2340812915 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd31810f210 msgr2=0x7fd3180f8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd31810f210 0x7fd3180f8890 secure :-1 s=READY pgs=1428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd30400d950 tx=0x7fd30400de20 comp rx=0 tx=0).stop 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 -- 10.20.193.4:0/2340812915 shutdown_connections 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd2ec0b56e0 0x7fd2ec0d5b90 unknown :-1 s=CLOSED pgs=485 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd318110d50 0x7fd3180f90f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3181103a0 0x7fd3181716e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 --2- 10.20.193.4:0/2340812915 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd31810f210 0x7fd3180f8890 unknown :-1 s=CLOSED pgs=1428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 -- 10.20.193.4:0/2340812915 >> 10.20.193.4:0/2340812915 conn(0x7fd3180ec960 msgr2=0x7fd3180eef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 -- 10.20.193.4:0/2340812915 shutdown_connections 2026-02-24T09:21:18.469 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.430+0000 7fd31dcc3640 1 -- 10.20.193.4:0/2340812915 wait complete. 2026-02-24T09:21:18.470 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2026-02-24T09:21:18.470 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2026-02-24T09:21:18.470 DEBUG:tasks.check_counter:Getting stats from f 2026-02-24T09:21:18.470 DEBUG:tasks.check_counter:skipping mds.24613 2026-02-24T09:21:18.470 DEBUG:tasks.check_counter:Getting stats from i 2026-02-24T09:21:18.470 DEBUG:tasks.check_counter:Getting stats from mds.24637 2026-02-24T09:21:18.470 DEBUG:teuthology.orchestra.run.trial004:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24637 perf dump --format=json-pretty 2026-02-24T09:21:18.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 -- 10.20.193.4:0/4233829676 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb7c0110380 msgr2=0x7fb7c01107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 --2- 10.20.193.4:0/4233829676 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb7c0110380 0x7fb7c01107f0 secure :-1 s=READY pgs=1433 gs=1 cs=0 l=1 c_cookie=15786689147497153018 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a8009950 tx=0x7fb7a802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 -- 10.20.193.4:0/4233829676 shutdown_connections 2026-02-24T09:21:18.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 --2- 10.20.193.4:0/4233829676 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb7c0110d30 0x7fb7c01716c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.539 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 --2- 10.20.193.4:0/4233829676 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb7c0110380 0x7fb7c01107f0 unknown :-1 s=CLOSED pgs=1433 gs=1 cs=0 l=1 c_cookie=15786689147497153018 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 --2- 10.20.193.4:0/4233829676 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb7c010f1f0 0x7fb7c010f5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 -- 10.20.193.4:0/4233829676 >> 10.20.193.4:0/4233829676 conn(0x7fb7c00ec920 msgr2=0x7fb7c010cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 -- 10.20.193.4:0/4233829676 shutdown_connections 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 -- 10.20.193.4:0/4233829676 wait complete. 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 Processor -- start 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 -- start start 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb7c010f1f0 0x7fb7c00f8830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb7c0110380 0x7fb7c01716c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb7c0110d30 0x7fb7c00f9090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c00f9c80 con 0x7fb7c010f1f0 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c00f9df0 con 0x7fb7c0110380 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7c521b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c00f9fb0 con 0x7fb7c0110d30 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7bed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb7c010f1f0 0x7fb7c00f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7bed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb7c010f1f0 0x7fb7c00f8830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42706/0 (socket says 10.20.193.4:42706) 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7bed76640 1 -- 10.20.193.4:0/3785954928 learned_addr learned my addr 10.20.193.4:0/3785954928 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7bf577640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb7c0110d30 0x7fb7c00f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7bed76640 1 -- 10.20.193.4:0/3785954928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb7c0110d30 msgr2=0x7fb7c00f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7bed76640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb7c0110d30 0x7fb7c00f9090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7bed76640 1 -- 10.20.193.4:0/3785954928 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb7c0110380 msgr2=0x7fb7c01716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7be575640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb7c0110380 0x7fb7c01716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7bed76640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb7c0110380 0x7fb7c01716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7bed76640 1 -- 10.20.193.4:0/3785954928 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a8009570 con 0x7fb7c010f1f0 2026-02-24T09:21:18.540 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7be575640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb7c0110380 0x7fb7c01716c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:18.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.535+0000 7fb7bed76640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb7c010f1f0 0x7fb7c00f8830 secure :-1 s=READY pgs=1434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b400d950 tx=0x7fb7b400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.536+0000 7fb79ffff640 1 -- 10.20.193.4:0/3785954928 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b4004540 con 0x7fb7c010f1f0 2026-02-24T09:21:18.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.536+0000 7fb79ffff640 1 -- 10.20.193.4:0/3785954928 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7b4009d00 con 0x7fb7c010f1f0 2026-02-24T09:21:18.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.536+0000 7fb7c521b640 1 -- 10.20.193.4:0/3785954928 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c00fa290 con 0x7fb7c010f1f0 2026-02-24T09:21:18.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.536+0000 7fb79ffff640 1 -- 10.20.193.4:0/3785954928 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b40106e0 con 0x7fb7c010f1f0 2026-02-24T09:21:18.541 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.536+0000 7fb7c521b640 1 -- 10.20.193.4:0/3785954928 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c00fa7b0 con 0x7fb7c010f1f0 2026-02-24T09:21:18.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.537+0000 7fb79ffff640 1 -- 10.20.193.4:0/3785954928 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fb7b4010870 con 0x7fb7c010f1f0 2026-02-24T09:21:18.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.538+0000 7fb79ffff640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb7940b5760 0x7fb7940d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.538+0000 7fb79ffff640 1 -- 10.20.193.4:0/3785954928 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb7b40e6de0 con 0x7fb7c010f1f0 2026-02-24T09:21:18.542 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.538+0000 7fb7be575640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb7940b5760 0x7fb7940d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.543 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7be575640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb7940b5760 0x7fb7940d5c10 secure :-1 s=READY pgs=486 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a80023d0 tx=0x7fb7a8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7c7801e00 1 Processor -- start 2026-02-24T09:21:18.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7c7801e00 1 -- start start 2026-02-24T09:21:18.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf7489340 0x55ddf74a9720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74a9c60 0x55ddf74ca040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74ea960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ddf73994b0 con 0x55ddf74ca580 2026-02-24T09:21:18.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ddf73951e0 con 0x55ddf74a9c60 2026-02-24T09:21:18.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ddf738f340 con 0x55ddf7489340 2026-02-24T09:21:18.545 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7bf577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7bf577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74ea960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42714/0 (socket says 10.20.193.4:42714) 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7bf577640 1 -- 10.20.193.4:0/22304843 learned_addr learned my addr 10.20.193.4:0/22304843 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7bed76640 1 --2- 10.20.193.4:0/22304843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf7489340 0x55ddf74a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.539+0000 7fb7be575640 1 --2- 10.20.193.4:0/22304843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74a9c60 0x55ddf74ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7bf577640 1 -- 10.20.193.4:0/22304843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf7489340 msgr2=0x55ddf74a9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7bf577640 1 --2- 10.20.193.4:0/22304843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf7489340 0x55ddf74a9720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7bf577640 1 -- 10.20.193.4:0/22304843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74a9c60 msgr2=0x55ddf74ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7bf577640 1 --2- 10.20.193.4:0/22304843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74a9c60 0x55ddf74ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7bf577640 1 -- 10.20.193.4:0/22304843 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf733a990 con 0x55ddf74ca580 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7bf577640 1 --2- 10.20.193.4:0/22304843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74ea960 secure :-1 s=READY pgs=1435 gs=1 cs=0 l=1 c_cookie=1594828498315461519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b0006d50 tx=0x7fb7b0003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1621f811c7c3438f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb79d3fe640 1 -- 10.20.193.4:0/22304843 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b0010c50 con 0x55ddf74ca580 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb79d3fe640 1 -- 10.20.193.4:0/22304843 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7b0010db0 con 0x55ddf74ca580 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb79d3fe640 1 -- 10.20.193.4:0/22304843 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b0011900 con 0x55ddf74ca580 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7c7801e00 1 -- 10.20.193.4:0/22304843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 msgr2=0x55ddf74ea960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/22304843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74ea960 secure :-1 s=READY pgs=1435 gs=1 cs=0 l=1 c_cookie=1594828498315461519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b0006d50 tx=0x7fb7b0003ea0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7c7801e00 1 -- 10.20.193.4:0/22304843 shutdown_connections 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/22304843 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74ea960 unknown :-1 s=CLOSED pgs=1435 gs=1 cs=0 l=1 c_cookie=1594828498315461519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/22304843 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74a9c60 0x55ddf74ca040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/22304843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf7489340 0x55ddf74a9720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7c7801e00 1 -- 10.20.193.4:0/22304843 >> 10.20.193.4:0/22304843 conn(0x55ddf73a4d30 msgr2=0x55ddf7487c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7c7801e00 1 -- 10.20.193.4:0/22304843 shutdown_connections 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.540+0000 7fb7c7801e00 1 -- 10.20.193.4:0/22304843 wait complete. 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7c7801e00 1 -- start start 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7c7801e00 1 Processor -- start 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf7489340 0x55ddf74a2970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.546 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74a9c60 0x55ddf74a2fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 0x55ddf74a3a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ddf74a4080 con 0x55ddf74a9c60 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ddf74a41f0 con 0x55ddf74ca580 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ddf74a43b0 con 0x55ddf7489340 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7be575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74a9c60 0x55ddf74a2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7be575640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74a9c60 0x55ddf74a2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42728/0 (socket says 10.20.193.4:42728) 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7be575640 1 -- 10.20.193.4:0/2983754030 learned_addr learned my addr 10.20.193.4:0/2983754030 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.541+0000 7fb7bed76640 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf7489340 0x55ddf74a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7bf577640 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 0x55ddf74a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7be575640 1 -- 10.20.193.4:0/2983754030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf7489340 msgr2=0x55ddf74a2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7be575640 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf7489340 0x55ddf74a2970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7be575640 1 -- 10.20.193.4:0/2983754030 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 msgr2=0x55ddf74a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7be575640 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 0x55ddf74a3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7be575640 1 -- 10.20.193.4:0/2983754030 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf7312d50 con 0x55ddf74a9c60 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7bf577640 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 0x55ddf74a3a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7be575640 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74a9c60 0x55ddf74a2fc0 secure :-1 s=READY pgs=1436 gs=1 cs=0 l=1 c_cookie=12513041499016354628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a8005ce0 tx=0x7fb7a8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada740f248975b44 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb788bfc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb788bfc640 1 -- 10.20.193.4:0/2983754030 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7a803f070 con 0x55ddf74a9c60 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2983754030 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b0005550 con 0x55ddf74a9c60 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb788bfc640 1 -- 10.20.193.4:0/2983754030 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7a804c040 con 0x55ddf74a9c60 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb788bfc640 1 -- 10.20.193.4:0/2983754030 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7a80503f0 con 0x55ddf74a9c60 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 10 client.18684 _ll_register_callbacks cb 0x55ddf7304fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2983754030 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ddf70699e0 con 0x55ddf74a9c60 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb788bfc640 1 -- 10.20.193.4:0/2983754030 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb7a8050580 con 0x55ddf74a9c60 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb788bfc640 1 -- 10.20.193.4:0/2983754030 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb7a8050740 con 0x55ddf74a9c60 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 10 client.18684 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:18.547 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2983754030 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55ddf7324ea0 con 0x55ddf74a9c60 2026-02-24T09:21:18.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb788bfc640 1 -- 10.20.193.4:0/2983754030 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb7a80433f0 con 0x55ddf74a9c60 2026-02-24T09:21:18.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 10 client.18684 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:18.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 10 client.18684 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:21:18.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 20 client.18684 populate_metadata read hostname 'trial004' 2026-02-24T09:21:18.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddf74a7110 0x55ddf74a7590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.548 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 4 client.18684 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2983754030 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddf73a0850 con 0x55ddf74a7110 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.542+0000 7fb7bed76640 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddf74a7110 0x55ddf74a7590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7bed76640 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddf74a7110 0x55ddf74a7590 crc :-1 s=READY pgs=247 gs=4 cs=0 l=0 c_cookie=6946274061020258381 s_cookie=11317140999996379856 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60661f749f9f604d server_cookie=9d0e8fc759cb12d0 in_seq=0 out_seq=0 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb788bfc640 10 client.18684 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb788bfc640 1 -- 10.20.193.4:0/2983754030 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25358 (crc 0 0 0) 0x55ddf73a0850 con 0x55ddf74a7110 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb788bfc640 10 client.18684 handle_command_reply: tid=0 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 client.18684 shutdown 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2983754030 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74a9c60 msgr2=0x55ddf74a2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74a9c60 0x55ddf74a2fc0 secure :-1 s=READY pgs=1436 gs=1 cs=0 l=1 c_cookie=12513041499016354628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a8005ce0 tx=0x7fb7a8009310 comp rx=0 tx=0).stop 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2983754030 shutdown_connections 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddf74a7110 0x55ddf74a7590 crc :-1 s=READY pgs=247 gs=4 cs=0 l=0 c_cookie=6946274061020258381 s_cookie=11317140999996379856 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 0x55ddf74a3a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74a9c60 0x55ddf74a2fc0 unknown :-1 s=CLOSED pgs=1436 gs=1 cs=0 l=1 c_cookie=12513041499016354628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2983754030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf7489340 0x55ddf74a2970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb788bfc640 0 client.18684 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2983754030 >> 10.20.193.4:0/2983754030 conn(0x55ddf73a4d30 msgr2=0x55ddf748a610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2983754030 shutdown_connections 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2983754030 wait complete. 2026-02-24T09:21:18.549 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.543+0000 7fb7c7801e00 20 client.18684 trim_cache size 0 max 16384 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7c7801e00 1 Processor -- start 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7c7801e00 1 -- start start 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf7489340 0x55ddf74a2ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf74a9c60 0x55ddf74c9450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74c9990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ddf738cf70 con 0x55ddf74ca580 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ddf705b9f0 con 0x55ddf7489340 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ddf74a44f0 con 0x55ddf74a9c60 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7bf577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7bf577640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42736/0 (socket says 10.20.193.4:42736) 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7bf577640 1 -- 10.20.193.4:0/1835666899 learned_addr learned my addr 10.20.193.4:0/1835666899 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7be575640 1 --2- 10.20.193.4:0/1835666899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf74a9c60 0x55ddf74c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.551+0000 7fb7bed76640 1 --2- 10.20.193.4:0/1835666899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf7489340 0x55ddf74a2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.555 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7bf577640 1 -- 10.20.193.4:0/1835666899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf74a9c60 msgr2=0x55ddf74c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7bf577640 1 --2- 10.20.193.4:0/1835666899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf74a9c60 0x55ddf74c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7bf577640 1 -- 10.20.193.4:0/1835666899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf7489340 msgr2=0x55ddf74a2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7bf577640 1 --2- 10.20.193.4:0/1835666899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf7489340 0x55ddf74a2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7bf577640 1 -- 10.20.193.4:0/1835666899 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf731f740 con 0x55ddf74ca580 2026-02-24T09:21:18.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7bf577640 1 --2- 10.20.193.4:0/1835666899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74c9990 secure :-1 s=READY pgs=1437 gs=2 cs=0 l=1 c_cookie=1585185733798300478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b00050f0 tx=0x7fb7b0006de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ffb606b6108b3e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb79cbfd640 1 -- 10.20.193.4:0/1835666899 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b0010c50 con 0x55ddf74ca580 2026-02-24T09:21:18.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb79cbfd640 1 -- 10.20.193.4:0/1835666899 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7b0021070 con 0x55ddf74ca580 2026-02-24T09:21:18.556 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb79cbfd640 1 -- 10.20.193.4:0/1835666899 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b001b6d0 con 0x55ddf74ca580 2026-02-24T09:21:18.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7c7801e00 1 -- 10.20.193.4:0/1835666899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 msgr2=0x55ddf74c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/1835666899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74c9990 secure :-1 s=READY pgs=1437 gs=2 cs=0 l=1 c_cookie=1585185733798300478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b00050f0 tx=0x7fb7b0006de0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7c7801e00 1 -- 10.20.193.4:0/1835666899 shutdown_connections 2026-02-24T09:21:18.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/1835666899 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf74ca580 0x55ddf74c9990 unknown :-1 s=CLOSED pgs=1437 gs=2 cs=0 l=1 c_cookie=1585185733798300478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/1835666899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf74a9c60 0x55ddf74c9450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/1835666899 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf7489340 0x55ddf74a2ef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7c7801e00 1 -- 10.20.193.4:0/1835666899 >> 10.20.193.4:0/1835666899 conn(0x55ddf73a4d30 msgr2=0x55ddf74a27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7c7801e00 1 -- 10.20.193.4:0/1835666899 shutdown_connections 2026-02-24T09:21:18.558 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7c7801e00 1 -- 10.20.193.4:0/1835666899 wait complete. 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.552+0000 7fb7c7801e00 1 -- start start 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 1 Processor -- start 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf7489340 0x55ddf74ab550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf74a9c60 0x55ddf74abb30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 0x55ddf74ac220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x55ddf74ac920 con 0x55ddf7489340 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x55ddf74aca90 con 0x55ddf74ca580 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x55ddf74acc50 con 0x55ddf74a9c60 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7bed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf7489340 0x55ddf74ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7bed76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf7489340 0x55ddf74ab550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42744/0 (socket says 10.20.193.4:42744) 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7bed76640 1 -- 10.20.193.4:0/2850940636 learned_addr learned my addr 10.20.193.4:0/2850940636 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7be575640 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf74a9c60 0x55ddf74abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7bf577640 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 0x55ddf74ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7bed76640 1 -- 10.20.193.4:0/2850940636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf74a9c60 msgr2=0x55ddf74abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7bed76640 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf74a9c60 0x55ddf74abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7bed76640 1 -- 10.20.193.4:0/2850940636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 msgr2=0x55ddf74ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7bed76640 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 0x55ddf74ac220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7bed76640 1 -- 10.20.193.4:0/2850940636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf7313080 con 0x55ddf7489340 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7bed76640 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf7489340 0x55ddf74ab550 secure :-1 s=READY pgs=1438 gs=1 cs=0 l=1 c_cookie=2051789196931064135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b400dfd0 tx=0x7fb7b4002cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c796b675d0f6147 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb788bfc640 10 client.0 ms_handle_connect on v2:10.20.193.4:3300/0 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb788bfc640 1 -- 10.20.193.4:0/2850940636 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b40adb10 con 0x55ddf7489340 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb788bfc640 1 -- 10.20.193.4:0/2850940636 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7b40b2e30 con 0x55ddf7489340 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb788bfc640 1 -- 10.20.193.4:0/2850940636 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7b4073650 con 0x55ddf7489340 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2850940636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf733a990 con 0x55ddf7489340 2026-02-24T09:21:18.559 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb788bfc640 1 -- 10.20.193.4:0/2850940636 <== mon.0 v2:10.20.193.4:3300/0 4 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fb7b40adda0 con 0x55ddf7489340 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb788bfc640 10 client.18690 inactive, discarding osd_map(79..79 src has 1..79) 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 10 client.18690 _ll_register_callbacks cb 0x55ddf7319d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2850940636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ddf73c6850 con 0x55ddf7489340 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb788bfc640 1 -- 10.20.193.4:0/2850940636 <== mon.0 v2:10.20.193.4:3300/0 5 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb7b40acf50 con 0x55ddf7489340 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 10 client.18690 fetch_fsmap learned FSMap version 19 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2850940636 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55ddf7325100 con 0x55ddf7489340 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.553+0000 7fb788bfc640 1 -- 10.20.193.4:0/2850940636 <== mon.0 v2:10.20.193.4:3300/0 6 ==== fsmap(e 19) ==== 8346+0+0 (secure 0 0 0) 0x7fb7b40b7dc0 con 0x55ddf7489340 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 10 client.18690 fetch_fsmap finished waiting for FSMap version 19 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 10 client.18690 resolve_mds: validated gid 24637 aka daemon mds.i 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 20 client.18690 populate_metadata read hostname 'trial004' 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddf74aedd0 0x55ddf74af270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 4 client.18690 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2850940636 --> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x55ddf70b7740 con 0x55ddf74aedd0 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7be575640 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddf74aedd0 0x55ddf74af270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7be575640 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddf74aedd0 0x55ddf74af270 crc :-1 s=READY pgs=248 gs=4 cs=0 l=0 c_cookie=9618555040175181361 s_cookie=9997307066553429169 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=857bf8d9062f4e31 server_cookie=8abd91cf1c6b6cb1 in_seq=0 out_seq=0 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb788bfc640 10 client.18690 ms_handle_connect on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb788bfc640 1 -- 10.20.193.4:0/2850940636 <== mds.0 v2:10.20.193.90:6838/2191295378 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18482 (crc 0 0 0) 0x55ddf70b7740 con 0x55ddf74aedd0 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb788bfc640 10 client.18690 handle_command_reply: tid=0 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 1 client.18690 shutdown 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2850940636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf7489340 msgr2=0x55ddf74ab550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf7489340 0x55ddf74ab550 secure :-1 s=READY pgs=1438 gs=1 cs=0 l=1 c_cookie=2051789196931064135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b400dfd0 tx=0x7fb7b4002cc0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2850940636 shutdown_connections 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.554+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.90:6838/2191295378,v1:10.20.193.90:6839/2191295378] conn(0x55ddf74aedd0 0x55ddf74af270 crc :-1 s=READY pgs=248 gs=4 cs=0 l=0 c_cookie=9618555040175181361 s_cookie=9997307066553429169 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.560 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x55ddf74ca580 0x55ddf74ac220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x55ddf74a9c60 0x55ddf74abb30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c7801e00 1 --2- 10.20.193.4:0/2850940636 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x55ddf7489340 0x55ddf74ab550 unknown :-1 s=CLOSED pgs=1438 gs=1 cs=0 l=1 c_cookie=2051789196931064135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb788bfc640 0 client.18690 ms_handle_reset on v2:10.20.193.90:6838/2191295378 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2850940636 >> 10.20.193.4:0/2850940636 conn(0x55ddf73a4d30 msgr2=0x55ddf74c8440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2850940636 shutdown_connections 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c7801e00 1 -- 10.20.193.4:0/2850940636 wait complete. 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c7801e00 20 client.18690 trim_cache size 0 max 16384 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout:{ 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: "AsyncMessenger::Worker-0": { 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_messages": 2291, 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages": 2221, 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_bytes": 596779, 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_bytes": 11836454, 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_created_connections": 232, 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_active_connections": 7, 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_total_time": 0.136942778, 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_send_time": 0.050645407, 2026-02-24T09:21:18.561 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_recv_time": 0.054940149, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_fast_dispatch_time": 0.019591300, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 2217, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.076321072, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000034425 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 476, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000023694, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000049 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_encrypted_bytes": 68480, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_encrypted_bytes": 43152 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "AsyncMessenger::Worker-1": { 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_messages": 2355, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages": 2249, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_bytes": 1178269, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_bytes": 4949744, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_created_connections": 6, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_active_connections": 5, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_total_time": 0.103300949, 2026-02-24T09:21:18.562 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_send_time": 0.053242882, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_recv_time": 0.042272655, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_fast_dispatch_time": 0.014533538, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 2252, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.070147347, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000031148 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 928, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000102536, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000110 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_encrypted_bytes": 567344, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_encrypted_bytes": 150416 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "AsyncMessenger::Worker-2": { 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_messages": 9499, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages": 9622, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_bytes": 3516132, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_bytes": 6990237, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_created_connections": 11, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_active_connections": 6, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_total_time": 0.521261819, 2026-02-24T09:21:18.563 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_send_time": 0.208698098, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_recv_time": 0.450844342, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_running_fast_dispatch_time": 0.010565086, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_messages_queue_lat": { 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 9621, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.097138441, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000010096 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_handle_ack_lat": { 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 14418, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.001601186, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000111 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_recv_encrypted_bytes": 3151920, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "msgr_send_encrypted_bytes": 3831968 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "cct": { 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "total_workers": 1, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "unhealthy_workers": 0 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "finisher-MDSRank": { 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "queue_len": 0, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "complete_latency": { 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 1376, 2026-02-24T09:21:18.564 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.756146709, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000549525 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "finisher-PurgeQueue": { 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "queue_len": 0, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "complete_latency": { 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 2576, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.024873975, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000009656 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "mds": { 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "request": 457, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "reply": 457, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "reply_latency": { 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 457, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 8.428916700, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.018444019 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "slow_reply": 0, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "forward": 0, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "dir_fetch_complete": 0, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "dir_fetch_keys": 0, 2026-02-24T09:21:18.565 INFO:teuthology.orchestra.run.trial004.stdout: "dir_commit": 12, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "dir_split": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "dir_merge": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "inodes": 27, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_top": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_bottom": 27, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_pin_tail": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_pinned": 26, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_expired": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "inodes_with_caps": 3, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "caps": 3, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "subtrees": 2, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "traverse": 878, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_hit": 870, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_forward": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_discover": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_dir_fetch": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_remote_ino": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "traverse_lock": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "load_cent": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "q": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "exported": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "exported_inodes": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "imported": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "imported_inodes": 0, 2026-02-24T09:21:18.566 INFO:teuthology.orchestra.run.trial004.stdout: "openino_dir_fetch": 0, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "openino_backtrace_fetch": 683, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "openino_peer_discover": 0, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "root_rfiles": 4, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "root_rbytes": 234, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "root_rsnaps": 0, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_backtrace_fetch": 683, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_set_tag": 0, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_backtrace_repaired": 0, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_inotable_repaired": 0, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_dir_inodes": 235, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_dir_base_inodes": 22, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_dirfrag_rstats": 213, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "scrub_file_inodes": 448, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "handle_inode_file_caps": 0, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_revoke": 701, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_grant": 696, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_trunc": 0, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_caps": 6757, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_caps_dirty": 6130, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_cap_release": 11, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "process_request_cap_release": 53 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.567 INFO:teuthology.orchestra.run.trial004.stdout: "mds_cache": { 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "dir_update": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "dir_update_receipt": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "dir_try_discover": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "dir_send_discover": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "dir_handle_discover": 2, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "num_strays": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "num_strays_delayed": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "num_strays_enqueuing": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "strays_created": 22, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "strays_enqueued": 22, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "strays_reintegrated": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "strays_migrated": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "num_recovering_processing": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "num_recovering_enqueued": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "num_recovering_prioritized": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "recovery_started": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "recovery_completed": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_quiesce_path": 11, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_quiesce_inode": 342, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_enqueue_scrub": 22, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_exportdir": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_flush": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_fragmentdir": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_fragstats": 0, 2026-02-24T09:21:18.568 INFO:teuthology.orchestra.run.trial004.stdout: "ireq_inodestats": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_started": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_succeeded": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "uninline_write_failed": 0 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "mds_log": { 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "evlrg": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "evadd": 6529, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "evex": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "evtrm": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "ev": 6529, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "evexg": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "evexd": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "segadd": 9, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "segex": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "segtrm": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "seg": 9, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "segmjr": 2, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "segexg": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "segexd": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "expos": 4194304, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "wrpos": 19605854, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "rdpos": 0, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "jlat": { 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 629, 2026-02-24T09:21:18.569 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 1.144685805, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.001819850 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "replayed": 0 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "mds_mem": { 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "ino": 26, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "ino+": 67, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "ino-": 41, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "dir": 18, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "dir+": 22, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "dir-": 4, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "dn": 27, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "dn+": 67, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "dn-": 40, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "cap": 3, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "cap+": 46, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "cap-": 43, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "rss": 58552, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "heap": 277577728 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "mds_server": { 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "dispatch_client_request": 717, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "dispatch_server_request": 0, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_request": 457, 2026-02-24T09:21:18.570 INFO:teuthology.orchestra.run.trial004.stdout: "handle_client_session": 15, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "handle_peer_request": 0, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "req_create_latency": { 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 22, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.006105680, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000277530 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "req_getattr_latency": { 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 190, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.629627712, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.003313830 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "req_getfilelock_latency": { 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "req_link_latency": { 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookup_latency": { 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 189, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.229290220, 2026-02-24T09:21:18.571 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.001213175 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookuphash_latency": { 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupino_latency": { 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 2, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000147895, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000073947 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupname_latency": { 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupparent_latency": { 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "req_lookupsnap_latency": { 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.572 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "req_lssnap_latency": { 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "req_mkdir_latency": { 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 10, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 7.503159419, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.750315941 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "req_mknod_latency": { 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "req_mksnap_latency": { 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "req_open_latency": { 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 1, 2026-02-24T09:21:18.573 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000058638, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000058638 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "req_readdir_latency": { 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 6, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.014487428, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.002414571 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "req_rename_latency": { 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 2, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000775280, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000387640 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "req_renamesnap_latency": { 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "req_snapdiff_latency": { 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "req_rmdir_latency": { 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 4, 2026-02-24T09:21:18.574 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.020999788, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.005249947 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "req_rmsnap_latency": { 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "req_rmxattr_latency": { 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "req_setattr_latency": { 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 1, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000642352, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000642352 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "req_setdirlayout_latency": { 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "req_setfilelock_latency": { 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.575 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "req_setlayout_latency": { 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "req_setxattr_latency": { 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 12, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.011315828, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000942985 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "req_symlink_latency": { 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "req_unlink_latency": { 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 18, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.012306460, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000683692 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "cap_revoke_eviction": 0, 2026-02-24T09:21:18.576 INFO:teuthology.orchestra.run.trial004.stdout: "cache_trim_throttle": 0, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "session_recall_throttle": 0, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "session_recall_throttle2o": 0, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "global_recall_throttle": 0, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "cap_acquisition_throttle": 0, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "req_getvxattr_latency": { 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "req_blockdiff_latency": { 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "mds_sessions": { 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "session_count": 1, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "session_add": 2, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "session_remove": 1, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "sessions_open": 1, 2026-02-24T09:21:18.577 INFO:teuthology.orchestra.run.trial004.stdout: "sessions_stale": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "total_load": 81, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "average_load": 81, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "avg_session_uptime": 683, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "mdthresh_evicted": 0 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "mempool": { 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bloom_filter_bytes": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bloom_filter_items": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_alloc_bytes": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_alloc_items": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_data_bytes": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_data_items": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_onode_items": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_meta_items": 0, 2026-02-24T09:21:18.578 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_other_bytes": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_other_items": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_cache_buffer_items": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_extent_bytes": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_extent_items": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_blob_bytes": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_blob_items": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_shared_blob_items": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_inline_bl_items": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_fsck_bytes": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_fsck_items": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_txc_bytes": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_txc_items": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_deferred_items": 0, 2026-02-24T09:21:18.579 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_bytes": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "bluestore_writing_items": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_bytes": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_items": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_reader_bytes": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_reader_items": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_writer_bytes": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "bluefs_file_writer_items": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_anon_bytes": 338510, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_anon_items": 113, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_meta_bytes": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "buffer_meta_items": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "osd_bytes": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "osd_items": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "osd_mapbl_bytes": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "osd_mapbl_items": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "osd_pglog_bytes": 0, 2026-02-24T09:21:18.580 INFO:teuthology.orchestra.run.trial004.stdout: "osd_pglog_items": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_bytes": 7888, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_items": 161, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_mapping_bytes": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "osdmap_mapping_items": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "pgmap_bytes": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "pgmap_items": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "mds_co_bytes": 113797, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "mds_co_items": 1465, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "ec_extent_cache_bytes": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "ec_extent_cache_items": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_1_bytes": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_1_items": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_2_bytes": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "unittest_2_items": 0 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "objecter": { 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "op_active": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "op_laggy": 0, 2026-02-24T09:21:18.581 INFO:teuthology.orchestra.run.trial004.stdout: "op_send": 4580, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "op_send_bytes": 15439266, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "op_resend": 32, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "op_reply": 4580, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "op_latency": { 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 4580, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 18.581460636, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.004057087 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "op_inflight": 0, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "oplen_avg": { 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 4636, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 4580 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "op": 4580, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "op_r": 733, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "op_w": 3847, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "op_rmw": 0, 2026-02-24T09:21:18.582 INFO:teuthology.orchestra.run.trial004.stdout: "op_pg": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_stat": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_create": 11, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_read": 28, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_write": 635, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_writefull": 54, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_writesame": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_append": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_zero": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_truncate": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_delete": 3097, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_mapext": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_sparse_read": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_clonerange": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_getxattr": 705, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_setxattr": 22, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_cmpxattr": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_rmxattr": 0, 2026-02-24T09:21:18.583 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_resetxattrs": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_call": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_watch": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_notify": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_src_cmpxattr": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_pgls": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_pgls_filter": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "osdop_other": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "linger_active": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "linger_send": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "linger_resend": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "linger_ping": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "poolop_active": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "poolop_send": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "poolop_resend": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "poolstat_active": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "poolstat_send": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "poolstat_resend": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "statfs_active": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "statfs_send": 0, 2026-02-24T09:21:18.584 INFO:teuthology.orchestra.run.trial004.stdout: "statfs_resend": 0, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "command_active": 0, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "command_send": 0, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "command_resend": 0, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "map_epoch": 79, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "map_full": 0, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "map_inc": 5, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "osd_sessions": 12, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "osd_session_open": 12, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "osd_session_close": 0, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "osd_laggy": 0, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "omap_wr": 68, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "omap_rd": 0, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "omap_del": 16, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "replica_read_sent": 0, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "replica_read_bounced": 0, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "replica_read_completed": 0 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "oft": { 2026-02-24T09:21:18.585 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_objs": 1, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_kv_pairs": 0, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_updates": 0, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "omap_total_removes": 0 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "purge_queue": { 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing_ops": 0, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing_ops_high_water": 513, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing": 0, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executing_high_water": 10, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executed_ops": 2582, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "pq_executed": 22, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "pq_item_in_journal": 0 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "max": 104857600, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "get": 14145, 2026-02-24T09:21:18.586 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 3663156, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 14145, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "take": 0, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 0, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "put": 14145, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 3663156, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-objecter_bytes": { 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "max": 104857600, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "get": 0, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 0, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.587 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 0, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "take": 4580, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 15441488, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "put": 4580, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 15441488, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-objecter_ops": { 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "max": 1024, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "get": 0, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 0, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 0, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "take": 4580, 2026-02-24T09:21:18.588 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 4580, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "put": 4580, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 4580, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-write_buf_throttle": { 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "val": 0, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "max": 3758096384, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "get": 22, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 2222, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 22, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "take": 0, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 0, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "put": 6, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 2222, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.589 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "throttle-write_buf_throttle-0x26f03c0": { 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "val": 1797, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "max": 3758096384, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "get_started": 0, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "get": 6529, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "get_sum": 15411550, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_fail": 0, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "get_or_fail_success": 6529, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "take": 0, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "take_sum": 0, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "put": 629, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "put_sum": 15409753, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "wait": { 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "avgcount": 0, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "sum": 0.000000000, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "avgtime": 0.000000000 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: }, 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "trackedop": { 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: "slow_ops_count": 429 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout: } 2026-02-24T09:21:18.590 INFO:teuthology.orchestra.run.trial004.stdout:} 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 -- 10.20.193.4:0/3785954928 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb7940b5760 msgr2=0x7fb7940d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb7940b5760 0x7fb7940d5c10 secure :-1 s=READY pgs=486 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7a80023d0 tx=0x7fb7a8031040 comp rx=0 tx=0).stop 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 -- 10.20.193.4:0/3785954928 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb7c010f1f0 msgr2=0x7fb7c00f8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb7c010f1f0 0x7fb7c00f8830 secure :-1 s=READY pgs=1434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7b400d950 tx=0x7fb7b400de20 comp rx=0 tx=0).stop 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 -- 10.20.193.4:0/3785954928 shutdown_connections 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fb7940b5760 0x7fb7940d5c10 unknown :-1 s=CLOSED pgs=486 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb7c0110d30 0x7fb7c00f9090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fb7c0110380 0x7fb7c01716c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 --2- 10.20.193.4:0/3785954928 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fb7c010f1f0 0x7fb7c00f8830 unknown :-1 s=CLOSED pgs=1434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 -- 10.20.193.4:0/3785954928 >> 10.20.193.4:0/3785954928 conn(0x7fb7c00ec920 msgr2=0x7fb7c00eeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 -- 10.20.193.4:0/3785954928 shutdown_connections 2026-02-24T09:21:18.591 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.555+0000 7fb7c521b640 1 -- 10.20.193.4:0/3785954928 wait complete. 2026-02-24T09:21:18.592 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2026-02-24T09:21:18.592 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2026-02-24T09:21:18.592 DEBUG:tasks.check_counter:Getting stats from l 2026-02-24T09:21:18.592 DEBUG:tasks.check_counter:skipping mds.24580 2026-02-24T09:21:18.592 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2026-02-24T09:21:18.604 INFO:tasks.kclient:Unmounting kernel clients... 2026-02-24T09:21:18.604 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:21:18.604 DEBUG:teuthology.orchestra.run.trial004:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-24T09:21:18.621 DEBUG:teuthology.orchestra.run.trial004:> set -ex 2026-02-24T09:21:18.621 DEBUG:teuthology.orchestra.run.trial004:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-24T09:21:18.679 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd blocklist ls 2026-02-24T09:21:18.831 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:18.934 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 -- 10.20.193.4:0/2756973283 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd928113200 msgr2=0x7fd928173bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 --2- 10.20.193.4:0/2756973283 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd928113200 0x7fd928173bd0 secure :-1 s=READY pgs=1439 gs=1 cs=0 l=1 c_cookie=12020303052006504786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd92400aa30 tx=0x7fd924030280 comp rx=0 tx=0).stop 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 -- 10.20.193.4:0/2756973283 shutdown_connections 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 --2- 10.20.193.4:0/2756973283 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd928113200 0x7fd928173bd0 unknown :-1 s=CLOSED pgs=1439 gs=1 cs=0 l=1 c_cookie=12020303052006504786 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 --2- 10.20.193.4:0/2756973283 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd92810da00 0x7fd928112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 --2- 10.20.193.4:0/2756973283 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd92810d010 0x7fd92810d3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 -- 10.20.193.4:0/2756973283 >> 10.20.193.4:0/2756973283 conn(0x7fd92805f830 msgr2=0x7fd92810ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 -- 10.20.193.4:0/2756973283 shutdown_connections 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 -- 10.20.193.4:0/2756973283 wait complete. 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 Processor -- start 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 -- start start 2026-02-24T09:21:18.935 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd92810d010 0x7fd9280f55d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd92810da00 0x7fd928173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd928113200 0x7fd9280f5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fd9280faee0 con 0x7fd92810da00 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fd9280fb050 con 0x7fd928113200 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92f036640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd9280fb210 con 0x7fd92810d010 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd91ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd92810da00 0x7fd928173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd91ffff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd92810da00 0x7fd928173ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42762/0 (socket says 10.20.193.4:42762) 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd91ffff640 1 -- 10.20.193.4:0/3210651849 learned_addr learned my addr 10.20.193.4:0/3210651849 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.929+0000 7fd92cdab640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd92810d010 0x7fd9280f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd91ffff640 1 -- 10.20.193.4:0/3210651849 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd92810d010 msgr2=0x7fd9280f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.936 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd92d5ac640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd928113200 0x7fd9280f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd91ffff640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd92810d010 0x7fd9280f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd91ffff640 1 -- 10.20.193.4:0/3210651849 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd928113200 msgr2=0x7fd9280f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd91ffff640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd928113200 0x7fd9280f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd91ffff640 1 -- 10.20.193.4:0/3210651849 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92400a650 con 0x7fd92810da00 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd92cdab640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd92810d010 0x7fd9280f55d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd92d5ac640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd928113200 0x7fd9280f5cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd91ffff640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd92810da00 0x7fd928173ad0 secure :-1 s=READY pgs=1440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd910005db0 tx=0x7fd91000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd91dffb640 1 -- 10.20.193.4:0/3210651849 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd910004500 con 0x7fd92810da00 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd91dffb640 1 -- 10.20.193.4:0/3210651849 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd910004d30 con 0x7fd92810da00 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd92f036640 1 -- 10.20.193.4:0/3210651849 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9280fb4f0 con 0x7fd92810da00 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd91dffb640 1 -- 10.20.193.4:0/3210651849 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9100053c0 con 0x7fd92810da00 2026-02-24T09:21:18.937 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd92f036640 1 -- 10.20.193.4:0/3210651849 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9280fb970 con 0x7fd92810da00 2026-02-24T09:21:18.938 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.930+0000 7fd92f036640 1 -- 10.20.193.4:0/3210651849 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd92810e2f0 con 0x7fd92810da00 2026-02-24T09:21:18.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.932+0000 7fd91dffb640 1 -- 10.20.193.4:0/3210651849 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fd910009940 con 0x7fd92810da00 2026-02-24T09:21:18.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.932+0000 7fd91dffb640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd9040b56d0 0x7fd9040d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:18.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.933+0000 7fd92cdab640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd9040b56d0 0x7fd9040d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:18.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.933+0000 7fd91dffb640 1 -- 10.20.193.4:0/3210651849 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fd9100e7140 con 0x7fd92810da00 2026-02-24T09:21:18.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.933+0000 7fd92cdab640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd9040b56d0 0x7fd9040d5b80 secure :-1 s=READY pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd918004740 tx=0x7fd918005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:18.939 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:18.933+0000 7fd91dffb640 1 -- 10.20.193.4:0/3210651849 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fd9100a9b00 con 0x7fd92810da00 2026-02-24T09:21:19.046 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.043+0000 7fd92f036640 1 -- 10.20.193.4:0/3210651849 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd9280fbb90 con 0x7fd92810da00 2026-02-24T09:21:19.047 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:18 trial004 ceph-mon[41596]: pgmap v497: 97 pgs: 97 active+clean; 1.7 GiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 196 MiB/s wr, 195 op/s 2026-02-24T09:21:19.047 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:18 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1052090303' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:19.047 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.043+0000 7fd91dffb640 1 -- 10.20.193.4:0/3210651849 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v79) ==== 81+0+577 (secure 0 0 0) 0x7fd9100d2020 con 0x7fd92810da00 2026-02-24T09:21:19.048 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4:0/733625572 2026-02-25T09:07:01.644667+0000 2026-02-24T09:21:19.048 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4:6801/1585316508 2026-02-25T09:07:01.644667+0000 2026-02-24T09:21:19.048 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4:0/3431762797 2026-02-25T09:07:01.644667+0000 2026-02-24T09:21:19.048 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4:0/2777942857 2026-02-25T09:07:01.644667+0000 2026-02-24T09:21:19.048 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4:6801/89142516 2026-02-25T09:06:52.024416+0000 2026-02-24T09:21:19.048 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4:6800/89142516 2026-02-25T09:06:52.024416+0000 2026-02-24T09:21:19.048 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4:0/2450775687 2026-02-25T09:06:52.024416+0000 2026-02-24T09:21:19.048 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4:6800/1585316508 2026-02-25T09:07:01.644667+0000 2026-02-24T09:21:19.049 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4:0/1377200746 2026-02-25T09:06:52.024416+0000 2026-02-24T09:21:19.049 INFO:teuthology.orchestra.run.trial004.stdout:10.20.193.4:0/3128547937 2026-02-25T09:06:52.024416+0000 2026-02-24T09:21:19.049 INFO:teuthology.orchestra.run.trial004.stderr:listed 10 entries 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 -- 10.20.193.4:0/3210651849 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd9040b56d0 msgr2=0x7fd9040d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd9040b56d0 0x7fd9040d5b80 secure :-1 s=READY pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd918004740 tx=0x7fd918005f00 comp rx=0 tx=0).stop 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 -- 10.20.193.4:0/3210651849 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd92810da00 msgr2=0x7fd928173ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd92810da00 0x7fd928173ad0 secure :-1 s=READY pgs=1440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd910005db0 tx=0x7fd91000ddf0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 -- 10.20.193.4:0/3210651849 shutdown_connections 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fd9040b56d0 0x7fd9040d5b80 unknown :-1 s=CLOSED pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fd928113200 0x7fd9280f5cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fd92810da00 0x7fd928173ad0 unknown :-1 s=CLOSED pgs=1440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 --2- 10.20.193.4:0/3210651849 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd92810d010 0x7fd9280f55d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 -- 10.20.193.4:0/3210651849 >> 10.20.193.4:0/3210651849 conn(0x7fd92805f830 msgr2=0x7fd92810b500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:19.050 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 -- 10.20.193.4:0/3210651849 shutdown_connections 2026-02-24T09:21:19.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.044+0000 7fd92f036640 1 -- 10.20.193.4:0/3210651849 wait complete. 2026-02-24T09:21:19.082 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2026-02-24T09:21:19.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:21:19.083 DEBUG:teuthology.orchestra.run.trial004:> sudo umount /home/ubuntu/cephtest/mnt.0 2026-02-24T09:21:19.117 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial004.front.sepia.ceph.com 2026-02-24T09:21:19.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:21:19.118 DEBUG:teuthology.orchestra.run.trial004:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2026-02-24T09:21:19.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:21:19.178 DEBUG:teuthology.orchestra.run.trial004:> ip netns list 2026-02-24T09:21:19.233 INFO:teuthology.orchestra.run.trial004.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2026-02-24T09:21:19.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:21:19.233 DEBUG:teuthology.orchestra.run.trial004:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-24T09:21:19.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-24T09:21:19.299 DEBUG:teuthology.orchestra.run.trial004:> sudo ip link delete ceph-brx 2026-02-24T09:21:19.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:18 trial090 ceph-mon[47278]: pgmap v497: 97 pgs: 97 active+clean; 1.7 GiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 196 MiB/s wr, 195 op/s 2026-02-24T09:21:19.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:18 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1052090303' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:19.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:18 trial014 ceph-mon[46941]: pgmap v497: 97 pgs: 97 active+clean; 1.7 GiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 196 MiB/s wr, 195 op/s 2026-02-24T09:21:19.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:18 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1052090303' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:19.404 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-24T09:21:19.421 INFO:tasks.cephadm:Teardown begin 2026-02-24T09:21:19.421 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2026-02-24T09:21:19.421 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:21:19.537 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:19.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2712229318 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe13810f630 msgr2=0x7fe13810fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:19.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 --2- 10.20.193.4:0/2712229318 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe13810f630 0x7fe13810fa00 secure :-1 s=READY pgs=1441 gs=1 cs=0 l=1 c_cookie=11837118256853744178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe128009950 tx=0x7fe12802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2712229318 shutdown_connections 2026-02-24T09:21:19.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 --2- 10.20.193.4:0/2712229318 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe138115820 0x7fe1381761f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 --2- 10.20.193.4:0/2712229318 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe138110020 0x7fe138115070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 --2- 10.20.193.4:0/2712229318 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe13810f630 0x7fe13810fa00 unknown :-1 s=CLOSED pgs=1441 gs=1 cs=0 l=1 c_cookie=11837118256853744178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.656 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2712229318 >> 10.20.193.4:0/2712229318 conn(0x7fe1380ecf20 msgr2=0x7fe13810d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2712229318 shutdown_connections 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2712229318 wait complete. 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 Processor -- start 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.650+0000 7fe13ee7a640 1 -- start start 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13ee7a640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe13810f630 0x7fe13811df80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13ee7a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe138110020 0x7fe13811e4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13ee7a640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe138115820 0x7fe138123890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13ee7a640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fe138123eb0 con 0x7fe13810f630 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13ee7a640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fe138124020 con 0x7fe138115820 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13ee7a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1381241e0 con 0x7fe138110020 2026-02-24T09:21:19.657 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13cbef640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe13810f630 0x7fe13811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13cbef640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe13810f630 0x7fe13811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42782/0 (socket says 10.20.193.4:42782) 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13cbef640 1 -- 10.20.193.4:0/2920847065 learned_addr learned my addr 10.20.193.4:0/2920847065 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13d3f0640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe138115820 0x7fe138123890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe12ffff640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe138110020 0x7fe13811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13cbef640 1 -- 10.20.193.4:0/2920847065 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe138110020 msgr2=0x7fe13811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13cbef640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe138110020 0x7fe13811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13cbef640 1 -- 10.20.193.4:0/2920847065 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe138115820 msgr2=0x7fe138123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13cbef640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe138115820 0x7fe138123890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13cbef640 1 -- 10.20.193.4:0/2920847065 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe128009570 con 0x7fe13810f630 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13cbef640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe13810f630 0x7fe13811df80 secure :-1 s=READY pgs=1442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1280023d0 tx=0x7fe1280043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe12dffb640 1 -- 10.20.193.4:0/2920847065 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe12803d070 con 0x7fe13810f630 2026-02-24T09:21:19.658 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2920847065 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe138124460 con 0x7fe13810f630 2026-02-24T09:21:19.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe12dffb640 1 -- 10.20.193.4:0/2920847065 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe128038920 con 0x7fe13810f630 2026-02-24T09:21:19.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe12dffb640 1 -- 10.20.193.4:0/2920847065 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1280419d0 con 0x7fe13810f630 2026-02-24T09:21:19.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.651+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2920847065 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe138164bc0 con 0x7fe13810f630 2026-02-24T09:21:19.659 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.652+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2920847065 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe138110910 con 0x7fe13810f630 2026-02-24T09:21:19.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.653+0000 7fe12dffb640 1 -- 10.20.193.4:0/2920847065 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fe128038a90 con 0x7fe13810f630 2026-02-24T09:21:19.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.654+0000 7fe12dffb640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe1140b56e0 0x7fe1140d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:19.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.654+0000 7fe12dffb640 1 -- 10.20.193.4:0/2920847065 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fe12810b7f0 con 0x7fe13810f630 2026-02-24T09:21:19.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.654+0000 7fe12ffff640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe1140b56e0 0x7fe1140d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:19.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.654+0000 7fe12ffff640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe1140b56e0 0x7fe1140d5b90 secure :-1 s=READY pgs=488 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe138124920 tx=0x7fe12000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:19.660 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.654+0000 7fe12dffb640 1 -- 10.20.193.4:0/2920847065 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fe1280ce2f0 con 0x7fe13810f630 2026-02-24T09:21:19.790 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.787+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2920847065 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe13811f0e0 con 0x7fe13810f630 2026-02-24T09:21:19.791 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.787+0000 7fe12dffb640 1 -- 10.20.193.4:0/2920847065 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7fe1280d1410 con 0x7fe13810f630 2026-02-24T09:21:19.791 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:21:19.791 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:21:19.792 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:21:19.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2920847065 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe1140b56e0 msgr2=0x7fe1140d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:19.792 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe1140b56e0 0x7fe1140d5b90 secure :-1 s=READY pgs=488 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe138124920 tx=0x7fe12000b410 comp rx=0 tx=0).stop 2026-02-24T09:21:19.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2920847065 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe13810f630 msgr2=0x7fe13811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:19.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe13810f630 0x7fe13811df80 secure :-1 s=READY pgs=1442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1280023d0 tx=0x7fe1280043d0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2920847065 shutdown_connections 2026-02-24T09:21:19.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fe1140b56e0 0x7fe1140d5b90 unknown :-1 s=CLOSED pgs=488 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fe138115820 0x7fe138123890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe138110020 0x7fe13811e4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 --2- 10.20.193.4:0/2920847065 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fe13810f630 0x7fe13811df80 unknown :-1 s=CLOSED pgs=1442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:19.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2920847065 >> 10.20.193.4:0/2920847065 conn(0x7fe1380ecf20 msgr2=0x7fe13810d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:19.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2920847065 shutdown_connections 2026-02-24T09:21:19.793 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:19.788+0000 7fe13ee7a640 1 -- 10.20.193.4:0/2920847065 wait complete. 2026-02-24T09:21:19.831 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs dump --format=json 2026-02-24T09:21:19.947 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:20.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 -- 10.20.193.4:0/3693112602 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52081158b0 msgr2=0x7f5208176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 --2- 10.20.193.4:0/3693112602 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52081158b0 0x7f5208176280 secure :-1 s=READY pgs=1443 gs=1 cs=0 l=1 c_cookie=14051468453455864987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f520400aa30 tx=0x7f5204030280 comp rx=0 tx=0).stop 2026-02-24T09:21:20.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 -- 10.20.193.4:0/3693112602 shutdown_connections 2026-02-24T09:21:20.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 --2- 10.20.193.4:0/3693112602 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52081158b0 0x7f5208176280 unknown :-1 s=CLOSED pgs=1443 gs=1 cs=0 l=1 c_cookie=14051468453455864987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.051 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 --2- 10.20.193.4:0/3693112602 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f52081100b0 0x7f5208115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 --2- 10.20.193.4:0/3693112602 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f520810f6c0 0x7f520810fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 -- 10.20.193.4:0/3693112602 >> 10.20.193.4:0/3693112602 conn(0x7f52080ecf70 msgr2=0x7f520810d380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 -- 10.20.193.4:0/3693112602 shutdown_connections 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 -- 10.20.193.4:0/3693112602 wait complete. 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 Processor -- start 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.045+0000 7f52102b6640 1 -- start start 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f52102b6640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f520810f6c0 0x7f520811df30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f52102b6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f52081100b0 0x7f520811e470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f52102b6640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52081158b0 0x7f5208123840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f52102b6640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f5208123e60 con 0x7f52081158b0 2026-02-24T09:21:20.052 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f52102b6640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f5208123fd0 con 0x7f520810f6c0 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f52102b6640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5208124190 con 0x7f52081100b0 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f520e82c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52081158b0 0x7f5208123840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f520e82c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52081158b0 0x7f5208123840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42802/0 (socket says 10.20.193.4:42802) 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f520e82c640 1 -- 10.20.193.4:0/1056357811 learned_addr learned my addr 10.20.193.4:0/1056357811 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f520e02b640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f520810f6c0 0x7f520811df30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f520e82c640 1 -- 10.20.193.4:0/1056357811 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f52081100b0 msgr2=0x7f520811e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f520e82c640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f52081100b0 0x7f520811e470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f520e82c640 1 -- 10.20.193.4:0/1056357811 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f520810f6c0 msgr2=0x7f520811df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f520e82c640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f520810f6c0 0x7f520811df30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f520e82c640 1 -- 10.20.193.4:0/1056357811 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520400a650 con 0x7f52081158b0 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f520e82c640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52081158b0 0x7f5208123840 secure :-1 s=READY pgs=1444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f520400a330 tx=0x7f52040039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:20.053 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f51ef7fe640 1 -- 10.20.193.4:0/1056357811 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f520403e070 con 0x7f52081158b0 2026-02-24T09:21:20.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f52102b6640 1 -- 10.20.193.4:0/1056357811 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5208124410 con 0x7f52081158b0 2026-02-24T09:21:20.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f51ef7fe640 1 -- 10.20.193.4:0/1056357811 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f52040055a0 con 0x7f52081158b0 2026-02-24T09:21:20.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f51ef7fe640 1 -- 10.20.193.4:0/1056357811 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5204042a70 con 0x7f52081158b0 2026-02-24T09:21:20.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.046+0000 7f52102b6640 1 -- 10.20.193.4:0/1056357811 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52081649d0 con 0x7f52081158b0 2026-02-24T09:21:20.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.047+0000 7f52102b6640 1 -- 10.20.193.4:0/1056357811 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52081109a0 con 0x7f52081158b0 2026-02-24T09:21:20.054 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.048+0000 7f51ef7fe640 1 -- 10.20.193.4:0/1056357811 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f52040050c0 con 0x7f52081158b0 2026-02-24T09:21:20.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.048+0000 7f51ef7fe640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51e40b56e0 0x7f51e40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.048+0000 7f520e02b640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51e40b56e0 0x7f51e40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:20.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.049+0000 7f51ef7fe640 1 -- 10.20.193.4:0/1056357811 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f520410d470 con 0x7f52081158b0 2026-02-24T09:21:20.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.049+0000 7f520e02b640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51e40b56e0 0x7f51e40d5b90 secure :-1 s=READY pgs=489 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51f8004740 tx=0x7f51f8004420 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:20.055 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.050+0000 7f51ef7fe640 1 -- 10.20.193.4:0/1056357811 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f52040cfdf0 con 0x7f52081158b0 2026-02-24T09:21:20.060 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:19 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3210651849' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-24T09:21:20.060 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:19 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/2920847065' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:20.186 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.183+0000 7f52102b6640 1 -- 10.20.193.4:0/1056357811 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f520811f090 con 0x7f52081158b0 2026-02-24T09:21:20.187 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.183+0000 7f51ef7fe640 1 -- 10.20.193.4:0/1056357811 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11882 (secure 0 0 0) 0x7f52040d2fa0 con 0x7f52081158b0 2026-02-24T09:21:20.187 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:21:20.187 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":19,"btime":"2026-02-24T09:09:50:728778+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14742,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6835/1622269315","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6834","nonce":1622269315},{"type":"v1","addr":"10.20.193.4:6835","nonce":1622269315}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14748,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6837/3175863747","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6836","nonce":3175863747},{"type":"v1","addr":"10.20.193.4:6837","nonce":3175863747}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14790,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6839/1186492308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6838","nonce":1186492308},{"type":"v1","addr":"10.20.193.4:6839","nonce":1186492308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":14796,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.4:6841/1594740511","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6840","nonce":1594740511},{"type":"v1","addr":"10.20.193.4:6841","nonce":1594740511}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24557,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6833/1885006877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6832","nonce":1885006877},{"type":"v1","addr":"10.20.193.14:6833","nonce":1885006877}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24575,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.14:6835/4114810438","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6834","nonce":4114810438},{"type":"v1","addr":"10.20.193.14:6835","nonce":4114810438}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-24T09:09:24.652522+0000","modified":"2026-02-24T09:09:50.337608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24637,"mds_1":24625,"mds_2":24620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24580":{"gid":24580,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6833/931807729","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":931807729},{"type":"v1","addr":"10.20.193.90:6833","nonce":931807729}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.14:6837/524790199","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6836","nonce":524790199},{"type":"v1","addr":"10.20.193.14:6837","nonce":524790199}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.90:6835/1296342299","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":1296342299},{"type":"v1","addr":"10.20.193.90:6835","nonce":1296342299}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24620":{"gid":24620,"name":"b","rank":2,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.14:6839/2269480307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6838","nonce":2269480307},{"type":"v1","addr":"10.20.193.14:6839","nonce":2269480307}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":1,"incarnation":14,"state":"up:active","state_seq":4,"addr":"10.20.193.90:6837/4190330264","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":4190330264},{"type":"v1","addr":"10.20.193.90:6837","nonce":4190330264}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"10.20.193.90:6839/2191295378","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":2191295378},{"type":"v1","addr":"10.20.193.90:6839","nonce":2191295378}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24637,"qdb_cluster":[24620,24625,24637]},"id":1}]} 2026-02-24T09:21:20.189 INFO:teuthology.orchestra.run.trial004.stderr:dumped fsmap epoch 19 2026-02-24T09:21:20.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 -- 10.20.193.4:0/1056357811 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51e40b56e0 msgr2=0x7f51e40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51e40b56e0 0x7f51e40d5b90 secure :-1 s=READY pgs=489 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51f8004740 tx=0x7f51f8004420 comp rx=0 tx=0).stop 2026-02-24T09:21:20.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 -- 10.20.193.4:0/1056357811 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52081158b0 msgr2=0x7f5208123840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52081158b0 0x7f5208123840 secure :-1 s=READY pgs=1444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f520400a330 tx=0x7f52040039b0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 -- 10.20.193.4:0/1056357811 shutdown_connections 2026-02-24T09:21:20.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f51e40b56e0 0x7f51e40d5b90 unknown :-1 s=CLOSED pgs=489 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f52081158b0 0x7f5208123840 unknown :-1 s=CLOSED pgs=1444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f52081100b0 0x7f520811e470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.189 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 --2- 10.20.193.4:0/1056357811 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f520810f6c0 0x7f520811df30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 -- 10.20.193.4:0/1056357811 >> 10.20.193.4:0/1056357811 conn(0x7f52080ecf70 msgr2=0x7f520810d350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:20.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 -- 10.20.193.4:0/1056357811 shutdown_connections 2026-02-24T09:21:20.190 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.184+0000 7f52102b6640 1 -- 10.20.193.4:0/1056357811 wait complete. 2026-02-24T09:21:20.244 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T09:21:20.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:19 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3210651849' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-24T09:21:20.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:19 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/2920847065' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:20.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:19 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3210651849' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2026-02-24T09:21:20.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:19 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/2920847065' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:20.362 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:20.463 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 -- 10.20.193.4:0/2276193639 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbce0115470 msgr2=0x7fbce0175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 --2- 10.20.193.4:0/2276193639 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbce0115470 0x7fbce0175e40 secure :-1 s=READY pgs=1445 gs=1 cs=0 l=1 c_cookie=11102329585562775377 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcdc00aa30 tx=0x7fbcdc030280 comp rx=0 tx=0).stop 2026-02-24T09:21:20.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 -- 10.20.193.4:0/2276193639 shutdown_connections 2026-02-24T09:21:20.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 --2- 10.20.193.4:0/2276193639 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbce0115470 0x7fbce0175e40 unknown :-1 s=CLOSED pgs=1445 gs=1 cs=0 l=1 c_cookie=11102329585562775377 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 --2- 10.20.193.4:0/2276193639 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbce010fc70 0x7fbce0114cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 --2- 10.20.193.4:0/2276193639 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbce010f280 0x7fbce010f650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 -- 10.20.193.4:0/2276193639 >> 10.20.193.4:0/2276193639 conn(0x7fbce005f830 msgr2=0x7fbce010cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:20.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 -- 10.20.193.4:0/2276193639 shutdown_connections 2026-02-24T09:21:20.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 -- 10.20.193.4:0/2276193639 wait complete. 2026-02-24T09:21:20.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 Processor -- start 2026-02-24T09:21:20.464 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 -- start start 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbce010f280 0x7fbce00f54e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbce010fc70 0x7fbce0175d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbce0115470 0x7fbce00f5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7fbce00fadf0 con 0x7fbce0115470 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7fbce00faf60 con 0x7fbce010fc70 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce80bb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbce00fb120 con 0x7fbce010f280 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce6631640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbce0115470 0x7fbce00f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce6631640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbce0115470 0x7fbce00f5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42814/0 (socket says 10.20.193.4:42814) 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.458+0000 7fbce6631640 1 -- 10.20.193.4:0/899423983 learned_addr learned my addr 10.20.193.4:0/899423983 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce5e30640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbce010f280 0x7fbce00f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce562f640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbce010fc70 0x7fbce0175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:20.465 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce6631640 1 -- 10.20.193.4:0/899423983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbce010f280 msgr2=0x7fbce00f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce6631640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbce010f280 0x7fbce00f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce6631640 1 -- 10.20.193.4:0/899423983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbce010fc70 msgr2=0x7fbce0175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce6631640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbce010fc70 0x7fbce0175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce6631640 1 -- 10.20.193.4:0/899423983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc00a650 con 0x7fbce0115470 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce6631640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbce0115470 0x7fbce00f5be0 secure :-1 s=READY pgs=1446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcdc00a330 tx=0x7fbcdc0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbcceffd640 1 -- 10.20.193.4:0/899423983 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcdc03e070 con 0x7fbce0115470 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce80bb640 1 -- 10.20.193.4:0/899423983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce00fb3a0 con 0x7fbce0115470 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbcceffd640 1 -- 10.20.193.4:0/899423983 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbcdc0055a0 con 0x7fbce0115470 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbcceffd640 1 -- 10.20.193.4:0/899423983 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcdc042910 con 0x7fbce0115470 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce80bb640 1 -- 10.20.193.4:0/899423983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce00fb810 con 0x7fbce0115470 2026-02-24T09:21:20.466 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.459+0000 7fbce80bb640 1 -- 10.20.193.4:0/899423983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce0110560 con 0x7fbce0115470 2026-02-24T09:21:20.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.461+0000 7fbcceffd640 1 -- 10.20.193.4:0/899423983 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7fbcdc042b20 con 0x7fbce0115470 2026-02-24T09:21:20.467 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.461+0000 7fbcceffd640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbcbc0b56d0 0x7fbcbc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.461+0000 7fbcceffd640 1 -- 10.20.193.4:0/899423983 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7fbcdc10ce50 con 0x7fbce0115470 2026-02-24T09:21:20.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.461+0000 7fbce5e30640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbcbc0b56d0 0x7fbcbc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:20.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.462+0000 7fbce5e30640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbcbc0b56d0 0x7fbcbc0d5b80 secure :-1 s=READY pgs=490 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcd0004740 tx=0x7fbcd0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:20.468 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.462+0000 7fbcceffd640 1 -- 10.20.193.4:0/899423983 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7fbcdc0cf810 con 0x7fbce0115470 2026-02-24T09:21:20.571 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.567+0000 7fbce80bb640 1 -- 10.20.193.4:0/899423983 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbce00f6640 con 0x7fbce0115470 2026-02-24T09:21:20.572 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.568+0000 7fbcceffd640 1 -- 10.20.193.4:0/899423983 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22823 (secure 0 0 0) 0x7fbcdc0d29c0 con 0x7fbce0115470 2026-02-24T09:21:20.572 INFO:teuthology.orchestra.run.trial004.stdout: 2026-02-24T09:21:20.573 INFO:teuthology.orchestra.run.trial004.stdout:{"epoch":79,"fsid":"19e0945d-1160-11f1-92cf-d404e6e7d460","created":"2026-02-24T09:06:42.076379+0000","modified":"2026-02-24T09:11:02.784264+0000","last_up_change":"2026-02-24T09:09:09.785048+0000","last_in_change":"2026-02-24T09:09:00.650520+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T09:07:59.854959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-24T09:09:22.406160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-24T09:09:23.651007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b567c39f-8e27-4d34-80f4-602463d6baa0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6802","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6803","nonce":2373413233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6804","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6805","nonce":2373413233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6808","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6809","nonce":2373413233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6806","nonce":2373413233},{"type":"v1","addr":"10.20.193.4:6807","nonce":2373413233}]},"public_addr":"10.20.193.4:6803/2373413233","cluster_addr":"10.20.193.4:6805/2373413233","heartbeat_back_addr":"10.20.193.4:6809/2373413233","heartbeat_front_addr":"10.20.193.4:6807/2373413233","state":["exists","up"]},{"osd":1,"uuid":"f911e6cb-66df-49e1-b032-3df5206c1b44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6800","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6801","nonce":1845604691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6802","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6803","nonce":1845604691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6806","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6807","nonce":1845604691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6804","nonce":1845604691},{"type":"v1","addr":"10.20.193.14:6805","nonce":1845604691}]},"public_addr":"10.20.193.14:6801/1845604691","cluster_addr":"10.20.193.14:6803/1845604691","heartbeat_back_addr":"10.20.193.14:6807/1845604691","heartbeat_front_addr":"10.20.193.14:6805/1845604691","state":["exists","up"]},{"osd":2,"uuid":"cd4a3bca-f02a-4c44-bf95-807c6df67daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6801","nonce":3627753021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6803","nonce":3627753021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6807","nonce":3627753021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3627753021},{"type":"v1","addr":"10.20.193.90:6805","nonce":3627753021}]},"public_addr":"10.20.193.90:6801/3627753021","cluster_addr":"10.20.193.90:6803/3627753021","heartbeat_back_addr":"10.20.193.90:6807/3627753021","heartbeat_front_addr":"10.20.193.90:6805/3627753021","state":["exists","up"]},{"osd":3,"uuid":"df7ad596-6759-4a7f-9699-264361763b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6810","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6811","nonce":1170432191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6812","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6813","nonce":1170432191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6816","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6817","nonce":1170432191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6814","nonce":1170432191},{"type":"v1","addr":"10.20.193.4:6815","nonce":1170432191}]},"public_addr":"10.20.193.4:6811/1170432191","cluster_addr":"10.20.193.4:6813/1170432191","heartbeat_back_addr":"10.20.193.4:6817/1170432191","heartbeat_front_addr":"10.20.193.4:6815/1170432191","state":["exists","up"]},{"osd":4,"uuid":"2242ac52-60ee-4ca6-8a5d-a50e99be2cca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6808","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6809","nonce":1479310505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6810","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6811","nonce":1479310505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6814","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6815","nonce":1479310505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6812","nonce":1479310505},{"type":"v1","addr":"10.20.193.14:6813","nonce":1479310505}]},"public_addr":"10.20.193.14:6809/1479310505","cluster_addr":"10.20.193.14:6811/1479310505","heartbeat_back_addr":"10.20.193.14:6815/1479310505","heartbeat_front_addr":"10.20.193.14:6813/1479310505","state":["exists","up"]},{"osd":5,"uuid":"e41925be-d3db-4038-a54b-50329f4f89b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6809","nonce":3682673793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6811","nonce":3682673793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6815","nonce":3682673793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":3682673793},{"type":"v1","addr":"10.20.193.90:6813","nonce":3682673793}]},"public_addr":"10.20.193.90:6809/3682673793","cluster_addr":"10.20.193.90:6811/3682673793","heartbeat_back_addr":"10.20.193.90:6815/3682673793","heartbeat_front_addr":"10.20.193.90:6813/3682673793","state":["exists","up"]},{"osd":6,"uuid":"43940c98-7188-4b67-b1c0-b7f7d7b73a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6818","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6819","nonce":3822012168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6820","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6821","nonce":3822012168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6824","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6825","nonce":3822012168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6822","nonce":3822012168},{"type":"v1","addr":"10.20.193.4:6823","nonce":3822012168}]},"public_addr":"10.20.193.4:6819/3822012168","cluster_addr":"10.20.193.4:6821/3822012168","heartbeat_back_addr":"10.20.193.4:6825/3822012168","heartbeat_front_addr":"10.20.193.4:6823/3822012168","state":["exists","up"]},{"osd":7,"uuid":"09b73119-5f2d-4d33-b62a-1b2f2421232e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6816","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6817","nonce":144746180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6818","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6819","nonce":144746180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6822","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6823","nonce":144746180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6820","nonce":144746180},{"type":"v1","addr":"10.20.193.14:6821","nonce":144746180}]},"public_addr":"10.20.193.14:6817/144746180","cluster_addr":"10.20.193.14:6819/144746180","heartbeat_back_addr":"10.20.193.14:6823/144746180","heartbeat_front_addr":"10.20.193.14:6821/144746180","state":["exists","up"]},{"osd":8,"uuid":"df60627d-303b-4c18-80fc-21774d90b61c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6817","nonce":1972287488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6819","nonce":1972287488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6823","nonce":1972287488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":1972287488},{"type":"v1","addr":"10.20.193.90:6821","nonce":1972287488}]},"public_addr":"10.20.193.90:6817/1972287488","cluster_addr":"10.20.193.90:6819/1972287488","heartbeat_back_addr":"10.20.193.90:6823/1972287488","heartbeat_front_addr":"10.20.193.90:6821/1972287488","state":["exists","up"]},{"osd":9,"uuid":"b446de8d-9063-4793-ad1f-a3db68e735ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6826","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6827","nonce":2740686484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6828","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6829","nonce":2740686484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6832","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6833","nonce":2740686484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.4:6830","nonce":2740686484},{"type":"v1","addr":"10.20.193.4:6831","nonce":2740686484}]},"public_addr":"10.20.193.4:6827/2740686484","cluster_addr":"10.20.193.4:6829/2740686484","heartbeat_back_addr":"10.20.193.4:6833/2740686484","heartbeat_front_addr":"10.20.193.4:6831/2740686484","state":["exists","up"]},{"osd":10,"uuid":"8825787e-e402-47ad-ae91-e3c270aefd15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6824","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6825","nonce":3870052801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6826","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6827","nonce":3870052801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6830","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6831","nonce":3870052801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.14:6828","nonce":3870052801},{"type":"v1","addr":"10.20.193.14:6829","nonce":3870052801}]},"public_addr":"10.20.193.14:6825/3870052801","cluster_addr":"10.20.193.14:6827/3870052801","heartbeat_back_addr":"10.20.193.14:6831/3870052801","heartbeat_front_addr":"10.20.193.14:6829/3870052801","state":["exists","up"]},{"osd":11,"uuid":"3a6bcce9-fc24-47c3-91ac-b3dfb572e2f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6825","nonce":3154606116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6827","nonce":3154606116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6831","nonce":3154606116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":3154606116},{"type":"v1","addr":"10.20.193.90:6829","nonce":3154606116}]},"public_addr":"10.20.193.90:6825/3154606116","cluster_addr":"10.20.193.90:6827/3154606116","heartbeat_back_addr":"10.20.193.90:6831/3154606116","heartbeat_front_addr":"10.20.193.90:6829/3154606116","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:40.740790+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:48.702423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:07:56.767683+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:04.934848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:12.860392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:20.860821+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:28.902773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:36.736497+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:44.719739+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:08:52.596192+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:00.339523+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T09:09:08.262847+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":6}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.12","mappings":[{"from":5,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.4:0/733625572":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/3431762797":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/2777942857":"2026-02-25T09:07:01.644667+0000","10.20.193.4:6801/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/89142516":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/2450775687":"2026-02-25T09:06:52.024416+0000","10.20.193.4:6800/1585316508":"2026-02-25T09:07:01.644667+0000","10.20.193.4:0/1377200746":"2026-02-25T09:06:52.024416+0000","10.20.193.4:0/3128547937":"2026-02-25T09:06:52.024416+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T09:21:20.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 -- 10.20.193.4:0/899423983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbcbc0b56d0 msgr2=0x7fbcbc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbcbc0b56d0 0x7fbcbc0d5b80 secure :-1 s=READY pgs=490 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcd0004740 tx=0x7fbcd0005f90 comp rx=0 tx=0).stop 2026-02-24T09:21:20.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 -- 10.20.193.4:0/899423983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbce0115470 msgr2=0x7fbce00f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbce0115470 0x7fbce00f5be0 secure :-1 s=READY pgs=1446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcdc00a330 tx=0x7fbcdc0039b0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 -- 10.20.193.4:0/899423983 shutdown_connections 2026-02-24T09:21:20.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7fbcbc0b56d0 0x7fbcbc0d5b80 unknown :-1 s=CLOSED pgs=490 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7fbce0115470 0x7fbce00f5be0 unknown :-1 s=CLOSED pgs=1446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7fbce010fc70 0x7fbce0175d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 --2- 10.20.193.4:0/899423983 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbce010f280 0x7fbce00f54e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.574 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 -- 10.20.193.4:0/899423983 >> 10.20.193.4:0/899423983 conn(0x7fbce005f830 msgr2=0x7fbce0112ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:20.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 -- 10.20.193.4:0/899423983 shutdown_connections 2026-02-24T09:21:20.575 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.569+0000 7fbce80bb640 1 -- 10.20.193.4:0/899423983 wait complete. 2026-02-24T09:21:20.610 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs fail cephfs 2026-02-24T09:21:20.727 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:20.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.830+0000 7f8112634640 1 -- 10.20.193.4:0/1936685352 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f810c10d010 msgr2=0x7f810c10d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.830+0000 7f8112634640 1 --2- 10.20.193.4:0/1936685352 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f810c10d010 0x7f810c10d3e0 secure :-1 s=READY pgs=1447 gs=1 cs=0 l=1 c_cookie=8128737544477466462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80f8009950 tx=0x7f80f802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.830+0000 7f8112634640 1 -- 10.20.193.4:0/1936685352 shutdown_connections 2026-02-24T09:21:20.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.830+0000 7f8112634640 1 --2- 10.20.193.4:0/1936685352 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f810c113200 0x7f810c173bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.830+0000 7f8112634640 1 --2- 10.20.193.4:0/1936685352 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f810c10da00 0x7f810c112a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.830+0000 7f8112634640 1 --2- 10.20.193.4:0/1936685352 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f810c10d010 0x7f810c10d3e0 unknown :-1 s=CLOSED pgs=1447 gs=1 cs=0 l=1 c_cookie=8128737544477466462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.830+0000 7f8112634640 1 -- 10.20.193.4:0/1936685352 >> 10.20.193.4:0/1936685352 conn(0x7f810c05f830 msgr2=0x7f810c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:20.836 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.830+0000 7f8112634640 1 -- 10.20.193.4:0/1936685352 shutdown_connections 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.830+0000 7f8112634640 1 -- 10.20.193.4:0/1936685352 wait complete. 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.830+0000 7f8112634640 1 Processor -- start 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f8112634640 1 -- start start 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f8112634640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f810c10d010 0x7f810c0f5590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f8112634640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f810c10da00 0x7f810c173ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f8112634640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f810c113200 0x7f810c0f5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f8112634640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0faea0 con 0x7f810c10d010 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f8112634640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0fb010 con 0x7f810c113200 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f8112634640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0fb1d0 con 0x7f810c10da00 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f810bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f810c10d010 0x7f810c0f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:20.837 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f810bfff640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f810c10d010 0x7f810c0f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42828/0 (socket says 10.20.193.4:42828) 2026-02-24T09:21:20.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f810bfff640 1 -- 10.20.193.4:0/261016704 learned_addr learned my addr 10.20.193.4:0/261016704 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:20.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f8110baa640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f810c113200 0x7f810c0f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:20.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f810bfff640 1 -- 10.20.193.4:0/261016704 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f810c10da00 msgr2=0x7f810c173ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f810bfff640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f810c10da00 0x7f810c173ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f810bfff640 1 -- 10.20.193.4:0/261016704 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f810c113200 msgr2=0x7f810c0f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f810bfff640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f810c113200 0x7f810c0f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f810bfff640 1 -- 10.20.193.4:0/261016704 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f8009570 con 0x7f810c10d010 2026-02-24T09:21:20.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f810bfff640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f810c10d010 0x7f810c0f5590 secure :-1 s=READY pgs=1448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80f80023d0 tx=0x7f80f8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:20.838 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f81097fa640 1 -- 10.20.193.4:0/261016704 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80f803d070 con 0x7f810c10d010 2026-02-24T09:21:20.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f81097fa640 1 -- 10.20.193.4:0/261016704 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f80f8002ad0 con 0x7f810c10d010 2026-02-24T09:21:20.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f81097fa640 1 -- 10.20.193.4:0/261016704 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80f80418a0 con 0x7f810c10d010 2026-02-24T09:21:20.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f8112634640 1 -- 10.20.193.4:0/261016704 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810c0fb450 con 0x7f810c10d010 2026-02-24T09:21:20.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.831+0000 7f8112634640 1 -- 10.20.193.4:0/261016704 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f810c0fb8c0 con 0x7f810c10d010 2026-02-24T09:21:20.839 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.832+0000 7f8112634640 1 -- 10.20.193.4:0/261016704 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f810c10e2f0 con 0x7f810c10d010 2026-02-24T09:21:20.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.833+0000 7f81097fa640 1 -- 10.20.193.4:0/261016704 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f80f8041a30 con 0x7f810c10d010 2026-02-24T09:21:20.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.833+0000 7f81097fa640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80e00b56d0 0x7f80e00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:20.840 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.834+0000 7f81097fa640 1 -- 10.20.193.4:0/261016704 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8304+0+0 (secure 0 0 0) 0x7f80f810b790 con 0x7f810c10d010 2026-02-24T09:21:20.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.834+0000 7f810b7fe640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80e00b56d0 0x7f80e00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:20.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.834+0000 7f81097fa640 1 -- 10.20.193.4:0/261016704 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f80f80ce150 con 0x7f810c10d010 2026-02-24T09:21:20.841 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.834+0000 7f810b7fe640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80e00b56d0 0x7f80e00d5b80 secure :-1 s=READY pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f810c0fbf30 tx=0x7f80fc009690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:20.968 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.965+0000 7f8112634640 1 -- 10.20.193.4:0/261016704 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f810c0fbae0 con 0x7f810c10d010 2026-02-24T09:21:20.970 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.966+0000 7f81097fa640 1 -- 10.20.193.4:0/261016704 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7f80f8041d10 con 0x7f810c10d010 2026-02-24T09:21:20.970 INFO:teuthology.orchestra.run.trial004.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2026-02-24T09:21:20.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 -- 10.20.193.4:0/261016704 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80e00b56d0 msgr2=0x7f80e00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80e00b56d0 0x7f80e00d5b80 secure :-1 s=READY pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f810c0fbf30 tx=0x7f80fc009690 comp rx=0 tx=0).stop 2026-02-24T09:21:20.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 -- 10.20.193.4:0/261016704 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f810c10d010 msgr2=0x7f810c0f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:20.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f810c10d010 0x7f810c0f5590 secure :-1 s=READY pgs=1448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80f80023d0 tx=0x7f80f8004290 comp rx=0 tx=0).stop 2026-02-24T09:21:20.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 -- 10.20.193.4:0/261016704 shutdown_connections 2026-02-24T09:21:20.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f80e00b56d0 0x7f80e00d5b80 unknown :-1 s=CLOSED pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f810c113200 0x7f810c0f5c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f810c10da00 0x7f810c173ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 --2- 10.20.193.4:0/261016704 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f810c10d010 0x7f810c0f5590 unknown :-1 s=CLOSED pgs=1448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:20.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 -- 10.20.193.4:0/261016704 >> 10.20.193.4:0/261016704 conn(0x7f810c05f830 msgr2=0x7f810c1101c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:20.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 -- 10.20.193.4:0/261016704 shutdown_connections 2026-02-24T09:21:20.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:20.968+0000 7f8112634640 1 -- 10.20.193.4:0/261016704 wait complete. 2026-02-24T09:21:21.010 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph fs rm cephfs --yes-i-really-mean-it 2026-02-24T09:21:21.126 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:20 trial004 ceph-mon[41596]: pgmap v498: 97 pgs: 97 active+clean; 15 MiB data, 852 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 196 MiB/s wr, 231 op/s 2026-02-24T09:21:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:20 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1056357811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:21.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:20 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/899423983' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:21:21.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:20 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a[41592]: 2026-02-24T09:21:20.965+0000 7fb64cf61640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 -- 10.20.193.4:0/3940201546 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faaf4110040 msgr2=0x7faaf4115090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 --2- 10.20.193.4:0/3940201546 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faaf4110040 0x7faaf4115090 secure :-1 s=READY pgs=1449 gs=1 cs=0 l=1 c_cookie=13517547882033883369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faae8009950 tx=0x7faae802f1d0 comp rx=0 tx=0).stop 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 -- 10.20.193.4:0/3940201546 shutdown_connections 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 --2- 10.20.193.4:0/3940201546 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faaf4115840 0x7faaf4176210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 --2- 10.20.193.4:0/3940201546 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faaf4110040 0x7faaf4115090 unknown :-1 s=CLOSED pgs=1449 gs=1 cs=0 l=1 c_cookie=13517547882033883369 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 --2- 10.20.193.4:0/3940201546 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faaf410f650 0x7faaf410fa20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 -- 10.20.193.4:0/3940201546 >> 10.20.193.4:0/3940201546 conn(0x7faaf40ecf20 msgr2=0x7faaf410d330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 -- 10.20.193.4:0/3940201546 shutdown_connections 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 -- 10.20.193.4:0/3940201546 wait complete. 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 Processor -- start 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 -- start start 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faaf410f650 0x7faaf40f58c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faaf4110040 0x7faaf4176110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faaf4115840 0x7faaf40f5fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7faaf40fb1d0 con 0x7faaf410f650 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7faaf40fb340 con 0x7faaf4110040 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.221+0000 7faafb4c9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7faaf40fb500 con 0x7faaf4115840 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf923e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faaf410f650 0x7faaf40f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf923e640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faaf410f650 0x7faaf40f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42840/0 (socket says 10.20.193.4:42840) 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf923e640 1 -- 10.20.193.4:0/1313044894 learned_addr learned my addr 10.20.193.4:0/1313044894 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:21.225 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf9a3f640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faaf4115840 0x7faaf40f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf8a3d640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faaf4110040 0x7faaf4176110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf923e640 1 -- 10.20.193.4:0/1313044894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faaf4115840 msgr2=0x7faaf40f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf923e640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faaf4115840 0x7faaf40f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf923e640 1 -- 10.20.193.4:0/1313044894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faaf4110040 msgr2=0x7faaf4176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf923e640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faaf4110040 0x7faaf4176110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf923e640 1 -- 10.20.193.4:0/1313044894 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae8009570 con 0x7faaf410f650 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faaf923e640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faaf410f650 0x7faaf40f58c0 secure :-1 s=READY pgs=1450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faae400c8c0 tx=0x7faae400cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faae27fc640 1 -- 10.20.193.4:0/1313044894 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faae40044a0 con 0x7faaf410f650 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faae27fc640 1 -- 10.20.193.4:0/1313044894 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faae4007c80 con 0x7faaf410f650 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faafb4c9640 1 -- 10.20.193.4:0/1313044894 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf40fb7e0 con 0x7faaf410f650 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faae27fc640 1 -- 10.20.193.4:0/1313044894 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faae400f6d0 con 0x7faaf410f650 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faafb4c9640 1 -- 10.20.193.4:0/1313044894 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf40fbcb0 con 0x7faaf410f650 2026-02-24T09:21:21.226 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.222+0000 7faafb4c9640 1 -- 10.20.193.4:0/1313044894 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf4110930 con 0x7faaf410f650 2026-02-24T09:21:21.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.224+0000 7faae27fc640 1 -- 10.20.193.4:0/1313044894 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7faae40026a0 con 0x7faaf410f650 2026-02-24T09:21:21.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.224+0000 7faae27fc640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faad00b5750 0x7faad00d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:21.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.224+0000 7faae27fc640 1 -- 10.20.193.4:0/1313044894 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8562+0+0 (secure 0 0 0) 0x7faae40e7130 con 0x7faaf410f650 2026-02-24T09:21:21.227 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.224+0000 7faaf8a3d640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faad00b5750 0x7faad00d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:21.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.225+0000 7faaf8a3d640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faad00b5750 0x7faad00d5c00 secure :-1 s=READY pgs=492 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faae80023d0 tx=0x7faae8031040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:21.228 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.225+0000 7faae27fc640 1 -- 10.20.193.4:0/1313044894 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7faae40a9980 con 0x7faaf410f650 2026-02-24T09:21:21.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:20 trial090 ceph-mon[47278]: pgmap v498: 97 pgs: 97 active+clean; 15 MiB data, 852 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 196 MiB/s wr, 231 op/s 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:20 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1056357811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:20 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/899423983' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.c.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-c[101071]: ignoring --setuser ceph since I am not root 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.c.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-c[101071]: ignoring --setgroup ceph since I am not root 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.c.trial090.stdout:Feb 24 09:21:20 trial090 ceph-mds[101077]: -- 10.20.193.90:0/3313626396 <== mon.1 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x1567b80 con 0x1533c00 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.c.trial090.stdout:Feb 24 09:21:20 trial090 ceph-mds[101077]: -- 10.20.193.90:0/3313626396 <== mon.1 v2:10.20.193.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x155eea0 con 0x1533c00 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.c.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-c[101071]: starting mds.c at 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.f.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-f[100741]: ignoring --setuser ceph since I am not root 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.f.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-f[100741]: ignoring --setgroup ceph since I am not root 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.f.trial090.stdout:Feb 24 09:21:20 trial090 ceph-mds[100745]: -- 10.20.193.90:0/591250769 <== mon.1 v2:10.20.193.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x1c58ea0 con 0x1c2d800 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.f.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-f[100741]: starting mds.f at 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.i.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-i[101407]: ignoring --setuser ceph since I am not root 2026-02-24T09:21:21.333 INFO:journalctl@ceph.mds.i.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-i[101407]: ignoring --setgroup ceph since I am not root 2026-02-24T09:21:21.334 INFO:journalctl@ceph.mds.i.trial090.stdout:Feb 24 09:21:20 trial090 ceph-mds[101411]: -- 10.20.193.90:0/2611723384 <== mon.1 v2:10.20.193.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x328aea0 con 0x325f800 2026-02-24T09:21:21.334 INFO:journalctl@ceph.mds.i.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-i[101407]: starting mds.i at 2026-02-24T09:21:21.334 INFO:journalctl@ceph.mds.l.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-l[100402]: ignoring --setuser ceph since I am not root 2026-02-24T09:21:21.334 INFO:journalctl@ceph.mds.l.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-l[100402]: ignoring --setgroup ceph since I am not root 2026-02-24T09:21:21.334 INFO:journalctl@ceph.mds.l.trial090.stdout:Feb 24 09:21:20 trial090 ceph-mds[100409]: -- 10.20.193.90:0/3268071233 <== mon.1 v2:10.20.193.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x2e9aea0 con 0x2e6f400 2026-02-24T09:21:21.334 INFO:journalctl@ceph.mds.l.trial090.stdout:Feb 24 09:21:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-l[100402]: starting mds.l at 2026-02-24T09:21:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:20 trial014 ceph-mon[46941]: pgmap v498: 97 pgs: 97 active+clean; 15 MiB data, 852 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 196 MiB/s wr, 231 op/s 2026-02-24T09:21:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:20 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1056357811' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-24T09:21:21.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:20 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/899423983' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T09:21:21.344 INFO:journalctl@ceph.mds.b.trial014.stdout:Feb 24 09:21:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-b[99086]: ignoring --setuser ceph since I am not root 2026-02-24T09:21:21.344 INFO:journalctl@ceph.mds.b.trial014.stdout:Feb 24 09:21:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-b[99086]: ignoring --setgroup ceph since I am not root 2026-02-24T09:21:21.344 INFO:journalctl@ceph.mds.b.trial014.stdout:Feb 24 09:21:20 trial014 ceph-mds[99090]: -- 10.20.193.14:0/1419018040 <== mon.2 v2:10.20.193.14:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x2ba2ea0 con 0x2b77800 2026-02-24T09:21:21.344 INFO:journalctl@ceph.mds.b.trial014.stdout:Feb 24 09:21:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-b[99086]: starting mds.b at 2026-02-24T09:21:21.345 INFO:journalctl@ceph.mds.h.trial014.stdout:Feb 24 09:21:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-h[98749]: ignoring --setuser ceph since I am not root 2026-02-24T09:21:21.345 INFO:journalctl@ceph.mds.h.trial014.stdout:Feb 24 09:21:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-h[98749]: ignoring --setgroup ceph since I am not root 2026-02-24T09:21:21.345 INFO:journalctl@ceph.mds.h.trial014.stdout:Feb 24 09:21:20 trial014 ceph-mds[98756]: -- 10.20.193.14:0/1555436765 <== mon.2 v2:10.20.193.14:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x1ceaea0 con 0x1cbf400 2026-02-24T09:21:21.345 INFO:journalctl@ceph.mds.h.trial014.stdout:Feb 24 09:21:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-h[98749]: starting mds.h at 2026-02-24T09:21:21.360 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.356+0000 7faafb4c9640 1 -- 10.20.193.4:0/1313044894 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7faaf40fbf30 con 0x7faaf410f650 2026-02-24T09:21:21.972 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.968+0000 7faae27fc640 1 -- 10.20.193.4:0/1313044894 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 If there are active snapshot schedules associated with this file-system, you might see EIO errors in the mgr logs or at the snap-schedule command-line due to the missing file-system. However, these errors are transient and will get auto-resolved. v21) ==== 350+0+0 (secure 0 0 0) 0x7faae40acb30 con 0x7faaf410f650 2026-02-24T09:21:21.972 INFO:teuthology.orchestra.run.trial004.stderr:If there are active snapshot schedules associated with this file-system, you might see EIO errors in the mgr logs or at the snap-schedule command-line due to the missing file-system. However, these errors are transient and will get auto-resolved. 2026-02-24T09:21:21.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.970+0000 7faafb4c9640 1 -- 10.20.193.4:0/1313044894 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faad00b5750 msgr2=0x7faad00d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:21.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.970+0000 7faafb4c9640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faad00b5750 0x7faad00d5c00 secure :-1 s=READY pgs=492 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faae80023d0 tx=0x7faae8031040 comp rx=0 tx=0).stop 2026-02-24T09:21:21.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.970+0000 7faafb4c9640 1 -- 10.20.193.4:0/1313044894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faaf410f650 msgr2=0x7faaf40f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:21.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.970+0000 7faafb4c9640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faaf410f650 0x7faaf40f58c0 secure :-1 s=READY pgs=1450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faae400c8c0 tx=0x7faae400cd90 comp rx=0 tx=0).stop 2026-02-24T09:21:21.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.970+0000 7faafb4c9640 1 -- 10.20.193.4:0/1313044894 shutdown_connections 2026-02-24T09:21:21.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.970+0000 7faafb4c9640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7faad00b5750 0x7faad00d5c00 unknown :-1 s=CLOSED pgs=492 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:21.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.970+0000 7faafb4c9640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faaf4115840 0x7faaf40f5fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:21.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.970+0000 7faafb4c9640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7faaf4110040 0x7faaf4176110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:21.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.970+0000 7faafb4c9640 1 --2- 10.20.193.4:0/1313044894 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7faaf410f650 0x7faaf40f58c0 unknown :-1 s=CLOSED pgs=1450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:21.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.970+0000 7faafb4c9640 1 -- 10.20.193.4:0/1313044894 >> 10.20.193.4:0/1313044894 conn(0x7faaf40ecf20 msgr2=0x7faaf4111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:21.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.971+0000 7faafb4c9640 1 -- 10.20.193.4:0/1313044894 shutdown_connections 2026-02-24T09:21:21.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:21.971+0000 7faafb4c9640 1 -- 10.20.193.4:0/1313044894 wait complete. 2026-02-24T09:21:22.011 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2026-02-24T09:21:22.128 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:22.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:21 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/261016704' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2026-02-24T09:21:22.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:21 trial004 ceph-mon[41596]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-24T09:21:22.214 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:21 trial004 ceph-mon[41596]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-24T09:21:22.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:21 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/261016704' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-24T09:21:22.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:21 trial004 ceph-mon[41596]: osdmap e80: 12 total, 12 up, 12 in 2026-02-24T09:21:22.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:21 trial004 ceph-mon[41596]: fsmap cephfs:0/3 6 up:standby, 3 failed 2026-02-24T09:21:22.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:21 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1313044894' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:21:22.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 -- 10.20.193.4:0/2274505024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f70d41158b0 msgr2=0x7f70d4176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 --2- 10.20.193.4:0/2274505024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f70d41158b0 0x7f70d4176280 secure :-1 s=READY pgs=1451 gs=1 cs=0 l=1 c_cookie=12398516167441039538 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70c400aa30 tx=0x7f70c4030280 comp rx=0 tx=0).stop 2026-02-24T09:21:22.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 -- 10.20.193.4:0/2274505024 shutdown_connections 2026-02-24T09:21:22.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 --2- 10.20.193.4:0/2274505024 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f70d41158b0 0x7f70d4176280 unknown :-1 s=CLOSED pgs=1451 gs=1 cs=0 l=1 c_cookie=12398516167441039538 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 --2- 10.20.193.4:0/2274505024 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70d41100b0 0x7f70d4115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 --2- 10.20.193.4:0/2274505024 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f70d410f6c0 0x7f70d410fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 -- 10.20.193.4:0/2274505024 >> 10.20.193.4:0/2274505024 conn(0x7f70d40ecfd0 msgr2=0x7f70d410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:22.233 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 -- 10.20.193.4:0/2274505024 shutdown_connections 2026-02-24T09:21:22.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 -- 10.20.193.4:0/2274505024 wait complete. 2026-02-24T09:21:22.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 Processor -- start 2026-02-24T09:21:22.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.227+0000 7f70d8e8c640 1 -- start start 2026-02-24T09:21:22.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d8e8c640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f70d410f6c0 0x7f70d411df70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d8e8c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70d41100b0 0x7f70d411e4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d8e8c640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f70d41158b0 0x7f70d4123880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d8e8c640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f70d4123ea0 con 0x7f70d41158b0 2026-02-24T09:21:22.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d8e8c640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f70d4124010 con 0x7f70d410f6c0 2026-02-24T09:21:22.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d8e8c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f70d41241d0 con 0x7f70d41100b0 2026-02-24T09:21:22.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f70d41158b0 0x7f70d4123880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2d76640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f70d41158b0 0x7f70d4123880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:42852/0 (socket says 10.20.193.4:42852) 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2d76640 1 -- 10.20.193.4:0/4209303852 learned_addr learned my addr 10.20.193.4:0/4209303852 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d1d74640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70d41100b0 0x7f70d411e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2575640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f70d410f6c0 0x7f70d411df70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2d76640 1 -- 10.20.193.4:0/4209303852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70d41100b0 msgr2=0x7f70d411e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2d76640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70d41100b0 0x7f70d411e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2d76640 1 -- 10.20.193.4:0/4209303852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f70d410f6c0 msgr2=0x7f70d411df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2d76640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f70d410f6c0 0x7f70d411df70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2d76640 1 -- 10.20.193.4:0/4209303852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c400a650 con 0x7f70d41158b0 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2575640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f70d410f6c0 0x7f70d411df70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d2d76640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f70d41158b0 0x7f70d4123880 secure :-1 s=READY pgs=1452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70c4005900 tx=0x7f70c4030de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70bb7fe640 1 -- 10.20.193.4:0/4209303852 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70c403e070 con 0x7f70d41158b0 2026-02-24T09:21:22.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d8e8c640 1 -- 10.20.193.4:0/4209303852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d4124450 con 0x7f70d41158b0 2026-02-24T09:21:22.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d8e8c640 1 -- 10.20.193.4:0/4209303852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d4164bb0 con 0x7f70d41158b0 2026-02-24T09:21:22.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70bb7fe640 1 -- 10.20.193.4:0/4209303852 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f70c4039e40 con 0x7f70d41158b0 2026-02-24T09:21:22.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70bb7fe640 1 -- 10.20.193.4:0/4209303852 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70c40428a0 con 0x7f70d41158b0 2026-02-24T09:21:22.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.228+0000 7f70d8e8c640 1 -- 10.20.193.4:0/4209303852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d4124720 con 0x7f70d41158b0 2026-02-24T09:21:22.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.230+0000 7f70bb7fe640 1 -- 10.20.193.4:0/4209303852 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f70c4005350 con 0x7f70d41158b0 2026-02-24T09:21:22.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.231+0000 7f70bb7fe640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70ac0b5760 0x7f70ac0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:22.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.231+0000 7f70d2575640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70ac0b5760 0x7f70ac0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:22.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.231+0000 7f70bb7fe640 1 -- 10.20.193.4:0/4209303852 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8562+0+0 (secure 0 0 0) 0x7f70c410c7e0 con 0x7f70d41158b0 2026-02-24T09:21:22.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.231+0000 7f70bb7fe640 1 -- 10.20.193.4:0/4209303852 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f70c40ce8c0 con 0x7f70d41158b0 2026-02-24T09:21:22.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.231+0000 7f70d2575640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70ac0b5760 0x7f70ac0d5c10 secure :-1 s=READY pgs=499 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70c8004740 tx=0x7f70c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:21 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/261016704' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2026-02-24T09:21:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:21 trial090 ceph-mon[47278]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-24T09:21:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:21 trial090 ceph-mon[47278]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-24T09:21:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:21 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/261016704' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-24T09:21:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:21 trial090 ceph-mon[47278]: osdmap e80: 12 total, 12 up, 12 in 2026-02-24T09:21:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:21 trial090 ceph-mon[47278]: fsmap cephfs:0/3 6 up:standby, 3 failed 2026-02-24T09:21:22.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:21 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1313044894' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:21:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:21 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/261016704' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2026-02-24T09:21:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:21 trial014 ceph-mon[46941]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-24T09:21:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:21 trial014 ceph-mon[46941]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-24T09:21:22.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:21 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/261016704' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-24T09:21:22.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:21 trial014 ceph-mon[46941]: osdmap e80: 12 total, 12 up, 12 in 2026-02-24T09:21:22.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:21 trial014 ceph-mon[46941]: fsmap cephfs:0/3 6 up:standby, 3 failed 2026-02-24T09:21:22.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:21 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1313044894' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2026-02-24T09:21:22.353 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.349+0000 7f70d8e8c640 1 -- 10.20.193.4:0/4209303852 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f70d411f0d0 con 0x7f70d41158b0 2026-02-24T09:21:22.973 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.969+0000 7f70bb7fe640 1 -- 10.20.193.4:0/4209303852 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) ==== 181+0+0 (secure 0 0 0) 0x7f70c40d2220 con 0x7f70d41158b0 2026-02-24T09:21:22.973 INFO:teuthology.orchestra.run.trial004.stderr:pool 'cephfs_metadata' removed 2026-02-24T09:21:22.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 -- 10.20.193.4:0/4209303852 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70ac0b5760 msgr2=0x7f70ac0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70ac0b5760 0x7f70ac0d5c10 secure :-1 s=READY pgs=499 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70c8004740 tx=0x7f70c8005f90 comp rx=0 tx=0).stop 2026-02-24T09:21:22.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 -- 10.20.193.4:0/4209303852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f70d41158b0 msgr2=0x7f70d4123880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:22.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f70d41158b0 0x7f70d4123880 secure :-1 s=READY pgs=1452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70c4005900 tx=0x7f70c4030de0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.975 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 -- 10.20.193.4:0/4209303852 shutdown_connections 2026-02-24T09:21:22.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f70ac0b5760 0x7f70ac0d5c10 unknown :-1 s=CLOSED pgs=499 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f70d41158b0 0x7f70d4123880 unknown :-1 s=CLOSED pgs=1452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70d41100b0 0x7f70d411e4b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 --2- 10.20.193.4:0/4209303852 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f70d410f6c0 0x7f70d411df70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:22.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 -- 10.20.193.4:0/4209303852 >> 10.20.193.4:0/4209303852 conn(0x7f70d40ecfd0 msgr2=0x7f70d410d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:22.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 -- 10.20.193.4:0/4209303852 shutdown_connections 2026-02-24T09:21:22.976 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:22.971+0000 7f70d8e8c640 1 -- 10.20.193.4:0/4209303852 wait complete. 2026-02-24T09:21:23.014 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2026-02-24T09:21:23.130 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: pgmap v500: 97 pgs: 97 active+clean; 15 MiB data, 743 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 109 MiB/s wr, 220 op/s 2026-02-24T09:21:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-24T09:21:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-24T09:21:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: Cluster is now healthy 2026-02-24T09:21:23.215 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/1313044894' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:21:23.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.14:6836/1236395561,v1:10.20.193.14:6838/1236395561] up:boot 2026-02-24T09:21:23.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.14:6837/1513995771,v1:10.20.193.14:6839/1513995771] up:boot 2026-02-24T09:21:23.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.90:6832/2731359163,v1:10.20.193.90:6835/2731359163] up:boot 2026-02-24T09:21:23.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.90:6833/1980928962,v1:10.20.193.90:6837/1980928962] up:boot 2026-02-24T09:21:23.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.90:6834/1685359174,v1:10.20.193.90:6838/1685359174] up:boot 2026-02-24T09:21:23.216 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: mds.? [v2:10.20.193.90:6836/471692444,v1:10.20.193.90:6839/471692444] up:boot 2026-02-24T09:21:23.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: fsmap 12 up:standby 2026-02-24T09:21:23.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:21:23.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:21:23.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:21:23.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-24T09:21:23.217 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:21:23.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-24T09:21:23.218 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:22 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4209303852' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:21:23.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 -- 10.20.193.4:0/1690038901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c1158b0 msgr2=0x7f9f9c176280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:23.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 --2- 10.20.193.4:0/1690038901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c1158b0 0x7f9f9c176280 secure :-1 s=READY pgs=1453 gs=1 cs=0 l=1 c_cookie=11277378706246368938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f9800aa30 tx=0x7f9f98030280 comp rx=0 tx=0).stop 2026-02-24T09:21:23.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 -- 10.20.193.4:0/1690038901 shutdown_connections 2026-02-24T09:21:23.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 --2- 10.20.193.4:0/1690038901 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c1158b0 0x7f9f9c176280 unknown :-1 s=CLOSED pgs=1453 gs=1 cs=0 l=1 c_cookie=11277378706246368938 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:23.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 --2- 10.20.193.4:0/1690038901 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c1100b0 0x7f9f9c115100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:23.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 --2- 10.20.193.4:0/1690038901 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c10f6c0 0x7f9f9c10fa90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:23.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 -- 10.20.193.4:0/1690038901 >> 10.20.193.4:0/1690038901 conn(0x7f9f9c0ecfd0 msgr2=0x7f9f9c10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:23.234 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 -- 10.20.193.4:0/1690038901 shutdown_connections 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 -- 10.20.193.4:0/1690038901 wait complete. 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 Processor -- start 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 -- start start 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 --2- >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10f6c0 0x7f9f9c11df70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c1100b0 0x7f9f9c11e4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c1158b0 0x7f9f9c123880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 -- --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c123ea0 con 0x7f9f9c1158b0 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 -- --> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c124010 con 0x7f9f9c10f6c0 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.228+0000 7f9fa4186640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c1241d0 con 0x7f9f9c1100b0 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa26fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c1158b0 0x7f9f9c123880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:23.235 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa26fc640 1 --2- >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c1158b0 0x7f9f9c123880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.4:3300/0 says I am v2:10.20.193.4:51740/0 (socket says 10.20.193.4:51740) 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa26fc640 1 -- 10.20.193.4:0/3771392838 learned_addr learned my addr 10.20.193.4:0/3771392838 (peer_addr_for_me v2:10.20.193.4:0/0) 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa1efb640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10f6c0 0x7f9f9c11df70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa16fa640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c1100b0 0x7f9f9c11e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa26fc640 1 -- 10.20.193.4:0/3771392838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c1100b0 msgr2=0x7f9f9c11e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa26fc640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c1100b0 0x7f9f9c11e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa26fc640 1 -- 10.20.193.4:0/3771392838 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10f6c0 msgr2=0x7f9f9c11df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa26fc640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10f6c0 0x7f9f9c11df70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa26fc640 1 -- 10.20.193.4:0/3771392838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9800a650 con 0x7f9f9c1158b0 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa1efb640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10f6c0 0x7f9f9c11df70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa26fc640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c1158b0 0x7f9f9c123880 secure :-1 s=READY pgs=1454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f9800a330 tx=0x7f9f980039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9f8affd640 1 -- 10.20.193.4:0/3771392838 <== mon.0 v2:10.20.193.4:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f9803e070 con 0x7f9f9c1158b0 2026-02-24T09:21:23.236 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9f8affd640 1 -- 10.20.193.4:0/3771392838 <== mon.0 v2:10.20.193.4:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f980055a0 con 0x7f9f9c1158b0 2026-02-24T09:21:23.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa4186640 1 -- 10.20.193.4:0/3771392838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9c124450 con 0x7f9f9c1158b0 2026-02-24T09:21:23.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9f8affd640 1 -- 10.20.193.4:0/3771392838 <== mon.0 v2:10.20.193.4:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f98042910 con 0x7f9f9c1158b0 2026-02-24T09:21:23.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa4186640 1 -- 10.20.193.4:0/3771392838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9c164a10 con 0x7f9f9c1158b0 2026-02-24T09:21:23.237 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.229+0000 7f9fa4186640 1 -- 10.20.193.4:0/3771392838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f9c1109a0 con 0x7f9f9c1158b0 2026-02-24T09:21:23.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.231+0000 7f9f8affd640 1 -- 10.20.193.4:0/3771392838 <== mon.0 v2:10.20.193.4:3300/0 4 ==== mgrmap(e 18) ==== 157121+0+0 (secure 0 0 0) 0x7f9f98042b40 con 0x7f9f9c1158b0 2026-02-24T09:21:23.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.231+0000 7f9f8affd640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f780b56e0 0x7f9f780d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T09:21:23.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.231+0000 7f9fa1efb640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f780b56e0 0x7f9f780d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T09:21:23.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.231+0000 7f9f8affd640 1 -- 10.20.193.4:0/3771392838 <== mon.0 v2:10.20.193.4:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7947+0+0 (secure 0 0 0) 0x7f9f9810cbc0 con 0x7f9f9c1158b0 2026-02-24T09:21:23.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.232+0000 7f9fa1efb640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f780b56e0 0x7f9f780d5b90 secure :-1 s=READY pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f8c004740 tx=0x7f9f8c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T09:21:23.238 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.233+0000 7f9f8affd640 1 -- 10.20.193.4:0/3771392838 <== mon.0 v2:10.20.193.4:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231538 (secure 0 0 0) 0x7f9f980cf6d0 con 0x7f9f9c1158b0 2026-02-24T09:21:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: pgmap v500: 97 pgs: 97 active+clean; 15 MiB data, 743 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 109 MiB/s wr, 220 op/s 2026-02-24T09:21:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-24T09:21:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-24T09:21:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: Cluster is now healthy 2026-02-24T09:21:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/1313044894' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:21:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.14:6836/1236395561,v1:10.20.193.14:6838/1236395561] up:boot 2026-02-24T09:21:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.14:6837/1513995771,v1:10.20.193.14:6839/1513995771] up:boot 2026-02-24T09:21:23.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.90:6832/2731359163,v1:10.20.193.90:6835/2731359163] up:boot 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.90:6833/1980928962,v1:10.20.193.90:6837/1980928962] up:boot 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.90:6834/1685359174,v1:10.20.193.90:6838/1685359174] up:boot 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: mds.? [v2:10.20.193.90:6836/471692444,v1:10.20.193.90:6839/471692444] up:boot 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: fsmap 12 up:standby 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-24T09:21:23.334 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:22 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4209303852' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:21:23.343 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.340+0000 7f9fa4186640 1 -- 10.20.193.4:0/3771392838 --> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9f9c10fa90 con 0x7f9f9c1158b0 2026-02-24T09:21:23.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: pgmap v500: 97 pgs: 97 active+clean; 15 MiB data, 743 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 109 MiB/s wr, 220 op/s 2026-02-24T09:21:23.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-24T09:21:23.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: Cluster is now healthy 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/1313044894' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.14:6836/1236395561,v1:10.20.193.14:6838/1236395561] up:boot 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.14:6837/1513995771,v1:10.20.193.14:6839/1513995771] up:boot 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.90:6832/2731359163,v1:10.20.193.90:6835/2731359163] up:boot 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.90:6833/1980928962,v1:10.20.193.90:6837/1980928962] up:boot 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.90:6834/1685359174,v1:10.20.193.90:6838/1685359174] up:boot 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: mds.? [v2:10.20.193.90:6836/471692444,v1:10.20.193.90:6839/471692444] up:boot 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: fsmap 12 up:standby 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-24T09:21:23.345 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-24T09:21:23.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-24T09:21:23.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-24T09:21:23.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: from='mgr.14152 10.20.193.4:0/2525201247' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-24T09:21:23.346 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:22 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4209303852' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:21:23.978 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.974+0000 7f9f8affd640 1 -- 10.20.193.4:0/3771392838 <== mon.0 v2:10.20.193.4:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) ==== 169+0+0 (secure 0 0 0) 0x7f9f980d2880 con 0x7f9f9c1158b0 2026-02-24T09:21:23.978 INFO:teuthology.orchestra.run.trial004.stderr:pool 'cephfs_data' removed 2026-02-24T09:21:23.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.977+0000 7f9fa4186640 1 -- 10.20.193.4:0/3771392838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f780b56e0 msgr2=0x7f9f780d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:23.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.977+0000 7f9fa4186640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f780b56e0 0x7f9f780d5b90 secure :-1 s=READY pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f8c004740 tx=0x7f9f8c005f90 comp rx=0 tx=0).stop 2026-02-24T09:21:23.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.977+0000 7f9fa4186640 1 -- 10.20.193.4:0/3771392838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c1158b0 msgr2=0x7f9f9c123880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T09:21:23.981 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.977+0000 7f9fa4186640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c1158b0 0x7f9f9c123880 secure :-1 s=READY pgs=1454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f9800a330 tx=0x7f9f980039b0 comp rx=0 tx=0).stop 2026-02-24T09:21:23.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.977+0000 7f9fa4186640 1 -- 10.20.193.4:0/3771392838 shutdown_connections 2026-02-24T09:21:23.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.977+0000 7f9fa4186640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.4:6800/2848002115,v1:10.20.193.4:6801/2848002115] conn(0x7f9f780b56e0 0x7f9f780d5b90 unknown :-1 s=CLOSED pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:23.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.977+0000 7f9fa4186640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.4:3300/0,v1:10.20.193.4:6789/0] conn(0x7f9f9c1158b0 0x7f9f9c123880 unknown :-1 s=CLOSED pgs=1454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:23.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.977+0000 7f9fa4186640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9f9c1100b0 0x7f9f9c11e4b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:23.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.977+0000 7f9fa4186640 1 --2- 10.20.193.4:0/3771392838 >> [v2:10.20.193.14:3300/0,v1:10.20.193.14:6789/0] conn(0x7f9f9c10f6c0 0x7f9f9c11df70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T09:21:23.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.977+0000 7f9fa4186640 1 -- 10.20.193.4:0/3771392838 >> 10.20.193.4:0/3771392838 conn(0x7f9f9c0ecfd0 msgr2=0x7f9f9c10d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T09:21:23.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.978+0000 7f9fa4186640 1 -- 10.20.193.4:0/3771392838 shutdown_connections 2026-02-24T09:21:23.982 INFO:teuthology.orchestra.run.trial004.stderr:2026-02-24T09:21:23.978+0000 7f9fa4186640 1 -- 10.20.193.4:0/3771392838 wait complete. 2026-02-24T09:21:24.021 DEBUG:teuthology.orchestra.run.trial004:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:21:24.049 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:21:24.077 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:21:24.107 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-24T09:21:24.107 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-24T09:21:24.223 INFO:teuthology.orchestra.run.trial004.stderr:Inferring config /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/mon.a/config 2026-02-24T09:21:24.241 INFO:teuthology.orchestra.run.trial004.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-24T09:21:24.242 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:23 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/4209303852' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T09:21:24.242 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:23 trial004 ceph-mon[41596]: osdmap e81: 12 total, 12 up, 12 in 2026-02-24T09:21:24.242 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:23 trial004 ceph-mon[41596]: from='client.? 10.20.193.4:0/3771392838' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:21:24.242 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:23 trial004 ceph-mon[41596]: pgmap v502: 65 pgs: 65 active+clean; 577 KiB data, 743 MiB used, 8.2 TiB / 8.2 TiB avail; 0 B/s wr, 22 op/s 2026-02-24T09:21:24.260 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-24T09:21:24.261 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-24T09:21:24.261 DEBUG:teuthology.orchestra.run.trial004:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T09:21:24.278 DEBUG:teuthology.orchestra.run.trial014:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T09:21:24.295 DEBUG:teuthology.orchestra.run.trial090:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T09:21:24.313 INFO:tasks.cephadm:Stopping all daemons... 2026-02-24T09:21:24.313 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-24T09:21:24.313 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.a 2026-02-24T09:21:24.332 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:23 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/4209303852' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T09:21:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:23 trial090 ceph-mon[47278]: osdmap e81: 12 total, 12 up, 12 in 2026-02-24T09:21:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:23 trial090 ceph-mon[47278]: from='client.? 10.20.193.4:0/3771392838' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:21:24.333 INFO:journalctl@ceph.mon.c.trial090.stdout:Feb 24 09:21:23 trial090 ceph-mon[47278]: pgmap v502: 65 pgs: 65 active+clean; 577 KiB data, 743 MiB used, 8.2 TiB / 8.2 TiB avail; 0 B/s wr, 22 op/s 2026-02-24T09:21:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:23 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/4209303852' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T09:21:24.343 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:23 trial014 ceph-mon[46941]: osdmap e81: 12 total, 12 up, 12 in 2026-02-24T09:21:24.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:23 trial014 ceph-mon[46941]: from='client.? 10.20.193.4:0/3771392838' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T09:21:24.344 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:23 trial014 ceph-mon[46941]: pgmap v502: 65 pgs: 65 active+clean; 577 KiB data, 743 MiB used, 8.2 TiB / 8.2 TiB avail; 0 B/s wr, 22 op/s 2026-02-24T09:21:24.510 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:24 trial004 systemd[1]: Stopping Ceph mon.a for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:24.510 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:24 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a[41592]: 2026-02-24T09:21:24.416+0000 7fb65276c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:21:24.510 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:24 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a[41592]: 2026-02-24T09:21:24.416+0000 7fb65276c640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-24T09:21:24.510 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:24 trial004 podman[151208]: 2026-02-24 09:21:24.437490304 +0000 UTC m=+0.032838131 container died 953bcc75edc7d772692b3a34bd4ecdc8b3733185376178f69a595fc6d9cb69bf (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:21:24.511 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:24 trial004 podman[151208]: 2026-02-24 09:21:24.447238335 +0000 UTC m=+0.042586152 container remove 953bcc75edc7d772692b3a34bd4ecdc8b3733185376178f69a595fc6d9cb69bf (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:21:24.511 INFO:journalctl@ceph.mon.a.trial004.stdout:Feb 24 09:21:24 trial004 bash[151208]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-a 2026-02-24T09:21:24.530 DEBUG:teuthology.orchestra.run.trial004:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.a.service' 2026-02-24T09:21:24.572 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:24.572 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-24T09:21:24.573 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-24T09:21:24.573 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.b 2026-02-24T09:21:24.872 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:24 trial014 systemd[1]: Stopping Ceph mon.b for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:24.873 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:24 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-b[46937]: 2026-02-24T09:21:24.675+0000 7f83f029b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:21:24.873 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:24 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-b[46937]: 2026-02-24T09:21:24.675+0000 7f83f029b640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-24T09:21:24.873 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:24 trial014 podman[102398]: 2026-02-24 09:21:24.807658921 +0000 UTC m=+0.143176972 container died 39baf9f280e1f3cf38453826796df25629d88be362376676a994422cfbefe6c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-b, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T09:21:24.873 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:24 trial014 podman[102398]: 2026-02-24 09:21:24.818741899 +0000 UTC m=+0.154259940 container remove 39baf9f280e1f3cf38453826796df25629d88be362376676a994422cfbefe6c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-b, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:21:24.873 INFO:journalctl@ceph.mon.b.trial014.stdout:Feb 24 09:21:24 trial014 bash[102398]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mon-b 2026-02-24T09:21:24.886 DEBUG:teuthology.orchestra.run.trial014:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.b.service' 2026-02-24T09:21:24.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:24.926 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-24T09:21:24.926 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-24T09:21:24.926 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.c 2026-02-24T09:21:25.146 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mon.c.service' 2026-02-24T09:21:25.185 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:25.185 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-24T09:21:25.186 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-24T09:21:25.186 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.x 2026-02-24T09:21:25.436 DEBUG:teuthology.orchestra.run.trial004:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.x.service' 2026-02-24T09:21:25.464 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:21:25 trial004 systemd[1]: Stopping Ceph mgr.x for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:25.464 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:21:25 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x[41869]: 2026-02-24T09:21:25.291+0000 7f8548b02640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:21:25.464 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:21:25 trial004 podman[151763]: 2026-02-24 09:21:25.33266376 +0000 UTC m=+0.053932006 container died 4b06235aa8ca98b41351f0683fc91a75cd565d9bc6da1d6270f4377bc66401c0 (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:21:25.465 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:21:25 trial004 podman[151763]: 2026-02-24 09:21:25.358822967 +0000 UTC m=+0.080091223 container remove 4b06235aa8ca98b41351f0683fc91a75cd565d9bc6da1d6270f4377bc66401c0 (image=quay.ceph.io/ceph-ci/ceph:5bc9a1ffc19df681248ece8c3c8c7191a571745b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:21:25.465 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:21:25 trial004 bash[151763]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mgr-x 2026-02-24T09:21:25.465 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:21:25 trial004 systemd[1]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.x.service: Deactivated successfully. 2026-02-24T09:21:25.465 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:21:25 trial004 systemd[1]: Stopped Ceph mgr.x for 19e0945d-1160-11f1-92cf-d404e6e7d460. 2026-02-24T09:21:25.465 INFO:journalctl@ceph.mgr.x.trial004.stdout:Feb 24 09:21:25 trial004 systemd[1]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.x.service: Consumed 21.912s CPU time. 2026-02-24T09:21:25.475 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:25.476 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-24T09:21:25.476 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-24T09:21:25.476 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.y 2026-02-24T09:21:25.593 INFO:journalctl@ceph.mgr.y.trial014.stdout:Feb 24 09:21:25 trial014 systemd[1]: Stopping Ceph mgr.y for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:25.689 DEBUG:teuthology.orchestra.run.trial014:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.y.service' 2026-02-24T09:21:25.725 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:25.726 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-24T09:21:25.726 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-24T09:21:25.726 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.z 2026-02-24T09:21:25.939 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mgr.z.service' 2026-02-24T09:21:25.974 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:25.975 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-24T09:21:25.975 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-24T09:21:25.975 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.0 2026-02-24T09:21:26.464 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:26 trial004 systemd[1]: Stopping Ceph osd.0 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:26.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:26 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0[61127]: 2026-02-24T09:21:26.071+0000 7f998b15e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:21:26.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:26 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0[61127]: 2026-02-24T09:21:26.071+0000 7f998b15e640 -1 osd.0 82 *** Got signal Terminated *** 2026-02-24T09:21:26.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:26 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0[61127]: 2026-02-24T09:21:26.071+0000 7f998b15e640 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:21:31.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:31 trial004 podman[151917]: 2026-02-24 09:21:31.161841816 +0000 UTC m=+5.101856910 container died 1438836dce9930b7c643edf3548625ab91809868e4be5fb7a78012847e67da23 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:21:31.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:31 trial004 podman[151917]: 2026-02-24 09:21:31.171744906 +0000 UTC m=+5.111759990 container remove 1438836dce9930b7c643edf3548625ab91809868e4be5fb7a78012847e67da23 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3) 2026-02-24T09:21:31.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:31 trial004 bash[151917]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0 2026-02-24T09:21:31.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:31 trial004 podman[152049]: 2026-02-24 09:21:31.30776668 +0000 UTC m=+0.015261809 container create 8b02cc94b2ba550dae722ef3246c02c1c311836dfd94af72727d935c1a7ef470 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:21:31.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:31 trial004 podman[152049]: 2026-02-24 09:21:31.341129636 +0000 UTC m=+0.048624765 container init 8b02cc94b2ba550dae722ef3246c02c1c311836dfd94af72727d935c1a7ef470 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS) 2026-02-24T09:21:31.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:31 trial004 podman[152049]: 2026-02-24 09:21:31.344038286 +0000 UTC m=+0.051533405 container start 8b02cc94b2ba550dae722ef3246c02c1c311836dfd94af72727d935c1a7ef470 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0-deactivate, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:21:31.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:31 trial004 podman[152049]: 2026-02-24 09:21:31.344477573 +0000 UTC m=+0.051972702 container attach 8b02cc94b2ba550dae722ef3246c02c1c311836dfd94af72727d935c1a7ef470 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-0-deactivate, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:21:31.465 INFO:journalctl@ceph.osd.0.trial004.stdout:Feb 24 09:21:31 trial004 podman[152049]: 2026-02-24 09:21:31.301351948 +0000 UTC m=+0.008847087 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:21:31.511 DEBUG:teuthology.orchestra.run.trial004:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.0.service' 2026-02-24T09:21:31.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:31.550 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-24T09:21:31.550 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-24T09:21:31.550 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.1 2026-02-24T09:21:31.844 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:31 trial014 systemd[1]: Stopping Ceph osd.1 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:31.844 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:31 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1[52698]: 2026-02-24T09:21:31.649+0000 7fe47b7c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:21:31.844 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:31 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1[52698]: 2026-02-24T09:21:31.649+0000 7fe47b7c6640 -1 osd.1 82 *** Got signal Terminated *** 2026-02-24T09:21:31.844 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:31 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1[52698]: 2026-02-24T09:21:31.649+0000 7fe47b7c6640 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:21:37.027 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:36 trial014 podman[102976]: 2026-02-24 09:21:36.729219644 +0000 UTC m=+5.091138864 container died 871ac0f658cccfb42d18ee02cb8bfc96af06826a249eea7a5fb53f268e2e06a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223) 2026-02-24T09:21:37.027 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:36 trial014 podman[102976]: 2026-02-24 09:21:36.738763411 +0000 UTC m=+5.100682631 container remove 871ac0f658cccfb42d18ee02cb8bfc96af06826a249eea7a5fb53f268e2e06a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , ceph=True, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0) 2026-02-24T09:21:37.028 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:36 trial014 bash[102976]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1 2026-02-24T09:21:37.028 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:36 trial014 podman[103111]: 2026-02-24 09:21:36.870528905 +0000 UTC m=+0.017617834 container create 3dc501efcce929285ee3ea4012eec3887c3deddb9cbe8ba1e0874ac9e319fcf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.build-date=20260223) 2026-02-24T09:21:37.028 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:36 trial014 podman[103111]: 2026-02-24 09:21:36.89815245 +0000 UTC m=+0.045241389 container init 3dc501efcce929285ee3ea4012eec3887c3deddb9cbe8ba1e0874ac9e319fcf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:21:37.028 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:36 trial014 podman[103111]: 2026-02-24 09:21:36.900628847 +0000 UTC m=+0.047717786 container start 3dc501efcce929285ee3ea4012eec3887c3deddb9cbe8ba1e0874ac9e319fcf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1-deactivate, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:21:37.028 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:36 trial014 podman[103111]: 2026-02-24 09:21:36.901082868 +0000 UTC m=+0.048171807 container attach 3dc501efcce929285ee3ea4012eec3887c3deddb9cbe8ba1e0874ac9e319fcf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True) 2026-02-24T09:21:37.028 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:36 trial014 podman[103111]: 2026-02-24 09:21:36.862078332 +0000 UTC m=+0.009167271 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:21:37.028 INFO:journalctl@ceph.osd.1.trial014.stdout:Feb 24 09:21:37 trial014 podman[103111]: 2026-02-24 09:21:37.027102449 +0000 UTC m=+0.174191398 container died 3dc501efcce929285ee3ea4012eec3887c3deddb9cbe8ba1e0874ac9e319fcf8 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-1-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3) 2026-02-24T09:21:37.059 DEBUG:teuthology.orchestra.run.trial014:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.1.service' 2026-02-24T09:21:37.097 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:37.098 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-24T09:21:37.098 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-24T09:21:37.098 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.2 2026-02-24T09:21:37.583 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:37 trial090 systemd[1]: Stopping Ceph osd.2 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:37.583 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:37 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2[53252]: 2026-02-24T09:21:37.195+0000 7f19dc5c8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:21:37.583 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:37 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2[53252]: 2026-02-24T09:21:37.195+0000 7f19dc5c8640 -1 osd.2 82 *** Got signal Terminated *** 2026-02-24T09:21:37.583 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:37 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2[53252]: 2026-02-24T09:21:37.195+0000 7f19dc5c8640 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:21:42.583 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:42 trial090 podman[105504]: 2026-02-24 09:21:42.28488926 +0000 UTC m=+5.101581979 container died c9d3d9ca43640eb9c8099a91433a597b07f8bfccc8d95b26d55e82a7d17766c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:21:42.583 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:42 trial090 podman[105504]: 2026-02-24 09:21:42.293085694 +0000 UTC m=+5.109778413 container remove c9d3d9ca43640eb9c8099a91433a597b07f8bfccc8d95b26d55e82a7d17766c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2026-02-24T09:21:42.584 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:42 trial090 bash[105504]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2 2026-02-24T09:21:42.584 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:42 trial090 podman[105638]: 2026-02-24 09:21:42.418822375 +0000 UTC m=+0.014614496 container create a6df2a95402b1a5dacffd0ad48f4bb8e8e8f632d43909e55a7d0fa2955d983ac (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T09:21:42.584 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:42 trial090 podman[105638]: 2026-02-24 09:21:42.456184611 +0000 UTC m=+0.051976752 container init a6df2a95402b1a5dacffd0ad48f4bb8e8e8f632d43909e55a7d0fa2955d983ac (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True) 2026-02-24T09:21:42.584 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:42 trial090 podman[105638]: 2026-02-24 09:21:42.458892079 +0000 UTC m=+0.054684211 container start a6df2a95402b1a5dacffd0ad48f4bb8e8e8f632d43909e55a7d0fa2955d983ac (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2-deactivate, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.build-date=20260223) 2026-02-24T09:21:42.584 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:42 trial090 podman[105638]: 2026-02-24 09:21:42.459375097 +0000 UTC m=+0.055167228 container attach a6df2a95402b1a5dacffd0ad48f4bb8e8e8f632d43909e55a7d0fa2955d983ac (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3) 2026-02-24T09:21:42.584 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 24 09:21:42 trial090 podman[105638]: 2026-02-24 09:21:42.41259093 +0000 UTC m=+0.008383061 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:21:42.621 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.2.service' 2026-02-24T09:21:42.659 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:42.660 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-24T09:21:42.660 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-24T09:21:42.660 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.3 2026-02-24T09:21:42.964 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:42 trial004 systemd[1]: Stopping Ceph osd.3 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:42.964 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:42 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3[73485]: 2026-02-24T09:21:42.761+0000 7fd11e898640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:21:42.965 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:42 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3[73485]: 2026-02-24T09:21:42.761+0000 7fd11e898640 -1 osd.3 82 *** Got signal Terminated *** 2026-02-24T09:21:42.965 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:42 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3[73485]: 2026-02-24T09:21:42.761+0000 7fd11e898640 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:21:48.154 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:47 trial004 podman[152178]: 2026-02-24 09:21:47.860744441 +0000 UTC m=+5.112066828 container died 24e84c9bde0b7cf68a473eb897c926478c01090cc10ab2dbb1f94dcc74f5b4d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223) 2026-02-24T09:21:48.154 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:47 trial004 podman[152178]: 2026-02-24 09:21:47.870364725 +0000 UTC m=+5.121687102 container remove 24e84c9bde0b7cf68a473eb897c926478c01090cc10ab2dbb1f94dcc74f5b4d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:21:48.154 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:47 trial004 bash[152178]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3 2026-02-24T09:21:48.154 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:47 trial004 podman[152308]: 2026-02-24 09:21:47.994338439 +0000 UTC m=+0.015137787 container create 9de004ba439ba3187dc08e202277dfbfad13647b1a03fe5963572520966711e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:21:48.154 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:48 trial004 podman[152308]: 2026-02-24 09:21:48.022261667 +0000 UTC m=+0.043061005 container init 9de004ba439ba3187dc08e202277dfbfad13647b1a03fe5963572520966711e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3-deactivate, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:21:48.154 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:48 trial004 podman[152308]: 2026-02-24 09:21:48.024782576 +0000 UTC m=+0.045581914 container start 9de004ba439ba3187dc08e202277dfbfad13647b1a03fe5963572520966711e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:21:48.154 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:48 trial004 podman[152308]: 2026-02-24 09:21:48.025274321 +0000 UTC m=+0.046073669 container attach 9de004ba439ba3187dc08e202277dfbfad13647b1a03fe5963572520966711e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3-deactivate, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T09:21:48.154 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:48 trial004 podman[152308]: 2026-02-24 09:21:47.987598062 +0000 UTC m=+0.008397410 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:21:48.154 INFO:journalctl@ceph.osd.3.trial004.stdout:Feb 24 09:21:48 trial004 podman[152308]: 2026-02-24 09:21:48.151933009 +0000 UTC m=+0.172732357 container died 9de004ba439ba3187dc08e202277dfbfad13647b1a03fe5963572520966711e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.vendor=CentOS) 2026-02-24T09:21:48.191 DEBUG:teuthology.orchestra.run.trial004:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.3.service' 2026-02-24T09:21:48.231 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:48.231 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-24T09:21:48.231 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-24T09:21:48.232 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.4 2026-02-24T09:21:48.593 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:48 trial014 systemd[1]: Stopping Ceph osd.4 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:48.594 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:48 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4[64822]: 2026-02-24T09:21:48.327+0000 7f93d2f3a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:21:48.594 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:48 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4[64822]: 2026-02-24T09:21:48.328+0000 7f93d2f3a640 -1 osd.4 82 *** Got signal Terminated *** 2026-02-24T09:21:48.594 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:48 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4[64822]: 2026-02-24T09:21:48.328+0000 7f93d2f3a640 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:21:51.843 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:51 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4[64822]: 2026-02-24T09:21:51.449+0000 7f93cb5fa640 -1 osd.4 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.072513+0000 front 2026-02-24T09:21:29.072522+0000 (oldest deadline 2026-02-24T09:21:51.372539+0000) 2026-02-24T09:21:52.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:21:52 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:21:52.242+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:21:52.843 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:52 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4[64822]: 2026-02-24T09:21:52.414+0000 7f93cb5fa640 -1 osd.4 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.072513+0000 front 2026-02-24T09:21:29.072522+0000 (oldest deadline 2026-02-24T09:21:51.372539+0000) 2026-02-24T09:21:53.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:21:52 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:21:52.948+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:21:53.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:21:53 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:21:53.278+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:21:53.731 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:53 trial014 podman[103254]: 2026-02-24 09:21:53.418873198 +0000 UTC m=+5.102411873 container died 8e335aae109c45b57a72386f769313a3d58f1a52e3bd2253072a7f9bf6fd595a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:21:53.732 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:53 trial014 podman[103254]: 2026-02-24 09:21:53.427419208 +0000 UTC m=+5.110957883 container remove 8e335aae109c45b57a72386f769313a3d58f1a52e3bd2253072a7f9bf6fd595a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:21:53.732 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:53 trial014 bash[103254]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4 2026-02-24T09:21:53.732 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:53 trial014 podman[103385]: 2026-02-24 09:21:53.572953585 +0000 UTC m=+0.014693437 container create 2e32faf8c95c344422477da373354f27aa7569638795422d7dcafcae757f456e (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4-deactivate, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2026-02-24T09:21:53.732 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:53 trial014 podman[103385]: 2026-02-24 09:21:53.600491763 +0000 UTC m=+0.042231615 container init 2e32faf8c95c344422477da373354f27aa7569638795422d7dcafcae757f456e (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4-deactivate, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , ceph=True) 2026-02-24T09:21:53.732 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:53 trial014 podman[103385]: 2026-02-24 09:21:53.603287872 +0000 UTC m=+0.045027744 container start 2e32faf8c95c344422477da373354f27aa7569638795422d7dcafcae757f456e (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T09:21:53.732 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:53 trial014 podman[103385]: 2026-02-24 09:21:53.603932906 +0000 UTC m=+0.045672768 container attach 2e32faf8c95c344422477da373354f27aa7569638795422d7dcafcae757f456e (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223) 2026-02-24T09:21:53.732 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:53 trial014 podman[103385]: 2026-02-24 09:21:53.566541378 +0000 UTC m=+0.008281240 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:21:53.733 INFO:journalctl@ceph.osd.4.trial014.stdout:Feb 24 09:21:53 trial014 podman[103385]: 2026-02-24 09:21:53.73158487 +0000 UTC m=+0.173324742 container died 2e32faf8c95c344422477da373354f27aa7569638795422d7dcafcae757f456e (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:21:53.760 DEBUG:teuthology.orchestra.run.trial014:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.4.service' 2026-02-24T09:21:53.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:53.797 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-24T09:21:53.798 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-24T09:21:53.798 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.5 2026-02-24T09:21:54.083 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:53 trial090 systemd[1]: Stopping Ceph osd.5 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:54.083 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:53 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5[65851]: 2026-02-24T09:21:53.893+0000 7fa00f993640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:21:54.083 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:53 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5[65851]: 2026-02-24T09:21:53.893+0000 7fa00f993640 -1 osd.5 82 *** Got signal Terminated *** 2026-02-24T09:21:54.083 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:53 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5[65851]: 2026-02-24T09:21:53.893+0000 7fa00f993640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:21:54.214 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:53 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:53.892+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:21:54.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:21:53 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:21:53.992+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:21:54.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:21:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:21:54.299+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:21:54.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:21:54 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:21:54.430+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:21:55.214 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:54 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:54.931+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:21:55.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:21:54 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:21:54.982+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:21:55.583 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:21:55 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:21:55.401+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:21:55.583 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:55 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5[65851]: 2026-02-24T09:21:55.314+0000 7fa00c05b640 -1 osd.5 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.617863+0000 front 2026-02-24T09:21:28.617878+0000 (oldest deadline 2026-02-24T09:21:54.517961+0000) 2026-02-24T09:21:55.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:21:55 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:21:55.281+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:21:56.214 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:55 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:55.951+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:21:56.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:21:56 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:21:56.010+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:21:56.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:21:56 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:21:56.261+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:21:56.833 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:56 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5[65851]: 2026-02-24T09:21:56.334+0000 7fa00c05b640 -1 osd.5 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.617863+0000 front 2026-02-24T09:21:28.617878+0000 (oldest deadline 2026-02-24T09:21:54.517961+0000) 2026-02-24T09:21:56.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:21:56 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:21:56.415+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:21:56.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:21:56 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:21:56.434+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:21:57.214 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:56 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:56.931+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:21:57.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:21:57 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:21:57.035+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:21:57.582 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:21:57 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:21:57.473+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:21:57.583 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:57 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5[65851]: 2026-02-24T09:21:57.308+0000 7fa00c05b640 -1 osd.5 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.617863+0000 front 2026-02-24T09:21:28.617878+0000 (oldest deadline 2026-02-24T09:21:54.517961+0000) 2026-02-24T09:21:57.583 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:21:57 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:21:57.463+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:21:57.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:21:57 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:21:57.238+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:21:58.214 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:57 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:57.935+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:21:58.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:21:58 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:21:58.027+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:21:58.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:21:58 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:21:58.027+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:21:58.582 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:58 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5[65851]: 2026-02-24T09:21:58.302+0000 7fa00c05b640 -1 osd.5 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.617863+0000 front 2026-02-24T09:21:28.617878+0000 (oldest deadline 2026-02-24T09:21:54.517961+0000) 2026-02-24T09:21:58.583 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:21:58 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:21:58.420+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:21:58.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:21:58 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:21:58.507+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:21:58.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:21:58 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:21:58.258+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:21:58.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:21:58 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:21:58.258+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:21:59.234 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:58 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:58.969+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:21:59.234 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:58 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:58.969+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.841415+0000 front 2026-02-24T09:21:35.841498+0000 (oldest deadline 2026-02-24T09:21:58.141446+0000) 2026-02-24T09:21:59.294 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:58 trial090 podman[105769]: 2026-02-24 09:21:58.982821514 +0000 UTC m=+5.102427885 container died 756fef11b74771d930534b4670283b6b2154275d99f7dbeb63e3b25658fa5404 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.build-date=20260223, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default) 2026-02-24T09:21:59.294 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:58 trial090 podman[105769]: 2026-02-24 09:21:58.991620507 +0000 UTC m=+5.111226878 container remove 756fef11b74771d930534b4670283b6b2154275d99f7dbeb63e3b25658fa5404 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, org.label-schema.build-date=20260223, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T09:21:59.294 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:58 trial090 bash[105769]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5 2026-02-24T09:21:59.294 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:59 trial090 podman[105899]: 2026-02-24 09:21:59.137751608 +0000 UTC m=+0.014660090 container create 77771c66f7c2e67441dc609b40d6c49e5260f2ed80a0868633d8e0e080aa989a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5-deactivate, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:21:59.295 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:59 trial090 podman[105899]: 2026-02-24 09:21:59.172212075 +0000 UTC m=+0.049120557 container init 77771c66f7c2e67441dc609b40d6c49e5260f2ed80a0868633d8e0e080aa989a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223) 2026-02-24T09:21:59.295 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:59 trial090 podman[105899]: 2026-02-24 09:21:59.174552853 +0000 UTC m=+0.051461335 container start 77771c66f7c2e67441dc609b40d6c49e5260f2ed80a0868633d8e0e080aa989a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5-deactivate, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS) 2026-02-24T09:21:59.295 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:59 trial090 podman[105899]: 2026-02-24 09:21:59.174959868 +0000 UTC m=+0.051868351 container attach 77771c66f7c2e67441dc609b40d6c49e5260f2ed80a0868633d8e0e080aa989a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:21:59.295 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:59 trial090 podman[105899]: 2026-02-24 09:21:59.131498194 +0000 UTC m=+0.008406676 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:21:59.295 INFO:journalctl@ceph.osd.5.trial090.stdout:Feb 24 09:21:59 trial090 podman[105899]: 2026-02-24 09:21:59.293032024 +0000 UTC m=+0.169940506 container died 77771c66f7c2e67441dc609b40d6c49e5260f2ed80a0868633d8e0e080aa989a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-5-deactivate, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:21:59.325 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.5.service' 2026-02-24T09:21:59.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:21:59 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:21:59.076+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:21:59.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:21:59 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:21:59.076+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:21:59.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:21:59.362 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-24T09:21:59.362 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-24T09:21:59.362 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.6 2026-02-24T09:21:59.582 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:21:59 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:21:59.391+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:21:59.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:21:59 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:21:59.512+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:21:59.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:21:59 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:21:59.512+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:21:59.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:21:59 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:21:59.231+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:21:59.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:21:59 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:21:59.231+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:21:59.714 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:59 trial004 systemd[1]: Stopping Ceph osd.6 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:21:59.714 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:59 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:59.462+0000 7f67184df640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:21:59.714 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:59 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:59.462+0000 7f67184df640 -1 osd.6 82 *** Got signal Terminated *** 2026-02-24T09:21:59.714 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:59 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:59.463+0000 7f67184df640 -1 osd.6 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:22:00.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:00 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:00.069+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:00.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:00 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:00.069+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:00.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:00 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:00.183+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:00.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:00 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:00.183+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:00.464 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:59 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:59.989+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:22:00.464 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:21:59 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:21:59.989+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.841415+0000 front 2026-02-24T09:21:35.841498+0000 (oldest deadline 2026-02-24T09:21:58.141446+0000) 2026-02-24T09:22:00.832 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:00 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:00.386+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:00.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:00 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:00.505+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:00.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:00 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:00.505+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:01.214 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:00 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:22:00.949+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:22:01.214 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:00 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:22:00.949+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.841415+0000 front 2026-02-24T09:21:35.841498+0000 (oldest deadline 2026-02-24T09:21:58.141446+0000) 2026-02-24T09:22:01.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:01 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:01.093+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:01.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:01 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:01.093+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:01.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:01 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:01.219+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:01.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:01 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:01.219+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:01.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:01 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:01.396+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:01.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:01 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:01.458+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:01.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:01 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:01.458+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:02.081 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:01 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:01.628+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.340158+0000 front 2026-02-24T09:21:35.340166+0000 (oldest deadline 2026-02-24T09:22:01.240244+0000) 2026-02-24T09:22:02.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:02 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:02.081+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:02.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:02 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:02.081+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:02.464 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:01 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:22:01.966+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:22:02.464 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:01 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:22:01.966+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.841415+0000 front 2026-02-24T09:21:35.841498+0000 (oldest deadline 2026-02-24T09:21:58.141446+0000) 2026-02-24T09:22:02.465 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:02 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:02.192+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:02.465 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:02 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:02.192+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:02.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:02 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:02.442+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:02.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:02 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:02.434+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:02.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:02 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:02.434+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:03.063 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:02 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:02.643+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.340158+0000 front 2026-02-24T09:21:35.340166+0000 (oldest deadline 2026-02-24T09:22:01.240244+0000) 2026-02-24T09:22:03.063 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:02 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:02.643+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.240441+0000 front 2026-02-24T09:21:41.240560+0000 (oldest deadline 2026-02-24T09:22:02.340528+0000) 2026-02-24T09:22:03.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:03 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:03.062+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:03.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:03 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:03.062+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:03.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:03 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:03.205+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:03.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:03 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:03.205+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:03.465 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:02 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:22:02.981+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:22:03.465 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:02 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:22:02.981+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.841415+0000 front 2026-02-24T09:21:35.841498+0000 (oldest deadline 2026-02-24T09:21:58.141446+0000) 2026-02-24T09:22:03.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:03 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:03.461+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:03.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:03 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:03.461+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:03.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:03 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:03.423+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:03.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:03 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:03.423+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:03.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:03 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:03.423+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:04.092 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:03 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:03.632+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.340158+0000 front 2026-02-24T09:21:35.340166+0000 (oldest deadline 2026-02-24T09:22:01.240244+0000) 2026-02-24T09:22:04.093 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:03 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:03.632+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.240441+0000 front 2026-02-24T09:21:41.240560+0000 (oldest deadline 2026-02-24T09:22:02.340528+0000) 2026-02-24T09:22:04.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:04 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:04.092+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:04.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:04 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:04.092+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:04.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:04 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:04.092+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:04.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:04 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:04.177+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:04.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:04 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:04.177+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:04.465 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:22:04.018+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.440710+0000 front 2026-02-24T09:21:29.440742+0000 (oldest deadline 2026-02-24T09:21:53.540810+0000) 2026-02-24T09:22:04.465 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:22:04.018+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.841415+0000 front 2026-02-24T09:21:35.841498+0000 (oldest deadline 2026-02-24T09:21:58.141446+0000) 2026-02-24T09:22:04.465 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6[85800]: 2026-02-24T09:22:04.018+0000 7f6714ba7640 -1 osd.6 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:38.141632+0000 front 2026-02-24T09:21:38.141649+0000 (oldest deadline 2026-02-24T09:22:03.941875+0000) 2026-02-24T09:22:04.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:04 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:04.476+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:04.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:04 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:04.476+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:04.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:04 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:04.416+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:04.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:04 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:04.416+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:04.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:04 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:04.416+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:04.856 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 podman[152442]: 2026-02-24 09:22:04.553602335 +0000 UTC m=+5.102515376 container died dd5f5332a8efe4e8b59514f9ab684121809d3a5b3ca0c90f5f4f739ec432ab9a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, OSD_FLAVOR=default, io.buildah.version=1.41.3) 2026-02-24T09:22:04.856 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 podman[152442]: 2026-02-24 09:22:04.562490948 +0000 UTC m=+5.111403999 container remove dd5f5332a8efe4e8b59514f9ab684121809d3a5b3ca0c90f5f4f739ec432ab9a (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:22:04.856 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 bash[152442]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6 2026-02-24T09:22:04.856 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 podman[152568]: 2026-02-24 09:22:04.693316057 +0000 UTC m=+0.014846907 container create f823a46032b0b94b62d2a423ba0239719a5b53ddffd5f001b7997a640a9f3107 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:22:04.856 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 podman[152568]: 2026-02-24 09:22:04.725687829 +0000 UTC m=+0.047218689 container init f823a46032b0b94b62d2a423ba0239719a5b53ddffd5f001b7997a640a9f3107 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, OSD_FLAVOR=default, org.label-schema.build-date=20260223, io.buildah.version=1.41.3) 2026-02-24T09:22:04.857 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 podman[152568]: 2026-02-24 09:22:04.728319524 +0000 UTC m=+0.049850384 container start f823a46032b0b94b62d2a423ba0239719a5b53ddffd5f001b7997a640a9f3107 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6-deactivate, ceph=True, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:22:04.857 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 podman[152568]: 2026-02-24 09:22:04.72896257 +0000 UTC m=+0.050493420 container attach f823a46032b0b94b62d2a423ba0239719a5b53ddffd5f001b7997a640a9f3107 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.schema-version=1.0) 2026-02-24T09:22:04.857 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 podman[152568]: 2026-02-24 09:22:04.686987626 +0000 UTC m=+0.008518476 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:22:04.857 INFO:journalctl@ceph.osd.6.trial004.stdout:Feb 24 09:22:04 trial004 podman[152568]: 2026-02-24 09:22:04.853836098 +0000 UTC m=+0.175366968 container died f823a46032b0b94b62d2a423ba0239719a5b53ddffd5f001b7997a640a9f3107 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default) 2026-02-24T09:22:04.891 DEBUG:teuthology.orchestra.run.trial004:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.6.service' 2026-02-24T09:22:04.930 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:04.931 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-24T09:22:04.931 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-24T09:22:04.931 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.7 2026-02-24T09:22:04.954 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:04 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:04.658+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.340158+0000 front 2026-02-24T09:21:35.340166+0000 (oldest deadline 2026-02-24T09:22:01.240244+0000) 2026-02-24T09:22:04.955 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:04 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:04.658+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.240441+0000 front 2026-02-24T09:21:41.240560+0000 (oldest deadline 2026-02-24T09:22:02.340528+0000) 2026-02-24T09:22:05.343 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:04 trial014 systemd[1]: Stopping Ceph osd.7 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:05.344 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:05 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:05.032+0000 7ffb967b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:22:05.344 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:05 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:05.032+0000 7ffb967b3640 -1 osd.7 82 *** Got signal Terminated *** 2026-02-24T09:22:05.344 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:05 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:05.032+0000 7ffb967b3640 -1 osd.7 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:22:05.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:05 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:05.062+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:05.345 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:05 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:05.062+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:05.345 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:05 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:05.062+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:05.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:05 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:05.214+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:05.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:05 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:05.214+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:05.715 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:05 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:05.214+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:05.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:05 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:05.484+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:05.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:05 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:05.484+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:05.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:05 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:05.417+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:05.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:05 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:05.417+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:05.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:05 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:05.417+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:06.093 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:05 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:05.653+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.340158+0000 front 2026-02-24T09:21:35.340166+0000 (oldest deadline 2026-02-24T09:22:01.240244+0000) 2026-02-24T09:22:06.094 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:05 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:05.653+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.240441+0000 front 2026-02-24T09:21:41.240560+0000 (oldest deadline 2026-02-24T09:22:02.340528+0000) 2026-02-24T09:22:06.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:06 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:06.191+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:06.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:06 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:06.191+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:06.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:06 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:06.191+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:06.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:06 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:06.105+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:06.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:06 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:06.105+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:06.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:06 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:06.105+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:06.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:06 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:06.443+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:06.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:06 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:06.443+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:06.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:06 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:06.403+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:06.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:06 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:06.403+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:06.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:06 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:06.403+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:07.093 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:06 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:06.669+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.340158+0000 front 2026-02-24T09:21:35.340166+0000 (oldest deadline 2026-02-24T09:22:01.240244+0000) 2026-02-24T09:22:07.093 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:06 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:06.669+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.240441+0000 front 2026-02-24T09:21:41.240560+0000 (oldest deadline 2026-02-24T09:22:02.340528+0000) 2026-02-24T09:22:07.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:07 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:07.200+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:07.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:07 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:07.200+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:07.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:07 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:07.200+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:07.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:07 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:07.098+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:07.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:07 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:07.098+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:07.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:07 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:07.098+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:07.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:07 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:07.401+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:07.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:07 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:07.401+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:07.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:07 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:07.355+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:07.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:07 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:07.355+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:07.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:07 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:07.355+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:08.093 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:07 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:07.693+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.340158+0000 front 2026-02-24T09:21:35.340166+0000 (oldest deadline 2026-02-24T09:22:01.240244+0000) 2026-02-24T09:22:08.093 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:07 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:07.693+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.240441+0000 front 2026-02-24T09:21:41.240560+0000 (oldest deadline 2026-02-24T09:22:02.340528+0000) 2026-02-24T09:22:08.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:08 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:08.185+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:08.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:08 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:08.185+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:08.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:08 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:08.185+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:08.583 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:08 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:08.363+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:08.583 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:08 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:08.363+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:08.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:08 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:08.320+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:08.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:08 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:08.320+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:08.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:08 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:08.320+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:08.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:08 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:08.119+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:08.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:08 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:08.119+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:08.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:08 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:08.119+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:09.093 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:08 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:08.693+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.340158+0000 front 2026-02-24T09:21:35.340166+0000 (oldest deadline 2026-02-24T09:22:01.240244+0000) 2026-02-24T09:22:09.093 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:08 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:08.693+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.240441+0000 front 2026-02-24T09:21:41.240560+0000 (oldest deadline 2026-02-24T09:22:02.340528+0000) 2026-02-24T09:22:09.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:09 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:09.102+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:09.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:09 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:09.102+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:09.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:09 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:09.102+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:09.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:09 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:09.221+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:09.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:09 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:09.221+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:09.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:09 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:09.221+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:09.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:09 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:09.351+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:09.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:09 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:09.351+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:09.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:09 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:09.357+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:09.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:09 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:09.357+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:09.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:09 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:09.357+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:09.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:09 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:09.357+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:10.093 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:09 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:09.644+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.340158+0000 front 2026-02-24T09:21:35.340166+0000 (oldest deadline 2026-02-24T09:22:01.240244+0000) 2026-02-24T09:22:10.094 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:09 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:09.644+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.240441+0000 front 2026-02-24T09:21:41.240560+0000 (oldest deadline 2026-02-24T09:22:02.340528+0000) 2026-02-24T09:22:10.094 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:09 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7[76977]: 2026-02-24T09:22:09.644+0000 7ffb92e7b640 -1 osd.7 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:47.341656+0000 front 2026-02-24T09:21:47.341676+0000 (oldest deadline 2026-02-24T09:22:09.041670+0000) 2026-02-24T09:22:10.423 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:10 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:10.124+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:10.423 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:10 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:10.124+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:10.423 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:10 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:10.124+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:10.423 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:10 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:10.124+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:10.424 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:10 trial014 podman[103521]: 2026-02-24 09:22:10.132401543 +0000 UTC m=+5.112117011 container died 443bae0313081331734c4c882d5d8dd5a4dbb77b1bc6831731b1b5cbb6dd2d94 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:22:10.424 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:10 trial014 podman[103521]: 2026-02-24 09:22:10.140636413 +0000 UTC m=+5.120351891 container remove 443bae0313081331734c4c882d5d8dd5a4dbb77b1bc6831731b1b5cbb6dd2d94 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2) 2026-02-24T09:22:10.424 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:10 trial014 bash[103521]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7 2026-02-24T09:22:10.424 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:10 trial014 podman[103650]: 2026-02-24 09:22:10.26320242 +0000 UTC m=+0.014960427 container create 9ee1f5d53aa23b32e14074674da1f35dab86cd140705d50764266ef4509f42cd (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.schema-version=1.0) 2026-02-24T09:22:10.424 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:10 trial014 podman[103650]: 2026-02-24 09:22:10.298425541 +0000 UTC m=+0.050183538 container init 9ee1f5d53aa23b32e14074674da1f35dab86cd140705d50764266ef4509f42cd (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7-deactivate, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:22:10.424 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:10 trial014 podman[103650]: 2026-02-24 09:22:10.301188027 +0000 UTC m=+0.052946034 container start 9ee1f5d53aa23b32e14074674da1f35dab86cd140705d50764266ef4509f42cd (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:22:10.425 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:10 trial014 podman[103650]: 2026-02-24 09:22:10.30172405 +0000 UTC m=+0.053482057 container attach 9ee1f5d53aa23b32e14074674da1f35dab86cd140705d50764266ef4509f42cd (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, ceph=True) 2026-02-24T09:22:10.425 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:10 trial014 podman[103650]: 2026-02-24 09:22:10.256868169 +0000 UTC m=+0.008626176 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:22:10.425 INFO:journalctl@ceph.osd.7.trial014.stdout:Feb 24 09:22:10 trial014 podman[103650]: 2026-02-24 09:22:10.423178517 +0000 UTC m=+0.174936524 container died 9ee1f5d53aa23b32e14074674da1f35dab86cd140705d50764266ef4509f42cd (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:22:10.456 DEBUG:teuthology.orchestra.run.trial014:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.7.service' 2026-02-24T09:22:10.532 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:10.533 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-24T09:22:10.533 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-24T09:22:10.533 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.8 2026-02-24T09:22:10.570 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:10 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:10.377+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:10.570 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:10 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:10.377+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:10.570 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:10 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:10.309+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:10.570 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:10 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:10.309+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:10.570 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:10 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:10.309+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:10.570 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:10 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:10.309+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:10.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:10 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:10.219+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:10.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:10 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:10.219+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:10.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:10 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:10.219+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:10.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:10 trial090 systemd[1]: Stopping Ceph osd.8 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:10.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:10 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:10.624+0000 7efd275fb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:22:10.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:10 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:10.624+0000 7efd275fb640 -1 osd.8 82 *** Got signal Terminated *** 2026-02-24T09:22:10.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:10 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:10.624+0000 7efd275fb640 -1 osd.8 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:22:11.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:11 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:11.119+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:11.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:11 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:11.119+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:11.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:11 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:11.119+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:11.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:11 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:11.119+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:11.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:11 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:11.267+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:11.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:11 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:11.267+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:11.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:11 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:11.267+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:11.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:11 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:11.403+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:11.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:11 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:11.403+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:11.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:11 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:11.403+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.700900+0000 front 2026-02-24T09:21:46.700804+0000 (oldest deadline 2026-02-24T09:22:10.800847+0000) 2026-02-24T09:22:11.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:11 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:11.344+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:11.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:11 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:11.344+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:11.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:11 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:11.344+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:11.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:11 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:11.344+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:12.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:12 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:12.127+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:12.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:12 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:12.127+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:12.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:12 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:12.127+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:12.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:12 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:12.127+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:12.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:12 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:12.245+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:12.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:12 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:12.245+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:12.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:12 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:12.245+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:12.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:12 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:12.336+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:12.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:12 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:12.336+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:12.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:12 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:12.336+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:12.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:12 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:12.336+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:12.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:12 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:12.354+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:12.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:12 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:12.354+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:12.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:12 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:12.354+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.700900+0000 front 2026-02-24T09:21:46.700804+0000 (oldest deadline 2026-02-24T09:22:10.800847+0000) 2026-02-24T09:22:13.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:13 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:13.080+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:13.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:13 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:13.080+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:13.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:13 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:13.080+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:13.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:13 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:13.080+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:13.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:13 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:13.271+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:13.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:13 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:13.271+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:13.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:13 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:13.271+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:13.715 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:13 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:13.271+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.624802+0000 front 2026-02-24T09:21:46.624811+0000 (oldest deadline 2026-02-24T09:22:12.524906+0000) 2026-02-24T09:22:13.733 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:13 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:13.380+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:13.733 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:13 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:13.380+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:13.734 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:13 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:13.380+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.700900+0000 front 2026-02-24T09:21:46.700804+0000 (oldest deadline 2026-02-24T09:22:10.800847+0000) 2026-02-24T09:22:13.734 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:13 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:13.355+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:13.734 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:13 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:13.355+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:13.734 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:13 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:13.355+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:13.734 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:13 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:13.355+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:14.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:14 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:14.061+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:14.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:14 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:14.061+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:14.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:14 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:14.061+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:14.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:14 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:14.061+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:14.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:14 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:14.061+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:14.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:14 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:14.259+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:14.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:14 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:14.259+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:14.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:14 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:14.259+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:14.715 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:14 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:14.259+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.624802+0000 front 2026-02-24T09:21:46.624811+0000 (oldest deadline 2026-02-24T09:22:12.524906+0000) 2026-02-24T09:22:14.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:14 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:14.394+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:14.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:14 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:14.394+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:14.833 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:14 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:14.394+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.700900+0000 front 2026-02-24T09:21:46.700804+0000 (oldest deadline 2026-02-24T09:22:10.800847+0000) 2026-02-24T09:22:14.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:14 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:14.385+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:14.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:14 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:14.385+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:14.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:14 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:14.385+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:14.834 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:14 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:14.385+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:15.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:15 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:15.069+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:15.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:15 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:15.069+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:15.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:15 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:15.069+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:15.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:15 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:15.069+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:15.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:15 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:15.069+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:15.706 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:15.385+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.299155+0000 front 2026-02-24T09:21:28.299100+0000 (oldest deadline 2026-02-24T09:21:53.599189+0000) 2026-02-24T09:22:15.706 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:15.385+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:41.000145+0000 front 2026-02-24T09:21:41.000152+0000 (oldest deadline 2026-02-24T09:22:03.300231+0000) 2026-02-24T09:22:15.706 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:15.385+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.700900+0000 front 2026-02-24T09:21:46.700804+0000 (oldest deadline 2026-02-24T09:22:10.800847+0000) 2026-02-24T09:22:15.706 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8[78066]: 2026-02-24T09:22:15.385+0000 7efd1fcbb640 -1 osd.8 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:53.101269+0000 front 2026-02-24T09:21:53.101246+0000 (oldest deadline 2026-02-24T09:22:14.801272+0000) 2026-02-24T09:22:15.707 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:15 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:15.348+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:15.707 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:15 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:15.348+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:15.707 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:15 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:15.348+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:15.707 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:15 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:15.348+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:15.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:15 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:15.293+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:15.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:15 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:15.293+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:15.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:15 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:15.293+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:15.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:15 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:15.293+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.624802+0000 front 2026-02-24T09:21:46.624811+0000 (oldest deadline 2026-02-24T09:22:12.524906+0000) 2026-02-24T09:22:15.985 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 podman[106034]: 2026-02-24 09:22:15.70458649 +0000 UTC m=+5.091942941 container died ada8e37b5c808db74b1ec616914900048e1a7839365abb4f47cc5af9b0546acf (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, ceph=True) 2026-02-24T09:22:15.985 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 podman[106034]: 2026-02-24 09:22:15.713821212 +0000 UTC m=+5.101177653 container remove ada8e37b5c808db74b1ec616914900048e1a7839365abb4f47cc5af9b0546acf (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:22:15.986 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 bash[106034]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8 2026-02-24T09:22:15.986 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 podman[106171]: 2026-02-24 09:22:15.831828041 +0000 UTC m=+0.014542792 container create 1a2824c91c7bf421ba2b84b2eb98356d533430d9646b1257d5add6fa186c1c90 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8-deactivate, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.label-schema.build-date=20260223, CEPH_REF=wip-vshankar-testing-20260223.155722, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:22:15.986 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 podman[106171]: 2026-02-24 09:22:15.860829105 +0000 UTC m=+0.043543856 container init 1a2824c91c7bf421ba2b84b2eb98356d533430d9646b1257d5add6fa186c1c90 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8-deactivate, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T09:22:15.986 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 podman[106171]: 2026-02-24 09:22:15.863233531 +0000 UTC m=+0.045948282 container start 1a2824c91c7bf421ba2b84b2eb98356d533430d9646b1257d5add6fa186c1c90 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8-deactivate, OSD_FLAVOR=default, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0) 2026-02-24T09:22:15.986 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 podman[106171]: 2026-02-24 09:22:15.863767934 +0000 UTC m=+0.046482695 container attach 1a2824c91c7bf421ba2b84b2eb98356d533430d9646b1257d5add6fa186c1c90 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8-deactivate, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, OSD_FLAVOR=default) 2026-02-24T09:22:15.986 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 podman[106171]: 2026-02-24 09:22:15.825624539 +0000 UTC m=+0.008339300 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:22:15.986 INFO:journalctl@ceph.osd.8.trial090.stdout:Feb 24 09:22:15 trial090 podman[106171]: 2026-02-24 09:22:15.983314351 +0000 UTC m=+0.166029122 container died 1a2824c91c7bf421ba2b84b2eb98356d533430d9646b1257d5add6fa186c1c90 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-8-deactivate, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.41.3, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b) 2026-02-24T09:22:16.015 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.8.service' 2026-02-24T09:22:16.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:16.093 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-24T09:22:16.093 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-24T09:22:16.093 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.9 2026-02-24T09:22:16.343 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:16 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:16.082+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:16.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:16 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:16.082+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:16.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:16 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:16.082+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:16.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:16 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:16.082+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:16.344 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:16 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:16.082+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:16.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:16 trial004 systemd[1]: Stopping Ceph osd.9 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:16.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:16 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:16.185+0000 7fe566e81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:22:16.464 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:16 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:16.185+0000 7fe566e81640 -1 osd.9 82 *** Got signal Terminated *** 2026-02-24T09:22:16.465 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:16 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:16.185+0000 7fe566e81640 -1 osd.9 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:22:16.465 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:16 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:16.299+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:16.465 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:16 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:16.299+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:16.465 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:16 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:16.299+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:16.465 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:16 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:16.299+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.624802+0000 front 2026-02-24T09:21:46.624811+0000 (oldest deadline 2026-02-24T09:22:12.524906+0000) 2026-02-24T09:22:16.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:16 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:16.312+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:16.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:16 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:16.312+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:16.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:16 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:16.312+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:16.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:16 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:16.312+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:17.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:17 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:17.327+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:17.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:17 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:17.327+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:17.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:17 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:17.327+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:17.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:17 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:17.327+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:17.583 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:17 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:17.327+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:17.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:17 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:17.120+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:17.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:17 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:17.120+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:17.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:17 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:17.120+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:17.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:17 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:17.120+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:17.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:17 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:17.120+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:17.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:17 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:17.327+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:17.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:17 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:17.327+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:17.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:17 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:17.327+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:17.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:17 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:17.327+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.624802+0000 front 2026-02-24T09:21:46.624811+0000 (oldest deadline 2026-02-24T09:22:12.524906+0000) 2026-02-24T09:22:18.494 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:18 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:18.147+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:18.494 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:18 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:18.147+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:18.494 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:18 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:18.147+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:18.494 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:18 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:18.147+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:18.494 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:18 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:18.147+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:18.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:18 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:18.286+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:18.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:18 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:18.286+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:18.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:18 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:18.286+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:18.715 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:18 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:18.286+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.624802+0000 front 2026-02-24T09:21:46.624811+0000 (oldest deadline 2026-02-24T09:22:12.524906+0000) 2026-02-24T09:22:18.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:18 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:18.359+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:18.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:18 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:18.359+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:18.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:18 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:18.359+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:18.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:18 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:18.359+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:18.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:18 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:18.359+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:19.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:19 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:19.195+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:19.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:19 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:19.195+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:19.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:19 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:19.195+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:19.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:19 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:19.195+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:19.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:19 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:19.195+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:19.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:19 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:19.280+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:19.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:19 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:19.280+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:19.715 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:19 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:19.280+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:19.715 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:19 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:19.280+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.624802+0000 front 2026-02-24T09:21:46.624811+0000 (oldest deadline 2026-02-24T09:22:12.524906+0000) 2026-02-24T09:22:19.715 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:19 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:19.280+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.525114+0000 front 2026-02-24T09:21:52.525258+0000 (oldest deadline 2026-02-24T09:22:18.425139+0000) 2026-02-24T09:22:19.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:19 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:19.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:19.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:19 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:19.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:19.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:19 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:19.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:19.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:19 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:19.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:19.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:19 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:19.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:20.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:20.198+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:20.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:20.198+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:20.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:20.198+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:20.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:20.198+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:20.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:20 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:20.198+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:20.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:20 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:20.267+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:29.223153+0000 front 2026-02-24T09:21:29.223164+0000 (oldest deadline 2026-02-24T09:21:52.123318+0000) 2026-02-24T09:22:20.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:20 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:20.267+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:33.823812+0000 front 2026-02-24T09:21:33.824025+0000 (oldest deadline 2026-02-24T09:21:57.323893+0000) 2026-02-24T09:22:20.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:20 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:20.267+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:39.624469+0000 front 2026-02-24T09:21:39.624590+0000 (oldest deadline 2026-02-24T09:22:04.924438+0000) 2026-02-24T09:22:20.714 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:20 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:20.267+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.624802+0000 front 2026-02-24T09:21:46.624811+0000 (oldest deadline 2026-02-24T09:22:12.524906+0000) 2026-02-24T09:22:20.715 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:20 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:20.267+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.525114+0000 front 2026-02-24T09:21:52.525258+0000 (oldest deadline 2026-02-24T09:22:18.425139+0000) 2026-02-24T09:22:20.715 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:20 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9[97905]: 2026-02-24T09:22:20.267+0000 7fe563549640 -1 osd.9 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:58.425391+0000 front 2026-02-24T09:21:58.425470+0000 (oldest deadline 2026-02-24T09:22:20.125359+0000) 2026-02-24T09:22:20.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:20.387+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:20.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:20.387+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:20.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:20.387+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:20.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:20.387+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:20.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:20.387+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:20.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:20 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:20.387+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:21.577 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:21 trial004 podman[152699]: 2026-02-24 09:22:21.285617741 +0000 UTC m=+5.111726877 container died aedf49e11300c35d4e70ab93656d6987817eed01b28a4d0c575cbf717f8247d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223) 2026-02-24T09:22:21.577 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:21 trial004 podman[152699]: 2026-02-24 09:22:21.294958264 +0000 UTC m=+5.121067400 container remove aedf49e11300c35d4e70ab93656d6987817eed01b28a4d0c575cbf717f8247d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:22:21.577 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:21 trial004 bash[152699]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9 2026-02-24T09:22:21.577 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:21 trial004 podman[152840]: 2026-02-24 09:22:21.420294884 +0000 UTC m=+0.014590911 container create 1b986259b00ba04595d20fd2d68815967c25942da487c8bb2be482d8718015b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9-deactivate, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2) 2026-02-24T09:22:21.577 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:21 trial004 podman[152840]: 2026-02-24 09:22:21.447750372 +0000 UTC m=+0.042046399 container init 1b986259b00ba04595d20fd2d68815967c25942da487c8bb2be482d8718015b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9-deactivate, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, OSD_FLAVOR=default, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T09:22:21.578 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:21 trial004 podman[152840]: 2026-02-24 09:22:21.450260581 +0000 UTC m=+0.044556598 container start 1b986259b00ba04595d20fd2d68815967c25942da487c8bb2be482d8718015b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.label-schema.build-date=20260223) 2026-02-24T09:22:21.578 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:21 trial004 podman[152840]: 2026-02-24 09:22:21.450939874 +0000 UTC m=+0.045235911 container attach 1b986259b00ba04595d20fd2d68815967c25942da487c8bb2be482d8718015b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:22:21.578 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:21 trial004 podman[152840]: 2026-02-24 09:22:21.414267222 +0000 UTC m=+0.008563250 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:22:21.578 INFO:journalctl@ceph.osd.9.trial004.stdout:Feb 24 09:22:21 trial004 podman[152840]: 2026-02-24 09:22:21.575028503 +0000 UTC m=+0.169324530 container died 1b986259b00ba04595d20fd2d68815967c25942da487c8bb2be482d8718015b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-9-deactivate, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, ceph=True, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS) 2026-02-24T09:22:21.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:21 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:21.200+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:21.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:21 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:21.200+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:21.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:21 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:21.200+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:21.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:21 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:21.200+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:21.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:21 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:21.200+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:21.604 DEBUG:teuthology.orchestra.run.trial004:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.9.service' 2026-02-24T09:22:21.645 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:21.645 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-24T09:22:21.646 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-24T09:22:21.646 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.10 2026-02-24T09:22:21.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:21 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:21.399+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:21.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:21 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:21.399+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:21.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:21 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:21.399+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:21.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:21 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:21.399+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:21.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:21 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:21.399+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:21.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:21 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:21.399+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:22.093 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:21 trial014 systemd[1]: Stopping Ceph osd.10 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:22.093 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:21 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:21.738+0000 7f38947dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:22:22.093 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:21 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:21.738+0000 7f38947dc640 -1 osd.10 82 *** Got signal Terminated *** 2026-02-24T09:22:22.094 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:21 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:21.738+0000 7f38947dc640 -1 osd.10 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:22:22.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:22 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:22.202+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:22.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:22 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:22.202+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:22.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:22 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:22.202+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:22.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:22 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:22.202+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:22.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:22 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:22.202+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:22.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:22 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:22.202+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:56.199385+0000 front 2026-02-24T09:21:56.199408+0000 (oldest deadline 2026-02-24T09:22:22.099415+0000) 2026-02-24T09:22:22.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:22 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:22.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:22.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:22 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:22.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:22.832 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:22 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:22.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:22.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:22 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:22.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:22.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:22 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:22.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:22.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:22 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:22.354+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:23.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:23 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:23.206+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:23.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:23 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:23.206+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:23.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:23 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:23.206+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:23.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:23 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:23.206+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:23.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:23 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:23.206+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:23.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:23 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:23.206+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:56.199385+0000 front 2026-02-24T09:21:56.199408+0000 (oldest deadline 2026-02-24T09:22:22.099415+0000) 2026-02-24T09:22:23.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:23 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:23.404+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:23.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:23 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:23.404+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:23.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:23 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:23.404+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:23.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:23 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:23.404+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:23.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:23 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:23.404+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:23.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:23 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:23.404+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:24.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:24 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:24.254+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:24.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:24 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:24.254+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:24.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:24 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:24.254+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:24.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:24 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:24.254+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:24.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:24 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:24.254+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:24.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:24 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:24.254+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:56.199385+0000 front 2026-02-24T09:21:56.199408+0000 (oldest deadline 2026-02-24T09:22:22.099415+0000) 2026-02-24T09:22:24.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:24 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:24.439+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:24.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:24 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:24.439+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:24.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:24 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:24.439+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:24.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:24 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:24.439+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:24.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:24 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:24.439+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:24.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:24 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:24.439+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:25.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:25 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:25.262+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:25.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:25 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:25.262+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:25.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:25 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:25.262+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:25.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:25 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:25.262+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:25.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:25 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:25.262+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:25.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:25 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:25.262+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:56.199385+0000 front 2026-02-24T09:21:56.199408+0000 (oldest deadline 2026-02-24T09:22:22.099415+0000) 2026-02-24T09:22:25.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:25 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:25.477+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:25.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:25 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:25.477+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:25.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:25 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:25.477+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:25.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:25 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:25.477+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:25.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:25 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:25.477+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:25.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:25 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:25.477+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:26.593 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:26.279+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:28.296410+0000 front 2026-02-24T09:21:28.296391+0000 (oldest deadline 2026-02-24T09:21:52.396422+0000) 2026-02-24T09:22:26.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:26.279+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:35.296692+0000 front 2026-02-24T09:21:35.296700+0000 (oldest deadline 2026-02-24T09:21:57.596809+0000) 2026-02-24T09:22:26.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:26.279+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:42.197373+0000 front 2026-02-24T09:21:42.197429+0000 (oldest deadline 2026-02-24T09:22:03.297405+0000) 2026-02-24T09:22:26.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:26.279+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.098156+0000 front 2026-02-24T09:21:46.098032+0000 (oldest deadline 2026-02-24T09:22:09.598034+0000) 2026-02-24T09:22:26.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:26.279+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:52.798863+0000 front 2026-02-24T09:21:52.798875+0000 (oldest deadline 2026-02-24T09:22:13.899018+0000) 2026-02-24T09:22:26.594 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10[89809]: 2026-02-24T09:22:26.279+0000 7f3890ea4640 -1 osd.10 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:56.199385+0000 front 2026-02-24T09:21:56.199408+0000 (oldest deadline 2026-02-24T09:22:22.099415+0000) 2026-02-24T09:22:26.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:26 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:26.458+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:26.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:26 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:26.458+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:26.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:26 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:26.458+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:26.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:26 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:26.458+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:26.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:26 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:26.458+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:26.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:26 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:26.458+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:27.094 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 podman[103786]: 2026-02-24 09:22:26.817675538 +0000 UTC m=+5.090567441 container died 3a77890e646a552cf6ab04c306af79118604b309a1b0d7918dbce374b40532be (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T09:22:27.094 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 podman[103786]: 2026-02-24 09:22:26.82688863 +0000 UTC m=+5.099780533 container remove 3a77890e646a552cf6ab04c306af79118604b309a1b0d7918dbce374b40532be (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-vshankar-testing-20260223.155722, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3) 2026-02-24T09:22:27.094 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 bash[103786]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10 2026-02-24T09:22:27.095 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 podman[103918]: 2026-02-24 09:22:26.956797275 +0000 UTC m=+0.015103252 container create 31a673ddc8be3d7fb77c27e190dadc75f4436bcc11d2c6770fe5646696df17a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, io.buildah.version=1.41.3, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True) 2026-02-24T09:22:27.095 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 podman[103918]: 2026-02-24 09:22:26.985347107 +0000 UTC m=+0.043653074 container init 31a673ddc8be3d7fb77c27e190dadc75f4436bcc11d2c6770fe5646696df17a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.license=GPLv2) 2026-02-24T09:22:27.095 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 podman[103918]: 2026-02-24 09:22:26.987775234 +0000 UTC m=+0.046081211 container start 31a673ddc8be3d7fb77c27e190dadc75f4436bcc11d2c6770fe5646696df17a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10-deactivate, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3) 2026-02-24T09:22:27.095 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:26 trial014 podman[103918]: 2026-02-24 09:22:26.988292883 +0000 UTC m=+0.046598870 container attach 31a673ddc8be3d7fb77c27e190dadc75f4436bcc11d2c6770fe5646696df17a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-10-deactivate, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3) 2026-02-24T09:22:27.095 INFO:journalctl@ceph.osd.10.trial014.stdout:Feb 24 09:22:27 trial014 podman[103918]: 2026-02-24 09:22:26.950380731 +0000 UTC m=+0.008686719 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:22:27.139 DEBUG:teuthology.orchestra.run.trial014:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.10.service' 2026-02-24T09:22:27.176 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:27.176 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-24T09:22:27.177 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-24T09:22:27.177 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.11 2026-02-24T09:22:27.496 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:27 trial090 systemd[1]: Stopping Ceph osd.11 for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:27.496 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:27 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:27.274+0000 7f4bba549640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T09:22:27.496 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:27 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:27.274+0000 7f4bba549640 -1 osd.11 82 *** Got signal Terminated *** 2026-02-24T09:22:27.496 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:27 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:27.274+0000 7f4bba549640 -1 osd.11 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T09:22:27.496 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:27 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:27.494+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:27.497 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:27 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:27.494+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:27.497 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:27 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:27.494+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:27.497 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:27 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:27.494+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:27.497 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:27 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:27.494+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:27.497 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:27 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:27.494+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:28.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:28 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:28.457+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:28.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:28 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:28.457+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:28.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:28 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:28.457+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:28.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:28 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:28.457+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:28.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:28 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:28.457+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:28.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:28 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:28.457+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:29.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:29 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:29.484+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:29.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:29 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:29.484+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:29.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:29 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:29.484+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:29.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:29 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:29.484+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:29.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:29 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:29.484+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:29.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:29 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:29.484+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:30.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:30 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:30.493+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:30.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:30 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:30.493+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:30.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:30 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:30.493+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:30.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:30 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:30.493+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:30.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:30 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:30.493+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:30.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:30 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:30.493+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:31.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:31 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:31.499+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6806 osd.0 since back 2026-02-24T09:21:30.315391+0000 front 2026-02-24T09:21:30.315422+0000 (oldest deadline 2026-02-24T09:21:56.215440+0000) 2026-02-24T09:22:31.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:31 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:31.499+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6804 osd.1 since back 2026-02-24T09:21:36.215717+0000 front 2026-02-24T09:21:36.215672+0000 (oldest deadline 2026-02-24T09:21:58.515726+0000) 2026-02-24T09:22:31.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:31 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:31.499+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6804 osd.2 since back 2026-02-24T09:21:40.216095+0000 front 2026-02-24T09:21:40.216106+0000 (oldest deadline 2026-02-24T09:22:02.516238+0000) 2026-02-24T09:22:31.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:31 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:31.499+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.4:6814 osd.3 since back 2026-02-24T09:21:46.016775+0000 front 2026-02-24T09:21:46.016758+0000 (oldest deadline 2026-02-24T09:22:08.916731+0000) 2026-02-24T09:22:31.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:31 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:31.499+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.14:6812 osd.4 since back 2026-02-24T09:21:51.817161+0000 front 2026-02-24T09:21:51.817130+0000 (oldest deadline 2026-02-24T09:22:17.117151+0000) 2026-02-24T09:22:31.833 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:31 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11[90963]: 2026-02-24T09:22:31.499+0000 7f4bb6c11640 -1 osd.11 82 heartbeat_check: no reply from 10.20.193.90:6812 osd.5 since back 2026-02-24T09:21:57.117307+0000 front 2026-02-24T09:21:57.117295+0000 (oldest deadline 2026-02-24T09:22:20.017378+0000) 2026-02-24T09:22:32.649 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:32 trial090 podman[106308]: 2026-02-24 09:22:32.353956762 +0000 UTC m=+5.091686247 container died bb80b59d12b50edb272a08958bc7e3c2b9d6fda4cea2fad3755fd58b8cb4fb74 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:22:32.650 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:32 trial090 podman[106308]: 2026-02-24 09:22:32.362540756 +0000 UTC m=+5.100270251 container remove bb80b59d12b50edb272a08958bc7e3c2b9d6fda4cea2fad3755fd58b8cb4fb74 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:22:32.650 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:32 trial090 bash[106308]: ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11 2026-02-24T09:22:32.650 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:32 trial090 podman[106435]: 2026-02-24 09:22:32.483848384 +0000 UTC m=+0.016178840 container create d3d902e4e7c35f5cf7195c0cae0a9b485987dba981aa54c8d2d1f00cfb65ce38 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11-deactivate, CEPH_REF=wip-vshankar-testing-20260223.155722, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, ceph=True, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T09:22:32.650 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:32 trial090 podman[106435]: 2026-02-24 09:22:32.512876028 +0000 UTC m=+0.045206484 container init d3d902e4e7c35f5cf7195c0cae0a9b485987dba981aa54c8d2d1f00cfb65ce38 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11-deactivate, org.label-schema.build-date=20260223, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_REF=wip-vshankar-testing-20260223.155722, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3) 2026-02-24T09:22:32.650 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:32 trial090 podman[106435]: 2026-02-24 09:22:32.515299179 +0000 UTC m=+0.047629625 container start d3d902e4e7c35f5cf7195c0cae0a9b485987dba981aa54c8d2d1f00cfb65ce38 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11-deactivate, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20260223, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_REF=wip-vshankar-testing-20260223.155722) 2026-02-24T09:22:32.650 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:32 trial090 podman[106435]: 2026-02-24 09:22:32.515772438 +0000 UTC m=+0.048102914 container attach d3d902e4e7c35f5cf7195c0cae0a9b485987dba981aa54c8d2d1f00cfb65ce38 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11-deactivate, ceph=True, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-24T09:22:32.650 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:32 trial090 podman[106435]: 2026-02-24 09:22:32.477333975 +0000 UTC m=+0.009664451 image pull 5573ff5fc120a550aed6712c8783a21e81140d263396683ccc9b7b93d0a0a212 quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b 2026-02-24T09:22:32.650 INFO:journalctl@ceph.osd.11.trial090.stdout:Feb 24 09:22:32 trial090 podman[106435]: 2026-02-24 09:22:32.647625533 +0000 UTC m=+0.179955989 container died d3d902e4e7c35f5cf7195c0cae0a9b485987dba981aa54c8d2d1f00cfb65ce38 (image=quay.ceph.io/ceph-ci/ceph@sha256:28667c575151a7626506ba757029b876f28721d0b7f412ef6a600ac887b5901b, name=ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-osd-11-deactivate, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=5bc9a1ffc19df681248ece8c3c8c7191a571745b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260223, io.buildah.version=1.41.3, CEPH_REF=wip-vshankar-testing-20260223.155722, org.label-schema.schema-version=1.0) 2026-02-24T09:22:32.679 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@osd.11.service' 2026-02-24T09:22:32.716 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:32.717 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-24T09:22:32.717 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-24T09:22:32.717 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.a 2026-02-24T09:22:33.214 INFO:journalctl@ceph.mds.a.trial004.stdout:Feb 24 09:22:32 trial004 systemd[1]: Stopping Ceph mds.a for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:33.215 INFO:journalctl@ceph.mds.a.trial004.stdout:Feb 24 09:22:32 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-a[108838]: 2026-02-24T09:22:32.810+0000 7f419c95b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:33.215 INFO:journalctl@ceph.mds.a.trial004.stdout:Feb 24 09:22:32 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-a[108838]: 2026-02-24T09:22:32.810+0000 7f419c95b640 -1 mds.a *** got signal Terminated *** 2026-02-24T09:22:33.854 DEBUG:teuthology.orchestra.run.trial004:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.a.service' 2026-02-24T09:22:33.890 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:33.890 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-24T09:22:33.890 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-24T09:22:33.891 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.d 2026-02-24T09:22:34.214 INFO:journalctl@ceph.mds.d.trial004.stdout:Feb 24 09:22:33 trial004 systemd[1]: Stopping Ceph mds.d for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:34.215 INFO:journalctl@ceph.mds.d.trial004.stdout:Feb 24 09:22:34 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-d[107961]: 2026-02-24T09:22:34.017+0000 7f08ab1b4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:34.215 INFO:journalctl@ceph.mds.d.trial004.stdout:Feb 24 09:22:34 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-d[107961]: 2026-02-24T09:22:34.017+0000 7f08ab1b4640 -1 mds.d *** got signal Terminated *** 2026-02-24T09:22:35.062 DEBUG:teuthology.orchestra.run.trial004:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.d.service' 2026-02-24T09:22:35.097 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:35.097 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-24T09:22:35.097 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-24T09:22:35.098 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.g 2026-02-24T09:22:35.464 INFO:journalctl@ceph.mds.g.trial004.stdout:Feb 24 09:22:35 trial004 systemd[1]: Stopping Ceph mds.g for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:35.464 INFO:journalctl@ceph.mds.g.trial004.stdout:Feb 24 09:22:35 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-g[108500]: 2026-02-24T09:22:35.225+0000 7f499af36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:35.464 INFO:journalctl@ceph.mds.g.trial004.stdout:Feb 24 09:22:35 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-g[108500]: 2026-02-24T09:22:35.225+0000 7f499af36640 -1 mds.g *** got signal Terminated *** 2026-02-24T09:22:36.268 DEBUG:teuthology.orchestra.run.trial004:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.g.service' 2026-02-24T09:22:36.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:36.302 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-24T09:22:36.302 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-24T09:22:36.303 DEBUG:teuthology.orchestra.run.trial004:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.j 2026-02-24T09:22:36.464 INFO:journalctl@ceph.mds.j.trial004.stdout:Feb 24 09:22:36 trial004 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-j[107630]: 2026-02-24T09:22:36.427+0000 7f9e0c91b640 -1 mds.j *** got signal Terminated *** 2026-02-24T09:22:37.447 DEBUG:teuthology.orchestra.run.trial004:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.j.service' 2026-02-24T09:22:37.482 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:37.483 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-24T09:22:37.483 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-24T09:22:37.483 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.b 2026-02-24T09:22:37.843 INFO:journalctl@ceph.mds.b.trial014.stdout:Feb 24 09:22:37 trial014 systemd[1]: Stopping Ceph mds.b for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:37.843 INFO:journalctl@ceph.mds.b.trial014.stdout:Feb 24 09:22:37 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-b[99086]: 2026-02-24T09:22:37.577+0000 7f2ef6c7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:37.843 INFO:journalctl@ceph.mds.b.trial014.stdout:Feb 24 09:22:37 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-b[99086]: 2026-02-24T09:22:37.577+0000 7f2ef6c7b640 -1 mds.b *** got signal Terminated *** 2026-02-24T09:22:38.614 DEBUG:teuthology.orchestra.run.trial014:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.b.service' 2026-02-24T09:22:38.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:38.650 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-24T09:22:38.650 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-24T09:22:38.650 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.e 2026-02-24T09:22:38.843 INFO:journalctl@ceph.mds.e.trial014.stdout:Feb 24 09:22:38 trial014 systemd[1]: Stopping Ceph mds.e for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:38.844 INFO:journalctl@ceph.mds.e.trial014.stdout:Feb 24 09:22:38 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-e[98416]: 2026-02-24T09:22:38.779+0000 7f85ebc44640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:38.844 INFO:journalctl@ceph.mds.e.trial014.stdout:Feb 24 09:22:38 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-e[98416]: 2026-02-24T09:22:38.779+0000 7f85ebc44640 -1 mds.e *** got signal Terminated *** 2026-02-24T09:22:39.824 DEBUG:teuthology.orchestra.run.trial014:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.e.service' 2026-02-24T09:22:39.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:39.858 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-24T09:22:39.858 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-24T09:22:39.858 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.h 2026-02-24T09:22:40.093 INFO:journalctl@ceph.mds.h.trial014.stdout:Feb 24 09:22:39 trial014 systemd[1]: Stopping Ceph mds.h for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:40.093 INFO:journalctl@ceph.mds.h.trial014.stdout:Feb 24 09:22:39 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-h[98749]: 2026-02-24T09:22:39.986+0000 7f12990c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:40.094 INFO:journalctl@ceph.mds.h.trial014.stdout:Feb 24 09:22:39 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-h[98749]: 2026-02-24T09:22:39.986+0000 7f12990c7640 -1 mds.h *** got signal Terminated *** 2026-02-24T09:22:41.018 DEBUG:teuthology.orchestra.run.trial014:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.h.service' 2026-02-24T09:22:41.052 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:41.053 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-24T09:22:41.053 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-24T09:22:41.053 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.k 2026-02-24T09:22:41.343 INFO:journalctl@ceph.mds.k.trial014.stdout:Feb 24 09:22:41 trial014 systemd[1]: Stopping Ceph mds.k for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:41.344 INFO:journalctl@ceph.mds.k.trial014.stdout:Feb 24 09:22:41 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-k[98080]: 2026-02-24T09:22:41.182+0000 7f3a12d53640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:41.344 INFO:journalctl@ceph.mds.k.trial014.stdout:Feb 24 09:22:41 trial014 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-k[98080]: 2026-02-24T09:22:41.182+0000 7f3a12d53640 -1 mds.k *** got signal Terminated *** 2026-02-24T09:22:42.216 DEBUG:teuthology.orchestra.run.trial014:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.k.service' 2026-02-24T09:22:42.248 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:42.248 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-24T09:22:42.249 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-24T09:22:42.249 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.c 2026-02-24T09:22:42.583 INFO:journalctl@ceph.mds.c.trial090.stdout:Feb 24 09:22:42 trial090 systemd[1]: Stopping Ceph mds.c for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:42.583 INFO:journalctl@ceph.mds.c.trial090.stdout:Feb 24 09:22:42 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-c[101071]: 2026-02-24T09:22:42.351+0000 7fc5bf5a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:42.583 INFO:journalctl@ceph.mds.c.trial090.stdout:Feb 24 09:22:42 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-c[101071]: 2026-02-24T09:22:42.351+0000 7fc5bf5a3640 -1 mds.c *** got signal Terminated *** 2026-02-24T09:22:43.402 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.c.service' 2026-02-24T09:22:43.437 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:43.438 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-24T09:22:43.438 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-24T09:22:43.438 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.f 2026-02-24T09:22:43.574 INFO:journalctl@ceph.mds.f.trial090.stdout:Feb 24 09:22:43 trial090 systemd[1]: Stopping Ceph mds.f for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:43.833 INFO:journalctl@ceph.mds.f.trial090.stdout:Feb 24 09:22:43 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-f[100741]: 2026-02-24T09:22:43.571+0000 7f6f19a6b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:43.833 INFO:journalctl@ceph.mds.f.trial090.stdout:Feb 24 09:22:43 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-f[100741]: 2026-02-24T09:22:43.571+0000 7f6f19a6b640 -1 mds.f *** got signal Terminated *** 2026-02-24T09:22:44.618 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.f.service' 2026-02-24T09:22:44.652 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:44.652 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-24T09:22:44.652 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-24T09:22:44.653 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.i 2026-02-24T09:22:44.790 INFO:journalctl@ceph.mds.i.trial090.stdout:Feb 24 09:22:44 trial090 systemd[1]: Stopping Ceph mds.i for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:45.082 INFO:journalctl@ceph.mds.i.trial090.stdout:Feb 24 09:22:44 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-i[101407]: 2026-02-24T09:22:44.788+0000 7f7fc5a84640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:45.082 INFO:journalctl@ceph.mds.i.trial090.stdout:Feb 24 09:22:44 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-i[101407]: 2026-02-24T09:22:44.788+0000 7f7fc5a84640 -1 mds.i *** got signal Terminated *** 2026-02-24T09:22:45.833 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.i.service' 2026-02-24T09:22:45.866 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:45.867 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-24T09:22:45.867 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-24T09:22:45.867 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.l 2026-02-24T09:22:46.003 INFO:journalctl@ceph.mds.l.trial090.stdout:Feb 24 09:22:45 trial090 systemd[1]: Stopping Ceph mds.l for 19e0945d-1160-11f1-92cf-d404e6e7d460... 2026-02-24T09:22:46.333 INFO:journalctl@ceph.mds.l.trial090.stdout:Feb 24 09:22:46 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-l[100402]: 2026-02-24T09:22:46.001+0000 7f67be24c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-24T09:22:46.333 INFO:journalctl@ceph.mds.l.trial090.stdout:Feb 24 09:22:46 trial090 ceph-19e0945d-1160-11f1-92cf-d404e6e7d460-mds-l[100402]: 2026-02-24T09:22:46.001+0000 7f67be24c640 -1 mds.l *** got signal Terminated *** 2026-02-24T09:22:47.040 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19e0945d-1160-11f1-92cf-d404e6e7d460@mds.l.service' 2026-02-24T09:22:47.072 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T09:22:47.073 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-24T09:22:47.073 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 --force --keep-logs 2026-02-24T09:22:47.194 INFO:teuthology.orchestra.run.trial004.stdout:Deleting cluster with fsid: 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:22:49.048 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 --force --keep-logs 2026-02-24T09:22:49.166 INFO:teuthology.orchestra.run.trial014.stdout:Deleting cluster with fsid: 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:22:51.005 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 --force --keep-logs 2026-02-24T09:22:51.124 INFO:teuthology.orchestra.run.trial090.stdout:Deleting cluster with fsid: 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:22:52.989 DEBUG:teuthology.orchestra.run.trial004:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:22:53.019 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:22:53.047 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T09:22:53.075 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-24T09:22:53.078 DEBUG:teuthology.misc:Transferring archived files from trial004:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081/remote/trial004/crash 2026-02-24T09:22:53.079 DEBUG:teuthology.orchestra.run.trial004:> sudo tar c -f - -C /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/crash -- . 2026-02-24T09:22:53.102 INFO:teuthology.orchestra.run.trial004.stderr:tar: /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T09:22:53.102 INFO:teuthology.orchestra.run.trial004.stderr:tar: Error is not recoverable: exiting now 2026-02-24T09:22:53.105 DEBUG:teuthology.misc:Transferring archived files from trial014:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081/remote/trial014/crash 2026-02-24T09:22:53.106 DEBUG:teuthology.orchestra.run.trial014:> sudo tar c -f - -C /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/crash -- . 2026-02-24T09:22:53.131 INFO:teuthology.orchestra.run.trial014.stderr:tar: /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T09:22:53.131 INFO:teuthology.orchestra.run.trial014.stderr:tar: Error is not recoverable: exiting now 2026-02-24T09:22:53.133 DEBUG:teuthology.misc:Transferring archived files from trial090:/var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081/remote/trial090/crash 2026-02-24T09:22:53.135 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/crash -- . 2026-02-24T09:22:53.160 INFO:teuthology.orchestra.run.trial090.stderr:tar: /var/lib/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T09:22:53.160 INFO:teuthology.orchestra.run.trial090.stderr:tar: Error is not recoverable: exiting now 2026-02-24T09:22:53.161 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-24T09:22:53.162 DEBUG:teuthology.orchestra.run.trial004:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-24T09:22:53.188 INFO:tasks.cephadm:Compressing logs... 2026-02-24T09:22:53.189 DEBUG:teuthology.orchestra.run.trial004:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:22:53.230 DEBUG:teuthology.orchestra.run.trial014:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:22:53.232 DEBUG:teuthology.orchestra.run.trial090:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:22:53.252 INFO:teuthology.orchestra.run.trial004.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2026-02-24T09:22:53.252 INFO:teuthology.orchestra.run.trial004.stderr: --verbose -- /var/log/ceph/cephadm.log 2026-02-24T09:22:53.252 INFO:teuthology.orchestra.run.trial004.stderr:gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mon.a.log 2026-02-24T09:22:53.252 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.d.log 2026-02-24T09:22:53.252 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.j.log 2026-02-24T09:22:53.253 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.0.log 2026-02-24T09:22:53.253 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.3.log 2026-02-24T09:22:53.253 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.cephadm.log 2026-02-24T09:22:53.254 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.a.log 2026-02-24T09:22:53.254 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.g.log 2026-02-24T09:22:53.254 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.audit.log 2026-02-24T09:22:53.254 INFO:teuthology.orchestra.run.trial004.stderr: 84.2% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.cephadm.log.gz 2026-02-24T09:22:53.255 INFO:teuthology.orchestra.run.trial014.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-24T09:22:53.255 INFO:teuthology.orchestra.run.trial014.stderr:: No such file or directory 2026-02-24T09:22:53.255 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mgr.y.log 2026-02-24T09:22:53.255 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-volume.log 2026-02-24T09:22:53.255 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.b.log 2026-02-24T09:22:53.255 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.h.log 2026-02-24T09:22:53.255 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.6.log 2026-02-24T09:22:53.255 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mgr.x.log 2026-02-24T09:22:53.256 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.6.log: 94.9% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.j.log.gz 2026-02-24T09:22:53.256 INFO:teuthology.orchestra.run.trial004.stderr: 94.9% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.d.log.gz 2026-02-24T09:22:53.256 INFO:teuthology.orchestra.run.trial004.stderr:gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.log 2026-02-24T09:22:53.256 INFO:teuthology.orchestra.run.trial004.stderr: 94.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T09:22:53.256 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.9.log 2026-02-24T09:22:53.256 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.7.log 2026-02-24T09:22:53.256 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.cephadm.log 2026-02-24T09:22:53.256 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.h.log: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.7.log: 2026-02-24T09:22:53.256 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.10.log 2026-02-24T09:22:53.257 INFO:teuthology.orchestra.run.trial004.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.log: /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.9.log: 90.6% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.audit.log.gz 2026-02-24T09:22:53.257 INFO:teuthology.orchestra.run.trial004.stderr: 94.9% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.a.log.gz 2026-02-24T09:22:53.257 INFO:teuthology.orchestra.run.trial004.stderr: 86.3% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.log.gz 2026-02-24T09:22:53.257 INFO:teuthology.orchestra.run.trial004.stderr: 94.9% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.g.log.gz 2026-02-24T09:22:53.258 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.4.log 2026-02-24T09:22:53.258 INFO:teuthology.orchestra.run.trial014.stderr: 85.2% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.cephadm.log.gz 2026-02-24T09:22:53.258 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.audit.log 2026-02-24T09:22:53.258 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mon.b.log 2026-02-24T09:22:53.258 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-volume.log 2026-02-24T09:22:53.258 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.1.log 2026-02-24T09:22:53.258 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.log 2026-02-24T09:22:53.258 INFO:teuthology.orchestra.run.trial014.stderr: 91.8% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-24T09:22:53.258 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.k.log 2026-02-24T09:22:53.258 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.e.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:: No such file or directory 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.2.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.i.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mon.c.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.f.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.i.log: /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.5.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.cephadm.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.11.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.audit.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr: 85.2% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.cephadm.log.gz 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-volume.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mgr.z.log 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.k.log: /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.e.log: 90.8% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.audit.log.gz 2026-02-24T09:22:53.259 INFO:teuthology.orchestra.run.trial014.stderr: 86.3% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.log.gz 2026-02-24T09:22:53.260 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.l.log 2026-02-24T09:22:53.260 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.c.log 2026-02-24T09:22:53.260 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.log 2026-02-24T09:22:53.260 INFO:teuthology.orchestra.run.trial004.stderr: 93.9% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-volume.log.gz 2026-02-24T09:22:53.260 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.8.log 2026-02-24T09:22:53.260 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.log: 90.8% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.audit.log.gz 2026-02-24T09:22:53.261 INFO:teuthology.orchestra.run.trial014.stderr: 94.9% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.k.log.gz 2026-02-24T09:22:53.261 INFO:teuthology.orchestra.run.trial014.stderr: 94.9% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.e.log.gz 2026-02-24T09:22:53.261 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.8.log: 86.3% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph.log.gz 2026-02-24T09:22:53.262 INFO:teuthology.orchestra.run.trial014.stderr: 93.8% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-volume.log.gz 2026-02-24T09:22:53.262 INFO:teuthology.orchestra.run.trial090.stderr: 92.0% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-24T09:22:53.264 INFO:teuthology.orchestra.run.trial090.stderr: 93.8% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-volume.log.gz 2026-02-24T09:22:53.282 INFO:teuthology.orchestra.run.trial014.stderr: 94.5% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.h.log.gz 2026-02-24T09:22:53.285 INFO:teuthology.orchestra.run.trial014.stderr: 92.7% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.b.log.gz 2026-02-24T09:22:53.289 INFO:teuthology.orchestra.run.trial090.stderr: 92.9% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.c.log.gz 2026-02-24T09:22:53.294 INFO:teuthology.orchestra.run.trial090.stderr: 94.3% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.l.log.gz 2026-02-24T09:22:53.361 INFO:teuthology.orchestra.run.trial004.stderr: 90.5% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-24T09:22:53.414 INFO:teuthology.orchestra.run.trial014.stderr: 92.1% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mon.b.log.gz 2026-02-24T09:22:53.416 INFO:teuthology.orchestra.run.trial090.stderr: 92.0% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mon.c.log.gz 2026-02-24T09:22:53.440 INFO:teuthology.orchestra.run.trial090.stderr: 95.7% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.f.log.gz 2026-02-24T09:22:53.709 INFO:teuthology.orchestra.run.trial004.stderr: 90.5% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mon.a.log.gz 2026-02-24T09:22:55.186 INFO:teuthology.orchestra.run.trial090.stderr: 94.4% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-mds.i.log.gz 2026-02-24T09:23:10.677 INFO:teuthology.orchestra.run.trial004.stderr: 94.3% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.9.log.gz 2026-02-24T09:23:13.236 INFO:teuthology.orchestra.run.trial090.stderr: 94.4% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.8.log.gz 2026-02-24T09:23:14.322 INFO:teuthology.orchestra.run.trial090.stderr: 94.4% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.2.log.gz 2026-02-24T09:23:14.523 INFO:teuthology.orchestra.run.trial004.stderr: 94.3% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.6.log.gz 2026-02-24T09:23:15.565 INFO:teuthology.orchestra.run.trial014.stderr: 94.3% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.7.log.gz 2026-02-24T09:23:16.254 INFO:teuthology.orchestra.run.trial090.stderr: 94.4% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.11.log.gz 2026-02-24T09:23:16.831 INFO:teuthology.orchestra.run.trial014.stderr: 94.4% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.10.log.gz 2026-02-24T09:23:17.033 INFO:teuthology.orchestra.run.trial090.stderr: 94.4% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.5.log.gz 2026-02-24T09:23:17.035 INFO:teuthology.orchestra.run.trial090.stderr: 2026-02-24T09:23:17.035 INFO:teuthology.orchestra.run.trial090.stderr:real 0m23.787s 2026-02-24T09:23:17.035 INFO:teuthology.orchestra.run.trial090.stderr:user 1m25.935s 2026-02-24T09:23:17.035 INFO:teuthology.orchestra.run.trial090.stderr:sys 0m4.049s 2026-02-24T09:23:17.887 INFO:teuthology.orchestra.run.trial014.stderr: 94.4% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.4.log.gz 2026-02-24T09:23:18.177 INFO:teuthology.orchestra.run.trial004.stderr: 94.3% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.0.log.gz 2026-02-24T09:23:18.720 INFO:teuthology.orchestra.run.trial004.stderr: 94.3% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.3.log.gz 2026-02-24T09:23:18.722 INFO:teuthology.orchestra.run.trial004.stderr: 2026-02-24T09:23:18.722 INFO:teuthology.orchestra.run.trial004.stderr:real 0m25.478s 2026-02-24T09:23:18.722 INFO:teuthology.orchestra.run.trial004.stderr:user 1m25.386s 2026-02-24T09:23:18.722 INFO:teuthology.orchestra.run.trial004.stderr:sys 0m4.106s 2026-02-24T09:23:18.841 INFO:teuthology.orchestra.run.trial014.stderr: 94.3% -- replaced with /var/log/ceph/19e0945d-1160-11f1-92cf-d404e6e7d460/ceph-osd.1.log.gz 2026-02-24T09:23:18.842 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T09:23:18.842 INFO:teuthology.orchestra.run.trial014.stderr:real 0m25.596s 2026-02-24T09:23:18.843 INFO:teuthology.orchestra.run.trial014.stderr:user 1m31.793s 2026-02-24T09:23:18.843 INFO:teuthology.orchestra.run.trial014.stderr:sys 0m4.336s 2026-02-24T09:23:18.844 INFO:tasks.cephadm:Archiving logs... 2026-02-24T09:23:18.844 DEBUG:teuthology.misc:Transferring archived files from trial004:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081/remote/trial004/log 2026-02-24T09:23:18.846 DEBUG:teuthology.orchestra.run.trial004:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T09:23:25.123 DEBUG:teuthology.misc:Transferring archived files from trial014:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081/remote/trial014/log 2026-02-24T09:23:25.123 DEBUG:teuthology.orchestra.run.trial014:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T09:23:31.794 DEBUG:teuthology.misc:Transferring archived files from trial090:/var/log/ceph to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081/remote/trial090/log 2026-02-24T09:23:31.795 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T09:23:38.139 INFO:tasks.cephadm:Removing cluster... 2026-02-24T09:23:38.139 DEBUG:teuthology.orchestra.run.trial004:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 --force 2026-02-24T09:23:38.257 INFO:teuthology.orchestra.run.trial004.stdout:Deleting cluster with fsid: 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:23:38.598 DEBUG:teuthology.orchestra.run.trial014:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 --force 2026-02-24T09:23:38.716 INFO:teuthology.orchestra.run.trial014.stdout:Deleting cluster with fsid: 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:23:39.035 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19e0945d-1160-11f1-92cf-d404e6e7d460 --force 2026-02-24T09:23:39.152 INFO:teuthology.orchestra.run.trial090.stdout:Deleting cluster with fsid: 19e0945d-1160-11f1-92cf-d404e6e7d460 2026-02-24T09:23:39.467 INFO:tasks.cephadm:Removing cephadm ... 2026-02-24T09:23:39.467 DEBUG:teuthology.orchestra.run.trial004:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T09:23:39.485 DEBUG:teuthology.orchestra.run.trial014:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T09:23:39.503 DEBUG:teuthology.orchestra.run.trial090:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T09:23:39.520 INFO:tasks.cephadm:Teardown complete 2026-02-24T09:23:39.521 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T09:23:39.533 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T09:23:39.533 DEBUG:teuthology.orchestra.run.trial004:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T09:23:39.534 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T09:23:39.545 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T09:23:39.816 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T09:23:39.830 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T09:23:39.830 DEBUG:teuthology.orchestra.run.trial004:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:23:39.832 DEBUG:teuthology.orchestra.run.trial014:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:23:39.834 DEBUG:teuthology.orchestra.run.trial090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T09:23:39.846 INFO:teuthology.orchestra.run.trial004.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:23:39.848 INFO:teuthology.orchestra.run.trial014.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:23:39.851 INFO:teuthology.orchestra.run.trial090.stderr:bash: line 1: ntpq: command not found 2026-02-24T09:23:39.875 INFO:teuthology.orchestra.run.trial014.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:23:39.875 INFO:teuthology.orchestra.run.trial014.stdout:=============================================================================== 2026-02-24T09:23:39.875 INFO:teuthology.orchestra.run.trial014.stdout:^+ clover0.mattnordhoffdns.> 3 7 377 29 +1116us[+1108us] +/- 34ms 2026-02-24T09:23:39.875 INFO:teuthology.orchestra.run.trial014.stdout:^* frumentum-zeus.infra.fru> 2 7 377 28 -848us[ -855us] +/- 24ms 2026-02-24T09:23:39.875 INFO:teuthology.orchestra.run.trial014.stdout:^? owners.kjsl.com 2 7 6 346 +1691us[+1993us] +/- 40ms 2026-02-24T09:23:39.875 INFO:teuthology.orchestra.run.trial014.stdout:^- 24-111-79-186-dynamic.mi> 2 6 377 25 -193us[ -193us] +/- 91ms 2026-02-24T09:23:39.876 INFO:teuthology.orchestra.run.trial090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:23:39.876 INFO:teuthology.orchestra.run.trial090.stdout:=============================================================================== 2026-02-24T09:23:39.876 INFO:teuthology.orchestra.run.trial090.stdout:^+ 149.28.61.105.vultruserc> 3 6 377 32 -230us[ -246us] +/- 34ms 2026-02-24T09:23:39.876 INFO:teuthology.orchestra.run.trial090.stdout:^+ 155.248.196.28 2 7 377 33 -1045us[-1061us] +/- 49ms 2026-02-24T09:23:39.876 INFO:teuthology.orchestra.run.trial090.stdout:^* tara.castrovalva.org 2 6 377 23 +1164us[+1148us] +/- 31ms 2026-02-24T09:23:39.877 INFO:teuthology.orchestra.run.trial090.stdout:^+ 24-111-79-186-dynamic.mi> 2 6 377 31 +844us[ +828us] +/- 94ms 2026-02-24T09:23:39.882 INFO:teuthology.orchestra.run.trial004.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T09:23:39.882 INFO:teuthology.orchestra.run.trial004.stdout:=============================================================================== 2026-02-24T09:23:39.882 INFO:teuthology.orchestra.run.trial004.stdout:^* 38.45.64.130 2 7 377 30 -1247us[-1234us] +/- 18ms 2026-02-24T09:23:39.882 INFO:teuthology.orchestra.run.trial004.stdout:^- ntp3.radio-sunshine.org 2 6 377 30 +584us[ +584us] +/- 61ms 2026-02-24T09:23:39.882 INFO:teuthology.orchestra.run.trial004.stdout:^+ tara.castrovalva.org 2 6 377 31 +680us[ +693us] +/- 31ms 2026-02-24T09:23:39.882 INFO:teuthology.orchestra.run.trial004.stdout:^- ntp.maxhost.io 2 7 77 91 -685us[ -695us] +/- 55ms 2026-02-24T09:23:39.883 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T09:23:39.897 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T09:23:39.897 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T09:23:39.913 DEBUG:teuthology.orchestra.run.trial004:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T09:23:39.990 DEBUG:teuthology.orchestra.run.trial014:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T09:23:40.049 DEBUG:teuthology.orchestra.run.trial090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T09:23:40.108 DEBUG:teuthology.orchestra.run.trial004:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:23:40.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:23:40.137 DEBUG:teuthology.orchestra.run.trial014:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:23:40.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:23:40.166 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2026-02-24T09:23:40.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:23:40.194 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T09:23:40.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T09:23:40.273 INFO:teuthology.task.internal:Duration was 1334.635281 seconds 2026-02-24T09:23:40.273 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T09:23:40.291 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T09:23:40.291 DEBUG:teuthology.orchestra.run.trial004:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T09:23:40.294 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T09:23:40.296 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T09:23:40.330 INFO:teuthology.orchestra.run.trial004.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:23:40.333 INFO:teuthology.orchestra.run.trial014.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:23:40.334 INFO:teuthology.orchestra.run.trial090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T09:23:40.750 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T09:23:40.750 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial004.front.sepia.ceph.com 2026-02-24T09:23:40.750 DEBUG:teuthology.orchestra.run.trial004:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T09:23:40.809 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial014.front.sepia.ceph.com 2026-02-24T09:23:40.809 DEBUG:teuthology.orchestra.run.trial014:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T09:23:40.830 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial090.front.sepia.ceph.com 2026-02-24T09:23:40.831 DEBUG:teuthology.orchestra.run.trial090:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T09:23:40.851 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T09:23:40.852 DEBUG:teuthology.orchestra.run.trial004:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:23:40.854 DEBUG:teuthology.orchestra.run.trial014:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:23:40.873 DEBUG:teuthology.orchestra.run.trial090:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:23:41.566 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T09:23:41.567 DEBUG:teuthology.orchestra.run.trial004:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:23:41.569 DEBUG:teuthology.orchestra.run.trial014:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:23:41.572 DEBUG:teuthology.orchestra.run.trial090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T09:23:41.590 INFO:teuthology.orchestra.run.trial004.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:23:41.591 INFO:teuthology.orchestra.run.trial004.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:23:41.592 INFO:teuthology.orchestra.run.trial004.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:23:41.592 INFO:teuthology.orchestra.run.trial004.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T09:23:41.592 INFO:teuthology.orchestra.run.trial004.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T09:23:41.594 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:23:41.596 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:23:41.596 INFO:teuthology.orchestra.run.trial014.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:23:41.596 INFO:teuthology.orchestra.run.trial014.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T09:23:41.596 INFO:teuthology.orchestra.run.trial014.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T09:23:41.597 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T09:23:41.598 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T09:23:41.598 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T09:23:41.598 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T09:23:41.598 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T09:23:41.615 INFO:teuthology.orchestra.run.trial014.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T09:23:41.618 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T09:23:41.717 INFO:teuthology.orchestra.run.trial004.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 91.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T09:23:41.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T09:23:41.738 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T09:23:41.738 DEBUG:teuthology.orchestra.run.trial004:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T09:23:41.784 DEBUG:teuthology.orchestra.run.trial014:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T09:23:41.810 DEBUG:teuthology.orchestra.run.trial090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T09:23:41.836 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T09:23:41.855 DEBUG:teuthology.orchestra.run.trial004:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:23:41.858 DEBUG:teuthology.orchestra.run.trial014:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:23:41.861 DEBUG:teuthology.orchestra.run.trial090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:23:41.882 INFO:teuthology.orchestra.run.trial004.stdout:kernel.core_pattern = core 2026-02-24T09:23:41.882 INFO:teuthology.orchestra.run.trial014.stdout:kernel.core_pattern = core 2026-02-24T09:23:41.900 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern = core 2026-02-24T09:23:41.916 DEBUG:teuthology.orchestra.run.trial004:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:23:41.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:23:41.957 DEBUG:teuthology.orchestra.run.trial014:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:23:41.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:23:41.972 DEBUG:teuthology.orchestra.run.trial090:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T09:23:41.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T09:23:41.989 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T09:23:42.010 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T09:23:42.011 DEBUG:teuthology.misc:Transferring archived files from trial004:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081/remote/trial004 2026-02-24T09:23:42.011 DEBUG:teuthology.orchestra.run.trial004:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T09:23:42.088 DEBUG:teuthology.misc:Transferring archived files from trial014:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081/remote/trial014 2026-02-24T09:23:42.088 DEBUG:teuthology.orchestra.run.trial014:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T09:23:42.127 DEBUG:teuthology.misc:Transferring archived files from trial090:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/vshankar-2026-02-24_05:06:44-fs-wip-vshankar-testing-20260223.155722-testing-default-trial/67081/remote/trial090 2026-02-24T09:23:42.127 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T09:23:42.167 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T09:23:42.167 DEBUG:teuthology.orchestra.run.trial004:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T09:23:42.170 DEBUG:teuthology.orchestra.run.trial014:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T09:23:42.172 DEBUG:teuthology.orchestra.run.trial090:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T09:23:42.214 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T09:23:42.232 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T09:23:42.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T09:23:42.250 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T09:23:42.251 DEBUG:teuthology.orchestra.run.trial004:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T09:23:42.253 DEBUG:teuthology.orchestra.run.trial014:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T09:23:42.256 DEBUG:teuthology.orchestra.run.trial090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T09:23:42.267 INFO:teuthology.orchestra.run.trial004.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 09:23 /home/ubuntu/cephtest 2026-02-24T09:23:42.271 INFO:teuthology.orchestra.run.trial014.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 09:23 /home/ubuntu/cephtest 2026-02-24T09:23:42.272 INFO:teuthology.orchestra.run.trial090.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 09:23 /home/ubuntu/cephtest 2026-02-24T09:23:42.273 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T09:23:42.284 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T09:23:42.320 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/iogen}} duration: 1334.635281085968 flavor: default owner: scheduled_vshankar@soko04.front.sepia.ceph.com success: true 2026-02-24T09:23:42.321 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T09:23:42.423 INFO:teuthology.run:pass